Skip to content

Commit

Permalink
update splade-pp-ed beir topics (castorini#2337)
Browse files Browse the repository at this point in the history 
add pre-encoded topic bindings for pyserini 2CR
remove -optimize flag to reduce runtime
  • Loading branch information
@justram
justram authored Jan 13, 2024
1 parent 47876e8 commit 53514b1
Show file tree
Hide file tree
Showing 60 changed files with 90 additions and 59 deletions.
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-arguana-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-arguana-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-arguana-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-arguana-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-bioasq-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-bioasq-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-bioasq-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-bioasq-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-climate-fever-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-climate-fever-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-climate-fever-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-climate-fever-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-cqadupstack-android-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-cqadupstack-android-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-cqadupstack-android-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-cqadupstack-android-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-cqadupstack-english-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-cqadupstack-english-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-cqadupstack-english-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-cqadupstack-english-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-cqadupstack-gaming-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-cqadupstack-gaming-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-cqadupstack-gaming-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-cqadupstack-gaming-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-cqadupstack-gis-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-cqadupstack-gis-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-cqadupstack-gis-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-cqadupstack-gis-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-cqadupstack-mathematica-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-cqadupstack-mathematica-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-cqadupstack-mathematica-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-cqadupstack-mathematica-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-cqadupstack-physics-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-cqadupstack-physics-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-cqadupstack-physics-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-cqadupstack-physics-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-cqadupstack-programmers-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-cqadupstack-programmers-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-cqadupstack-programmers-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-cqadupstack-programmers-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-cqadupstack-stats-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-cqadupstack-stats-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-cqadupstack-stats-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-cqadupstack-stats-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-cqadupstack-tex-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-cqadupstack-tex-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-cqadupstack-tex-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-cqadupstack-tex-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-cqadupstack-unix-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-cqadupstack-unix-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-cqadupstack-unix-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-cqadupstack-unix-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-cqadupstack-webmasters-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-cqadupstack-webmasters-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-cqadupstack-webmasters-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-cqadupstack-webmasters-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-cqadupstack-wordpress-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-cqadupstack-wordpress-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-cqadupstack-wordpress-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-cqadupstack-wordpress-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-dbpedia-entity-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-dbpedia-entity-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-dbpedia-entity-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-dbpedia-entity-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-fever-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-fever-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-fever-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-fever-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-fiqa-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-fiqa-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-fiqa-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-fiqa-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-hotpotqa-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-hotpotqa-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-hotpotqa-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-hotpotqa-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-nfcorpus-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-nfcorpus-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-nfcorpus-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-nfcorpus-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-nq-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-nq-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-nq-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-nq-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-quora-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-quora-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-quora-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-quora-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-robust04-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-robust04-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-robust04-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-robust04-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-scidocs-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-scidocs-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-scidocs-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-scidocs-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-scifact-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-scifact-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-scifact-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-scifact-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-signal1m-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-signal1m-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-signal1m-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-signal1m-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-trec-covid-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-trec-covid-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-trec-covid-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-trec-covid-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-trec-news-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-trec-news-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-trec-news-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-trec-news-splade-pp-ed &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-webis-touche2020-splade-pp-ed.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ target/appassembler/bin/IndexCollection \
-input /path/to/beir-v1.0.0-webis-touche2020-splade-pp-ed \
-generator DefaultLuceneDocumentGenerator \
-index indexes/lucene-index.beir-v1.0.0-webis-touche2020-splade-pp-ed/ \
-threads 16 -impact -pretokenized -optimize \
-threads 16 -impact -pretokenized \
>& logs/log.beir-v1.0.0-webis-touche2020-splade-pp-ed &
```

Expand Down
31 changes: 31 additions & 0 deletions src/main/java/io/anserini/search/topicreader/Topics.java
View file
Original file line number Diff line number Diff line change
Expand Up @@ -277,6 +277,37 @@ public enum Topics {
BEIR_V1_0_0_CLIMATE_FEVER_TEST_SPLADE_DISTILL_COCODENSER_MEDIUM(TsvStringTopicReader.class, "topics.beir-v1.0.0-climate-fever.test.splade_distil_cocodenser_medium.tsv.gz"),
BEIR_V1_0_0_SCIFACT_TEST_SPLADE_DISTILL_COCODENSER_MEDIUM(TsvStringTopicReader.class, "topics.beir-v1.0.0-scifact.test.splade_distil_cocodenser_medium.tsv.gz"),

// BEIR (v1.0.0): pre-encoded queries for SPLADE++ (CoCondenser-EnsembleDistil)
BEIR_V1_0_0_TREC_COVID_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-trec-covid.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_BIOASQ_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-bioasq.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_NFCORPUS_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-nfcorpus.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_NQ_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-nq.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_HOTPOTQA_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-hotpotqa.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_FIQA_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-fiqa.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_SIGNAL1M_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-signal1m.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_TREC_NEWS_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-trec-news.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_ROBUST04_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-robust04.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_ARGUANA_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-arguana.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_WEBIS_TOUCHE2020_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-webis-touche2020.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_CQADUPSTACK_ANDROID_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-cqadupstack-android.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_CQADUPSTACK_ENGLISH_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-cqadupstack-english.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_CQADUPSTACK_GAMING_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-cqadupstack-gaming.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_CQADUPSTACK_GIS_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-cqadupstack-gis.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_CQADUPSTACK_MATHEMATICA_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-cqadupstack-mathematica.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_CQADUPSTACK_PHYSICS_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-cqadupstack-physics.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_CQADUPSTACK_PROGRAMMERS_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-cqadupstack-programmers.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_CQADUPSTACK_STATS_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-cqadupstack-stats.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_CQADUPSTACK_TEX_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-cqadupstack-tex.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_CQADUPSTACK_UNIX_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-cqadupstack-unix.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_CQADUPSTACK_WEBMASTERS_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-cqadupstack-webmasters.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_CQADUPSTACK_WORDPRESS_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-cqadupstack-wordpress.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_QUORA_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-quora.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_DBPEDIA_ENTITY_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-dbpedia-entity.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_SCIDOCS_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-scidocs.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_FEVER_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-fever.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_CLIMATE_FEVER_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-climate-fever.test.splade-pp-ed.tsv.gz"),
BEIR_V1_0_0_SCIFACT_TEST_SPLADE_PP_ED(TsvStringTopicReader.class, "topics.beir-v1.0.0-scifact.test.splade-pp-ed.tsv.gz"),

// BEIR (v1.0.0): pre-encoded queries for uniCOIL-noexp
BEIR_V1_0_0_TREC_COVID_TEST_UNCOIL_NOEXP(TsvStringTopicReader.class, "topics.beir-v1.0.0-trec-covid.test.unicoil-noexp.tsv.gz"),
BEIR_V1_0_0_BIOASQ_TEST_UNCOIL_NOEXP(TsvStringTopicReader.class, "topics.beir-v1.0.0-bioasq.test.unicoil-noexp.tsv.gz"),
Expand Down
2 changes: 1 addition & 1 deletion src/main/resources/regression/beir-v1.0.0-arguana-splade-pp-ed.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ index_path: indexes/lucene-index.beir-v1.0.0-arguana-splade-pp-ed/
collection_class: JsonVectorCollection
generator_class: DefaultLuceneDocumentGenerator
index_threads: 16
index_options: -impact -pretokenized -optimize
index_options: -impact -pretokenized
index_stats:
documents: 8674
documents (non-empty): 8674
Expand Down
2 changes: 1 addition & 1 deletion src/main/resources/regression/beir-v1.0.0-bioasq-splade-pp-ed.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ index_path: indexes/lucene-index.beir-v1.0.0-bioasq-splade-pp-ed/
collection_class: JsonVectorCollection
generator_class: DefaultLuceneDocumentGenerator
index_threads: 16
index_options: -impact -pretokenized -optimize
index_options: -impact -pretokenized
index_stats:
documents: 14914603
documents (non-empty): 14914603
Expand Down
2 changes: 1 addition & 1 deletion src/main/resources/regression/beir-v1.0.0-climate-fever-splade-pp-ed.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ index_path: indexes/lucene-index.beir-v1.0.0-climate-fever-splade-pp-ed/
collection_class: JsonVectorCollection
generator_class: DefaultLuceneDocumentGenerator
index_threads: 16
index_options: -impact -pretokenized -optimize
index_options: -impact -pretokenized
index_stats:
documents: 5416593
documents (non-empty): 5416593
Expand Down
2 changes: 1 addition & 1 deletion src/main/resources/regression/beir-v1.0.0-cqadupstack-android-splade-pp-ed.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ index_path: indexes/lucene-index.beir-v1.0.0-cqadupstack-android-splade-pp-ed/
collection_class: JsonVectorCollection
generator_class: DefaultLuceneDocumentGenerator
index_threads: 16
index_options: -impact -pretokenized -optimize
index_options: -impact -pretokenized
index_stats:
documents: 22998
documents (non-empty): 22998
Expand Down
2 changes: 1 addition & 1 deletion src/main/resources/regression/beir-v1.0.0-cqadupstack-english-splade-pp-ed.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ index_path: indexes/lucene-index.beir-v1.0.0-cqadupstack-english-splade-pp-ed/
collection_class: JsonVectorCollection
generator_class: DefaultLuceneDocumentGenerator
index_threads: 16
index_options: -impact -pretokenized -optimize
index_options: -impact -pretokenized
index_stats:
documents: 40221
documents (non-empty): 40221
Expand Down
2 changes: 1 addition & 1 deletion src/main/resources/regression/beir-v1.0.0-cqadupstack-gaming-splade-pp-ed.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ index_path: indexes/lucene-index.beir-v1.0.0-cqadupstack-gaming-splade-pp-ed/
collection_class: JsonVectorCollection
generator_class: DefaultLuceneDocumentGenerator
index_threads: 16
index_options: -impact -pretokenized -optimize
index_options: -impact -pretokenized
index_stats:
documents: 45301
documents (non-empty): 45301
Expand Down
2 changes: 1 addition & 1 deletion src/main/resources/regression/beir-v1.0.0-cqadupstack-gis-splade-pp-ed.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ index_path: indexes/lucene-index.beir-v1.0.0-cqadupstack-gis-splade-pp-ed/
collection_class: JsonVectorCollection
generator_class: DefaultLuceneDocumentGenerator
index_threads: 16
index_options: -impact -pretokenized -optimize
index_options: -impact -pretokenized
index_stats:
documents: 37637
documents (non-empty): 37637
Expand Down
2 changes: 1 addition & 1 deletion src/main/resources/regression/beir-v1.0.0-cqadupstack-mathematica-splade-pp-ed.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ index_path: indexes/lucene-index.beir-v1.0.0-cqadupstack-mathematica-splade-pp-e
collection_class: JsonVectorCollection
generator_class: DefaultLuceneDocumentGenerator
index_threads: 16
index_options: -impact -pretokenized -optimize
index_options: -impact -pretokenized
index_stats:
documents: 16705
documents (non-empty): 16705
Expand Down
2 changes: 1 addition & 1 deletion src/main/resources/regression/beir-v1.0.0-cqadupstack-physics-splade-pp-ed.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ index_path: indexes/lucene-index.beir-v1.0.0-cqadupstack-physics-splade-pp-ed/
collection_class: JsonVectorCollection
generator_class: DefaultLuceneDocumentGenerator
index_threads: 16
index_options: -impact -pretokenized -optimize
index_options: -impact -pretokenized
index_stats:
documents: 38316
documents (non-empty): 38316
Expand Down
2 changes: 1 addition & 1 deletion src/main/resources/regression/beir-v1.0.0-cqadupstack-programmers-splade-pp-ed.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ index_path: indexes/lucene-index.beir-v1.0.0-cqadupstack-programmers-splade-pp-e
collection_class: JsonVectorCollection
generator_class: DefaultLuceneDocumentGenerator
index_threads: 16
index_options: -impact -pretokenized -optimize
index_options: -impact -pretokenized
index_stats:
documents: 32176
documents (non-empty): 32176
Expand Down
2 changes: 1 addition & 1 deletion src/main/resources/regression/beir-v1.0.0-cqadupstack-stats-splade-pp-ed.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ index_path: indexes/lucene-index.beir-v1.0.0-cqadupstack-stats-splade-pp-ed/
collection_class: JsonVectorCollection
generator_class: DefaultLuceneDocumentGenerator
index_threads: 16
index_options: -impact -pretokenized -optimize
index_options: -impact -pretokenized
index_stats:
documents: 42269
documents (non-empty): 42269
Expand Down
Loading

0 comments on commit 53514b1

Please sign in to comment.