Skip to content

Commit

Permalink
Fix paths for regressions (#2100)
Browse files Browse the repository at this point in the history 
src/main/resources/topics-and-qrels/ -> tools/topics-and-qrels/
  • Loading branch information
@lintool
lintool authored Apr 11, 2023
1 parent ca6b285 commit ed89401
Show file tree
Hide file tree
Showing 712 changed files with 4,545 additions and 5,279 deletions.
16 changes: 8 additions & 8 deletions docs/regressions-backgroundlinking18.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -43,21 +43,21 @@ After indexing has completed, you should be able to perform retrieval as follows
```
target/appassembler/bin/SearchCollection \
-index indexes/lucene-index.wapo.v2/ \
-topics src/main/resources/topics-and-qrels/topics.backgroundlinking18.txt \
-topics tools/topics-and-qrels/topics.backgroundlinking18.txt \
-topicreader BackgroundLinking \
-output runs/run.wapo.v2.bm25.topics.backgroundlinking18.txt \
-backgroundlinking -backgroundlinking.k 100 -bm25 -hits 100 &
target/appassembler/bin/SearchCollection \
-index indexes/lucene-index.wapo.v2/ \
-topics src/main/resources/topics-and-qrels/topics.backgroundlinking18.txt \
-topics tools/topics-and-qrels/topics.backgroundlinking18.txt \
-topicreader BackgroundLinking \
-output runs/run.wapo.v2.bm25+rm3.topics.backgroundlinking18.txt \
-backgroundlinking -backgroundlinking.k 100 -bm25 -rm3 -hits 100 &
target/appassembler/bin/SearchCollection \
-index indexes/lucene-index.wapo.v2/ \
-topics src/main/resources/topics-and-qrels/topics.backgroundlinking18.txt \
-topics tools/topics-and-qrels/topics.backgroundlinking18.txt \
-topicreader BackgroundLinking \
-output runs/run.wapo.v2.bm25+rm3+df.topics.backgroundlinking18.txt \
-backgroundlinking -backgroundlinking.datefilter -backgroundlinking.k 100 -bm25 -rm3 -hits 100 &
Expand All @@ -66,11 +66,11 @@ target/appassembler/bin/SearchCollection \
Evaluation can be performed using `trec_eval`:

```
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 src/main/resources/topics-and-qrels/qrels.backgroundlinking18.txt runs/run.wapo.v2.bm25.topics.backgroundlinking18.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking18.txt runs/run.wapo.v2.bm25.topics.backgroundlinking18.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 src/main/resources/topics-and-qrels/qrels.backgroundlinking18.txt runs/run.wapo.v2.bm25+rm3.topics.backgroundlinking18.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking18.txt runs/run.wapo.v2.bm25+rm3.topics.backgroundlinking18.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 src/main/resources/topics-and-qrels/qrels.backgroundlinking18.txt runs/run.wapo.v2.bm25+rm3+df.topics.backgroundlinking18.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking18.txt runs/run.wapo.v2.bm25+rm3+df.topics.backgroundlinking18.txt
```

## Effectiveness
Expand All @@ -79,7 +79,7 @@ With the above commands, you should be able to reproduce the following results:

| **MAP** | **BM25** | **+RM3** | **+RM3+DF**|
|:-------------------------------------------------------------------------------------------------------------|-----------|-----------|-----------|
| [TREC 2018 Topics](../src/main/resources/topics-and-qrels/topics.backgroundlinking18.txt) | 0.2490 | 0.2661 | 0.2679 |
| [TREC 2018 Topics](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking18.txt)| 0.2490 | 0.2661 | 0.2679 |
| **nDCG@5** | **BM25** | **+RM3** | **+RM3+DF**|
| [TREC 2018 Topics](../src/main/resources/topics-and-qrels/topics.backgroundlinking18.txt) | 0.3293 | 0.3436 | 0.4027 |
| [TREC 2018 Topics](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking18.txt)| 0.3293 | 0.3436 | 0.4027 |

16 changes: 8 additions & 8 deletions docs/regressions-backgroundlinking19.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -43,21 +43,21 @@ After indexing has completed, you should be able to perform retrieval as follows
```
target/appassembler/bin/SearchCollection \
-index indexes/lucene-index.wapo.v2/ \
-topics src/main/resources/topics-and-qrels/topics.backgroundlinking19.txt \
-topics tools/topics-and-qrels/topics.backgroundlinking19.txt \
-topicreader BackgroundLinking \
-output runs/run.wapo.v2.bm25.topics.backgroundlinking19.txt \
-backgroundlinking -backgroundlinking.k 100 -bm25 -hits 100 &
target/appassembler/bin/SearchCollection \
-index indexes/lucene-index.wapo.v2/ \
-topics src/main/resources/topics-and-qrels/topics.backgroundlinking19.txt \
-topics tools/topics-and-qrels/topics.backgroundlinking19.txt \
-topicreader BackgroundLinking \
-output runs/run.wapo.v2.bm25+rm3.topics.backgroundlinking19.txt \
-backgroundlinking -backgroundlinking.k 100 -bm25 -rm3 -hits 100 &
target/appassembler/bin/SearchCollection \
-index indexes/lucene-index.wapo.v2/ \
-topics src/main/resources/topics-and-qrels/topics.backgroundlinking19.txt \
-topics tools/topics-and-qrels/topics.backgroundlinking19.txt \
-topicreader BackgroundLinking \
-output runs/run.wapo.v2.bm25+rm3+df.topics.backgroundlinking19.txt \
-backgroundlinking -backgroundlinking.datefilter -backgroundlinking.k 100 -bm25 -rm3 -hits 100 &
Expand All @@ -66,11 +66,11 @@ target/appassembler/bin/SearchCollection \
Evaluation can be performed using `trec_eval`:

```
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 src/main/resources/topics-and-qrels/qrels.backgroundlinking19.txt runs/run.wapo.v2.bm25.topics.backgroundlinking19.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking19.txt runs/run.wapo.v2.bm25.topics.backgroundlinking19.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 src/main/resources/topics-and-qrels/qrels.backgroundlinking19.txt runs/run.wapo.v2.bm25+rm3.topics.backgroundlinking19.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking19.txt runs/run.wapo.v2.bm25+rm3.topics.backgroundlinking19.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 src/main/resources/topics-and-qrels/qrels.backgroundlinking19.txt runs/run.wapo.v2.bm25+rm3+df.topics.backgroundlinking19.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking19.txt runs/run.wapo.v2.bm25+rm3+df.topics.backgroundlinking19.txt
```

## Effectiveness
Expand All @@ -79,7 +79,7 @@ With the above commands, you should be able to reproduce the following results:

| **MAP** | **BM25** | **+RM3** | **+RM3+DF**|
|:-------------------------------------------------------------------------------------------------------------|-----------|-----------|-----------|
| [TREC 2019 Topics](../src/main/resources/topics-and-qrels/topics.backgroundlinking19.txt) | 0.3029 | 0.3787 | 0.3160 |
| [TREC 2019 Topics](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking19.txt)| 0.3029 | 0.3787 | 0.3160 |
| **nDCG@5** | **BM25** | **+RM3** | **+RM3+DF**|
| [TREC 2019 Topics](../src/main/resources/topics-and-qrels/topics.backgroundlinking19.txt) | 0.4785 | 0.5200 | 0.5018 |
| [TREC 2019 Topics](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking19.txt)| 0.4785 | 0.5200 | 0.5018 |

16 changes: 8 additions & 8 deletions docs/regressions-backgroundlinking20.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -43,21 +43,21 @@ After indexing has completed, you should be able to perform retrieval as follows
```
target/appassembler/bin/SearchCollection \
-index indexes/lucene-index.wapo.v3/ \
-topics src/main/resources/topics-and-qrels/topics.backgroundlinking20.txt \
-topics tools/topics-and-qrels/topics.backgroundlinking20.txt \
-topicreader BackgroundLinking \
-output runs/run.wapo.v3.bm25.topics.backgroundlinking20.txt \
-backgroundlinking -backgroundlinking.k 100 -bm25 -hits 100 &
target/appassembler/bin/SearchCollection \
-index indexes/lucene-index.wapo.v3/ \
-topics src/main/resources/topics-and-qrels/topics.backgroundlinking20.txt \
-topics tools/topics-and-qrels/topics.backgroundlinking20.txt \
-topicreader BackgroundLinking \
-output runs/run.wapo.v3.bm25+rm3.topics.backgroundlinking20.txt \
-backgroundlinking -backgroundlinking.k 100 -bm25 -rm3 -hits 100 &
target/appassembler/bin/SearchCollection \
-index indexes/lucene-index.wapo.v3/ \
-topics src/main/resources/topics-and-qrels/topics.backgroundlinking20.txt \
-topics tools/topics-and-qrels/topics.backgroundlinking20.txt \
-topicreader BackgroundLinking \
-output runs/run.wapo.v3.bm25+rm3+df.topics.backgroundlinking20.txt \
-backgroundlinking -backgroundlinking.datefilter -backgroundlinking.k 100 -bm25 -rm3 -hits 100 &
Expand All @@ -66,11 +66,11 @@ target/appassembler/bin/SearchCollection \
Evaluation can be performed using `trec_eval`:

```
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 src/main/resources/topics-and-qrels/qrels.backgroundlinking20.txt runs/run.wapo.v3.bm25.topics.backgroundlinking20.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking20.txt runs/run.wapo.v3.bm25.topics.backgroundlinking20.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 src/main/resources/topics-and-qrels/qrels.backgroundlinking20.txt runs/run.wapo.v3.bm25+rm3.topics.backgroundlinking20.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking20.txt runs/run.wapo.v3.bm25+rm3.topics.backgroundlinking20.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 src/main/resources/topics-and-qrels/qrels.backgroundlinking20.txt runs/run.wapo.v3.bm25+rm3+df.topics.backgroundlinking20.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking20.txt runs/run.wapo.v3.bm25+rm3+df.topics.backgroundlinking20.txt
```

## Effectiveness
Expand All @@ -79,7 +79,7 @@ With the above commands, you should be able to reproduce the following results:

| **MAP** | **BM25** | **+RM3** | **+RM3+DF**|
|:-------------------------------------------------------------------------------------------------------------|-----------|-----------|-----------|
| [TREC 2020 Topics](../src/main/resources/topics-and-qrels/topics.backgroundlinking20.txt) | 0.3286 | 0.4528 | 0.3438 |
| [TREC 2020 Topics](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking20.txt)| 0.3286 | 0.4528 | 0.3438 |
| **nDCG@5** | **BM25** | **+RM3** | **+RM3+DF**|
| [TREC 2020 Topics](../src/main/resources/topics-and-qrels/topics.backgroundlinking20.txt) | 0.5231 | 0.5696 | 0.5304 |
| [TREC 2020 Topics](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking20.txt)| 0.5231 | 0.5696 | 0.5304 |

8 changes: 4 additions & 4 deletions docs/regressions-beir-v1.0.0-arguana-flat-wp.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ After indexing has completed, you should be able to perform retrieval as follows
```
target/appassembler/bin/SearchCollection \
-index indexes/lucene-index.beir-v1.0.0-arguana-flat-wp/ \
-topics src/main/resources/topics-and-qrels/topics.beir-v1.0.0-arguana.test.wp.tsv.gz \
-topics tools/topics-and-qrels/topics.beir-v1.0.0-arguana.test.wp.tsv.gz \
-topicreader TsvString \
-output runs/run.beir-v1.0.0-arguana-flat-wp.bm25.topics.beir-v1.0.0-arguana.test.wp.txt \
-bm25 -removeQuery -pretokenized &
Expand All @@ -45,9 +45,9 @@ target/appassembler/bin/SearchCollection \
Evaluation can be performed using `trec_eval`:

```
tools/eval/trec_eval.9.0.4/trec_eval -c -m ndcg_cut.10 src/main/resources/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat-wp.bm25.topics.beir-v1.0.0-arguana.test.wp.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.100 src/main/resources/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat-wp.bm25.topics.beir-v1.0.0-arguana.test.wp.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.1000 src/main/resources/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat-wp.bm25.topics.beir-v1.0.0-arguana.test.wp.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m ndcg_cut.10 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat-wp.bm25.topics.beir-v1.0.0-arguana.test.wp.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.100 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat-wp.bm25.topics.beir-v1.0.0-arguana.test.wp.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.1000 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat-wp.bm25.topics.beir-v1.0.0-arguana.test.wp.txt
```

## Effectiveness
Expand Down
8 changes: 4 additions & 4 deletions docs/regressions-beir-v1.0.0-arguana-flat.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ After indexing has completed, you should be able to perform retrieval as follows
```
target/appassembler/bin/SearchCollection \
-index indexes/lucene-index.beir-v1.0.0-arguana-flat/ \
-topics src/main/resources/topics-and-qrels/topics.beir-v1.0.0-arguana.test.tsv.gz \
-topics tools/topics-and-qrels/topics.beir-v1.0.0-arguana.test.tsv.gz \
-topicreader TsvString \
-output runs/run.beir-v1.0.0-arguana-flat.bm25.topics.beir-v1.0.0-arguana.test.txt \
-bm25 -removeQuery -hits 1000 &
Expand All @@ -44,9 +44,9 @@ target/appassembler/bin/SearchCollection \
Evaluation can be performed using `trec_eval`:

```
tools/eval/trec_eval.9.0.4/trec_eval -c -m ndcg_cut.10 src/main/resources/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat.bm25.topics.beir-v1.0.0-arguana.test.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.100 src/main/resources/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat.bm25.topics.beir-v1.0.0-arguana.test.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.1000 src/main/resources/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat.bm25.topics.beir-v1.0.0-arguana.test.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m ndcg_cut.10 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat.bm25.topics.beir-v1.0.0-arguana.test.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.100 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat.bm25.topics.beir-v1.0.0-arguana.test.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.1000 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat.bm25.topics.beir-v1.0.0-arguana.test.txt
```

## Effectiveness
Expand Down
8 changes: 4 additions & 4 deletions docs/regressions-beir-v1.0.0-arguana-multifield.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ After indexing has completed, you should be able to perform retrieval as follows
```
target/appassembler/bin/SearchCollection \
-index indexes/lucene-index.beir-v1.0.0-arguana-multifield/ \
-topics src/main/resources/topics-and-qrels/topics.beir-v1.0.0-arguana.test.tsv.gz \
-topics tools/topics-and-qrels/topics.beir-v1.0.0-arguana.test.tsv.gz \
-topicreader TsvString \
-output runs/run.beir-v1.0.0-arguana-multifield.bm25.topics.beir-v1.0.0-arguana.test.txt \
-bm25 -removeQuery -hits 1000 -fields contents=1.0 title=1.0 &
Expand All @@ -45,9 +45,9 @@ target/appassembler/bin/SearchCollection \
Evaluation can be performed using `trec_eval`:

```
tools/eval/trec_eval.9.0.4/trec_eval -c -m ndcg_cut.10 src/main/resources/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-multifield.bm25.topics.beir-v1.0.0-arguana.test.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.100 src/main/resources/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-multifield.bm25.topics.beir-v1.0.0-arguana.test.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.1000 src/main/resources/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-multifield.bm25.topics.beir-v1.0.0-arguana.test.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m ndcg_cut.10 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-multifield.bm25.topics.beir-v1.0.0-arguana.test.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.100 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-multifield.bm25.topics.beir-v1.0.0-arguana.test.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.1000 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-multifield.bm25.topics.beir-v1.0.0-arguana.test.txt
```

## Effectiveness
Expand Down
8 changes: 4 additions & 4 deletions docs/regressions-beir-v1.0.0-arguana-splade-distil-cocodenser-medium.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ After indexing has completed, you should be able to perform retrieval as follows
```
target/appassembler/bin/SearchCollection \
-index indexes/lucene-index.beir-v1.0.0-arguana-splade_distil_cocodenser_medium/ \
-topics src/main/resources/topics-and-qrels/topics.beir-v1.0.0-arguana.test.splade_distil_cocodenser_medium.tsv.gz \
-topics tools/topics-and-qrels/topics.beir-v1.0.0-arguana.test.splade_distil_cocodenser_medium.tsv.gz \
-topicreader TsvString \
-output runs/run.beir-v1.0.0-arguana-splade_distil_cocodenser_medium.splade_distil_cocodenser_medium.topics.beir-v1.0.0-arguana.test.splade_distil_cocodenser_medium.txt \
-impact -pretokenized -removeQuery -hits 1000 &
Expand All @@ -80,9 +80,9 @@ target/appassembler/bin/SearchCollection \
Evaluation can be performed using `trec_eval`:

```
tools/eval/trec_eval.9.0.4/trec_eval -c -m ndcg_cut.10 src/main/resources/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-splade_distil_cocodenser_medium.splade_distil_cocodenser_medium.topics.beir-v1.0.0-arguana.test.splade_distil_cocodenser_medium.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.100 src/main/resources/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-splade_distil_cocodenser_medium.splade_distil_cocodenser_medium.topics.beir-v1.0.0-arguana.test.splade_distil_cocodenser_medium.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.1000 src/main/resources/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-splade_distil_cocodenser_medium.splade_distil_cocodenser_medium.topics.beir-v1.0.0-arguana.test.splade_distil_cocodenser_medium.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m ndcg_cut.10 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-splade_distil_cocodenser_medium.splade_distil_cocodenser_medium.topics.beir-v1.0.0-arguana.test.splade_distil_cocodenser_medium.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.100 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-splade_distil_cocodenser_medium.splade_distil_cocodenser_medium.topics.beir-v1.0.0-arguana.test.splade_distil_cocodenser_medium.txt
tools/eval/trec_eval.9.0.4/trec_eval -c -m recall.1000 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-splade_distil_cocodenser_medium.splade_distil_cocodenser_medium.topics.beir-v1.0.0-arguana.test.splade_distil_cocodenser_medium.txt
```

## Effectiveness
Expand Down
Loading

0 comments on commit ed89401

Please sign in to comment.