Fixing issues where Pyserini failed to produce metrices with TREC eva…

…luation tool on MS MAROC passgae retrieval (#342)
castorini · Jan 29, 2021 · 74a87e4 · 74a87e4
1 parent 388a517
commit 74a87e4
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/docs/experiments-msmarco-passage.md b/docs/experiments-msmarco-passage.md
@@ -105,8 +105,11 @@ For that we first need to convert the run file into TREC format:
 ```bash
 $ python tools/scripts/msmarco/convert_msmarco_to_trec_run.py \
    --input runs/run.msmarco-passage.bm25tuned.txt --output runs/run.msmarco-passage.bm25tuned.trec
+$ python tools/scripts/msmarco/convert_msmarco_to_trec_qrels.py \
+   --input tools/topics-and-qrels/qrels.msmarco-passage.dev-subset.txt --output collections/msmarco-passage/qrels.dev.small.trec
 ```
 
+
 And then run the `trec_eval` tool:
 
 ```bash