Skip to content

Commit

Permalink
Remove appassembler-maven-plugin (castorini#2444)
Browse files Browse the repository at this point in the history 
Deprecation in JDK 21 of plugin requires an entirely new approach to launch classes.
Switching over to a custom run script.
  • Loading branch information
@lintool
lintool authored Apr 8, 2024
1 parent 1bced8b commit e9f4a38
Show file tree
Hide file tree
Showing 1,172 changed files with 8,029 additions and 8,091 deletions.
2 changes: 1 addition & 1 deletion bin/build.sh
View file
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
#!/bin/sh

mvn clean package appassembler:assemble
mvn clean package
2 changes: 1 addition & 1 deletion bin/qbuild.sh
View file
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
#!/bin/sh

mvn clean package appassembler:assemble -DskipTests -Dmaven.javadoc.skip=true
mvn clean package -DskipTests -Dmaven.javadoc.skip=true
3 changes: 3 additions & 0 deletions bin/run.sh
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
#!/bin/sh

java -cp `ls target/*-fatjar.jar` -Xms512M -Xmx64G --add-modules jdk.incubator.vector $@
3 changes: 3 additions & 0 deletions bin/trec_eval
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
#!/bin/sh

java -cp `ls target/*-fatjar.jar` -Xms512M -Xmx64G --add-modules jdk.incubator.vector trec_eval $@
14 changes: 7 additions & 7 deletions docs/regressions/regressions-backgroundlinking18.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ python src/main/python/run_regression.py --index --verify --search --regression
Typical indexing command:

```
target/appassembler/bin/IndexCollection \
bin/run.sh io.anserini.index.IndexCollection \
-collection WashingtonPostCollection \
-input /path/to/wapo.v2 \
-generator WashingtonPostGenerator \
Expand All @@ -42,21 +42,21 @@ They are downloaded from NIST:
After indexing has completed, you should be able to perform retrieval as follows:

```
target/appassembler/bin/SearchCollection \
bin/run.sh io.anserini.search.SearchCollection \
-index indexes/lucene-index.wapo.v2/ \
-topics tools/topics-and-qrels/topics.backgroundlinking18.txt \
-topicReader BackgroundLinking \
-output runs/run.wapo.v2.bm25.topics.backgroundlinking18.txt \
-backgroundLinking -backgroundLinking.k 100 -bm25 -hits 100 &
target/appassembler/bin/SearchCollection \
bin/run.sh io.anserini.search.SearchCollection \
-index indexes/lucene-index.wapo.v2/ \
-topics tools/topics-and-qrels/topics.backgroundlinking18.txt \
-topicReader BackgroundLinking \
-output runs/run.wapo.v2.bm25+rm3.topics.backgroundlinking18.txt \
-backgroundLinking -backgroundLinking.k 100 -bm25 -rm3 -hits 100 &
target/appassembler/bin/SearchCollection \
bin/run.sh io.anserini.search.SearchCollection \
-index indexes/lucene-index.wapo.v2/ \
-topics tools/topics-and-qrels/topics.backgroundlinking18.txt \
-topicReader BackgroundLinking \
Expand All @@ -67,11 +67,11 @@ target/appassembler/bin/SearchCollection \
Evaluation can be performed using `trec_eval`:

```
target/appassembler/bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking18.txt runs/run.wapo.v2.bm25.topics.backgroundlinking18.txt
bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking18.txt runs/run.wapo.v2.bm25.topics.backgroundlinking18.txt
target/appassembler/bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking18.txt runs/run.wapo.v2.bm25+rm3.topics.backgroundlinking18.txt
bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking18.txt runs/run.wapo.v2.bm25+rm3.topics.backgroundlinking18.txt
target/appassembler/bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking18.txt runs/run.wapo.v2.bm25+rm3+df.topics.backgroundlinking18.txt
bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking18.txt runs/run.wapo.v2.bm25+rm3+df.topics.backgroundlinking18.txt
```

## Effectiveness
Expand Down
14 changes: 7 additions & 7 deletions docs/regressions/regressions-backgroundlinking19.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ python src/main/python/run_regression.py --index --verify --search --regression
Typical indexing command:

```
target/appassembler/bin/IndexCollection \
bin/run.sh io.anserini.index.IndexCollection \
-collection WashingtonPostCollection \
-input /path/to/wapo.v2 \
-generator WashingtonPostGenerator \
Expand All @@ -42,21 +42,21 @@ They are downloaded from NIST:
After indexing has completed, you should be able to perform retrieval as follows:

```
target/appassembler/bin/SearchCollection \
bin/run.sh io.anserini.search.SearchCollection \
-index indexes/lucene-index.wapo.v2/ \
-topics tools/topics-and-qrels/topics.backgroundlinking19.txt \
-topicReader BackgroundLinking \
-output runs/run.wapo.v2.bm25.topics.backgroundlinking19.txt \
-backgroundLinking -backgroundLinking.k 100 -bm25 -hits 100 &
target/appassembler/bin/SearchCollection \
bin/run.sh io.anserini.search.SearchCollection \
-index indexes/lucene-index.wapo.v2/ \
-topics tools/topics-and-qrels/topics.backgroundlinking19.txt \
-topicReader BackgroundLinking \
-output runs/run.wapo.v2.bm25+rm3.topics.backgroundlinking19.txt \
-backgroundLinking -backgroundLinking.k 100 -bm25 -rm3 -hits 100 &
target/appassembler/bin/SearchCollection \
bin/run.sh io.anserini.search.SearchCollection \
-index indexes/lucene-index.wapo.v2/ \
-topics tools/topics-and-qrels/topics.backgroundlinking19.txt \
-topicReader BackgroundLinking \
Expand All @@ -67,11 +67,11 @@ target/appassembler/bin/SearchCollection \
Evaluation can be performed using `trec_eval`:

```
target/appassembler/bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking19.txt runs/run.wapo.v2.bm25.topics.backgroundlinking19.txt
bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking19.txt runs/run.wapo.v2.bm25.topics.backgroundlinking19.txt
target/appassembler/bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking19.txt runs/run.wapo.v2.bm25+rm3.topics.backgroundlinking19.txt
bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking19.txt runs/run.wapo.v2.bm25+rm3.topics.backgroundlinking19.txt
target/appassembler/bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking19.txt runs/run.wapo.v2.bm25+rm3+df.topics.backgroundlinking19.txt
bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking19.txt runs/run.wapo.v2.bm25+rm3+df.topics.backgroundlinking19.txt
```

## Effectiveness
Expand Down
14 changes: 7 additions & 7 deletions docs/regressions/regressions-backgroundlinking20.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ python src/main/python/run_regression.py --index --verify --search --regression
Typical indexing command:

```
target/appassembler/bin/IndexCollection \
bin/run.sh io.anserini.index.IndexCollection \
-collection WashingtonPostCollection \
-input /path/to/wapo.v3 \
-generator WashingtonPostGenerator \
Expand All @@ -42,21 +42,21 @@ They are downloaded from NIST:
After indexing has completed, you should be able to perform retrieval as follows:

```
target/appassembler/bin/SearchCollection \
bin/run.sh io.anserini.search.SearchCollection \
-index indexes/lucene-index.wapo.v3/ \
-topics tools/topics-and-qrels/topics.backgroundlinking20.txt \
-topicReader BackgroundLinking \
-output runs/run.wapo.v3.bm25.topics.backgroundlinking20.txt \
-backgroundLinking -backgroundLinking.k 100 -bm25 -hits 100 &
target/appassembler/bin/SearchCollection \
bin/run.sh io.anserini.search.SearchCollection \
-index indexes/lucene-index.wapo.v3/ \
-topics tools/topics-and-qrels/topics.backgroundlinking20.txt \
-topicReader BackgroundLinking \
-output runs/run.wapo.v3.bm25+rm3.topics.backgroundlinking20.txt \
-backgroundLinking -backgroundLinking.k 100 -bm25 -rm3 -hits 100 &
target/appassembler/bin/SearchCollection \
bin/run.sh io.anserini.search.SearchCollection \
-index indexes/lucene-index.wapo.v3/ \
-topics tools/topics-and-qrels/topics.backgroundlinking20.txt \
-topicReader BackgroundLinking \
Expand All @@ -67,11 +67,11 @@ target/appassembler/bin/SearchCollection \
Evaluation can be performed using `trec_eval`:

```
target/appassembler/bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking20.txt runs/run.wapo.v3.bm25.topics.backgroundlinking20.txt
bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking20.txt runs/run.wapo.v3.bm25.topics.backgroundlinking20.txt
target/appassembler/bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking20.txt runs/run.wapo.v3.bm25+rm3.topics.backgroundlinking20.txt
bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking20.txt runs/run.wapo.v3.bm25+rm3.topics.backgroundlinking20.txt
target/appassembler/bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking20.txt runs/run.wapo.v3.bm25+rm3+df.topics.backgroundlinking20.txt
bin/trec_eval -c -M1000 -m map -c -M1000 -m ndcg_cut.5 tools/topics-and-qrels/qrels.backgroundlinking20.txt runs/run.wapo.v3.bm25+rm3+df.topics.backgroundlinking20.txt
```

## Effectiveness
Expand Down
10 changes: 5 additions & 5 deletions .../regressions/regressions-beir-v1.0.0-arguana-bge-base-en-v1.5-hnsw-int8-onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ After download and unpacking the corpora, the `run_regression.py` command above
Sample indexing command, building HNSW indexes:

```
target/appassembler/bin/IndexHnswDenseVectors \
bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-bge-base-en-v1.5 \
-generator HnswDenseVectorDocumentGenerator \
Expand All @@ -52,7 +52,7 @@ Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/t
After indexing has completed, you should be able to perform retrieval as follows:

```
target/appassembler/bin/SearchHnswDenseVectors \
bin/run.sh io.anserini.search.SearchHnswDenseVectors \
-index indexes/lucene-hnsw.beir-v1.0.0-arguana-bge-base-en-v1.5-int8/ \
-topics tools/topics-and-qrels/topics.beir-v1.0.0-arguana.test.tsv.gz \
-topicReader TsvString \
Expand All @@ -63,9 +63,9 @@ target/appassembler/bin/SearchHnswDenseVectors \
Evaluation can be performed using `trec_eval`:

```
target/appassembler/bin/trec_eval -c -m ndcg_cut.10 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.txt
target/appassembler/bin/trec_eval -c -m recall.100 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.txt
target/appassembler/bin/trec_eval -c -m recall.1000 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.txt
bin/trec_eval -c -m ndcg_cut.10 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.txt
bin/trec_eval -c -m recall.100 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.txt
bin/trec_eval -c -m recall.1000 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.txt
```

## Effectiveness
Expand Down
10 changes: 5 additions & 5 deletions docs/regressions/regressions-beir-v1.0.0-arguana-bge-base-en-v1.5-hnsw-int8.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ After download and unpacking the corpora, the `run_regression.py` command above
Sample indexing command, building HNSW indexes:

```
target/appassembler/bin/IndexHnswDenseVectors \
bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-bge-base-en-v1.5 \
-generator HnswDenseVectorDocumentGenerator \
Expand All @@ -52,7 +52,7 @@ Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/t
After indexing has completed, you should be able to perform retrieval as follows:

```
target/appassembler/bin/SearchHnswDenseVectors \
bin/run.sh io.anserini.search.SearchHnswDenseVectors \
-index indexes/lucene-hnsw.beir-v1.0.0-arguana-bge-base-en-v1.5-int8/ \
-topics tools/topics-and-qrels/topics.beir-v1.0.0-arguana.test.bge-base-en-v1.5.jsonl.gz \
-topicReader JsonStringVector \
Expand All @@ -63,9 +63,9 @@ target/appassembler/bin/SearchHnswDenseVectors \
Evaluation can be performed using `trec_eval`:

```
target/appassembler/bin/trec_eval -c -m ndcg_cut.10 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.bge-base-en-v1.5.jsonl.txt
target/appassembler/bin/trec_eval -c -m recall.100 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.bge-base-en-v1.5.jsonl.txt
target/appassembler/bin/trec_eval -c -m recall.1000 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.bge-base-en-v1.5.jsonl.txt
bin/trec_eval -c -m ndcg_cut.10 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.bge-base-en-v1.5.jsonl.txt
bin/trec_eval -c -m recall.100 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.bge-base-en-v1.5.jsonl.txt
bin/trec_eval -c -m recall.1000 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.bge-base-en-v1.5.jsonl.txt
```

## Effectiveness
Expand Down
10 changes: 5 additions & 5 deletions docs/regressions/regressions-beir-v1.0.0-arguana-bge-base-en-v1.5-hnsw-onnx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ After download and unpacking the corpora, the `run_regression.py` command above
Sample indexing command, building HNSW indexes:

```
target/appassembler/bin/IndexHnswDenseVectors \
bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-bge-base-en-v1.5 \
-generator HnswDenseVectorDocumentGenerator \
Expand All @@ -52,7 +52,7 @@ Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/t
After indexing has completed, you should be able to perform retrieval as follows:

```
target/appassembler/bin/SearchHnswDenseVectors \
bin/run.sh io.anserini.search.SearchHnswDenseVectors \
-index indexes/lucene-hnsw.beir-v1.0.0-arguana-bge-base-en-v1.5/ \
-topics tools/topics-and-qrels/topics.beir-v1.0.0-arguana.test.tsv.gz \
-topicReader TsvString \
Expand All @@ -63,9 +63,9 @@ target/appassembler/bin/SearchHnswDenseVectors \
Evaluation can be performed using `trec_eval`:

```
target/appassembler/bin/trec_eval -c -m ndcg_cut.10 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.txt
target/appassembler/bin/trec_eval -c -m recall.100 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.txt
target/appassembler/bin/trec_eval -c -m recall.1000 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.txt
bin/trec_eval -c -m ndcg_cut.10 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.txt
bin/trec_eval -c -m recall.100 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.txt
bin/trec_eval -c -m recall.1000 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.txt
```

## Effectiveness
Expand Down
10 changes: 5 additions & 5 deletions docs/regressions/regressions-beir-v1.0.0-arguana-bge-base-en-v1.5-hnsw.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ After download and unpacking the corpora, the `run_regression.py` command above
Sample indexing command, building HNSW indexes:

```
target/appassembler/bin/IndexHnswDenseVectors \
bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-collection JsonDenseVectorCollection \
-input /path/to/beir-v1.0.0-bge-base-en-v1.5 \
-generator HnswDenseVectorDocumentGenerator \
Expand All @@ -52,7 +52,7 @@ Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/t
After indexing has completed, you should be able to perform retrieval as follows:

```
target/appassembler/bin/SearchHnswDenseVectors \
bin/run.sh io.anserini.search.SearchHnswDenseVectors \
-index indexes/lucene-hnsw.beir-v1.0.0-arguana-bge-base-en-v1.5/ \
-topics tools/topics-and-qrels/topics.beir-v1.0.0-arguana.test.bge-base-en-v1.5.jsonl.gz \
-topicReader JsonStringVector \
Expand All @@ -63,9 +63,9 @@ target/appassembler/bin/SearchHnswDenseVectors \
Evaluation can be performed using `trec_eval`:

```
target/appassembler/bin/trec_eval -c -m ndcg_cut.10 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.bge-base-en-v1.5.jsonl.txt
target/appassembler/bin/trec_eval -c -m recall.100 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.bge-base-en-v1.5.jsonl.txt
target/appassembler/bin/trec_eval -c -m recall.1000 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.bge-base-en-v1.5.jsonl.txt
bin/trec_eval -c -m ndcg_cut.10 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.bge-base-en-v1.5.jsonl.txt
bin/trec_eval -c -m recall.100 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.bge-base-en-v1.5.jsonl.txt
bin/trec_eval -c -m recall.1000 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-bge-base-en-v1.5.bge-hnsw.topics.beir-v1.0.0-arguana.test.bge-base-en-v1.5.jsonl.txt
```

## Effectiveness
Expand Down
10 changes: 5 additions & 5 deletions docs/regressions/regressions-beir-v1.0.0-arguana-flat-wp.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ After download and unpacking the corpora, the `run_regression.py` command above
Typical indexing command:

```
target/appassembler/bin/IndexCollection \
bin/run.sh io.anserini.index.IndexCollection \
-collection BeirFlatCollection \
-input /path/to/beir-v1.0.0-arguana-flat-wp \
-generator DefaultLuceneDocumentGenerator \
Expand All @@ -46,7 +46,7 @@ Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/t
After indexing has completed, you should be able to perform retrieval as follows:

```
target/appassembler/bin/SearchCollection \
bin/run.sh io.anserini.search.SearchCollection \
-index indexes/lucene-index.beir-v1.0.0-arguana-flat-wp/ \
-topics tools/topics-and-qrels/topics.beir-v1.0.0-arguana.test.wp.tsv.gz \
-topicReader TsvString \
Expand All @@ -57,9 +57,9 @@ target/appassembler/bin/SearchCollection \
Evaluation can be performed using `trec_eval`:

```
target/appassembler/bin/trec_eval -c -m ndcg_cut.10 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat-wp.bm25.topics.beir-v1.0.0-arguana.test.wp.txt
target/appassembler/bin/trec_eval -c -m recall.100 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat-wp.bm25.topics.beir-v1.0.0-arguana.test.wp.txt
target/appassembler/bin/trec_eval -c -m recall.1000 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat-wp.bm25.topics.beir-v1.0.0-arguana.test.wp.txt
bin/trec_eval -c -m ndcg_cut.10 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat-wp.bm25.topics.beir-v1.0.0-arguana.test.wp.txt
bin/trec_eval -c -m recall.100 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat-wp.bm25.topics.beir-v1.0.0-arguana.test.wp.txt
bin/trec_eval -c -m recall.1000 tools/topics-and-qrels/qrels.beir-v1.0.0-arguana.test.txt runs/run.beir-v1.0.0-arguana-flat-wp.bm25.topics.beir-v1.0.0-arguana.test.wp.txt
```

## Effectiveness
Expand Down
Loading

0 comments on commit e9f4a38

Please sign in to comment.