Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regressions for MS MARCO V2 #1630

Merged
merged 9 commits into from
Sep 4, 2021
Merged

Regressions for MS MARCO V2 #1630

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
6e4901c
Regressions for MS MARCO v2 passage
lintool Aug 28, 2021
5b5f295
MS MARCO doc v2
lintool Aug 29, 2021
d34019b
stubs
lintool Aug 29, 2021
adc3bcc
segmented figures
lintool Sep 3, 2021
6e608be
initial docs.
lintool Sep 4, 2021
c3a6fcc
Merge branch 'master' into msmarco-regressions
lintool Sep 4, 2021
c00d47b
doc updates.
lintool Sep 4, 2021
0e8770a
updated docs.
lintool Sep 4, 2021
18f9cc3
doc updates
lintool Sep 4, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
doc updates
  • Loading branch information
@lintool
lintool committed Sep 4, 2021
commit 18f9cc309dabb1016866ae4b74da6e23fee967c9
4 changes: 2 additions & 2 deletions docs/regressions-msmarco-doc-v2-segmented.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Anserini: Regressions for [MS MARCO Document Ranking (V2) Segmented](https://microsoft.github.io/msmarco/TREC-Deep-Learning.html)
# Anserini: Regressions for [MS MARCO Document Ranking (V2)](https://microsoft.github.io/msmarco/TREC-Deep-Learning.html)

This page documents regression experiments for document ranking _on the segmented version_ of the MS MARCO Document (V2) corpus, which is integrated into Anserini's regression testing framework.
For more complete instructions on how to run end-to-end experiments, refer to [this page](experiments-msmarco-v2.md).
Expand Down Expand Up @@ -27,7 +27,7 @@ For additional details, see explanation of [common indexing options](common-inde
## Retrieval

Topics and qrels are stored in [`src/main/resources/topics-and-qrels/`](../src/main/resources/topics-and-qrels/).
The regression experiments here evaluate on the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-doc-v2.dev.txt).
These regression experiments use the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-doc-v2.dev.txt).

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions-msmarco-doc-v2.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ For additional details, see explanation of [common indexing options](common-inde
## Retrieval

Topics and qrels are stored in [`src/main/resources/topics-and-qrels/`](../src/main/resources/topics-and-qrels/).
The regression experiments here evaluate on the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-doc-v2.dev.txt).
These regression experiments use the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-doc-v2.dev.txt).

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
4 changes: 2 additions & 2 deletions docs/regressions-msmarco-passage-v2-augmented.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# Anserini: Regressions for [MS MARCO Passage Ranking (V2)](https://microsoft.github.io/msmarco/TREC-Deep-Learning.html)

This page documents regression experiments for passage ranking _on the augmented version_ of the MS MARCO Passage (V2) corpus, which is integrated into Anserini's regression testing framework.
For more complete instructions on how to run end-to-end experiments, refer to [this page](experiments-msmarco-v2-augmented.md).
For more complete instructions on how to run end-to-end experiments, refer to [this page](experiments-msmarco-v2.md).

The exact configurations for these regressions are stored in [this YAML file](../src/main/resources/regression/msmarco-passage-v2-augmented.yaml).
Note that this page is automatically generated from [this template](../src/main/resources/docgen/templates/msmarco-passage-v2-augmented.template) as part of Anserini's regression pipeline, so do not modify this page directly; modify the template instead.
Expand All @@ -27,7 +27,7 @@ For additional details, see explanation of [common indexing options](common-inde
## Retrieval

Topics and qrels are stored in [`src/main/resources/topics-and-qrels/`](../src/main/resources/topics-and-qrels/).
The regression experiments here evaluate on the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-passage-v2.dev.txt).
These regression experiments use the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-passage-v2.dev.txt).

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions-msmarco-passage-v2.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ For additional details, see explanation of [common indexing options](common-inde
## Retrieval

Topics and qrels are stored in [`src/main/resources/topics-and-qrels/`](../src/main/resources/topics-and-qrels/).
The regression experiments here evaluate on the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-passage-v2.dev.txt).
These regression experiments use the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-passage-v2.dev.txt).

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
4 changes: 2 additions & 2 deletions src/main/resources/docgen/templates/msmarco-doc-v2-segmented.template
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Anserini: Regressions for [MS MARCO Document Ranking (V2) Segmented](https://microsoft.github.io/msmarco/TREC-Deep-Learning.html)
# Anserini: Regressions for [MS MARCO Document Ranking (V2)](https://microsoft.github.io/msmarco/TREC-Deep-Learning.html)

This page documents regression experiments for document ranking _on the segmented version_ of the MS MARCO Document (V2) corpus, which is integrated into Anserini's regression testing framework.
For more complete instructions on how to run end-to-end experiments, refer to [this page](experiments-msmarco-v2.md).
Expand All @@ -22,7 +22,7 @@ For additional details, see explanation of [common indexing options](common-inde
## Retrieval

Topics and qrels are stored in [`src/main/resources/topics-and-qrels/`](../src/main/resources/topics-and-qrels/).
The regression experiments here evaluate on the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-doc-v2.dev.txt).
These regression experiments use the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-doc-v2.dev.txt).

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
2 changes: 1 addition & 1 deletion src/main/resources/docgen/templates/msmarco-doc-v2.template
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ For additional details, see explanation of [common indexing options](common-inde
## Retrieval

Topics and qrels are stored in [`src/main/resources/topics-and-qrels/`](../src/main/resources/topics-and-qrels/).
The regression experiments here evaluate on the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-doc-v2.dev.txt).
These regression experiments use the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-doc-v2.dev.txt).

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
4 changes: 2 additions & 2 deletions src/main/resources/docgen/templates/msmarco-passage-v2-augmented.template
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# Anserini: Regressions for [MS MARCO Passage Ranking (V2)](https://microsoft.github.io/msmarco/TREC-Deep-Learning.html)

This page documents regression experiments for passage ranking _on the augmented version_ of the MS MARCO Passage (V2) corpus, which is integrated into Anserini's regression testing framework.
For more complete instructions on how to run end-to-end experiments, refer to [this page](experiments-msmarco-v2-augmented.md).
For more complete instructions on how to run end-to-end experiments, refer to [this page](experiments-msmarco-v2.md).

The exact configurations for these regressions are stored in [this YAML file](../src/main/resources/regression/msmarco-passage-v2-augmented.yaml).
Note that this page is automatically generated from [this template](../src/main/resources/docgen/templates/msmarco-passage-v2-augmented.template) as part of Anserini's regression pipeline, so do not modify this page directly; modify the template instead.
Expand All @@ -22,7 +22,7 @@ For additional details, see explanation of [common indexing options](common-inde
## Retrieval

Topics and qrels are stored in [`src/main/resources/topics-and-qrels/`](../src/main/resources/topics-and-qrels/).
The regression experiments here evaluate on the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-passage-v2.dev.txt).
These regression experiments use the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-passage-v2.dev.txt).

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
2 changes: 1 addition & 1 deletion src/main/resources/docgen/templates/msmarco-passage-v2.template
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ For additional details, see explanation of [common indexing options](common-inde
## Retrieval

Topics and qrels are stored in [`src/main/resources/topics-and-qrels/`](../src/main/resources/topics-and-qrels/).
The regression experiments here evaluate on the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-passage-v2.dev.txt).
These regression experiments use the [dev queries](../src/main/resources/topics-and-qrels/topics.msmarco-passage-v2.dev.txt).

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down