Updated regression log (castorini#643)

Updated documentation, fixed broken links.
zeynepakkalyoncu · May 13, 2019 · 32e0191 · 32e0191
1 parent 3eef2fb
commit 32e0191
Show file tree

Hide file tree

Showing 2 changed files with 15 additions and 3 deletions.
diff --git a/docs/regressions-log.md b/docs/regressions-log.md
@@ -4,6 +4,14 @@ The following change log details commits to regression tests that alter effectiv
 This documentation is useful for figuring why results may have changed over time.
 
 
+### May 11, 2019
+
++ [commit 3eef2fb4808d88608d2c467418b77516eba3538a](https://github.com/castorini/anserini/commit/3eef2fb4808d88608d2c467418b77516eba3538a) Sat May 11 14:34:46 2019 -0400
++ [commit 2ba2b9582ee942aee714301b78015a2ded16da8c](https://github.com/castorini/anserini/commit/2ba2b9582ee942aee714301b78015a2ded16da8c) Sat May 11 11:20:47 2019 -0400
++ [commit d911bba180aceabbe052624b7f715a2189e25dbb](https://github.com/castorini/anserini/commit/d911bba180aceabbe052624b7f715a2189e25dbb) Fri May 10 09:12:26 2019 -0400
+
+CAR regression refactoring: added v2.0 regression and renamed existing regression to v1.5. Both use `benchmarkY1-test` to support consistent comparisons.
+
 ### January 2, 2019
 
 + [commit 407f308cc543286e39701caf0acd1afab39dde2c](https://github.com/castorini/Anserini/commit/407f308cc543286e39701caf0acd1afab39dde2c) Wed Jan 2 06:34:57 2019 -0800

diff --git a/docs/regressions.md b/docs/regressions.md
@@ -39,7 +39,8 @@ nohup python src/main/python/run_regression.py --collection cw09b >& log.cw09b &
 nohup python src/main/python/run_regression.py --collection cw12b13 >& log.cw12b13 &
 nohup python src/main/python/run_regression.py --collection cw12 >& log.cw12 &
 
-nohup python src/main/python/run_regression.py --collection car17 >& log.car17 &
+nohup python src/main/python/run_regression.py --collection car17v1.5 >& log.car17v1.5 &
+nohup python src/main/python/run_regression.py --collection car17v2.0 >& log.car17v2.0 &
 ```
 
 Copy and paste the following lines into console on `tuna` to run the regressions from the raw collection, which includes building indexes from scratch (note difference is the additional `--index` option):
@@ -60,7 +61,8 @@ nohup python src/main/python/run_regression.py --collection cw09b --index >& log
 nohup python src/main/python/run_regression.py --collection cw12b13 --index >& log.cw12b13 &
 nohup python src/main/python/run_regression.py --collection cw12 --index >& log.cw12 &
 
-nohup python src/main/python/run_regression.py --collection car17 --index >& log.car17 &
+nohup python src/main/python/run_regression.py --collection car17v1.5 --index >& log.car17v1.5 &
+nohup python src/main/python/run_regression.py --collection car17v2.0 --index >& log.car17v2.0 &
 ```
 
 Watch out: the full `cw12` regress takes a couple days to run and generates a 12TB index!
@@ -79,7 +81,9 @@ Details of each specific regression:
 + `cw12`: [Experiments on ClueWeb12](experiments-cw12.md)
 + `mb11`: [Experiments on Tweets2011 (MB11 &amp; MB12)](experiments-mb11.md)
 + `mb13`: [Experiments on Tweets2013 (MB13 &amp; MB14)](experiments-mb13.md)
-+ `car17`: [Experiments on Car17](experiments-car17.md)
++ `car17v1.5`: [Experiments on Complex Answer Retrieval v1.5 (CAR17)](experiments-car17v1.5.md)
++ `car17v2.0`: [Experiments on Complex Answer Retrieval v2.0 (CAR17)](experiments-car17v2.0.md)
+
 
 ## Additional Regressions