I have found a bug within the challenge evaluation framework, which causes the software to fail when train_asr_eval or train_asv_eval is set to false instead of the default value true.

The problem is caused by line 19 in main_eval_asr.sh and line 80 in main_eval_asv.sh which are almost the same except 'asv' instead of 'asr'.

if [ $train_asr_eval ]; then

This test expression always evaluates to true, even when the corresponding config entry is set to false or 0.

It could be fixed by changing the braces with parentheses. I can open up a pull request if desired.