Skip to content

Latest commit

 

History

History

asr1

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
conf
conf
 
 
local
local
 
 
README.md
README.md
 
 
asr.sh
asr.sh
 
 
cmd.sh
cmd.sh
 
 
db.sh
db.sh
 
 
path.sh
path.sh
 
 
pyscripts
pyscripts
 
 
run.sh
run.sh
 
 
scripts
scripts
 
 
steps
steps
 
 
utils
utils
 
 

README.md

E-Branchformer

Environments

  • date: Tue Dec 27 05:05:40 CST 2022
  • python version: 3.9.15 (main, Nov 24 2022, 14:31:59) [GCC 11.2.0]
  • espnet version: espnet 202211
  • pytorch version: pytorch 1.12.1
  • Git hash: ef3ce328551c12c03284defc757f42df47c46170
    • Commit date: Mon Dec 26 20:34:28 2022 -0500

asr_train_asr_e_branchformer_e12_size256_mlp1024_linear1024_macaron_raw_en_bpe2000_sp

WER

dataset Snt Wrd Corr Sub Del Ins Err S.Err
decode_asr_asr_model_valid.acc.ave/eval2000/hyp.callhm.ctm.filt.sys 2628 21594 89.1 8.4 2.5 2.1 13.1 46.0
decode_asr_asr_model_valid.acc.ave/eval2000/hyp.ctm.filt.sys 4459 42989 91.8 6.1 2.1 1.6 9.8 41.3
decode_asr_asr_model_valid.acc.ave/eval2000/hyp.swbd.ctm.filt.sys 1831 21395 94.5 3.8 1.7 1.0 6.4 34.5

CER

dataset Snt Wrd Corr Sub Del Ins Err S.Err
decode_asr_asr_model_valid.acc.ave/eval2000 4351 193404 93.0 3.3 3.7 5.3 12.3 67.9

TER

dataset Snt Wrd Corr Sub Del Ins Err S.Err
decode_asr_asr_model_valid.acc.ave/eval2000 4351 50250 82.9 12.4 4.7 9.8 26.9 67.9

Conformer

Environments

  • date: Tue Dec 27 03:17:13 CST 2022
  • python version: 3.9.15 (main, Nov 24 2022, 14:31:59) [GCC 11.2.0]
  • espnet version: espnet 202211
  • pytorch version: pytorch 1.12.1
  • Git hash: ef3ce328551c12c03284defc757f42df47c46170
    • Commit date: Mon Dec 26 20:34:28 2022 -0500

asr_train_asr_conformer_e12_size256_linear2048_raw_en_bpe2000_sp

WER

dataset Snt Wrd Corr Sub Del Ins Err S.Err
decode_asr_asr_model_valid.acc.ave/eval2000/hyp.callhm.ctm.filt.sys 2628 21594 88.3 8.5 3.2 2.1 13.8 46.8
decode_asr_asr_model_valid.acc.ave/eval2000/hyp.ctm.filt.sys 4459 42989 90.8 6.2 3.0 1.5 10.7 42.4
decode_asr_asr_model_valid.acc.ave/eval2000/hyp.swbd.ctm.filt.sys 1831 21395 93.4 3.9 2.7 0.9 7.5 36.1

CER

dataset Snt Wrd Corr Sub Del Ins Err S.Err
decode_asr_asr_model_valid.acc.ave/eval2000 4322 181952 92.8 3.4 3.8 10.8 18.0 68.1

TER

dataset Snt Wrd Corr Sub Del Ins Err S.Err
decode_asr_asr_model_valid.acc.ave/eval2000 4322 47227 82.6 12.8 4.6 15.3 32.7 68.1

Conformer: initial

Environments

asr_train_asr_cformer5_raw_bpe2000_sp

WER

exp_sp/train_nodup_sp_pytorch_train_pytorch_conformer_lr5_specaug_resume/decode_eval2000_model.last10.avg.best_decode_train_transformer_lm_pytorch_swbd+fisher_bpe2000/scoring/hyp.callhm.ctm.filt.sys
|       SPKR              |        # Snt              # Wrd        |        Corr                 Sub                  Del                 Ins                  Err               S.Err        |
|       Sum/Avg           |        2628               21594        |        84.4                 9.6                  3.8                 2.2                 15.6                49.4        |
exp_sp/train_nodup_sp_pytorch_train_pytorch_conformer_lr5_specaug_resume/decode_eval2000_model.last10.avg.best_decode_train_transformer_lm_pytorch_swbd+fisher_bpe2000/scoring/hyp.ctm.filt.sys
|       SPKR              |       # Snt             # Wrd        |       Corr                 Sub                Del                 Ins                 Err              S.Err        |
|       Sum/Avg           |       4459              42989        |       89.6                7.0                3.4                 1.6                12.0               44.9        |
exp_sp/train_nodup_sp_pytorch_train_pytorch_conformer_lr5_specaug_resume/decode_eval2000_model.last10.avg.best_decode_train_transformer_lm_pytorch_swbd+fisher_bpe2000/scoring/hyp.swbd.ctm.filt.sys
|       SPKR             |        # Snt              # Wrd        |       Corr                  Sub                 Del                 Ins                  Err               S.Err        |
|       Sum/Avg          |        1831               21395        |       92.5                  4.4                 3.1                 0.9                  8.4                38.3        |

Fbank-pitch Model with BPE2k, Specaug- with and without 12L, BPE2k SWBD+Fisher Transformer LM

Environments

Without LM Rescoring

exp/asr_train_asr_conformer_fbank_pitch_bpe2000/decode_asr_asr_model_valid.acc.ave_10best/eval2000/score_wer/scoring/hyp.callhm.ctm.filt.sys
|       SPKR              |        # Snt              # Wrd        |        Corr                 Sub                  Del                 Ins                  Err               S.Err        |
|	Sum/Avg	|	2628	|	21594	|	87.4	|	9.6	|	3.0	|	2.0	|	14.6	|	49.7	|
exp/asr_train_asr_conformer_fbank_pitch_bpe2000/decode_asr_asr_model_valid.acc.ave_10best/eval2000/score_wer/scoring/hyp.ctm.filt.sys
|       SPKR              |        # Snt              # Wrd        |        Corr                 Sub                  Del                 Ins                  Err               S.Err        |
|	Sum/Avg	|	4459	|	42989	|	90.5	|	7.0	|	2.5	|	1.5	|	10.9	|	44.7	|
exp/asr_train_asr_conformer_fbank_pitch_bpe2000/decode_asr_asr_model_valid.acc.ave_10best/eval2000/score_wer/scoring/hyp.swbd.ctm.filt.sys
|       SPKR              |        # Snt              # Wrd        |        Corr                 Sub                  Del                 Ins                  Err               S.Err        |
|	Sum/Avg	|	1831	|	21395	|	93.7	|	4.3	|	2.0	|	0.9	|	7.2	|	37.7	|

With Transformer LM

exp/asr_train_asr_conformer_fbank_pitch_bpe2000/decode_lm_transformer_valid.loss.ave_asr_model_valid.acc.ave_10best/eval2000/score_wer/scoring/hyp.callhm.ctm.filt.sys
|       SPKR              |        # Snt              # Wrd        |        Corr                 Sub                  Del                 Ins                  Err               S.Err        |
|	Sum/Avg	|	2628	|	21594	|	88.0	|	8.9	|	3.1	|	2.0	|	14.0	|	48.0	|
exp/asr_train_asr_conformer_fbank_pitch_bpe2000/decode_lm_transformer_valid.loss.ave_asr_model_valid.acc.ave_10best/eval2000/score_wer/scoring/hyp.ctm.filt.sys
|       SPKR              |        # Snt              # Wrd        |        Corr                 Sub                  Del                 Ins                  Err               S.Err        |
|	Sum/Avg	|	4459	|	42989	|	91.0	|	6.5	|	2.5	|	1.4	|	10.4	|	43.0	|
exp/asr_train_asr_conformer_fbank_pitch_bpe2000/decode_lm_transformer_valid.loss.ave_asr_model_valid.acc.ave_10best/eval2000/score_wer/scoring/hyp.swbd.ctm.filt.sys
|       SPKR              |        # Snt              # Wrd        |        Corr                 Sub                  Del                 Ins                  Err               S.Err        |
|	Sum/Avg	|	1831	|	21395	|	94.0	|	4.0	|	2.0	|	0.9	|	6.8	|	35.9	|