update pre-trained models with audio demos

keonlee9420 · Feb 17, 2022 · 6c4fb0e · 6c4fb0e
1 parent 814cdda
commit 6c4fb0e
Show file tree

Hide file tree

Showing 156 changed files with 15 additions and 6 deletions.
diff --git a/README.md b/README.md
@@ -116,9 +116,13 @@ tensorboard --logdir output/log
 to serve TensorBoard on your localhost.
 The loss curves, synthesized mel-spectrograms, and audios are shown.
 
-<!-- ![](./img/tensorboard_loss.png)
+## Normal Model
+![](./img/tensorboard_loss.png)
 ![](./img/tensorboard_spec.png)
-![](./img/tensorboard_audio.png) -->
+![](./img/tensorboard_audio.png)
+
+## Small Model Loss
+![](./img/tensorboard_loss_small.png)
 
 # Notes
 
@@ -129,12 +133,17 @@ The loss curves, synthesized mel-spectrograms, and audios are shown.
     ```yaml
     # In the train.yaml
     aligner:
-        helper_type: "ctc" # ["ctc", "dga", "none"]
+        helper_type: "dga" # ["dga", "ctc", "none"]
     ```
-    - "ctc": [Connectionist Temporal Classification (CTC)](https://dl.acm.org/doi/pdf/10.1145/1143844.1143891) Loss with forward-sum algorithm
     - "dga": [Diagonal Guided Attention (DGA)](https://arxiv.org/abs/1710.08969) Loss
-    - The default setting is "ctc". If you set "none", no helper loss will be applied during training.
-
+    - "ctc": [Connectionist Temporal Classification (CTC)](https://dl.acm.org/doi/pdf/10.1145/1143844.1143891) Loss with forward-sum algorithm
+    - If you set "none", no helper loss will be applied during training.
+    - The alignments comparision of three methods ("dga", "ctc", and "none" from top to bottom):
+        ![](./img/val_attn_step_125000_LJ040-0055_dga.png)
+        ![](./img/val_attn_step_125000_LJ040-0055_ctc.png)
+        ![](./img/val_attn_step_125000_LJ040-0055_none.png)
+    - The default setting is "dga". Although "ctc" makes the strongest alignment, the output quality and the accuracy are worse than "dga".
+    - But still, there is a room for the improvement of output quality. The audio quality and the alingment (accuracy) seem to be a trade-off.
 - Will be extended to a **multi-speaker TTS**.
 <!-- - Two options for embedding for the **multi-speaker TTS** setting: training speaker embedder from scratch or using a pre-trained [philipperemy's DeepSpeaker](https://github.com/philipperemy/deep-speaker) model (as [STYLER](https://github.com/keonlee9420/STYLER) did). You can toggle it by setting the config (between `'none'` and `'DeepSpeaker'`).
 - DeepSpeaker on VCTK dataset shows clear identification among speakers. The following figure shows the T-SNE plot of extracted speaker embedding.

diff --git a/demo/LJSpeech/normal/100k/LJ001-0165.png b/demo/LJSpeech/normal/100k/LJ001-0165.png
diff --git a/demo/LJSpeech/normal/100k/LJ001-0165.wav b/demo/LJSpeech/normal/100k/LJ001-0165.wav
diff --git a/demo/LJSpeech/normal/100k/LJ001-0174.png b/demo/LJSpeech/normal/100k/LJ001-0174.png
diff --git a/demo/LJSpeech/normal/100k/LJ001-0174.wav b/demo/LJSpeech/normal/100k/LJ001-0174.wav
diff --git a/demo/LJSpeech/normal/100k/LJ002-0002.png b/demo/LJSpeech/normal/100k/LJ002-0002.png
diff --git a/demo/LJSpeech/normal/100k/LJ002-0002.wav b/demo/LJSpeech/normal/100k/LJ002-0002.wav
diff --git a/demo/LJSpeech/normal/100k/LJ011-0269.png b/demo/LJSpeech/normal/100k/LJ011-0269.png
diff --git a/demo/LJSpeech/normal/100k/LJ011-0269.wav b/demo/LJSpeech/normal/100k/LJ011-0269.wav
diff --git a/demo/LJSpeech/normal/100k/LJ017-0025.png b/demo/LJSpeech/normal/100k/LJ017-0025.png
diff --git a/demo/LJSpeech/normal/100k/LJ017-0025.wav b/demo/LJSpeech/normal/100k/LJ017-0025.wav
diff --git a/demo/LJSpeech/normal/100k/LJ028-0403.png b/demo/LJSpeech/normal/100k/LJ028-0403.png
diff --git a/demo/LJSpeech/normal/100k/LJ028-0403.wav b/demo/LJSpeech/normal/100k/LJ028-0403.wav
diff --git a/demo/LJSpeech/normal/100k/LJ045-0141.png b/demo/LJSpeech/normal/100k/LJ045-0141.png
diff --git a/demo/LJSpeech/normal/100k/LJ045-0141.wav b/demo/LJSpeech/normal/100k/LJ045-0141.wav
diff --git a/...e remembered is that the ornament, whatever it is, whether picture or patte.png b/...e remembered is that the ornament, whatever it is, whether picture or patte.png
diff --git a/...point to be remembered is that the ornament, whatever it is, whether picture or patte.wav b/...point to be remembered is that the ornament, whatever it is, whether picture or patte.wav
diff --git a/... are of an earlier character, though they also much resemble flemish or col.png b/... are of an earlier character, though they also much resemble flemish or col.png
diff --git a/... own types are of an earlier character, though they also much resemble flemish or col.wav b/... own types are of an earlier character, though they also much resemble flemish or col.wav
diff --git a/...gements are to be found in mr. neilds state of prisons in england, scotland.png b/...gements are to be found in mr. neilds state of prisons in england, scotland.png
diff --git a/... the arrangements are to be found in mr. neilds state of prisons in england, scotland.wav b/... the arrangements are to be found in mr. neilds state of prisons in england, scotland.wav
diff --git a/demo/LJSpeech/normal/125k/LJ001-0165.png b/demo/LJSpeech/normal/125k/LJ001-0165.png
diff --git a/demo/LJSpeech/normal/125k/LJ001-0165.wav b/demo/LJSpeech/normal/125k/LJ001-0165.wav
diff --git a/demo/LJSpeech/normal/125k/LJ001-0174.png b/demo/LJSpeech/normal/125k/LJ001-0174.png
diff --git a/demo/LJSpeech/normal/125k/LJ001-0174.wav b/demo/LJSpeech/normal/125k/LJ001-0174.wav
diff --git a/demo/LJSpeech/normal/125k/LJ002-0002.png b/demo/LJSpeech/normal/125k/LJ002-0002.png
diff --git a/demo/LJSpeech/normal/125k/LJ002-0002.wav b/demo/LJSpeech/normal/125k/LJ002-0002.wav
diff --git a/demo/LJSpeech/normal/125k/LJ011-0269.png b/demo/LJSpeech/normal/125k/LJ011-0269.png
diff --git a/demo/LJSpeech/normal/125k/LJ011-0269.wav b/demo/LJSpeech/normal/125k/LJ011-0269.wav
diff --git a/demo/LJSpeech/normal/125k/LJ017-0025.png b/demo/LJSpeech/normal/125k/LJ017-0025.png
diff --git a/demo/LJSpeech/normal/125k/LJ017-0025.wav b/demo/LJSpeech/normal/125k/LJ017-0025.wav
diff --git a/demo/LJSpeech/normal/125k/LJ028-0403.png b/demo/LJSpeech/normal/125k/LJ028-0403.png
diff --git a/demo/LJSpeech/normal/125k/LJ028-0403.wav b/demo/LJSpeech/normal/125k/LJ028-0403.wav
diff --git a/demo/LJSpeech/normal/125k/LJ045-0141.png b/demo/LJSpeech/normal/125k/LJ045-0141.png
diff --git a/demo/LJSpeech/normal/125k/LJ045-0141.wav b/demo/LJSpeech/normal/125k/LJ045-0141.wav
diff --git a/... remembered is that the ornament, whatever it is, whether picture or patter.png b/... remembered is that the ornament, whatever it is, whether picture or patter.png
diff --git a/...oint to be remembered is that the ornament, whatever it is, whether picture or patter.wav b/...oint to be remembered is that the ornament, whatever it is, whether picture or patter.wav
diff --git a/... are of an earlier character, though they also much resemble flemish or col.png b/... are of an earlier character, though they also much resemble flemish or col.png
diff --git a/... own types are of an earlier character, though they also much resemble flemish or col.wav b/... own types are of an earlier character, though they also much resemble flemish or col.wav
diff --git a/...gements are to be found in mr. neilds state of prisons in england, scotland.png b/...gements are to be found in mr. neilds state of prisons in england, scotland.png
diff --git a/... the arrangements are to be found in mr. neilds state of prisons in england, scotland.wav b/... the arrangements are to be found in mr. neilds state of prisons in england, scotland.wav
diff --git a/demo/LJSpeech/normal/200k/Hello!.png b/demo/LJSpeech/normal/200k/Hello!.png
diff --git a/demo/LJSpeech/normal/200k/Hello!.wav b/demo/LJSpeech/normal/200k/Hello!.wav
diff --git a/demo/LJSpeech/normal/200k/LJ001-0165.png b/demo/LJSpeech/normal/200k/LJ001-0165.png
diff --git a/demo/LJSpeech/normal/200k/LJ001-0165.wav b/demo/LJSpeech/normal/200k/LJ001-0165.wav
diff --git a/demo/LJSpeech/normal/200k/LJ001-0174.png b/demo/LJSpeech/normal/200k/LJ001-0174.png
diff --git a/demo/LJSpeech/normal/200k/LJ001-0174.wav b/demo/LJSpeech/normal/200k/LJ001-0174.wav
diff --git a/demo/LJSpeech/normal/200k/LJ002-0002.png b/demo/LJSpeech/normal/200k/LJ002-0002.png
diff --git a/demo/LJSpeech/normal/200k/LJ002-0002.wav b/demo/LJSpeech/normal/200k/LJ002-0002.wav
diff --git a/demo/LJSpeech/normal/200k/LJ011-0269.png b/demo/LJSpeech/normal/200k/LJ011-0269.png
diff --git a/demo/LJSpeech/normal/200k/LJ011-0269.wav b/demo/LJSpeech/normal/200k/LJ011-0269.wav
diff --git a/demo/LJSpeech/normal/200k/LJ017-0025.png b/demo/LJSpeech/normal/200k/LJ017-0025.png
diff --git a/demo/LJSpeech/normal/200k/LJ017-0025.wav b/demo/LJSpeech/normal/200k/LJ017-0025.wav
diff --git a/demo/LJSpeech/normal/200k/LJ028-0403.png b/demo/LJSpeech/normal/200k/LJ028-0403.png
diff --git a/demo/LJSpeech/normal/200k/LJ028-0403.wav b/demo/LJSpeech/normal/200k/LJ028-0403.wav
diff --git a/demo/LJSpeech/normal/200k/LJ045-0141.png b/demo/LJSpeech/normal/200k/LJ045-0141.png
diff --git a/demo/LJSpeech/normal/200k/LJ045-0141.wav b/demo/LJSpeech/normal/200k/LJ045-0141.wav
diff --git a/demo/LJSpeech/normal/200k/This is a sample speech..png b/demo/LJSpeech/normal/200k/This is a sample speech..png
diff --git a/demo/LJSpeech/normal/200k/This is a sample speech..wav b/demo/LJSpeech/normal/200k/This is a sample speech..wav
diff --git a/... remembered is that the ornament, whatever it is, whether picture or patter.png b/... remembered is that the ornament, whatever it is, whether picture or patter.png
diff --git a/...oint to be remembered is that the ornament, whatever it is, whether picture or patter.wav b/...oint to be remembered is that the ornament, whatever it is, whether picture or patter.wav
diff --git a/... are of an earlier character, though they also much resemble flemish or col.png b/... are of an earlier character, though they also much resemble flemish or col.png
diff --git a/... own types are of an earlier character, though they also much resemble flemish or col.wav b/... own types are of an earlier character, though they also much resemble flemish or col.wav
diff --git a/...gements are to be found in mr. neilds state of prisons in england, scotland.png b/...gements are to be found in mr. neilds state of prisons in england, scotland.png
diff --git a/... the arrangements are to be found in mr. neilds state of prisons in england, scotland.wav b/... the arrangements are to be found in mr. neilds state of prisons in england, scotland.wav
diff --git a/demo/LJSpeech/small/150k/LJ001-0165.png b/demo/LJSpeech/small/150k/LJ001-0165.png
diff --git a/demo/LJSpeech/small/150k/LJ001-0165.wav b/demo/LJSpeech/small/150k/LJ001-0165.wav
diff --git a/demo/LJSpeech/small/150k/LJ001-0174.png b/demo/LJSpeech/small/150k/LJ001-0174.png
diff --git a/demo/LJSpeech/small/150k/LJ001-0174.wav b/demo/LJSpeech/small/150k/LJ001-0174.wav
diff --git a/demo/LJSpeech/small/150k/LJ002-0002.png b/demo/LJSpeech/small/150k/LJ002-0002.png
diff --git a/demo/LJSpeech/small/150k/LJ002-0002.wav b/demo/LJSpeech/small/150k/LJ002-0002.wav
diff --git a/demo/LJSpeech/small/150k/LJ011-0269.png b/demo/LJSpeech/small/150k/LJ011-0269.png
diff --git a/demo/LJSpeech/small/150k/LJ011-0269.wav b/demo/LJSpeech/small/150k/LJ011-0269.wav
diff --git a/demo/LJSpeech/small/150k/LJ017-0025.png b/demo/LJSpeech/small/150k/LJ017-0025.png
diff --git a/demo/LJSpeech/small/150k/LJ017-0025.wav b/demo/LJSpeech/small/150k/LJ017-0025.wav
diff --git a/demo/LJSpeech/small/150k/LJ028-0403.png b/demo/LJSpeech/small/150k/LJ028-0403.png
diff --git a/demo/LJSpeech/small/150k/LJ028-0403.wav b/demo/LJSpeech/small/150k/LJ028-0403.wav
diff --git a/demo/LJSpeech/small/150k/LJ045-0141.png b/demo/LJSpeech/small/150k/LJ045-0141.png
diff --git a/demo/LJSpeech/small/150k/LJ045-0141.wav b/demo/LJSpeech/small/150k/LJ045-0141.wav
diff --git a/... remembered is that the ornament, whatever it is, whether picture or patter.png b/... remembered is that the ornament, whatever it is, whether picture or patter.png
diff --git a/...oint to be remembered is that the ornament, whatever it is, whether picture or patter.wav b/...oint to be remembered is that the ornament, whatever it is, whether picture or patter.wav
diff --git a/... are of an earlier character, though they also much resemble flemish or col.png b/... are of an earlier character, though they also much resemble flemish or col.png
diff --git a/... own types are of an earlier character, though they also much resemble flemish or col.wav b/... own types are of an earlier character, though they also much resemble flemish or col.wav
diff --git a/...gements are to be found in mr. neilds state of prisons in england, scotland.png b/...gements are to be found in mr. neilds state of prisons in england, scotland.png
diff --git a/... the arrangements are to be found in mr. neilds state of prisons in england, scotland.wav b/... the arrangements are to be found in mr. neilds state of prisons in england, scotland.wav
diff --git a/demo/LJSpeech/small/175k/LJ001-0165.png b/demo/LJSpeech/small/175k/LJ001-0165.png
diff --git a/demo/LJSpeech/small/175k/LJ001-0165.wav b/demo/LJSpeech/small/175k/LJ001-0165.wav
diff --git a/demo/LJSpeech/small/175k/LJ001-0174.png b/demo/LJSpeech/small/175k/LJ001-0174.png
diff --git a/demo/LJSpeech/small/175k/LJ001-0174.wav b/demo/LJSpeech/small/175k/LJ001-0174.wav
diff --git a/demo/LJSpeech/small/175k/LJ002-0002.png b/demo/LJSpeech/small/175k/LJ002-0002.png
diff --git a/demo/LJSpeech/small/175k/LJ002-0002.wav b/demo/LJSpeech/small/175k/LJ002-0002.wav
diff --git a/demo/LJSpeech/small/175k/LJ011-0269.png b/demo/LJSpeech/small/175k/LJ011-0269.png
diff --git a/demo/LJSpeech/small/175k/LJ011-0269.wav b/demo/LJSpeech/small/175k/LJ011-0269.wav
diff --git a/demo/LJSpeech/small/175k/LJ017-0025.png b/demo/LJSpeech/small/175k/LJ017-0025.png
diff --git a/demo/LJSpeech/small/175k/LJ017-0025.wav b/demo/LJSpeech/small/175k/LJ017-0025.wav
diff --git a/demo/LJSpeech/small/175k/LJ028-0403.png b/demo/LJSpeech/small/175k/LJ028-0403.png
diff --git a/demo/LJSpeech/small/175k/LJ028-0403.wav b/demo/LJSpeech/small/175k/LJ028-0403.wav
diff --git a/demo/LJSpeech/small/175k/LJ045-0141.png b/demo/LJSpeech/small/175k/LJ045-0141.png
diff --git a/demo/LJSpeech/small/175k/LJ045-0141.wav b/demo/LJSpeech/small/175k/LJ045-0141.wav
diff --git a/... remembered is that the ornament, whatever it is, whether picture or patter.png b/... remembered is that the ornament, whatever it is, whether picture or patter.png
diff --git a/...oint to be remembered is that the ornament, whatever it is, whether picture or patter.wav b/...oint to be remembered is that the ornament, whatever it is, whether picture or patter.wav
diff --git a/... are of an earlier character, though they also much resemble flemish or col.png b/... are of an earlier character, though they also much resemble flemish or col.png
diff --git a/... own types are of an earlier character, though they also much resemble flemish or col.wav b/... own types are of an earlier character, though they also much resemble flemish or col.wav
diff --git a/...gements are to be found in mr. neilds state of prisons in england, scotland.png b/...gements are to be found in mr. neilds state of prisons in england, scotland.png
diff --git a/... the arrangements are to be found in mr. neilds state of prisons in england, scotland.wav b/... the arrangements are to be found in mr. neilds state of prisons in england, scotland.wav
diff --git a/demo/LJSpeech/small/200k/LJ001-0165.png b/demo/LJSpeech/small/200k/LJ001-0165.png
diff --git a/demo/LJSpeech/small/200k/LJ001-0165.wav b/demo/LJSpeech/small/200k/LJ001-0165.wav
diff --git a/demo/LJSpeech/small/200k/LJ001-0174.png b/demo/LJSpeech/small/200k/LJ001-0174.png
diff --git a/demo/LJSpeech/small/200k/LJ001-0174.wav b/demo/LJSpeech/small/200k/LJ001-0174.wav
diff --git a/demo/LJSpeech/small/200k/LJ002-0002.png b/demo/LJSpeech/small/200k/LJ002-0002.png
diff --git a/demo/LJSpeech/small/200k/LJ002-0002.wav b/demo/LJSpeech/small/200k/LJ002-0002.wav
diff --git a/demo/LJSpeech/small/200k/LJ011-0269.png b/demo/LJSpeech/small/200k/LJ011-0269.png
diff --git a/demo/LJSpeech/small/200k/LJ011-0269.wav b/demo/LJSpeech/small/200k/LJ011-0269.wav
diff --git a/demo/LJSpeech/small/200k/LJ017-0025.png b/demo/LJSpeech/small/200k/LJ017-0025.png
diff --git a/demo/LJSpeech/small/200k/LJ017-0025.wav b/demo/LJSpeech/small/200k/LJ017-0025.wav
diff --git a/demo/LJSpeech/small/200k/LJ028-0403.png b/demo/LJSpeech/small/200k/LJ028-0403.png
diff --git a/demo/LJSpeech/small/200k/LJ028-0403.wav b/demo/LJSpeech/small/200k/LJ028-0403.wav
diff --git a/demo/LJSpeech/small/200k/LJ045-0141.png b/demo/LJSpeech/small/200k/LJ045-0141.png
diff --git a/demo/LJSpeech/small/200k/LJ045-0141.wav b/demo/LJSpeech/small/200k/LJ045-0141.wav
diff --git a/... remembered is that the ornament, whatever it is, whether picture or patter.png b/... remembered is that the ornament, whatever it is, whether picture or patter.png
diff --git a/...oint to be remembered is that the ornament, whatever it is, whether picture or patter.wav b/...oint to be remembered is that the ornament, whatever it is, whether picture or patter.wav
diff --git a/... are of an earlier character, though they also much resemble flemish or col.png b/... are of an earlier character, though they also much resemble flemish or col.png
diff --git a/... own types are of an earlier character, though they also much resemble flemish or col.wav b/... own types are of an earlier character, though they also much resemble flemish or col.wav
diff --git a/...gements are to be found in mr. neilds state of prisons in england, scotland.png b/...gements are to be found in mr. neilds state of prisons in england, scotland.png
diff --git a/... the arrangements are to be found in mr. neilds state of prisons in england, scotland.wav b/... the arrangements are to be found in mr. neilds state of prisons in england, scotland.wav
diff --git a/demo/LJSpeech/small/320k/Hello!.png b/demo/LJSpeech/small/320k/Hello!.png
diff --git a/demo/LJSpeech/small/320k/Hello!.wav b/demo/LJSpeech/small/320k/Hello!.wav
diff --git a/demo/LJSpeech/small/320k/LJ001-0165.png b/demo/LJSpeech/small/320k/LJ001-0165.png
diff --git a/demo/LJSpeech/small/320k/LJ001-0165.wav b/demo/LJSpeech/small/320k/LJ001-0165.wav
diff --git a/demo/LJSpeech/small/320k/LJ001-0174.png b/demo/LJSpeech/small/320k/LJ001-0174.png
diff --git a/demo/LJSpeech/small/320k/LJ001-0174.wav b/demo/LJSpeech/small/320k/LJ001-0174.wav
diff --git a/demo/LJSpeech/small/320k/LJ002-0002.png b/demo/LJSpeech/small/320k/LJ002-0002.png
diff --git a/demo/LJSpeech/small/320k/LJ002-0002.wav b/demo/LJSpeech/small/320k/LJ002-0002.wav
diff --git a/demo/LJSpeech/small/320k/LJ011-0269.png b/demo/LJSpeech/small/320k/LJ011-0269.png
diff --git a/demo/LJSpeech/small/320k/LJ011-0269.wav b/demo/LJSpeech/small/320k/LJ011-0269.wav
diff --git a/demo/LJSpeech/small/320k/LJ017-0025.png b/demo/LJSpeech/small/320k/LJ017-0025.png
diff --git a/demo/LJSpeech/small/320k/LJ017-0025.wav b/demo/LJSpeech/small/320k/LJ017-0025.wav
diff --git a/demo/LJSpeech/small/320k/LJ028-0403.png b/demo/LJSpeech/small/320k/LJ028-0403.png
diff --git a/demo/LJSpeech/small/320k/LJ028-0403.wav b/demo/LJSpeech/small/320k/LJ028-0403.wav
diff --git a/demo/LJSpeech/small/320k/LJ045-0141.png b/demo/LJSpeech/small/320k/LJ045-0141.png
diff --git a/demo/LJSpeech/small/320k/LJ045-0141.wav b/demo/LJSpeech/small/320k/LJ045-0141.wav
diff --git a/demo/LJSpeech/small/320k/This is a sample speech..png b/demo/LJSpeech/small/320k/This is a sample speech..png
diff --git a/demo/LJSpeech/small/320k/This is a sample speech..wav b/demo/LJSpeech/small/320k/This is a sample speech..wav
diff --git a/... remembered is that the ornament, whatever it is, whether picture or patter.png b/... remembered is that the ornament, whatever it is, whether picture or patter.png
diff --git a/...oint to be remembered is that the ornament, whatever it is, whether picture or patter.wav b/...oint to be remembered is that the ornament, whatever it is, whether picture or patter.wav
diff --git a/... are of an earlier character, though they also much resemble flemish or col.png b/... are of an earlier character, though they also much resemble flemish or col.png
diff --git a/... own types are of an earlier character, though they also much resemble flemish or col.wav b/... own types are of an earlier character, though they also much resemble flemish or col.wav
diff --git a/...gements are to be found in mr. neilds state of prisons in england, scotland.png b/...gements are to be found in mr. neilds state of prisons in england, scotland.png
diff --git a/... the arrangements are to be found in mr. neilds state of prisons in england, scotland.wav b/... the arrangements are to be found in mr. neilds state of prisons in england, scotland.wav
diff --git a/img/tensorboard_audio.png b/img/tensorboard_audio.png
diff --git a/img/tensorboard_loss.png b/img/tensorboard_loss.png
diff --git a/img/tensorboard_loss_small.png b/img/tensorboard_loss_small.png
diff --git a/img/tensorboard_spec.png b/img/tensorboard_spec.png
diff --git a/img/val_attn_step_125000_LJ040-0055_ctc.png b/img/val_attn_step_125000_LJ040-0055_ctc.png
diff --git a/img/val_attn_step_125000_LJ040-0055_dga.png b/img/val_attn_step_125000_LJ040-0055_dga.png
diff --git a/img/val_attn_step_125000_LJ040-0055_none.png b/img/val_attn_step_125000_LJ040-0055_none.png