Skip to content

LSTM: lowest char training % not saved as checkpoint #956

Closed
@Shreeshrii

Description

It seems that LSTM training does not keep track of the 'minima' that might be reached during training, but instead saves the char train % at every 100 iterations ...

Iteration 12990: ALIGNED TRUTH : तुलसीनामषोडशकस्तोत्रम् - तुलसीषोडशनामावलिः
Iteration 12990: BEST OCR TEXT : तुलसीनामषोडशकस्तोत्रम् - तुलसीषोडशनामावलिः
File /home/shree/tesstutorial/san/tulasi16-1.lstmf page 0 (Perfect):
Mean rms=0.499%, delta=0.542%, train=2.007%(6.855%), skip ratio=10.5%
Iteration 12991: ALIGNED TRUTH : विघ्नेश्वरपूजां कलशपूजां तुलसी पूजां च यथाविधि निर्वर्त्य .....
Iteration 12991: BEST OCR TEXT : विघ्नेश्वरपूजां कलशपूजां तुलसी पूजां च यथाविधि निर्वर्त्य .....
File /home/shree/tesstutorial/san/tulasi1.lstmf page 0 (Perfect):

Mean rms=0.498%, delta=0.539%, train=1.997%(6.809%), skip ratio=10.5%

Iteration 12992: ALIGNED TRUTH : त....णःपौत... शरं, श पु
Iteration 12992: BEST OCR TEXT : र्भं.... शर्मःरीं... शर्मःरी,शर्मःपुरी
File /home/shree/tesstutorial/san/tulasi2.lstmf page 0 :
Mean rms=0.5%, delta=0.541%, train=2.041%(6.901%), skip ratio=10.5%
Iteration 12993: ALIGNED TRUTH : क्षीरोदधौ जाग्रतोऽसावेकादश्यां तु का र्तिके ।
Iteration 12993: BEST OCR TEXT : क्षीरोदधौ जाग्रतोऽसावेकादश्यां तु का्तिके ।
File /home/shree/tesstutorial/san/tulasi3.lstmf page 8 (Perfect):
Mean rms=0.5%, delta=0.541%, train=2.046%(6.934%), skip ratio=10.5%
Iteration 12994: ALIGNED TRUTH : जयशब्दं च तद्द्वारे बोधयामास सुन्दरीम् ॥ ४
Iteration 12994: BEST OCR TEXT : जयशब्दं च तद््ारे बोधयामास सुन्दरीम् ॥ ४
File /home/shree/tesstutorial/san/tulasi5.lstmf page 8 (Perfect):
Mean rms=0.5%, delta=0.541%, train=2.048%(6.942%), skip ratio=10.5%
Iteration 12995: ALIGNED TRUTH : विश्वपावन्यै नमः । पुष्पसारायै नमः । नन्दिन्यै नमः । तुलस्यै नमः
Iteration 12995: BEST OCR TEXT : विश्वपावन्यै नमः । पुष्पसारायै नमः । नन्दिन्यै नमः । तुलस्यै नमः
File /home/shree/tesstutorial/san/tulasi8.lstmf page 0 (Perfect):
Mean rms=0.5%, delta=0.541%, train=2.046%(6.932%), skip ratio=10.5%
Iteration 12996: ALIGNED TRUTH : होएत अछी। ई निकुञ्जक शिवपुरी क्षेत्रक सरदर लम्बाई २०
Iteration 12996: BEST OCR TEXT : होएत अछी। ई निकुञ्जक शिवपुरी क्षेत्रक सरदर लम्बाई २०
File /tmp/tmp.TBOyJ1H1Gv/san/bih.Siddhanta.exp-0.lstmf page 3570 (Perfect):
Mean rms=0.499%, delta=0.537%, train=2.04%(6.832%), skip ratio=10.3%
Iteration 12997: ALIGNED TRUTH : शतके कुक्कुटो प्रेक्ष्य । } अस्ति पश्यन्ति प्राप्नोत् भविष्यति।। ता ऍम॰ दिने कृपालुं
Iteration 12997: BEST OCR TEXT : शतके कुक्कुटो प्रेक्ष्य । } अस्ति पश्यन्ति प्राप्नोत् भविष्यति।। ता ऍम॰ दिने कृपालुं
File /tmp/tmp.TBOyJ1H1Gv/san/san.Arial_Unicode_MS.exp0.lstmf page 16 (Perfect):
Mean rms=0.499%, delta=0.537%, train=2.04%(6.832%), skip ratio=10.3%
Iteration 12998: ALIGNED TRUTH : सर्वशक्तिमते परमात्मने श्री रामाय नमः ॥ ✾ ✿ ➜ ॐ स्वस्तिक शुभ चिन्ह
Iteration 12998: BEST OCR TEXT : सर्वशक्तिमते परमात्मने श्री रामाय नमः ॥ ✾ ✿ ➜ ॐ स्वस्तिक शुभ चिन्ह
File /tmp/tmp.TBOyJ1H1Gv/san/san.FreeSerif.exp0.lstmf page 14 (Perfect):
Mean rms=0.498%, delta=0.536%, train=2.038%(6.832%), skip ratio=10.3%
Iteration 12999: ALIGNED TRUTH : कथम्चित् ॥ । ता प्रद्युम्न अतीव । त<Undecodable><Undecodable> दक्षो राक्षसो श्रियं शङ्खाश्च 58 अर्थो १५ ३५॥ ॥
Iteration 12999: BEST OCR TEXT : कथम्चित् ॥ । ता प्रद्युम्न अतीव । त<Undecodable><Undecodable> दक्षो राक्षसो श्रियं शङ्काश्च 58 अर्थो १५ ३५॥ ॥
File /tmp/tmp.TBOyJ1H1Gv/san/san.Siddhanta.exp1.lstmf page 169 :

Mean rms=0.498%, delta=0.536%, train=2.04%(6.838%), skip ratio=10.3%

2 Percent improvement time=1651, best error was 4.066 @ 4741
At iteration 6392/13000/14254, Mean rms=0.498%, delta=0.536%, char train=2.04%, word train=6.838%, skip ratio=10.3%,  New best char error = 2.04 wrote checkpoint.

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions