Skip to content

Latest commit

 

History

History

resources

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 

About the "languages" folder and files

Most of these files are from the original software from Nakatani Shuyo. Unfortunately, the data sources from which they were generated are not available. It looks like the text comes from Wikipedia pages.

To generate your own language profile, see the main readme at https://github.com/optimaize/language-detector

km Khmer: sources available, see #19

About the "languages.shorttext" folder and files

These files are from the original software from Nakatani Shuyo.

Either they are for detecting language on short messages, or they are built from short message text, or both, I don't know.

About the "messages.properties" file

They are used in the CharNormalizer.