Skip to content

Lingua 1.1.0

Compare
Choose a tag to compare
@github-actions github-actions released this 22 Aug 18:08
· 104 commits to main since this release

Features

  • The new method LanguageDetectorBuilder.with_low_accuracy_mode() has been introduced. By activating it, detection accuracy for short text is reduced in favor of a smaller memory footprint and faster detection performance.

Improvements

  • The memory footprint has been reduced significantly by storing the language models in structured NumPy arrays instead of dictionaries. This reduces memory consumption from 2600 MB to 800 MB, approximately.
  • Several language model files have become obsolete and could be deleted without decreasing detection accuracy. This results in a smaller memory footprint.

Compatibility

  • The lowest supported Python version is 3.8 now. Python 3.7 is no longer compatible with this library.