Language Identification with Support for More Than 2000 Labels -- EMNLP 2023

Faster, modernized fork of the language identification tool langid.py

An AI model that automatically detects the language of a given text supported by 3 pre-trained NLP models and one ML algorithm.

.NET Port of Language Identification Library for langid-java. 移植自langid-java的语言识别库。

A Julia package for language identification.

Trainable language identifier

Language detection (majority voting)

To 1) create train/test samples of Tatoeba sentences for NLP-related tasks & 2) evaluate the performance of different solutions for detecting the language of a given text.