Source codes for paper:
CNN-Based Chinese NER with Lexicon Rethinking
Python 3.6
Pytorch 0.4.1
CoNLL format, with each character and its label split by a whitespace in a line. The "BMES" tag scheme is prefered.
别 O
错 O
过 O
邻 O
近 O
大 B-LOC
鹏 M-LOC
湾 E-LOC
的 O
湿 O
地 O
The pretrained embeddings(word embedding, char embedding) are the same with Lattice LSTM(https://github.com/jiesutd/LatticeLSTM)
- Download the character embeddings and word embeddings and put them in the
data
folder. - To train/test the demo:
sh train.sh
/sh test.sh
- To train/test your own data: modify the 'train.sh' or 'test.sh' file with your file path, and run the shell file.