New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

修复加载用户字典时total不改变，添加是否加载默认字典配置 #58

Open

alexqdjay wants to merge 3 commits into huaban:master from alexqdjay:master

alexqdjay commented Jul 30, 2017

之前加载用户字典时total不会改变，这会导致最后计算频率比时不精确，特别是用户字典也非常大时
用户字典跟默认字典产生冲突时会覆盖之前的，应该是相加，其实是对之前训练预料的扩展
是否加载默认字典可配置，可在初始化WorkDictionary之前调用
```
System.setProperty("jieba.defaultDict", "false")  //禁止使用默认词库 
```
或者启动参数中添加 -Djieba.defaultDict=false，禁用默认词库对专业领域分词是非常必要的

alexqdjay added 3 commits

July 29, 2017 16:59


          添加gradle方式

76463c2


          修改加载用户自定义字典时没有将次数算入total

b0facfd


          是否使用默认字典可配置

51f3af1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet