normalize chinese characters r=chris

Author Forrest Sun <sxh19911230@gmail.com>
Author date 2020-07-21 12:Jul:st
Author local date 2020-07-21 05:Jul:st -0700
Committer Chris Pollett <chris@pollett.org>
Committer date 2020-07-21 18:Jul:st
Committer local date 2020-07-21 11:Jul:st -0700
Commit 71294cf47d5a94a2b81b1035a5dd06681106377f
Tree 7a7656c97266c7a001c8867e276c460a2f5caa6a
Parent 271df3e1e04e892baa14becd880bc85b72fb1880
normalize chinese characters r=chris

Signed-off-by: Chris Pollett <chris@pollett.org>
Affected files:
src/configs/TokenTool.php
src/library/NamedEntityContextTagger.php
src/library/StochasticTermSegmenter.php
src/locale/zh_CN/resources/zh2HansChar.txt.gz
ViewGit