fixed tokenization counting error, added more english tokenization
authorMarc Cromme <marc@indexdata.dk>
Thu, 10 May 2007 10:29:58 +0000 (10:29 +0000)
committerMarc Cromme <marc@indexdata.dk>
Thu, 10 May 2007 10:29:58 +0000 (10:29 +0000)
commit5d6bbb98e223ed34bd25f7c6f7ca1ac44e9c2684
treee591adcca92463e516d60b36f23474ff27d016e1
parent4d37a7d84107f77bd61f5eb057ed99c59b84607d
fixed tokenization counting error, added more english tokenization
unit tests
src/test_icu_I18N.c