Revision: 7876
http://languagetool.svn.sourceforge.net/languagetool/?rev=7876&view=rev
Author: dnaber
Date: 2012-08-18 19:21:49 +0000 (Sat, 18 Aug 2012)
Log Message:
-----------
[zh] run native2ascii on part of the file as my IDE chokes on this otherwise
Modified Paths:
--------------
trunk/JLanguageTool/src/test/org/languagetool/tokenizers/zh/ChineseSentenceTokenizerTest.java
Modified:
trunk/JLanguageTool/src/test/org/languagetool/tokenizers/zh/ChineseSentenceTokenizerTest.java
===================================================================
---
trunk/JLanguageTool/src/test/org/languagetool/tokenizers/zh/ChineseSentenceTokenizerTest.java
2012-08-18 13:18:45 UTC (rev 7875)
+++
trunk/JLanguageTool/src/test/org/languagetool/tokenizers/zh/ChineseSentenceTokenizerTest.java
2012-08-18 19:21:49 UTC (rev 7876)
@@ -48,7 +48,8 @@
testSplit(t2 + i + t3);// 例子：我们是中国人_中国人很好
}
- char[] punctuation2 = { '，', '：', '…', '！', '？', '、', '；', '。'
};
+ //char[] punctuation2 = { '，', '：', '…', '！', '？', '、', '；',
'。' };
+ char[] punctuation2 = { '\uff0c', '\uff1a', '\u2026', '\uff01',
'\uff1f', '\u3001', '\uff1b', '\u3002' };
for (char i : punctuation2) {
testSplit(t2 + i, t3);// 例子：我们是中国人，/中国人很好
}
This was sent by the SourceForge.net collaborative development platform, the
world's largest Open Source development site.
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Languagetool-cvs mailing list
Languagetool-cvs@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/languagetool-cvs
