Hi,
In the lucene-1.3-final version's CHANGES.txt it is written that "Fix
StandardTokenizer's handling of CJK characters (Chinese, Japanese and Korean
ideograms)."
Does it mean that for CJK characters we now do not need to use any separate
analyzer, standard analyzer will be sufficient??
You tell us. Does it work for you?
An analyzer is a pretty personal decision based on your dataset, so it is impossible to answer your question directly.
Erik
--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
