[
http://issues.apache.org/jira/browse/LUCENE-478?page=comments#action_12361493 ]
Daniel Naber commented on LUCENE-478:
-------------------------------------
This is how the code looks currently:
| < CJ: // Chinese, Japanese
[
"\u3040"-"\u318f",
"\u3300"-"\u337f",
"\u3400"-"\u3d2d",
"\u4e00"-"\u9fff",
"\uf900"-"\ufaff"
]
>
| < KOREAN: // Korean
[
"\uac00"-"\ud7af"
]
>
Are your suggested changes still needed and if so, where should which range be
added (Chinese/Japanese or Korean)?
> CJK char list
> -------------
>
> Key: LUCENE-478
> URL: http://issues.apache.org/jira/browse/LUCENE-478
> Project: Lucene - Java
> Type: Bug
> Components: Analysis
> Versions: 1.4
> Reporter: John Wang
> Priority: Minor
>
> Seems the character list in the CJK section of the StandardTokenizer.jj is
> not quite complete. Following is a more complete list:
> < CJK: // non-alphabets
> [
> "\u1100"-"\u11ff",
> "\u3040"-"\u30ff",
> "\u3130"-"\u318f",
> "\u31f0"-"\u31ff",
> "\u3300"-"\u337f",
> "\u3400"-"\u4dbf",
> "\u4e00"-"\u9fff",
> "\uac00"-"\ud7a3",
> "\uf900"-"\ufaff",
> "\uff65"-"\uffdc"
> ]
> >
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
