Nattapong Sirilappanich created LUCENE-4254:
-----------------------------------------------
Summary: ICUCollationKeyAnalyzer fail to tokenize Thai word
Key: LUCENE-4254
URL: https://issues.apache.org/jira/browse/LUCENE-4254
Project: Lucene - Core
Issue Type: Bug
Components: modules/analysis
Affects Versions: Realtime Branch
Environment: Windows 7 SP1.
Java 1.7.0-b147
Reporter: Nattapong Sirilappanich
Current implementation is:
KeywordTokenizer tokenizer = new KeywordTokenizer(factory, reader,
KeywordTokenizer.DEFAULT_BUFFER_SIZE);
return new TokenStreamComponents(tokenizer, tokenizer);
I tried change tokenizer from KeywordTokenizer to ICUTokenizer. It return a
proper tokenized word.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
