[
https://issues.apache.org/jira/browse/LUCENE-4956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13856704#comment-13856704
]
Robert Muir commented on LUCENE-4956:
-------------------------------------
Yes, the nocommits.
In general there are not enough tests to proceed fixing more things. I took it
as far as I could with TestCoverageHack, but the stuff like the AIOOBE-catching
is just the tip of the iceberg to some problems in WSOutput/WordSpaceAnalyzer.
The main challenge here is just that, there are many many many special cases
happening in the analysis logic. There needs to be good tests for these, rather
than just testing that the analysis "does not change" because currently the
analysis does really funky things in some situations and needs to change.
TokenStream logic needs cleanup too: offsets/posincs and so on need to work and
BaseTokenStreamTestCase.checkRandomData etc should pass.
> the korean analyzer that has a korean morphological analyzer and dictionaries
> -----------------------------------------------------------------------------
>
> Key: LUCENE-4956
> URL: https://issues.apache.org/jira/browse/LUCENE-4956
> Project: Lucene - Core
> Issue Type: New Feature
> Components: modules/analysis
> Affects Versions: 4.2
> Reporter: SooMyung Lee
> Assignee: Christian Moen
> Labels: newbie
> Attachments: LUCENE-4956.patch, eval.patch, kr.analyzer.4x.tar,
> lucene-4956.patch, lucene4956.patch
>
>
> Korean language has specific characteristic. When developing search service
> with lucene & solr in korean, there are some problems in searching and
> indexing. The korean analyer solved the problems with a korean morphological
> anlyzer. It consists of a korean morphological analyzer, dictionaries, a
> korean tokenizer and a korean filter. The korean anlyzer is made for lucene
> and solr. If you develop a search service with lucene in korean, It is the
> best idea to choose the korean analyzer.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
