Michael McCandless created LUCENE-5012:
------------------------------------------
Summary: Make graph-based TokenFilters easier
Key: LUCENE-5012
URL: https://issues.apache.org/jira/browse/LUCENE-5012
Project: Lucene - Core
Issue Type: Improvement
Components: modules/analysis
Reporter: Michael McCandless
Assignee: Michael McCandless
SynonymFilter has two limitations today:
* It cannot create positions, so eg dns -> domain name service
creates blatantly wrong highlights (SOLR-3390, LUCENE-4499 and
others).
* It cannot consume a graph, so e.g. if you try to apply synonyms
after Kuromoji tokenizer I'm not sure what will happen.
I've thought about how to fix these issues but it's really quite
difficult with the current PosInc/PosLen graph representation, so I'd
like to explore an alternative approach.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
