Standard Tokenizer doesn't recognise I.B.M as Acronym, it requires it ends with
a dot i.e I.B.M.
------------------------------------------------------------------------------------------------
Key: LUCENE-1787
URL: https://issues.apache.org/jira/browse/LUCENE-1787
Project: Lucene - Java
Issue Type: Improvement
Components: Analysis
Affects Versions: 2.9
Reporter: Paul taylor
Standard Tokenzizer doesn't recognise I.B.M it requires it end with a dot i.e
I.B.M. This is particulary problematic if I.B.M is added tot the index, with
the StandardAnalyser it will get added as IBM , a search for I.B.M will not
match because I.B.M will be left as is, I would expect a match in this scenario
I think it could be fixed by modifying the grammar ACRONYM_DEP in
StandardTokenizerImpl.jflex so that it also supports
{ALPHANUM} ("." {ALPHANUM})+
dot only required between each character, (I'm not familiar with jflex syntax )
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org
