[
https://issues.apache.org/jira/browse/LUCENE-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12740233#action_12740233
]
Shai Erera commented on LUCENE-1787:
------------------------------------
We should fix ACRONYM, not ACRONYM_DEP right? ACRONYM_DEP is deprecated and
will be removed in 3.0. Instead, you can change ACRONYM to
{LETTER} ("." {LETTER})+ (".")? which will match I.B.M. and I.B.M. For the
first example, it will eat the last dot as well, which IMO is important.
BTW, my ACRONYM rule looks like this:
// Acronyms: U.S.A., I.B.M., however also U.S.A (without the last "."). In
addition, it recognizes R&D, AT&T, A&B&C.
ACRONYM = {LETTER} ("." {LETTER})+ (".")?
| {LETTER}{1,2} (("&")
{LETTER})+
Don't know if this change is allowed at this point though.
> Standard Tokenizer doesn't recognise I.B.M as Acronym, it requires it ends
> with a dot i.e I.B.M.
> ------------------------------------------------------------------------------------------------
>
> Key: LUCENE-1787
> URL: https://issues.apache.org/jira/browse/LUCENE-1787
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Analysis
> Affects Versions: 2.9
> Reporter: Paul taylor
>
> Standard Tokenzizer doesn't recognise I.B.M it requires it end with a dot i.e
> I.B.M. This is particulary problematic if I.B.M is added tot the index, with
> the StandardAnalyser it will get added as IBM , a search for I.B.M will not
> match because I.B.M will be left as is, I would expect a match in this
> scenario
> I think it could be fixed by modifying the grammar ACRONYM_DEP in
> StandardTokenizerImpl.jflex so that it also supports
> {ALPHANUM} ("." {ALPHANUM})+
> dot only required between each character, (I'm not familiar with jflex syntax
> )
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
