[ 
https://issues.apache.org/jira/browse/SOLR-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

James Dyer updated SOLR-2993:
-----------------------------

    Attachment: SOLR-2993.patch

Here is a new patch that can better handle collations involving mixed 
required/prohibited/optional terms and also boolean operators (AND/OR/NOT).

When combining words, we do not want to combine an optional term with a 
prohibited one, etc.  We also do not want to combine words that belong to 
different boolean clauses or those that were "NOT"ed to one another.

Likewise, when splitting a term into multiples, we want to ensure all the 
resulting terms are required if the original one was required, etc.  Also, if 
the query contains boolean operators (AND/OR/NOT), this version ANDs the split 
terms together.

In the case of Boolean operators, SpellingQueryConverter can only make a guess 
as to the best action.  It doesn't know the actual query parser used, the 
default "q.op" or "mm" setting, etc.  All this does is make a reasonable guess 
as to the best way to re-write the query if corrections involved combining 
and/or splitting words.

See WordBreakSpellCheckerTest#testCollate and 
SpellingQueryConverterTest#testRequiredOrProhibitedFlags for examples of how 
this works.

Unless there are other issues, I plan to commit this in a few days.
                
> Integrate WordBreakSpellChecker with Solr
> -----------------------------------------
>
>                 Key: SOLR-2993
>                 URL: https://issues.apache.org/jira/browse/SOLR-2993
>             Project: Solr
>          Issue Type: Improvement
>          Components: spellchecker
>    Affects Versions: 4.0
>            Reporter: James Dyer
>            Assignee: James Dyer
>            Priority: Minor
>             Fix For: 4.0, 5.0
>
>         Attachments: SOLR-2993.patch, SOLR-2993.patch, SOLR-2993.patch, 
> SOLR-2993.patch
>
>
> A SpellCheckComponent enhancement, leveraging the WordBreakSpellChecker from 
> LUCENE-3523:
> - Detect spelling errors resulting from misplaced whitespace without the use 
> of shingle-based dictionaries.  
> - Seamlessly integrate word-break suggestions with single-word spelling 
> corrections from the existing FileBased-, IndexBased- or Direct- spell 
> checkers.  
> - Provide collation support for word-break errors including cases where the 
> user has a mix of single-word spelling errors and word-break errors in the 
> same query.  
> - Provide shard support.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to