FuzzyLookup does not return exact matches first

2014-08-15 Thread Harun Reşit Zafer

I have the following configuration.

searchComponent class=solr.SpellCheckComponent name=suggest
lst name=spellchecker
str name=namefsuggest/str
str 
name=classnameorg.apache.solr.spelling.suggest.Suggester/str
str 
name=lookupImplorg.apache.solr.spelling.suggest.fst.FuzzyLookupFactory/str

str name=suggestAnalyzerFieldTypetext_suggest/str
str name=fieldtext_suggest/str
str name=sourceLocationsuggestionsFull.txt/str
bool name=exactMatchFirsttrue/bool
bool name=preserveSepfalse/bool
/lst
str name=queryAnalyzerFieldTypetext_suggest/str
/searchComponent

queryConverter name=queryConverter 
class=org.apache.solr.spelling.SuggestQueryConverter/


 requestHandler 
class=org.apache.solr.handler.component.SearchHandler name=/fsuggest

lst name=defaults
str name=spellchecktrue/str
str name=spellcheck.dictionaryfsuggest/str
str name=spellcheck.onlyMorePopulartrue/str
str name=spellcheck.count5/str
/lst
arr name=components
strsuggest/str
/arr
/requestHandler

When I search for beşiktaş s I got the following suggesitons. Since 
minEdit=1 and all the following phrases has a prefix that has 1 edit 
distance with the query, they match.


beşiktaş ile
beşiktaş kulübü
beşiktaş ve
beşiktaş cola
beşiktaş teknik

However there are suggestions starting with exactly beşiktaş s. But 
their weight are less than the above.


beşiktaş son
beşiktaş spor
beşiktaş spor toto
beşiktaş süper
beşiktaş sivasspor


Any solution/work around?


--
Harun Reşit Zafer
TÜBİTAK BİLGEM BTE
Bulut Bilişim ve Büyük Veri Analiz Sistemleri Bölümü
T +90 262 675 3268
W  http://www.hrzafer.com



Autosuggest with spelling correction

2014-08-13 Thread Harun Reşit Zafer

Hi everyone,

Currently I'm using AnalyzingInfixLookupFactory with a suggestions file 
containing up to 3 word phrases. However this component can't keep 
suggesting in case of spelling errors. I heard about FuzzySuggester and 
found some sample configurations here 
http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-phrasesuggest.xml. 
But I  couldn't make any of them work. I got the same error: 
...solr-4.9.0\example\solr\collection1\data\fuzzy_suggest_analyzing\fwfsta.bin 
(The system cannot find the file specified).


In short, is there a Suggester component that supports both infix lookup 
and fuzzy suggest, and where can I find a proper sample configuration.


Thanks

--
Harun Reşit Zafer
TÜBİTAK BİLGEM BTE
Bulut Bilişim ve Büyük Veri Analiz Sistemleri Bölümü
T +90 262 675 3268
W  http://www.hrzafer.com



Re: When I use minimum match and maxCollationTries parameters together in edismax, Solr gets stuck

2014-08-12 Thread Harun Reşit Zafer
I happens once the server is fully started. And when it gets stuck 
sometimes I have to restart the server, sometimes I'm able to edit the 
solrconfig.xml and reload it.


Harun Reşit Zafer
TÜBİTAK BİLGEM BTE
Bulut Bilişim ve Büyük Veri Analiz Sistemleri Bölümü
T +90 262 675 3268
W  http://www.hrzafer.com

On 11.08.2014 17:32, Dyer, James wrote:

Harun,

Just to clarify, is this happening during startup when a warmup query is 
running, or is this once the server is fully started?  This might be another 
instance of https://issues.apache.org/jira/browse/SOLR-5386 .

James Dyer
Ingram Content Group
(615) 213-4311


-Original Message-
From: Harun Reşit Zafer [mailto:harun.za...@tubitak.gov.tr]
Sent: Monday, August 11, 2014 8:39 AM
To: solr-user@lucene.apache.org
Subject: When I use minimum match and maxCollationTries parameters together in 
edismax, Solr gets stuck

Hi,

In the following configuration when uncomment both mm and
maxCollationTries lines, and run a query on |/select|, Solr gets stuck
with no exception.

I tried different values for both parameters and found that values for
mm less than %40 still works.


|requestHandler name=/select class=solr.SearchHandler
  !-- default values for query parameters can be specified, these
   will be overridden by parameters in the request
--
   lst name=defaults
 str name=echoParamsexplicit/str
 str name=defTypeedismax/str
 int name=timeAllowed1000/int
 str name=qftitle^3 title_s^2 content/str
 str name=pftitle content/str
 str name=flid,title,content,score/str
 float name=tie0.1/float
 str name=lowercaseOperatorstrue/str
 str name=stopwordstrue/str
 !-- str name=mm75%/str--
 int name=rows10/int

 str name=spellcheckon/str
 str name=spellcheck.dictionarydefault/str
 str name=spellcheck.dictionarywordbreak/str
 str name=spellcheck.onlyMorePopulartrue/str
 str name=spellcheck.count5/str
 str name=spellcheck.maxResultsForSuggest5/str
 str name=spellcheck.extendedResultsfalse/str
 str name=spellcheck.alternativeTermCount2/str
 str name=spellcheck.collatetrue/str
 str name=spellcheck.collateExtendedResultstrue/str
 str name=spellcheck.maxCollationTries5/str
 !-- str name=spellcheck.collateParam.mm100%/str--

 str name=spellcheck.maxCollations3/str
   /lst

   arr name=last-components
 strspellcheck/str
   /arr

  /requestHandler

Any idea? Thanks
|






Re: When I use minimum match and maxCollationTries parameters together in edismax, Solr gets stuck

2014-08-12 Thread Harun Reşit Zafer
I tried again to make sure. Server starts, I can see web admin gui but I 
can't navigate btw tabs. It just says loading. But on the terminal 
console everything seems normal.


Harun Reşit Zafer
TÜBİTAK BİLGEM BTE
Bulut Bilişim ve Büyük Veri Analiz Sistemleri Bölümü
T +90 262 675 3268
W  http://www.hrzafer.com

On 12.08.2014 09:42, Harun Reşit Zafer wrote:
I happens once the server is fully started. And when it gets stuck 
sometimes I have to restart the server, sometimes I'm able to edit the 
solrconfig.xml and reload it.


Harun Reşit Zafer
TÜBİTAK BİLGEM BTE
Bulut Bilişim ve Büyük Veri Analiz Sistemleri Bölümü
T +90 262 675 3268
W  http://www.hrzafer.com

On 11.08.2014 17:32, Dyer, James wrote:

Harun,

Just to clarify, is this happening during startup when a warmup query 
is running, or is this once the server is fully started? This might 
be another instance of https://issues.apache.org/jira/browse/SOLR-5386 .


James Dyer
Ingram Content Group
(615) 213-4311


-Original Message-
From: Harun Reşit Zafer [mailto:harun.za...@tubitak.gov.tr]
Sent: Monday, August 11, 2014 8:39 AM
To: solr-user@lucene.apache.org
Subject: When I use minimum match and maxCollationTries parameters 
together in edismax, Solr gets stuck


Hi,

In the following configuration when uncomment both mm and
maxCollationTries lines, and run a query on |/select|, Solr gets stuck
with no exception.

I tried different values for both parameters and found that values for
mm less than %40 still works.


|requestHandler name=/select class=solr.SearchHandler
  !-- default values for query parameters can be specified, these
   will be overridden by parameters in the request
--
   lst name=defaults
 str name=echoParamsexplicit/str
 str name=defTypeedismax/str
 int name=timeAllowed1000/int
 str name=qftitle^3 title_s^2 content/str
 str name=pftitle content/str
 str name=flid,title,content,score/str
 float name=tie0.1/float
 str name=lowercaseOperatorstrue/str
 str name=stopwordstrue/str
 !-- str name=mm75%/str--
 int name=rows10/int

 str name=spellcheckon/str
 str name=spellcheck.dictionarydefault/str
 str name=spellcheck.dictionarywordbreak/str
 str name=spellcheck.onlyMorePopulartrue/str
 str name=spellcheck.count5/str
 str name=spellcheck.maxResultsForSuggest5/str
 str name=spellcheck.extendedResultsfalse/str
 str name=spellcheck.alternativeTermCount2/str
 str name=spellcheck.collatetrue/str
 str name=spellcheck.collateExtendedResultstrue/str
 str name=spellcheck.maxCollationTries5/str
 !-- str name=spellcheck.collateParam.mm100%/str--

 str name=spellcheck.maxCollations3/str
   /lst

   arr name=last-components
 strspellcheck/str
   /arr

  /requestHandler

Any idea? Thanks
|









When I use minimum match and maxCollationTries parameters together in edismax, Solr gets stuck

2014-08-11 Thread Harun Reşit Zafer

Hi,

In the following configuration when uncomment both mm and 
maxCollationTries lines, and run a query on |/select|, Solr gets stuck 
with no exception.


I tried different values for both parameters and found that values for 
mm less than %40 still works.



|requestHandler name=/select class=solr.SearchHandler
!-- default values for query parameters can be specified, these
 will be overridden by parameters in the request
  --
 lst name=defaults
   str name=echoParamsexplicit/str
   str name=defTypeedismax/str
   int name=timeAllowed1000/int
   str name=qftitle^3 title_s^2 content/str
   str name=pftitle content/str
   str name=flid,title,content,score/str
   float name=tie0.1/float
   str name=lowercaseOperatorstrue/str
   str name=stopwordstrue/str
   !-- str name=mm75%/str--
   int name=rows10/int

   str name=spellcheckon/str
   str name=spellcheck.dictionarydefault/str
   str name=spellcheck.dictionarywordbreak/str
   str name=spellcheck.onlyMorePopulartrue/str
   str name=spellcheck.count5/str
   str name=spellcheck.maxResultsForSuggest5/str
   str name=spellcheck.extendedResultsfalse/str
   str name=spellcheck.alternativeTermCount2/str
   str name=spellcheck.collatetrue/str
   str name=spellcheck.collateExtendedResultstrue/str
   str name=spellcheck.maxCollationTries5/str
   !-- str name=spellcheck.collateParam.mm100%/str--

   str name=spellcheck.maxCollations3/str
 /lst

 arr name=last-components
   strspellcheck/str
 /arr

/requestHandler

Any idea? Thanks
|


--
Harun Reşit Zafer
TÜBİTAK BİLGEM BTE
Bulut Bilişim ve Büyük Veri Analiz Sistemleri Bölümü
T +90 262 675 3268
W  http://www.hrzafer.com



Fwd: FuzzyLookupFactory fwfsta.bin

2013-12-11 Thread Harun Reşit Zafer

With the configration below:

searchComponent class=solr.SpellCheckComponent name=suggest
   lst name=spellchecker
  str name=namesuggest/str
  str 
name=classnameorg.apache.solr.spelling.suggest.Suggester/str
  str 
name=lookupImplorg.apache.solr.spelling.suggest.fst.FuzzyLookupFactory/str

  str name=storeDirfuzzy_suggest_analyzing/str
  str name=buildOnCommittrue/str

  str name=suggestAnalyzerFieldTypetext_tr/str

  str name=sourceLocationsuggestions.txt/str

  !-- Suggester properties --
  bool name=exactMatchFirsttrue/bool
  bool name=preserveSepfalse/bool

   /lst

   str name=queryAnalyzerFieldTypelowercase/str
/searchComponent

*I got th**e error:*

...\solr-4.6.0\example\solr\collection1\data\fuzzy_suggest_analyzing\fwfsta.bin 
(The system cannot find the file specified)



--
Harun Reşit Zafer
TÜBİTAK BİLGEM BTE
Metin Madenciliği ve Kaynaştırma Sistemleri Bölümü
T +90 262 675 3268
Whttp://www.hrzafer.com