Re: Size of suggest dictionary

2012-02-16 Thread Mike Hugo
Thanks Em!

What if we use a threshold value in the suggest configuration, like 

  float name=threshold0.005/float

I assume the dictionary size will then be smaller than the total number of 
distinct terms, is there anyway to determine what that size is?

Thanks,

Mike


On Wednesday, February 15, 2012 at 4:39 PM, Em wrote:

 Hello Mike,
 
 have a look at Solr's Schema Browser. Click on FIELDS, select label
 and have a look at the number of distinct (term-)values.
 
 Regards,
 Em
 
 
 Am 15.02.2012 23:07, schrieb Mike Hugo:
  Hello,
  
  We're building an auto suggest component based on the label field of
  documents. Is there a way to see how many terms are in the dictionary, or
  how much memory it's taking up? I looked on the statistics page but didn't
  find anything obvious.
  
  Thanks in advance,
  
  Mike
  
  ps- here's the config:
  
  searchComponent name=suggestlabel class=solr.SpellCheckComponent
  lst name=spellchecker
  str name=namesuggestlabel/str
  str
  name=classnameorg.apache.solr.spelling.suggest.Suggester/str
  str
  name=lookupImplorg.apache.solr.spelling.suggest.tst.TSTLookup/str
  str name=fieldlabel/str
  str name=buildOnOptimizetrue/str
  /lst
  /searchComponent
  
  requestHandler name=suggestlabel
  class=org.apache.solr.handler.component.SearchHandler
  lst name=defaults
  str name=spellchecktrue/str
  str name=spellcheck.dictionarysuggestlabel/str
  str name=spellcheck.count10/str
  /lst
  arr name=components
  strsuggestlabel/str
  /arr
  /requestHandler
  
 
 
 




Size of suggest dictionary

2012-02-15 Thread Mike Hugo
Hello,

We're building an auto suggest component based on the label field of
documents.  Is there a way to see how many terms are in the dictionary, or
how much memory it's taking up?  I looked on the statistics page but didn't
find anything obvious.

Thanks in advance,

Mike

ps- here's the config:

searchComponent name=suggestlabel class=solr.SpellCheckComponent
lst name=spellchecker
str name=namesuggestlabel/str
str
name=classnameorg.apache.solr.spelling.suggest.Suggester/str
str
name=lookupImplorg.apache.solr.spelling.suggest.tst.TSTLookup/str
str name=fieldlabel/str
str name=buildOnOptimizetrue/str
/lst
/searchComponent

requestHandler name=suggestlabel
class=org.apache.solr.handler.component.SearchHandler
lst name=defaults
str name=spellchecktrue/str
str name=spellcheck.dictionarysuggestlabel/str
str name=spellcheck.count10/str
/lst
arr name=components
strsuggestlabel/str
/arr
/requestHandler


Re: Size of suggest dictionary

2012-02-15 Thread Em
Hello Mike,

have a look at Solr's Schema Browser. Click on FIELDS, select label
and have a look at the number of distinct (term-)values.

Regards,
Em


Am 15.02.2012 23:07, schrieb Mike Hugo:
 Hello,
 
 We're building an auto suggest component based on the label field of
 documents.  Is there a way to see how many terms are in the dictionary, or
 how much memory it's taking up?  I looked on the statistics page but didn't
 find anything obvious.
 
 Thanks in advance,
 
 Mike
 
 ps- here's the config:
 
 searchComponent name=suggestlabel class=solr.SpellCheckComponent
 lst name=spellchecker
 str name=namesuggestlabel/str
 str
 name=classnameorg.apache.solr.spelling.suggest.Suggester/str
 str
 name=lookupImplorg.apache.solr.spelling.suggest.tst.TSTLookup/str
 str name=fieldlabel/str
 str name=buildOnOptimizetrue/str
 /lst
 /searchComponent
 
 requestHandler name=suggestlabel
 class=org.apache.solr.handler.component.SearchHandler
 lst name=defaults
 str name=spellchecktrue/str
 str name=spellcheck.dictionarysuggestlabel/str
 str name=spellcheck.count10/str
 /lst
 arr name=components
 strsuggestlabel/str
 /arr
 /requestHandler