Yeah.. that was weird. removing the line "forever,for ever" from my synonyms file fixed the problem. In fact, i was having the same problem for every double word like that. I decided I didn't really need the synonym filter for that field so I just took it out, but I'd really like to know what the problem is. -mike
On Mon, Sep 14, 2009 at 1:10 AM, Yonik Seeley <yo...@lucidimagination.com>wrote: > That's pretty strange... perhaps something to do with your synonyms > file mapping "for" to a zero length token? > > -Yonik > http://www.lucidimagination.com > > On Mon, Sep 14, 2009 at 12:13 AM, mike anderson <saidthero...@gmail.com> > wrote: > > I'm kind of stumped by this one.. is it something obvious? > > I'm running the latest trunk. In some cases the stopFilterFactory isn't > > removing the field name. > > > > Thanks in advance, > > > > -mike > > > > From debugQuery (both words are in the stopwords file): > > > > http://localhost:8983/solr/select?q=citations:for&debugQuery=true > > > > <str name="rawquerystring">citations:for</str> > > <str name="querystring">citations:for</str> > > <str name="parsedquery">citations:</str> > > <str name="parsedquery_toString">citations:</str> > > > > > > http://localhost:8983/solr/select?q=citations:the&debugQuery=true > > > > <str name="rawquerystring">citations:the</str> > > <str name="querystring">citations:the</str> > > <str name="parsedquery"></str> > > <str name="parsedquery_toString"></str> > > > > > > > > > > schema analyzer for this field: > > <!-- Citation text --> > > <fieldType name="citationtext" class="solr.TextField" > > positionIncrementGap="100"> > > <analyzer type="index"> > > <tokenizer class="solr.StandardTokenizerFactory"/> > > <filter class="solr.SynonymFilterFactory" > > synonyms="substitutions.txt" ignoreCase="true" expand="false"/> > > <filter class="solr.StandardFilterFactory"/> > > <filter class="solr.StopFilterFactory" ignoreCase="false" > > words="citationstopwords.txt"/> > > <filter class="solr.LowerCaseFilterFactory"/> > > <filter class="solr.ISOLatin1AccentFilterFactory"/> > > > > <!--<filter class="solr.EnglishPorterFilterFactory" > > protected="protwords.txt"/>--> > > </analyzer> > > <analyzer type="query"> > > <tokenizer class="solr.StandardTokenizerFactory"/> > > <filter class="solr.SynonymFilterFactory" > > synonyms="substitutions.txt" ignoreCase="true" expand="false"/> > > <filter class="solr.StandardFilterFactory"/> > > <filter class="solr.StopFilterFactory" ignoreCase="false" > > words="citationstopwords.txt"/> > > <filter class="solr.LowerCaseFilterFactory"/> > > <filter class="solr.ISOLatin1AccentFilterFactory"/> > > <!-- <filter class="solr.EnglishPorterFilterFactory" > > protected="protwords.txt"/> --> > > </analyzer> > > </fieldType> > > >
