Re: Problem with PorterStemFilter

2008-12-09 Thread Erick Erickson
Thanks for reporting back, I learned something new today... Best Erick On Tue, Dec 9, 2008 at 1:02 PM, Preetam Rao <[EMAIL PROTECTED]> wrote: > Thanks Eric. Looking at Luke output helped. > > The problem was that I had overridden tokenStream() of the StandardAnalyzer > but did not override the

Re: Problem with PorterStemFilter

2008-12-09 Thread Preetam Rao
Thanks Eric. Looking at Luke output helped. The problem was that I had overridden tokenStream() of the StandardAnalyzer but did not override the reusableTokenStream(). The IndexWriter was using reusableTokenStream() and QueryParser was using tokenStream() and hence the mismatch. So looks like one

Re: Problem with PorterStemFilter

2008-12-08 Thread Erick Erickson
your output says you couldn't find "ugli", but you indexed "ugly". I assume that's just a typo, and the stemmer probably makes it moot anyway I don't see anything obvious in the code, but here's what I'd suggest... 1> write this out to a FSDir rather than a RAMDir, get a copy of Luke (goo