NGramTokenizer issue

2008-06-25 Thread Jonathan Ariel
Hi, I've been trying to use the NGramTokenizer and I ran into a problem. It seems like solr is trying to match documents with all the tokens that the analyzer returns from the query term. So if I index a document with a title field with the value nice dog and search for dog (where the

Re: NGramTokenizer issue

2008-06-25 Thread Norberto Meijome
On Wed, 25 Jun 2008 15:37:09 -0300 Jonathan Ariel [EMAIL PROTECTED] wrote: I've been trying to use the NGramTokenizer and I ran into a problem. It seems like solr is trying to match documents with all the tokens that the analyzer returns from the query term. So if I index a document with a

Re: NGramTokenizer issue

2008-06-25 Thread Jonathan Ariel
Well, it is working if I search just two letters, but that just tells me that something is wrong somewhere. The Analysis tools is showing me how dog is being tokenized to do og, so if when indexing and querying I'm using the same tokenizer/filters (which is my case) I should get results even when

Re: NGramTokenizer issue

2008-06-25 Thread Norberto Meijome
On Thu, 26 Jun 2008 10:44:32 +1000 Norberto Meijome [EMAIL PROTECTED] wrote: On Wed, 25 Jun 2008 15:37:09 -0300 Jonathan Ariel [EMAIL PROTECTED] wrote: I've been trying to use the NGramTokenizer and I ran into a problem. It seems like solr is trying to match documents with all the tokens

Re: NGramTokenizer issue

2008-06-25 Thread Jonathan Ariel
Ok. Played a bit more with that. So I had a difference between my unit test and solr. In solr I'm actually using a solr.RemoveDuplicatesTokenFilterFactory when querying. Tried to add that to the test, and it fails. So in my case I think the error is trying to use a

Re: NGramTokenizer issue

2008-06-25 Thread Norberto Meijome
On Thu, 26 Jun 2008 01:15:34 -0300 Jonathan Ariel [EMAIL PROTECTED] wrote: Ok. Played a bit more with that. So I had a difference between my unit test and solr. In solr I'm actually using a solr.RemoveDuplicatesTokenFilterFactory when querying. Tried to add that to the test, and it fails. So