Re: solr returns reduced results for same query after adding a new field to the schema.
: When I query solr with the query ?q=ingredientSuggestion=banana I get : 160 results. : Ok, all fine. : : When I add a new field such as : : : : to my index it reduces the number of results from my query to 131, even : though the query : has'nt changed and does not (at least explicitly) filter the result set. presumably you changed your DIH config in some way when you added that field? are you certain that you didn't do anything to alter the total number of docs being indexed? or that the data source didn't change between the first time you indexed and the second? -Hoss
RE: solr returns reduced results for same query after adding a new field to the schema.
yes, sorry. -Original Message- From: Dmitry Kan [mailto:dmitry@gmail.com] Sent: 28 February 2012 12:33 To: solr-user@lucene.apache.org Subject: Re: solr returns reduced results for same query after adding a new field to the schema. Hi, you meant you query is: ?q=ingredientSuggestion:banana right? On Tue, Feb 28, 2012 at 2:29 PM, Mark Swinson wrote: > Hi, > > I'm currently setting up a schema in solr, which is being imported using > the data-import plugin. > > The initial config contains the following key information: > >... > > class="solr.TextField" positionIncrementGap="100" stored="false" > multiValued="false"> > > class="solr.KeywordTokenizerFactory"/> > ignoreCase="true" words="stopwords.txt"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > > > class="solr.KeywordTokenizerFactory"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > > > > class="solr.TextField" positionIncrementGap="100" stored="false" > multiValued="true"> > > class="solr.WhitespaceTokenizerFactory"/> > ignoreCase="true" words="stopwords.txt"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > > > class="solr.WhitespaceTokenizerFactory"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > > > > class="solr.TextField" positionIncrementGap="100" stored="false" > multiValued="false"> > > class="solr.WhitespaceTokenizerFactory"/> > ignoreCase="true" words="stopwords.txt"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > class="solr.EdgeNGramFilterFactory" minGramSize="3" maxGramSize="15" > side="front"/> > > > class="solr.WhitespaceTokenizerFactory"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > > > > class="solr.TextField" positionIncrementGap="100" stored="false" > multiValued="false"> > > class="solr.WhitespaceTokenizerFactory"/> > ignoreCase="true" words="stopwords.txt"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > class="solr.EdgeNGramFilterFactory" minGramSize="3" maxGramSize="15" > side="front"/> > > > class="solr.WhitespaceTokenizerFactory"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > > >... > > with the following fields: > >... > > indexed="true" stored="true" required="true"/> > indexed="
Re: solr returns reduced results for same query after adding a new field to the schema.
Hi, you meant you query is: ?q=ingredientSuggestion:banana right? On Tue, Feb 28, 2012 at 2:29 PM, Mark Swinson wrote: > Hi, > > I'm currently setting up a schema in solr, which is being imported using > the data-import plugin. > > The initial config contains the following key information: > >... > > class="solr.TextField" positionIncrementGap="100" stored="false" > multiValued="false"> > > class="solr.KeywordTokenizerFactory"/> > ignoreCase="true" words="stopwords.txt"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > > > class="solr.KeywordTokenizerFactory"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > > > > class="solr.TextField" positionIncrementGap="100" stored="false" > multiValued="true"> > > class="solr.WhitespaceTokenizerFactory"/> > ignoreCase="true" words="stopwords.txt"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > > > class="solr.WhitespaceTokenizerFactory"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > > > > class="solr.TextField" positionIncrementGap="100" stored="false" > multiValued="false"> > > class="solr.WhitespaceTokenizerFactory"/> > ignoreCase="true" words="stopwords.txt"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > class="solr.EdgeNGramFilterFactory" minGramSize="3" maxGramSize="15" > side="front"/> > > > class="solr.WhitespaceTokenizerFactory"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > > > > class="solr.TextField" positionIncrementGap="100" stored="false" > multiValued="false"> > > class="solr.WhitespaceTokenizerFactory"/> > ignoreCase="true" words="stopwords.txt"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > class="solr.EdgeNGramFilterFactory" minGramSize="3" maxGramSize="15" > side="front"/> > > > class="solr.WhitespaceTokenizerFactory"/> > class="solr.LowerCaseFilterFactory"/> > class="solr.RemoveDuplicatesTokenFilterFactory"/> > > >... > > with the following fields: > >... > > indexed="true" stored="true" required="true"/> > indexed="true" stored="true" required="true"/> > type="programmeSuggestionType" stored="true"/> > indexed="true" stored="true" required="true"/> > stored="true"/> > indexed="true" stored="true" required="true"/> > type="ingredientSuggestionType" stored="true"/> > > and >... > > > >recipeId >ingredientText > > > > When I query solr with the query ?q=ingredientSuggestion=banana I get > 160 results. > Ok, all fine. > > When I add a new field such as > > stored="true" required="true"/> > > to my index it reduces the number of results from my query to 131, even > though the query > has'nt changed and does not (at least explicitly) filter the result set. > > > Obviously I'm missing something fundemental , but I'm not sure what it > is. Has anyone else experienced a similar > problem? Am I doing something wrong in the way I am indexing my > database? > > > Mark > > > > > > > > > http://www.bbc.co.uk/ > This e-mail (and any attachments) is confidential and may contain personal > views which are not the views of the BBC unless specifically stated. > If you
