Re: solr returns reduced results for same query after adding a new field to the schema.

2012-02-28 Thread Chris Hostetter

: When I query solr with the query ?q=ingredientSuggestion=banana I get
: 160 results.
: Ok, all fine.
: 
: When I add a new field such as
: 
:   
: 
: to my index it reduces the number of results from my query to 131, even
: though the query 
: has'nt changed and does not (at least explicitly) filter the result set.

presumably you changed your DIH config in some way when you added that 
field? are you certain that you didn't do anything to alter the total 
number of docs being indexed?  or that the data source didn't change 
between the first time you indexed and the second?


-Hoss


RE: solr returns reduced results for same query after adding a new field to the schema.

2012-02-28 Thread Mark Swinson
yes, sorry.

-Original Message-
From: Dmitry Kan [mailto:dmitry@gmail.com] 
Sent: 28 February 2012 12:33
To: solr-user@lucene.apache.org
Subject: Re: solr returns reduced results for same query after adding a new 
field to the schema.

Hi,

you meant you query is:

?q=ingredientSuggestion:banana

right?

On Tue, Feb 28, 2012 at 2:29 PM, Mark Swinson wrote:

> Hi,
>
> I'm currently setting up a schema in solr, which is being imported using
> the data-import plugin.
>
> The initial config contains the following key information:
>
>...
>
> class="solr.TextField" positionIncrementGap="100" stored="false"
> multiValued="false">
>
> class="solr.KeywordTokenizerFactory"/>
> ignoreCase="true" words="stopwords.txt"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
>
>
> class="solr.KeywordTokenizerFactory"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
>
>
>
> class="solr.TextField" positionIncrementGap="100" stored="false"
> multiValued="true">
>
> class="solr.WhitespaceTokenizerFactory"/>
> ignoreCase="true" words="stopwords.txt"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
>
>
> class="solr.WhitespaceTokenizerFactory"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
>
>
>
> class="solr.TextField" positionIncrementGap="100" stored="false"
> multiValued="false">
>
> class="solr.WhitespaceTokenizerFactory"/>
> ignoreCase="true" words="stopwords.txt"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
> class="solr.EdgeNGramFilterFactory" minGramSize="3" maxGramSize="15"
> side="front"/>
>
>
> class="solr.WhitespaceTokenizerFactory"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
>
>
>
> class="solr.TextField" positionIncrementGap="100" stored="false"
> multiValued="false">
>
> class="solr.WhitespaceTokenizerFactory"/>
> ignoreCase="true" words="stopwords.txt"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
> class="solr.EdgeNGramFilterFactory" minGramSize="3" maxGramSize="15"
> side="front"/>
>
>
> class="solr.WhitespaceTokenizerFactory"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
>
>
>...
>
> with the following fields:
>
>...
>
> indexed="true" stored="true" required="true"/>
> indexed="

Re: solr returns reduced results for same query after adding a new field to the schema.

2012-02-28 Thread Dmitry Kan
Hi,

you meant you query is:

?q=ingredientSuggestion:banana

right?

On Tue, Feb 28, 2012 at 2:29 PM, Mark Swinson wrote:

> Hi,
>
> I'm currently setting up a schema in solr, which is being imported using
> the data-import plugin.
>
> The initial config contains the following key information:
>
>...
>
> class="solr.TextField" positionIncrementGap="100" stored="false"
> multiValued="false">
>
> class="solr.KeywordTokenizerFactory"/>
> ignoreCase="true" words="stopwords.txt"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
>
>
> class="solr.KeywordTokenizerFactory"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
>
>
>
> class="solr.TextField" positionIncrementGap="100" stored="false"
> multiValued="true">
>
> class="solr.WhitespaceTokenizerFactory"/>
> ignoreCase="true" words="stopwords.txt"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
>
>
> class="solr.WhitespaceTokenizerFactory"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
>
>
>
> class="solr.TextField" positionIncrementGap="100" stored="false"
> multiValued="false">
>
> class="solr.WhitespaceTokenizerFactory"/>
> ignoreCase="true" words="stopwords.txt"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
> class="solr.EdgeNGramFilterFactory" minGramSize="3" maxGramSize="15"
> side="front"/>
>
>
> class="solr.WhitespaceTokenizerFactory"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
>
>
>
> class="solr.TextField" positionIncrementGap="100" stored="false"
> multiValued="false">
>
> class="solr.WhitespaceTokenizerFactory"/>
> ignoreCase="true" words="stopwords.txt"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
> class="solr.EdgeNGramFilterFactory" minGramSize="3" maxGramSize="15"
> side="front"/>
>
>
> class="solr.WhitespaceTokenizerFactory"/>
> class="solr.LowerCaseFilterFactory"/>
> class="solr.RemoveDuplicatesTokenFilterFactory"/>
>
>
>...
>
> with the following fields:
>
>...
>
> indexed="true" stored="true" required="true"/>
> indexed="true" stored="true" required="true"/>
> type="programmeSuggestionType" stored="true"/>
> indexed="true" stored="true" required="true"/>
> stored="true"/>
> indexed="true" stored="true" required="true"/>
> type="ingredientSuggestionType" stored="true"/>
>
> and
>...
>
>
>
>recipeId
>ingredientText
>
>
>
> When I query solr with the query ?q=ingredientSuggestion=banana I get
> 160 results.
> Ok, all fine.
>
> When I add a new field such as
>
> stored="true" required="true"/>
>
> to my index it reduces the number of results from my query to 131, even
> though the query
> has'nt changed and does not (at least explicitly) filter the result set.
>
>
> Obviously I'm missing something fundemental , but I'm not sure what it
> is. Has anyone else experienced a similar
> problem? Am I doing something wrong in the way I am indexing my
> database?
>
>
> Mark
>
>
>
>
>
>
>
>
> http://www.bbc.co.uk/
> This e-mail (and any attachments) is confidential and may contain personal
> views which are not the views of the BBC unless specifically stated.
> If you

solr returns reduced results for same query after adding a new field to the schema.

2012-02-28 Thread Mark Swinson
Hi,

I'm currently setting up a schema in solr, which is being imported using
the data-import plugin.

The initial config contains the following key information:

...


























































...

with the following fields:

...









and
...



recipeId
ingredientText



When I query solr with the query ?q=ingredientSuggestion=banana I get
160 results.
Ok, all fine.

When I add a new field such as



to my index it reduces the number of results from my query to 131, even
though the query 
has'nt changed and does not (at least explicitly) filter the result set.


Obviously I'm missing something fundemental , but I'm not sure what it
is. Has anyone else experienced a similar
problem? Am I doing something wrong in the way I am indexing my
database?


Mark








http://www.bbc.co.uk/
This e-mail (and any attachments) is confidential and may contain personal 
views which are not the views of the BBC unless specifically stated.
If you have received it in error, please delete it from your system.
Do not use, copy or disclose the information in any way nor act in reliance on 
it and notify the sender immediately.
Please note that the BBC monitors e-mails sent or received.
Further communication will signify your consent to this.