How do you delete items? By ID or by query? My guess is that one of two things is happening: 1> your delete process is deleting too much data. 2> your index process isn't indexing what you think.
I'd add some logging to the SolrJ program to see what it thinks is has deleted or added to the index and go from there. Best Erick On Mon, Sep 24, 2012 at 6:55 AM, Kissue Kissue <kissue...@gmail.com> wrote: > Hi, > > I am running Solr 3.5, using SolrJ and using StreamingUpdateSolrServer to > index and delete items from solr. > > I basically index items from the db into solr every night. Existing items > can be marked for deletion in the db and a delete request sent to solr to > delete such items. > > My process runs as follows every night: > > 1. Check if items have been marked for deletion and delete from solr. I > commit and optimize after the entire solr deletion runs. > 2. Index any new items to solr. I commit and optimize after all the new > items have been added. > > Recently i started noticing that huge chunks of items that have not been > marked for deletion are disappearing from the index. I checked the solr > logs and the logs indicate that it is deleting exactly the number of items > requested but still a lot of other items disappear from the index from time > to time. Any ideas what might be causing this or what i am doing wrong. > > > Thanks.
