Hi Erick, Thanks for your reply. Yes i am using delete by query. I am currently logging the number of items to be deleted before handing off to solr. And from solr logs i can it deleted exactly that number. I will verify further.
Thanks. On Mon, Sep 24, 2012 at 1:21 PM, Erick Erickson <erickerick...@gmail.com>wrote: > How do you delete items? By ID or by query? > > My guess is that one of two things is happening: > 1> your delete process is deleting too much data. > 2> your index process isn't indexing what you think. > > I'd add some logging to the SolrJ program to see what > it thinks is has deleted or added to the index and go from there. > > Best > Erick > > On Mon, Sep 24, 2012 at 6:55 AM, Kissue Kissue <kissue...@gmail.com> > wrote: > > Hi, > > > > I am running Solr 3.5, using SolrJ and using StreamingUpdateSolrServer to > > index and delete items from solr. > > > > I basically index items from the db into solr every night. Existing items > > can be marked for deletion in the db and a delete request sent to solr to > > delete such items. > > > > My process runs as follows every night: > > > > 1. Check if items have been marked for deletion and delete from solr. I > > commit and optimize after the entire solr deletion runs. > > 2. Index any new items to solr. I commit and optimize after all the new > > items have been added. > > > > Recently i started noticing that huge chunks of items that have not been > > marked for deletion are disappearing from the index. I checked the solr > > logs and the logs indicate that it is deleting exactly the number of > items > > requested but still a lot of other items disappear from the index from > time > > to time. Any ideas what might be causing this or what i am doing wrong. > > > > > > Thanks. >
