RE: Issues with docFreq/docCount on SolrCloud

2013-01-24 Thread Markus Jelsma
user to the correct replica if possible. Thanks, Markus -Original message- > From:Mark Miller > Sent: Thu 24-Jan-2013 00:33 > To: solr-user@lucene.apache.org > Subject: Re: Issues with docFreq/docCount on SolrCloud > > > On Jan 23, 2013, at 6:21 PM, Yonik Seeley

Re: Issues with docFreq/docCount on SolrCloud

2013-01-23 Thread Mark Miller
On Jan 23, 2013, at 6:21 PM, Yonik Seeley wrote: > A solr request could request a token that when resubmitted with a > follow-up request would result in hitting the same replicas if > possible. Yeah, this would be good. It's also useful for not catching "eventual consistency" effects between q

Re: Issues with docFreq/docCount on SolrCloud

2013-01-23 Thread Yonik Seeley
On Wed, Jan 23, 2013 at 6:15 PM, Markus Jelsma wrote: > We need, and i think many SolrCloud users are going to need this as well, to > make replica's don't deviate too much from eachother, because if they do > documents are certainly going to jump positions. The synchronization that would be ne

RE: Issues with docFreq/docCount on SolrCloud

2013-01-23 Thread Markus Jelsma
ny thanks for sharing your thoughts, Markus -Original message- > From:Michael Ryan > Sent: Wed 23-Jan-2013 23:50 > To: solr-user@lucene.apache.org > Subject: RE: Issues with docFreq/docCount on SolrCloud > > Are you able to see any evidence that some of the 500k docs ar

RE: Issues with docFreq/docCount on SolrCloud

2013-01-23 Thread Michael Ryan
5:38 PM To: solr-user@lucene.apache.org Subject: RE: Issues with docFreq/docCount on SolrCloud Hi again, I've tried various settings for TieredMergePolicy to make sure the docFreq, maxDoc and docCount don't deviate too much. We've also did tests after increasing reclaimDeletesW

RE: Issues with docFreq/docCount on SolrCloud

2013-01-23 Thread Markus Jelsma
Hi again, I've tried various settings for TieredMergePolicy to make sure the docFreq, maxDoc and docCount don't deviate too much. We've also did tests after increasing reclaimDeletesWeight from 2.0 to 8.0 and slightly more frequent merging. In these tests we reindexed the same 500k docs each ti