It is an ancient issue. One of the major contributors to the issue was resolved 
some versions ago but we are still seeing it sometimes too, there is nothing to 
see in the logs. We ignore it and just reindex.

-----Original message-----
> From:S.L <simpleliving...@gmail.com>
> Sent: Monday 27th October 2014 16:25
> To: solr-user@lucene.apache.org
> Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas out 
> of synch.
> 
> Thank Otis,
> 
> I have checked the logs , in my case the default catalina.out and I dont
> see any OOMs or , any other exceptions.
> 
> What others metrics do you suggest ?
> 
> On Mon, Oct 27, 2014 at 9:26 AM, Otis Gospodnetic <
> otis.gospodne...@gmail.com> wrote:
> 
> > Hi,
> >
> > You may simply be overwhelming your cluster-nodes. Have you checked
> > various metrics to see if that is the case?
> >
> > Otis
> > --
> > Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> > Solr & Elasticsearch Support * http://sematext.com/
> >
> >
> >
> > > On Oct 26, 2014, at 9:59 PM, S.L <simpleliving...@gmail.com> wrote:
> > >
> > > Folks,
> > >
> > > I have posted previously about this , I am using SolrCloud 4.10.1 and
> > have
> > > a sharded collection with  6 nodes , 3 shards and a replication factor
> > of 2.
> > >
> > > I am indexing Solr using a Hadoop job , I have 15 Map fetch tasks , that
> > > can each have upto 5 threds each , so the load on the indexing side can
> > get
> > > to as high as 75 concurrent threads.
> > >
> > > I am facing an issue where the replicas of a particular shard(s) are
> > > consistently getting out of synch , initially I thought this was
> > beccause I
> > > was using a custom component , but I did a fresh install and removed the
> > > custom component and reindexed using the Hadoop job , I still see the
> > same
> > > behavior.
> > >
> > > I do not see any exceptions in my catalina.out , like OOM , or any other
> > > excepitions, I suspecting thi scould be because of the multi-threaded
> > > indexing nature of the Hadoop job . I use CloudSolrServer from my java
> > code
> > > to index and initialize the CloudSolrServer using a 3 node ZK ensemble.
> > >
> > > Does any one know of any known issues with a highly multi-threaded
> > indexing
> > > and SolrCloud ?
> > >
> > > Can someone help ? This issue has been slowing things down on my end for
> > a
> > > while now.
> > >
> > > Thanks and much appreciated!
> >
> 

Reply via email to