https://issues.apache.org/jira/browse/SOLR-4260 resolved https://issues.apache.org/jira/browse/SOLR-4924 open
-----Original message----- > From:Michael Della Bitta <michael.della.bi...@appinions.com> > Sent: Monday 27th October 2014 16:40 > To: solr-user@lucene.apache.org > Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas out > of synch. > > I'm curious, could you elaborate on the issue and the partial fix? > > Thanks! > > On 10/27/14 11:31, Markus Jelsma wrote: > > It is an ancient issue. One of the major contributors to the issue was > > resolved some versions ago but we are still seeing it sometimes too, there > > is nothing to see in the logs. We ignore it and just reindex. > > > > -----Original message----- > >> From:S.L <simpleliving...@gmail.com> > >> Sent: Monday 27th October 2014 16:25 > >> To: solr-user@lucene.apache.org > >> Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas > >> out of synch. > >> > >> Thank Otis, > >> > >> I have checked the logs , in my case the default catalina.out and I dont > >> see any OOMs or , any other exceptions. > >> > >> What others metrics do you suggest ? > >> > >> On Mon, Oct 27, 2014 at 9:26 AM, Otis Gospodnetic < > >> otis.gospodne...@gmail.com> wrote: > >> > >>> Hi, > >>> > >>> You may simply be overwhelming your cluster-nodes. Have you checked > >>> various metrics to see if that is the case? > >>> > >>> Otis > >>> -- > >>> Monitoring * Alerting * Anomaly Detection * Centralized Log Management > >>> Solr & Elasticsearch Support * http://sematext.com/ > >>> > >>> > >>> > >>>> On Oct 26, 2014, at 9:59 PM, S.L <simpleliving...@gmail.com> wrote: > >>>> > >>>> Folks, > >>>> > >>>> I have posted previously about this , I am using SolrCloud 4.10.1 and > >>> have > >>>> a sharded collection with 6 nodes , 3 shards and a replication factor > >>> of 2. > >>>> I am indexing Solr using a Hadoop job , I have 15 Map fetch tasks , that > >>>> can each have upto 5 threds each , so the load on the indexing side can > >>> get > >>>> to as high as 75 concurrent threads. > >>>> > >>>> I am facing an issue where the replicas of a particular shard(s) are > >>>> consistently getting out of synch , initially I thought this was > >>> beccause I > >>>> was using a custom component , but I did a fresh install and removed the > >>>> custom component and reindexed using the Hadoop job , I still see the > >>> same > >>>> behavior. > >>>> > >>>> I do not see any exceptions in my catalina.out , like OOM , or any other > >>>> excepitions, I suspecting thi scould be because of the multi-threaded > >>>> indexing nature of the Hadoop job . I use CloudSolrServer from my java > >>> code > >>>> to index and initialize the CloudSolrServer using a 3 node ZK ensemble. > >>>> > >>>> Does any one know of any known issues with a highly multi-threaded > >>> indexing > >>>> and SolrCloud ? > >>>> > >>>> Can someone help ? This issue has been slowing things down on my end for > >>> a > >>>> while now. > >>>> > >>>> Thanks and much appreciated! > >
