Re: Solr 7 + HDFS issue

2018-06-13 Thread Shawn Heisey
On 6/12/2018 10:14 PM, Joe Obernberger wrote: Thank you Shawn.  It looks like it is being applied.  This could be some sort of chain reaction where: Drive or server fails.  HDFS starts to replicate blocks which causes network congestion.  Solr7 can't talk, so initiates a replication process

Re: Solr 7 + HDFS issue

2018-06-12 Thread Joe Obernberger
Thank you Shawn.  It looks like it is being applied.  This could be some sort of chain reaction where: Drive or server fails.  HDFS starts to replicate blocks which causes network congestion.  Solr7 can't talk, so initiates a replication process which causes more network congestionwhich

Re: Solr 7 + HDFS issue

2018-06-12 Thread Shawn Heisey
On 6/11/2018 9:46 AM, Joe Obernberger wrote: > We are seeing an issue on our Solr Cloud 7.3.1 cluster where > replication starts and pegs network interfaces so aggressively that > other tasks cannot talk.  We will see it peg a bonded 2GB interfaces.  > In some cases the replication fails over and

Solr 7 + HDFS issue

2018-06-11 Thread Joe Obernberger
We are seeing an issue on our Solr Cloud 7.3.1 cluster where replication starts and pegs network interfaces so aggressively that other tasks cannot talk.  We will see it peg a bonded 2GB interfaces.  In some cases the replication fails over and over until it finally succeeds and the replica