Spark Kafka API tries connecting to dead node for every batch, which increases the processing time

2017-10-16 Thread Suprith T Jain
Hi guys, I have a 3 node cluster and i am running a spark streaming job. consider the below example /*spark-submit* --master yarn-cluster --class com.huawei.bigdata.spark.examples.FemaleInfoCollectionPrint --jars

Re: Spark Kafka API tries connecting to dead node for every batch, which increases the processing time

2017-10-16 Thread Suprith T Jain
er.org> wrote: > Have you tried adjusting the timeout? > > On Mon, Oct 16, 2017 at 8:08 AM, Suprith T Jain <t.supr...@gmail.com> > wrote: > > Hi guys, > > > > I have a 3 node cluster and i am running a spark streaming job. consider > the > > below