Hi,
This seems not fixed yet.
I filed an issue in jira: https://issues.apache.org/jira/browse/SPARK-5505
Greg
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Error-when-Spark-streaming-consumes-from-Kafka-tp19570p21471.html
Sent from the Apache Spark User
at 1:07 PM, Greg Temchenko s...@dicefield.com wrote:
Hi,
This seems not fixed yet.
I filed an issue in jira: https://issues.apache.org/jira/browse/SPARK-5505
Greg
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Error-when-Spark-streaming-consumes-from
:07 PM, Greg Temchenko s...@dicefield.com wrote:
Hi,
This seems not fixed yet.
I filed an issue in jira:
https://issues.apache.org/jira/browse/SPARK-5505
Greg
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Error-when-Spark-streaming-consumes-from
.1001560.n3.nabble.com/Error-when-Spark-streaming-consumes-from-Kafka-tp19570p21471.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
yet.
I filed an issue in jira:
https://issues.apache.org/jira/browse/SPARK-5505
Greg
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Error-when-Spark-streaming-consumes-from-Kafka-tp19570p21471.html
Sent from the Apache Spark User List mailing list
Hi Dibyendu,
Thank you for answer. I will try the Spark-Kafka consumer.
Bill
On Sat, Nov 22, 2014 at 9:15 PM, Dibyendu Bhattacharya
dibyendu.bhattach...@gmail.com wrote:
I believe this is something to do with how Kafka High Level API manages
consumers within a Consumer group and how it
Hi all,
I am using Spark to consume from Kafka. However, after the job has run for
several hours, I saw the following failure of an executor:
kafka.common.ConsumerRebalanceFailedException:
group-1416624735998_ip-172-31-5-242.ec2.internal-1416648124230-547d2c31
can't rebalance after 4 retries
I believe this is something to do with how Kafka High Level API manages
consumers within a Consumer group and how it re-balance during failure. You
can find some mention in this Kafka wiki.
https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Client+Re-Design
Due to various issues in Kafka
