Re: How to replay consuming messages from kafka using spark streaming?

2015-01-23 Thread mykidong
. With this kafka receiver, the kafka message offset control can be done more easier for Receiver Woker Node Failure and Driver Node Failure. - Kidong. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-replay-consuming-messages-from-kafka-using-spark

Re: How to replay consuming messages from kafka using spark streaming?

2015-01-14 Thread Cody Koeninger
written using Kafka High Level > Consumer API, not Simple Consumer API. > > Any idea how to replay kafka consuming in spark streaming? > > - Kidong. > > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/How-to-

RE: How to replay consuming messages from kafka using spark streaming?

2015-01-14 Thread Shao, Saisai
: Thursday, January 15, 2015 11:59 AM To: user@spark.apache.org Subject: How to replay consuming messages from kafka using spark streaming? Hi, My Spark Streaming Job is doing like kafka etl to HDFS. For instance, every 10 min. my streaming job is retrieving messages from kafka, and save them as

How to replay consuming messages from kafka using spark streaming?

2015-01-14 Thread mykidong
.nabble.com/How-to-replay-consuming-messages-from-kafka-using-spark-streaming-tp21145.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For