Re: Read from kafka after application is restarted

2016-02-23 Thread vaibhavrtk1
Hello I have tried with Direct API but i am getting this an error, which is being tracked here https://issues.apache.org/jira/browse/SPARK-5594 I also tried using Receiver approach with Write Ahead Logs ,then this issue comes https://issues.apache.org/jira/browse/SPARK-12407 In both cases it

Read from kafka after application is restarted

2016-02-22 Thread vaibhavrtk1
Hi I am using kafka with spark streaming 1.3.0 . When the spark application is not running kafka is still receiving messages. When i start the application those messages which have already been received when spark was not running are not processed. I am using a unreliable receiver based approach.