subject:"Spark Streaming 1.5.2\+Kafka\+Python. Strange reading"

Re: Spark Streaming 1.5.2+Kafka+Python. Strange reading

2015-12-24 Thread Akhil Das

Would you mind posting the relevant code snippet? Thanks Best Regards On Wed, Dec 23, 2015 at 7:33 PM, Vyacheslav Yanuk wrote: > Hi. > I have very strange situation with direct reading from Kafka. > For example. > I have 1000 messages in Kafka. > After submitting my

Spark Streaming 1.5.2+Kafka+Python. Strange reading

2015-12-23 Thread Vyacheslav Yanuk

Hi. I have very strange situation with direct reading from Kafka. For example. I have 1000 messages in Kafka. After submitting my application I read this data and process it. As I process the data I have accumulated 10 new entries. In next reading from Kafka I read only 3 records, but not 10!!!