Does this happen at low event rate for that topic as well, or only for a high volume rate?
TD On Wed, Apr 9, 2014 at 11:24 PM, gaganbm <gagan.mis...@gmail.com> wrote: > I am really at my wits' end here. > > I have different Streaming contexts, lets say 2, and both listening to same > Kafka topics. I establish the KafkaStream by setting different consumer > groups to each of them. > > Ideally, I should be seeing the kafka events in both the streams. But what > I > am getting is really unpredictable. Only one stream gets a lot of events > and > the other one almost gets nothing or very less compared to the other. Also > the frequency is very skewed. I get a lot of events in one stream > continuously, and after some duration I get a few events in the other one. > > I don't know where I am going wrong. I can see consumer fetcher threads for > both the streams that listen to the Kafka topics. > > I can give further details if needed. Any help will be great. > > Thanks > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Strange-behaviour-of-different-SSCs-with-same-Kafka-topic-tp4050.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >
