That's not much information to go on. Any relevant code sample or log messages?
On Thu, May 5, 2016 at 11:18 AM, Jerry <jerry.king2.w...@gmail.com> wrote: > Hi, > > Does anybody give me an idea why the data is lost at the Kafka Consumer > side? I use Kafka 0.8.2 and Spark (streaming) version is 1.5.2. Sometimes, I > found out I could not receive the same number of data with Kafka producer. > Exp) I sent 1000 data to Kafka Broker via Kafka Producer and confirmed the > same number in the Broker. But when I checked either HDFS or Cassandra, the > number is just 363. The data is not always lost, just sometimes... That's > wired and annoying to me. > Can anybody give me some reasons? > > Thanks! > Jerry > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Missing-data-in-Kafka-Consumer-tp26887.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
