Adding more info Batch interval is 2000ms. I expect all 100 messages go thru one dstream from directsream but it receives at rate of 10 messages at time. Am I missing some configurations here. Any help appreciated.
Regards Diwakar. Sent from Samsung Mobile. <div>-------- Original message --------</div><div>From: Diwakar Dhanuskodi <diwakar.dhanusk...@gmail.com> </div><div>Date:05/02/2016 07:33 (GMT+05:30) </div><div>To: user@spark.apache.org </div><div>Cc: </div><div>Subject: Kafka directsream receiving rate </div><div> </div>Hi, Using spark 1.5.1. I have a topic with 20 partitions. When I publish 100 messages. Spark direct stream is receiving 10 messages per dstream. I have only one receiver . When I used createStream the receiver received entire 100 messages at once. Appreciate any help . Regards Diwakar Sent from Samsung Mobile.
