Hi, processing time depends on what you are doing with the events. Increasing the number of partitions could be an idea if you write more messages to the topic than you read currently via Spark.
Can you write more details? Mit freundlichen Grüßen / best regards Kay-Uwe Moosheimer > Am 04.12.2015 um 22:21 schrieb SRK <swethakasire...@gmail.com>: > > Hi, > > Our processing times in Spark Streaming with kafka Direct approach seems to > have increased considerably with increase in the Site traffic. Would > increasing the number of kafka partitions decrease the processing times? > Any suggestions on tuning to reduce the processing times would be of great > help. > > Thanks, > Swetha > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Higher-Processing-times-in-Spark-Streaming-with-kafka-Direct-tp25571.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
