Hi, Is it possible to limit the size of the batches returned by the Kafka consumer for Spark Streaming? I am asking because the first batch I get has hundred of millions of records and it takes ages to process and checkpoint them.
Thank you. Samy --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
