Hi , Released latest version of Receiver based Kafka Consumer for Spark Streaming .
Available at Spark Packages : https://spark-packages.org/package/dibbhatt/ kafka-spark-consumer Also at github : https://github.com/dibbhatt/kafka-spark-consumer Some key features - Tuned for better performance - Support for Spark 2.x, Kafka 0.10 - Support for Consumer Lag Check ( ConsumerOffsetChecker/ Burrow etc) - WAL less recovery - Better tuned PID Controller having Auto Rate Adjustment with incoming traffic - Support for Custom Message Interceptors Please refer to https://github.com/dibbhatt/kafka-spark-consumer/ blob/master/README.md for more details Regards, Dibyendu