Cody has graciously worked on a new connector for dstream for Kafka 0.10. Can people that use Kafka test this connector out? The patch is at https://github.com/apache/spark/pull/11863
Although we have stopped merging new features into branch-2.0, this connector is very decoupled from rest of Spark and we might be able to put this into 2.0.1 (or 2.0.0 if everything works out). Thanks.