[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15328894#comment-15328894 ]
Sean McKibben commented on SPARK-12177: --------------------------------------- Unfortunately I can't contribute what I would like to, but I wholeheartedly agree with Cody that waiting for 0.11 doesn't make sense. Kafka is a lynchpin of many production scenarios and skipping 0.9 was bad enough for Spark. Waiting longer will make Spark overall less competitive in the streaming/fast data landscape, and the community will have much harder choices between Kafka Streams, Akka Streams, and Spark if another version of Kafka is omitted. > Update KafkaDStreams to new Kafka 0.10 Consumer API > --------------------------------------------------- > > Key: SPARK-12177 > URL: https://issues.apache.org/jira/browse/SPARK-12177 > Project: Spark > Issue Type: Improvement > Components: Streaming > Affects Versions: 1.6.0 > Reporter: Nikita Tarasenko > Labels: consumer, kafka > > Kafka 0.9 already released and it introduce new consumer API that not > compatible with old one. So, I added new consumer api. I made separate > classes in package org.apache.spark.streaming.kafka.v09 with changed API. I > didn't remove old classes for more backward compatibility. User will not need > to change his old spark applications when he uprgade to new Spark version. > Please rewiew my changes -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org