[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267347#comment-15267347
]
Reynold Xin commented on SPARK-12177:
-------------------------------------
Talked more with Cody offline. Summary of discussion:
Background information:
1. Kafka 0.8 client works with Kafka 0.8 and 0.9 broker.
2. Kafka 0.9 changes the client API.
3. Kafka 0.10, not yet released, will change the client API again.
Recommended steps:
1. Rename existing Kafka connector to include 0.8 version in the Maven project
name.
2. Don't support 0.9 client for now (otherwise we will need to support 3
clients very soon). We should revisit the 0.10 support in 2.1, and most likely
support that.
> Update KafkaDStreams to new Kafka 0.9 Consumer API
> --------------------------------------------------
>
> Key: SPARK-12177
> URL: https://issues.apache.org/jira/browse/SPARK-12177
> Project: Spark
> Issue Type: Improvement
> Components: Streaming
> Affects Versions: 1.6.0
> Reporter: Nikita Tarasenko
> Labels: consumer, kafka
>
> Kafka 0.9 already released and it introduce new consumer API that not
> compatible with old one. So, I added new consumer api. I made separate
> classes in package org.apache.spark.streaming.kafka.v09 with changed API. I
> didn't remove old classes for more backward compatibility. User will not need
> to change his old spark applications when he uprgade to new Spark version.
> Please rewiew my changes
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
