[
https://issues.apache.org/jira/browse/SPARK-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Grover resolved SPARK-13252.
---------------------------------
Resolution: Won't Fix
Marking this as won't fix, and taking the focus back on the discussion in
SPARK-12177. The very likely outcome will be that the existing kafka
integration (using the old consumer API) will be built against Kafka 0.8.x, and
a completely new module for the new kafka consumer api (which is in beta) will
be introduced that will be built against 0.9.x. Those who rely on the old kafka
consumer API will not have to upgrade their Kafka version (but can if they want
to) when they upgrade to Spark 2.0.
> Bump up Kafka to 0.9.0.0
> ------------------------
>
> Key: SPARK-13252
> URL: https://issues.apache.org/jira/browse/SPARK-13252
> Project: Spark
> Issue Type: Improvement
> Components: Streaming
> Affects Versions: 2.0.0
> Reporter: Mark Grover
> Labels: kafka
>
> Apache Kafka release 0.9.0.0 came out some time and we should add support for
> it. This JIRA is related to SPARK-12177 which is related to adding support
> for new consumer API only available starting v0.9.0.0
> However, we should upgrade Kafka to 0.9.0.0 regardless of when (and before)
> the support for the new consumer API gets added.
> We also use some non-public APIs from Kafka which have changed in 0.9.0.0
> release. So, this change should also take care of updating those usages.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
