[
https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330500#comment-15330500
]
Mark Grover commented on SPARK-12177:
-------------------------------------
bq. It's worth mentioning that authentication is also supported via TLS. I am
aware of a number of people who are using TLS for both authentication and
encryption. So, the security benefit is available now for some people, at least.
Fair point, thanks.
Ok, so what remains to get this in?
1. The PR (https://github.com/apache/spark/pull/11863) reviewed by me, so it
probably needs to be reviewed by a committer.
2. Sorry for sounding like a broken record, but I don't think kafka-beta as the
name for the subproject makes much sense, especially now that the new consumer
api in Kafka 0.10 is not beta. So, some committer buy in would be more valuable
there too.
Anything else?
> Update KafkaDStreams to new Kafka 0.10 Consumer API
> ---------------------------------------------------
>
> Key: SPARK-12177
> URL: https://issues.apache.org/jira/browse/SPARK-12177
> Project: Spark
> Issue Type: Improvement
> Components: Streaming
> Affects Versions: 1.6.0
> Reporter: Nikita Tarasenko
> Labels: consumer, kafka
>
> Kafka 0.9 already released and it introduce new consumer API that not
> compatible with old one. So, I added new consumer api. I made separate
> classes in package org.apache.spark.streaming.kafka.v09 with changed API. I
> didn't remove old classes for more backward compatibility. User will not need
> to change his old spark applications when he uprgade to new Spark version.
> Please rewiew my changes
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
