[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370642#comment-16370642
]
Sönke Liebau commented on SPARK-18057:
--------------------------------------
I think in addition to the naming convention issue there was also the question
of whether or not to wait for
[KAFKA-4897|https://issues.apache.org/jira/browse/KAFKA-4879] which as I
understand it causes a stress test in Spark to hang indefinitely. However I do
not think that that ticket will get fixed anytime soon, its currently assigned
to the 2.0 release which I believe is scheduled to land around October, but
that will change of course if no one works on it..
Since repeatedly deleting an recreating topics is not really a common use case
I'd be in favor of moving forward with updating the version regardless.
On the naming convention, as [~guozhang] mentioned, with
[KAFKA-4462|https://issues.apache.org/jira/browse/KAFKA-4462] now merged the
strict dependence on binary protocol versions that Kafka used to impose have
been lifted to a large degree, so I think an argument could be made that we
don't need the Kafka version in the artifact name any more.
> Update structured streaming kafka from 10.0.1 to 10.2.0
> -------------------------------------------------------
>
> Key: SPARK-18057
> URL: https://issues.apache.org/jira/browse/SPARK-18057
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Reporter: Cody Koeninger
> Priority: Major
>
> There are a couple of relevant KIPs here,
> https://archive.apache.org/dist/kafka/0.10.1.0/RELEASE_NOTES.html
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
