[ 
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15837791#comment-15837791
 ] 

Helena Edelson commented on SPARK-18057:
----------------------------------------

I'd tried this upgrade just cursory attempt with version change to see the 
behavior and definitely ran into offset logic changes in the spark streaming 
kafka code that will need to happen. Expected offset behavior change, but I 
didn't investigate enough to clarify where in Kafka that is from. 

This is a very important issue for us, needing this Kafka upgrade to 10.1.0.

> Update structured streaming kafka from 10.0.1 to 10.1.0
> -------------------------------------------------------
>
>                 Key: SPARK-18057
>                 URL: https://issues.apache.org/jira/browse/SPARK-18057
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>            Reporter: Cody Koeninger
>
> There are a couple of relevant KIPs here, 
> https://archive.apache.org/dist/kafka/0.10.1.0/RELEASE_NOTES.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to