HeartSaVioR commented on issue #28235: [SPARK-31464][BUILD][SS] Upgrade Kafka to 2.5.0 URL: https://github.com/apache/spark/pull/28235#issuecomment-615050510 Just curious, did you hit the issue KAFKA-9241 in production or likewise? Because if KAFKA-9241 is worth to consider as outstanding issue, then we probably may want to get this in Spark 3.0.0 as well. If the affected version on KAFKA-9241 is correct - KIP-368 seemed to be introduced in Kafka 2.2 so likely - then it would affect starting from Spark 3.0.0, not Spark 2.x. (Yeah I also waited for Kafka 2.5.0 to remove the usage of `poll(0)` - [SPARK-28367] - (https://issues.apache.org/jira/browse/SPARK-28367) so the change itself is welcome.)
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
