[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun updated SPARK-33913: ---------------------------------- Fix Version/s: 3.2.0 > Upgrade Kafka to 2.8.0 > ---------------------- > > Key: SPARK-33913 > URL: https://issues.apache.org/jira/browse/SPARK-33913 > Project: Spark > Issue Type: Sub-task > Components: Build, DStreams > Affects Versions: 3.2.0 > Reporter: dengziming > Assignee: Dongjoon Hyun > Priority: Major > Fix For: 3.2.0 > > > This issue aims to upgrade Kafka client to 2.8.0. > Note that Kafka 2.8.0 uses ZSTD JNI 1.4.9-1 like Apache Spark 3.2.0. > *RELEASE NOTE* > - https://downloads.apache.org/kafka/2.8.0/RELEASE_NOTES.html > - https://downloads.apache.org/kafka/2.7.0/RELEASE_NOTES.html > This will bring the latest client-side improvement and bug fixes like the > following examples. > - KAFKA-10631 ProducerFencedException is not Handled on Offest Commit > - KAFKA-10134 High CPU issue during rebalance in Kafka consumer after > upgrading to 2.5 > - KAFKA-12193 Re-resolve IPs when a client is disconnected > - KAFKA-10090 Misleading warnings: The configuration was supplied but isn't a > known config > - KAFKA-9263 The new hw is added to incorrect log when > ReplicaAlterLogDirsThread is replacing log > - KAFKA-10607 Ensure the error counts contains the NONE > - KAFKA-10458 Need a way to update quota for TokenBucket registered with > Sensor > - KAFKA-10503 MockProducer doesn't throw ClassCastException when no partition > for topic -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org