mjsax commented on code in PR #861: URL: https://github.com/apache/kafka-site/pull/861#discussion_r3236664266
########## content/en/blog/releases/ak-4.3.0.md: ########## @@ -0,0 +1,125 @@ +--- +date: TBD +title: Apache Kafka 4.3.0 Release Announcement +linkTitle: AK 4.3.0 +author: Mickael Maison +aliases: + - /blog/T/B/D/apache-kafka-4.3.0-release-announcement/ +--- + +<!-- + Licensed to the Apache Software Foundation (ASF) under one or more + contributor license agreements. See the NOTICE file distributed with + this work for additional information regarding copyright ownership. + The ASF licenses this file to You under the Apache License, Version 2.0 + (the "License"); you may not use this file except in compliance with + the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. +--> + +We are proud to announce the release of Apache Kafka® 4.3. This release contains many new features and improvements. This blog post will highlight some of the more prominent ones. For a full list of changes, be sure to check the [release notes](https://downloads.apache.org/kafka/4.3.0/RELEASE_NOTES.html). + +With 26 KIPs and over 600 commits since 4.2.0, this release introduces many new features, improvements and bug fixes to all the components. Review Comment: I counted 25 on the release plan wiki page? ########## content/en/blog/releases/ak-4.3.0.md: ########## @@ -0,0 +1,125 @@ +--- +date: TBD +title: Apache Kafka 4.3.0 Release Announcement +linkTitle: AK 4.3.0 +author: Mickael Maison +aliases: + - /blog/T/B/D/apache-kafka-4.3.0-release-announcement/ +--- + +<!-- + Licensed to the Apache Software Foundation (ASF) under one or more + contributor license agreements. See the NOTICE file distributed with + this work for additional information regarding copyright ownership. + The ASF licenses this file to You under the Apache License, Version 2.0 + (the "License"); you may not use this file except in compliance with + the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. +--> + +We are proud to announce the release of Apache Kafka® 4.3. This release contains many new features and improvements. This blog post will highlight some of the more prominent ones. For a full list of changes, be sure to check the [release notes](https://downloads.apache.org/kafka/4.3.0/RELEASE_NOTES.html). + +With 26 KIPs and over 600 commits since 4.2.0, this release introduces many new features, improvements and bug fixes to all the components. + + +See the [Upgrading to 4.3](https://kafka.apache.org/documentation.html#upgrade_4_3_0) section in the documentation for the list of notable changes and detailed upgrade steps. + +## Deprecation Notices +* [KIP-1244 Drop support for streams-scala in Kafka 5.0 (deprecate in 4.3)](https://cwiki.apache.org/confluence/x/r4LMFw) + Deprecates the streams-scala module. Marked for removal in Apache Kafka 5.0. + +* [KIP-1237: Deprecate group.coordinator.rebalance.protocols config](https://cwiki.apache.org/confluence/x/jIqmFw) + Deprecates the `group.coordinator.rebalance.protocols` broker configuration. Marked for removal in Apache Kafka 5.0. + +* [KIP-1280: Update MirrorMaker to use KIP-877 to emit metrics](https://cwiki.apache.org/confluence/x/a4s8G) + Deprecates the existing MirrorMaker metrics. They are marked for removal in Apache Kafka 5.0. Users should transition to the new metric names. + +## Kafka Broker, Controller, Producer, Consumer and Admin Client + +* [KIP-1023: Follower fetch from tiered offset](https://cwiki.apache.org/confluence/x/8op3EQ) + Adds a new broker configuration, `follower.fetch.last.tiered.offset.enable` (default: `false`). When enabled the last tiered offset is used as the start offset when bootstrapping a new follower. + +* [KIP-1066: Mechanism to cordon brokers and log directories](https://cwiki.apache.org/confluence/x/Lg_TEg) + Introduces a new configuration, `cordoned.log.dirs` to cordon log directories. New partitions cannot be placed on a cordoned log directory. This can be used when scaling or [decommissioning brokers or log directories](https://kafka.apache.org/43/operations/basic-kafka-operations/#decommissioning-brokers-and-log-directories). + +* [KIP-1196: Introduce group.coordinator.append.max.buffer.size config](https://cwiki.apache.org/confluence/x/hA5JFg) + Introduces the `group.coordinator.append.max.buffer.size` and `share.coordinator.append.max.buffer.size` configurations to set the maximum buffer size the coordinators can use. There are also metrics to track the buffer usage. + +* [KIP-1208: Add prefix to TopicBasedRemoteLogMetadataManagerConfig to enable setting admin configs](https://cwiki.apache.org/confluence/x/vYqhFg) + Introduces a new prefix `remote.log.metadata.admin.` for setting configurations for the admin client used by the tiered storage's `RemoteLogMetadataManager`. + +* [KIP-1211: Align the behavior of num.partitions and default.replication.factor for topic creation](https://cwiki.apache.org/confluence/x/WIrHFg) + Fixes inconsistencies how `num.partitions` and `default.replication.factor` were applied when creating topics. + +* [KIP-1219: Configurations for KRaft Fetch and FetchSnapshot Byte Size](https://cwiki.apache.org/confluence/x/yQkGFw) + Adds new broker configurations, `controller.quorum.fetch.snapshot.max.bytes` and `controller.quorum.fetch.max.bytes`, to control the maximum amount of data Fetch and FetchSnapshot requests can retrieve. + +* [KIP-1235: Correct the default min.insync.replicas to 2 for the __remote_log_metadata topic](https://cwiki.apache.org/confluence/x/yommFw) + Adds a new broker configuration, `remote.log.metadata.topic.min.isr`, to set the minimum in-sync replicas for the internal topic used by tiered storage. + +* [KIP-1240: Additional group configurations for share groups](https://cwiki.apache.org/confluence/x/tIHMFw) + Adds a number of new broker and group configurations to control the behavior of share groups. + +* [KIP-1251: Assignment epochs for consumer groups](https://cwiki.apache.org/confluence/x/8ITMFw) + Improves the member epoch validation logic to avoid unnecessary fencing of group members. + +* [KIP-1257: Partition Size Percentage Metrics for Storage Monitoring](https://cwiki.apache.org/confluence/x/MAEXG) + Introduces new metrics to track how much of the maximum retention each topic-partition currently uses. + +* [KIP-1258: Add Support for OAuth Client Assertion to client_credentials Grant Type](https://cwiki.apache.org/confluence/x/dwEXG) + Adds support for client assertion authentication to client_credentials grant type with OAuth to enhance security and compatibility with OAuth providers. + +* [KIP-1263: Group Coordinator Assignment Batching and Offload](https://cwiki.apache.org/confluence/x/DIE8G) + Improves the group coordinator assignment logic to avoid recomputing assignments when unnecessary. + +* [KIP-1274: Deprecate and remove support for Classic rebalance protocol in KafkaConsumer (Phase 1)](https://cwiki.apache.org/confluence/x/PoY8G) + Logs a message at consumer startup if the `classic` consumer rebalance protocol is used, informing that it will be deprecated in Apache Kafka 5.0. + +## Kafka Streams + +* [KIP-1035: StateStore managed changelog offsets](https://cwiki.apache.org/confluence/x/aQviEQ) + Adds methods to the `StateStore` API to manage changelog offsets. + +* [KIP-1247: Make Bytes utils class part of the public API](https://cwiki.apache.org/confluence/x/DYTMFw) + Exposes the `Bytes` class as part of the public API so it appears in the javadoc. + +* [KIP-1250: Add metric to track size of in-memory state stores](https://cwiki.apache.org/confluence/x/noTMFw) + Adds new metrics tracking the number of keys in the in-memory state stores. + +* [KIP-1259: Add configuration to wipe Kafka Streams local state on startup](https://cwiki.apache.org/confluence/x/XgIXG) + Adds a new configuration, `state.cleanup.dir.max.age.ms`, to automatically delete state directories that have not been modified for that duration. Review Comment: They key is, that this happens at startup if enabled, ie, before we join the group. (There is already a regular "cleanup interval" which runs during runtime.) ########## content/en/blog/releases/ak-4.3.0.md: ########## @@ -0,0 +1,125 @@ +--- +date: TBD +title: Apache Kafka 4.3.0 Release Announcement +linkTitle: AK 4.3.0 +author: Mickael Maison +aliases: + - /blog/T/B/D/apache-kafka-4.3.0-release-announcement/ +--- + +<!-- + Licensed to the Apache Software Foundation (ASF) under one or more + contributor license agreements. See the NOTICE file distributed with + this work for additional information regarding copyright ownership. + The ASF licenses this file to You under the Apache License, Version 2.0 + (the "License"); you may not use this file except in compliance with + the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. +--> + +We are proud to announce the release of Apache Kafka® 4.3. This release contains many new features and improvements. This blog post will highlight some of the more prominent ones. For a full list of changes, be sure to check the [release notes](https://downloads.apache.org/kafka/4.3.0/RELEASE_NOTES.html). + +With 26 KIPs and over 600 commits since 4.2.0, this release introduces many new features, improvements and bug fixes to all the components. + + +See the [Upgrading to 4.3](https://kafka.apache.org/documentation.html#upgrade_4_3_0) section in the documentation for the list of notable changes and detailed upgrade steps. + +## Deprecation Notices +* [KIP-1244 Drop support for streams-scala in Kafka 5.0 (deprecate in 4.3)](https://cwiki.apache.org/confluence/x/r4LMFw) + Deprecates the streams-scala module. Marked for removal in Apache Kafka 5.0. + +* [KIP-1237: Deprecate group.coordinator.rebalance.protocols config](https://cwiki.apache.org/confluence/x/jIqmFw) + Deprecates the `group.coordinator.rebalance.protocols` broker configuration. Marked for removal in Apache Kafka 5.0. + +* [KIP-1280: Update MirrorMaker to use KIP-877 to emit metrics](https://cwiki.apache.org/confluence/x/a4s8G) + Deprecates the existing MirrorMaker metrics. They are marked for removal in Apache Kafka 5.0. Users should transition to the new metric names. + +## Kafka Broker, Controller, Producer, Consumer and Admin Client + +* [KIP-1023: Follower fetch from tiered offset](https://cwiki.apache.org/confluence/x/8op3EQ) + Adds a new broker configuration, `follower.fetch.last.tiered.offset.enable` (default: `false`). When enabled the last tiered offset is used as the start offset when bootstrapping a new follower. + +* [KIP-1066: Mechanism to cordon brokers and log directories](https://cwiki.apache.org/confluence/x/Lg_TEg) + Introduces a new configuration, `cordoned.log.dirs` to cordon log directories. New partitions cannot be placed on a cordoned log directory. This can be used when scaling or [decommissioning brokers or log directories](https://kafka.apache.org/43/operations/basic-kafka-operations/#decommissioning-brokers-and-log-directories). + +* [KIP-1196: Introduce group.coordinator.append.max.buffer.size config](https://cwiki.apache.org/confluence/x/hA5JFg) + Introduces the `group.coordinator.append.max.buffer.size` and `share.coordinator.append.max.buffer.size` configurations to set the maximum buffer size the coordinators can use. There are also metrics to track the buffer usage. + +* [KIP-1208: Add prefix to TopicBasedRemoteLogMetadataManagerConfig to enable setting admin configs](https://cwiki.apache.org/confluence/x/vYqhFg) + Introduces a new prefix `remote.log.metadata.admin.` for setting configurations for the admin client used by the tiered storage's `RemoteLogMetadataManager`. + +* [KIP-1211: Align the behavior of num.partitions and default.replication.factor for topic creation](https://cwiki.apache.org/confluence/x/WIrHFg) + Fixes inconsistencies how `num.partitions` and `default.replication.factor` were applied when creating topics. + +* [KIP-1219: Configurations for KRaft Fetch and FetchSnapshot Byte Size](https://cwiki.apache.org/confluence/x/yQkGFw) + Adds new broker configurations, `controller.quorum.fetch.snapshot.max.bytes` and `controller.quorum.fetch.max.bytes`, to control the maximum amount of data Fetch and FetchSnapshot requests can retrieve. + +* [KIP-1235: Correct the default min.insync.replicas to 2 for the __remote_log_metadata topic](https://cwiki.apache.org/confluence/x/yommFw) + Adds a new broker configuration, `remote.log.metadata.topic.min.isr`, to set the minimum in-sync replicas for the internal topic used by tiered storage. + +* [KIP-1240: Additional group configurations for share groups](https://cwiki.apache.org/confluence/x/tIHMFw) + Adds a number of new broker and group configurations to control the behavior of share groups. + +* [KIP-1251: Assignment epochs for consumer groups](https://cwiki.apache.org/confluence/x/8ITMFw) + Improves the member epoch validation logic to avoid unnecessary fencing of group members. + +* [KIP-1257: Partition Size Percentage Metrics for Storage Monitoring](https://cwiki.apache.org/confluence/x/MAEXG) + Introduces new metrics to track how much of the maximum retention each topic-partition currently uses. + +* [KIP-1258: Add Support for OAuth Client Assertion to client_credentials Grant Type](https://cwiki.apache.org/confluence/x/dwEXG) + Adds support for client assertion authentication to client_credentials grant type with OAuth to enhance security and compatibility with OAuth providers. + +* [KIP-1263: Group Coordinator Assignment Batching and Offload](https://cwiki.apache.org/confluence/x/DIE8G) + Improves the group coordinator assignment logic to avoid recomputing assignments when unnecessary. + +* [KIP-1274: Deprecate and remove support for Classic rebalance protocol in KafkaConsumer (Phase 1)](https://cwiki.apache.org/confluence/x/PoY8G) + Logs a message at consumer startup if the `classic` consumer rebalance protocol is used, informing that it will be deprecated in Apache Kafka 5.0. + +## Kafka Streams + +* [KIP-1035: StateStore managed changelog offsets](https://cwiki.apache.org/confluence/x/aQviEQ) + Adds methods to the `StateStore` API to manage changelog offsets. Review Comment: For most users, this is an internal change only. Should we highlight it? -- It relevant for people implementing custom state stores; they should migrate their stores to the new APIs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
