Re: [VOTE] 2.4.0 RC4
Hello Manikumar, I verified the unit tests on scala 2.13 binary, web docs and java docs. +1 (binding). Guozhang On Fri, Dec 13, 2019 at 10:11 AM Jun Rao wrote: > Hi, Manikumar, > > Thanks for preparing the release. Verified quickstart on scala 2.13 > binary. +1 from me. > > Jun > > On Thu, Dec 12, 2019 at 10:30 PM Gwen Shapira wrote: > > > +1 (binding) > > > > Validated signatures, tests and ran some test workloads. > > > > Thank you so much for driving this. Mani. > > > > On Mon, Dec 9, 2019 at 9:32 AM Manikumar > > wrote: > > > > > > Hello Kafka users, developers and client-developers, > > > > > > This is the fifth candidate for release of Apache Kafka 2.4.0. > > > > > > This release includes many new features, including: > > > - Allow consumers to fetch from closest replica > > > - Support for incremental cooperative rebalancing to the consumer > > rebalance > > > protocol > > > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter > > replication > > > engine > > > - New Java authorizer Interface > > > - Support for non-key joining in KTable > > > - Administrative API for replica reassignment > > > - Sticky partitioner > > > - Return topic metadata and configs in CreateTopics response > > > - Securing Internal connect REST endpoints > > > - API to delete consumer offsets and expose it via the AdminClient. > > > > > > Release notes for the 2.4.0 release: > > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html > > > > > > *** Please download, test and vote by Thursday, December 12, 9am PT > > > > > > Kafka's KEYS file containing PGP keys we use to sign the release: > > > https://kafka.apache.org/KEYS > > > > > > * Release artifacts to be voted upon (source and binary): > > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/ > > > > > > * Maven artifacts to be voted upon: > > > https://repository.apache.org/content/groups/staging/org/apache/kafka/ > > > > > > * Javadoc: > > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/ > > > > > > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag: > > > https://github.com/apache/kafka/releases/tag/2.4.0-rc4 > > > > > > * Documentation: > > > https://kafka.apache.org/24/documentation.html > > > > > > * Protocol: > > > https://kafka.apache.org/24/protocol.html > > > > > > Thanks, > > > Manikumar > > > -- -- Guozhang
Re: [VOTE] 2.4.0 RC4
Hi, Manikumar, Thanks for preparing the release. Verified quickstart on scala 2.13 binary. +1 from me. Jun On Thu, Dec 12, 2019 at 10:30 PM Gwen Shapira wrote: > +1 (binding) > > Validated signatures, tests and ran some test workloads. > > Thank you so much for driving this. Mani. > > On Mon, Dec 9, 2019 at 9:32 AM Manikumar > wrote: > > > > Hello Kafka users, developers and client-developers, > > > > This is the fifth candidate for release of Apache Kafka 2.4.0. > > > > This release includes many new features, including: > > - Allow consumers to fetch from closest replica > > - Support for incremental cooperative rebalancing to the consumer > rebalance > > protocol > > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter > replication > > engine > > - New Java authorizer Interface > > - Support for non-key joining in KTable > > - Administrative API for replica reassignment > > - Sticky partitioner > > - Return topic metadata and configs in CreateTopics response > > - Securing Internal connect REST endpoints > > - API to delete consumer offsets and expose it via the AdminClient. > > > > Release notes for the 2.4.0 release: > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html > > > > *** Please download, test and vote by Thursday, December 12, 9am PT > > > > Kafka's KEYS file containing PGP keys we use to sign the release: > > https://kafka.apache.org/KEYS > > > > * Release artifacts to be voted upon (source and binary): > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/ > > > > * Maven artifacts to be voted upon: > > https://repository.apache.org/content/groups/staging/org/apache/kafka/ > > > > * Javadoc: > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/ > > > > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag: > > https://github.com/apache/kafka/releases/tag/2.4.0-rc4 > > > > * Documentation: > > https://kafka.apache.org/24/documentation.html > > > > * Protocol: > > https://kafka.apache.org/24/protocol.html > > > > Thanks, > > Manikumar >
Re: [VOTE] 2.4.0 RC4
+1 (binding) Validated signatures, tests and ran some test workloads. Thank you so much for driving this. Mani. On Mon, Dec 9, 2019 at 9:32 AM Manikumar wrote: > > Hello Kafka users, developers and client-developers, > > This is the fifth candidate for release of Apache Kafka 2.4.0. > > This release includes many new features, including: > - Allow consumers to fetch from closest replica > - Support for incremental cooperative rebalancing to the consumer rebalance > protocol > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication > engine > - New Java authorizer Interface > - Support for non-key joining in KTable > - Administrative API for replica reassignment > - Sticky partitioner > - Return topic metadata and configs in CreateTopics response > - Securing Internal connect REST endpoints > - API to delete consumer offsets and expose it via the AdminClient. > > Release notes for the 2.4.0 release: > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html > > *** Please download, test and vote by Thursday, December 12, 9am PT > > Kafka's KEYS file containing PGP keys we use to sign the release: > https://kafka.apache.org/KEYS > > * Release artifacts to be voted upon (source and binary): > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/ > > * Maven artifacts to be voted upon: > https://repository.apache.org/content/groups/staging/org/apache/kafka/ > > * Javadoc: > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/ > > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag: > https://github.com/apache/kafka/releases/tag/2.4.0-rc4 > > * Documentation: > https://kafka.apache.org/24/documentation.html > > * Protocol: > https://kafka.apache.org/24/protocol.html > > Thanks, > Manikumar
Re: [VOTE] 2.4.0 RC4
Thanks @Manikumar for running the release as well. In my latest run, all signature validations and tests passed successfully without any issues. +1 (non-binding) On Thu, Dec 12, 2019 at 10:25 AM Mickael Maison wrote: > Thanks Manikumar for running this release > > I verified the signatures > All tests passed without failures. > We've also been running this release for a few days in a couple of > environments without any issues. > > +1 (binding) > > On Thu, Dec 12, 2019 at 3:14 PM Manikumar > wrote: > > > > Hi all, > > > > Successful Jenkins builds for the 2.4 branch: > > Unit/integration tests: > > > https://builds.apache.org/blue/organizations/jenkins/kafka-2.4-jdk8/detail/kafka-2.4-jdk8/106/ > > System tests: > > > http://confluent-kafka-2-4-system-test-results.s3-us-west-2.amazonaws.com/2019-12-12--001.1576143096--confluentinc--2.4--9a7f26d/report.html > > > > > > > > On Mon, Dec 9, 2019 at 11:02 PM Manikumar > wrote: > > > > > Hello Kafka users, developers and client-developers, > > > > > > This is the fifth candidate for release of Apache Kafka 2.4.0. > > > > > > This release includes many new features, including: > > > - Allow consumers to fetch from closest replica > > > - Support for incremental cooperative rebalancing to the consumer > > > rebalance protocol > > > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter > replication > > > engine > > > - New Java authorizer Interface > > > - Support for non-key joining in KTable > > > - Administrative API for replica reassignment > > > - Sticky partitioner > > > - Return topic metadata and configs in CreateTopics response > > > - Securing Internal connect REST endpoints > > > - API to delete consumer offsets and expose it via the AdminClient. > > > > > > Release notes for the 2.4.0 release: > > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html > > > > > > *** Please download, test and vote by Thursday, December 12, 9am PT > > > > > > Kafka's KEYS file containing PGP keys we use to sign the release: > > > https://kafka.apache.org/KEYS > > > > > > * Release artifacts to be voted upon (source and binary): > > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/ > > > > > > * Maven artifacts to be voted upon: > > > https://repository.apache.org/content/groups/staging/org/apache/kafka/ > > > > > > * Javadoc: > > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/ > > > > > > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag: > > > https://github.com/apache/kafka/releases/tag/2.4.0-rc4 > > > > > > * Documentation: > > > https://kafka.apache.org/24/documentation.html > > > > > > * Protocol: > > > https://kafka.apache.org/24/protocol.html > > > > > > Thanks, > > > Manikumar > > > >
Re: [VOTE] 2.4.0 RC4
Thanks Manikumar for running this release I verified the signatures All tests passed without failures. We've also been running this release for a few days in a couple of environments without any issues. +1 (binding) On Thu, Dec 12, 2019 at 3:14 PM Manikumar wrote: > > Hi all, > > Successful Jenkins builds for the 2.4 branch: > Unit/integration tests: > https://builds.apache.org/blue/organizations/jenkins/kafka-2.4-jdk8/detail/kafka-2.4-jdk8/106/ > System tests: > http://confluent-kafka-2-4-system-test-results.s3-us-west-2.amazonaws.com/2019-12-12--001.1576143096--confluentinc--2.4--9a7f26d/report.html > > > > On Mon, Dec 9, 2019 at 11:02 PM Manikumar wrote: > > > Hello Kafka users, developers and client-developers, > > > > This is the fifth candidate for release of Apache Kafka 2.4.0. > > > > This release includes many new features, including: > > - Allow consumers to fetch from closest replica > > - Support for incremental cooperative rebalancing to the consumer > > rebalance protocol > > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication > > engine > > - New Java authorizer Interface > > - Support for non-key joining in KTable > > - Administrative API for replica reassignment > > - Sticky partitioner > > - Return topic metadata and configs in CreateTopics response > > - Securing Internal connect REST endpoints > > - API to delete consumer offsets and expose it via the AdminClient. > > > > Release notes for the 2.4.0 release: > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html > > > > *** Please download, test and vote by Thursday, December 12, 9am PT > > > > Kafka's KEYS file containing PGP keys we use to sign the release: > > https://kafka.apache.org/KEYS > > > > * Release artifacts to be voted upon (source and binary): > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/ > > > > * Maven artifacts to be voted upon: > > https://repository.apache.org/content/groups/staging/org/apache/kafka/ > > > > * Javadoc: > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/ > > > > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag: > > https://github.com/apache/kafka/releases/tag/2.4.0-rc4 > > > > * Documentation: > > https://kafka.apache.org/24/documentation.html > > > > * Protocol: > > https://kafka.apache.org/24/protocol.html > > > > Thanks, > > Manikumar > >
Re: [VOTE] 2.4.0 RC4
Hi all, Successful Jenkins builds for the 2.4 branch: Unit/integration tests: https://builds.apache.org/blue/organizations/jenkins/kafka-2.4-jdk8/detail/kafka-2.4-jdk8/106/ System tests: http://confluent-kafka-2-4-system-test-results.s3-us-west-2.amazonaws.com/2019-12-12--001.1576143096--confluentinc--2.4--9a7f26d/report.html On Mon, Dec 9, 2019 at 11:02 PM Manikumar wrote: > Hello Kafka users, developers and client-developers, > > This is the fifth candidate for release of Apache Kafka 2.4.0. > > This release includes many new features, including: > - Allow consumers to fetch from closest replica > - Support for incremental cooperative rebalancing to the consumer > rebalance protocol > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication > engine > - New Java authorizer Interface > - Support for non-key joining in KTable > - Administrative API for replica reassignment > - Sticky partitioner > - Return topic metadata and configs in CreateTopics response > - Securing Internal connect REST endpoints > - API to delete consumer offsets and expose it via the AdminClient. > > Release notes for the 2.4.0 release: > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html > > *** Please download, test and vote by Thursday, December 12, 9am PT > > Kafka's KEYS file containing PGP keys we use to sign the release: > https://kafka.apache.org/KEYS > > * Release artifacts to be voted upon (source and binary): > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/ > > * Maven artifacts to be voted upon: > https://repository.apache.org/content/groups/staging/org/apache/kafka/ > > * Javadoc: > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/ > > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag: > https://github.com/apache/kafka/releases/tag/2.4.0-rc4 > > * Documentation: > https://kafka.apache.org/24/documentation.html > > * Protocol: > https://kafka.apache.org/24/protocol.html > > Thanks, > Manikumar >
Re: [VOTE] 2.4.0 RC4
Hi Israel, Thanks for testing the release candidate. We can use https://issues.apache.org/jira/browse/KAFKA-9283 for fixing the flaky test. Thanks, On Thu, Dec 12, 2019 at 8:18 PM Israel Ekpo wrote: > > @Manikumar , I have rerun the latest release > candidate (RC4) and all the tests have passed with no errors. > > Should we go ahead and close this issue regarding the Flaky test? - > https://issues.apache.org/jira/browse/KAFKA-9283 > > > On Tue, Dec 10, 2019 at 11:11 AM Adam Bellemare > wrote: > >> - All PGP signatures are good >> - All md5, sha1sums and sha512sums pass >> >> Initial test results: >> 1310 tests completed, 2 failed, 17 skipped >> >> > Task :core:integrationTest FAILED >> >> The failed tests: >> SaslSslAdminClientIntegrationTest. testElectPreferredLeaders >> SslAdminClientIntegrationTest. >> testSynchronousAuthorizerAclUpdatesBlockRequestThreads >> >> Both failed due to timeout: >> >> java.util.concurrent.ExecutionException: >> org.apache.kafka.common.errors.TimeoutException: Aborted due to >> timeout. >> >> Reran the tests and both passed. >> >> +1 from me. >> >> >> >> >> >> On Mon, Dec 9, 2019 at 12:32 PM Manikumar >> wrote: >> >> > Hello Kafka users, developers and client-developers, >> > >> > This is the fifth candidate for release of Apache Kafka 2.4.0. >> > >> > This release includes many new features, including: >> > - Allow consumers to fetch from closest replica >> > - Support for incremental cooperative rebalancing to the consumer >> rebalance >> > protocol >> > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter >> replication >> > engine >> > - New Java authorizer Interface >> > - Support for non-key joining in KTable >> > - Administrative API for replica reassignment >> > - Sticky partitioner >> > - Return topic metadata and configs in CreateTopics response >> > - Securing Internal connect REST endpoints >> > - API to delete consumer offsets and expose it via the AdminClient. >> > >> > Release notes for the 2.4.0 release: >> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html >> > >> > *** Please download, test and vote by Thursday, December 12, 9am PT >> > >> > Kafka's KEYS file containing PGP keys we use to sign the release: >> > https://kafka.apache.org/KEYS >> > >> > * Release artifacts to be voted upon (source and binary): >> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/ >> > >> > * Maven artifacts to be voted upon: >> > https://repository.apache.org/content/groups/staging/org/apache/kafka/ >> > >> > * Javadoc: >> > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/ >> > >> > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag: >> > https://github.com/apache/kafka/releases/tag/2.4.0-rc4 >> > >> > * Documentation: >> > https://kafka.apache.org/24/documentation.html >> > >> > * Protocol: >> > https://kafka.apache.org/24/protocol.html >> > >> > Thanks, >> > Manikumar >> > >> >
Re: [VOTE] 2.4.0 RC4
@Manikumar , I have rerun the latest release candidate (RC4) and all the tests have passed with no errors. Should we go ahead and close this issue regarding the Flaky test? - https://issues.apache.org/jira/browse/KAFKA-9283 On Tue, Dec 10, 2019 at 11:11 AM Adam Bellemare wrote: > - All PGP signatures are good > - All md5, sha1sums and sha512sums pass > > Initial test results: > 1310 tests completed, 2 failed, 17 skipped > > > Task :core:integrationTest FAILED > > The failed tests: > SaslSslAdminClientIntegrationTest. testElectPreferredLeaders > SslAdminClientIntegrationTest. > testSynchronousAuthorizerAclUpdatesBlockRequestThreads > > Both failed due to timeout: > > java.util.concurrent.ExecutionException: > org.apache.kafka.common.errors.TimeoutException: Aborted due to > timeout. > > Reran the tests and both passed. > > +1 from me. > > > > > > On Mon, Dec 9, 2019 at 12:32 PM Manikumar > wrote: > > > Hello Kafka users, developers and client-developers, > > > > This is the fifth candidate for release of Apache Kafka 2.4.0. > > > > This release includes many new features, including: > > - Allow consumers to fetch from closest replica > > - Support for incremental cooperative rebalancing to the consumer > rebalance > > protocol > > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter > replication > > engine > > - New Java authorizer Interface > > - Support for non-key joining in KTable > > - Administrative API for replica reassignment > > - Sticky partitioner > > - Return topic metadata and configs in CreateTopics response > > - Securing Internal connect REST endpoints > > - API to delete consumer offsets and expose it via the AdminClient. > > > > Release notes for the 2.4.0 release: > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html > > > > *** Please download, test and vote by Thursday, December 12, 9am PT > > > > Kafka's KEYS file containing PGP keys we use to sign the release: > > https://kafka.apache.org/KEYS > > > > * Release artifacts to be voted upon (source and binary): > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/ > > > > * Maven artifacts to be voted upon: > > https://repository.apache.org/content/groups/staging/org/apache/kafka/ > > > > * Javadoc: > > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/ > > > > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag: > > https://github.com/apache/kafka/releases/tag/2.4.0-rc4 > > > > * Documentation: > > https://kafka.apache.org/24/documentation.html > > > > * Protocol: > > https://kafka.apache.org/24/protocol.html > > > > Thanks, > > Manikumar > > >
Re: [VOTE] 2.4.0 RC4
- All PGP signatures are good - All md5, sha1sums and sha512sums pass Initial test results: 1310 tests completed, 2 failed, 17 skipped > Task :core:integrationTest FAILED The failed tests: SaslSslAdminClientIntegrationTest. testElectPreferredLeaders SslAdminClientIntegrationTest. testSynchronousAuthorizerAclUpdatesBlockRequestThreads Both failed due to timeout: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Aborted due to timeout. Reran the tests and both passed. +1 from me. On Mon, Dec 9, 2019 at 12:32 PM Manikumar wrote: > Hello Kafka users, developers and client-developers, > > This is the fifth candidate for release of Apache Kafka 2.4.0. > > This release includes many new features, including: > - Allow consumers to fetch from closest replica > - Support for incremental cooperative rebalancing to the consumer rebalance > protocol > - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication > engine > - New Java authorizer Interface > - Support for non-key joining in KTable > - Administrative API for replica reassignment > - Sticky partitioner > - Return topic metadata and configs in CreateTopics response > - Securing Internal connect REST endpoints > - API to delete consumer offsets and expose it via the AdminClient. > > Release notes for the 2.4.0 release: > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html > > *** Please download, test and vote by Thursday, December 12, 9am PT > > Kafka's KEYS file containing PGP keys we use to sign the release: > https://kafka.apache.org/KEYS > > * Release artifacts to be voted upon (source and binary): > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/ > > * Maven artifacts to be voted upon: > https://repository.apache.org/content/groups/staging/org/apache/kafka/ > > * Javadoc: > https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/ > > * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag: > https://github.com/apache/kafka/releases/tag/2.4.0-rc4 > > * Documentation: > https://kafka.apache.org/24/documentation.html > > * Protocol: > https://kafka.apache.org/24/protocol.html > > Thanks, > Manikumar >
[VOTE] 2.4.0 RC4
Hello Kafka users, developers and client-developers, This is the fifth candidate for release of Apache Kafka 2.4.0. This release includes many new features, including: - Allow consumers to fetch from closest replica - Support for incremental cooperative rebalancing to the consumer rebalance protocol - MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication engine - New Java authorizer Interface - Support for non-key joining in KTable - Administrative API for replica reassignment - Sticky partitioner - Return topic metadata and configs in CreateTopics response - Securing Internal connect REST endpoints - API to delete consumer offsets and expose it via the AdminClient. Release notes for the 2.4.0 release: https://home.apache.org/~manikumar/kafka-2.4.0-rc4/RELEASE_NOTES.html *** Please download, test and vote by Thursday, December 12, 9am PT Kafka's KEYS file containing PGP keys we use to sign the release: https://kafka.apache.org/KEYS * Release artifacts to be voted upon (source and binary): https://home.apache.org/~manikumar/kafka-2.4.0-rc4/ * Maven artifacts to be voted upon: https://repository.apache.org/content/groups/staging/org/apache/kafka/ * Javadoc: https://home.apache.org/~manikumar/kafka-2.4.0-rc4/javadoc/ * Tag to be voted upon (off 2.4 branch) is the 2.4.0 tag: https://github.com/apache/kafka/releases/tag/2.4.0-rc4 * Documentation: https://kafka.apache.org/24/documentation.html * Protocol: https://kafka.apache.org/24/protocol.html Thanks, Manikumar