Hi Ron, Thanks for reporting this issue. KAFKA-13270 is an obvious regression from previous versions, so the fix - that I now see has been merged already - is approved for inclusion in 3.0.0 and I'll add it to the next release candidate that we'll need to generate for 3.0.0.
Konstantine On Fri, Sep 3, 2021 at 4:24 AM Ron Dagostino <rndg...@gmail.com> wrote: > Hi Konstantine. I have opened a probable blocker ticket > https://issues.apache.org/jira/browse/KAFKA-13270. I will work on a PR > shortly. The description on that ticket is as follows: > > The implementation of https://issues.apache.org/jira/browse/ZOOKEEPER-3593 > in > ZooKeeper version 3.6.0 decreased the default value for the ZooKeeper > client's `jute.maxbuffer` configuration from 4MB to 1MB. This can cause a > problem if Kafka tries to retrieve a large amount of data across many > znodes – in such a case the ZooKeeper client will repeatedly emit a message > of the form "java.io.IOException: Packet len <####> is out of range" and > the Kafka broker will never connect to ZooKeeper and fail to make progress > on the startup sequence. We can avoid the potential for this issue to occur > by explicitly setting the value to 4MB whenever we create a new ZooKeeper > client as long as no explicit value has been set via the `jute.maxbuffer` > system property. > > Ron > > On Thu, Sep 2, 2021 at 5:52 PM Israel Ekpo <israele...@gmail.com> wrote: > > > Magnus, > > > > Please could you share the machine and network specs? > > > > How much CPU, RAM is available on each node? > > > > What JDK, JRE version are you using? > > > > What are your broker and client configuration values? Please could you > > share this info if possible? > > > > Thanks. > > > > > > > > On Wed, Sep 1, 2021 at 10:25 AM Magnus Edenhill <mag...@edenhill.se> > > wrote: > > > > > Hi Konstantine, > > > > > > Some findings from running 3.0.0-RC1 with the librdkafka test suite: > > > > > > * Compaction seems to take slightly longer to kick in when segment > sizes > > > exceed their threshold. (Used to take less than 20 seconds, now takes > > > 20..30 seconds.) > > > > > > * CreateTopic seems to take slightly longer to propagate through the > > > cluster, > > > e.g., before a new topic is available in metadata from other brokers. > > > > > > * CreateTopics seems to take longer when the Admin request timeout is > > set, > > > looks like a plateau at 10 seconds: > > > https://imgur.com/a/n6y76sj > > > > > > (This is a 3 broker cluster with identical configs between 2.8 and > > 3.0.0.) > > > > > > Nothing critical, but could be an indication of regression so I thought > > I'd > > > mention it. > > > > > > Regards, > > > Magnus > > > > > > > > > Den tis 31 aug. 2021 kl 17:51 skrev Konstantine Karantasis < > > > kkaranta...@apache.org>: > > > > > > > Small correction to my previous email. > > > > The actual link for public preview of the 3.0.0 blog post draft is: > > > > > > > > > > > > > > https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache6 > > > > > > > > (see also the email thread with title: [DISCUSS] Please review the > > 3.0.0 > > > > blog post) > > > > > > > > Best, > > > > Konstantine > > > > > > > > On Tue, Aug 31, 2021 at 6:34 PM Konstantine Karantasis < > > > > kkaranta...@apache.org> wrote: > > > > > > > > > > > > > > Hello Kafka users, developers and client-developers, > > > > > > > > > > This is the second release candidate for Apache Kafka 3.0.0. > > > > > It corresponds to a major release that includes many new features, > > > > > including: > > > > > > > > > > * The deprecation of support for Java 8 and Scala 2.12. > > > > > * Kafka Raft support for snapshots of the metadata topic and > > > > > other improvements in the self-managed quorum. > > > > > * Deprecation of message formats v0 and v1. > > > > > * Stronger delivery guarantees for the Kafka producer enabled by > > > default. > > > > > * Optimizations in OffsetFetch and FindCoordinator requests. > > > > > * More flexible Mirror Maker 2 configuration and deprecation of > > > > > Mirror Maker 1. > > > > > * Ability to restart a connector's tasks on a single call in Kafka > > > > Connect. > > > > > * Connector log contexts and connector client overrides are now > > enabled > > > > > by default. > > > > > * Enhanced semantics for timestamp synchronization in Kafka > Streams. > > > > > * Revamped public API for Stream's TaskId. > > > > > * Default serde becomes null in Kafka Streams and several > > > > > other configuration changes. > > > > > > > > > > You may read and review a more detailed list of changes in the > 3.0.0 > > > blog > > > > > post draft here: > > > > > > > > > > > > > > > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache6 > > > > > > > > > > Release notes for the 3.0.0 release: > > > > > > > > > https://home.apache.org/~kkarantasis/kafka-3.0.0-rc1/RELEASE_NOTES.html > > > > > > > > > > *** Please download, test and vote by Wednesday, September 8, 2021 > > *** > > > > > > > > > > Kafka's KEYS file containing PGP keys we use to sign the release: > > > > > https://kafka.apache.org/KEYS > > > > > > > > > > * Release artifacts to be voted upon (source and binary): > > > > > https://home.apache.org/~kkarantasis/kafka-3.0.0-rc1/ > > > > > > > > > > * Maven artifacts to be voted upon: > > > > > > > https://repository.apache.org/content/groups/staging/org/apache/kafka/ > > > > > > > > > > * Javadoc: > > > > > https://home.apache.org/~kkarantasis/kafka-3.0.0-rc1/javadoc/ > > > > > > > > > > * Tag to be voted upon (off 3.0 branch) is the 3.0.0 tag: > > > > > https://github.com/apache/kafka/releases/tag/3.0.0-rc1 > > > > > > > > > > * Documentation: > > > > > https://kafka.apache.org/30/documentation.html > > > > > > > > > > * Protocol: > > > > > https://kafka.apache.org/30/protocol.html > > > > > > > > > > * Successful Jenkins builds for the 3.0 branch: > > > > > Unit/integration tests: > > > > > > > > > > > > > > > https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka/detail/3.0/121/pipeline/ > > > > > (only few flaky failures) > > > > > System tests: > > > > > https://jenkins.confluent.io/job/system-test-kafka/job/3.0/57/ > > > > > > > > > > /************************************** > > > > > > > > > > Thanks, > > > > > Konstantine > > > > > > > > > > > > > > >
