Re: [DISCUSS] Brokers disconnect intermittently with TLS1.3

Hi Shylaja, Thanks for reporting the issue. > Given that TLS1.3 does not support renegotiation, can I make it applicable just for TLS1.2? Are you saying you're trying to make Kafka default supports to TLS1.2, instead of TLS1.3? If so, I don't think it's a good idea to fall back to an older and

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #571

See Changes: -- [...truncated 501119 lines...] [2021-11-16T06:06:54.525Z] LeaderElectionTest > testLeaderElectionWithStaleControllerEpoch() STARTED

Re: [DISCUSS] KIP-796: Interactive Query v2

Thanks for the review, Guozhang! 1. This is a great point. I fell into the age-old trap of only considering the simplest store type and forgot about this extra wrinkle of the "key schema" that we use in Windowed and Session stores. Depending on how we want to forge forward with our provided

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 2.8 #90

See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #570

See Changes: -- [...truncated 498005 lines...] [2021-11-16T03:58:29.848Z] [INFO] Parameter: packageInPathFormat, Value: myapps [2021-11-16T03:58:29.848Z] [INFO] Parameter:

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #569

See Changes: -- [...truncated 500377 lines...] [2021-11-16T01:51:40.353Z] [2021-11-16T01:51:40.353Z] PlaintextConsumerTest > testConsumeMessagesWithCreateTime() PASSED

Re: [DISCUSS] KIP-796: Interactive Query v2

Hello John, Great, great, great writeup! :) And thank you for bringing this up finally. I have made a pass on the KIP as well as the POC PR of it, here are some initial thoughts: First are some meta ones: 1. Today the serdes do not only happen at the metered-store layer, unfortunately. For

[jira] [Created] (KAFKA-13457) socketChannel in Acceptor#accept is not closed upon IOException

Haoze Wu created KAFKA-13457: Summary: socketChannel in Acceptor#accept is not closed upon IOException Key: KAFKA-13457 URL: https://issues.apache.org/jira/browse/KAFKA-13457 Project: Kafka

Re: [DISCUSS] KIP-796: Interactive Query v2

Hi Patrick and Sagar, Thanks for the feedback! I'll just break out the questions and address them one at a time. Patrick 1. The default bound that I'm proposing is only to let active tasks answer queries (which is also the default with IQ today). Therefore, calling getPositionBound() would

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #11

See Changes: -- [...truncated 500572 lines...] [2021-11-15T21:48:40.257Z] > Task :raft:testClasses UP-TO-DATE [2021-11-15T21:48:40.257Z] > Task :connect:json:testJar

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #568

See Changes: -- [...truncated 499215 lines...] [2021-11-15T21:16:52.297Z] > Task :raft:testClasses UP-TO-DATE [2021-11-15T21:16:52.297Z] > Task :connect:json:testJar

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 2.8 #89

See

[DISCUSS] Brokers disconnect intermittently with TLS1.3

Hi all, Using TLS1.3 (with JDK11) is causing an intermittent increase in inter-broker p99 latency, as mentioned by Yiming in Kafka-9320.

Re: [DISCUSS] KIP-779: Allow Source Tasks to Handle Producer Exceptions

Chris, Thank you for the feedback. I can certainly update the KIP to state that once exactly one support is in place, the task would be failed even if error.tolerance were set to all. Programmatically it would still require PRs to be merged to build on top of. I also liked my original

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.1 #10

See

[jira] [Resolved] (KAFKA-10104) Remove deprecated --zookeeper flags as specified in KIP-604

[ https://issues.apache.org/jira/browse/KAFKA-10104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10104. - Resolution: Duplicate > Remove deprecated --zookeeper flags as specified in KIP-604 >

Re: [DISCUSS] KIP-799 Align behaviour for producer callbacks with documented behaviour

Hi, Séamus, Thanks for the KIP. We definitely want the input semantic for the producer callback to be consistent. It's probably better to make the input semantic consistent between the producer callback and the interceptor. If producer.send() throws an ApiException, we may not know the partition

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #567

See Changes: -- [...truncated 499316 lines...] [2021-11-15T18:10:15.320Z] PlaintextConsumerTest > testFetchRecordLargerThanFetchMaxBytes() PASSED

Re: [DISCUSS] KIP-778 KRaft Upgrades

Thanks David, 1. Got it. One thing I'm still not very clear is why it's sufficient to select a metadata.version which is supported by majority of the quorum, but not the whole quorum (i.e. choosing the lowest version among all the quorum members)? Since the leader election today does not take

Re: [DISCUSS] KIP-796: Interactive Query v2

Hi John, Thanks for the great writeup! Couple of things I wanted to bring up(may or mayn't be relevant): 1) The sample implementation that you have presented for KeyQuery is very helpful. One thing which may be added to it is how it connects to the KeyValue.get(key) method. That's something that

[jira] [Created] (KAFKA-13456) controller.listener.names is required for all KRaft nodes, not just controllers

Ron Dagostino created KAFKA-13456: - Summary: controller.listener.names is required for all KRaft nodes, not just controllers Key: KAFKA-13456 URL: https://issues.apache.org/jira/browse/KAFKA-13456

[jira] [Created] (KAFKA-13455) The Apache Kafka quickstart guide does not contain any steps for running Kafka Connect

Kate Stanley created KAFKA-13455: Summary: The Apache Kafka quickstart guide does not contain any steps for running Kafka Connect Key: KAFKA-13455 URL: https://issues.apache.org/jira/browse/KAFKA-13455

Re: [DISCUSS] KIP-792: Add "generation" field into consumer protocol

Hi Luke, Thanks for the KIP. Overall, I think that the motivation makes sense. I have a couple of comments/questions: 1. In the Public Interfaces section, it would be great if you could put the end state not the current one. 2. Do we need to update the Subscription class to expose the

Re: [DISCUSS] KIP-778 KRaft Upgrades

Guozhang, thanks for the review! 1, As we've defined it so far, the initial metadata.version is set by an operator via the "kafka-storage.sh" tool. It would be possible for different values to be selected, but only the quorum leader would commit a FeatureLevelRecord with the version they read

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #566

See Changes: -- [...truncated 500086 lines...] [2021-11-15T15:46:20.983Z] > Task :raft:testClasses UP-TO-DATE [2021-11-15T15:46:20.983Z] > Task :connect:json:testJar

Re: [DISCUSS] KIP-778 KRaft Upgrades

Jun, thanks for the comments! 16, When a new cluster is deployed, we don't select the highest available metadata.version, but rather the quorum leader picks a bootstrap version defined in meta.properties. As mentioned earlier, we should add validation here to ensure a majority of the followers

订阅

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #565

See Changes: -- [...truncated 499913 lines...] [2021-11-15T13:30:06.080Z] [2021-11-15T13:30:06.080Z] PlaintextConsumerTest > testConsumeMessagesWithCreateTime() PASSED

[jira] [Resolved] (KAFKA-13441) improve upgrade doc

[ https://issues.apache.org/jira/browse/KAFKA-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13441. Fix Version/s: 3.2.0 Resolution: Fixed > improve upgrade doc > ---

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #9

See Changes: -- [...truncated 500798 lines...] [2021-11-15T12:54:22.393Z] > Task :raft:testClasses UP-TO-DATE [2021-11-15T12:54:22.393Z] > Task :connect:json:testJar

Re: [DISCUSS] KIP-796: Interactive Query v2

Hi John, Thanks for submitting the KIP! One question I have is, assuming one instantiates InteractiveQueryRequest via withQuery, and then later calls getPositionBound, what will the result be? Also I noticed the Position returning method is in InteractiveQueryRequest and InteractiveQueryResult is

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #564

See

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

Hi Dongjin, Thanks for the clarifications. I wonder if a simpler course of action could be: - Deprecate log4j-appender now - Document how to use logging-log4j2 - Remove log4j-appender and all the log4j dependencies in Kafka 4.0 This delays KIP-653 till Kafka 4.0 but (so far) Kafka is not

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #8

See Changes: -- [...truncated 498870 lines...] [2021-11-15T10:53:36.513Z] [INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ streams-quickstart-java ---

[jira] [Resolved] (KAFKA-13255) Mirrormaker config property config.properties.exclude is not working as expected

[ https://issues.apache.org/jira/browse/KAFKA-13255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13255. Fix Version/s: 3.2.0 Resolution: Fixed > Mirrormaker config property

Re: [DISCUSS] Apache Kafka 3.1.0 release

Hi folks, We reached the code freeze for the Apache Kafka 3.1 release on Friday. Therefore, we will only accept blockers from now on. There already are a couple of blockers identified which were not completed before the code freeze. Please, raise any new blockers to this thread. For all the

[GitHub] [kafka-site] mimaison commented on pull request #383: MINOR: Updates for 2.7.2

mimaison commented on pull request #383: URL: https://github.com/apache/kafka-site/pull/383#issuecomment-968706179 Waiting for https://github.com/apache/kafka/pull/11497 to be merged first -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka-site] mimaison commented on pull request #382: MINOR: Updates for 2.6.3

mimaison commented on pull request #382: URL: https://github.com/apache/kafka-site/pull/382#issuecomment-968705989 Waiting for https://github.com/apache/kafka/pull/11495 to be merged first -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Resolved] (KAFKA-13111) Re-evaluate Fetch Sessions when using topic IDs

[ https://issues.apache.org/jira/browse/KAFKA-13111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-13111. - Reviewer: David Jacot Resolution: Fixed > Re-evaluate Fetch Sessions when using topic IDs