Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1244

2022-09-20 Thread Apache Jenkins Server
See

Re: Delete quota node in zookeeper when configs are empty

2022-09-20 Thread Luke Chen
Hi Junyang, Could you open a JIRA for this improvement? Also, if you're interested, welcome to submit a PR for it. Thank you. Luke On Wed, Sep 21, 2022 at 2:08 AM Junyang Liu wrote: > Hi, > > > When configuring flow control quota for users and clients, Kafka will add > a child node to

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1243

2022-09-20 Thread Apache Jenkins Server
See

[VOTE] 3.3.0 RC2

2022-09-20 Thread David Arthur
Hello Kafka users, developers and client-developers, This is the second release candidate for Apache Kafka 3.3.0. Many new features and bug fixes are included in this major release of Kafka. A significant number of the issues in this release are related to KRaft, which will be considered

[jira] [Resolved] (KAFKA-14214) StandardAuthorizer may transiently process ACLs out of write order

2022-09-20 Thread David Arthur (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur resolved KAFKA-14214. -- Resolution: Fixed > StandardAuthorizer may transiently process ACLs out of write order >

[jira] [Resolved] (KAFKA-14243) Temporarily disable unsafe downgrade

2022-09-20 Thread David Arthur (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur resolved KAFKA-14243. -- Resolution: Fixed > Temporarily disable unsafe downgrade >

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1242

2022-09-20 Thread Apache Jenkins Server
See Changes: -- [...truncated 425655 lines...] [2022-09-20T20:55:08.017Z] [2022-09-20T20:55:08.017Z] > Task :connect:api:testJar [2022-09-20T20:55:08.017Z] > Task

Re: [DISCUSS] KIP-869: Improve Streams State Restoration Visibility

2022-09-20 Thread Guozhang Wang
Hello Bruno/Nick, I've updated the KIP wiki to reflect the incorporated comments from you, please feel free to take another look and let me know what you think. Guozhang On Tue, Sep 20, 2022 at 9:37 AM Guozhang Wang wrote: > Hi Nick, > > Thanks for the reviews, and I think these are good

Re: Re: [DISCUSS] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters

2022-09-20 Thread Chris Egerton
Hi Daniel, Looking pretty good! Regarding the worker ID generation--apologies, I was unclear with my question. I was wondering if we had to adopt any special logic at all for MM2, or if we could use the same logic that vanilla Kafka Connect does in distributed mode, where the worker ID is its

Delete quota node in zookeeper when configs are empty

2022-09-20 Thread Junyang Liu
Hi, When configuring flow control quota for users and clients, Kafka will add a child node to /config/users or /config/clients in zookeeper. When deleting a flow control quota config, the existing node in zookeeper will not be deleted even if the configs in the node are empty. So if a client

[jira] [Created] (KAFKA-14247) Implement EventHandler interface and DefaultEventHandler

2022-09-20 Thread Philip Nee (Jira)
Philip Nee created KAFKA-14247: -- Summary: Implement EventHandler interface and DefaultEventHandler Key: KAFKA-14247 URL: https://issues.apache.org/jira/browse/KAFKA-14247 Project: Kafka Issue

[jira] [Created] (KAFKA-14246) Refactor KafkaConsumer Threading Model

2022-09-20 Thread Philip Nee (Jira)
Philip Nee created KAFKA-14246: -- Summary: Refactor KafkaConsumer Threading Model Key: KAFKA-14246 URL: https://issues.apache.org/jira/browse/KAFKA-14246 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-14245) Topic deleted during reassignment

2022-09-20 Thread Junyang Liu (Jira)
Junyang Liu created KAFKA-14245: --- Summary: Topic deleted during reassignment Key: KAFKA-14245 URL: https://issues.apache.org/jira/browse/KAFKA-14245 Project: Kafka Issue Type: Bug Affects

Re: [DISCUSS] KIP-863: Reduce Fetcher#parseRecord() memory copy

2022-09-20 Thread Guozhang Wang
In this case, could you update the KIP to clarify the allocation savings more clearly in the "Motivation" section? Also you could mention that for user customizable serdes, if they could provide overwrites on the overloaded function that's also possible for optimize memory allocations. Guozhang

Re: [DISCUSS] KIP-863: Reduce Fetcher#parseRecord() memory copy

2022-09-20 Thread Guozhang Wang
1. Ack, thanks. 2. Sounds good, thanks for clarifying. On Tue, Sep 20, 2022 at 9:50 AM ShunKang Lin wrote: > Hi Guozhang, > > Thanks for your comments! > > 1. We can reduce memory allocation if the key/value types happen to be > ByteBuffer or String. > 2. I would like to add `default ByteBuffer

Re: [DISCUSS] KIP-863: Reduce Fetcher#parseRecord() memory copy

2022-09-20 Thread ShunKang Lin
Hi Guozhang, Thanks for your comments! 1. We can reduce memory allocation if the key/value types happen to be ByteBuffer or String. 2. I would like to add `default ByteBuffer serializeToByteBuffer(String topic, Headers headers, T data)` in Serializer to reduce memory copy in

Re: [DISCUSS] KIP-869: Improve Streams State Restoration Visibility

2022-09-20 Thread Guozhang Wang
Hi Nick, Thanks for the reviews, and I think these are good suggestions. Note that currently the `restore-records-total/rate` would include both restoring active tasks as well as updating standby tasks, I think for your purposes you'd be more interested in active restoring tasks since they could

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1241

2022-09-20 Thread Apache Jenkins Server
See

Testing Kafka on laptop

2022-09-20 Thread vinoth rajagopalan
I want know if I can run the bench mark tests for kafka on a single laptop. If not is there anything available for open source contributors to run thier tests that is provided by the apache software foundation Regards, Vinoth

Maximum Number of Streams In KSQL Join

2022-09-20 Thread Tim McClure
We are using a CDC tool that will generate up to 30 different streams when an update occurs on the database. Was going to have each table be a separate topic and join them together with KSQL. This is reasonable? Also not all 30 topics will have data - how do I guarantee I capture all the data

[jira] [Created] (KAFKA-14244) Prevent unit/integration tests from terminating JVM

2022-09-20 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-14244: - Summary: Prevent unit/integration tests from terminating JVM Key: KAFKA-14244 URL: https://issues.apache.org/jira/browse/KAFKA-14244 Project: Kafka Issue

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1240

2022-09-20 Thread Apache Jenkins Server
See

Re: CVE-2022-34917: Unauthenticated clients may cause OutOfMemoryError on Apache Kafka Brokers

2022-09-20 Thread Luke Chen
What a great finding! Thanks Mickael Maison, Tom Bentley and Daniel Collins! And thanks for all the release managers who help drive all these security patch releases! Luke On Mon, Sep 19, 2022 at 11:53 PM Manikumar wrote: > Severity: High > > Description: > > A security vulnerability has

Re: [DISCUSS] KIP-869: Improve Streams State Restoration Visibility

2022-09-20 Thread Nick Telford
Hi Guozhang, KIP looks great, I have one suggestion: in addition to "restore-records-total", it would also be useful to track the number of records *remaining*, that is, the records that have not yet been restored. This is actually the metric I was attempting to implement in the

[GitHub] [kafka-site] tombentley merged pull request #444: MINOR: Mention CVE-2022-34917 in downloads.html

2022-09-20 Thread GitBox
tombentley merged PR #444: URL: https://github.com/apache/kafka-site/pull/444 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1239

2022-09-20 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-14212) Fetch error response when hitting public OAuth/OIDC provider

2022-09-20 Thread Manikumar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-14212. --- Fix Version/s: 3.4.0 Resolution: Fixed > Fetch error response when hitting public OAuth/OIDC