Re: Streams: clarification needed, checkpoint vs. position files

Ah, good thing John showed up to clear things up -- sorry for the misinformation in my first reply (fake news!) Generally speaking only public APIs *need* to be included in the KIP document, anything internal is an implementation detail as you said. In some cases it may still be appropriate to

Re: [DISCUSS] Apache Kafka 3.4.0 release

Hi Sophie, Here it is: KIP-881: https://cwiki.apache.org/confluence/display/KAFKA/KIP-881%3A+Rack-aware+Partition+Assignment+for+Kafka+Consumers I've helped create an entry in under discussion table in KIP page. Luke On Wed, Nov 16, 2022 at 11:18 AM Sophie Blee-Goldman wrote: > Rajini can you

Re: [DISCUSS] Apache Kafka 3.4.0 release

Rajini can you send me the link to this KIP? I don't see it on the KIP page yet Actually this is a good reminder to everyone: *please make sure you have added* *and/or updated all KIPs on the *KIP status page . After

Re: [DISCUSS] Apache Kafka 3.4.0 release

Thanks Rajini, we can include KIP-881 in the 3.4 release assuming it will pass. I'll add it to the release page On Tue, Nov 15, 2022 at 3:51 AM Rajini Sivaram wrote: > Hi Sophie, > > I was out of office and hence couldn't get voting started for KIP-881 in > time. I will start the vote for the

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1355

See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1354

See Changes: -- [...truncated 428683 lines...] [2022-11-16T00:22:13.614Z] [INFO]

Re: [DISCUSS] KIP-884: Add config to configure KafkaClientSupplier in Kafka Streams

Thanks for the questions Matthias! 1. I think we can check the config in the constructor which doesn't take the client supplier as a parameter. This one: public KafkaStreams(final Topology topology, final Properties props) { ... } If users provide a client

Re: [DISCUSS] KIP-884: Add config to configure KafkaClientSupplier in Kafka Streams

Thanks for the KIP Hao. What is the behavior if users set the config and also pass in a client supplier into the constructor? Following other config/API patterns we use, it seems the best thing would be if the code would overwrite the config? If we do this, should we change the config name

[DISCUSS] KIP-884: Add config to configure KafkaClientSupplier in Kafka Streams

Hi all, I have submitted KIP-884 to add config to configure KafkaClientSupplier and would like to start a discussion: https://cwiki.apache.org/confluence/display/KAFKA/KIP-884%3A+Add+config+to+configure+KafkaClientSupplier+in+Kafka+Streams -- Thanks, Hao

Re: [DISCUSS] KIP-881: Rack-aware Partition Assignment for Kafka Consumers

Hi, Rajini, Thanks for the updated KIP. Just another minor comment. It would be useful to list all RPC requests whose version needs to be bumped because of the changes in ConsumerProtocolSubscription. Jun On Tue, Nov 15, 2022 at 3:45 AM Rajini Sivaram wrote: > Hi David, > > Sorry, I was out

[jira] [Resolved] (KAFKA-14360) Documentation: Streams Security page has broken links

[ https://issues.apache.org/jira/browse/KAFKA-14360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14360. - Resolution: Fixed > Documentation: Streams Security page has broken links >

[jira] [Resolved] (KAFKA-12495) Unbalanced connectors/tasks distribution will happen in Connect's incremental cooperative assignor

[ https://issues.apache.org/jira/browse/KAFKA-12495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-12495. --- Resolution: Fixed > Unbalanced connectors/tasks distribution will happen in Connect's

[jira] [Resolved] (KAFKA-13764) Potential improvements for Connect incremental rebalancing logic

[ https://issues.apache.org/jira/browse/KAFKA-13764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-13764. --- Resolution: Fixed > Potential improvements for Connect incremental rebalancing logic >

Re: [VOTE] KIP-881: Rack-aware Partition Assignment for Kafka Consumers

+1 (non-binding). Makes sense, Rajini. This would be a great addition. On Tue, Nov 15, 2022 at 10:55 AM Rajini Sivaram wrote: > Hi all, > > I would like to start vote on KIP-881 to support rack-aware partition > assignment for Kafka consumers: > >

[jira] [Resolved] (KAFKA-14309) Kafka Streams upgrade tests do not cover for FK-joins

[ https://issues.apache.org/jira/browse/KAFKA-14309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-14309. Resolution: Fixed > Kafka Streams upgrade tests do not cover for FK-joins >

[VOTE] KIP-881: Rack-aware Partition Assignment for Kafka Consumers

Hi all, I would like to start vote on KIP-881 to support rack-aware partition assignment for Kafka consumers: https://cwiki.apache.org/confluence/display/KAFKA/KIP-881%3A+Rack-aware+Partition+Assignment+for+Kafka+Consumers . Thank you! Regards, Rajini

[jira] [Created] (KAFKA-14393) Change default size based retention for the cluster metadata partition

José Armando García Sancio created KAFKA-14393: -- Summary: Change default size based retention for the cluster metadata partition Key: KAFKA-14393 URL:

Re: [DISCUSS] KIP-883: Add delete callback method to Connector API

Hey Hector, Thanks for the KIP. I have a minor suggestion in terms of naming. Since this is a callback method, would it make sense to call it onDelete()? Also, the failure scenarios discussed by Greg would need handling. Among other things, I like the idea of having a timeout for graceful

[jira] [Created] (KAFKA-14392) KRaft should comment controller.socket.timeout.ms <= broker.session.timeout.ms

Ron Dagostino created KAFKA-14392: - Summary: KRaft should comment controller.socket.timeout.ms <= broker.session.timeout.ms Key: KAFKA-14392 URL: https://issues.apache.org/jira/browse/KAFKA-14392

[jira] [Resolved] (KAFKA-7206) Enable batching in FindCoordinator

[ https://issues.apache.org/jira/browse/KAFKA-7206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-7206. --- Fix Version/s: 3.0.0 Resolution: Duplicate Duplicate of

Re: Request the account for Kafka Jira

Hi Simon, Usernames have to be all lower case ascii letters and digits, so I used simonzhang. You should have a password reset email where you can complete the account creation. Thanks for your interest in Apache Kafka. On Tue, 15 Nov 2022 at 15:25, zsy112371 wrote: > Hi team, > I would like

Request the account for Kafka Jira

Hi team, I would like to request an account for the kafka jira. username: Simon Zhang display name: Simon Zhang email address: zsy112...@163.com Thank you

[jira] [Resolved] (KAFKA-14389) CVE-2022-34917 | Fixed in 3.3.1

[ https://issues.apache.org/jira/browse/KAFKA-14389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] masood resolved KAFKA-14389. Resolution: Fixed > CVE-2022-34917 | Fixed in 3.3.1 > --- > >

[jira] [Created] (KAFKA-14391) Add ConsumerGroupHeartbeat API

David Jacot created KAFKA-14391: --- Summary: Add ConsumerGroupHeartbeat API Key: KAFKA-14391 URL: https://issues.apache.org/jira/browse/KAFKA-14391 Project: Kafka Issue Type: Sub-task

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1353

See

[jira] [Resolved] (KAFKA-14324) [CVE-2018-25032] introduced by rocksdbjni:6.29.4.1

[ https://issues.apache.org/jira/browse/KAFKA-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christo Lolov resolved KAFKA-14324. --- Resolution: Fixed > [CVE-2018-25032] introduced by rocksdbjni:6.29.4.1 >

Re: [DISCUSS] Apache Kafka 3.4.0 release

Hi Sophie, I was out of office and hence couldn't get voting started for KIP-881 in time. I will start the vote for the KIP today. If there are sufficient votes by tomorrow (16th Nov), can we include this KIP in 3.4, even though voting will only complete on the 17th? It is a small KIP, so we can

Re: [DISCUSS] KIP-881: Rack-aware Partition Assignment for Kafka Consumers

Hi David, Sorry, I was out of office and hence the delay in responding. Thanks for reviewing the KIP and answering Viktor's question (thanks for the review, Viktor). Responses below: 01) I was in two minds about adding new assignors, because as you said, user experience is better if assignors

[jira] [Created] (KAFKA-14390) Kafka and Zookeeper with FIPS SASL has error

lkgen created KAFKA-14390: - Summary: Kafka and Zookeeper with FIPS SASL has error Key: KAFKA-14390 URL: https://issues.apache.org/jira/browse/KAFKA-14390 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-13401) Introduce a new Interface to manage Kafka resources in MM2

[ https://issues.apache.org/jira/browse/KAFKA-13401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13401. Resolution: Fixed > Introduce a new Interface to manage Kafka resources in MM2 >