Re: [VOTE] KIP-872: Add Serializer#serializeToByteBuffer() to reduce memory copying

Hello ShunKang, +1(binding) from me -- Thanks, Ziming > On May 30, 2023, at 20:07, ShunKang Lin wrote: > > Hi all, > > Bump this thread again and see if we could get a few more votes. Currently > we have +2 non-binding and +1 binding. > Hoping we can get this approved, reviewed, and merged

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1878

See

Re: [DISCUSS] KIP-923: Add A Grace Period to Stream Table Join

Thanks for all the additional comments. I will either address them here or update the kip accordingly. I mentioned a follow kip to add extra features before and in the responses. I will try to briefly summarize what options and optimizations I plan to include. If a concern is not covered in this

Re: [DISCUSS] KIP-937 Improve Message Timestamp Validation

Thank you for the feedback Justine. Yes, I can expand on the KIP what the behavior is when we return INVALID_TIMESTAMP. On 5/30/23, 1:34 PM, "Justine Olshan" mailto:jols...@confluent.io.inva>LID> wrote: CAUTION: This email originated from outside of the organization. Do not click links or

Re: [DISCUSS] KIP-925: rack aware task assignment in Kafka Streams

Hey Hao, thanks for the KIP! 1. There's a typo in the "internal.rack.aware.assignment.strategry" config, this should be internal.rack.aware.assignment.strategy. 2. > For O(E^2 * (CU)) complexity, C and U can be viewed as constant. Number of > edges E is T * N where T is the number of clients

Re: [DISCUSS] KIP-937 Improve Message Timestamp Validation

Hi Mehari, This is an interesting KIP! I've seen my fair share of issues due to future timestamps, so this is definitely an area that could be improved. I noticed in the compatibility section it says: > There are no changes to public interfaces that will impact clients. However, this change is

[DISCUSS] KIP-937 Improve Message Timestamp Validation

Hi Everyone, I would like to start a discussion on KIP-937: Improve Message Timestamp Validation (https://cwiki.apache.org/confluence/display/KAFKA/KIP-937%3A+Improve+Message+Timestamp+Validation). This is a small KIP that aims to tighten the current validation logic of a message timestamp.

Re: [VOTE] KIP-925: rack aware task assignment in Kafka Streams

+1 (non-binding) Thank you Hao! Colt McNealy *Founder, LittleHorse.dev* On Tue, May 30, 2023 at 9:50 AM Hao Li wrote: > Hi all, > > I'd like to open the vote for KIP-925: rack aware task assignment in Kafka > Streams. The link for the KIP is > >

Re: [VOTE] 3.4.1 RC3

Hi Luke, Many thanks for your continued work on this release! To verify, I: - Built from source using Java 11 with both: - - the 3.4.1-rc3 tag on GitHub - - the kafka-3.4.1-src.tgz artifact from https://home.apache.org/~showuon/kafka-3.4.1-rc3/ - Checked signatures and checksums - Ran the

Requesting permission to contribute

Hi, I'm kindly asking for permission to contribute to the Apache Kafka project, as described on https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals page. My Apache Wiki ID: beegor My Apache JIRA ID: beegor Thanks in advance, Igor

[VOTE] KIP-925: rack aware task assignment in Kafka Streams

Hi all, I'd like to open the vote for KIP-925: rack aware task assignment in Kafka Streams. The link for the KIP is https://cwiki.apache.org/confluence/display/KAFKA/KIP-925%3A+Rack+aware+task+assignment+in+Kafka+Streams . -- Thanks, Hao

Re: [DISCUSS] KIP-932: Queues for Kafka

Yes, that’s it. I imagine something similar to KIP-848 for managing the share group membership, and consumers that fetch records from their assigned partitions and acknowledge when delivery completes. Thanks, Andrew > On 30 May 2023, at 16:52, Adam Warski wrote: > > Thanks for the explanation!

Re: [DISCUSS] Adding non-committers as Github collaborators

Hey all, I received an invitation to collaborate on apache/kafka, but let the invitation expire after 7 days. Is there a workflow for refreshing the invite, or is an admin able to manually re-invite me? I'm gharris1727 on github. Thanks! Greg On Wed, May 24, 2023 at 9:32 AM Justine Olshan

Re: [DISCUSS] KIP-858: Handle JBOD broker disk failure in KRaft

Hi Alexandre, Thank you for having a look at this KIP, and thank you for pointing this out. I like the idea of expanding the health status of a log directory beyond just online/offline status. This KIP currently proposes a single logdir state transition, from online to offline, conveyed in a

Re: [DISCUSS] KIP-932: Queues for Kafka

Thanks for the explanation! So effectively, a share group is subscribed to each partition - but the data is not pushed to the consumer, but only sent on demand. And when demand is signalled, a batch of messages is sent? Hence it would be up to the consumer to prefetch a sufficient number of

Re: [VOTE] 3.4.1 RC3

Hi Luke, I built from source with Java 11 and Scala 2.13 and ran the unit and integration tests. It took a few retries to get some of them to pass. I verified signatures and hashes and also ran the zookeeper quickstart. +1 (binding) Thanks, Mickael On Sat, May 27, 2023 at 12:58 PM Jakub Scholz

[jira] [Created] (KAFKA-15039) Reduce logging level to trace in PartitionChangeBuilder.tryElection()

Ron Dagostino created KAFKA-15039: - Summary: Reduce logging level to trace in PartitionChangeBuilder.tryElection() Key: KAFKA-15039 URL: https://issues.apache.org/jira/browse/KAFKA-15039 Project:

Re: [DISCUSS] KIP-921 OpenJDK CRaC support

Thank you for mentioning the use case. I will try to summarize what you mentioned above in my own words to ensure that I have understood this correctly. There are practical use cases where the user application has a dependency on Kafka producer and requires very quick cold starts. In such cases,

Re: [DISCUSS] KIP-932: Queues for Kafka

Hi Adam, Thanks for your question. With a share group, each fetch is able to grab available records from any partition. So, it alleviates the “head-of-line” blocking problem where a slow consumer gets in the way. There’s no actual stealing from a slow consumer, but it can be overtaken and must

Re: [DISCUSS] KIP-932: Queues for Kafka

Hi Luke, Thanks for your comments. 1) I expect that fetch-from-follower will not be supported for share groups. If you think about it, FFF gives freedom to fetch records from a nearby broker, but it does not also give the ability to commit offsets to a nearby broker. For a share-group, the

[jira] [Resolved] (KAFKA-14970) Dual write mode testing for SCRAM and Quota

[ https://issues.apache.org/jira/browse/KAFKA-14970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proven Provenzano resolved KAFKA-14970. --- Resolution: Fixed Committed and merged into 3.5. > Dual write mode testing for

Re: [DISCUSS] KIP-932: Queues for Kafka

Hi Satish, Thanks for your comments. 101 I am not planning to extend this functionality for queuing semantics like the JMS point-to-point model in future. While this KIP does make it more viable to create a relatively thin JMS client that talks Kafka protocol directly, there’s a lot more to

Re: [VOTE] KIP-872: Add Serializer#serializeToByteBuffer() to reduce memory copying

Hi all, Bump this thread again and see if we could get a few more votes. Currently we have +2 non-binding and +1 binding. Hoping we can get this approved, reviewed, and merged in time for 3.6.0. Best, ShunKang ShunKang Lin 于2023年5月7日周日 15:24写道： > Hi everyone, > > I'd like to open the vote for

[GitHub] [kafka-site] fvaleri commented on pull request #516: MINOR: Add blog for 3.5.0 release

fvaleri commented on PR #516: URL: https://github.com/apache/kafka-site/pull/516#issuecomment-1568312800 Thanks @mimaison. In addition to the previous comments, should we also add a link for reporting issues with KRaft migration? -- This is an automated message from the Apache Git

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1877

See

[jira] [Created] (KAFKA-15038) Use topic id/name mapping from the Metadata cache in RLM

Alexandre Dupriez created KAFKA-15038: - Summary: Use topic id/name mapping from the Metadata cache in RLM Key: KAFKA-15038 URL: https://issues.apache.org/jira/browse/KAFKA-15038 Project: Kafka

[GitHub] [kafka-site] divijvaidya commented on pull request #516: MINOR: Add blog for 3.5.0 release

divijvaidya commented on PR #516: URL: https://github.com/apache/kafka-site/pull/516#issuecomment-1568142629 Suggestion: It would be useful for the user persona if we can add links to the "[upgrade to 3.5.0](https://kafka.apache.org/35/documentation.html#upgrade_3_5_0)" somewhere in the

[jira] [Created] (KAFKA-15037) initialize unifiedLog with remoteStorageSystemEnable correctly

Luke Chen created KAFKA-15037: - Summary: initialize unifiedLog with remoteStorageSystemEnable correctly Key: KAFKA-15037 URL: https://issues.apache.org/jira/browse/KAFKA-15037 Project: Kafka

[GitHub] [kafka-site] jlprat commented on a diff in pull request #516: MINOR: Add blog for 3.5.0 release

jlprat commented on code in PR #516: URL: https://github.com/apache/kafka-site/pull/516#discussion_r1210019797 ## blog.html: ## @@ -0,0 +1,69 @@ + + + + + + + + +Blog + + + +

About My build In Package using KafkaJS

Greetings, I have built a NPM package named "*kafka-pub-sub*" using the KafkaJS library with the support of stream processing that enables applications to publish, consume and process high volumes of record streams in a fast and durable way. Anyone will be able to use the Kafka Pub Sub calling

Re: [DISCUSS] KIP-877: Mechanism for plugins and connectors to register metrics

Hi Jorge, There are a few issues with the current proposal. Once 3.5 is out, I plan to start looking at this again. Thanks, Mickael On Mon, May 15, 2023 at 3:19 PM Jorge Esteban Quilcate Otoya wrote: > > Hi Mickael, > > Just to check the status of this KIP as it looks very useful. I can see

Re: [DISCUSS] Apache Kafka 3.5.0 release

Hi, Traditionally we used to publish an announcement on the Apache blog for major and minor releases. Unfortunately the Apache blog is going away so we can't use it anymore. There has been a few discussions on updating our website to have a proper blog (and use a markup language instead of raw

Re: [VOTE] 3.5.0 RC0

Hi David, Feel free to backport the necessary fixes to 3.5. Thanks, Mickael On Tue, May 30, 2023 at 10:32 AM Mickael Maison wrote: > > Hi Greg, > > Thanks for the heads up, this indeed looks like something we want in > 3.5. I've replied in the PR. > > Mickael > > On Sat, May 27, 2023 at 11:44 

Re: [VOTE] 3.5.0 RC0

Hi Greg, Thanks for the heads up, this indeed looks like something we want in 3.5. I've replied in the PR. Mickael On Sat, May 27, 2023 at 11:44 PM David Arthur wrote: > > Mickael, after looking more closely, I definitely think KAFKA-15010 is a > blocker. It creates the case where the