Re: [DISCUSS] KIP-962 Relax non-null key requirement in Kafka Streams

Hi Lucas, Thanks. I added the point about the upgrade guide as well. Florin On Mon, 7 Aug 2023 at 11:06, Lucas Brutschy wrote: > Hi Florin, > > thanks for the KIP! This looks good to me. I agree that the precise > Java doc wording doesn't have to be discussed as part of the KIP. > > I would

Re: new KIP doubt

Hi Sergio, Thanks for contributing to Apache Kafka! You don't need any credentials to start a discussion thread. The discussion thread is started by sending an email to this very same mailing list with a subject like [DISUSS] KIP-964: Have visibility when produce requests become "async". And then

[DISCUSS] KIP-964: Have visibility when produce requests become "async".

Hi everyone! I would like to start a discuss thread for this KIP Thanks

new KIP doubt

hey everyone, Sorry for bothering you, I created a KIP long time ago and now I am creating a new one here The problem is I lost my apache credentials for starting a discussion thread, could you please tell me how I can

[VOTE] KIP-953: partition method to be overloaded to accept headers as well.

Hey everyone. I would like to call for a vote on KIP-953: partition method to be overloaded to accept headers as well. KIP : https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=263424937 Discussion thread : https://lists.apache.org/thread/0f20kvfqkmhdqrwcb8vqgqn80szcrcdd Thanks --

Re: [QUESTION] What is the difference between sequence and offset for a Record?

Hi Matthias and Justine, Thanks for your reply! I can summarize the answer as - Record offset = base offset + offset delta. This field is calculated by the broker and the delta won't change but the base offset may change during log normalizing. Record sequence = base sequence + (offset) delta.

Re: [QUESTION] What is the difference between sequence and offset for a Record?

but the base offset may change during log normalizing. Not sure what you mean by "normalization" but offsets are immutable, so they don't change. (To be fair, I am not an expert on brokers, so not sure how this work in detail when log compaction ticks in). This field is given by the

Re: [DISCUSS] KIP-953: partition method to be overloaded to accept headers as well.

Hey everyone I'm closing the discussion as I haven't heard from 3 days. Before I close the thread I would like to thank Sagar and Andrew for their suggestions and feedback. I believe it has helped to improve the KIP. Thank you all. On Fri, Aug 4, 2023 at 10:26 AM Jack Tomy wrote: > All

Re: [VOTE] KIP-959 Add BooleanConverter to Kafka Connect

Hello, I still need help from a committer to review/approve this (small) KIP, which adds a new BooleanConverter to the list of converters in Kafka Connect. The KIP has a companion PR implementing the feature as well. Thanks again! Sent from Bloomberg Professional for iPhone - Original

Re: [DISCUSS] KIP-962 Relax non-null key requirement in Kafka Streams

Hi Both, Thanks. I added remarks to account for this. https://cwiki.apache.org/confluence/display/KAFKA/KIP-962%3A+Relax+non-null+key+requirement+in+Kafka+Streams#KIP962:RelaxnonnullkeyrequirementinKafkaStreams-Remarks In short, let's add a note in the Java docs? The exact wording of the note

Re: [VOTE] KIP-940: Broker extension point for validating record contents at produce time

Hi Adrian, Thanks for the KIP. Looks like a nice improvement. +1 (non-binding) Thanks, Andrew > On 2 Aug 2023, at 12:33, Adrian Preston wrote: > > Hello all, > > > > Edo and I would like to call for a vote on KIP-940: > >

Re: [DISCUSS] KIP-962 Relax non-null key requirement in Kafka Streams

Hi Florin, thanks for the KIP! This looks good to me. I agree that the precise Java doc wording doesn't have to be discussed as part of the KIP. I would also suggest to include an update to https://kafka.apache.org/documentation/streams/upgrade-guide Cheers, Lucas On Mon, Aug 7, 2023 at 10:51 

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2074

See

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #153

See Changes: -- [...truncated 495740 lines...] Gradle Test Run :core:integrationTest > Gradle Test Executor 168 > KafkaZkClientTest > testControllerManagementMethods()

Re: [QUESTION] What is the difference between sequence and offset for a Record?

The sequence summary looks right to me. For log normalization, are you referring to compaction? The segment's first and last offsets might change, but a batch keeps its offsets when compaction occurs. Hope that helps. Justine On Mon, Aug 7, 2023 at 8:59 AM Matthias J. Sax wrote: > > but the

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #149

See Changes: -- [...truncated 439977 lines...] FetchRequestTestDowngrade > testTopicIdIsRemovedFromFetcherWhenControllerDowngrades() STARTED SslAdminIntegrationTest >

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #53

See Changes: -- [...truncated 281624 lines...] Gradle Test Run :streams:integrationTest > Gradle Test Executor 177 > VersionedKeyValueStoreIntegrationTest > shouldRestore

[jira] [Created] (KAFKA-15312) FileRawSnapshotWriter must flush before atomic move

José Armando García Sancio created KAFKA-15312: -- Summary: FileRawSnapshotWriter must flush before atomic move Key: KAFKA-15312 URL: https://issues.apache.org/jira/browse/KAFKA-15312

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #184

See Changes: -- [...truncated 253727 lines...] org.apache.kafka.streams.integration.StandbyTaskCreationIntegrationTest >

[jira] [Created] (KAFKA-15311) Docs incorrectly state that reverting to ZooKeeper mode during the migration is not possible

Colin McCabe created KAFKA-15311: Summary: Docs incorrectly state that reverting to ZooKeeper mode during the migration is not possible Key: KAFKA-15311 URL: https://issues.apache.org/jira/browse/KAFKA-15311

Re: [DISCUSS] KIP-955: Add stream-table join on foreign key

Hi Matthias, Hi Matthias, Thanks for your comments. I would like to clarify the use case a little more to show why existing table-table foreign key join will not work for the use case I am trying to address. Let’s consider the very simple use case with the parent messages in one Kafka