Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-06-12 Thread Matthias J. Sax
106: For the use-case of deduplicating a "at least once written" stream, we are sure that the duplicate record has the same key as the original one, and will land on the same task. Here, a user would want to specify a deduplication key different from the topic's key in case the topic's key is

Re: Subscribe for discussion on Kafka® development

2024-06-12 Thread Matthias J. Sax
This is self service. Please follow the instructions from the web page: https://kafka.apache.org/contact -Matthias On 6/11/24 9:38 AM, Punsak Incham wrote: I want to subscribe for discussion on Kafka® development. Best regards, A black and blue logo Description automatically generated

Re: [VOTE] KIP-1035: StateStore managed changelog offsets

2024-06-12 Thread Matthias J. Sax
Thanks Nick. +1 (binding) Looking forward to get this all merged! -Matthias On 6/12/24 9:36 AM, Nick Telford wrote: Hi everyone, I'd like to call a vote on KIP-1035[1]. Regards, Nick 1: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1035%3A+StateStore+managed+changelog+offsets

Re: [VOTE] KIP-1049: Add config log.summary.interval.ms to Kafka Streams

2024-06-12 Thread Matthias J. Sax
+1 (binding) On 6/11/24 1:17 PM, Sophie Blee-Goldman wrote: +1 (binding) Thanks for the KIP! On Tue, Jun 11, 2024 at 5:37 AM jiang dou wrote: HI I would like to start a vote for KIP-1049: Add config log.summary.interval.ms to Kafka Streams KIP:

Re: [DISCUSS] KIP-1027 Add MockFixedKeyProcessorContext

2024-06-12 Thread Matthias J. Sax
I believe the class name was picked on purpose, to make clear that it should not be used -- the problem is, that the class is in a public package and is by itself public (that's unfortunately require, given how Java works). Of course, it's also in the JavaDocs that the class is internal and

Re: [DISCUSS] KIP-1056: Remove `default.` prefix for exception handler StreamsConfig

2024-06-12 Thread Matthias J. Sax
Thanks Greg, this is a valid idea. However, there was no demand in the past to allow for error handler callbacks in a fine grained manner, and I am frankly also not sure if it would make sense or would be required. Thus, I am not concerned about this case, and believe this KIP does make

[jira] [Resolved] (KAFKA-14877) refactor InMemoryLeaderEpochCheckpoint

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-14877. Resolution: Invalid > refactor InMemoryLeaderEpochCheckpoint >

[jira] [Reopened] (KAFKA-16935) Automatically wait for cluster startup in embedded Connect integration tests

2024-06-12 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton reopened KAFKA-16935: --- > Automatically wait for cluster startup in embedded Connect integration tests >

[jira] [Resolved] (KAFKA-16935) Automatically wait for cluster startup in embedded Connect integration tests

2024-06-12 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-16935. --- Resolution: Fixed > Automatically wait for cluster startup in embedded Connect integration

[jira] [Created] (KAFKA-16947) Kafka Tiered Storage V2

2024-06-12 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-16947: -- Summary: Kafka Tiered Storage V2 Key: KAFKA-16947 URL: https://issues.apache.org/jira/browse/KAFKA-16947 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-13561) Consider deprecating `StreamsBuilder#build(props)` function

2024-06-12 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-13561. - Resolution: Duplicate > Consider deprecating `StreamsBuilder#build(props)` function >

[jira] [Resolved] (KAFKA-16890) Failing to build aux state on broker failover

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-16890. Resolution: Fixed > Failing to build aux state on broker failover >

[jira] [Created] (KAFKA-16946) Utils.getHost/getPort cannot parse SASL_PLAINTEXT://host:port

2024-06-12 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16946: - Summary: Utils.getHost/getPort cannot parse SASL_PLAINTEXT://host:port Key: KAFKA-16946 URL: https://issues.apache.org/jira/browse/KAFKA-16946 Project: Kafka

Kafka certification

2024-06-12 Thread Matheus Pereira dos Santos
Hi! I am a Back End developer and I am looking for official kafka certifications, but for now I am just finding courses. If exists any official certification for Kafka developer, I would like to know. Best regards! Matheus P. S.

Re: [DISCUSS] KIP-1027 Add MockFixedKeyProcessorContext

2024-06-12 Thread Shashwat Pandey
Hi Matthias, I think that strategy definitely works, abstracting away changes to FixedKeyRecord from users, I can put that new factory class and update the KIP. This might be a discussion for another KIP, but would it also make sense to rename the InternalFixedKeyRecordFactory to just

[jira] [Created] (KAFKA-16945) Cleanup StreamsBuilder and TopologyConfig

2024-06-12 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16945: --- Summary: Cleanup StreamsBuilder and TopologyConfig Key: KAFKA-16945 URL: https://issues.apache.org/jira/browse/KAFKA-16945 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-16897) Move OffsetIndexTest and OffsetMapTest to storage module

2024-06-12 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16897. Fix Version/s: 3.9.0 Resolution: Fixed > Move OffsetIndexTest and OffsetMapTest to

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.8 #36

2024-06-12 Thread Apache Jenkins Server
See

Re: [PR] MINOR: Mention confirming email subscriptions to contact page [kafka-site]

2024-06-12 Thread via GitHub
gharris1727 merged PR #606: URL: https://github.com/apache/kafka-site/pull/606 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: Subscribe for discussion on Kafka(R) development

2024-06-12 Thread Greg Harris
Hi Punsak, Please find the instructions for subscribing to this mailing list here: https://kafka.apache.org/contact and here: https://www.apache.org/foundation/mailinglists Thanks, Greg On Wed, Jun 12, 2024 at 7:11 AM Punsak Incham wrote: > I want to subscribe for discussion on Kafka®

[PR] MINOR: Mention confirming email subscriptions to contact page [kafka-site]

2024-06-12 Thread via GitHub
gharris1727 opened a new pull request, #606: URL: https://github.com/apache/kafka-site/pull/606 Some users partially subscribe to the mailing list, possibly because we don't mention the second step of replying to the confirmation email. Mentioning this succinctly in the page and linking to

Re: [DISCUSS] KIP-1056: Remove `default.` prefix for exception handler StreamsConfig

2024-06-12 Thread Greg Harris
Hi Murali, Thanks for the KIP! I'm not familiar with Streams so I'll pose a general question, open for anyone to answer: The configs that are being changed don't currently accept in-place overwrites in the code, so the "default.*" prefix doesn't make sense. Could there be a KIP to accept

[jira] [Resolved] (KAFKA-16858) Flatten SMT throws NPE

2024-06-12 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-16858. - Resolution: Fixed > Flatten SMT throws NPE > -- > > Key:

[jira] [Created] (KAFKA-16944) Range assignor doesn't co-partition with stickiness

2024-06-12 Thread Ritika Reddy (Jira)
Ritika Reddy created KAFKA-16944: Summary: Range assignor doesn't co-partition with stickiness Key: KAFKA-16944 URL: https://issues.apache.org/jira/browse/KAFKA-16944 Project: Kafka Issue

RE: [VOTE] KIP-1040: Improve handling of nullable values in InsertField, ExtractField, and other transformations

2024-06-12 Thread Punsak Incham
Hi all, I have a few questions. If you include all the related SMTs in the KIP, such as MaskField and ValueToKey, As a user, when will I be able to use the updated SMTs? Do all the related SMTs in the KIP need to be fixed first before you release them for users like me to use? Punsak Incham

[jira] [Created] (KAFKA-16943) Synchronously verify Connect worker startup failure in InternalTopicsIntegrationTest

2024-06-12 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-16943: - Summary: Synchronously verify Connect worker startup failure in InternalTopicsIntegrationTest Key: KAFKA-16943 URL: https://issues.apache.org/jira/browse/KAFKA-16943

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-12 Thread José Armando García Sancio
Hi Josep, See my comment below. On Wed, Jun 12, 2024 at 1:17 PM Josep Prat wrote: > How long do you think it will take to bring KIP-853 to completion? We are still missing a few issues/jiras that need to get implemented for the feature to be usable. I would say a few more weeks. May be early

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.8 #35

2024-06-12 Thread Apache Jenkins Server
See

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-12 Thread Josep Prat
Hi Colin, How long do you think it will take to bring KIP-853 to completion? Best, On Wed, Jun 12, 2024 at 6:42 PM Colin McCabe wrote: > Hi Josep, > > KIP-966 is not needed for feature parity with ZK. Indeed, KIP-966 will not > be implemented in ZK at all (and never was). > > There is a PR

Re: [VOTE] KIP-1040: Improve handling of nullable values in InsertField, ExtractField, and other transformations

2024-06-12 Thread Greg Harris
Hi Mario, Thank you for mentioning the earlier DISCUSS thread. I found this comment from Chris, which was agreed upon and applied to the KIP: > Yes, I think we should just do one KIP for all the SMTs. You don't have to > implement everything all at once or by yourself, but I don't see why we >

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-12 Thread Colin McCabe
Hi Josep, KIP-966 is not needed for feature parity with ZK. Indeed, KIP-966 will not be implemented in ZK at all (and never was). There is a PR related to honoring dynamic configs for unclean.leader.election which we did agree to do for 3.8. It's under review and we hope to get it in soon.

[VOTE] KIP-1035: StateStore managed changelog offsets

2024-06-12 Thread Nick Telford
Hi everyone, I'd like to call a vote on KIP-1035[1]. Regards, Nick 1: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1035%3A+StateStore+managed+changelog+offsets

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-12 Thread Justine Olshan
I'm just going to echo what Luke said. KIP-966 is definitely delayed to the next release and we only need the unclean leadership election PR he shared. Thanks, Justine On Wed, Jun 12, 2024 at 9:33 AM Calvin Liu wrote: > Hi Josep > Due to the limit of the review resources, KIP-966 may have to

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-12 Thread Calvin Liu
Hi Josep Due to the limit of the review resources, KIP-966 may have to be delayed to the next release. Thanks. On Wed, Jun 12, 2024 at 2:05 AM Rajini Sivaram wrote: > > > > Yes, we could backport this one to the 3.8 branch. Would you be able to > do > > this once you merge this PR? > > > Thanks

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-12 Thread Josep Prat
Hi Edoardo, Correct, you can still cherry-pick this one. I'll send an email tomorrow morning (CEST) asking maintainers to stop cherry picking commits unless we discuss it beforehand. Best, On Wed, Jun 12, 2024 at 6:09 PM Edoardo Comar wrote: > Hi Josep, I understand I am still in time to

Re: [VOTE] 3.7.1 RC1

2024-06-12 Thread Edoardo Comar
Hi Igor, is it too late to cherry-pick https://github.com/apache/kafka/pull/16229 to 3.7.1 ? Thanks, Edo On Tue, 11 Jun 2024 at 08:29, Igor Soarez wrote: > > Now attaching the container build reports, which I seem to have forgotten to > include before. > > -- > Igor

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-12 Thread Edoardo Comar
Hi Josep, I understand I am still in time to cherry-pick on 3.8.0 https://github.com/apache/kafka/pull/16229 right? thanks On Wed, 12 Jun 2024 at 11:34, Ivan Yurchenko wrote: > > Hi, > > I'll try to do all the fixes and changes for KIP-899 [1] sooner today, but > please proceed with the

[jira] [Created] (KAFKA-16942) Use ConcurrentHashMap in RecordAccumulator#nodeStats

2024-06-12 Thread Kuan Po Tseng (Jira)
Kuan Po Tseng created KAFKA-16942: - Summary: Use ConcurrentHashMap in RecordAccumulator#nodeStats Key: KAFKA-16942 URL: https://issues.apache.org/jira/browse/KAFKA-16942 Project: Kafka Issue

[jira] [Resolved] (KAFKA-16865) Admin.describeTopics behavior change after KIP-966

2024-06-12 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-16865. Resolution: Fixed > Admin.describeTopics behavior change after KIP-966 >

Subscribe for discussion on Kafka® development

2024-06-12 Thread Punsak Incham
I want to subscribe for discussion on Kafka® development. Best regards, [A black and blue logo Description automatically generated] Punsak Incham (Mon) Data Platform Engineer Data Modernization Tel : +66(0)91-790-1302 | Email : pun...@mfec.co.th

Re: [VOTE] KIP-1040: Improve handling of nullable values in InsertField, ExtractField, and other transformations

2024-06-12 Thread Mario Fiore Vitale
Hi Greg, The same check was made by Chris Egerton during the discussion thread. The original KIP scope was just for the InsertField, ExtractField SMTs, then we decided to enlarge the scope of only the KIP to also other potential affected SMTs. As of now the PR scope, instead, is only for

[jira] [Created] (KAFKA-16941) Flaky test - testDynamicBrokerConfigUpdateUsingKraft [1] Type=Raft-Combined, MetadataVersion=4.0-IV0,Security=PLAINTEXT – kafka.admin.ConfigCommandIntegrationTest

2024-06-12 Thread Igor Soarez (Jira)
Igor Soarez created KAFKA-16941: --- Summary: Flaky test - testDynamicBrokerConfigUpdateUsingKraft [1] Type=Raft-Combined, MetadataVersion=4.0-IV0,Security=PLAINTEXT – kafka.admin.ConfigCommandIntegrationTest Key: KAFKA-16941

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-12 Thread Ivan Yurchenko
Hi, I'll try to do all the fixes and changes for KIP-899 [1] sooner today, but please proceed with the release if I don't manage. Ivan [1] https://github.com/apache/kafka/pull/13277 On Wed, Jun 12, 2024, at 12:54, Josep Prat wrote: > Hi Luke, > I think Jose, also mentioned that it won't be

[jira] [Created] (KAFKA-16940) Flaky test "testNoConsumeWithDescribeAclViaSubscribe(String).quorum=kraft" – kafka.api.DelegationTokenEndToEndAuthorizationWithOwnerTest

2024-06-12 Thread Igor Soarez (Jira)
Igor Soarez created KAFKA-16940: --- Summary: Flaky test "testNoConsumeWithDescribeAclViaSubscribe(String).quorum=kraft" – kafka.api.DelegationTokenEndToEndAuthorizationWithOwnerTest Key: KAFKA-16940 URL:

Re: [DISCUSS] RemoteLogSegmentMetadataRecord Schema Evolution

2024-06-12 Thread Kamal Chandraprakash
Ignore the above message. Went over the Kafka message definition README guide and learnt about the tagged fields. On Tue, Jun 11, 2024 at 10:32 PM Kamal Chandraprakash <

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-12 Thread Josep Prat
Hi Luke, I think Jose, also mentioned that it won't be ready for v3.8.0 (but he can confirm this). My question now would be, given that it seems we would need a v3.9.0, do you think it's important to include https://github.com/apache/kafka/pull/16284 in v3.8.0? Best, On Wed, Jun 12, 2024 at

[jira] [Created] (KAFKA-16939) Revisit ConfigCommandIntegrationTest

2024-06-12 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16939: -- Summary: Revisit ConfigCommandIntegrationTest Key: KAFKA-16939 URL: https://issues.apache.org/jira/browse/KAFKA-16939 Project: Kafka Issue Type: Test

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-12 Thread Luke Chen
Hi Josep For KIP-966, I think Calvin had mentioned he won't complete in v3.8.0. https://lists.apache.org/thread/fsnr8wy5fznzfso7jgk90skgyo277fmw For unclean leader election, all we need is this PR: https://github.com/apache/kafka/pull/16284 For this PR, I think it needs one more week to be

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #3000

2024-06-12 Thread Apache Jenkins Server
See

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-12 Thread Rajini Sivaram
> > Yes, we could backport this one to the 3.8 branch. Would you be able to do > this once you merge this PR? Thanks Josep! There were some unit test failures in last night's PR build, so I have commented on the PR for Ivan to fix. If he fixes it today, then I can merge to trunk and then

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-12 Thread Josep Prat
Hi all, We are now really close to the planned code freeze deadline (today EOD). According to KIP-1012 [1] we agreed to stay in the 3.x branch until we achieve feature parity regarding Zookeeper and KRaft. The two main KIPs identified that would achieve this are: KIP-853 [2] and KIP-966 [3]. At

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-12 Thread Josep Prat
Hi Rajini, Yes, we could backport this one to the 3.8 branch. Would you be able to do this once you merge this PR? Thanks On Tue, Jun 11, 2024 at 10:53 PM Rajini Sivaram wrote: > Hi Josep, > > The PR https://github.com/apache/kafka/pull/13277 for KIP-899 looks ready > to be merged (waiting for

[jira] [Created] (KAFKA-16938) non-dynamic props gets corrupted due to circular reference between DynamicBrokerConfig and DynamicConfig

2024-06-12 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16938: -- Summary: non-dynamic props gets corrupted due to circular reference between DynamicBrokerConfig and DynamicConfig Key: KAFKA-16938 URL:

[jira] [Resolved] (KAFKA-16770) Coalesce records into bigger batches

2024-06-12 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16770. - Resolution: Fixed > Coalesce records into bigger batches >

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.8 #33

2024-06-11 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-16937) Consider inlineing Time#waitObject to ProducerMetadata#awaitUpdate

2024-06-11 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16937: -- Summary: Consider inlineing Time#waitObject to ProducerMetadata#awaitUpdate Key: KAFKA-16937 URL: https://issues.apache.org/jira/browse/KAFKA-16937 Project:

[jira] [Resolved] (KAFKA-15600) KIP-990: Capability to PAUSE Tasks on DeserializationException

2024-06-11 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-15600. - Resolution: Won't Fix > KIP-990: Capability to PAUSE Tasks on DeserializationException

Re: [VOTE] KIP-1040: Improve handling of nullable values in InsertField, ExtractField, and other transformations

2024-06-11 Thread Greg Harris
Hi Mario, Thanks for the KIP. I'm on-board with this KIP, I just wanted to verify a discrepancy I noticed. I checked all of the call-sites of Struct#get(Field) and Struct#get(String) in Kafka, and noticed there are some call-sites which are not included in the KIP. 1. The Flatten transformation

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-06-11 Thread Ayoub Omari
Hi Sebastien & Matthias, For 106. My idea was to deduplicate on a per-task basis. If the user wants to do a global deduplication over all partitions, I think it's better to have him explicitly repartition and then call the deduplication processor. For the use-case of deduplicating a "at least

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-11 Thread Rajini Sivaram
Hi Josep, The PR https://github.com/apache/kafka/pull/13277 for KIP-899 looks ready to be merged (waiting for the PR build).The PR changes several files, but is relatively straightforward and not risky. Also the changes are under a config that is not enabled by default. Since the KIP was approved

[jira] [Created] (KAFKA-16936) Upgrade slf4k to 2.0.9 and integrate "-Dslf4j.provider" to kafka script

2024-06-11 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16936: -- Summary: Upgrade slf4k to 2.0.9 and integrate "-Dslf4j.provider" to kafka script Key: KAFKA-16936 URL: https://issues.apache.org/jira/browse/KAFKA-16936 Project:

Re: [VOTE] KIP-1049: Add config log.summary.interval.ms to Kafka Streams

2024-06-11 Thread Sophie Blee-Goldman
+1 (binding) Thanks for the KIP! On Tue, Jun 11, 2024 at 5:37 AM jiang dou wrote: > HI > I would like to start a vote for KIP-1049: Add config > log.summary.interval.ms to Kafka Streams > > KIP: > >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2998

2024-06-11 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1017: A health check endpoint for Kafka Connect

2024-06-11 Thread Chris Egerton
Hi Viktor, Thanks for your comments! 1) I'm realizing now that there's some implicit behavior in the KIP that I should spell out explicitly. I was thinking that the timeout of 10 seconds that I mentioned in the "Public Interfaces" section would have to elapse before any 5xx responses were

[jira] [Resolved] (KAFKA-16930) UniformHeterogeneousAssignmentBuilder throws NPE when member has not subscriptions

2024-06-11 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16930. - Resolution: Fixed > UniformHeterogeneousAssignmentBuilder throws NPE when member has not >

[jira] [Created] (KAFKA-16935) Automatically wait for cluster startup in embedded Connect integration tests

2024-06-11 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-16935: - Summary: Automatically wait for cluster startup in embedded Connect integration tests Key: KAFKA-16935 URL: https://issues.apache.org/jira/browse/KAFKA-16935

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-06-11 Thread Matthias J. Sax
Thanks Sebastien, that's a good point. Thanks for raising it. -- I like your proposal. An alternative would be to have two overloads of `deduplicate()` one w/ and one w/o the "id extractor" parameter. This would be less explicit though. -Matthias On 6/11/24 2:30 AM, Sebastien Viale wrote:

RE: Re: [VOTE] KIP-1040: Improve handling of nullable values in InsertField, ExtractField, and other transformations

2024-06-11 Thread Punsak Incham
Thanks for the KIP! +1 (Non-binding) On 2024/06/11 16:23:38 Yash Mayya wrote: > Thanks for the KIP! > > +1 (binding) > > On Tue, Jun 11, 2024 at 7:40 PM Mario Fiore Vitale > mv...@redhat.com > wrote: > > > Hi all, > > > > Just wanted to bump up this thread for

[jira] [Resolved] (KAFKA-7744) Type in java

2024-06-11 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-7744. Resolution: Duplicate > Type in java > > > Key: KAFKA-7744 >

[DISCUSS] RemoteLogSegmentMetadataRecord Schema Evolution

2024-06-11 Thread Kamal Chandraprakash
Hi, We have defined the remote log segment metadata schemas with type as "metadata" (controller records) in #10271 : 1. RemoteLogSegmentMetadataRecord.json

[jira] [Created] (KAFKA-16934) Clean up and refactor release.py

2024-06-11 Thread Igor Soarez (Jira)
Igor Soarez created KAFKA-16934: --- Summary: Clean up and refactor release.py Key: KAFKA-16934 URL: https://issues.apache.org/jira/browse/KAFKA-16934 Project: Kafka Issue Type: Improvement

Re: [VOTE] KIP-1040: Improve handling of nullable values in InsertField, ExtractField, and other transformations

2024-06-11 Thread Yash Mayya
Thanks for the KIP! +1 (binding) On Tue, Jun 11, 2024 at 7:40 PM Mario Fiore Vitale wrote: > Hi all, > > Just wanted to bump up this thread for visibility. > > Thanks! > > On Wed, May 29, 2024 at 5:31 PM Mickael Maison > wrote: > > > Hi Mario, > > > > +1 (binding) > > Thanks for the KIP! > >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2997

2024-06-11 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1017: A health check endpoint for Kafka Connect

2024-06-11 Thread Viktor Somogyi-Vass
Hi Chris, I also have 2 other comments: 1. One more thing I came across is that should we provide the Retry-After header in the response in case of 503 response? Although I'm not sure how many clients honor this, we could add it just in case some does and if you also find it useful. (We could

RE: [DISCUSS] KIP-1017: A health check endpoint for Kafka Connect

2024-06-11 Thread Adrian Preston
Hi Chris, Thanks for taking the time to provide more details about the intended usage. I hadn’t appreciated how nuanced (and perhaps in some cases not fully explored) the causes of an unhealthy Connect could be. With that in mind, I can see why you want to nail down a straight-forward and

Re: [DISCUSS] KIP-1034: Dead letter queue in Kafka Streams

2024-06-11 Thread Bruno Cadonna
Hi, since there was not too much activity in this thread recently, I was wondering what the status of this discussion is. I cannot find the examples in the KIP Sébastien mentioned in the last message to this thread. I can also not find the corresponding definition of the following method

[jira] [Created] (KAFKA-16933) New consumer leave group flow may not send leave request and clear epoch

2024-06-11 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-16933: -- Summary: New consumer leave group flow may not send leave request and clear epoch Key: KAFKA-16933 URL: https://issues.apache.org/jira/browse/KAFKA-16933

Re: [DISCUSS] KIP-1017: A health check endpoint for Kafka Connect

2024-06-11 Thread Chris Egerton
Hi Adrian, Thanks for your comments/questions! The responses to them are related so I'll try to address both at once. The most recent update I made to the KIP should help provide insight into what's going wrong if a non-200 response is returned. I don't plan on adding any structured data such as

[jira] [Resolved] (KAFKA-16827) Integrate Native Apache Kafka with System tests

2024-06-11 Thread Krishna Agarwal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Agarwal resolved KAFKA-16827. - Resolution: Done > Integrate Native Apache Kafka with System tests >

[jira] [Created] (KAFKA-16932) Documentation changes for Native Docker image

2024-06-11 Thread Krishna Agarwal (Jira)
Krishna Agarwal created KAFKA-16932: --- Summary: Documentation changes for Native Docker image Key: KAFKA-16932 URL: https://issues.apache.org/jira/browse/KAFKA-16932 Project: Kafka Issue

Re: [VOTE] KIP-1040: Improve handling of nullable values in InsertField, ExtractField, and other transformations

2024-06-11 Thread Mario Fiore Vitale
Hi all, Just wanted to bump up this thread for visibility. Thanks! On Wed, May 29, 2024 at 5:31 PM Mickael Maison wrote: > Hi Mario, > > +1 (binding) > Thanks for the KIP! > > Mickael > > On Mon, May 27, 2024 at 12:06 PM Mario Fiore Vitale > wrote: > > > > After 7 days I received only one

[jira] [Created] (KAFKA-16931) A transient REST failure to forward fenceZombie request leaves Connect Task in FAILED state

2024-06-11 Thread Edoardo Comar (Jira)
Edoardo Comar created KAFKA-16931: - Summary: A transient REST failure to forward fenceZombie request leaves Connect Task in FAILED state Key: KAFKA-16931 URL: https://issues.apache.org/jira/browse/KAFKA-16931

Re: [PR] Add blog post for 3.7.1 [kafka-site]

2024-06-11 Thread via GitHub
soarez commented on PR #605: URL: https://github.com/apache/kafka-site/pull/605#issuecomment-2160795775 https://github.com/apache/kafka-site/assets/1357510/c708a89a-f529-4fec-acc7-e338c3650646;> -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [VOTE] KIP-1025: Optionally URL-encode clientID and clientSecret in authorization header

2024-06-11 Thread Nelson B.
Hi all, I want to bump up this thread for visibility. Currently, this KIP is one binding vote short of being accepted. Thanks! On Thu, May 16, 2024 at 1:07 AM Mickael Maison wrote: > Hi, > > +1 (binding) > Thanks for the KIP! > > Mickael > > On Sun, Apr 21, 2024 at 7:12 PM Nelson B. wrote:

[PR] Add blog post for 3.7.1 [kafka-site]

2024-06-11 Thread via GitHub
soarez opened a new pull request, #605: URL: https://github.com/apache/kafka-site/pull/605 This change should not to be merged before a 3.7.1 RC is promoted. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[PR] Update docs for 3.7.1 [kafka-site]

2024-06-11 Thread via GitHub
soarez opened a new pull request, #604: URL: https://github.com/apache/kafka-site/pull/604 This change should not to be merged before a 3.7.1 RC is promoted. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Created] (KAFKA-16930) UniformHeterogeneousAssignmentBuilder throws NPE when member has not subscriptions

2024-06-11 Thread David Jacot (Jira)
David Jacot created KAFKA-16930: --- Summary: UniformHeterogeneousAssignmentBuilder throws NPE when member has not subscriptions Key: KAFKA-16930 URL: https://issues.apache.org/jira/browse/KAFKA-16930

[VOTE] KIP-1049: Add config log.summary.interval.ms to Kafka Streams

2024-06-11 Thread jiang dou
HI I would like to start a vote for KIP-1049: Add config log.summary.interval.ms to Kafka Streams KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1049%3A+Add+config+log.summary.interval.ms+to+Kafka+Streams Discussion thread:

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.8 #31

2024-06-11 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-16914) Add Share Group dynamic and broker configs

2024-06-11 Thread Abhinav Dixit (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhinav Dixit resolved KAFKA-16914. --- Resolution: Fixed > Add Share Group dynamic and broker configs >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2996

2024-06-11 Thread Apache Jenkins Server
See

[jira] [Reopened] (KAFKA-14567) Kafka Streams crashes after ProducerFencedException

2024-06-11 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna reopened KAFKA-14567: --- > Kafka Streams crashes after ProducerFencedException >

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-06-11 Thread Sebastien Viale
Hi, I am really interested in this KIP. 106: I hope I am not talking nonsense, but if you do not deduplicate based on the key, the input stream has to be repartitioned. Otherwise, different stream tasks may handle records that need to be deduplicated, and thus duplicates will not be detected.

Re: [PR] MINOR: Add Josep Prat Key [kafka-site]

2024-06-11 Thread via GitHub
jlprat commented on PR #603: URL: https://github.com/apache/kafka-site/pull/603#issuecomment-2160245477 Thanks @mimaison ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] MINOR: Add Josep Prat Key [kafka-site]

2024-06-11 Thread via GitHub
mimaison commented on PR #603: URL: https://github.com/apache/kafka-site/pull/603#issuecomment-2160201828 I added the key to https://dist.apache.org/repos/dist/release/kafka/KEYS -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] MINOR: Add Josep Prat Key [kafka-site]

2024-06-11 Thread via GitHub
jlprat merged PR #603: URL: https://github.com/apache/kafka-site/pull/603 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-11 Thread Josep Prat
Hi all, I just want to remind everybody that the code freeze deadline is approaching. June 12th EOD is the deadline. Please do not automatically backport any commit to the 3.8 branch after June 12th EOD. Ping me if you think the commit should be backported (fixes failures in the branch or

Re: [PR] MINOR: Add Josep Prat Key [kafka-site]

2024-06-11 Thread via GitHub
soarez commented on PR #603: URL: https://github.com/apache/kafka-site/pull/603#issuecomment-2160115947 I noticed the same. I don't know if it is actually important. I suppose you can add another key later if it proves really necessary. -- This is an automated message from the Apache Git

Re: [PR] MINOR: Add Josep Prat Key [kafka-site]

2024-06-11 Thread via GitHub
jlprat commented on PR #603: URL: https://github.com/apache/kafka-site/pull/603#issuecomment-2160111387 I see that others also lack this comment? How important is it to have it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[PR] MINOR: Add Josep Prat Key [kafka-site]

2024-06-11 Thread via GitHub
jlprat opened a new pull request, #603: URL: https://github.com/apache/kafka-site/pull/603 Once merged, could a PMC member update the KEYS file in https://dist.apache.org/repos/dist/release/kafka/KEYS? Thanks! -- This is an automated message from the Apache Git Service. To respond

  1   2   3   4   5   6   7   8   9   10   >