Re: Kafka trunk test & build stability

The slowness of the CI is definitely causing us a lot of pain. I wonder if we should move to a dedicated CI infrastructure for Kafka. Our integration tests are quite heavy and ASF's CI is not really tuned for them. We could tune it for our needs and this would also allow external companies to

[jira] [Created] (KAFKA-16034) AsyncKafkaConsumer will get Invalid Request error when trying to rejoin on fenced/unknown member Id

Philip Nee created KAFKA-16034: -- Summary: AsyncKafkaConsumer will get Invalid Request error when trying to rejoin on fenced/unknown member Id Key: KAFKA-16034 URL: https://issues.apache.org/jira/browse/KAFKA-16034

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #23

See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2499

See Changes: -- [...truncated 346606 lines...] Gradle Test Run :streams:test > Gradle Test Executor 90 > RocksDBMetricsRecorderTest >

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2498

See Changes: -- [...truncated 130455 lines...] Gradle Test Run :core:test > Gradle Test Executor 91 > KafkaZkClientTest > testTopicAssignments() STARTED Gradle Test Run

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.6 #128

See

Re: Apache Kafka 3.7.0 Release

Hi Viktor, Extending the code freeze doesn't help stabilize things. If we have important bugs for JBOD, we should mark those as blockers and we'll wait until they are fixed if the fixes won't take too long (as usual). Ismael On Tue, Dec 19, 2023 at 11:58 AM Viktor Somogyi-Vass wrote: > Hi

Re: Kafka trunk test & build stability

Hey Николай, Apologies about this - I wasn't aware of this behavior. I have made all the gists public. On Wed, Dec 20, 2023 at 12:09 AM Greg Harris wrote: > Hey Stan, > > Thanks for opening the discussion. I haven't been looking at overall > build duration recently, so it's good that you are

Re: Kafka trunk test & build stability

Hey Stan, Thanks for opening the discussion. I haven't been looking at overall build duration recently, so it's good that you are calling it out. I worry about us over-indexing on this one build, which itself appears to be an outlier. I only see one other build [1] above 6h overall in the last

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2497

See Changes: -- [...truncated 238967 lines...] Gradle Test Run :core:test > Gradle Test Executor 92 > KafkaZkClientTest >

Re: Kafka trunk test & build stability

Hello, Stanislav. Can you, please, make the gist public. Private gists not available for some GitHub users even if link are known. > 19 дек. 2023 г., в 17:33, Stanislav Kozlovski > написал(а): > > Hey everybody, > I've heard various complaints that build times in trunk are taking too > long,

Re: Kafka trunk test & build stability

Hey Stan, I also experienced this, some of the tests indeed take a long time. As an immediate workaround, do you think we can enforce a global timeout of let's say 10 minutes? I don't know if these are taking a long time because of some race condition or because of the lack of resources and

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #22

See

Re: Apache Kafka 3.7.0 Release

Hi all, I was wondering what people think about extending the code freeze date to early January? The reason I'm asking is that there are still a couple of testing gaps in JBOD (https://issues.apache.org/jira/browse/KAFKA-14127) which I think is very important to finish to ensure a high quality

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2496

See

[jira] [Created] (KAFKA-16033) Review retry logic of OffsetFetch and OffsetCommit responses

Lianet Magrans created KAFKA-16033: -- Summary: Review retry logic of OffsetFetch and OffsetCommit responses Key: KAFKA-16033 URL: https://issues.apache.org/jira/browse/KAFKA-16033 Project: Kafka

[jira] [Created] (KAFKA-16032) Review inconsistent error handling of OffsetFetch and OffsetCommit responses

Lianet Magrans created KAFKA-16032: -- Summary: Review inconsistent error handling of OffsetFetch and OffsetCommit responses Key: KAFKA-16032 URL: https://issues.apache.org/jira/browse/KAFKA-16032

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #21

See

[jira] [Resolved] (KAFKA-15980) Add KIP-1001 CurrentControllerId metric

[ https://issues.apache.org/jira/browse/KAFKA-15980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-15980. Fix Version/s: 3.7.0 Resolution: Fixed > Add KIP-1001 CurrentControllerId metric >

[jira] [Resolved] (KAFKA-15000) High vulnerability PRISMA-2023-0067 reported in jackson-core

[ https://issues.apache.org/jira/browse/KAFKA-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-15000. Resolution: Fixed > High vulnerability PRISMA-2023-0067 reported in jackson-core >

Kafka trunk test & build stability

Hey everybody, I've heard various complaints that build times in trunk are taking too long, some taking as much as 8 hours (the timeout) - and this is slowing us down from being able to meet the code freeze deadline for 3.7. I took it upon myself to gather up some data in Gradle Enterprise to see

Re: [VOTE] KIP-993: Allow restricting files accessed by File and Directory ConfigProviders

Thanks for the KIP. +1 (non-binding) Thanks, Andrew > On 14 Dec 2023, at 13:41, Mickael Maison wrote: > > +1 (binding) > Thanks for the KIP > > Mickael > > On Wed, Dec 13, 2023 at 4:01 PM Chris Egerton wrote: >> >> Hi Tina, >> >> Thanks for the KIP! +1 (binding) >> >> Cheers, >> >> Chris >>

[jira] [Resolved] (KAFKA-15696) Revoke partitions on Consumer.close()

[ https://issues.apache.org/jira/browse/KAFKA-15696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-15696. Resolution: Fixed > Revoke partitions on Consumer.close() >

[jira] [Resolved] (KAFKA-15548) Send GroupConsumerHeartbeatRequest on Consumer.close()

[ https://issues.apache.org/jira/browse/KAFKA-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-15548. Resolution: Fixed > Send GroupConsumerHeartbeatRequest on Consumer.close() >

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #127

See Changes: -- [...truncated 410711 lines...] Gradle Test Run :core:test > Gradle Test Executor 90 > KafkaZkClientTest > testDeletePath() PASSED Gradle Test Run :core:test

Re: [DISCUSS] Road to Kafka 4.0

Hi Justine, Thanks for your reply. > I think that for folks that want to prioritize availability over durability, the aggressive recovery strategy from KIP-966 should be preferable to the old unclean leader election configuration.

[jira] [Resolved] (KAFKA-15775) Implement listTopics() and partitionFor() for the AsyncKafkaConsumer

[ https://issues.apache.org/jira/browse/KAFKA-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-15775. -- Resolution: Fixed > Implement listTopics() and partitionFor() for the

Re: [VOTE] KIP-993: Allow restricting files accessed by File and Directory ConfigProviders

Thank you so much Edo! The KIP is accepted with 3 binding votes (Chris, Mickael, Edo). Thank you all. Regards, Tina On Tue, Dec 19, 2023 at 10:34 AM Edoardo Comar wrote: > +1 (binding) > Thanks for the KIP Tina! > > Edo > > On Tue, 19 Dec 2023 at 10:01, Gantigmaa Selenge > wrote: > > > >

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2495

See

Re: [VOTE] KIP-993: Allow restricting files accessed by File and Directory ConfigProviders

+1 (binding) Thanks for the KIP Tina! Edo On Tue, 19 Dec 2023 at 10:01, Gantigmaa Selenge wrote: > > Thank you Chris and Mickael for the vote! > > KIP is missing just one more +1 (binding). > > Regards, > Tina > > On Thu, Dec 14, 2023 at 1:48 PM Mickael Maison > wrote: > > > +1 (binding) > >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #20

See

Re: [VOTE] KIP-993: Allow restricting files accessed by File and Directory ConfigProviders

Thank you Chris and Mickael for the vote! KIP is missing just one more +1 (binding). Regards, Tina On Thu, Dec 14, 2023 at 1:48 PM Mickael Maison wrote: > +1 (binding) > Thanks for the KIP > > Mickael > > On Wed, Dec 13, 2023 at 4:01 PM Chris Egerton > wrote: > > > > Hi Tina, > > > > Thanks

[VOTE] KIP-877: Mechanism for plugins and connectors to register metrics

Hi, I'd like to start a vote on KIP-877: https://cwiki.apache.org/confluence/display/KAFKA/KIP-877%3A+Mechanism+for+plugins+and+connectors+to+register+metrics Let me know if you have any feedback. Thanks, Mickael

[jira] [Resolved] (KAFKA-15448) Streams StandbyTaskUpdateListener

[ https://issues.apache.org/jira/browse/KAFKA-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-15448. - Fix Version/s: 3.7.0 Assignee: Colt McNealy Resolution: Fixed > Streams

Re: DISCUSS KIP-1011: Use incrementalAlterConfigs when updating broker configs by kafka-configs.sh

Hello. Can we just forward all invocations of alterConfig to incrementalAlterConfig? Transform parameters and call correct method. > 19 дек. 2023 г., в 11:36, Federico Valeri написал(а): > > HI Ziming, thanks for the KIP. Looks good to me. > > Just on question: given that alterConfig is

Re: DISCUSS KIP-1011: Use incrementalAlterConfigs when updating broker configs by kafka-configs.sh

HI Ziming, thanks for the KIP. Looks good to me. Just on question: given that alterConfig is deprecated, shouldn't we also introduce --disable-incremental as deprecated? That way we would get rid of both in Kafka 4.0. Also see: https://issues.apache.org/jira/browse/KAFKA-14705. On Tue, Dec 19,

Re: DISCUSS KIP-1011: Use incrementalAlterConfigs when updating broker configs by kafka-configs.sh

Thank you for mention this Ismael, I added this to the motivation section, and I think we can still update configs in this case by passing all sensitive configs, which is weird and not friendly. -- Best, Ziming > On Dec 19, 2023, at 14:24, Ismael Juma wrote: > > Thanks for the KIP. I think