Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2510

2023-12-22 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.7 #34

2023-12-22 Thread Apache Jenkins Server
See Changes: -- [...truncated 3003 lines...] 280 actionable tasks: 227 executed, 53 up-to-date Publishing build scan... https://ge.apache.org/s/bs4zmo3wcuugm See the profili

Re: New Release Branch 3.7

2023-12-22 Thread Justine Olshan
Hey Stan, I just merged KAFKA-16012 into 3.7. I've also resolved the blocker ticket. Justine On Fri, Dec 15, 2023 at 5:00 AM Josep Prat wrote: > Hi Stanislav, > I cherry-picked this change to 3.7: > https://github.com/apache/kafka/pull/15002

[jira] [Resolved] (KAFKA-16012) Incomplete range assignment in consumer

2023-12-22 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan resolved KAFKA-16012. Resolution: Fixed > Incomplete range assignment in consumer >

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2509

2023-12-22 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-16047) Source connector with EOS enabled have some InitProducerId requests timing out

2023-12-22 Thread Angelos Kaltsikis (Jira)
Angelos Kaltsikis created KAFKA-16047: - Summary: Source connector with EOS enabled have some InitProducerId requests timing out Key: KAFKA-16047 URL: https://issues.apache.org/jira/browse/KAFKA-16047

[DISCUSS] KIP-1013: Drop broker and tools support for Java 11 in Kafka 4.0 (deprecate in 3.7)

2023-12-22 Thread Ismael Juma
Hi all, I was watching the Java Highlights of 2023 from Nicolai Parlog[1] and it became clear that many projects are moving to Java 17 for its developer productivity improvements. It occurred to me that there is also an opportunity for the Apache Kafka project and I wrote a quick KIP with the prop

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.7 #33

2023-12-22 Thread Apache Jenkins Server
See Changes: -- [...truncated 3069 lines...] > Task :storage:checkstyleTest > Task :storage:spotbugsTest SKIPPED > Task :storage:check > Task :jmh-benchmarks:compileJava > Task

[jira] [Resolved] (KAFKA-16046) Stream Stream Joins fail after restoration with deserialization exceptions

2023-12-22 Thread Almog Gavra (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Almog Gavra resolved KAFKA-16046. - Resolution: Fixed > Stream Stream Joins fail after restoration with deserialization exceptions >

Meet our keynote speakers and register to Community Over Code EU!

2023-12-22 Thread Ryan Skraba
[Note: You're receiving this email because you are subscribed to one or more project dev@ mailing lists at the Apache Software Foundation.] * Merge with the ASF EUniverse!The registration for Community

Re: Kafka trunk test & build stability

2023-12-22 Thread Justine Olshan
Thanks David! I think this should help a lot! While we should include these improvements, I think it is also good to remind folks that a lot of these issues come from merging on builds that regress the CI. I know I'm not perfect at this (and have merged on flaky and failing tests), but let's all b

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.7 #32

2023-12-22 Thread Apache Jenkins Server
See Changes: -- [...truncated 3002 lines...] > Task :shell:classes > Task :shell:checkstyleMain > Task :shell:spotbugsMain > Task :shell:spotbugsMain > Task :core:compileTestSc

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.7 #31

2023-12-22 Thread Apache Jenkins Server
See Changes: -- [...truncated 3001 lines...] > Task :connect:mirror:checkstyleTest > Task :connect:mirror:check > Task :tools:checkstyleTest > Task :tools:check > Task :connect

Re: Kafka trunk test & build stability

2023-12-22 Thread David Jacot
I just merged both PRs. Cheers, David Le ven. 22 déc. 2023 à 14:38, David Jacot a écrit : > Hey folks, > > I believe that my two PRs will fix most of the issues. I have also tweaked > the configuration of Jenkins to fix the issues relating to cloning the > repo. There may be other issues but th

Re: Kafka trunk test & build stability

2023-12-22 Thread David Jacot
Hey folks, I believe that my two PRs will fix most of the issues. I have also tweaked the configuration of Jenkins to fix the issues relating to cloning the repo. There may be other issues but the overall situation should be much better when I merge those two. I will update this thread when I mer

Re: Kafka trunk test & build stability

2023-12-22 Thread Divij Vaidya
Hey folks I think David (dajac) has some fixes lined-up to improve CI such as https://github.com/apache/kafka/pull/15063 and https://github.com/apache/kafka/pull/15062. I have some bandwidth for the next two days to work on fixing the CI. Let me start by taking a look at the list that Sophie shar

Re: Kafka trunk test & build stability

2023-12-22 Thread Luke Chen
Hi Sophie and Philip and all, I share the same pain as you. I've been waiting for a CI build result in a PR for days. Unfortunately, I can only get 1 result each day because it takes 8 hours for each run, and with failed results. :( I've looked into the 8 hour timeout build issue and would like t

Re: [DISCUSS] KIP-1012: The need for a Kafka 3.8.x release

2023-12-22 Thread Josep Prat
On this note, I'd like to add that I would volunteer to be the release manager of such release 3.8.0. Best, On Fri, Dec 22, 2023 at 1:31 PM Josep Prat wrote: > Hi all! > As agreed on the "Road to Kafka 4.0" email thread, I created KIP-1012 to > discuss and I'd like to open it up for discussion:

Re: [DISCUSS] Road to Kafka 4.0

2023-12-22 Thread Josep Prat
Hi all, Discuss thread for KIP-1012 (The need for a Kafka 3.8 release) can be found under https://lists.apache.org/thread/kvdp2gmq5gd9txkvxh5vk3z2n55b04s5 Best, On Fri, Dec 22, 2023 at 4:00 AM Luke Chen wrote: > For release 3.8, I think we should also include the unclean leader election > suppo

[DISCUSS] KIP-1012: The need for a Kafka 3.8.x release

2023-12-22 Thread Josep Prat
Hi all! As agreed on the "Road to Kafka 4.0" email thread, I created KIP-1012 to discuss and I'd like to open it up for discussion: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1012%3A+The+need+for+a+Kafka+3.8.x+release Let's use this KIP to: a) Leave a papertrail agreement for the need o

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2507

2023-12-22 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1007: Introduce Remote Storage Not Ready Exception

2023-12-22 Thread Divij Vaidya
Thanks for the KIP, Kamal. The change looks good to me, though, I think we can do a better job at documenting what the error means for the clients and users. Correct me if I'm wrong, when remote metadata is being synced on a new leader, we cannot fetch even the local data (as per [1]), hence, par

Re: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2023-12-22 Thread Divij Vaidya
Thank you for writing the KIP Assane. In general, exposing a "pluggable" interface is not a decision made lightly because it limits our ability to remove / change that interface in future. Any future changes to the interface will have to remain compatible with existing plugins which limits the fle

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.7 #30

2023-12-22 Thread Apache Jenkins Server
See Changes: -- [...truncated 3013 lines...] > Task :core:compileTestJava NO-SOURCE > Task :core:checkstyleMain > Task :shell:compileJava > Task :shell:classes > Task :shell:ch

Re: DISCUSS KIP-1011: Use incrementalAlterConfigs when updating broker configs by kafka-configs.sh

2023-12-22 Thread Divij Vaidya
Hi folks Am I right in understanding that if a user is currently using this CLI to update old versions (< 2.3.0), they will have to update their scripts and operational tools when they upgrade ops tools / scripts from Kafka 3.6 to 3.8 (assuming this releases in 3.8)? In that case, may I suggest ke