Re: [PR] MINOR Update default docs point to 3.6.0 release docs [kafka-site]

2023-10-05 Thread via GitHub
satishd commented on code in PR #556: URL: https://github.com/apache/kafka-site/pull/556#discussion_r1348235808 ## downloads.html: ## @@ -6,12 +6,41 @@ Download -3.5.1 is the latest release. The current stable version is 3.5.1 +3.6.0 is the latest

[PR] MINOR Update default docs point to 3.6.0 release docs [kafka-site]

2023-10-05 Thread via GitHub
satishd opened a new pull request, #556: URL: https://github.com/apache/kafka-site/pull/556 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #77

2023-10-05 Thread Apache Jenkins Server
See Changes: -- [...truncated 278000 lines...] Gradle Test Run :core:integrationTest > Gradle Test Executor 178 > PlaintextAdminIntegrationTest >

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #168

2023-10-05 Thread Apache Jenkins Server
See Changes: -- [...truncated 524055 lines...] Gradle Test Run :streams:integrationTest > Gradle Test Executor 181 > KTableKTableForeignKeyJoinIntegrationTest >

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.0 #223

2023-10-05 Thread Apache Jenkins Server
See Changes: -- [...truncated 330692 lines...] ControllerIntegrationTest > testControllerMoveOnTopicCreation() STARTED ControllerIntegrationTest >

Re: Apache Kafka 3.6.0 release

2023-10-05 Thread Ismael Juma
The upgrade page is the right place to add it, in my opinion. Ismael On Thu, Oct 5, 2023 at 5:02 PM David Arthur wrote: > Hey folks, we found a significant ZK migration bug today > https://issues.apache.org/jira/browse/KAFKA-15552. Since the release is > already voted in, the fix will wait for

Re: Apache Kafka 3.6.0 release

2023-10-05 Thread David Arthur
Hey folks, we found a significant ZK migration bug today https://issues.apache.org/jira/browse/KAFKA-15552. Since the release is already voted in, the fix will wait for 3.6.1. In the meantime, do we have a way to indicate known significant issues in the release notes? Maybe just a note in the

[jira] [Created] (KAFKA-15559) KIP-987: Connect Static Assignments

2023-10-05 Thread Greg Harris (Jira)
Greg Harris created KAFKA-15559: --- Summary: KIP-987: Connect Static Assignments Key: KAFKA-15559 URL: https://issues.apache.org/jira/browse/KAFKA-15559 Project: Kafka Issue Type: New Feature

[DISCUSS] KIP-987: Connect Static Assignments

2023-10-05 Thread Greg Harris
Hey everyone! I'd like to propose an improvement to Kafka Connect's scheduling algorithm, with the goal of improving the operability of connect clusters through resource isolation. Find the KIP here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-987%3A+Connect+Static+Assignments This

[jira] [Resolved] (KAFKA-15437) Add metrics about open iterators

2023-10-05 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-15437. - Resolution: Duplicate > Add metrics about open iterators >

[jira] [Created] (KAFKA-15558) Determine if Timer should be used elsewhere in PrototypeAsyncConsumer.updateFetchPositions()

2023-10-05 Thread Kirk True (Jira)
Kirk True created KAFKA-15558: - Summary: Determine if Timer should be used elsewhere in PrototypeAsyncConsumer.updateFetchPositions() Key: KAFKA-15558 URL: https://issues.apache.org/jira/browse/KAFKA-15558

[jira] [Created] (KAFKA-15557) Fix duplicate metadata update in fetcher tests

2023-10-05 Thread Kirk True (Jira)
Kirk True created KAFKA-15557: - Summary: Fix duplicate metadata update in fetcher tests Key: KAFKA-15557 URL: https://issues.apache.org/jira/browse/KAFKA-15557 Project: Kafka Issue Type: Bug

Re: Upgrading from 2.8.0 to 3.5.1

2023-10-05 Thread Walchester Gaw
Hello, Josep. Thanks for the swift response. Thanks, Chester On Wed, Oct 4, 2023 at 4:26 PM Josep Prat wrote: > Hi Chester, > > If I'm not mistaken, what it means is to update the Kafka version on the > broker. > Broker with version 2.8.0 -> Shutdown -> Replace jars and binaries so it >

[jira] [Created] (KAFKA-15556) Remove isUnavailable and maybeThrowAuthFailure if possible

2023-10-05 Thread Kirk True (Jira)
Kirk True created KAFKA-15556: - Summary: Remove isUnavailable and maybeThrowAuthFailure if possible Key: KAFKA-15556 URL: https://issues.apache.org/jira/browse/KAFKA-15556 Project: Kafka Issue

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.6 #86

2023-10-05 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-15555) Ensure wakeups are handled correctly in PrototypeAsyncConsumer.poll()

2023-10-05 Thread Kirk True (Jira)
Kirk True created KAFKA-1: - Summary: Ensure wakeups are handled correctly in PrototypeAsyncConsumer.poll() Key: KAFKA-1 URL: https://issues.apache.org/jira/browse/KAFKA-1 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2260

2023-10-05 Thread Apache Jenkins Server
See Changes: -- [...truncated 317901 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > TasksTest >

[jira] [Created] (KAFKA-15554) Update client state machine to align with protocol sending one assignment at a time

2023-10-05 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-15554: -- Summary: Update client state machine to align with protocol sending one assignment at a time Key: KAFKA-15554 URL: https://issues.apache.org/jira/browse/KAFKA-15554

[jira] [Resolved] (KAFKA-15275) Implement consumer group membership state machine

2023-10-05 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans resolved KAFKA-15275. Resolution: Fixed > Implement consumer group membership state machine >

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #151

2023-10-05 Thread Apache Jenkins Server
See Changes: -- [...truncated 297235 lines...] [INFO] [Pipeline] dir Running in

[jira] [Created] (KAFKA-15553) Review committed offset refresh logic

2023-10-05 Thread Philip Nee (Jira)
Philip Nee created KAFKA-15553: -- Summary: Review committed offset refresh logic Key: KAFKA-15553 URL: https://issues.apache.org/jira/browse/KAFKA-15553 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-15552) Duplicate Producer ID blocks during ZK migration

2023-10-05 Thread David Arthur (Jira)
David Arthur created KAFKA-15552: Summary: Duplicate Producer ID blocks during ZK migration Key: KAFKA-15552 URL: https://issues.apache.org/jira/browse/KAFKA-15552 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-15551) Evaluate conditions for short circuiting consumer API calls

2023-10-05 Thread Philip Nee (Jira)
Philip Nee created KAFKA-15551: -- Summary: Evaluate conditions for short circuiting consumer API calls Key: KAFKA-15551 URL: https://issues.apache.org/jira/browse/KAFKA-15551 Project: Kafka

Re: [DISCUSS] KIP-980: Allow creating connectors in a stopped state

2023-10-05 Thread Chris Egerton
Hi Yash, Yeah, I think just hardcoding with JSON-first, properties-second is fine. IMO it's worth calling this out explicitly in the KIP. Apart from that, no further comments. LGTM, thanks for the KIP! Cheers, Chris On Thu, Oct 5, 2023 at 6:23 AM Yash Mayya wrote: > Hi Chris, > > Thanks for

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2259

2023-10-05 Thread Apache Jenkins Server
See Changes: -- [...truncated 302036 lines...] Gradle Test Run :streams:test > Gradle Test Executor 83 > StateQueryResultTest > Valid query results still works STARTED

Re: [DISCUSS] KIP-985 Add reverseRange and reverseAll query over kv-store in IQv2

2023-10-05 Thread Hanyu (Peter) Zheng
Hi, Hao, In this case, it will return an empty set or list in the end. Sincerely, Hanyu On Wed, Oct 4, 2023 at 10:29 PM Matthias J. Sax wrote: > Great discussion! > > It seems the only open question might be about ordering guarantees? > IIRC, we had a discussion about this in the past. > > >

Re: [DISCUSS] KIP-986: Cross-Cluster Replication

2023-10-05 Thread Greg Harris
Hey Viktor, Please do! This is a draft, and it's open for you to edit to include your new ideas :) I don't think I understand what you mean here. Are you suggesting an alternative to the Admin API? An external project could certainly build such a component with the Admin API. Thanks, Greg On

[jira] [Created] (KAFKA-15550) OffsetsForTimes validation for negative timestamps in new consumer

2023-10-05 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-15550: -- Summary: OffsetsForTimes validation for negative timestamps in new consumer Key: KAFKA-15550 URL: https://issues.apache.org/jira/browse/KAFKA-15550 Project:

Re: [VOTE] KIP-858: Handle JBOD broker disk failure in KRaft

2023-10-05 Thread David Arthur
Hey, just chiming in regarding the ZK migration piece. Generally speaking, one of the design goals of the migration was to have minimal changes on the ZK brokers and especially the ZK controller. Since ZK mode is our safe/well-known fallback mode, we wanted to reduce the chances of introducing

Re: [DISCUSS] KIP-989: RocksDB Iterator Metrics

2023-10-05 Thread Nick Telford
Hi Colt, I kept the details out of the KIP, because KIPs generally document high-level design, but the way I'm doing it is like this: final ManagedKeyValueIterator rocksDbPrefixSeekIterator = cf.prefixScan(accessor, prefixBytes); --> final long startedAt = System.nanoTime();

Re: [REVIEW REQUEST] ReassignPartitionCommand scala -> java

2023-10-05 Thread Николай Ижиков
Hello. PR got some review and approves from non committers. CI is OK. Dear committers, please, join the review - https://github.com/apache/kafka/pull/13247 > 3 окт. 2023 г., в 00:22, Николай Ижиков написал(а): > > Hello. > > Thanks everyone for the help. > I think we come to the stage when

Re: [DISCUSS] KIP-986: Cross-Cluster Replication

2023-10-05 Thread Viktor Somogyi-Vass
Hi Greg, Sure, I'll expand it with my thoughts. Is it fine if I add it to the KIP and update this discussion? Another thing that crossed my mind is that in MM2 you can handle configs and replication flow in a central place because it is a separate component. I think that for use-cases where

[jira] [Created] (KAFKA-15549) Bump swagger dependency version

2023-10-05 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-15549: -- Summary: Bump swagger dependency version Key: KAFKA-15549 URL: https://issues.apache.org/jira/browse/KAFKA-15549 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP-968: Support single-key_multi-timestamp interactive queries (IQv2) for versioned state stores

2023-10-05 Thread Bruno Cadonna
Hi Matthias, Given all the IQv2 KIPs that use getX and given recent PRs (internal interfaces mainly) that got merged, I was under the impression that we moved away from the strict no-getX policy. I do not think it was an accident using getX in the IQv2 KIPs since somebody would have brought

Re: [DISCUSS] KIP-989: RocksDB Iterator Metrics

2023-10-05 Thread Colt McNealy
Thank you for the KIP, Nick! This would be highly useful for many reasons. Much more sane than checking for leaked iterators by profiling memory usage while running 100's of thousands of range scans via interactive queries (: One small question: >The iterator-duration metrics will be updated

Re: [DISCUSS] KIP-980: Allow creating connectors in a stopped state

2023-10-05 Thread Yash Mayya
Hi Chris, Thanks for all your feedback so far! 3. That's a good question. I was thinking we'd do some "intelligent" parsing internally during the implementation (i.e. essentially your last option - attempting to parse first as one format, then the other) which is why I didn't include any more

Re: [PR] Added a blog entry for 3.6.0 release [kafka-site]

2023-10-05 Thread via GitHub
mimaison commented on code in PR #547: URL: https://github.com/apache/kafka-site/pull/547#discussion_r1347093948 ## blog.html: ## @@ -39,35 +39,35 @@ for details regarding KRaft and JBOD. Support for Delegation Tokens in

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2258

2023-10-05 Thread Apache Jenkins Server
See Changes: -- [...truncated 209945 lines...] Gradle Test Run :streams:test > Gradle Test Executor 83 > TasksTest > shouldAddAndRemovePendingTaskToRecycle() STARTED