[jira] [Created] (KAFKA-15643) Improve unloading logging

2023-10-18 Thread David Jacot (Jira)
David Jacot created KAFKA-15643: --- Summary: Improve unloading logging Key: KAFKA-15643 URL: https://issues.apache.org/jira/browse/KAFKA-15643 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-15642) Ensure offset fetcher behaves correctly when the request is Timeout

2023-10-18 Thread Philip Nee (Jira)
Philip Nee created KAFKA-15642: -- Summary: Ensure offset fetcher behaves correctly when the request is Timeout Key: KAFKA-15642 URL: https://issues.apache.org/jira/browse/KAFKA-15642 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #93

2023-10-18 Thread Apache Jenkins Server
See Changes: -- [...truncated 307037 lines...] > Task :connect:json:generateMetadataFileForMavenJavaPublication > Task :connect:json:testClasses UP-TO-DATE > Task

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2304

2023-10-18 Thread Apache Jenkins Server
See Changes: -- [...truncated 316163 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > DefaultStateUpdaterTest > shouldDrainRestoredActiveTasks()

[jira] [Resolved] (KAFKA-15620) Duplicate remote log DELETE_SEGMENT metadata is generated when there are multiple leader epochs in the segment

2023-10-18 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15620. --- Fix Version/s: 3.7.0 Resolution: Duplicate > Duplicate remote log DELETE_SEGMENT metadata is

[jira] [Created] (KAFKA-15641) Investigate CompletedFetch handleInitializeErrors for accuracy

2023-10-18 Thread Kirk True (Jira)
Kirk True created KAFKA-15641: - Summary: Investigate CompletedFetch handleInitializeErrors for accuracy Key: KAFKA-15641 URL: https://issues.apache.org/jira/browse/KAFKA-15641 Project: Kafka

Re: [PR] MINOR: add KIP-941 to Kafka Streams upgrade docs [kafka-site]

2023-10-18 Thread via GitHub
mjsax merged PR #563: URL: https://github.com/apache/kafka-site/pull/563 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] MINOR: add KIP-941 to Kafka Streams upgrade docs [kafka-site]

2023-10-18 Thread via GitHub
mjsax opened a new pull request, #563: URL: https://github.com/apache/kafka-site/pull/563 Porting https://github.com/apache/kafka/pull/14577 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [DISCUSS] KIP-988 Streams Standby Task Update Listener

2023-10-18 Thread Matthias J. Sax
Thanks for the KIP. Seems I am almost late to the party. About naming (fun, fun, fun): I like the current proposal overall, except `onBachLoaded`, but would prefer `onBatchUpdated`. It better aligns to everything else: - it's an update-listener, not loaded-listener - `StateRestoreListener`

[jira] [Created] (KAFKA-15640) Refactor CompletedFetch initialization

2023-10-18 Thread Kirk True (Jira)
Kirk True created KAFKA-15640: - Summary: Refactor CompletedFetch initialization Key: KAFKA-15640 URL: https://issues.apache.org/jira/browse/KAFKA-15640 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-15639) Investigate ConsumerNetworkThread's testResetPositionsProcessFailureIsIgnored

2023-10-18 Thread Kirk True (Jira)
Kirk True created KAFKA-15639: - Summary: Investigate ConsumerNetworkThread's testResetPositionsProcessFailureIsIgnored Key: KAFKA-15639 URL: https://issues.apache.org/jira/browse/KAFKA-15639 Project:

[jira] [Created] (KAFKA-15638) Investigate ConsumerNetworkThread's testPollResultTimer

2023-10-18 Thread Kirk True (Jira)
Kirk True created KAFKA-15638: - Summary: Investigate ConsumerNetworkThread's testPollResultTimer Key: KAFKA-15638 URL: https://issues.apache.org/jira/browse/KAFKA-15638 Project: Kafka Issue

[jira] [Created] (KAFKA-15637) CLONE - Investigate FetcherTest's/FetchRequestManager's testFetchCompletedBeforeHandlerAdded

2023-10-18 Thread Kirk True (Jira)
Kirk True created KAFKA-15637: - Summary: CLONE - Investigate FetcherTest's/FetchRequestManager's testFetchCompletedBeforeHandlerAdded Key: KAFKA-15637 URL: https://issues.apache.org/jira/browse/KAFKA-15637

[jira] [Created] (KAFKA-15636) Investigate FetcherTest's/FetchRequestManager's testFetchResponseMetrics

2023-10-18 Thread Kirk True (Jira)
Kirk True created KAFKA-15636: - Summary: Investigate FetcherTest's/FetchRequestManager's testFetchResponseMetrics Key: KAFKA-15636 URL: https://issues.apache.org/jira/browse/KAFKA-15636 Project: Kafka

[jira] [Created] (KAFKA-15635) Investigate FetcherTest's/FetchRequestManager's testFetcherLeadMetric

2023-10-18 Thread Kirk True (Jira)
Kirk True created KAFKA-15635: - Summary: Investigate FetcherTest's/FetchRequestManager's testFetcherLeadMetric Key: KAFKA-15635 URL: https://issues.apache.org/jira/browse/KAFKA-15635 Project: Kafka

[jira] [Created] (KAFKA-15634) Investigate FetcherTest's/FetchRequestManager's testQuotaMetrics

2023-10-18 Thread Kirk True (Jira)
Kirk True created KAFKA-15634: - Summary: Investigate FetcherTest's/FetchRequestManager's testQuotaMetrics Key: KAFKA-15634 URL: https://issues.apache.org/jira/browse/KAFKA-15634 Project: Kafka

[jira] [Created] (KAFKA-15633) Bug: Generated Persistent Directory IDs are overwritten on startup.

2023-10-18 Thread Proven Provenzano (Jira)
Proven Provenzano created KAFKA-15633: - Summary: Bug: Generated Persistent Directory IDs are overwritten on startup. Key: KAFKA-15633 URL: https://issues.apache.org/jira/browse/KAFKA-15633

Re: [DISCUSS] KIP-987: Connect Static Assignments

2023-10-18 Thread Greg Harris
Hey Sagar, Thanks for the questions. I hope you find the answers satisfying: 1. This is detailed in the KIP two sentences earlier: "If the connect.protocol is set to static, each worker will send it's static.connectors and static.tasks to the coordinator during rebalances." 2. If you have a

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2303

2023-10-18 Thread Apache Jenkins Server
See Changes: -- [...truncated 316860 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > DefaultTaskExecutorTest >

[jira] [Created] (KAFKA-15632) Drop the invalid remote log metadata events

2023-10-18 Thread Kamal Chandraprakash (Jira)
Kamal Chandraprakash created KAFKA-15632: Summary: Drop the invalid remote log metadata events Key: KAFKA-15632 URL: https://issues.apache.org/jira/browse/KAFKA-15632 Project: Kafka

UncleanLeaderElectionsPerSec metric and Raft

2023-10-18 Thread Neil Buesing
Development, with Raft controllers, is the unclean leader election / sec metric supose to be available? kafka.controller:type=ControllerStats,name=UncleanLeaderElectionsPerSec Nothing in documentation indicates that it isn’t as well as in code navigation nothing indicates to me that it wouldn’t

Re: [DISCUSS] KIP-974 Docker Image for GraalVM based Native Kafka Broker

2023-10-18 Thread Krishna Agarwal
Hi Federico, Thanks for the feedback and apologies for the delay. I've included a section in the KIP on the release process. I would greatly appreciate your insights after reviewing it. Regards, Krishna On Fri, Sep 8, 2023 at 3:08 PM Federico Valeri wrote: > Hi Krishna, thanks for opening

[jira] [Created] (KAFKA-15631) Do not send new heartbeat request while another one in-flight

2023-10-18 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-15631: -- Summary: Do not send new heartbeat request while another one in-flight Key: KAFKA-15631 URL: https://issues.apache.org/jira/browse/KAFKA-15631 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2302

2023-10-18 Thread Apache Jenkins Server
See Changes: -- [...truncated 315602 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > DefaultStateUpdaterTest >

[jira] [Resolved] (KAFKA-15554) Update client state machine to align with protocol sending one assignment at a time

2023-10-18 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15554. - Resolution: Fixed > Update client state machine to align with protocol sending one assignment

Re: [DISCUSS] KIP-974 Docker Image for GraalVM based Native Kafka Broker

2023-10-18 Thread Krishna Agarwal
Hi Ismael, Thanks for the feedback. I noticed that the graalvm-reachability-metadata project now includes > kafka-clients[1]. Worth checking if the metadata over there matches what > we've observed for our own attempt. > After reviewing the graalvm-reachability-metadata, I observed that they have

[jira] [Created] (KAFKA-15630) Improve documentation of offset.lag.max

2023-10-18 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-15630: -- Summary: Improve documentation of offset.lag.max Key: KAFKA-15630 URL: https://issues.apache.org/jira/browse/KAFKA-15630 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-989: RocksDB Iterator Metrics

2023-10-18 Thread Lucas Brutschy
Hi Nick, I did not think in detail about how to implement it, just about what metrics would be nice to have. You are right, we'd have to register/deregister the iterators during open/close. This would be more complicated to implement than the other metrics, but I do not see a fundamental problem

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

2023-10-18 Thread Nick Telford
Hi Lucas, TaskCorruptedException is how Streams signals that the Task state needs to be wiped, so we can't retain that exception without also wiping state on timeouts. Regards, Nick On Wed, 18 Oct 2023 at 14:48, Lucas Brutschy wrote: > Hi Nick, > > I think indeed the better behavior would be

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

2023-10-18 Thread Lucas Brutschy
Hi Nick, I think indeed the better behavior would be to retry commitTransaction until we risk running out of time to meet `max.poll.interval.ms`. However, if it's handled as a `TaskCorruptedException` at the moment, I would do the same in this KIP, and leave exception handling improvements to

Re: [DISCUSS] KIP-987: Connect Static Assignments

2023-10-18 Thread Sagar
Hi Greg, Thanks for the KIP. I have a few questions/comments: 1) You mentioned that during a rebalance if all the members of the cluster support the static protocol, then it would use the steps outlined in the Proposed Section to do the assignments. In those steps, the leader identifies the

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2301

2023-10-18 Thread Apache Jenkins Server
See Changes: -- [...truncated 314742 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > DefaultStateUpdaterTest > shouldPauseStandbyTask() STARTED

Re: [PR] MINOR: add docs for tiered storage quick start [kafka-site]

2023-10-18 Thread via GitHub
showuon merged PR #562: URL: https://github.com/apache/kafka-site/pull/562 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2300

2023-10-18 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-15629) proposal to introduce IQv2 Query Types: TimeStampKeyQuery and TimeStampRangeQuery

2023-10-18 Thread Hanyu Zheng (Jira)
Hanyu Zheng created KAFKA-15629: --- Summary: proposal to introduce IQv2 Query Types: TimeStampKeyQuery and TimeStampRangeQuery Key: KAFKA-15629 URL: https://issues.apache.org/jira/browse/KAFKA-15629