[PR] MINOR: add docs for tiered storage quick start [kafka-site]

2023-10-16 Thread via GitHub
showuon opened a new pull request, #562: URL: https://github.com/apache/kafka-site/pull/562 Updated docs from kafka repo: 1. tiered storage quick start guide: https://github.com/apache/kafka/pull/14528 2. Fix docs for ReplicationBytes(Out|In)PerSec metrics:

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2294

2023-10-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 315340 lines...] Gradle Test Run :core:test > Gradle Test Executor 88 > ZkAclMigrationClientTest > testAclsMigrateAndDualWrite() STARTED

[jira] [Created] (KAFKA-15619) Kafka

2023-10-16 Thread Deng Ziming (Jira)
Deng Ziming created KAFKA-15619: --- Summary: Kafka Key: KAFKA-15619 URL: https://issues.apache.org/jira/browse/KAFKA-15619 Project: Kafka Issue Type: Improvement Affects Versions: 3.5.1,

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2293

2023-10-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 211080 lines...] Gradle Test Run :streams:test > Gradle Test Executor 85 > DefaultStateUpdaterTest >

Re: [VOTE] KIP-985 Add reverseRange and reverseAll query over kv-store in IQv2

2023-10-16 Thread Matthias J. Sax
+1 (binding) On 10/13/23 9:24 AM, Hanyu (Peter) Zheng wrote: Hello everyone, I would like to start a vote for KIP-985 that Add reverseRange and reverseAll query over kv-store in IQv2. Sincerely, Hanyu On Fri, Oct 13, 2023 at 9:15 AM Hanyu (Peter) Zheng wrote:

[jira] [Created] (KAFKA-15618) Implement MetricsCollector which collects metrics in OTLP format

2023-10-16 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15618: - Summary: Implement MetricsCollector which collects metrics in OTLP format Key: KAFKA-15618 URL: https://issues.apache.org/jira/browse/KAFKA-15618 Project: Kafka

[jira] [Created] (KAFKA-15617) Determine if testFetchingPendingPartitions and testInflightFetchOnPendingPartitions overlap

2023-10-16 Thread Kirk True (Jira)
Kirk True created KAFKA-15617: - Summary: Determine if testFetchingPendingPartitions and testInflightFetchOnPendingPartitions overlap Key: KAFKA-15617 URL: https://issues.apache.org/jira/browse/KAFKA-15617

[jira] [Created] (KAFKA-15616) Define client telemetry states and their transitions

2023-10-16 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15616: - Summary: Define client telemetry states and their transitions Key: KAFKA-15616 URL: https://issues.apache.org/jira/browse/KAFKA-15616 Project: Kafka Issue

[jira] [Created] (KAFKA-15615) Improve handling of fetching during metadata updates

2023-10-16 Thread Kirk True (Jira)
Kirk True created KAFKA-15615: - Summary: Improve handling of fetching during metadata updates Key: KAFKA-15615 URL: https://issues.apache.org/jira/browse/KAFKA-15615 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-15614) Define interfaces/classes for capturing telemetry metrics

2023-10-16 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15614: - Summary: Define interfaces/classes for capturing telemetry metrics Key: KAFKA-15614 URL: https://issues.apache.org/jira/browse/KAFKA-15614 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2292

2023-10-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 317082 lines...] > Task :connect:api:copyDependantLibs UP-TO-DATE > Task :connect:api:jar UP-TO-DATE > Task :connect:json:testJar > Task

[jira] [Created] (KAFKA-15613) Add Client API in interfaces and client configurations.

2023-10-16 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15613: - Summary: Add Client API in interfaces and client configurations. Key: KAFKA-15613 URL: https://issues.apache.org/jira/browse/KAFKA-15613 Project: Kafka

Re: [DISCUSS] KIP-977: Partition-Level Throughput Metrics

2023-10-16 Thread Qichao Chu
Hi Divij and Kirk, Thank you both for providing the valuable feedback and sorry for the delay. I have just updated the KIP to address the comments. 1. Instead of using a topic-level control, global verbosity control makes more sense if we want to extend it in the future. It would be very

Re: [DISCUSS] KIP-982: Access SslPrincipalMapper and kerberosShortNamer in Custom KafkaPrincipalBuilder

2023-10-16 Thread Manikumar
Hi Raghu, Thanks for the KIP. Proposed changes look good to me. Thanks, Manikumar On Fri, Sep 22, 2023 at 11:44 PM Raghu B wrote: > Hi everyone, > > I would like to start the discussion on the KIP-982 to Access > SslPrincipalMapper and kerberosShortNamer in Custom KafkaPrincipalBuilder > >

[jira] [Resolved] (KAFKA-15543) Send HB request right after reconciliation completes

2023-10-16 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-15543. --- Resolution: Duplicate > Send HB request right after reconciliation completes >

[jira] [Resolved] (KAFKA-14761) Integration Tests for the New Consumer Implementation

2023-10-16 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-14761. --- Fix Version/s: 3.6.0 Resolution: Fixed > Integration Tests for the New Consumer

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2291

2023-10-16 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-980: Allow creating connectors in a stopped state

2023-10-16 Thread Yash Mayya
Hi all, Thanks for participating in the discussion and voting! KIP-980 has been accepted with the following +1 votes: - Chris Egerton (binding) - Knowles Atchison Jr (non-binding) - Greg Harris (binding) - Mickael Maison (binding) - Yash Mayya (binding) The target release for

[jira] [Created] (KAFKA-15612) Followup on whether the indexes need to be materialized before they are passed to RSM for writing them to tiered storage.

2023-10-16 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15612: -- Summary: Followup on whether the indexes need to be materialized before they are passed to RSM for writing them to tiered storage. Key: KAFKA-15612 URL:

[jira] [Created] (KAFKA-15611) Use virtual threads in the Connect framework

2023-10-16 Thread Greg Harris (Jira)
Greg Harris created KAFKA-15611: --- Summary: Use virtual threads in the Connect framework Key: KAFKA-15611 URL: https://issues.apache.org/jira/browse/KAFKA-15611 Project: Kafka Issue Type:

Re: [VOTE] KIP-980: Allow creating connectors in a stopped state

2023-10-16 Thread Mickael Maison
+1 (binding) Thanks for the KIP Mickael On Mon, Oct 16, 2023 at 9:05 AM Yash Mayya wrote: > > Hi all, > > Bumping up this vote thread - we have two binding +1 votes and one > non-binding +1 vote so far. > > Thanks, > Yash > > On Mon, Oct 9, 2023 at 11:57 PM Greg Harris > wrote: > > > Thanks

Re: [DISCUSS] KIP-988 Streams Standby Task Update Listener

2023-10-16 Thread Bruno Cadonna
Thanks for the KIP, Colt and Eduwer, Are you sure there is also not a significant performance impact for passing into the callback `currentEndOffset`? I am asking because the comment here:

[jira] [Created] (KAFKA-15610) Fix `CoreUtils.swallow()` test gaps

2023-10-16 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-15610: --- Summary: Fix `CoreUtils.swallow()` test gaps Key: KAFKA-15610 URL: https://issues.apache.org/jira/browse/KAFKA-15610 Project: Kafka Issue Type: Bug

Re: [PR] MINOR: Fix docs for ReplicationBytes(Out|In)PerSec metrics [kafka-site]

2023-10-16 Thread via GitHub
mimaison merged PR #561: URL: https://github.com/apache/kafka-site/pull/561 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Reopened] (KAFKA-15355) Message schema changes

2023-10-16 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez reopened KAFKA-15355: - closed by mistake > Message schema changes > -- > > Key:

[PR] MINOR: Fix docs for ReplicationBytes(Out|In)PerSec metrics [kafka-site]

2023-10-16 Thread via GitHub
bachmanity1 opened a new pull request, #561: URL: https://github.com/apache/kafka-site/pull/561 Related to the https://github.com/apache/kafka/pull/14228 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [DISCUSS] KIP-989: RocksDB Iterator Metrics

2023-10-16 Thread Lucas Brutschy
Hi Nick! thanks for the KIP! I think this could be quite useful, given the problems that we had with leaks due to RocksDB resources not being closed. I don't have any pressing issues why we can't accept it like it is, just one minor point for discussion: would it also make sense to make it

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2290

2023-10-16 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

2023-10-16 Thread Lucas Brutschy
Hi all, I think I liked your suggestion of allowing EOS with READ_UNCOMMITTED, but keep wiping the state on error, and I'd vote for this solution when introducing `default.state.isolation.level`. This way, we'd have the most low-risk roll-out of this feature (no behavior change without

[jira] [Created] (KAFKA-15609) Corrupted index uploaded to remote tier

2023-10-16 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-15609: Summary: Corrupted index uploaded to remote tier Key: KAFKA-15609 URL: https://issues.apache.org/jira/browse/KAFKA-15609 Project: Kafka Issue Type: Bug

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2289

2023-10-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 314419 lines...] Gradle Test Run :core:test > Gradle Test Executor 88 > KafkaZkClientTest > testAclMethods() PASSED Gradle Test Run

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

2023-10-16 Thread Nick Telford
Hi Guozhang, The KIP as it stands introduces a new configuration, default.state.isolation.level, which is independent of processing.mode. It's intended that this new configuration be used to configure a global IQ isolation level in the short term, with a future KIP introducing the capability to

[jira] [Created] (KAFKA-15608) Uncopied leader epoch cache cause repeated OffsetOutOfRangeException

2023-10-16 Thread Drawxy (Jira)
Drawxy created KAFKA-15608: -- Summary: Uncopied leader epoch cache cause repeated OffsetOutOfRangeException Key: KAFKA-15608 URL: https://issues.apache.org/jira/browse/KAFKA-15608 Project: Kafka

[jira] [Resolved] (KAFKA-14684) Replace EasyMock and PowerMock with Mockito in WorkerSinkTaskThreadedTest

2023-10-16 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-14684. Fix Version/s: 3.7.0 Resolution: Fixed > Replace EasyMock and PowerMock with

Re: [VOTE] KIP-988 Streams StandbyUpdateListener

2023-10-16 Thread Lucas Brutschy
Hi, thanks again for the KIP! +1 (binding) Cheers, Lucas On Sun, Oct 15, 2023 at 9:13 AM Colt McNealy wrote: > > Hello there, > > I'd like to call a vote on KIP-988 (co-authored by my friend and colleague > Eduwer Camacaro). We are hoping to get it in before the 3.7.0 release. > >

Re: [DISCUSS] KIP-988 Streams Standby Task Update Listener

2023-10-16 Thread Lucas Brutschy
Hi all, it's a nice improvement! I don't have anything to add on top of the previous comments, just came here to say that it seems to me consensus has been reached and the result looks good to me. Thanks Colt and Eduwer! Lucas On Sun, Oct 15, 2023 at 9:11 AM Colt McNealy wrote: > > Thanks,

Re: [VOTE] KIP-714: Client metrics and observability

2023-10-16 Thread Andrew Schofield
The vote for KIP-714 has now concluded and the KIP is APPROVED. The votes are: Binding: +4 (Jason, Matthias, Sophie, Jun) Non-binding: +3 (Milind, Kirk, Philip) -1 (Ryanne) This KIP aims to improve monitoring and troubleshooting of client performance by enabling clients to push metrics

[jira] [Resolved] (KAFKA-15572) Race condition between log roll and log rename

2023-10-16 Thread Lucian Ilie (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucian Ilie resolved KAFKA-15572. - Resolution: Fixed > Race condition between log roll and log rename >

Re: KIP-991: Allow DropHeaders SMT to drop headers by wildcard/regexp

2023-10-16 Thread Roman Schmitz
Hi Andrew, Ok, thanks for the feedback! I added a few more details and code examples to explain the proposed changes. Thanks, Roman Am So., 15. Okt. 2023 um 22:12 Uhr schrieb Andrew Schofield < andrew_schofield_j...@outlook.com>: > Hi Roman, > Thanks for the KIP. I think it’s an interesting

Re: [VOTE] KIP-980: Allow creating connectors in a stopped state

2023-10-16 Thread Yash Mayya
Hi all, Bumping up this vote thread - we have two binding +1 votes and one non-binding +1 vote so far. Thanks, Yash On Mon, Oct 9, 2023 at 11:57 PM Greg Harris wrote: > Thanks Yash for the well written KIP! > > And thank you for finally adding JSON support to the standalone mode > that isn't