[jira] [Created] (KAFKA-15602) Breaking change in 3.4.0 ByteBufferSerializer

Luke Kirby created KAFKA-15602: -- Summary: Breaking change in 3.4.0 ByteBufferSerializer Key: KAFKA-15602 URL: https://issues.apache.org/jira/browse/KAFKA-15602 Project: Kafka Issue Type: Bug

Re: [DISCUSS] 3.5.2 Release

Thanks for volunteering Luke! On Thu, Oct 12, 2023 at 2:55 AM Levani Kokhreidze wrote: > Hi Divij, > > Thanks for the explanation, makes sense. > > Hi Luke, thanks you! It would be awesome to see 3.5.2 out. > > Best, > Levani > > > On 12. Oct 2023, at 12:39, Luke Chen wrote: > > > > Hi Levani

[PR] MINOR: fix Kafka Streams metric names [kafka-site]

mjsax opened a new pull request, #558: URL: https://github.com/apache/kafka-site/pull/558 Follow up to https://github.com/apache/kafka/pull/14221 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: Requesting to be added to Kafka project

Hey Alyssa, Thanks for considering opening a KIP! I've given you the necessary permissions to create a KIP, let me know if you have any more issues. Thanks! Greg On Thu, Oct 12, 2023 at 3:22 PM Alyssa Huang wrote: > > Can I also have edit/write permission for Confluence to start a KIP? My >

[jira] [Created] (KAFKA-15601) Client metrics and observability

Apoorv Mittal created KAFKA-15601: - Summary: Client metrics and observability Key: KAFKA-15601 URL: https://issues.apache.org/jira/browse/KAFKA-15601 Project: Kafka Issue Type: Improvement

Re: Requesting to be added to Kafka project

Can I also have edit/write permission for Confluence to start a KIP? My username is ahuang98, thanks a bunch On Fri, Apr 30, 2021 at 3:31 PM Bill Bejeck wrote: > Hi Alyssa, > > I've added you to the contributors role in Jira so you should be able to > self-assign tickets now. > > -Bill > > On

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

Hey Nick! First of all thanks for taking up this awesome feature, I'm sure every single Kafka Streams user and dev would agree that it is sorely needed. I've just been catching up on the KIP and surrounding discussion, so please forgive me for any misunderstandings or misinterpretations of the

Re: [DISCUSS] KIP-714: Client metrics and observability

Thanks Andrew. Makes sense to me. Adding the parameter-less overload was just a random idea. No need to extend the KIP. -Matthias On 10/12/23 12:12 PM, Jun Rao wrote: Hi, Andrew, Thanks for the reply. 131. Could we also document how one could correlate each client instance in KStreams with

Re: [DISCUSS] KIP-985 Add reverseRange and reverseAll query over kv-store in IQv2

Hi, just pointing to javadocs for range() and reverseRange(): range(): *@return The iterator for this range, from smallest to largest bytes.* reverseRange(): * @return The reverse iterator for this range, from largest to smallest key bytes. Cheers, Alieh On Thu, Oct 12, 2023 at 7:32 AM

Re: [DISCUSS] KIP-714: Client metrics and observability

Hi, Andrew, Thanks for the reply. 131. Could we also document how one could correlate each client instance in KStreams with the labels for the metrics received by the brokers? 132. The documentation for RequestsPerSec is not complete. If you trace through how

Re: [DISCUSS] KIP-714: Client metrics and observability

Hi Matthias, I’ll answer (1) to (3). (1) The KIP uses the phrase “client instance id” and the method name mirrors that. Personally, I’m comfortable with the current name. (2) That’s a good point. I’ll update it to use a Kafka Uuid instead. (3) Although it’s a trivial thing to add an overload

Re: [DISCUSS] KIP-714: Client metrics and observability

Hi Jun, Thanks for your comments. 130. As Matthias described, and I am adding to the KIP, the `KafkaStreams#clientInstanceIds` method is only permitted when the state is RUNNING or REBALANCING. Also, clients can be added dynamically so the maps might change over time. If it’s in a permitted

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2281

See Changes: -- [...truncated 210646 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > DefaultStateUpdaterTest >

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.6 #91

See

[jira] [Resolved] (KAFKA-15540) Handle heartbeat and revocation when consumer leaves group

[ https://issues.apache.org/jira/browse/KAFKA-15540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans resolved KAFKA-15540. Resolution: Duplicate Duplicate of KAKFA-15548 > Handle heartbeat and revocation when

Re: [DISCUSS] KIP-714: Client metrics and observability

Seems both Andrew and Jun prefer to merge the consumers. I am ok with this. I'll leave it to Andrew to update the KIP accordingly, including adding `throws TimeoutException`. -Matthias On 10/12/23 10:07 AM, Jun Rao wrote: Hi, Matthias, 130. Yes, throwing an exception sounds reasonable. It

Re: [DISCUSS] KIP-714: Client metrics and observability

Hi, Matthias, 130. Yes, throwing an exception sounds reasonable. It would be useful to document this. 131. I was thinking that we could just return all consumers (including the global consumer) through Map consumerInstanceIds() and use keys to identify each consumer instance. The benefit is that

[jira] [Created] (KAFKA-15599) Move KafkaMetadataLog and RaftManager to metadata module

Ismael Juma created KAFKA-15599: --- Summary: Move KafkaMetadataLog and RaftManager to metadata module Key: KAFKA-15599 URL: https://issues.apache.org/jira/browse/KAFKA-15599 Project: Kafka Issue

[jira] [Created] (KAFKA-15600) KIP-990: Capability to SUSPEND Tasks on DeserializationException

Nicholas Telford created KAFKA-15600: Summary: KIP-990: Capability to SUSPEND Tasks on DeserializationException Key: KAFKA-15600 URL: https://issues.apache.org/jira/browse/KAFKA-15600 Project:

Re: [VOTE] KIP-960: Support single-key_single-timestamp interactive queries (IQv2) for versioned state stores

Thanks to Matthias, Bruno, Lucas, and Walker for voting. So I consider this KIP accepted. Cheers, Alieh On Thu, Oct 12, 2023 at 9:26 AM Lucas Brutschy wrote: > +1 (binding) > > Thanks for the KIP! > > Cheers, > Lucas > > On Wed, Oct 11, 2023 at 7:55 PM Walker Carlson > wrote: > > > > +1

[DISCUSS] KIP-990: Capability to SUSPEND Tasks on DeserializationException

Hi everyone, This is a Streams KIP to add a new DeserializationHandlerResponse, "SUSPEND", that suspends the failing Task but continues to process other Tasks normally. https://cwiki.apache.org/confluence/display/KAFKA/KIP-990%3A+Capability+to+SUSPEND+Tasks+on+DeserializationException I'm not

Re: [DISCUSS] KIP-714: Client metrics and observability

Hi Matthias, 131) I also think that separating the main and restore consumers is excessively specific about the current implementation. So, I think I’d prefer: public class ClientInstanceIds { String adminInstanceId(); Optional globalConsumerInstanceId(); Map consumerInstanceIds();

Re: [DISCUSS] KIP-714: Client metrics and observability

Thanks Sophie and Jun. `clientInstanceIds()` is fine with me -- was not sure about the double plural myself. Sorry if my comments was confusing. I was trying to say, that adding a overload to `KafkaStreams` that does not take a timeout parameter does not make sense, because there is no

[jira] [Resolved] (KAFKA-15596) Upgrade ZooKeeper to 3.8.3

[ https://issues.apache.org/jira/browse/KAFKA-15596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-15596. Fix Version/s: 3.7.0 3.6.1 Resolution: Fixed > Upgrade

Re: [DISCUSS] KIP-714: Client metrics and observability

Hi, Matthias, Thanks for the reply. 130. What would be the semantic? If the timeout has expired and only some of the client instances' id have been retrieved, does the call return the partial result or throw an exception? 131. Could we group all consumer instances in a single method since we

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2280

See Changes: -- [...truncated 316828 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > DefaultTaskExecutorTest >

Re: [ANNOUNCE] Apache Kafka 3.6.0

Congratulations to the community on an exciting release! Special thanks to Satish for driving the release and KIP-405. :) Ismael On Tue, Oct 10, 2023 at 10:39 PM Satish Duggana wrote: > The Apache Kafka community is pleased to announce the release for > Apache Kafka 3.6.0 > > This is a minor

[jira] [Resolved] (KAFKA-14504) Implement DescribeGroups API

[ https://issues.apache.org/jira/browse/KAFKA-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-14504. - Reviewer: David Jacot Resolution: Fixed > Implement DescribeGroups API >

[jira] [Resolved] (KAFKA-14506) Implement DeleteGroups API and OffsetDelete API

[ https://issues.apache.org/jira/browse/KAFKA-14506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-14506. - Reviewer: David Jacot Resolution: Fixed > Implement DeleteGroups API and OffsetDelete API

Re: [ANNOUNCE] Apache Kafka 3.6.0

I'd like to clarify calling out 3.6.0 as a minor release. We use semantic versioning*(Major.Minor.Patch) in Apache Kafka releases. Releases like 3.5.0 or 3.6.0 are called minor releases according to the semantic versioning. The next major release will be 4.0.0. 3.6.0 release is packed with big

[jira] [Created] (KAFKA-15598) Add integration tests for DescribeGroups API, DeleteGroups API and OffsetDelete API

Dongnuo Lyu created KAFKA-15598: --- Summary: Add integration tests for DescribeGroups API, DeleteGroups API and OffsetDelete API Key: KAFKA-15598 URL: https://issues.apache.org/jira/browse/KAFKA-15598

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #79

See Changes: -- [...truncated 287166 lines...] Gradle Test Run :streams:integrationTest > Gradle Test Executor 181 > TableTableJoinIntegrationTest > [caching enabled = true]

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2279

See Changes: -- [...truncated 211178 lines...] Gradle Test Run :streams:test > Gradle Test Executor 83 > DefaultTaskExecutorTest > shouldNotFlushOnException() STARTED

[jira] [Resolved] (KAFKA-15492) Enable spotbugs when building with Java 21

[ https://issues.apache.org/jira/browse/KAFKA-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya resolved KAFKA-15492. -- Resolution: Fixed > Enable spotbugs when building with Java 21 >

Re:[DISCUSS] KIP-967: Support custom SSL configuration for Kafka Connect RestServer

Hi Ashwin, > I was referring to (and did not understand) the removal of L141 in > clients/src/main/java/org/apache/kafka/common/security/ssl/SslFactory.java This line is moved to "new" private method `instantiateSslEngineFactory0 `. Please take a look at the `SslFactory:L132` at the patch. Just

[jira] [Created] (KAFKA-15597) Allow Connect DropHeaders SMT remove headers on a wildcard-basis

Roman Schmitz created KAFKA-15597: - Summary: Allow Connect DropHeaders SMT remove headers on a wildcard-basis Key: KAFKA-15597 URL: https://issues.apache.org/jira/browse/KAFKA-15597 Project: Kafka

[jira] [Created] (KAFKA-15596) Upgrade ZooKeeper to 3.8.3

Mickael Maison created KAFKA-15596: -- Summary: Upgrade ZooKeeper to 3.8.3 Key: KAFKA-15596 URL: https://issues.apache.org/jira/browse/KAFKA-15596 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-15595) Session window aggregate drops records headers

Abdullah alkhawatrah created KAFKA-15595: Summary: Session window aggregate drops records headers Key: KAFKA-15595 URL: https://issues.apache.org/jira/browse/KAFKA-15595 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2278

See Changes: -- [...truncated 316180 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > DefaultStateUpdaterTest >

Re: [DISCUSS] 3.5.2 Release

Hi Divij, Thanks for the explanation, makes sense. Hi Luke, thanks you! It would be awesome to see 3.5.2 out. Best, Levani > On 12. Oct 2023, at 12:39, Luke Chen wrote: > > Hi Levani and Divij, > > I can work on the 3.5.2 release. > I'll start a new thread for volunteering it maybe next

Re: [DISCUSS] 3.5.2 Release

Hi Levani and Divij, I can work on the 3.5.2 release. I'll start a new thread for volunteering it maybe next week. Thanks. Luke On Thu, Oct 12, 2023 at 5:07 PM Divij Vaidya wrote: > Hello Levani > > From a process perspective, there is no fixed schedule for bug fix > releases. If we have a

Re: [DISCUSS] 3.5.2 Release

Hello Levani >From a process perspective, there is no fixed schedule for bug fix releases. If we have a volunteer for release manager (must be a committer), they can start with the process of bug fix release (with the approval of PMC). My personal opinion is that it's too early to start 3.6.1

[DISCUSS] 3.5.2 Release

Hello, KAFKA-15571 [1] was merged and backported to the 3.5 and 3.6 branches. Bug fixes the feature that was added in 3.5. Considering the feature doesn't work as expected without a fix, I would like to know if it's reasonable to start the 3.5.2 release. Of course, releasing such a massive

Re: [VOTE] KIP-960: Support single-key_single-timestamp interactive queries (IQv2) for versioned state stores

+1 (binding) Thanks for the KIP! Cheers, Lucas On Wed, Oct 11, 2023 at 7:55 PM Walker Carlson wrote: > > +1 (binding) > > Thanks for the kip Alieh! > > Walker > > On Wed, Oct 11, 2023 at 3:52 AM Bruno Cadonna wrote: > > > Thanks for the KIP, Alieh! > > > > +1 (binding) > > > > Best, > > Bruno

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #78

See Changes: -- [...truncated 284693 lines...] > Task :connect:json:testJar > Task :raft:compileTestJava UP-TO-DATE > Task :raft:testClasses UP-TO-DATE > Task

Re: [DISCUSS] KIP-714: Client metrics and observability

Regarding the naming, I personally think `clientInstanceId` makes sense for the plain clients -- especially if we might later introduce the notion of an `applicationInstanceId`. I'm not a huge fan of `clientsInstanceIds` for the Kafka Streams API, though, can we use `clientInstanceIds` instead?

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2277

See Changes: -- [...truncated 210268 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > DefaultTaskManagerTest >

[jira] [Resolved] (KAFKA-14987) Implement Group/Offset expiration

[ https://issues.apache.org/jira/browse/KAFKA-14987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-14987. - Fix Version/s: 3.7.0 Reviewer: David Jacot Resolution: Fixed > Implement