Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.4 #49

See

[DISCUSS] Tiered-Storage: Implement RocksdbBasedMetadataCache for TopicBased RLMM

Background: In KIP-405: Kafka Tiered Storage - Apache Kafka - Apache Software Foundation, kafka introduced the feature of hierarchical storage, and RLMM is responsible for storing remote segment's metadata. BTW, [KAFKA-9555] Topic-based implementation for the RemoteLogMetadataManager - ASF

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1527

See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1526

See Changes: -- [...truncated 528129 lines...] [2023-01-21T01:11:52.470Z] [2023-01-21T01:11:52.470Z] > Task :clients:javadoc [2023-01-21T01:11:52.470Z]

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.4 #47

See

Re: [DISCUSS] KIP-890 Server Side Defense

> looks like we already have code to handle bumping the epoch and when the epoch is Short.MAX_VALUE, we get a new producer ID. My understanding is that this logic is currently encapsulated in the broker and the client doesn't really know at which epoch value the new producer id is generated.

Re: [DISCUSS] KIP-890 Server Side Defense

That's a fair point about other clients. I think the abortable error case is interesting because I'm curious how other clients would handle this. I assume they would need to implement handling for the error code unless they did something like "any unknown error codes/any codes that aren't x,y,z

[jira] [Created] (KAFKA-14644) Process should stop after failure in raft IO thread

Jason Gustafson created KAFKA-14644: --- Summary: Process should stop after failure in raft IO thread Key: KAFKA-14644 URL: https://issues.apache.org/jira/browse/KAFKA-14644 Project: Kafka

Re: [DISCUSS] KIP-890 Server Side Defense

Thanks Justine for the replies! I agree with most of your thoughts. Just for 3/7), though I agree for our own AK producer, since we do "nextRequest(boolean hasIncompleteBatches)", we guarantee the end-txn would not be sent until we've effectively flushed, but I was referring to any future bugs or

Re: [DISCUSS] KIP-890 Server Side Defense

Hey Guozhang. Thanks for taking a look and for the detailed comments! I'll do my best to address below. 1. I see what you are saying here, but I think I need to look through the sequence of events you mention. Typically we've seen this issue in a few cases. One is when we have a producer

Re: [DISCUSS] KIP-900: KRaft kafka-storage.sh API additions to support SCRAM

Hi Colin, Thanks for the response. I chose raw records, thinking it might be useful for future additions of records that customers might want to add before the first start of the cluster. I do see that it is at best an engineer friendly interface. I do think kafka-storage is the correct place to

Re: [DISCUSS] KIP-890 Server Side Defense

Hello Justine, Thanks for the great write-up! I made a quick pass through it and here are some thoughts (I have not been able to read through this thread so pardon me if they have overlapped or subsumed by previous comments): First are some meta ones: 1. I think we need to also improve the

[GitHub] [kafka-site] bbejeck commented on pull request #482: MINOR: Rename description of flatMapValues transformation

bbejeck commented on PR #482: URL: https://github.com/apache/kafka-site/pull/482#issuecomment-1398623164 Thanks @maseiler ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [kafka-site] bbejeck merged pull request #482: MINOR: Rename description of flatMapValues transformation

bbejeck merged PR #482: URL: https://github.com/apache/kafka-site/pull/482 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[VOTE] 3.4.0 RC1

Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 3.4.0. Some of the major features include: * KIP-881: Rack-aware Partition Assignment for Kafka Consumers <

[GitHub] [kafka-site] maseiler opened a new pull request, #482: MINOR: Rename description of flatMapValues transformation

maseiler opened a new pull request, #482: URL: https://github.com/apache/kafka-site/pull/482 The table of (stateless) transformations uses the transformation name in the first column and a description in the second column. I adjusted the transformation name for FlatMapValues accordingly.

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #46

See Changes: -- [...truncated 435732 lines...] [2023-01-20T12:40:16.565Z] > Task :clients:javadoc [2023-01-20T12:40:16.565Z]

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1525

See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.4 #45

See

[GitHub] [kafka-site] ableegoldman merged pull request #481: MINOR: Pre-release of Kafka 3.4.0 documentation and javadocs

ableegoldman merged PR #481: URL: https://github.com/apache/kafka-site/pull/481 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka-site] ableegoldman opened a new pull request, #481: MINOR: Pre-release of Kafka 3.4.0 documentation and javadocs

ableegoldman opened a new pull request, #481: URL: https://github.com/apache/kafka-site/pull/481 This adds the site documentation and javadocs for 3.4 generated with RC1. This PR does not include the updated reference in the top-level documentation.html file. -- This is an automated