Re: Compression - producer vs topic?

Thanks, Liam! I have a mixture of Kafka record size. 10% are large (>100kbs) and 90% of the records are smaller than 1kb. I'm working on a streaming analytics solution that streams impressions, user actions and serving info and combines them together. End-to-end latency is more important than

Re: Compression - producer vs topic?

Hi Dan, Decompression generally only happens in the broker if the topic has a particular compression algorithm set, and the producer is using a different one - then the broker will decompress records from the producer, then recompress it using the topic's configured algorithm. (The LogCleaner

Compression - producer vs topic?

Hi. I looked around for advice about Kafka compression. I've seen mixed and conflicting advice. Is there any sorta "if X, do Y" type of documentation around Kafka compression? Any advice? Any good posts to read that talk about this trade off? *Detailed comments* I tried looking for producer

Re: [kafka-clients] [ANNOUNCE] Apache Kafka 3.0.1

Thank you Mickael! On Mon, Mar 14, 2022 at 6:47 PM John Roesler wrote: > Yes, thank you, Mickael! > -John > > On Mon, 2022-03-14 at 12:19 +0100, Bruno Cadonna wrote: > > Thanks Mickael for driving this release! > > > > Best, > > Bruno > > > > On 14.03.22 11:42, Mickael Maison wrote: > > > The

Re: [kafka-clients] [ANNOUNCE] Apache Kafka 3.0.1

Yes, thank you, Mickael! -John On Mon, 2022-03-14 at 12:19 +0100, Bruno Cadonna wrote: > Thanks Mickael for driving this release! > > Best, > Bruno > > On 14.03.22 11:42, Mickael Maison wrote: > > The Apache Kafka community is pleased to announce the release for > > Apache Kafka 3.0.1 > > > >

Error creating PREFIXED ACL's

Hi Since weeks we have on one of our environments the following error by creating PREFIXED ACL’s. Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=xyz1, patternType=PREFIXED)`: (principal=User:xyz, host=*, operation=READ, permissionType=ALLOW)

Re: [kafka-clients] [ANNOUNCE] Apache Kafka 3.0.1

Thanks Mickael for driving this release! Best, Bruno On 14.03.22 11:42, Mickael Maison wrote: The Apache Kafka community is pleased to announce the release for Apache Kafka 3.0.1 Apache Kafka 3.0.1 is a bugfix release and 29 issues have been fixed since 3.0.0. All of the changes in this

[ANNOUNCE] Apache Kafka 3.0.1

The Apache Kafka community is pleased to announce the release for Apache Kafka 3.0.1 Apache Kafka 3.0.1 is a bugfix release and 29 issues have been fixed since 3.0.0. All of the changes in this release can be found in the release notes: https://www.apache.org/dist/kafka/3.0.1/RELEASE_NOTES.html

Multi Cluster Failover Kafka Client

Hi, I am designing a Geo Red Kafka cluster with MirrorMaker. My use case is an active/passive cluster where the follower is kept up-to-date by MirrorMaker. Now, I want that my consumers and producers should switch to the follower cluster when none of the brokers in the primary cluster are