RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

t to invoke the YAGNI principle here. Thanks, Greg On Mon, May 13, 2024 at 11:22 AM Diop, Assane wrote: > > Hi Greg, > > Thank you for your thoughtful response. Resending this email to continue > engagement on the KIP discussion. > > Our motivation here is to accel

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

that could implement this feature, and just leave the Kafka compression off? I think an "Add Brotli Compression" KIP is definitely worth pursuing, if that is the compression algorithm you have in mind currently. Thanks, Greg On Mon, Apr 29, 2024 at 3:10 PM Diop, Assane wrote: > > Hi D

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

f? I think an "Add Brotli Compression" KIP is definitely worth pursuing, if that is the compression algorithm you have in mind currently. Thanks, Greg On Mon, Apr 29, 2024 at 3:10 PM Diop, Assane wrote: > > Hi Divij, Greg and Luke, > I have updated the KIP for Kafka pluggable

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

have made significant changes to the design to accommodate the concerns and would like some feedback from the community and engage communication. Assane -Original Message- From: Diop, Assane Sent: Friday, March 1, 2024 4:45 PM To: dev@kafka.apache.org Subject: RE: DISCUSS KIP-984 Add

RE:DISCUSS KIP-984 Add pluggable compression interface to Kafka

communication. Assane -Original Message- From: Diop, Assane Sent: Friday, March 1, 2024 4:45 PM To: dev@kafka.apache.org Subject: RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka Hi Luke, The proposal doesn't preclude supporting multiple clients but each client would ne

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

n Tue, Feb 27, 2024 at 7:44 AM Diop, Assane wrote: > Hi Greg, > > Thanks for taking the time to give some feedback. It was very insightful. > > I have some answers: > > 1. The current proposal is Java centric. We want to figure out with > Java first and then later incorp

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

erface and leaving the namespace to be wrangled by operators and client libraries. Thanks, Greg [1] https://github.com/confluentinc/librdkafka [2] https://github.com/apache/kafka/blob/e8c70fce26626ed2ab90f2728a45f6e55e907ec1/clients/src/main/java/org/apache/kafka/common/record/DefaultRecordBatch.jav

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

KIP gets accepted Assane -Original Message- From: Diop, Assane Sent: Wednesday, January 31, 2024 10:24 AM To: dev@kafka.apache.org Subject: RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka Hi Divij, Thank you for your response! Although compression is not a new problem

RE: [VOTE] KIP-390: Support Compression Level (rebooted)

Hi Mickael I will take some time today to add some documentation to KIP-984. I actually have a working implementation of the plugin and I have been running test. I would be ready to do a PR anytime. As far as motivation, Divij did asked about that and I responded in an email to the mailing li

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

d message with V1 and broker expects in V2, we convert the message and recompress it. -- Divij Vaidya On Mon, Dec 18, 2023 at 7:22 PM Diop, Assane wrote: > I would like to bring some attention to this KIP. We have added an > interface to the compression code that allow anyone to build t

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

I would like to bring some attention to this KIP. We have added an interface to the compression code that allow anyone to build their own compression plugin and integrate easily back to kafka. Assane -Original Message- From: Diop, Assane Sent: Monday, October 2, 2023 9:27 AM To

DISCUSS KIP-984 Add pluggable compression interface to Kafka

https://cwiki.apache.org/confluence/display/KAFKA/KIP-984%3A+Add+pluggable+compression+interface+to+Kafka

Permissions to contribute to Apache Kafka

Hi Team, Following are the details for Wiki id Email: assane.d...@intel.com Username: Assane.diop Jira id Email: assane.d...@gmail.com Username: adiop Thanks, Assane Diop

Can't creare a Jira

I am unable to complete my Jira account. The request seems to be pending. Can anyone help with this? Assane