[ 
https://issues.apache.org/jira/browse/KAFKA-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Manikumar Reddy updated KAFKA-2213:
-----------------------------------
    Attachment: KAFKA-2213_2015-08-20_17:04:28.patch

> Log cleaner should write compacted messages using configured compression type
> -----------------------------------------------------------------------------
>
>                 Key: KAFKA-2213
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2213
>             Project: Kafka
>          Issue Type: Bug
>            Reporter: Joel Koshy
>            Assignee: Manikumar Reddy
>         Attachments: KAFKA-2213.patch, KAFKA-2213_2015-05-30_00:23:01.patch, 
> KAFKA-2213_2015-06-17_16:05:53.patch, KAFKA-2213_2015-07-10_20:18:06.patch, 
> KAFKA-2213_2015-08-20_17:04:28.patch
>
>
> In KAFKA-1374 the log cleaner was improved to handle compressed messages. 
> There were a couple of follow-ups from that:
> * We write compacted messages using the original compression type in the 
> compressed message-set. We should instead append all retained messages with 
> the configured broker compression type of the topic.
> * While compressing messages we should ideally do some batching before 
> compression.
> * Investigate the use of the client compressor. (See the discussion in the 
> RBs for KAFKA-1374)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to