[
https://issues.apache.org/jira/browse/KAFKA-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15570935#comment-15570935
]
ASF GitHub Bot commented on KAFKA-4298:
---------------------------------------
GitHub user hachikuji opened a pull request:
https://github.com/apache/kafka/pull/2019
KAFKA-4298: Ensure compressed message sets are converted when cleaning the
log
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/hachikuji/kafka KAFKA-4298
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/2019.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2019
----
commit af3b31b4d94ece1603ac470bfd8d781558987501
Author: Jason Gustafson <[email protected]>
Date: 2016-10-13T04:56:52Z
KAFKA-4298: Ensure compressed message sets are converted when cleaning the
log
----
> LogCleaner does not convert compressed message sets properly
> ------------------------------------------------------------
>
> Key: KAFKA-4298
> URL: https://issues.apache.org/jira/browse/KAFKA-4298
> Project: Kafka
> Issue Type: Bug
> Reporter: Jason Gustafson
> Assignee: Jason Gustafson
> Priority: Critical
> Fix For: 0.10.1.1
>
>
> When cleaning the log, we attempt to write the cleaned messages using the
> message format configured for the topic, but as far as I can tell, we do not
> convert the wrapped messages in compressed message sets. For example, if
> there is an old compressed message set with magic=0 in the log and the topic
> is configured for magic=1, then after cleaning, the new message set will have
> a wrapper with magic=1, but the nested messages will still have magic=0. If
> this happens, there does not seem to be an easy way to recover without
> manually fixing up the log.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)