[ https://issues.apache.org/jira/browse/KAFKA-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14257268#comment-14257268 ]
Jay Kreps commented on KAFKA-1755: ---------------------------------- Rejecting messages without a key doesn't actually solve the problem, I think as you can change the retention setting of a topic to compaction later at which point there may already be null keys. Perhaps the most consistent thing to do would actually be to treat null as a key value. So the cleaner would retain a single null value and remove the others. > Improve error handling in log cleaner > ------------------------------------- > > Key: KAFKA-1755 > URL: https://issues.apache.org/jira/browse/KAFKA-1755 > Project: Kafka > Issue Type: Bug > Reporter: Joel Koshy > Assignee: Joel Koshy > Labels: newbie++ > Fix For: 0.8.3 > > > The log cleaner is a critical process when using compacted topics. > However, if there is any error in any topic (notably if a key is missing) > then the cleaner exits and all other compacted topics will also be adversely > affected - i.e., compaction stops across the board. > This can be improved by just aborting compaction for a topic on any error and > keep the thread from exiting. > Another improvement would be to reject messages without keys that are sent to > compacted topics although this is not enough by itself. -- This message was sent by Atlassian JIRA (v6.3.4#6332)