Re: compaction not happening for change log topic

Hi Sachin, I’ve found this useful: http://stackoverflow.com/questions/34281643/how-to-test-whether-log-compaction-is-working-or-not-in-kafka, as well as this

Re: compaction not happening for change log topic

Ok I have gone through the docs and looked the log.cleaner properties. The use case we have is that say for a change log topic we have at a point of time (k, v1). When for same key we now have (k, v2) we really don't want (k, v1) to be retained and get cleaned up as soon as possible. So I see

Re: compaction not happening for change log topic

That's a topic config you need to set at the broker side: See config parameter `log.cleaner.*` in http://kafka.apache.org/documentation/#brokerconfigs -Matthias On 3/31/17 11:49 AM, Sachin Mittal wrote: > Hi, > I have noticed that many times change log topics don't get compacted. The > segment

compaction not happening for change log topic

Hi, I have noticed that many times change log topics don't get compacted. The segment log file is always 1 GB. So I would like to know how and when compaction comes into play. is there a way we can get the topic compacted say trigger compaction after x seconds of a given message or a given