Hi,
I'm having some problems with kafka.
After a week from starting the kafka/zookeeper servers on windows, I get an
error message
"Failed to clean up logs for __consumer_offset_5 in dir C:\tmp\kafka-logs
due to IOExeption"
Windows Server 2019 standard
Thanks
Hi all,
I find KAFKA-1641, it's fixed. But I encounter this bug in kafka-0.10.0.0. Log
as follow:
[2016-12-02 11:33:52,744] ERROR [kafka-log-cleaner-thread-0], Error due to
(kafka.log.LogCleaner)
java.lang.IllegalArgumentException: requirement failed: Last clean offset is
28233065550
If there are no "dirty" logs then the cleaner does not log anything.
You can try changing the dirty ratio config
(min.cleanable.dirty.ratio) to something smaller than the default
(which is 0.5).
Joel
On Tue, Aug 26, 2014 at 03:56:20PM -0400, Philippe Laflamme wrote:
> Yes, and in order to "force
Yes, and in order to "force" it to compact regardless of the volume, we've
set the "segment.ms" configuration key on the topic. According to the
docs[1], that should force a compaction at a certain time interval.
We're seeing the segment rolling, but not the compaction.
[1]http://kafka.apache.org
Log cleaner will only wakeup and start the cleaning work when there are
logs that are "dirty" enough to be cleaned. So if the topic-partitions does
not get enough traffic to make it dirty the log cleaner will not kicks in
to that partition again.
Guozhang
On Tue, Aug 26, 2014 at 9:02 AM, Philipp
Here's the thread dump:
https://gist.github.com/plaflamme/634411b162f56d8f48f6
There's a log-cleaner thread sleeping. Would there be any reason why it's
not writing to it's log-cleaner.log file if it's still running?
We are not using compression (unless it's on by default?)
Thanks,
Philippe
On
Hello Philippe,
You can get a thread dump and check if the log cleaner thread is still
alive, or it is blocked.
Also, are you using some compression on the messages stored on server?
Guozhang
Gu
On Tue, Aug 26, 2014 at 8:15 AM, Philippe Laflamme
wrote:
> Hi,
>
> We're using compaction on so
Hi,
We're using compaction on some of our topics. The log cleaner output showed
that it kicked in when the broker was restarted. But now after several
months of uptime, the log cleaner output is empty. The compacted topics
segment files don't seem to be cleaned up (compacted) anymore.
If there an
