Re: log.cleaner.io.max.bytes.per.second

2022-12-28 Thread Luke Chen
Hi Nicolas, > Any Idea some may have to limit log compaction disk usage ? That's a pretty big issue we're having, compaction of a few topics is using far more IO than everything else on the broker... I don't know any other better solution except make the `log.cleaner.io.ma

Re: log.cleaner.io.max.bytes.per.second

2022-12-28 Thread Nicolas Carlot
Okay, thx for the explaination Luc. When looking for logs on a bigger topic, I can see the IO limitation kinda works. I have like15MB/s when having configured log.cleaner.io.max.bytes.per.second=1024.0 I'm not very comfortable with this. Setting the limit rate to 1Kb/s, ending with 15Mb/s, se

Re: log.cleaner.io.max.bytes.per.second

2022-12-28 Thread Luke Chen
gt; I'm trying to use the log.cleaner.io.max.bytes.per.second configuration to > limit disk usage when the log cleaner runs, but it doesn't seem to work as > expected. > When looking at the logs, I can see it still uses far more than configured. > > This is the output

log.cleaner.io.max.bytes.per.second

2022-12-22 Thread Nicolas Carlot
Hello users, I'm trying to use the log.cleaner.io.max.bytes.per.second configuration to limit disk usage when the log cleaner runs, but it doesn't seem to work as expected. When looking at the logs, I can see it still uses far more than configured. This is the o