Divij Vaidya created KAFKA-18268:
------------------------------------
Summary: Add metric for log cleaner thread busy percentage
Key: KAFKA-18268
URL: https://issues.apache.org/jira/browse/KAFKA-18268
Project: Kafka
Issue Type: Improvement
Reporter: Divij Vaidya
Assignee: Jason Taylor
## Background
The number of cleaner threads (responsible for cleaning up/compacting topics
which contains "compact") is configured using
[https://kafka.apache.org/documentation.html#brokerconfigs_log.cleaner.threads]
## Problem
When the number of threads is in-adequate to handle the compaction load, the
user will notice an increase in `max-compaction-delay-secs` metric. However,
an increase in this metric does not necessarily mean that the threads are
overloaded. For example, this metric could be increasing due to all cleaner
threads getting throttled.
## Requirement
We want a mechanism to determine when the cleaner threads should be increased.
## Proposal
Add a thread pool utilization metric for log cleaner thread busy percentage.
This is similar to how to we have thread pool utilization metrics for
io-threads, network-threads etc.
### Note that this Jira required a KIP since we are adding a new metric
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
