Hi,
We are trying to setup a utilization plot for our multi-tenant
kafka cluster.
Setup is Kafka: 2.6, Scala 2.12, Ubuntu 18
We noticed 2 issues:
1. Throttling happens even when quota violation doesn't occur
As per JMX metrics:
Producer byte-rate is 148KB/s,
Consumer byte-rate & kafka.server(type=FetchByteRate) both show 99KB/s whereas
quota is set at 165K (split equally across 3 brokers => 55K)
Everything else checks out fine. There is no other quota coming into picture.
All brokers have equal number of partitions. Per official docs, graph should
show a spike which goes beyond 55K and then throttle window, but I don't see
any peak go beyond 55K
[Diagram Description automatically generated with medium confidence]
1. JMX metric kafka.server(type=FetchByteRate) is wrong in some cases when
the load is low.
Only 1 or 2 brokers show proper value even though there is no partition skew
and data are being distributed equally.
Am I missing something ?
Any help would be much appreciated.
Thanks,
Ahmed
