Andras Hatvani created KAFKA-16584:
--------------------------------------
Summary: Make log processing summary configurable or debug
Key: KAFKA-16584
URL: https://issues.apache.org/jira/browse/KAFKA-16584
Project: Kafka
Issue Type: Bug
Components: streams
Affects Versions: 3.6.2
Reporter: Andras Hatvani
Currently *every two minutes for every stream thread* statistics will be logged
on INFO log level.
{code:log}
2024-04-18T09:18:23.790+02:00 INFO 33178 --- [service] [-StreamThread-1]
o.a.k.s.p.internals.StreamThread : stream-thread
[service-149405a3-c7e3-4505-8bbd-c3bff226b115-StreamThread-1] Processed 0 total
records, ran 0 punctuators, and committed 0 total tasks since the last update
{code}
This is absolutely unnecessary and even harmful since it fills the logs and
thus storage space with unwanted and useless data. Otherwise the INFO logs are
useful and helpful, therefore it's not an option to raise the log level to WARN.
Please make the logProcessingSummary
* either to a DEBUG level log or
* make it configurable so that it can be disabled.
This is the relevant code:
https://github.com/apache/kafka/blob/aee9724ee15ed539ae73c09cc2c2eda83ae3c864/streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java#L1073
--
This message was sent by Atlassian Jira
(v8.20.10#820010)