Ryan Blough created HDDS-13220:
----------------------------------
Summary: Negative usedBytes messages flood Recon logs in large
clusters
Key: HDDS-13220
URL: https://issues.apache.org/jira/browse/HDDS-13220
Project: Apache Ozone
Issue Type: Bug
Components: Ozone Recon
Affects Versions: 1.4.1
Reporter: Ryan Blough
In Recon, WARN messages of the type:
{code:java}
2025-05-13 12:41:29,141 WARN
[ContainerSizeCountTask]-org.apache.hadoop.ozone.recon.tasks.ContainerSizeCountTask:
Negative usedBytes (-99999999) for container #555555 treating it as 0{code}
Can flood the logs in large clusters. In a cluster with 150+ DataNodes and 50+
PB of data, I observed 90k such entries reporting once per minute, flooding the
Recon logs into uselessness.
The root cause of these messages is logging on the DataNode, which is
aggregated into Recon. The appearance of the messages on the DataNode side has
been resolved in HDDS-11267. The flood of messages on the Recon side can be
resolved by switching the loglevel of this message from WARN to DEBUG.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]