ZanderXu created HDFS-16678:
-------------------------------
Summary: RBF supports disable getNodeUsage() in RBFMetrics
Key: HDFS-16678
URL: https://issues.apache.org/jira/browse/HDFS-16678
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: ZanderXu
Assignee: ZanderXu
In our prod environment, we try to collect RBF metrics every 15s through
jmx_exporter. And we found that collection task often failed.
After tracing and found that the collection task is blocked at getNodeUsage()
in RBFMetrics, because it will collection all datanode's usage from downstream
nameservices. This is a very expensive and almost useless operation. Because
in most scenarios, each NameSerivce contains almost the same DNs. We can get
the data usage's from any one nameservices, not from RBF.
So I feel that RBF should supports disable getNodeUsage() in RBFMetrics.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
