Shilun Fan created HDDS-11531:
---------------------------------

             Summary: Collect iowait and system on the node.
                 Key: HDDS-11531
                 URL: https://issues.apache.org/jira/browse/HDDS-11531
             Project: Apache Ozone
          Issue Type: Sub-task
          Components: Ozone Datanode
            Reporter: Shilun Fan
            Assignee: Shilun Fan


This feature will periodically retrieve data from /proc/stat, parse the iowait 
and system information, and write it into metrics. In the future, we will 
report this metric to SCM so that it can skip high-load DNs when returning the 
pipeline DN list, decommison data transfers, creating pipelines, and balancing, 
thereby enhancing the system's access performance.

Parsing `/proc/stat` is a lightweight action that won't impose additional load 
on the system. This metric has good sensitivity to reflect the current IO 
performance of the DN. High IOWait typically indicates conditions during 
high-frequency read/write operations or when using `du` for HDD/SSD access. An 
increase in System time usually occurs during high-frequency read/write 
operations with NVMe. When these situations arise, the DN is no longer in 
optimal condition for data access or writing (as responses will be very slow), 
so we should find ways to skip such DNs during data access.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to