[
https://issues.apache.org/jira/browse/HDFS-16595?focusedWorklogId=775689&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-775689
]
ASF GitHub Bot logged work on HDFS-16595:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 29/May/22 04:37
Start Date: 29/May/22 04:37
Worklog Time Spent: 10m
Work Description: virajjasani commented on code in PR #4357:
URL: https://github.com/apache/hadoop/pull/4357#discussion_r884209200
##########
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestSlowPeerTracker.java:
##########
@@ -79,9 +79,12 @@ public void testEmptyReports() {
@Test
public void testReportsAreRetrieved() {
- tracker.addReport("node2", "node1", 1.2);
- tracker.addReport("node3", "node1", 2.1);
- tracker.addReport("node3", "node2", 1.22);
+ OutlierMetrics outlierMetrics1 = new OutlierMetrics(0.0, 0.0, 0.0, 1.2);
Review Comment:
Got it, addressed this change in the latest commit, thanks @tomscut
##########
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestSlowPeerTracker.java:
##########
@@ -161,17 +176,28 @@ public void testGetJson() throws IOException {
@Test
public void testGetJsonSizeIsLimited() throws IOException {
- tracker.addReport("node1", "node2", 1.634);
- tracker.addReport("node1", "node3", 2.3566);
- tracker.addReport("node2", "node3", 3.869);
- tracker.addReport("node2", "node4", 4.1356);
- tracker.addReport("node3", "node4", 1.73057);
- tracker.addReport("node3", "node5", 2.4956730);
- tracker.addReport("node4", "node6", 3.29847);
- tracker.addReport("node5", "node6", 4.13444);
- tracker.addReport("node5", "node7", 5.10845);
- tracker.addReport("node6", "node8", 2.37464);
- tracker.addReport("node6", "node7", 1.29475656);
+ OutlierMetrics outlierMetrics1 = new OutlierMetrics(0.0, 0.0, 0.0, 1.634);
Review Comment:
Done, thanks
Issue Time Tracking
-------------------
Worklog Id: (was: 775689)
Time Spent: 1h 40m (was: 1.5h)
> Slow peer metrics - add median, mad and upper latency limits
> ------------------------------------------------------------
>
> Key: HDFS-16595
> URL: https://issues.apache.org/jira/browse/HDFS-16595
> Project: Hadoop HDFS
> Issue Type: New Feature
> Reporter: Viraj Jasani
> Assignee: Viraj Jasani
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> Slow datanode metrics include slow node and it's reporting node details. With
> HDFS-16582, we added the aggregate latency that is perceived by the reporting
> nodes.
> In order to get more insights into how the outlier slownode's latencies
> differ from the rest of the nodes, we should also expose median, median
> absolute deviation and the calculated upper latency limit details.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
