[
https://issues.apache.org/jira/browse/HDFS-15745?focusedWorklogId=727009&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-727009
]
ASF GitHub Bot logged work on HDFS-15745:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 15/Feb/22 13:16
Start Date: 15/Feb/22 13:16
Worklog Time Spent: 10m
Work Description: tasanuma opened a new pull request #3992:
URL: https://github.com/apache/hadoop/pull/3992
<!--
Thanks for sending a pull request!
1. If this is your first time, please read our contributor guidelines:
https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute
2. Make sure your PR title starts with JIRA issue id, e.g.,
'HADOOP-17799. Your PR title ...'.
-->
### Description of PR
HDFS-15745. Make DataNodePeerMetrics#LOW_THRESHOLD_MS and
MIN_OUTLIER_DETECTION_NODES configurable.
### How was this patch tested?
### For code changes:
- [x] Does the title or this PR starts with the corresponding JIRA issue id
(e.g. 'HADOOP-17799. Your PR title ...')?
- [ ] Object storage: have the integration tests been executed and the
endpoint declared according to the connector-specific documentation?
- [ ] If adding new dependencies to the code, are these dependencies
licensed in a way that is compatible for inclusion under [ASF
2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`,
`NOTICE-binary` files?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 727009)
Remaining Estimate: 0h
Time Spent: 10m
> Make DataNodePeerMetrics#LOW_THRESHOLD_MS and MIN_OUTLIER_DETECTION_NODES
> configurable
> --------------------------------------------------------------------------------------
>
> Key: HDFS-15745
> URL: https://issues.apache.org/jira/browse/HDFS-15745
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Haibin Huang
> Assignee: Haibin Huang
> Priority: Major
> Fix For: 3.4.0
>
> Attachments: HDFS-15745-001.patch, HDFS-15745-002.patch,
> HDFS-15745-003.patch, HDFS-15745-branch-3.1.001.patch,
> HDFS-15745-branch-3.2.001.patch, HDFS-15745-branch-3.3.001.patch,
> image-2020-12-22-17-00-50-796.png
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> When i enable DataNodePeerMetrics to find slow slow peer in cluster, i found
> there is a lot of slow peer but ReportingNodes's averageDelay is very low,
> and these slow peer node are normal. I think the reason of why generating so
> many slow peer is that the value of DataNodePeerMetrics#LOW_THRESHOLD_MS is
> too small (only 5ms) and it is not configurable. The default value of slow io
> warning log threshold is 300ms, i.e.
> DFSConfigKeys.DFS_DATANODE_SLOW_IO_WARNING_THRESHOLD_DEFAULT = 300, so
> DataNodePeerMetrics#LOW_THRESHOLD_MS should not be less than 300ms, otherwise
> namenode will get a lot of invalid slow peer information.
> !image-2020-12-22-17-00-50-796.png!
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
