[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-18 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17365399#comment-17365399 ] Haibin Huang commented on HDFS-13671: - [~zhaojk] I will cherry-pick to branch 3.1 later, you can just

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-18 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17365319#comment-17365319 ] Haibin Huang commented on HDFS-13671: - [~tomscut] there are 2 blocks in one disk and each

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-18 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17365296#comment-17365296 ] Haibin Huang commented on HDFS-13671: - [~tomscut] You are right, it will affect the performance of 

[jira] [Updated] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-18 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-13671: Attachment: image-2021-06-18-15-47-04-037.png > Namenode deletes large dir slowly caused by

[jira] [Updated] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-18 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-13671: Attachment: image-2021-06-18-15-46-46-052.png > Namenode deletes large dir slowly caused by

[jira] [Updated] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-10 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-13671: Attachment: image-2021-06-10-19-28-58-359.png > Namenode deletes large dir slowly caused by

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-10 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17360763#comment-17360763 ] Haibin Huang commented on HDFS-13671: - We apply this patch in our company's cluster which has over

[jira] [Updated] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-10 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-13671: Attachment: image-2021-06-10-19-28-18-373.png > Namenode deletes large dir slowly caused by

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-02 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355679#comment-17355679 ] Haibin Huang commented on HDFS-13671: - Thanks [~ferhui] 's reminding, i have update the PR, and the

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-01 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355019#comment-17355019 ] Haibin Huang commented on HDFS-13671: - Thanks [~ferhui], i have created a new PR

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-05-24 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350752#comment-17350752 ] Haibin Huang commented on HDFS-13671: - [^HDFS-13671-001.patch] is based on 

[jira] [Updated] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-05-24 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-13671: Attachment: HDFS-13671-001.patch > Namenode deletes large dir slowly caused by

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-05-19 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347348#comment-17347348 ] Haibin Huang commented on HDFS-13671: - Thanks [~ferhui] and [~LiJinglun] involving me here, i will

[jira] [Commented] (HDFS-15745) Make DataNodePeerMetrics#LOW_THRESHOLD_MS and MIN_OUTLIER_DETECTION_NODES configurable

2021-03-26 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309362#comment-17309362 ] Haibin Huang commented on HDFS-15745: - Thanks [~prasad-acit] for comment, i have update this patch

[jira] [Updated] (HDFS-15745) Make DataNodePeerMetrics#LOW_THRESHOLD_MS and MIN_OUTLIER_DETECTION_NODES configurable

2021-03-26 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15745: Attachment: HDFS-15745-branch-3.3.001.patch HDFS-15745-branch-3.2.001.patch

[jira] [Commented] (HDFS-15744) Use cumulative counting way to improve the accuracy of slow disk detection

2021-01-20 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268996#comment-17268996 ] Haibin Huang commented on HDFS-15744: - [~ayushtkn] [~aajisaka] [~elgoiri] [~hexiaoqiao] would you

[jira] [Commented] (HDFS-15666) add average latency information to the SlowPeerReport

2021-01-20 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268985#comment-17268985 ] Haibin Huang commented on HDFS-15666: - [~ayushtkn] [~aajisaka] [~elgoiri] [~hexiaoqiao] would you

[jira] [Commented] (HDFS-15758) Fix typos in MutableMetric

2021-01-14 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265667#comment-17265667 ] Haibin Huang commented on HDFS-15758: - [~ayushtkn] would you mind take a look at this? > Fix typos

[jira] [Updated] (HDFS-15758) Fix typos in MutableMetric

2021-01-03 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15758: Status: Patch Available (was: Open) > Fix typos in MutableMetric > -- > >

[jira] [Updated] (HDFS-15758) Fix typos in MutableMetric

2021-01-03 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15758: Attachment: HDFS-15758-001.patch > Fix typos in MutableMetric > -- > >

[jira] [Updated] (HDFS-15758) Fix typos in MutableMetric

2021-01-03 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15758: Priority: Minor (was: Major) > Fix typos in MutableMetric > -- > >

[jira] [Created] (HDFS-15758) Fix typos in MutableMetric

2021-01-03 Thread Haibin Huang (Jira)
Haibin Huang created HDFS-15758: --- Summary: Fix typos in MutableMetric Key: HDFS-15758 URL: https://issues.apache.org/jira/browse/HDFS-15758 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-15745) Make DataNodePeerMetrics#LOW_THRESHOLD_MS and MIN_OUTLIER_DETECTION_NODES configurable

2020-12-31 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257080#comment-17257080 ] Haibin Huang commented on HDFS-15745: - Thanx [~ayushtkn], i have updated the patch. > Make

[jira] [Updated] (HDFS-15745) Make DataNodePeerMetrics#LOW_THRESHOLD_MS and MIN_OUTLIER_DETECTION_NODES configurable

2020-12-31 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15745: Attachment: HDFS-15745-003.patch > Make DataNodePeerMetrics#LOW_THRESHOLD_MS and

[jira] [Commented] (HDFS-15745) Make DataNodePeerMetrics#LOW_THRESHOLD_MS and MIN_OUTLIER_DETECTION_NODES configurable

2020-12-31 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256966#comment-17256966 ] Haibin Huang commented on HDFS-15745: - Thanks [~ayushtkn] for review, i have update the patch, take a

[jira] [Updated] (HDFS-15745) Make DataNodePeerMetrics#LOW_THRESHOLD_MS and MIN_OUTLIER_DETECTION_NODES configurable

2020-12-31 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15745: Attachment: HDFS-15745-002.patch > Make DataNodePeerMetrics#LOW_THRESHOLD_MS and

[jira] [Updated] (HDFS-14789) namenode should avoid slow node while chooseTarget in BlockPlacementPolicyDefault

2020-12-22 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14789: Attachment: image-2020-12-22-22-15-17-703.png > namenode should avoid slow node while chooseTarget

[jira] [Updated] (HDFS-14789) namenode should avoid slow node while chooseTarget in BlockPlacementPolicyDefault

2020-12-22 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14789: Description: With HDFS-11194 and HDFS-11551, namenode can show SlowPeersReport and

[jira] [Updated] (HDFS-14789) namenode should avoid slow node while chooseTarget in BlockPlacementPolicyDefault

2020-12-22 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14789: Attachment: HDFS-14789-001.patch > namenode should avoid slow node while chooseTarget in >

[jira] [Updated] (HDFS-14789) namenode should avoid slow node while chooseTarget in BlockPlacementPolicyDefault

2020-12-22 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14789: Summary: namenode should avoid slow node while chooseTarget in BlockPlacementPolicyDefault (was:

[jira] [Updated] (HDFS-14789) namenode should avoid slow node when choose target in BlockPlacementPolicyDefault

2020-12-22 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14789: Description: With HDFS-11194 and HDFS-11551, namenode can show SlowPeersReport and

[jira] [Updated] (HDFS-14789) namenode should avoid slow node when choose target in BlockPlacementPolicyDefault

2020-12-22 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14789: Description: With HDFS-11194 and HDFS-11551, namenode can show SlowPeersReport and

[jira] [Updated] (HDFS-14789) namenode should avoid slow node when choose target in BlockPlacementPolicyDefault

2020-12-22 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14789: Summary: namenode should avoid slow node when choose target in BlockPlacementPolicyDefault (was:

[jira] [Updated] (HDFS-15745) Make DataNodePeerMetrics#LOW_THRESHOLD_MS and MIN_OUTLIER_DETECTION_NODES configurable

2020-12-22 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15745: Attachment: HDFS-15745-001.patch Status: Patch Available (was: Open) > Make

[jira] [Created] (HDFS-15745) Make DataNodePeerMetrics#LOW_THRESHOLD_MS and MIN_OUTLIER_DETECTION_NODES configurable

2020-12-22 Thread Haibin Huang (Jira)
Haibin Huang created HDFS-15745: --- Summary: Make DataNodePeerMetrics#LOW_THRESHOLD_MS and MIN_OUTLIER_DETECTION_NODES configurable Key: HDFS-15745 URL: https://issues.apache.org/jira/browse/HDFS-15745

[jira] [Updated] (HDFS-15744) Use cumulative counting way to improve the accuracy of slow disk detection

2020-12-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15744: Status: Patch Available (was: Open) > Use cumulative counting way to improve the accuracy of slow

[jira] [Updated] (HDFS-15744) Use cumulative counting way to improve the accuracy of slow disk detection

2020-12-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15744: Attachment: HDFS-15744-001.patch > Use cumulative counting way to improve the accuracy of slow

[jira] [Updated] (HDFS-15744) Use cumulative counting way to improve the accuracy of slow disk detection

2020-12-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15744: Description: Hdfs has supported the datanode disk outlier detection in

[jira] [Updated] (HDFS-15744) Use cumulative counting way to improve the accuracy of slow disk detection

2020-12-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15744: Description: Hdfs has supported the datanode disk outlier detection in

[jira] [Updated] (HDFS-15744) Use cumulative counting way to improve the accuracy of slow disk detection

2020-12-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15744: Description: [11461|https://issues.apache.org/jira/browse/HDFS-11461]11461 support the datanode

[jira] [Updated] (HDFS-15744) Use cumulative counting way to improve the accuracy of slow disk detection

2020-12-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15744: Description: 11461 support the datanode disk outlier detection, we can use it to find out slow

[jira] [Created] (HDFS-15744) Use cumulative counting way to improve the accuracy of slow disk detection

2020-12-21 Thread Haibin Huang (Jira)
Haibin Huang created HDFS-15744: --- Summary: Use cumulative counting way to improve the accuracy of slow disk detection Key: HDFS-15744 URL: https://issues.apache.org/jira/browse/HDFS-15744 Project:

[jira] [Updated] (HDFS-15666) add average latency information to the SlowPeerReport

2020-12-20 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15666: Attachment: HDFS-15666-004.patch > add average latency information to the SlowPeerReport >

[jira] [Updated] (HDFS-15666) add average latency information to the SlowPeerReport

2020-12-20 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15666: Attachment: HDFS-15666-003.patch > add average latency information to the SlowPeerReport >

[jira] [Commented] (HDFS-15733) Add seqno in log when BlockReceiver receive packet

2020-12-18 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251761#comment-17251761 ] Haibin Huang commented on HDFS-15733: - Thanks [~elgoiri] for comment, i have updated the patch, now

[jira] [Updated] (HDFS-15733) Add seqno in log when BlockReceiver receive packet

2020-12-18 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15733: Attachment: HDFS-15733-002.patch > Add seqno in log when BlockReceiver receive packet >

[jira] [Updated] (HDFS-15666) add average latency information to the SlowPeerReport

2020-12-17 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15666: Attachment: HDFS-15666.002.patch > add average latency information to the SlowPeerReport >

[jira] [Updated] (HDFS-15733) Add seqno in log when BlockReceiver receive packet

2020-12-17 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15733: Attachment: HDFS-15733-001.patch > Add seqno in log when BlockReceiver receive packet >

[jira] [Updated] (HDFS-15733) Add seqno in log when BlockReceiver receive packet

2020-12-17 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15733: Status: Patch Available (was: Open) > Add seqno in log when BlockReceiver receive packet >

[jira] [Created] (HDFS-15733) Add seqno in log when BlockReceiver receive packet

2020-12-17 Thread Haibin Huang (Jira)
Haibin Huang created HDFS-15733: --- Summary: Add seqno in log when BlockReceiver receive packet Key: HDFS-15733 URL: https://issues.apache.org/jira/browse/HDFS-15733 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-15666) add average latency information to the SlowPeerReport

2020-11-04 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15666: Attachment: HDFS-15666.001.patch > add average latency information to the SlowPeerReport >

[jira] [Updated] (HDFS-15666) add average latency information to the SlowPeerReport

2020-11-04 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15666: Status: Patch Available (was: Open) > add average latency information to the SlowPeerReport >

[jira] [Updated] (HDFS-15666) add average latency information to the SlowPeerReport

2020-11-04 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15666: Description: In namenode's jmx, there is a SlowDisksReport like this: {code:java}

[jira] [Updated] (HDFS-15666) add average latency information to the SlowPeerReport

2020-11-04 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15666: Description: In namenode's jmx, there is a SlowDisksReport like this: {code:java}

[jira] [Updated] (HDFS-15666) add average latency information to the SlowPeerReport

2020-11-04 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15666: Description: In namenode's jmx, there is a SlowDisksReport like this: {code:java}

[jira] [Created] (HDFS-15666) add average latency information to the SlowPeerReport

2020-11-04 Thread Haibin Huang (Jira)
Haibin Huang created HDFS-15666: --- Summary: add average latency information to the SlowPeerReport Key: HDFS-15666 URL: https://issues.apache.org/jira/browse/HDFS-15666 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15629) Add seqno when warning slow mirror/disk in BlockReceiver

2020-10-13 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15629: Assignee: Haibin Huang Status: Patch Available (was: Open) > Add seqno when warning slow

[jira] [Updated] (HDFS-15629) Add seqno when warning slow mirror/disk in BlockReceiver

2020-10-13 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15629: Attachment: HDFS-15629-001.patch > Add seqno when warning slow mirror/disk in BlockReceiver >

[jira] [Updated] (HDFS-15629) Add seqno when warning slow mirror/disk in BlockReceiver

2020-10-13 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15629: Description: When client write slow, it will print a slow log from DataStreamer {code:java} if

[jira] [Created] (HDFS-15629) Add seqno when warning slow mirror/disk in BlockReceiver

2020-10-13 Thread Haibin Huang (Jira)
Haibin Huang created HDFS-15629: --- Summary: Add seqno when warning slow mirror/disk in BlockReceiver Key: HDFS-15629 URL: https://issues.apache.org/jira/browse/HDFS-15629 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-15257) Fix spelling mistake in DataXceiverServer

2020-04-02 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang resolved HDFS-15257. - Resolution: Fixed > Fix spelling mistake in DataXceiverServer >

[jira] [Updated] (HDFS-15257) Fix spelling mistake in DataXceiverServer

2020-04-02 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15257: Status: Open (was: Patch Available) > Fix spelling mistake in DataXceiverServer >

[jira] [Updated] (HDFS-15257) Fix spelling mistake in DataXceiverServer

2020-04-02 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15257: Attachment: HDFS-15257-001.patch > Fix spelling mistake in DataXceiverServer >

[jira] [Updated] (HDFS-15257) Fix spelling mistake in DataXceiverServer

2020-04-02 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15257: Status: Patch Available (was: Open) > Fix spelling mistake in DataXceiverServer >

[jira] [Created] (HDFS-15257) Fix spelling mistake in DataXceiverServer

2020-04-02 Thread Haibin Huang (Jira)
Haibin Huang created HDFS-15257: --- Summary: Fix spelling mistake in DataXceiverServer Key: HDFS-15257 URL: https://issues.apache.org/jira/browse/HDFS-15257 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-14783) Expired SampleStat should ignore when generating SlowPeersReport

2020-03-29 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Description: SlowPeersReport is generated by the SampleStat between tow dn, so it can present on

[jira] [Commented] (HDFS-14783) Expired SampleStat should ignore when generating SlowPeersReport

2020-03-29 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070685#comment-17070685 ] Haibin Huang commented on HDFS-14783: - Thanks [~elgoiri], i have update the title and description, if 

[jira] [Updated] (HDFS-14783) Expired SampleStat should ignore when generating SlowPeersReport

2020-03-29 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Description: SlowPeersReport is generated by the SampleStat between tow dn, so it can present on

[jira] [Updated] (HDFS-14783) Expired SampleStat should ignore when generating SlowPeersReport

2020-03-29 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Description: SlowPeersReport is generated by the SampleStat between tow dn, so it can present on

[jira] [Updated] (HDFS-14783) Expired SampleStat should ignore when generating SlowPeersReport

2020-03-29 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Description: SlowPeersReport is generated by the SampleStat between tow dn, so it can present on

[jira] [Updated] (HDFS-14783) Expired SampleStat should ignore when generating SlowPeersReport

2020-03-29 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Description: SlowPeersReport is calculated by the SampleStat between tow dn, so it can present on

[jira] [Updated] (HDFS-14783) Expired SampleStat should ignore when generating SlowPeersReport

2020-03-29 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Summary: Expired SampleStat should ignore when generating SlowPeersReport (was: Expired

[jira] [Commented] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-25 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066638#comment-17066638 ] Haibin Huang commented on HDFS-14783: - Thanks [~elgoiri], can this patch commit to trunk, or need

[jira] [Commented] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-22 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064491#comment-17064491 ] Haibin Huang commented on HDFS-14783: - [~elgoiri], i'm sorry, the newest patch is 

[jira] [Commented] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064157#comment-17064157 ] Haibin Huang commented on HDFS-14783: - [~elgoiri] thakns for suggestion, i have updated the patch,

[jira] [Updated] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Attachment: HDFS-14783-005.patch > Expired SampleStat needs to be removed from SlowPeersReport >

[jira] [Comment Edited] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063802#comment-17063802 ] Haibin Huang edited comment on HDFS-14783 at 3/21/20, 7:28 AM: --- Thanks

[jira] [Commented] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063802#comment-17063802 ] Haibin Huang commented on HDFS-14783: - Thanks [~elgoiri] for suggestion, i think changing the

[jira] [Updated] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Attachment: HDFS-14783-004.patch > Expired SampleStat needs to be removed from SlowPeersReport >

[jira] [Commented] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-17 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060902#comment-17060902 ] Haibin Huang commented on HDFS-14783: - update patch, fix bug and checkstyle > expired SampleStat

[jira] [Updated] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-17 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Attachment: HDFS-14783-003.patch > expired SampleStat need to be removed from SlowPeersReport >

[jira] [Commented] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-16 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060623#comment-17060623 ] Haibin Huang commented on HDFS-14783: - [~ayushtkn] [~elgoiri] , can you take a look for this, thanks.

[jira] [Updated] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-16 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Description: SlowPeersReport is calculated by the SampleStat between tow dn, so it can present on

[jira] [Updated] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-16 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Attachment: HDFS-14783-002.patch > expired SampleStat need to be removed from SlowPeersReport >

[jira] [Updated] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-16 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Summary: expired SampleStat need to be removed from SlowPeersReport (was: expired SlowPeersReport

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-12 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058374#comment-17058374 ] Haibin Huang commented on HDFS-15155: - [~ayushtkn], you are right, it can directly use {code:java}

[jira] [Updated] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-12 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15155: Attachment: HDFS-15155.005.patch > writeIoRate of DataNodeVolumeMetrics is never used >

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-12 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058357#comment-17058357 ] Haibin Huang commented on HDFS-15155: - [~elgoiri], can this patch commit to trunk? > writeIoRate of

[jira] [Commented] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-10 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056599#comment-17056599 ] Haibin Huang commented on HDFS-14612: - [~elgoiri]  [~hanishakoneru] , I have updated the test part,

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-10 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14612: Attachment: HDFS-14612-008.patch > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Commented] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-09 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055005#comment-17055005 ] Haibin Huang commented on HDFS-14612: - [~elgoiri], how about the patch v7, when nn handle the new

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-09 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14612: Attachment: HDFS-14612-007.patch > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Commented] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-05 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052683#comment-17052683 ] Haibin Huang commented on HDFS-14612: - [~ayushtkn] [~elgoiri] would you please review this patch?  >

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-05 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14612: Description: I found SlowDiskReport won't update when slowDisks is always empty in

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-05 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14612: Attachment: HDFS-14612-006.patch > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Updated] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-04 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15155: Attachment: HDFS-15155.004.patch > writeIoRate of DataNodeVolumeMetrics is never used >

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-03 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050193#comment-17050193 ] Haibin Huang commented on HDFS-15155: - [~elgoiri] I have updated the patch. Please review it. >

[jira] [Updated] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-03 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15155: Attachment: HDFS-15155.003.patch > writeIoRate of DataNodeVolumeMetrics is never used >

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047182#comment-17047182 ] Haibin Huang commented on HDFS-15155: - Ok, i will update the patch soon > writeIoRate of

[jira] [Comment Edited] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047171#comment-17047171 ] Haibin Huang edited comment on HDFS-15155 at 2/28/20 3:05 AM: -- [~elgoiri] 

  1   2   >