[
https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-14789:
Summary: namenode should avoid slow node when choose target in
BlockPlacementPolicyDefault (was:
[
https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-14789:
Description:
With HDFS-11194 and HDFS-11551, namenode can show SlowPeersReport and
[
https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-14789:
Attachment: HDFS-14789-001.patch
> namenode should avoid slow node while chooseTarget in
>
[
https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-14789:
Description:
With HDFS-11194 and HDFS-11551, namenode can show SlowPeersReport and
[
https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-14789:
Summary: namenode should avoid slow node while chooseTarget in
BlockPlacementPolicyDefault (was:
[
https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-14789:
Description:
With HDFS-11194 and HDFS-11551, namenode can show SlowPeersReport and
Haibin Huang created HDFS-15744:
---
Summary: Use cumulative counting way to improve the accuracy of
slow disk detection
Key: HDFS-15744
URL: https://issues.apache.org/jira/browse/HDFS-15744
Project:
[
https://issues.apache.org/jira/browse/HDFS-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15744:
Description:
Hdfs has supported the datanode disk outlier detection in
[
https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15745:
Attachment: HDFS-15745-001.patch
Status: Patch Available (was: Open)
> Make
[
https://issues.apache.org/jira/browse/HDFS-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15744:
Description:
11461 support the datanode disk outlier detection, we can use it to find out
slow
[
https://issues.apache.org/jira/browse/HDFS-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15744:
Description:
[11461|https://issues.apache.org/jira/browse/HDFS-11461]11461 support the
datanode
[
https://issues.apache.org/jira/browse/HDFS-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15744:
Status: Patch Available (was: Open)
> Use cumulative counting way to improve the accuracy of slow
Haibin Huang created HDFS-15745:
---
Summary: Make DataNodePeerMetrics#LOW_THRESHOLD_MS and
MIN_OUTLIER_DETECTION_NODES configurable
Key: HDFS-15745
URL: https://issues.apache.org/jira/browse/HDFS-15745
[
https://issues.apache.org/jira/browse/HDFS-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15744:
Attachment: HDFS-15744-001.patch
> Use cumulative counting way to improve the accuracy of slow
[
https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15666:
Attachment: HDFS-15666-003.patch
> add average latency information to the SlowPeerReport
>
[
https://issues.apache.org/jira/browse/HDFS-15733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251761#comment-17251761
]
Haibin Huang commented on HDFS-15733:
-
Thanks [~elgoiri] for comment, i have updated the patch, now
[
https://issues.apache.org/jira/browse/HDFS-15733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15733:
Attachment: HDFS-15733-002.patch
> Add seqno in log when BlockReceiver receive packet
>
[
https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15666:
Description:
In namenode's jmx, there is a SlowDisksReport like this:
{code:java}
[
https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15666:
Description:
In namenode's jmx, there is a SlowDisksReport like this:
{code:java}
[
https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15666:
Description:
In namenode's jmx, there is a SlowDisksReport like this:
{code:java}
Haibin Huang created HDFS-15666:
---
Summary: add average latency information to the SlowPeerReport
Key: HDFS-15666
URL: https://issues.apache.org/jira/browse/HDFS-15666
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15666:
Attachment: HDFS-15666.001.patch
> add average latency information to the SlowPeerReport
>
[
https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15666:
Status: Patch Available (was: Open)
> add average latency information to the SlowPeerReport
>
[
https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256966#comment-17256966
]
Haibin Huang commented on HDFS-15745:
-
Thanks [~ayushtkn] for review, i have update the patch, take a
[
https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15745:
Attachment: HDFS-15745-002.patch
> Make DataNodePeerMetrics#LOW_THRESHOLD_MS and
[
https://issues.apache.org/jira/browse/HDFS-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268996#comment-17268996
]
Haibin Huang commented on HDFS-15744:
-
[~ayushtkn] [~aajisaka] [~elgoiri] [~hexiaoqiao] would you
[
https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268985#comment-17268985
]
Haibin Huang commented on HDFS-15666:
-
[~ayushtkn] [~aajisaka] [~elgoiri] [~hexiaoqiao] would you
[
https://issues.apache.org/jira/browse/HDFS-15758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265667#comment-17265667
]
Haibin Huang commented on HDFS-15758:
-
[~ayushtkn] would you mind take a look at this?
> Fix typos
[
https://issues.apache.org/jira/browse/HDFS-15758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15758:
Priority: Minor (was: Major)
> Fix typos in MutableMetric
> --
>
>
Haibin Huang created HDFS-15758:
---
Summary: Fix typos in MutableMetric
Key: HDFS-15758
URL: https://issues.apache.org/jira/browse/HDFS-15758
Project: Hadoop HDFS
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HDFS-15758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15758:
Status: Patch Available (was: Open)
> Fix typos in MutableMetric
> --
>
>
[
https://issues.apache.org/jira/browse/HDFS-15758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15758:
Attachment: HDFS-15758-001.patch
> Fix typos in MutableMetric
> --
>
>
[
https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15745:
Attachment: HDFS-15745-003.patch
> Make DataNodePeerMetrics#LOW_THRESHOLD_MS and
[
https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257080#comment-17257080
]
Haibin Huang commented on HDFS-15745:
-
Thanx [~ayushtkn], i have updated the patch.
> Make
[
https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-13671:
Attachment: image-2021-06-10-19-28-18-373.png
> Namenode deletes large dir slowly caused by
[
https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17360763#comment-17360763
]
Haibin Huang commented on HDFS-13671:
-
We apply this patch in our company's cluster which has over
[
https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-13671:
Attachment: image-2021-06-10-19-28-58-359.png
> Namenode deletes large dir slowly caused by
[
https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-13671:
Attachment: image-2021-06-18-15-47-04-037.png
> Namenode deletes large dir slowly caused by
[
https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-13671:
Attachment: image-2021-06-18-15-46-46-052.png
> Namenode deletes large dir slowly caused by
[
https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17365319#comment-17365319
]
Haibin Huang commented on HDFS-13671:
-
[~tomscut] there are 2 blocks in one disk and each
[
https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17365399#comment-17365399
]
Haibin Huang commented on HDFS-13671:
-
[~zhaojk] I will cherry-pick to branch 3.1 later, you can just
[
https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17365296#comment-17365296
]
Haibin Huang commented on HDFS-13671:
-
[~tomscut] You are right, it will affect the performance of
[
https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347348#comment-17347348
]
Haibin Huang commented on HDFS-13671:
-
Thanks [~ferhui] and [~LiJinglun] involving me here, i will
[
https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350752#comment-17350752
]
Haibin Huang commented on HDFS-13671:
-
[^HDFS-13671-001.patch] is based on
[
https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-13671:
Attachment: HDFS-13671-001.patch
> Namenode deletes large dir slowly caused by
[
https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355679#comment-17355679
]
Haibin Huang commented on HDFS-13671:
-
Thanks [~ferhui] 's reminding, i have update the PR, and the
[
https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355019#comment-17355019
]
Haibin Huang commented on HDFS-13671:
-
Thanks [~ferhui], i have created a new PR
[
https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haibin Huang updated HDFS-15745:
Attachment: HDFS-15745-branch-3.3.001.patch
HDFS-15745-branch-3.2.001.patch
[
https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309362#comment-17309362
]
Haibin Huang commented on HDFS-15745:
-
Thanks [~prasad-acit] for comment, i have update this patch
101 - 149 of 149 matches
Mail list logo
