[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2019-06-27 Thread HaiBin Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14612: Attachment: HDFS-14612-001.patch > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2019-06-27 Thread HaiBin Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14612: Description: I found SlowDiskReport won't update when slowDisks is always empty in

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2019-06-27 Thread HaiBin Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14612: Hadoop Flags: (was: Reviewed) > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Created] (HDFS-14780) make the information of SlowPeersReport in namenode's jmx more specific

2019-08-27 Thread HaiBin Huang (Jira)
HaiBin Huang created HDFS-14780: --- Summary: make the information of SlowPeersReport in namenode's jmx more specific Key: HDFS-14780 URL: https://issues.apache.org/jira/browse/HDFS-14780 Project: Hadoop

[jira] [Updated] (HDFS-14780) make the information of SlowPeersReport in namenode's jmx more specific

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14780: Description: I found  > make the information of SlowPeersReport in namenode's jmx more specific >

[jira] [Updated] (HDFS-14780) make the information of SlowPeersReport in namenode's jmx more specific

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14780: Description: I found the information of  (was: I found ) > make the information of

[jira] [Updated] (HDFS-14780) make the information of SlowPeersReport in namenode's jmx more specific

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14780: Description: I found *SlowPeersReport* in namenode's jmx is too simple, so i make an  inner class

[jira] [Updated] (HDFS-14780) make the information of SlowPeersReport in namenode's jmx more specific

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14780: Description: I found the information of *SlowPeersReport* in namenode's jmx is too simple, so i

[jira] [Updated] (HDFS-14780) make the information of SlowPeersReport in namenode's jmx more specific

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14780: Attachment: (was: HDFS-14780) > make the information of SlowPeersReport in namenode's jmx more

[jira] [Updated] (HDFS-14780) make the information of SlowPeersReport in namenode's jmx more specific

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14780: Attachment: HDFS-14780 Status: Patch Available (was: Open) > make the information of

[jira] [Created] (HDFS-14783) expired SlowPeersReport will keep staying on namenode's jmx

2019-08-27 Thread HaiBin Huang (Jira)
HaiBin Huang created HDFS-14783: --- Summary: expired SlowPeersReport will keep staying on namenode's jmx Key: HDFS-14783 URL: https://issues.apache.org/jira/browse/HDFS-14783 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14783) expired SlowPeersReport will keep staying on namenode's jmx

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14783: Description: I found  > expired SlowPeersReport will keep staying on namenode's jmx >

[jira] [Updated] (HDFS-14783) expired SlowPeersReport will keep staying on namenode's jmx

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14783: Description: (was: I found expired SlowPeersReport will keep staying on namenode's jmx, which

[jira] [Updated] (HDFS-14783) expired SlowPeersReport will keep staying on namenode's jmx

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14783: Attachment: HDFS-14783 > expired SlowPeersReport will keep staying on namenode's jmx >

[jira] [Updated] (HDFS-14783) expired SlowPeersReport will keep staying on namenode's jmx

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14783: Description: I found expired SlowPeersReport will keep staying on namenode's jmx, which means if 

[jira] [Updated] (HDFS-14783) expired SlowPeersReport will keep staying on namenode's jmx

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14783: Description: SlowPeersReport in namenode's jmx can tell us which datanode is slow node, and it is 

[jira] [Assigned] (HDFS-14783) expired SlowPeersReport will keep staying on namenode's jmx

2019-08-28 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang reassigned HDFS-14783: --- Assignee: HaiBin Huang > expired SlowPeersReport will keep staying on namenode's jmx >

[jira] [Updated] (HDFS-14783) expired SlowPeersReport will keep staying on namenode's jmx

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14783: Description: SlowPeersReport in namenode's jmx can tell us which datanode is slow node, and it is 

[jira] [Updated] (HDFS-14783) expired SlowPeersReport will keep staying on namenode's jmx

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14783: Attachment: (was: HDFS-14783) > expired SlowPeersReport will keep staying on namenode's jmx >

[jira] [Updated] (HDFS-14783) expired SlowPeersReport will keep staying on namenode's jmx

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14783: Attachment: HDFS-14783 Status: Patch Available (was: Open) > expired SlowPeersReport will

[jira] [Updated] (HDFS-14783) expired SlowPeersReport will keep staying on namenode's jmx

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14783: Component/s: (was: hdfs) > expired SlowPeersReport will keep staying on namenode's jmx >

[jira] [Created] (HDFS-14789) namenode should check slow node when assigning a node for writing block

2019-08-28 Thread HaiBin Huang (Jira)
HaiBin Huang created HDFS-14789: --- Summary: namenode should check slow node when assigning a node for writing block Key: HDFS-14789 URL: https://issues.apache.org/jira/browse/HDFS-14789 Project: Hadoop

[jira] [Updated] (HDFS-14789) namenode should check slow node when assigning a node for writing block

2019-08-28 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14789: Description: With[  HDFS-11194|https://issues.apache.org/jira/browse/HDFS-11194] and 

[jira] [Updated] (HDFS-14789) namenode should check slow node when assigning a node for writing block

2019-08-28 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14789: Attachment: HDFS-14789 Status: Patch Available (was: Open) > namenode should check slow

[jira] [Updated] (HDFS-14789) namenode should check slow node when assigning a node for writing block

2019-08-28 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14789: Description: With HDFS-11194 and HDFS-11551, we can find slow node through namenode's jmx. So i

[jira] [Updated] (HDFS-14780) make the information of SlowPeersReport in namenode's jmx more specific

2019-08-27 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14780: Attachment: HDFS-14780 > make the information of SlowPeersReport in namenode's jmx more specific >

[jira] [Created] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2019-06-27 Thread HaiBin Huang (JIRA)
HaiBin Huang created HDFS-14612: --- Summary: SlowDiskReport won't update when SlowDisks is always empty in heartbeat Key: HDFS-14612 URL: https://issues.apache.org/jira/browse/HDFS-14612 Project: Hadoop

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2019-06-27 Thread HaiBin Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14612: Description: I found SlowDiskReport won't update when slowDisks is always empty in

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2019-06-27 Thread HaiBin Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14612: Attachment: HDFS-14612.patch > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2019-06-27 Thread HaiBin Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14612: Attachment: (was: HDFS-14612.patch) > SlowDiskReport won't update when SlowDisks is always

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2019-06-27 Thread HaiBin Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14612: Hadoop Flags: Reviewed Attachment: HDFS-14612.patch Status: Patch Available (was:

[jira] [Commented] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2019-11-12 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972486#comment-16972486 ] Haibin Huang commented on HDFS-14612: - [~weichiu],i have update this patch, would you help review it?

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2019-11-12 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14612: Attachment: HDFS-14612-005.patch > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2019-10-11 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14612: Attachment: HDFS-14612-003.patch > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Commented] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2019-10-10 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949074#comment-16949074 ] HaiBin Huang commented on HDFS-14612: - update patch v2, add a new test > SlowDiskReport won't update

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2019-10-10 Thread HaiBin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiBin Huang updated HDFS-14612: Attachment: HDFS-14612-002.patch > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Updated] (HDFS-14780) add ReportingNode to make the information of SlowPeersReport in namenode's jmx more specific

2019-10-11 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14780: Summary: add ReportingNode to make the information of SlowPeersReport in namenode's jmx more

[jira] [Updated] (HDFS-14780) add ReportingNode to make the information of SlowPeersReport in namenode's jmx more specific

2019-10-11 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14780: Attachment: HDFS-14780.001.patch > add ReportingNode to make the information of SlowPeersReport in

[jira] [Comment Edited] (HDFS-14780) add ReportingNode to make the information of SlowPeersReport in namenode's jmx more specific

2019-10-11 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949292#comment-16949292 ] Haibin Huang edited comment on HDFS-14780 at 10/11/19 9:00 AM: --- update

[jira] [Commented] (HDFS-14780) add ReportingNode to make the information of SlowPeersReport in namenode's jmx more specific

2019-10-11 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949292#comment-16949292 ] Haibin Huang commented on HDFS-14780: - updata patch ,add a new test > add ReportingNode to make the

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2019-10-11 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14612: Attachment: HDFS-14612-004.patch > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Commented] (HDFS-14783) expired SlowPeersReport will keep staying on namenode's jmx

2019-10-11 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949410#comment-16949410 ] Haibin Huang commented on HDFS-14783: - update patch ,add a new test > expired SlowPeersReport will

[jira] [Updated] (HDFS-14783) expired SlowPeersReport will keep staying on namenode's jmx

2019-10-11 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Attachment: HDFS-14783-001.patch > expired SlowPeersReport will keep staying on namenode's jmx >

[jira] [Updated] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-04 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15155: Attachment: HDFS-15155.004.patch > writeIoRate of DataNodeVolumeMetrics is never used >

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-05 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14612: Attachment: HDFS-14612-006.patch > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-05 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14612: Description: I found SlowDiskReport won't update when slowDisks is always empty in

[jira] [Updated] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-03 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15155: Attachment: HDFS-15155.003.patch > writeIoRate of DataNodeVolumeMetrics is never used >

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-03 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050193#comment-17050193 ] Haibin Huang commented on HDFS-15155: - [~elgoiri] I have updated the patch. Please review it. >

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047171#comment-17047171 ] Haibin Huang commented on HDFS-15155: - I think TestDataNodeVolumeMetrics#testVolumeMetrics has

[jira] [Comment Edited] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047171#comment-17047171 ] Haibin Huang edited comment on HDFS-15155 at 2/28/20 3:05 AM: -- [~elgoiri] 

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047182#comment-17047182 ] Haibin Huang commented on HDFS-15155: - Ok, i will update the patch soon > writeIoRate of

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046809#comment-17046809 ] Haibin Huang commented on HDFS-15155: - [~elgoiri]  [~ayushtkn] , i have updated the patch, can you

[jira] [Updated] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15155: Attachment: HDFS-15155.002.patch > writeIoRate of DataNodeVolumeMetrics is never used >

[jira] [Commented] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-05 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052683#comment-17052683 ] Haibin Huang commented on HDFS-14612: - [~ayushtkn] [~elgoiri] would you please review this patch?  >

[jira] [Updated] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-06 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15155: Status: Patch Available (was: Open) > writeIoRate of DataNodeVolumeMetrics is never used >

[jira] [Created] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-06 Thread Haibin Huang (Jira)
Haibin Huang created HDFS-15155: --- Summary: writeIoRate of DataNodeVolumeMetrics is never used Key: HDFS-15155 URL: https://issues.apache.org/jira/browse/HDFS-15155 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-06 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15155: Attachment: HDFS-15155.001.patch > writeIoRate of DataNodeVolumeMetrics is never used >

[jira] [Commented] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-10 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056599#comment-17056599 ] Haibin Huang commented on HDFS-14612: - [~elgoiri]  [~hanishakoneru] , I have updated the test part,

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-10 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14612: Attachment: HDFS-14612-008.patch > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Commented] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-09 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055005#comment-17055005 ] Haibin Huang commented on HDFS-14612: - [~elgoiri], how about the patch v7, when nn handle the new

[jira] [Updated] (HDFS-14612) SlowDiskReport won't update when SlowDisks is always empty in heartbeat

2020-03-09 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14612: Attachment: HDFS-14612-007.patch > SlowDiskReport won't update when SlowDisks is always empty in

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-12 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058357#comment-17058357 ] Haibin Huang commented on HDFS-15155: - [~elgoiri], can this patch commit to trunk? > writeIoRate of

[jira] [Updated] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-12 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15155: Attachment: HDFS-15155.005.patch > writeIoRate of DataNodeVolumeMetrics is never used >

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-12 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058374#comment-17058374 ] Haibin Huang commented on HDFS-15155: - [~ayushtkn], you are right, it can directly use {code:java}

[jira] [Updated] (HDFS-15257) Fix spelling mistake in DataXceiverServer

2020-04-02 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15257: Attachment: HDFS-15257-001.patch > Fix spelling mistake in DataXceiverServer >

[jira] [Updated] (HDFS-15257) Fix spelling mistake in DataXceiverServer

2020-04-02 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15257: Status: Patch Available (was: Open) > Fix spelling mistake in DataXceiverServer >

[jira] [Updated] (HDFS-15257) Fix spelling mistake in DataXceiverServer

2020-04-02 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15257: Status: Open (was: Patch Available) > Fix spelling mistake in DataXceiverServer >

[jira] [Resolved] (HDFS-15257) Fix spelling mistake in DataXceiverServer

2020-04-02 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang resolved HDFS-15257. - Resolution: Fixed > Fix spelling mistake in DataXceiverServer >

[jira] [Updated] (HDFS-14783) Expired SampleStat should ignore when generating SlowPeersReport

2020-03-29 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Description: SlowPeersReport is generated by the SampleStat between tow dn, so it can present on

[jira] [Updated] (HDFS-14783) Expired SampleStat should ignore when generating SlowPeersReport

2020-03-29 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Description: SlowPeersReport is generated by the SampleStat between tow dn, so it can present on

[jira] [Updated] (HDFS-14783) Expired SampleStat should ignore when generating SlowPeersReport

2020-03-29 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Description: SlowPeersReport is calculated by the SampleStat between tow dn, so it can present on

[jira] [Updated] (HDFS-14783) Expired SampleStat should ignore when generating SlowPeersReport

2020-03-29 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Description: SlowPeersReport is generated by the SampleStat between tow dn, so it can present on

[jira] [Updated] (HDFS-14783) Expired SampleStat should ignore when generating SlowPeersReport

2020-03-29 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Description: SlowPeersReport is generated by the SampleStat between tow dn, so it can present on

[jira] [Updated] (HDFS-14783) Expired SampleStat should ignore when generating SlowPeersReport

2020-03-29 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Summary: Expired SampleStat should ignore when generating SlowPeersReport (was: Expired

[jira] [Commented] (HDFS-14783) Expired SampleStat should ignore when generating SlowPeersReport

2020-03-29 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070685#comment-17070685 ] Haibin Huang commented on HDFS-14783: - Thanks [~elgoiri], i have update the title and description, if 

[jira] [Created] (HDFS-15257) Fix spelling mistake in DataXceiverServer

2020-04-02 Thread Haibin Huang (Jira)
Haibin Huang created HDFS-15257: --- Summary: Fix spelling mistake in DataXceiverServer Key: HDFS-15257 URL: https://issues.apache.org/jira/browse/HDFS-15257 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-25 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066638#comment-17066638 ] Haibin Huang commented on HDFS-14783: - Thanks [~elgoiri], can this patch commit to trunk, or need

[jira] [Updated] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-17 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Attachment: HDFS-14783-003.patch > expired SampleStat need to be removed from SlowPeersReport >

[jira] [Commented] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-17 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060902#comment-17060902 ] Haibin Huang commented on HDFS-14783: - update patch, fix bug and checkstyle > expired SampleStat

[jira] [Commented] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063802#comment-17063802 ] Haibin Huang commented on HDFS-14783: - Thanks [~elgoiri] for suggestion, i think changing the

[jira] [Comment Edited] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063802#comment-17063802 ] Haibin Huang edited comment on HDFS-14783 at 3/21/20, 7:28 AM: --- Thanks

[jira] [Updated] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Attachment: HDFS-14783-004.patch > Expired SampleStat needs to be removed from SlowPeersReport >

[jira] [Commented] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064157#comment-17064157 ] Haibin Huang commented on HDFS-14783: - [~elgoiri] thakns for suggestion, i have updated the patch,

[jira] [Updated] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Attachment: HDFS-14783-005.patch > Expired SampleStat needs to be removed from SlowPeersReport >

[jira] [Commented] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-22 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064491#comment-17064491 ] Haibin Huang commented on HDFS-14783: - [~elgoiri], i'm sorry, the newest patch is 

[jira] [Commented] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-16 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060623#comment-17060623 ] Haibin Huang commented on HDFS-14783: - [~ayushtkn] [~elgoiri] , can you take a look for this, thanks.

[jira] [Updated] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-16 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Description: SlowPeersReport is calculated by the SampleStat between tow dn, so it can present on

[jira] [Updated] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-16 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Summary: expired SampleStat need to be removed from SlowPeersReport (was: expired SlowPeersReport

[jira] [Updated] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-16 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Attachment: HDFS-14783-002.patch > expired SampleStat need to be removed from SlowPeersReport >

[jira] [Updated] (HDFS-15629) Add seqno when warning slow mirror/disk in BlockReceiver

2020-10-13 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15629: Attachment: HDFS-15629-001.patch > Add seqno when warning slow mirror/disk in BlockReceiver >

[jira] [Updated] (HDFS-15629) Add seqno when warning slow mirror/disk in BlockReceiver

2020-10-13 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15629: Assignee: Haibin Huang Status: Patch Available (was: Open) > Add seqno when warning slow

[jira] [Created] (HDFS-15629) Add seqno when warning slow mirror/disk in BlockReceiver

2020-10-13 Thread Haibin Huang (Jira)
Haibin Huang created HDFS-15629: --- Summary: Add seqno when warning slow mirror/disk in BlockReceiver Key: HDFS-15629 URL: https://issues.apache.org/jira/browse/HDFS-15629 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15629) Add seqno when warning slow mirror/disk in BlockReceiver

2020-10-13 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15629: Description: When client write slow, it will print a slow log from DataStreamer {code:java} if

[jira] [Updated] (HDFS-15733) Add seqno in log when BlockReceiver receive packet

2020-12-17 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15733: Attachment: HDFS-15733-001.patch > Add seqno in log when BlockReceiver receive packet >

[jira] [Created] (HDFS-15733) Add seqno in log when BlockReceiver receive packet

2020-12-17 Thread Haibin Huang (Jira)
Haibin Huang created HDFS-15733: --- Summary: Add seqno in log when BlockReceiver receive packet Key: HDFS-15733 URL: https://issues.apache.org/jira/browse/HDFS-15733 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-15733) Add seqno in log when BlockReceiver receive packet

2020-12-17 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15733: Status: Patch Available (was: Open) > Add seqno in log when BlockReceiver receive packet >

[jira] [Updated] (HDFS-15666) add average latency information to the SlowPeerReport

2020-12-17 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15666: Attachment: HDFS-15666.002.patch > add average latency information to the SlowPeerReport >

[jira] [Updated] (HDFS-15666) add average latency information to the SlowPeerReport

2020-12-20 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15666: Attachment: HDFS-15666-004.patch > add average latency information to the SlowPeerReport >

[jira] [Updated] (HDFS-15744) Use cumulative counting way to improve the accuracy of slow disk detection

2020-12-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15744: Description: Hdfs has supported the datanode disk outlier detection in

[jira] [Updated] (HDFS-14789) namenode should avoid slow node while chooseTarget in BlockPlacementPolicyDefault

2020-12-22 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14789: Attachment: image-2020-12-22-22-15-17-703.png > namenode should avoid slow node while chooseTarget

  1   2   >