[
https://issues.apache.org/jira/browse/HDFS-14904?focusedWorklogId=515343&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-515343
]
ASF GitHub Bot logged work on HDFS-14904:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 23/Nov/20 01:30
Start Date: 23/Nov/20 01:30
Worklog Time Spent: 10m
Work Description: LeonGao91 opened a new pull request #2483:
URL: https://github.com/apache/hadoop/pull/2483
Normally the most important purpose for HDFS balancer is to reduce the top
used node to prevent datanode usage from being too high.
Currently, balancer almost randomly picks nodes as sources regardless of
usage, which makes it slow to bring down the top used datanodes in the cluster,
when there are less underutilized nodes in the cluster (consider expansion).
We can add an option to prefer top used nodes first in each iteration.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 515343)
Remaining Estimate: 0h
Time Spent: 10m
> Option to let Balancer prefer top used nodes in each iteration
> --------------------------------------------------------------
>
> Key: HDFS-14904
> URL: https://issues.apache.org/jira/browse/HDFS-14904
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: balancer & mover
> Reporter: Leon Gao
> Assignee: Leon Gao
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Normally the most important purpose for HDFS balancer is to reduce the top
> used node to prevent datanode usage from being too high.
> Currently, balancer almost randomly picks nodes as sources regardless of
> usage, which makes it slow to bring down the top used datanodes in the
> cluster, when there are less underutilized nodes in the cluster (consider
> expansion).
> We can add an option to prefer top used nodes first in each iteration, as
> suggested in HDFS-14894 .
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
