Stephen O'Donnell created HDFS-14675:
----------------------------------------
Summary: Increase Balancer Defaults Further
Key: HDFS-14675
URL: https://issues.apache.org/jira/browse/HDFS-14675
Project: Hadoop HDFS
Issue Type: Improvement
Components: balancer & mover
Affects Versions: 3.3.0
Reporter: Stephen O'Donnell
Assignee: Stephen O'Donnell
HDFS-10297 increased the balancer defaults to 50 for
dfs.datanode.balance.max.concurrent.moves and to 10MB/s for
dfs.datanode.balance.bandwidthPerSec.
We have found that these settings often have to be increased further as users
find the balancer operates too slowly with 50 and 10MB/s. We often recommend
moving concurrent moves to between 200 and 300 and setting the bandwidth to 100
or even 1000MB/s, and these settings seem to work well in practice.
I would like to suggest we increase the balancer defaults further. I would
suggest 100 for concurrent moves and 100MB/s for the bandwidth, but I would
like to know what others think on this topic too.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
