[
https://issues.apache.org/jira/browse/HDFS-14675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16909869#comment-16909869
]
Wei-Chiu Chuang edited comment on HDFS-14675 at 8/18/19 2:26 AM:
-----------------------------------------------------------------
Also worth noting the HDP's HDFS balancer doc recommendation where there are
background mode and fast mode:
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_hdfs-administration/content/recommended_configurations.html
was (Author: jojochuang):
Also worth noting the HDP's HDFS balancer doc recommendation:
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_hdfs-administration/content/recommended_configurations.html
> Increase Balancer Defaults Further
> ----------------------------------
>
> Key: HDFS-14675
> URL: https://issues.apache.org/jira/browse/HDFS-14675
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: balancer & mover
> Affects Versions: 3.3.0
> Reporter: Stephen O'Donnell
> Assignee: Stephen O'Donnell
> Priority: Major
> Attachments: HDFS-14675.001.patch
>
>
> HDFS-10297 increased the balancer defaults to 50 for
> dfs.datanode.balance.max.concurrent.moves and to 10MB/s for
> dfs.datanode.balance.bandwidthPerSec.
> We have found that these settings often have to be increased further as users
> find the balancer operates too slowly with 50 and 10MB/s. We often recommend
> moving concurrent moves to between 200 and 300 and setting the bandwidth to
> 100 or even 1000MB/s, and these settings seem to work well in practice.
> I would like to suggest we increase the balancer defaults further. I would
> suggest 100 for concurrent moves and 100MB/s for the bandwidth, but I would
> like to know what others think on this topic too.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
