[
https://issues.apache.org/jira/browse/HDFS-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574868#comment-14574868
]
Arpit Agarwal commented on HDFS-8538:
-------------------------------------
bq. The writes are skewed towards the disks with more absolute free space, but
not 100% skewed (this skew is actually configurable)
Thanks Andrew. I took another look. Looks like we classify volumes into two
buckets of availability and choose from the higher bucket with a higher
probability. If that's correct it's still possible that just one or a small
number of volumes would fall into the higher bucket and get overloaded.
> Change the default volume choosing policy to
> AvailableSpaceVolumeChoosingPolicy
> -------------------------------------------------------------------------------
>
> Key: HDFS-8538
> URL: https://issues.apache.org/jira/browse/HDFS-8538
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 2.7.0
> Reporter: Andrew Wang
> Assignee: Andrew Wang
> Attachments: hdfs-8538.001.patch
>
>
> For datanodes with different sized disks, they almost always want the
> available space policy. Users with homogenous disks are unaffected.
> Since this code has baked for a while, let's change it to be the default.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
