[
https://issues.apache.org/jira/browse/HDFS-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16069569#comment-16069569
]
chencan commented on HDFS-12011:
--------------------------------
Thank you for your attention to this problem. My environment configuration is
relatively simple，two datanode，every datanode with ten disks. Hibench
configure with 8 parallelism mapper and 8 parallelism reducer. During the
test, I looked at the reference of each disk. Actually，there is no significant
load imbalance was observed when configured with RoundRobin and AvailableSpace
volume choosing policy. So this load balancing volume choosing policy did not
play out its advantages. Thandks!
> Add a new load balancing volume choosing policy
> ------------------------------------------------
>
> Key: HDFS-12011
> URL: https://issues.apache.org/jira/browse/HDFS-12011
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode
> Reporter: chencan
> Assignee: chencan
> Attachments: HADOOP-12011.002.patch, HADOOP-12011.patch
>
>
> There are two types of volume choosing policies when choose a volume
> inner a datanode to write in a datablock : RoundRobinVolumeChoosingPolicy and
> AvailableSpaceVolumeChoosingPolicy.This two policies do not take into account
> the fsvolume's load. We can add a new load balancing volume choosing policy,
> using existing reference in FsVolumeImpl.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
