[ http://issues.apache.org/jira/browse/HADOOP-386?page=all ]
Johan Oskarson updated HADOOP-386:
----------------------------------
Attachment: excessRepSpaceAware.patch
This patch removes excess replicates from the machine with least absolute space
first, as suggested by Bryan.
Would be helpful to have this, no matter what we decide when it comes to
redistributing blocks to nodes with more free space.
> Periodically move blocks from full nodes to those with space
> ------------------------------------------------------------
>
> Key: HADOOP-386
> URL: http://issues.apache.org/jira/browse/HADOOP-386
> Project: Hadoop
> Issue Type: New Feature
> Components: dfs
> Affects Versions: 0.4.0
> Reporter: Johan Oskarson
> Attachments: excessRepSpaceAware.patch
>
>
> I'm still having *a lot* of problems with some nodes filling up quickly and
> others hardly being touched, mostly because of the hardware being
> very different.
> As someone suggested, there should be a thread that periodically checks the
> dfs for nodes with little or no free space and schedules blocks
> to be moved off that node.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
