[ http://issues.apache.org/jira/browse/HADOOP-386?page=comments#action_12423300 ] Johan Oskarson commented on HADOOP-386: ---------------------------------------
As a first step, one could make chooseExcessReplicates in FSNamesystem.java space-aware. So that if a block are over replicated it is removed from the machine with least percentage free space. That way, all we would have to do is to copy the block to one extra node with lots of space and the rest would solve itself. > Periodically move blocks from full nodes to those with space > ------------------------------------------------------------ > > Key: HADOOP-386 > URL: http://issues.apache.org/jira/browse/HADOOP-386 > Project: Hadoop > Issue Type: New Feature > Components: dfs > Affects Versions: 0.4.0 > Reporter: Johan Oskarson > > I'm still having *a lot* of problems with some nodes filling up quickly and > others hardly being touched, mostly because of the hardware being > very different. > As someone suggested, there should be a thread that periodically checks the > dfs for nodes with little or no free space and schedules blocks > to be moved off that node. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira
