[ http://issues.apache.org/jira/browse/HADOOP-296?page=all ]

Johan Oskarson updated HADOOP-296:
----------------------------------

    Attachment: minspacev5.patch

Terribly sorry guys, this is a corrected version, disregard the previous ones.
How hard can it be to do a five line patch? :)

I'm a bit stressed out by other things, probably shouldn't send patches right 
now :)

> Do not assign blocks to a datanode with < x mb free
> ---------------------------------------------------
>
>          Key: HADOOP-296
>          URL: http://issues.apache.org/jira/browse/HADOOP-296
>      Project: Hadoop
>         Type: New Feature

>   Components: dfs
>     Versions: 0.3.2
>     Reporter: Johan Oskarson
>  Attachments: minspace.patch, minspacev2.patch, minspacev3.patch, 
> minspacev3.patch, minspacev4.patch, minspacev5.patch
>
> We're running a smallish cluster with very different machines, some with only 
> 60 gb harddrives
> This creates a problem when inserting files into the dfs, these machines run 
> out of space quickly and then they cannot run any map reduce operations
> A solution would be to not assign any new blocks once the space is below a 
> certain user configurable threshold
> This free space could then be used by the map reduce operations instead (if 
> that's on the same disk)

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira

Reply via email to