[ 
https://issues.apache.org/jira/browse/YARN-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13919996#comment-13919996
 ] 

Varun Vasudev commented on YARN-1781:
-------------------------------------

The attached patch adds support for checking disk utilization as part of the 
checkDirs function in DirectoryCollection. Disk utilization can be specified as 
a percentage via the yarn config, with the default value set to 1.0F(use the 
full disk). 

> NM should allow users to specify max disk utilization for local disks
> ---------------------------------------------------------------------
>
>                 Key: YARN-1781
>                 URL: https://issues.apache.org/jira/browse/YARN-1781
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager
>            Reporter: Varun Vasudev
>            Assignee: Varun Vasudev
>         Attachments: apache-yarn-1781.0.patch
>
>
> This is related to YARN-257(it's probably a sub task?). Currently, the NM 
> does not detect full disks and allows full disks to be used by containers 
> leading to repeated failures. YARN-257 deals with graceful handling of full 
> disks. This ticket is only about detection of full disks by the disk health 
> checkers.
> The NM should allow users to set a maximum disk utilization for local disks 
> and mark disks as bad once they exceed that utilization. At the very least, 
> the NM should at least detect full disks.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to