[ https://issues.apache.org/jira/browse/YARN-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13919996#comment-13919996 ]
Varun Vasudev commented on YARN-1781: ------------------------------------- The attached patch adds support for checking disk utilization as part of the checkDirs function in DirectoryCollection. Disk utilization can be specified as a percentage via the yarn config, with the default value set to 1.0F(use the full disk). > NM should allow users to specify max disk utilization for local disks > --------------------------------------------------------------------- > > Key: YARN-1781 > URL: https://issues.apache.org/jira/browse/YARN-1781 > Project: Hadoop YARN > Issue Type: Sub-task > Components: nodemanager > Reporter: Varun Vasudev > Assignee: Varun Vasudev > Attachments: apache-yarn-1781.0.patch > > > This is related to YARN-257(it's probably a sub task?). Currently, the NM > does not detect full disks and allows full disks to be used by containers > leading to repeated failures. YARN-257 deals with graceful handling of full > disks. This ticket is only about detection of full disks by the disk health > checkers. > The NM should allow users to set a maximum disk utilization for local disks > and mark disks as bad once they exceed that utilization. At the very least, > the NM should at least detect full disks. -- This message was sent by Atlassian JIRA (v6.2#6252)