[
https://issues.apache.org/jira/browse/YARN-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13919750#comment-13919750
]
Jason Lowe commented on YARN-1781:
----------------------------------
Note that we may need to do more than just mark disks as unusable once they are
"full" for a specified definition of "full." I suspect a disk being "full" is
a more transient kind of failure than other failures, and it would be nice if
full disks were added back in to the list of good dirs once they fall below a
threshold. Not a hard requirement necessarily for this JIRA, but I can see it
being an immediate followup request if not implemented. The recovery from full
may be covered by YARN-90 when that's implemented.
> NM should allow users to specify max disk utilization for local disks
> ---------------------------------------------------------------------
>
> Key: YARN-1781
> URL: https://issues.apache.org/jira/browse/YARN-1781
> Project: Hadoop YARN
> Issue Type: Bug
> Components: nodemanager
> Reporter: Varun Vasudev
>
> This is related to YARN-257(it's probably a sub task?). Currently, the NM
> does not detect full disks and allows full disks to be used by containers
> leading to repeated failures. YARN-257 deals with graceful handling of full
> disks. This ticket is only about detection of full disks by the disk health
> checkers.
> The NM should allow users to set a maximum disk utilization for local disks
> and mark disks as bad once they exceed that utilization. At the very least,
> the NM should at least detect full disks.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
