[
https://issues.apache.org/jira/browse/YARN-4276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963123#comment-14963123
]
Steve Loughran commented on YARN-4276:
--------------------------------------
There's been some discussion about requesting IO resources in containers:
bandwidth/IOPs. It'd be more complex, but
# gives admins more control over limits
# allow better performance guarantees for allocated nodes
# permit cgroup throttling of IO
# force the container requests to be explicit in their IO needs, for consistent
performance on idle/busy nodes
IO resource allocations wouldn't work with HDFS; its a separate process.
Anyway, there is a YARN JIRA somewhere, awaiting someone (you?) to work on it
> Per-application-type local dirs for NodeManager
> -----------------------------------------------
>
> Key: YARN-4276
> URL: https://issues.apache.org/jira/browse/YARN-4276
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: nodemanager
> Affects Versions: 2.6.0
> Reporter: He Tianyi
>
> Requesting the ability of specifying per-application-type local dirs in
> NodeManager.
> The scenario is having both SSDs & HDDs installed on each node, and managing
> to launch Spark containers on these SSD drives while other containers
> belonging to other types of applications on normal HDD drives.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)