[ 
https://issues.apache.org/jira/browse/YARN-4276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963123#comment-14963123
 ] 

Steve Loughran commented on YARN-4276:
--------------------------------------

There's been some discussion about requesting IO resources in containers: 
bandwidth/IOPs. It'd be more complex, but
# gives admins more control over limits
# allow better performance guarantees for allocated nodes
# permit cgroup throttling of IO
# force the container requests to be explicit in their IO needs, for consistent 
performance on idle/busy nodes

IO resource allocations wouldn't work with HDFS; its a separate process.

Anyway, there is a YARN JIRA somewhere, awaiting someone (you?) to work on it

> Per-application-type local dirs for NodeManager
> -----------------------------------------------
>
>                 Key: YARN-4276
>                 URL: https://issues.apache.org/jira/browse/YARN-4276
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager
>    Affects Versions: 2.6.0
>            Reporter: He Tianyi
>
> Requesting the ability of specifying per-application-type local dirs in 
> NodeManager.
> The scenario is having both SSDs & HDDs installed on each node, and managing 
> to launch Spark containers on these SSD drives while other containers 
> belonging to other types of applications on normal HDD drives.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to