Swapnil Daingade commented on YARN-2791:

Karthik Kambatla - I'll go through the design doc for YARN-2139 and post our 
design document here as well. We can then decide if we should have two JIRA's 
or combine them as Aditya Kishore suggested. However I fully support combining 
our efforts on this.

> Add Disk as a resource for scheduling
> -------------------------------------
>                 Key: YARN-2791
>                 URL: https://issues.apache.org/jira/browse/YARN-2791
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: scheduler
>    Affects Versions: 2.5.1
>            Reporter: Swapnil Daingade
>            Assignee: Yuliya Feldman
> Currently, the number of disks present on a node is not considered a factor 
> while scheduling containers on that node. Having large amount of memory on a 
> node can lead to high number of containers being launched on that node, all 
> of which compete for I/O bandwidth. This multiplexing of I/O across 
> containers can lead to slower overall progress and sub-optimal resource 
> utilization as containers starved for I/O bandwidth hold on to other 
> resources like cpu and memory. This problem can be solved by considering disk 
> as a resource and including it in deciding how many containers can be 
> concurrently run on a node.

This message was sent by Atlassian JIRA

Reply via email to