Wei Yan commented on YARN-2139:

Thanks for the comments, [~acmurthy].

bq. 1. We shouldn't embed Linux or blkio specific semantics such as 
proportional weight division into YARN. We need something generic such as 
bandwidth which can be understood by users, supportable on heterogenous nodes 
in the same cluster and supportable on other platforms like Windows.
One concern for the bandwidth is that, it may be hard for user to specify the 
bandwidth requirement when submitting the resource requests. 

bq. 2. Spindle locality or I/O parallelism is a real concern. 3. Spindle 
locality or I/O parallelism cannot be tied to HDFS.
Yes, I agree that spindle locality is very important. I'll look into KAFKA-1754 
to rethink about the spindle design. 

> Add support for disk IO isolation/scheduling for containers
> -----------------------------------------------------------
>                 Key: YARN-2139
>                 URL: https://issues.apache.org/jira/browse/YARN-2139
>             Project: Hadoop YARN
>          Issue Type: New Feature
>            Reporter: Wei Yan
>            Assignee: Wei Yan
>         Attachments: Disk_IO_Scheduling_Design_1.pdf, 
> Disk_IO_Scheduling_Design_2.pdf

This message was sent by Atlassian JIRA

Reply via email to