Arun C Murthy commented on YARN-2139:

[~ywskycn] - thanks for the design doc, it's well put together.

Some feedback:

# We shouldn't embed Linux or blkio specific semantics such as {{proportional 
weight division}} into YARN. We need something generic such as {{bandwidth}} 
which can be understood by users, supportable on heterogenous nodes in the same 
cluster and supportable on other platforms like Windows.
# Spindle locality or I/O parallelism is a real concern - we should probably 
support {{bandwidth}} and {{spindles}}.
# Spindle locality or I/O parallelism cannot be tied to HDFS. In fact, YARN 
should not have a dependency on HDFS at all (*smile*)! This is particularly 
important in light of developments like Kafka-on-YARN (KAFKA-1754) because 
people want to use YARN to deploy only Kafka & Storm etc. YARN-2817 helps in 
this regard.

Makes sense?

> Add support for disk IO isolation/scheduling for containers
> -----------------------------------------------------------
>                 Key: YARN-2139
>                 URL: https://issues.apache.org/jira/browse/YARN-2139
>             Project: Hadoop YARN
>          Issue Type: New Feature
>            Reporter: Wei Yan
>            Assignee: Wei Yan
>         Attachments: Disk_IO_Scheduling_Design_1.pdf, 
> Disk_IO_Scheduling_Design_2.pdf

This message was sent by Atlassian JIRA

Reply via email to