Wangda Tan commented on YARN-2986:

An update:

After an offline discussion with [~vinodkv] and [~jianhe], now proposed 
configuration file looks like:
  <queue name="root">
            <queue name="default">
                        <node-label name="x">

One highlight of this proposal and previous proposal is: this contains a 
"policy-properties" for each configuration node, which means a 
scheduler-specific configurations, like capacity in CapacityScheduler and 
minShare in FairScheduler, etc. ("policy" here means different kinds of 
scheduling method).

For other common options (not belongs to a specific scheduler implementation), 
should be placed outside of "policy-properties".

*Please feel free to share your thoughts about this proposal :).*

To move this forward, I filed several sub ticket, YARN-3233 is targeted to 
solve the configuration file (for common scheduler and capacity scheduler) 
definition and parsing, I will upload a patch right now. YARN-3234 is to solve 
Capacity Scheduler integration with the new config file.

> (Umbrella) Support hierarchical and unified scheduler configuration
> -------------------------------------------------------------------
>                 Key: YARN-2986
>                 URL: https://issues.apache.org/jira/browse/YARN-2986
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Wangda Tan
>         Attachments: YARN-2986.1.patch
> Today's scheduler configuration is fragmented and non-intuitive, and needs to 
> be improved. Details in comments.

This message was sent by Atlassian JIRA

Reply via email to