[jira] [Commented] (YARN-10928) Support default queue properties of capacity scheduler to simplify configuration management
[
https://issues.apache.org/jira/browse/YARN-10928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412918#comment-17412918
]
Tao Yang commented on YARN-10928:
-
The PR LGTM now, +1 from my side. I will merge this PR after a few days if
there are no objections.
> Support default queue properties of capacity scheduler to simplify
> configuration management
> ---
>
> Key: YARN-10928
> URL: https://issues.apache.org/jira/browse/YARN-10928
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: capacity scheduler
>Reporter: Weihao Zheng
>Assignee: Weihao Zheng
>Priority: Major
> Labels: pull-request-available
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> There are many user cases that one user owns many queues in his
> organization's cluster for different business usages in practice. These
> queues often share the same properties, such as minimum-user-limit-percent
> and user-limit-factor. Users have to write one property for every queue they
> use if they want to use customized these shared properties. Adding default
> queue properties for these cases will simplify capacity scheduler's
> configuration file and make it easy to adjust queue's common properties.
>
> CHANGES:
> Add two properties as queue's default value in capacity scheduler's
> configuration:
> * {{yarn.scheduler.capacity.minimum-user-limit-percent}}
> * {{yarn.scheduler.capacity.user-limit-factor}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10928) Support default queue properties of capacity scheduler to simplify configuration management
[
https://issues.apache.org/jira/browse/YARN-10928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411357#comment-17411357
]
Weiwei Yang commented on YARN-10928:
Sure, granted the contributor role to [~Weihao Zheng]. Thanks
> Support default queue properties of capacity scheduler to simplify
> configuration management
> ---
>
> Key: YARN-10928
> URL: https://issues.apache.org/jira/browse/YARN-10928
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: capacity scheduler
>Reporter: Weihao Zheng
>Assignee: Weihao Zheng
>Priority: Major
> Labels: pull-request-available
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> There are many user cases that one user owns many queues in his
> organization's cluster for different business usages in practice. These
> queues often share the same properties, such as minimum-user-limit-percent
> and user-limit-factor. Users have to write one property for every queue they
> use if they want to use customized these shared properties. Adding default
> queue properties for these cases will simplify capacity scheduler's
> configuration file and make it easy to adjust queue's common properties.
>
> CHANGES:
> Add two properties as queue's default value in capacity scheduler's
> configuration:
> * {{yarn.scheduler.capacity.minimum-user-limit-percent}}
> * {{yarn.scheduler.capacity.user-limit-factor}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10928) Support default queue properties of capacity scheduler to simplify configuration management
[
https://issues.apache.org/jira/browse/YARN-10928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410898#comment-17410898
]
Tao Yang commented on YARN-10928:
-
Hi, [~wwei]. Could you please help to authorize [~Weihao Zheng] as a
contributor so that he can assign this issue to himself. Thanks!
> Support default queue properties of capacity scheduler to simplify
> configuration management
> ---
>
> Key: YARN-10928
> URL: https://issues.apache.org/jira/browse/YARN-10928
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: capacity scheduler
>Reporter: Weihao Zheng
>Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> There are many user cases that one user owns many queues in his
> organization's cluster for different business usages in practice. These
> queues often share the same properties, such as minimum-user-limit-percent
> and user-limit-factor. Users have to write one property for every queue they
> use if they want to use customized these shared properties. Adding default
> queue properties for these cases will simplify capacity scheduler's
> configuration file and make it easy to adjust queue's common properties.
>
> CHANGES:
> Add two properties as queue's default value in capacity scheduler's
> configuration:
> * {{yarn.scheduler.capacity.minimum-user-limit-percent}}
> * {{yarn.scheduler.capacity.user-limit-factor}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10928) Support default queue properties of capacity scheduler to simplify configuration management
[
https://issues.apache.org/jira/browse/YARN-10928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17407781#comment-17407781
]
Weihao Zheng commented on YARN-10928:
-
Ok, I will add more detail in this PR.
> Support default queue properties of capacity scheduler to simplify
> configuration management
> ---
>
> Key: YARN-10928
> URL: https://issues.apache.org/jira/browse/YARN-10928
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: capacity scheduler
>Reporter: Weihao Zheng
>Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> There are many user cases that one user owns many queues in his
> organization's cluster for different business usages in practice. These
> queues often share the same properties, such as minimum-user-limit-percent
> and user-limit-factor. Users have to write one property for every queue they
> use if they want to use customized these shared properties. Adding default
> queue properties for these cases will simplify capacity scheduler's
> configuration file and make it easy to adjust queue's common properties.
>
> CHANGES:
> Add two properties as queue's default value in capacity scheduler's
> configuration:
> * {{yarn.scheduler.capacity.minimum-user-limit-percent}}
> * {{yarn.scheduler.capacity.user-limit-factor}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10928) Support default queue properties of capacity scheduler to simplify configuration management
[
https://issues.apache.org/jira/browse/YARN-10928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17407775#comment-17407775
]
Tao Yang commented on YARN-10928:
-
Thanks [~Weihao Zheng] for filling this ticket!
I think it's very useful for cluster management, and it's reasonable to use the
non-specified-queue configuration as some cluster-level configurations already
did (e.g. yarn.scheduler.capacity.maximum-applications /
yarn.scheduler.capacity.maximum-am-resource-percent /
yarn.scheduler.capacity.max-parallel-apps).
For the PR, I think it's better to add a simple UT in TestApplicationLimit and
make sure the related document is updated.
> Support default queue properties of capacity scheduler to simplify
> configuration management
> ---
>
> Key: YARN-10928
> URL: https://issues.apache.org/jira/browse/YARN-10928
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: capacity scheduler
>Reporter: Weihao Zheng
>Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> There are many user cases that one user owns many queues in his
> organization's cluster for different business usages in practice. These
> queues often share the same properties, such as minimum-user-limit-percent
> and user-limit-factor. Users have to write one property for every queue they
> use if they want to use customized these shared properties. Adding default
> queue properties for these cases will simplify capacity scheduler's
> configuration file and make it easy to adjust queue's common properties.
>
> CHANGES:
> Add two properties as queue's default value in capacity scheduler's
> configuration:
> * {{yarn.scheduler.capacity.minimum-user-limit-percent}}
> * {{yarn.scheduler.capacity.user-limit-factor}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
