[
https://issues.apache.org/jira/browse/YARN-9200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aihua Xu updated YARN-9200:
---------------------------
Description:
In capacity scheduler, currently two resource allocations are supported. 1.
percentage allocation for child queues - the child queue gets a defined
percentage of the resources for all the resource types; 2. absolute values
(YARN-5881) - each resource is configured an absolute values.
Right now we can't mix these case together and it would also very confusing to
mix them in one cluster. The second case actually is more targeting toward
cloud env.
In a non-cloud env, the ability to configure each resource independently is
also useful, but percentage is preferable over absolute value. One thought here
is to add the percentage configuration for each resource type on the queue.
That would allow us to configure memory bounded queues, or CPU bounded queues.
was:
In capacity scheduler, currently two resource allocations are supported. 1.
percentage allocation for child queues - the child queue gets a defined
percentage of the resources for all the resource types; 2. absolute values
(YARN-5881) - each resource is configured an absolute values.
Right now we can't mix these case together and it would also very confusing to
mix them in one cluster. The second case actually is more targeting toward
cloud env.
In a non-cloud env, the ability to configure each resource independently is
also useful, but in such env, percentage is preferable instead of absolute
value. One thought here is to add the percentage configuration for each
resource type on the queue. That would allow us to configure memory bounded
queues, or CPU bounded queues.
> Enable resource configuration of queue capacity for different resources
> independently
> -------------------------------------------------------------------------------------
>
> Key: YARN-9200
> URL: https://issues.apache.org/jira/browse/YARN-9200
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: capacity scheduler
> Affects Versions: 3.1.0
> Reporter: Aihua Xu
> Priority: Major
>
> In capacity scheduler, currently two resource allocations are supported. 1.
> percentage allocation for child queues - the child queue gets a defined
> percentage of the resources for all the resource types; 2. absolute values
> (YARN-5881) - each resource is configured an absolute values.
> Right now we can't mix these case together and it would also very confusing
> to mix them in one cluster. The second case actually is more targeting toward
> cloud env.
> In a non-cloud env, the ability to configure each resource independently is
> also useful, but percentage is preferable over absolute value. One thought
> here is to add the percentage configuration for each resource type on the
> queue. That would allow us to configure memory bounded queues, or CPU bounded
> queues.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
