[
https://issues.apache.org/jira/browse/YARN-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16380029#comment-16380029
]
Sunil G commented on YARN-3153:
-------------------------------
[[email protected]]
Since we are looking for a deprecation of
{{yarn.scheduler.capacity.maximum-am-resource-percent}} and introduce something
like {{yarn.scheduler.capacity.maximum-am-capacity}}
I think we have to support both for some more time, 3.0 was a correct version
for this to deprecate. So now we can look ahead and try to fix this in next
major version (but have old one for some more version for compatibility issue)
I think "default per cluster + override per queue is sufficient." model may be
better. This means that all queues will use whats set in cluster level. Each
queue can override as needed, I am not seeing inheritance from parent queue is
very much needed here. cc [~leftnoteasy]
> Capacity Scheduler max AM resource limit for queues is defined as percentage
> but used as ratio
> ----------------------------------------------------------------------------------------------
>
> Key: YARN-3153
> URL: https://issues.apache.org/jira/browse/YARN-3153
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Wangda Tan
> Assignee: Wangda Tan
> Priority: Critical
>
> In existing Capacity Scheduler, it can limit max applications running within
> a queue. The config is yarn.scheduler.capacity.maximum-am-resource-percent,
> but actually, it is used as "ratio", in implementation, it assumes input will
> be \[0,1\]. So now user can specify it up to 100, which makes AM can use 100x
> of queue capacity. We should fix that.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
