[
https://issues.apache.org/jira/browse/YUNIKORN-790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17504788#comment-17504788
]
Peter Bacsko commented on YUNIKORN-790:
---------------------------------------
I need some clarification here. This feature is present in both Fair and
Capacity Scheduler in Hadoop so I'd like to know how this one compares to the
feature in those schedulers.
Eg in FS, one can set:
* {{root.users}} - maxRunningApps: 10
* {{root.users.alice}} - maxRunningApps: 20
* {{root.users.bob}} - maxRunningApps: 20
According to the JIRA specs, this configuration will not be allowed. Is this
correct?
Next example:
* {{root.users}} - maxRunningApps: 10
* {{root.users.alice}} - maxRunningApps: 8
* {{root.users.bob}} - maxRunningApps: 8
{{root.users.alice}} has 7 applications running and {{root.users.bob}} has 3.
Bob wants to submit another application to his queue, what is the expected
behavior? Is {{root.users}} supposed to dominate the setting of
∑child(root.users) and force the application to stay in Pending state?
> Implement MaxApplications enforcement
> -------------------------------------
>
> Key: YUNIKORN-790
> URL: https://issues.apache.org/jira/browse/YUNIKORN-790
> Project: Apache YuniKorn
> Issue Type: New Feature
> Components: core - scheduler
> Reporter: Wilfred Spiegelenburg
> Assignee: Chung En Lee
> Priority: Major
> Labels: pull-request-available
>
> Queues have an option to set the MaxApplications that can run in a queue.
> There is currently no code in the scheduler that checks this setting.
> As a new feature we should add the enforcement for this setting:
> * enforce the setting on a leaf queue
> * enforce the setting on a parent, the apps running in a parent queue is
> defined as the sum of all the apps running in all leaf queues of the parent.
> As a side note from a config check: we need to make sure that the parent
> setting cannot be lower than any of the child queues it has. We _must not_
> enforce that the parent setting must be larger than sum of all leafs.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
