[
https://issues.apache.org/jira/browse/YARN-10891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szilard Nemeth resolved YARN-10891.
-----------------------------------
Hadoop Flags: Reviewed
Resolution: Fixed
> Extend QueueInfo with max-parallel-apps in CapacityScheduler
> ------------------------------------------------------------
>
> Key: YARN-10891
> URL: https://issues.apache.org/jira/browse/YARN-10891
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: capacity scheduler
> Reporter: Tamas Domok
> Assignee: Tamas Domok
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.0
>
> Time Spent: 3h 50m
> Remaining Estimate: 0h
>
> Add max-parallel-apps to the Cluster Scheduler API's
> [response|[https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_Scheduler_API]]
> and extend the Yarn-API's QueueInfoProto with the max-parallel-apps property.
>
> The REST api can be tested with:
> {code:java}
> curl "http://localhost:8088/ws/v1/cluster/scheduler"; | jq {code}
>
> The protobuf api can be tested with the yarn client:
> {code:java}
> yarn queue --status root.queue.foo
> Queue Information :
> Queue Name : foo
> Queue Path : root.queue.foo
> State : RUNNING
> Capacity : 75.00%
> Current Capacity : .00%
> Maximum Capacity : 100.00%
> Weight : -1.00
> Maximum Parallel Apps : 9
> Default Node Label expression : <DEFAULT_PARTITION>
> Accessible Node Labels : *
> Preemption : disabled
> Intra-queue Preemption : disabled {code}
>
> About the max-parallel-apps:
> Maximum number of applications that can run at the same time. Unlike to
> {{maximum-applications}}, application submissions are _not_ rejected when
> this limit is reached. Instead they stay in {{ACCEPTED}} state until they are
> eligible to run. This can be set for all queues with
> {{yarn.scheduler.capacity.max-parallel-apps}} and can also be overridden on a
> per queue basis by setting
> {{yarn.scheduler.capacity.<queue-path>.max-parallel-apps}}. Integer value is
> expected. By default, there is no limit.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
