[
https://issues.apache.org/jira/browse/YARN-7117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16217381#comment-16217381
]
Carlo Curino commented on YARN-7117:
------------------------------------
[~wangda] I agree with your comments. In particular:
# I am ok to rename the {{PlanQueue}}/{{ReservationQueue}} to something more
generic
# I don't have strong preferences regarding {{SchedulingEditPolicy}}, the only
caveat is that those are used by {{PlanFollower}} and
{{MetricsInvariantChecker}}(s) as well, so make sure those flows are not
broken/made complicated. In particular, the configuration should be backward
compatible.
# I don't follow all the prototype design well, but the
{{QueueEntitlementDynamicEditPolicy}} looks very similar in spirit the job done
by the {{CapacitySchedulerPlanFollower}} part of the {{ReservationSystem}},
check if you can re-use/extend/refactor that logic.
> Capacity Scheduler: Support Auto Creation of Leaf Queues While Doing Queue
> Mapping
> ----------------------------------------------------------------------------------
>
> Key: YARN-7117
> URL: https://issues.apache.org/jira/browse/YARN-7117
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: capacity scheduler
> Reporter: Wangda Tan
> Assignee: Suma Shivaprasad
> Attachments:
> YARN-7117.Capacity.Scheduler.Support.Auto.Creation.Of.Leaf.Queue.pdf,
> YARN-7117.poc.1.patch, YARN-7117.poc.patch, YARN-7117_Workflow.pdf
>
>
> Currently Capacity Scheduler doesn't support auto creation of queues when
> doing queue mapping. We saw more and more use cases which has complex queue
> mapping policies configured to handle application to queues mapping.
> The most common use case of CapacityScheduler queue mapping is to create one
> queue for each user/group. However update {{capacity-scheduler.xml}} and
> {{RMAdmin:refreshQueues}} needs to be done when new user/group onboard. One
> of the option to solve the problem is automatically create queues when new
> user/group arrives.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
