[
https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17316277#comment-17316277
]
Peter Bacsko edited comment on YARN-10564 at 4/7/21, 12:16 PM:
---------------------------------------------------------------
Thanks [~gandras], I think I get it. I guess the trick is the "for" loop which
modifies "queuePathParts". First we try to find the templates for the parent
explicitly, then we step back a wildcard at each iteration. By changing
"queuePathParts", the prefix changes so eventually we might find a parent which
contains templates.
Finally, we call {{setConfigFromTemplateEntries()}} where we set the collected
values for the original queue.
Is this correct?
was (Author: pbacsko):
Thanks [~gandras], I think I get it. I guess the trick is the "for" loop which
modifies "queuePathParts". First we try to find the templates for the parent
explicitly, then we step back each wildcard at a time. By changing
"queuePathParts", the prefix changes so eventually we might find a parent which
contains templates.
Finally, we call {{setConfigFromTemplateEntries()}} where we set the collected
values for the original queue.
Is this correct?
> Support Auto Queue Creation template configurations
> ---------------------------------------------------
>
> Key: YARN-10564
> URL: https://issues.apache.org/jira/browse/YARN-10564
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Andras Gyori
> Assignee: Andras Gyori
> Priority: Major
> Attachments: YARN-10564.001.patch, YARN-10564.002.patch,
> YARN-10564.003.patch, YARN-10564.004.patch, YARN-10564.005.patch,
> YARN-10564.poc.001.patch
>
>
> Similar to how the template configuration works for ManagedParents, we need
> to support templates for the new auto queue creation logic. Proposition is to
> allow wildcards in template configs such as:
> {noformat}
> yarn.scheduler.capacity.root.*.*.weight 10{noformat}
> which would mean, that set weight to 10 of every leaf of every parent under
> root.
> We should possibly take an approach, that could support arbitrary depth of
> template configuration, because we might need to lift the limitation of auto
> queue nesting.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
