[
https://issues.apache.org/jira/browse/YARN-7562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16269883#comment-16269883
]
Wilfred Spiegelenburg commented on YARN-7562:
---------------------------------------------
Your changes will break existing configurations. You are even breaking existing
use cases that are tested. The changes you are making to the tests are not
acceptable: changing a parent to a leaf queue fundamentally changes the test.
Please run the junit tests relevant to the code you are changing before you
submit the patch.
What you are after can already be achieved through config. You need to change
the order in the placement rules and use ACLs if needed.
This is what the placement rules should look like:
{code}
<queuePlacementPolicy>
<rule name="specified" create="false"/>
<rule name="user" create="false" />
<rule name="default" queue="default"/>
</queuePlacementPolicy>
{code}
Put ACLs on specific queues if you only want specific users or groups to use
them.
> queuePlacementPolicy should not match parent queue
> --------------------------------------------------
>
> Key: YARN-7562
> URL: https://issues.apache.org/jira/browse/YARN-7562
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: fairscheduler, resourcemanager
> Affects Versions: 2.7.1
> Reporter: chuanjie.duan
> Attachments: YARN-7562.002.patch, YARN-7562.patch
>
>
> User algo submit a mapreduce job, console log said "root.algo is not a leaf
> queue exception".
> root.algo is a parent queue, it's meanless for me. Not sure why parent queue
> added before
> <queue name="default">
> <minResources>3000 mb, 1 vcores</minResources>
> <maxResources>24000 mb, 8 vcores</maxResources>
> <maxRunningApps>4</maxRunningApps>
> <weight>1</weight>
> <schedulingMode>fifo</schedulingMode>
> </queue>
> <queue name="cim">
> <minResources>3000 mb, 1 vcores</minResources>
> <maxResources>24000 mb, 8 vcores</maxResources>
> <maxRunningApps>4</maxRunningApps>
> <weight>1</weight>
> <schedulingMode>fifo</schedulingMode>
> </queue>
> <queue name="algo">
> <minSharePreemptionTimeout>300</minSharePreemptionTimeout>
> <minResources>40000 mb, 10 vcores</minResources>
> <maxResources>200000 mb, 60 vcores</maxResources>
> <queue name="testb">
> <minSharePreemptionTimeout>300</minSharePreemptionTimeout>
> <minResources>40000 mb, 10 vcores</minResources>
> <maxResources>100000 mb, 30 vcores</maxResources>
> <maxRunningApps>20</maxRunningApps>
> <schedulingMode>fifo</schedulingMode>
> <weight>4</weight>
> </queue>
> <queue name="testa">
> <minSharePreemptionTimeout>300</minSharePreemptionTimeout>
> <minResources>40000 mb, 10 vcores</minResources>
> <maxResources>100000 mb, 30 vcores</maxResources>
> <maxRunningApps>20</maxRunningApps>
> <schedulingMode>fifo</schedulingMode>
> <weight>4</weight>
> </queue>
> </queue>
> <queuePlacementPolicy>
> <rule name="user" create="false" />
> <rule name="specified" />
> <rule name="default" queue="default"/>
> </queuePlacementPolicy>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
