[jira] [Created] (YARN-2973) Capacity scheduler configuration ACLs not work.
Jimmy Song created YARN-2973: Summary: Capacity scheduler configuration ACLs not work. Key: YARN-2973 URL: https://issues.apache.org/jira/browse/YARN-2973 Project: Hadoop YARN Issue Type: Bug Components: capacityscheduler Affects Versions: 2.5.0 Environment: ubuntu 12.04, cloudera manager, cdh5.2.1 Reporter: Jimmy Song I follow this page to configure yarn: http://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html. I configured YARN to use capacity scheduler in yarn-site.xml with yarn.resourcemanager.scheduler.class for org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler. Then modified capacity-scheduler.xml, ___ ?xml version=1.0? configuration property nameyarn.scheduler.capacity.root.queues/name valuedefault,extract,report,tool/value /property property nameyarn.scheduler.capacity.root.state/name valueRUNNING/value /property property nameyarn.scheduler.capacity.root.default.acl_submit_applications/name valuejcsong2,yanxu2 /value /property property nameyarn.scheduler.capacity.root.default.acl_administer_queue/name valuejcsong2,yanxu2 /value /property property nameyarn.scheduler.capacity.root.default.capacity/name value35/value /property property nameyarn.scheduler.capacity.root.extract.acl_submit_applications/name valuejcsong2 /value /property property nameyarn.scheduler.capacity.root.extract.acl_administer_queue/name valuejcsong2 /value /property property nameyarn.scheduler.capacity.root.extract.capacity/name value15/value /property property nameyarn.scheduler.capacity.root.report.acl_submit_applications/name valueyanxu2 /value /property property nameyarn.scheduler.capacity.root.report.acl_administer_queue/name valueyanxu2 /value /property property nameyarn.scheduler.capacity.root.report.capacity/name value35/value /property property nameyarn.scheduler.capacity.root.tool.acl_submit_applications/name value /value /property property nameyarn.scheduler.capacity.root.tool.acl_administer_queue/name value /value /property property nameyarn.scheduler.capacity.root.tool.capacity/name value15/value /property /configuration ___ I have enabled the acl in yarn-site.xml, but the user jcsong2 can submit applications to every queue. The queue acl does't work! And the queue used capacity more than it was configured! -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (YARN-2973) Capacity scheduler configuration ACLs not work.
[ https://issues.apache.org/jira/browse/YARN-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Song updated YARN-2973: - Description: I follow this page to configure yarn: http://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html. I configured YARN to use capacity scheduler in yarn-site.xml with yarn.resourcemanager.scheduler.class for org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler. Then modified capacity-scheduler.xml, ___ ?xml version=1.0? configuration property nameyarn.scheduler.capacity.root.queues/name valuedefault,extract,report,tool/value /property property nameyarn.scheduler.capacity.root.state/name valueRUNNING/value /property property nameyarn.scheduler.capacity.root.default.acl_submit_applications/name valuejcsong2, y2 /value /property property nameyarn.scheduler.capacity.root.default.acl_administer_queue/name valuejcsong2, y2 /value /property property nameyarn.scheduler.capacity.root.default.capacity/name value35/value /property property nameyarn.scheduler.capacity.root.extract.acl_submit_applications/name valuejcsong2 /value /property property nameyarn.scheduler.capacity.root.extract.acl_administer_queue/name valuejcsong2 /value /property property nameyarn.scheduler.capacity.root.extract.capacity/name value15/value /property property nameyarn.scheduler.capacity.root.report.acl_submit_applications/name valuey2 /value /property property nameyarn.scheduler.capacity.root.report.acl_administer_queue/name valuey2 /value /property property nameyarn.scheduler.capacity.root.report.capacity/name value35/value /property property nameyarn.scheduler.capacity.root.tool.acl_submit_applications/name value /value /property property nameyarn.scheduler.capacity.root.tool.acl_administer_queue/name value /value /property property nameyarn.scheduler.capacity.root.tool.capacity/name value15/value /property /configuration ___ I have enabled the acl in yarn-site.xml, but the user jcsong2 can submit applications to every queue. The queue acl does't work! And the queue used capacity more than it was configured! was: I follow this page to configure yarn: http://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html. I configured YARN to use capacity scheduler in yarn-site.xml with yarn.resourcemanager.scheduler.class for org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler. Then modified capacity-scheduler.xml, ___ ?xml version=1.0? configuration property nameyarn.scheduler.capacity.root.queues/name valuedefault,extract,report,tool/value /property property nameyarn.scheduler.capacity.root.state/name valueRUNNING/value /property property nameyarn.scheduler.capacity.root.default.acl_submit_applications/name valuejcsong2,yanxu2 /value /property property nameyarn.scheduler.capacity.root.default.acl_administer_queue/name valuejcsong2,yanxu2 /value /property property nameyarn.scheduler.capacity.root.default.capacity/name value35/value /property property nameyarn.scheduler.capacity.root.extract.acl_submit_applications/name valuejcsong2 /value /property property nameyarn.scheduler.capacity.root.extract.acl_administer_queue/name valuejcsong2 /value /property property nameyarn.scheduler.capacity.root.extract.capacity/name value15/value /property property nameyarn.scheduler.capacity.root.report.acl_submit_applications/name valueyanxu2 /value /property property nameyarn.scheduler.capacity.root.report.acl_administer_queue/name valueyanxu2 /value /property property nameyarn.scheduler.capacity.root.report.capacity/name value35/value /property property nameyarn.scheduler.capacity.root.tool.acl_submit_applications/name value /value /property property nameyarn.scheduler.capacity.root.tool.acl_administer_queue/name value /value /property property nameyarn.scheduler.capacity.root.tool.capacity/name value15/value /property /configuration ___ I have enabled the acl in yarn-site.xml, but the user jcsong2 can submit applications to every queue. The queue acl does't work! And the queue used capacity more than it was configured! Capacity scheduler configuration ACLs not work. --- Key: YARN-2973 URL: https://issues.apache.org/jira/browse/YARN-2973 Project: Hadoop YARN Issue Type: Bug
[jira] [Updated] (YARN-2973) Capacity scheduler configuration ACLs not work.
[ https://issues.apache.org/jira/browse/YARN-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Song updated YARN-2973: - Issue Type: Improvement (was: Bug) Capacity scheduler configuration ACLs not work. --- Key: YARN-2973 URL: https://issues.apache.org/jira/browse/YARN-2973 Project: Hadoop YARN Issue Type: Improvement Components: capacityscheduler Affects Versions: 2.5.0 Environment: ubuntu 12.04, cloudera manager, cdh5.2.1 Reporter: Jimmy Song Assignee: Rohith Labels: acl, capacity-scheduler, yarn I follow this page to configure yarn: http://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html. I configured YARN to use capacity scheduler in yarn-site.xml with yarn.resourcemanager.scheduler.class for org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler. Then modified capacity-scheduler.xml, ___ ?xml version=1.0? configuration property nameyarn.scheduler.capacity.root.queues/name valuedefault,extract,report,tool/value /property property nameyarn.scheduler.capacity.root.state/name valueRUNNING/value /property property nameyarn.scheduler.capacity.root.default.acl_submit_applications/name valuejcsong2, y2 /value /property property nameyarn.scheduler.capacity.root.default.acl_administer_queue/name valuejcsong2, y2 /value /property property nameyarn.scheduler.capacity.root.default.capacity/name value35/value /property property nameyarn.scheduler.capacity.root.extract.acl_submit_applications/name valuejcsong2 /value /property property nameyarn.scheduler.capacity.root.extract.acl_administer_queue/name valuejcsong2 /value /property property nameyarn.scheduler.capacity.root.extract.capacity/name value15/value /property property nameyarn.scheduler.capacity.root.report.acl_submit_applications/name valuey2 /value /property property nameyarn.scheduler.capacity.root.report.acl_administer_queue/name valuey2 /value /property property nameyarn.scheduler.capacity.root.report.capacity/name value35/value /property property nameyarn.scheduler.capacity.root.tool.acl_submit_applications/name value /value /property property nameyarn.scheduler.capacity.root.tool.acl_administer_queue/name value /value /property property nameyarn.scheduler.capacity.root.tool.capacity/name value15/value /property /configuration ___ I have enabled the acl in yarn-site.xml, but the user jcsong2 can submit applications to every queue. The queue acl does't work! And the queue used capacity more than it was configured! -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2973) Capacity scheduler configuration ACLs not work.
[ https://issues.apache.org/jira/browse/YARN-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14249642#comment-14249642 ] Jimmy Song commented on YARN-2973: -- The child queue inherits the ACL of root queue In the capacity scheduler configuration. The child queues' ACL is the UNION of the root queue. So the configurations of child queue will not work if the root queue not configured, in other word, leave the root queue in default configuration which allow any user to submit applications. Capacity scheduler configuration ACLs not work. --- Key: YARN-2973 URL: https://issues.apache.org/jira/browse/YARN-2973 Project: Hadoop YARN Issue Type: Improvement Components: capacityscheduler Affects Versions: 2.5.0 Environment: ubuntu 12.04, cloudera manager, cdh5.2.1 Reporter: Jimmy Song Assignee: Rohith Labels: acl, capacity-scheduler, yarn I follow this page to configure yarn: http://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html. I configured YARN to use capacity scheduler in yarn-site.xml with yarn.resourcemanager.scheduler.class for org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler. Then modified capacity-scheduler.xml, ___ ?xml version=1.0? configuration property nameyarn.scheduler.capacity.root.queues/name valuedefault,extract,report,tool/value /property property nameyarn.scheduler.capacity.root.state/name valueRUNNING/value /property property nameyarn.scheduler.capacity.root.default.acl_submit_applications/name valuejcsong2, y2 /value /property property nameyarn.scheduler.capacity.root.default.acl_administer_queue/name valuejcsong2, y2 /value /property property nameyarn.scheduler.capacity.root.default.capacity/name value35/value /property property nameyarn.scheduler.capacity.root.extract.acl_submit_applications/name valuejcsong2 /value /property property nameyarn.scheduler.capacity.root.extract.acl_administer_queue/name valuejcsong2 /value /property property nameyarn.scheduler.capacity.root.extract.capacity/name value15/value /property property nameyarn.scheduler.capacity.root.report.acl_submit_applications/name valuey2 /value /property property nameyarn.scheduler.capacity.root.report.acl_administer_queue/name valuey2 /value /property property nameyarn.scheduler.capacity.root.report.capacity/name value35/value /property property nameyarn.scheduler.capacity.root.tool.acl_submit_applications/name value /value /property property nameyarn.scheduler.capacity.root.tool.acl_administer_queue/name value /value /property property nameyarn.scheduler.capacity.root.tool.capacity/name value15/value /property /configuration ___ I have enabled the acl in yarn-site.xml, but the user jcsong2 can submit applications to every queue. The queue acl does't work! And the queue used capacity more than it was configured! -- This message was sent by Atlassian JIRA (v6.3.4#6332)
