Diego created YARN-8641:
----------------------------
Summary: Refresh Queues ResourceManager - Failed to re-init queues
: Unable to construct queue ordering policy=fifo queue=root.llap
Key: YARN-8641
URL: https://issues.apache.org/jira/browse/YARN-8641
Project: Hadoop YARN
Issue Type: Bug
Components: capacity scheduler, resourcemanager
Affects Versions: 3.1.0
Environment: -Ambari 2.7
-HDP3
-YARN
{{$ yarn version}}
{{Hadoop 3.1.0.3.0.0.0-1634}}
{{Source code repository [email protected]:hortonworks/hadoop.git -r
ab6fed463d44250e0f1cc433987c9de0592db596}}
{{Compiled by jenkins on 2018-07-12T20:32Z}}
{{Compiled with protoc 2.5.0}}
{{From source with checksum 13431af4b6ec467e2496f7dd95d9dd}}
{{This command was run using
/usr/hdp/3.0.0.0-1634/hadoop/hadoop-common-3.1.0.3.0.0.0-1634.jar}}
Reporter: Diego
Steps:
in Ambari (2.7) Yarn Queue manager, I've created a leaf queue as follows:
{{/root}}
{{--/default}}
{{--/llap}}
{{----/test}}
After doing save and refresh, the refresh YARN Capacity Scheduler fails. It
does take the changes and the queue seams to work fine if Yarn is restarted.
the refresh YARN Capacity Scheduler error is:
resource_management.core.exceptions.ExecutionFailed: Execution of ' export
HADOOP_LIBEXEC_DIR=/usr/hdp/3.0.0.0-1634/hadoop/libexec &&
/usr/hdp/3.0.0.0-1634/hadoop-yarn/bin/yarn rmadmin -refreshQueues' returned
255. 18/08/09 15:08:51 INFO client.ConfiguredRMFailoverProxyProvider: Failing
over to rm2
refreshQueues: java.io.IOException: Failed to re-init queues : Unable to
construct queue ordering policy=fifo queue=root.llap
at
org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:38)
at
org.apache.hadoop.yarn.server.resourcemanager.AdminService.logAndWrapException(AdminService.java:913)
at
org.apache.hadoop.yarn.server.resourcemanager.AdminService.refreshQueues(AdminService.java:399)
at
org.apache.hadoop.yarn.server.api.impl.pb.service.ResourceManagerAdministrationProtocolPBServiceImpl.refreshQueues(ResourceManagerAdministrationProtocolPBServiceImpl.java:114)
at
org.apache.hadoop.yarn.proto.ResourceManagerAdministrationProtocol$ResourceManagerAdministrationProtocolService$2.callBlockingMethod(ResourceManagerAdministrationProtocol.java:271)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991)
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872)
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1688)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678)
Caused by: java.io.IOException: Failed to re-init queues : Unable to construct
queue ordering policy=fifo queue=root.llap
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:476)
at
org.apache.hadoop.yarn.server.resourcemanager.AdminService.refreshQueues(AdminService.java:423)
at
org.apache.hadoop.yarn.server.resourcemanager.AdminService.refreshQueues(AdminService.java:394)
... 10 more
Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Unable to
construct queue ordering policy=fifo queue=root.llap
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration.getQueueOrderingPolicy(CapacitySchedulerConfiguration.java:1505)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue.setupQueueConfigs(ParentQueue.java:143)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue.<init>(ParentQueue.java:110)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager.parseQueue(CapacitySchedulerQueueManager.java:275)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager.parseQueue(CapacitySchedulerQueueManager.java:283)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager.reinitializeQueues(CapacitySchedulerQueueManager.java:171)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitializeQueues(CapacityScheduler.java:725)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:471)
... 12 more
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
