[
https://issues.apache.org/jira/browse/AMBARI-19556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Akhil PB updated AMBARI-19556:
------------------------------
Description:
====================================
Info
This cluster has gone through below upgrade.
Ambari 2.4.0.0 - Ambari 2.4.2.0-115
HDP 2.5.0 - HDP 2.5.3.0.-14
Cluster Details : https://github.com/hortonworks/HCube#stanley-hotel-hdp-25
Please login with okta credential to these cluster machines
====================================
1] Create a queue as per attached screenshort where 2 leaf queue name are the
same
i.e root.hive.tpch and root.hbase.tpch
2] Save and restart
Actual Result:
RM would not start with below exception in logs.
{code}
2016-12-01 05:04:29,340 INFO service.AbstractService
(AbstractService.java:noteFailure(272)) - Service
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler
failed in state INITED; cause: java.io.IOException: Two leaf queues were named
tpch. Leaf queue names must be distinct
java.io.IOException: Two leaf queues were named tpch. Leaf queue names must be
distinct
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:659)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:496)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:299)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:330)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:584)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:998)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:266)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1228)
2016-12-01 05:04:29,343 INFO service.AbstractService
(AbstractService.java:noteFailure(272)) - Service RMActiveServices failed in
state INITED; cause: org.apache.hadoop.service.ServiceStateException:
java.io.IOException: Two leaf queues were named tpch. Leaf queue names must be
distinct
org.apache.hadoop.service.ServiceStateException: java.io.IOException: Two leaf
queues were named tpch. Leaf queue names must be distinct
at
org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
at
org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:584)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:998)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:266)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1228)
Caused by: java.io.IOException: Two leaf queues were named tpch. Leaf queue
names must be distinct
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:659)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:496)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:299)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:330)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
... 7 more
2016-12-01 05:04:29,344 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stop(211)) - Stopping ResourceManager metrics system...
2016-12-01 05:04:29,345 INFO impl.MetricsSinkAdapter
(MetricsSinkAdapter.java:publishMetricsFromQueue(141)) - timeline thread
interrupted.
2016-12-01 05:04:29,346 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stop(217)) - ResourceManager metrics system stopped.
2016-12-01 05:04:29,346 INFO timeline.HadoopTimelineMetricsSink
(HadoopTimelineMetricsSink.java:run(416)) - Closing HadoopTimelineMetricSink.
Flushing metrics to collector...
2016-12-01 05:04:29,346 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:shutdown(606)) - ResourceManager metrics system
shutdown complete.
2016-12-01 05:04:29,347 INFO event.AsyncDispatcher
(AsyncDispatcher.java:serviceStop(142)) - AsyncDispatcher is draining to stop,
igonring any new events.
2016-12-01 05:04:29,347 INFO service.AbstractService
(AbstractService.java:noteFailure(272)) - Service ResourceManager failed in
state INITED; cause: org.apache.hadoop.service.ServiceStateException:
java.io.IOException: Two leaf queues were named tpch. Leaf queue names must be
distinct
org.apache.hadoop.service.ServiceStateException: java.io.IOException: Two leaf
queues were named tpch. Leaf queue names must be distinct
at
org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
at
org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:584)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:998)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:266)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1228)
Caused by: java.io.IOException: Two leaf queues were named tpch. Leaf queue
names must be distinct
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:659)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:496)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:299)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:330)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
... 7 more
2016-12-01 05:04:29,347 INFO resourcemanager.ResourceManager
(ResourceManager.java:transitionToStandby(1070)) - Transitioning to standby
state
2016-12-01 05:04:29,348 INFO resourcemanager.ResourceManager
(ResourceManager.java:transitionToStandby(1077)) - Transitioned to standby state
2016-12-01 05:04:29,348 FATAL resourcemanager.ResourceManager
(ResourceManager.java:main(1232)) - Error starting ResourceManager
org.apache.hadoop.service.ServiceStateException: java.io.IOException: Two leaf
queues were named tpch. Leaf queue names must be distinct
at
org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
at
org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:584)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:998)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:266)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1228)
Caused by: java.io.IOException: Two leaf queues were named tpch. Leaf queue
names must be distinct
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:659)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:496)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:299)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:330)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
... 7 more
2016-12-01 05:04:29,350 INFO resourcemanager.ResourceManager
(LogAdapter.java:info(45)) - SHUTDOWN_MSG:
{code}
> Ambari Yarn Queue Manager allows two same queue name
> ----------------------------------------------------
>
> Key: AMBARI-19556
> URL: https://issues.apache.org/jira/browse/AMBARI-19556
> Project: Ambari
> Issue Type: Bug
> Components: ambari-views
> Affects Versions: 2.4.2
> Reporter: Akhil PB
> Assignee: Akhil PB
> Fix For: 2.5.0
>
>
> ====================================
> Info
> This cluster has gone through below upgrade.
> Ambari 2.4.0.0 - Ambari 2.4.2.0-115
> HDP 2.5.0 - HDP 2.5.3.0.-14
> Cluster Details : https://github.com/hortonworks/HCube#stanley-hotel-hdp-25
> Please login with okta credential to these cluster machines
> ====================================
> 1] Create a queue as per attached screenshort where 2 leaf queue name are the
> same
> i.e root.hive.tpch and root.hbase.tpch
> 2] Save and restart
> Actual Result:
> RM would not start with below exception in logs.
> {code}
> 2016-12-01 05:04:29,340 INFO service.AbstractService
> (AbstractService.java:noteFailure(272)) - Service
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler
> failed in state INITED; cause: java.io.IOException: Two leaf queues were
> named tpch. Leaf queue names must be distinct
> java.io.IOException: Two leaf queues were named tpch. Leaf queue names must
> be distinct
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:659)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:496)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:299)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:330)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> at
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:584)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:998)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:266)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1228)
> 2016-12-01 05:04:29,343 INFO service.AbstractService
> (AbstractService.java:noteFailure(272)) - Service RMActiveServices failed in
> state INITED; cause: org.apache.hadoop.service.ServiceStateException:
> java.io.IOException: Two leaf queues were named tpch. Leaf queue names must
> be distinct
> org.apache.hadoop.service.ServiceStateException: java.io.IOException: Two
> leaf queues were named tpch. Leaf queue names must be distinct
> at
> org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
> at
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:584)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:998)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:266)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1228)
> Caused by: java.io.IOException: Two leaf queues were named tpch. Leaf queue
> names must be distinct
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:659)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:496)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:299)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:330)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> ... 7 more
> 2016-12-01 05:04:29,344 INFO impl.MetricsSystemImpl
> (MetricsSystemImpl.java:stop(211)) - Stopping ResourceManager metrics
> system...
> 2016-12-01 05:04:29,345 INFO impl.MetricsSinkAdapter
> (MetricsSinkAdapter.java:publishMetricsFromQueue(141)) - timeline thread
> interrupted.
> 2016-12-01 05:04:29,346 INFO impl.MetricsSystemImpl
> (MetricsSystemImpl.java:stop(217)) - ResourceManager metrics system stopped.
> 2016-12-01 05:04:29,346 INFO timeline.HadoopTimelineMetricsSink
> (HadoopTimelineMetricsSink.java:run(416)) - Closing HadoopTimelineMetricSink.
> Flushing metrics to collector...
> 2016-12-01 05:04:29,346 INFO impl.MetricsSystemImpl
> (MetricsSystemImpl.java:shutdown(606)) - ResourceManager metrics system
> shutdown complete.
> 2016-12-01 05:04:29,347 INFO event.AsyncDispatcher
> (AsyncDispatcher.java:serviceStop(142)) - AsyncDispatcher is draining to
> stop, igonring any new events.
> 2016-12-01 05:04:29,347 INFO service.AbstractService
> (AbstractService.java:noteFailure(272)) - Service ResourceManager failed in
> state INITED; cause: org.apache.hadoop.service.ServiceStateException:
> java.io.IOException: Two leaf queues were named tpch. Leaf queue names must
> be distinct
> org.apache.hadoop.service.ServiceStateException: java.io.IOException: Two
> leaf queues were named tpch. Leaf queue names must be distinct
> at
> org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
> at
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:584)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:998)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:266)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1228)
> Caused by: java.io.IOException: Two leaf queues were named tpch. Leaf queue
> names must be distinct
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:659)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:496)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:299)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:330)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> ... 7 more
> 2016-12-01 05:04:29,347 INFO resourcemanager.ResourceManager
> (ResourceManager.java:transitionToStandby(1070)) - Transitioning to standby
> state
> 2016-12-01 05:04:29,348 INFO resourcemanager.ResourceManager
> (ResourceManager.java:transitionToStandby(1077)) - Transitioned to standby
> state
> 2016-12-01 05:04:29,348 FATAL resourcemanager.ResourceManager
> (ResourceManager.java:main(1232)) - Error starting ResourceManager
> org.apache.hadoop.service.ServiceStateException: java.io.IOException: Two
> leaf queues were named tpch. Leaf queue names must be distinct
> at
> org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
> at
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:584)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:998)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:266)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1228)
> Caused by: java.io.IOException: Two leaf queues were named tpch. Leaf queue
> names must be distinct
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:659)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:649)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:496)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:299)
> at
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:330)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> ... 7 more
> 2016-12-01 05:04:29,350 INFO resourcemanager.ResourceManager
> (LogAdapter.java:info(45)) - SHUTDOWN_MSG:
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
