Jon Bringhurst created YARN-10044:
-------------------------------------
Summary: ResourceManager NPE - Error in handling event type
NODE_UPDATE to the Event Dispatcher
Key: YARN-10044
URL: https://issues.apache.org/jira/browse/YARN-10044
Project: Hadoop YARN
Issue Type: Improvement
Affects Versions: 2.9.2
Reporter: Jon Bringhurst
{noformat}
2019-12-18 00:46:42,577 [INFO] [IPC Server handler 48 on 8030]
resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) -
USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container
TARGET=SchedulerApp RESULT=SUCCESS APPID=
application_1575937033226_0426
CONTAINERID=container_e18_1575937033226_0426_01_000389 RESOURCE=<memory:5120,
vCores:12>
2019-12-18 00:46:42,577 [INFO] [IPC Server handler 48 on 8030]
rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) -
container_e18_1575937033226_0426_01_000392 Container Transitioned from ACQUIRED
to RELEASED
2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030]
resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) -
USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container
TARGET=SchedulerApp RESULT=SUCCESS APPID=
application_1575937033226_0426
CONTAINERID=container_e18_1575937033226_0426_01_000392 RESOURCE=<memory:5120,
vCores:12>
2019-12-18 00:46:42,578 [INFO] [SchedulerEventDispatcher:Event Processor]
allocator.AbstractContainerAllocator.getCSAssignmentFromAllocateResult(AbstractContainerAllocator.java:126)
- assignedContainer application attempt=appattempt_1575937033226
_0426_000001 container=null
queue=org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator@73179037
clusterResource=<memory:151592720, vCores:115668> type=OFF_SWITCH
requestedPartition=concourse
2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030]
rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) -
container_e18_1575937033226_0426_01_000393 Container Transitioned from ACQUIRED
to RELEASED
2019-12-18 00:46:42,578 [INFO] [SchedulerEventDispatcher:Event Processor]
capacity.ParentQueue.assignContainers(ParentQueue.java:616) - assignedContainer
queue=root usedCapacity=0.68548673 absoluteUsedCapacity=0.68548673
used=<memory:23682935, vC
ores:11062> cluster=<memory:151592720, vCores:115668>
2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030]
resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) -
USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container
TARGET=SchedulerApp RESULT=SUCCESS APPID=
application_1575937033226_0426
CONTAINERID=container_e18_1575937033226_0426_01_000393 RESOURCE=<memory:5120,
vCores:12>
2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030]
rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) -
container_e18_1575937033226_0426_01_000394 Container Transitioned from ACQUIRED
to RELEASED
2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030]
resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) -
USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container
TARGET=SchedulerApp RESULT=SUCCESS APPID=
application_1575937033226_0426
CONTAINERID=container_e18_1575937033226_0426_01_000394 RESOURCE=<memory:5120,
vCores:12>
2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030]
scheduler.AppSchedulingInfo.updatePendingResources(AppSchedulingInfo.java:250)
- checking for deactivate of application :application_1575937033226_0426
2019-12-18 00:46:42,580 [FATAL] [SchedulerEventDispatcher:Event Processor]
event.EventDispatcher$EventProcessor.run(EventDispatcher.java:75) - Error in
handling event type NODE_UPDATE to the Event Dispatcher
java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo.allocate(AppSchedulingInfo.java:448)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerApp.apply(FiCaSchedulerApp.java:533)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.tryCommit(CapacityScheduler.java:2563)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.submitResourceCommitRequest(CapacityScheduler.java:2429)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateOrReserveNewContainers(CapacityScheduler.java:1359)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainerOnSingleNode(CapacityScheduler.java:1348)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainersToNode(CapacityScheduler.java:1437)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainersToNode(CapacityScheduler.java:1208)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.nodeUpdate(CapacityScheduler.java:1070)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:1479)
at
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:153)
at
org.apache.hadoop.yarn.event.EventDispatcher$EventProcessor.run(EventDispatcher.java:66)
at java.lang.Thread.run(Thread.java:748)
2019-12-18 00:46:42,580 [INFO] [SchedulerEventDispatcher:Event Processor]
event.EventDispatcher$EventProcessor.run(EventDispatcher.java:79) - Exiting,
bbye..
2019-12-18 00:46:42,651 [ERROR] [Thread[Thread-20,5,main]]
delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover.run(AbstractDelegationTokenSecretManager.java:696)
- ExpiredTokenRemover received java.lang.InterruptedException: sleep
interrupted
2019-12-18 00:46:42,676 [INFO] [shutdown-hook-0]
log.Slf4jLog.info(Slf4jLog.java:67) - Stopped
[email protected]:8088
2019-12-18 00:46:42,810 [INFO] [shutdown-hook-0]
event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher
is draining to stop, ignoring any new events.
2019-12-18 00:46:42,812 [INFO] [shutdown-hook-0]
event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher
is draining to stop, ignoring any new events.
2019-12-18 00:46:42,814 [INFO] [shutdown-hook-0]
event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher
is draining to stop, ignoring any new events.
2019-12-18 00:46:42,816 [INFO] [shutdown-hook-0]
event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher
is draining to stop, ignoring any new events.
2019-12-18 00:46:42,818 [INFO] [shutdown-hook-0]
event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher
is draining to stop, ignoring any new events.
2019-12-18 00:46:42,918 [INFO] [shutdown-hook-0]
event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for
AsyncDispatcher to drain. Thread state is :RUNNABLE
2019-12-18 00:46:43,009 [INFO] [Socket Reader #1 for port 8030]
ipc.Server$Connection.saslProcess(Server.java:1820) - Auth successful for
appattempt_1559780328064_0296_000004 (auth:SIMPLE)
2019-12-18 00:46:43,018 [INFO] [shutdown-hook-0]
event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for
AsyncDispatcher to drain. Thread state is :RUNNABLE
2019-12-18 00:46:43,119 [INFO] [shutdown-hook-0]
event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for
AsyncDispatcher to drain. Thread state is :RUNNABLE
2019-12-18 00:46:43,219 [INFO] [shutdown-hook-0]
event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for
AsyncDispatcher to drain. Thread state is :RUNNABLE
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
