Jon Bringhurst created YARN-10044: ------------------------------------- Summary: ResourceManager NPE - Error in handling event type NODE_UPDATE to the Event Dispatcher Key: YARN-10044 URL: https://issues.apache.org/jira/browse/YARN-10044 Project: Hadoop YARN Issue Type: Improvement Affects Versions: 2.9.2 Reporter: Jon Bringhurst
{noformat} 2019-12-18 00:46:42,577 [INFO] [IPC Server handler 48 on 8030] resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) - USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID= application_1575937033226_0426 CONTAINERID=container_e18_1575937033226_0426_01_000389 RESOURCE=<memory:5120, vCores:12> 2019-12-18 00:46:42,577 [INFO] [IPC Server handler 48 on 8030] rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) - container_e18_1575937033226_0426_01_000392 Container Transitioned from ACQUIRED to RELEASED 2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030] resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) - USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID= application_1575937033226_0426 CONTAINERID=container_e18_1575937033226_0426_01_000392 RESOURCE=<memory:5120, vCores:12> 2019-12-18 00:46:42,578 [INFO] [SchedulerEventDispatcher:Event Processor] allocator.AbstractContainerAllocator.getCSAssignmentFromAllocateResult(AbstractContainerAllocator.java:126) - assignedContainer application attempt=appattempt_1575937033226 _0426_000001 container=null queue=org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator@73179037 clusterResource=<memory:151592720, vCores:115668> type=OFF_SWITCH requestedPartition=concourse 2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030] rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) - container_e18_1575937033226_0426_01_000393 Container Transitioned from ACQUIRED to RELEASED 2019-12-18 00:46:42,578 [INFO] [SchedulerEventDispatcher:Event Processor] capacity.ParentQueue.assignContainers(ParentQueue.java:616) - assignedContainer queue=root usedCapacity=0.68548673 absoluteUsedCapacity=0.68548673 used=<memory:23682935, vC ores:11062> cluster=<memory:151592720, vCores:115668> 2019-12-18 00:46:42,578 [INFO] [IPC Server handler 48 on 8030] resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) - USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID= application_1575937033226_0426 CONTAINERID=container_e18_1575937033226_0426_01_000393 RESOURCE=<memory:5120, vCores:12> 2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030] rmcontainer.RMContainerImpl.handle(RMContainerImpl.java:486) - container_e18_1575937033226_0426_01_000394 Container Transitioned from ACQUIRED to RELEASED 2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030] resourcemanager.RMAuditLogger.logSuccess(RMAuditLogger.java:200) - USER=vapp5003 IP=10.186.103.102 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID= application_1575937033226_0426 CONTAINERID=container_e18_1575937033226_0426_01_000394 RESOURCE=<memory:5120, vCores:12> 2019-12-18 00:46:42,579 [INFO] [IPC Server handler 48 on 8030] scheduler.AppSchedulingInfo.updatePendingResources(AppSchedulingInfo.java:250) - checking for deactivate of application :application_1575937033226_0426 2019-12-18 00:46:42,580 [FATAL] [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor.run(EventDispatcher.java:75) - Error in handling event type NODE_UPDATE to the Event Dispatcher java.lang.NullPointerException at org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo.allocate(AppSchedulingInfo.java:448) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerApp.apply(FiCaSchedulerApp.java:533) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.tryCommit(CapacityScheduler.java:2563) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.submitResourceCommitRequest(CapacityScheduler.java:2429) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateOrReserveNewContainers(CapacityScheduler.java:1359) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainerOnSingleNode(CapacityScheduler.java:1348) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainersToNode(CapacityScheduler.java:1437) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocateContainersToNode(CapacityScheduler.java:1208) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.nodeUpdate(CapacityScheduler.java:1070) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:1479) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:153) at org.apache.hadoop.yarn.event.EventDispatcher$EventProcessor.run(EventDispatcher.java:66) at java.lang.Thread.run(Thread.java:748) 2019-12-18 00:46:42,580 [INFO] [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor.run(EventDispatcher.java:79) - Exiting, bbye.. 2019-12-18 00:46:42,651 [ERROR] [Thread[Thread-20,5,main]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover.run(AbstractDelegationTokenSecretManager.java:696) - ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2019-12-18 00:46:42,676 [INFO] [shutdown-hook-0] log.Slf4jLog.info(Slf4jLog.java:67) - Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8088 2019-12-18 00:46:42,810 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher is draining to stop, ignoring any new events. 2019-12-18 00:46:42,812 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher is draining to stop, ignoring any new events. 2019-12-18 00:46:42,814 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher is draining to stop, ignoring any new events. 2019-12-18 00:46:42,816 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher is draining to stop, ignoring any new events. 2019-12-18 00:46:42,818 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:159) - AsyncDispatcher is draining to stop, ignoring any new events. 2019-12-18 00:46:42,918 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for AsyncDispatcher to drain. Thread state is :RUNNABLE 2019-12-18 00:46:43,009 [INFO] [Socket Reader #1 for port 8030] ipc.Server$Connection.saslProcess(Server.java:1820) - Auth successful for appattempt_1559780328064_0296_000004 (auth:SIMPLE) 2019-12-18 00:46:43,018 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for AsyncDispatcher to drain. Thread state is :RUNNABLE 2019-12-18 00:46:43,119 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for AsyncDispatcher to drain. Thread state is :RUNNABLE 2019-12-18 00:46:43,219 [INFO] [shutdown-hook-0] event.AsyncDispatcher.serviceStop(AsyncDispatcher.java:169) - Waiting for AsyncDispatcher to drain. Thread state is :RUNNABLE {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org