[
https://issues.apache.org/jira/browse/TEZ-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tangjunjie updated TEZ-1984:
----------------------------
Comment: was deleted
(was: This ResourceManager Log:
2015-01-22 00:27:24,505 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000005 Container Transitioned from ALLOCATED to
ACQUIRED
2015-01-22 00:27:25,150 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000005 Container Transitioned from ACQUIRED to
RUNNING
2015-01-22 00:27:25,507 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo:
checking for deactivate...
2015-01-22 00:27:28,154 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000005 Container Transitioned from RUNNING to
COMPLETED
2015-01-22 00:27:28,155 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt:
Completed container: container_1421076019070_0161_01_000005 in state: COMPLETED
event:FINISHED
2015-01-22 00:27:28,155 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000005
2015-01-22 00:27:28,155 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released
container container_1421076019070_0161_01_000005 of capacity <memory:1024,
vCores:1> on host localhost:8041, which currently has 1 containers,
<memory:1536, vCores:1> used and <memory:2127, vCores:3> available, release
resources=true
2015-01-22 00:27:28,155 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Application attempt appattempt_1421076019070_0161_000001 released container
container_1421076019070_0161_01_000005 on node: host: localhost:8041
#containers=1 available=2127 used=1536 with event: FINISHED
2015-01-22 00:27:29,156 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:27:30,158 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:29:22,730 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt:
Raising locality level from RACK_LOCAL to NODE_LOCAL at priority 2
2015-01-22 00:29:22,731 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000006 Container Transitioned from NEW to
ALLOCATED
2015-01-22 00:29:22,731 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000006
2015-01-22 00:29:22,731 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Assigned
container container_1421076019070_0161_01_000006 of capacity <memory:1024,
vCores:1> on host localhost:8041, which has 2 containers, <memory:2560,
vCores:2> used and <memory:1103, vCores:2> available after allocation
2015-01-22 00:29:23,733 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000006 Container Transitioned from ALLOCATED to
ACQUIRED
2015-01-22 00:29:24,332 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000006 Container Transitioned from ACQUIRED to
RUNNING
2015-01-22 00:29:24,735 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo:
checking for deactivate...
2015-01-22 00:29:27,335 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000006 Container Transitioned from RUNNING to
COMPLETED
2015-01-22 00:29:27,336 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt:
Completed container: container_1421076019070_0161_01_000006 in state: COMPLETED
event:FINISHED
2015-01-22 00:29:27,336 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000006
2015-01-22 00:29:27,336 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released
container container_1421076019070_0161_01_000006 of capacity <memory:1024,
vCores:1> on host localhost:8041, which currently has 1 containers,
<memory:1536, vCores:1> used and <memory:2127, vCores:3> available, release
resources=true
2015-01-22 00:29:27,336 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Application attempt appattempt_1421076019070_0161_000001 released container
container_1421076019070_0161_01_000006 on node: host: localhost:8041
#containers=1 available=2127 used=1536 with event: FINISHED
2015-01-22 00:29:28,337 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:29:28,744 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000007 Container Transitioned from NEW to
ALLOCATED
2015-01-22 00:29:28,744 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000007
2015-01-22 00:29:28,744 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Assigned
container container_1421076019070_0161_01_000007 of capacity <memory:1024,
vCores:1> on host localhost:8041, which has 2 containers, <memory:2560,
vCores:2> used and <memory:1103, vCores:2> available after allocation
2015-01-22 00:29:29,339 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:29:29,744 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000007 Container Transitioned from ALLOCATED to
ACQUIRED
2015-01-22 00:29:30,340 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000007 Container Transitioned from ACQUIRED to
RUNNING
2015-01-22 00:29:30,746 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo:
checking for deactivate...
2015-01-22 00:29:33,344 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000007 Container Transitioned from RUNNING to
COMPLETED
2015-01-22 00:29:33,344 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt:
Completed container: container_1421076019070_0161_01_000007 in state: COMPLETED
event:FINISHED
2015-01-22 00:29:33,344 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000007
2015-01-22 00:29:33,344 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released
container container_1421076019070_0161_01_000007 of capacity <memory:1024,
vCores:1> on host localhost:8041, which currently has 1 containers,
<memory:1536, vCores:1> used and <memory:2127, vCores:3> available, release
resources=true
2015-01-22 00:29:33,344 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Application attempt appattempt_1421076019070_0161_000001 released container
container_1421076019070_0161_01_000007 on node: host: localhost:8041
#containers=1 available=2127 used=1536 with event: FINISHED
2015-01-22 00:29:34,345 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:29:34,755 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000008 Container Transitioned from NEW to
ALLOCATED
2015-01-22 00:29:34,756 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000008
2015-01-22 00:29:34,756 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Assigned
container container_1421076019070_0161_01_000008 of capacity <memory:1024,
vCores:1> on host localhost:8041, which has 2 containers, <memory:2560,
vCores:2> used and <memory:1103, vCores:2> available after allocation
2015-01-22 00:29:35,347 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:29:35,755 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000008 Container Transitioned from ALLOCATED to
ACQUIRED
2015-01-22 00:29:36,349 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000008 Container Transitioned from ACQUIRED to
RUNNING
2015-01-22 00:29:36,758 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo:
checking for deactivate...
2015-01-22 00:29:39,353 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000008 Container Transitioned from RUNNING to
COMPLETED
2015-01-22 00:29:39,353 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt:
Completed container: container_1421076019070_0161_01_000008 in state: COMPLETED
event:FINISHED
2015-01-22 00:29:39,353 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000008
2015-01-22 00:29:39,354 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released
container container_1421076019070_0161_01_000008 of capacity <memory:1024,
vCores:1> on host localhost:8041, which currently has 1 containers,
<memory:1536, vCores:1> used and <memory:2127, vCores:3> available, release
resources=true
2015-01-22 00:29:39,354 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Application attempt appattempt_1421076019070_0161_000001 released container
container_1421076019070_0161_01_000008 on node: host: localhost:8041
#containers=1 available=2127 used=1536 with event: FINISHED
2015-01-22 00:29:40,355 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:29:40,768 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000009 Container Transitioned from NEW to
ALLOCATED
2015-01-22 00:29:40,768 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000009
2015-01-22 00:29:40,769 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Assigned
container container_1421076019070_0161_01_000009 of capacity <memory:1024,
vCores:1> on host localhost:8041, which has 2 containers, <memory:2560,
vCores:2> used and <memory:1103, vCores:2> available after allocation
2015-01-22 00:29:41,356 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:29:41,767 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000009 Container Transitioned from ALLOCATED to
ACQUIRED
2015-01-22 00:29:42,358 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000009 Container Transitioned from ACQUIRED to
RUNNING
2015-01-22 00:29:42,769 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo:
checking for deactivate...
2015-01-22 00:29:45,362 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000009 Container Transitioned from RUNNING to
COMPLETED
2015-01-22 00:29:45,362 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt:
Completed container: container_1421076019070_0161_01_000009 in state: COMPLETED
event:FINISHED
2015-01-22 00:29:45,362 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000009
2015-01-22 00:29:45,362 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released
container container_1421076019070_0161_01_000009 of capacity <memory:1024,
vCores:1> on host localhost:8041, which currently has 1 containers,
<memory:1536, vCores:1> used and <memory:2127, vCores:3> available, release
resources=true
2015-01-22 00:29:45,363 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Application attempt appattempt_1421076019070_0161_000001 released container
container_1421076019070_0161_01_000009 on node: host: localhost:8041
#containers=1 available=2127 used=1536 with event: FINISHED
2015-01-22 00:29:46,364 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:29:47,365 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
^C
[hdfs@test demo]$ clear
[hdfs@test demo]$ tail -f
/var/log/hadoop-yarn/hadoop-cmf-yarn-RESOURCEMANAGER-localhost.log.out
2015-01-22 00:29:41,767 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000009 Container Transitioned from ALLOCATED to
ACQUIRED
2015-01-22 00:29:42,358 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000009 Container Transitioned from ACQUIRED to
RUNNING
2015-01-22 00:29:42,769 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo:
checking for deactivate...
2015-01-22 00:29:45,362 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000009 Container Transitioned from RUNNING to
COMPLETED
2015-01-22 00:29:45,362 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt:
Completed container: container_1421076019070_0161_01_000009 in state: COMPLETED
event:FINISHED
2015-01-22 00:29:45,362 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000009
2015-01-22 00:29:45,362 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released
container container_1421076019070_0161_01_000009 of capacity <memory:1024,
vCores:1> on host localhost:8041, which currently has 1 containers,
<memory:1536, vCores:1> used and <memory:2127, vCores:3> available, release
resources=true
2015-01-22 00:29:45,363 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Application attempt appattempt_1421076019070_0161_000001 released container
container_1421076019070_0161_01_000009 on node: host: localhost:8041
#containers=1 available=2127 used=1536 with event: FINISHED
2015-01-22 00:29:46,364 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:29:47,365 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:30:44,888 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt:
Raising locality level from RACK_LOCAL to NODE_LOCAL at priority 2
2015-01-22 00:30:44,888 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000010 Container Transitioned from NEW to
ALLOCATED
2015-01-22 00:30:44,888 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000010
2015-01-22 00:30:44,888 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Assigned
container container_1421076019070_0161_01_000010 of capacity <memory:1024,
vCores:1> on host localhost:8041, which has 2 containers, <memory:2560,
vCores:2> used and <memory:1103, vCores:2> available after allocation
2015-01-22 00:30:45,889 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000010 Container Transitioned from ALLOCATED to
ACQUIRED
2015-01-22 00:30:46,458 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000010 Container Transitioned from ACQUIRED to
RUNNING
2015-01-22 00:30:46,891 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo:
checking for deactivate...
2015-01-22 00:30:49,462 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000010 Container Transitioned from RUNNING to
COMPLETED
2015-01-22 00:30:49,463 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt:
Completed container: container_1421076019070_0161_01_000010 in state: COMPLETED
event:FINISHED
2015-01-22 00:30:49,463 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000010
2015-01-22 00:30:49,463 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released
container container_1421076019070_0161_01_000010 of capacity <memory:1024,
vCores:1> on host localhost:8041, which currently has 1 containers,
<memory:1536, vCores:1> used and <memory:2127, vCores:3> available, release
resources=true
2015-01-22 00:30:49,463 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Application attempt appattempt_1421076019070_0161_000001 released container
container_1421076019070_0161_01_000010 on node: host: localhost:8041
#containers=1 available=2127 used=1536 with event: FINISHED
2015-01-22 00:30:50,464 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:30:50,902 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000011 Container Transitioned from NEW to
ALLOCATED
2015-01-22 00:30:50,902 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000011
2015-01-22 00:30:50,902 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Assigned
container container_1421076019070_0161_01_000011 of capacity <memory:1024,
vCores:1> on host localhost:8041, which has 2 containers, <memory:2560,
vCores:2> used and <memory:1103, vCores:2> available after allocation
2015-01-22 00:30:51,466 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:30:51,901 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000011 Container Transitioned from ALLOCATED to
ACQUIRED
2015-01-22 00:30:52,467 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000011 Container Transitioned from ACQUIRED to
RUNNING
2015-01-22 00:30:52,903 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo:
checking for deactivate...
2015-01-22 00:30:54,469 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000011 Container Transitioned from RUNNING to
COMPLETED
2015-01-22 00:30:54,469 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt:
Completed container: container_1421076019070_0161_01_000011 in state: COMPLETED
event:FINISHED
2015-01-22 00:30:54,469 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000011
2015-01-22 00:30:54,469 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released
container container_1421076019070_0161_01_000011 of capacity <memory:1024,
vCores:1> on host localhost:8041, which currently has 1 containers,
<memory:1536, vCores:1> used and <memory:2127, vCores:3> available, release
resources=true
2015-01-22 00:30:54,469 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Application attempt appattempt_1421076019070_0161_000001 released container
container_1421076019070_0161_01_000011 on node: host: localhost:8041
#containers=1 available=2127 used=1536 with event: FINISHED
2015-01-22 00:30:55,471 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:30:55,910 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000012 Container Transitioned from NEW to
ALLOCATED
2015-01-22 00:30:55,910 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000012
2015-01-22 00:30:55,910 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Assigned
container container_1421076019070_0161_01_000012 of capacity <memory:1024,
vCores:1> on host localhost:8041, which has 2 containers, <memory:2560,
vCores:2> used and <memory:1103, vCores:2> available after allocation
2015-01-22 00:30:56,472 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:30:56,911 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000012 Container Transitioned from ALLOCATED to
ACQUIRED
2015-01-22 00:30:57,473 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000012 Container Transitioned from ACQUIRED to
RUNNING
2015-01-22 00:30:57,913 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo:
checking for deactivate...
2015-01-22 00:31:00,480 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000012 Container Transitioned from RUNNING to
COMPLETED
2015-01-22 00:31:00,480 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt:
Completed container: container_1421076019070_0161_01_000012 in state: COMPLETED
event:FINISHED
2015-01-22 00:31:00,481 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000012
2015-01-22 00:31:00,481 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released
container container_1421076019070_0161_01_000012 of capacity <memory:1024,
vCores:1> on host localhost:8041, which currently has 1 containers,
<memory:1536, vCores:1> used and <memory:2127, vCores:3> available, release
resources=true
2015-01-22 00:31:00,481 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Application attempt appattempt_1421076019070_0161_000001 released container
container_1421076019070_0161_01_000012 on node: host: localhost:8041
#containers=1 available=2127 used=1536 with event: FINISHED
2015-01-22 00:31:01,482 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:31:01,923 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000013 Container Transitioned from NEW to
ALLOCATED
2015-01-22 00:31:01,923 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000013
2015-01-22 00:31:01,923 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Assigned
container container_1421076019070_0161_01_000013 of capacity <memory:1024,
vCores:1> on host localhost:8041, which has 2 containers, <memory:2560,
vCores:2> used and <memory:1103, vCores:2> available after allocation
2015-01-22 00:31:02,484 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:31:02,923 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000013 Container Transitioned from ALLOCATED to
ACQUIRED
2015-01-22 00:31:03,485 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000013 Container Transitioned from ACQUIRED to
RUNNING
2015-01-22 00:31:03,926 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo:
checking for deactivate...
2015-01-22 00:31:06,489 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1421076019070_0161_01_000013 Container Transitioned from RUNNING to
COMPLETED
2015-01-22 00:31:06,490 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt:
Completed container: container_1421076019070_0161_01_000013 in state: COMPLETED
event:FINISHED
2015-01-22 00:31:06,490 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hdfs
OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS
APPID=application_1421076019070_0161
CONTAINERID=container_1421076019070_0161_01_000013
2015-01-22 00:31:06,490 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released
container container_1421076019070_0161_01_000013 of capacity <memory:1024,
vCores:1> on host localhost:8041, which currently has 1 containers,
<memory:1536, vCores:1> used and <memory:2127, vCores:3> available, release
resources=true
2015-01-22 00:31:06,490 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Application attempt appattempt_1421076019070_0161_000001 released container
container_1421076019070_0161_01_000013 on node: host: localhost:8041
#containers=1 available=2127 used=1536 with event: FINISHED
2015-01-22 00:31:07,491 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
2015-01-22 00:31:08,493 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Null container completed...
)
> hive0.13.1+tez-0.4.1-incubating+hadoop-2.5.0-cdh5.2.0 run query error
> ---------------------------------------------------------------------
>
> Key: TEZ-1984
> URL: https://issues.apache.org/jira/browse/TEZ-1984
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.4.1
> Environment: hive0.13.1+tez-0.4.1-incubating+hadoop-2.5.0-cdh5.2.0
> Reporter: tangjunjie
> Attachments: applog.txt
>
>
> hive> select count(*) from u_data;
> Total jobs = 1
> Launching Job 1 out of 1
> Status: Running (application id: application_1421076019070_0156)
> Map 1: -/- Reducer 2: 0/1
> Map 1: 0/1 Reducer 2: 0/1
> Map 1: 0/1 Reducer 2: 0/1
> Map 1: 0/1 Reducer 2: 0/1
> Map 1: 0/1 Reducer 2: 0/1
> Map 1: 0/1 Reducer 2: 0/1
> Map 1: 0/1 Reducer 2: 0/1
> Map 1: 0/1 Reducer 2: 0/1
> Map 1: 0/1 Reducer 2: 0/1
> Map 1: 0/1 Reducer 2: 0/1
> Status: Failed
> Vertex failed, vertexName=Map 1, vertexId=vertex_1421076019070_0156_1_01,
> diagnostics=[Task failed, taskId=task_1421076019070_0156_1_01_000000,
> diagnostics=[AttemptID:attempt_1421076019070_0156_1_01_000000_0
> Info:Container container_1421076019070_0156_01_000002 COMPLETED with
> diagnostics set to [Exception from container-launch.
> Container id: container_1421076019070_0156_01_000002
> Exit code: 255
> Stack trace: ExitCodeException exitCode=255:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> at org.apache.hadoop.util.Shell.run(Shell.java:455)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:196)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:299)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 255
> ], AttemptID:attempt_1421076019070_0156_1_01_000000_1 Info:Container
> container_1421076019070_0156_01_000003 COMPLETED with diagnostics set to
> [Exception from container-launch.
> Container id: container_1421076019070_0156_01_000003
> Exit code: 255
> Stack trace: ExitCodeException exitCode=255:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> at org.apache.hadoop.util.Shell.run(Shell.java:455)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:196)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:299)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 255
> ], AttemptID:attempt_1421076019070_0156_1_01_000000_2 Info:Container
> container_1421076019070_0156_01_000004 COMPLETED with diagnostics set to
> [Exception from container-launch.
> Container id: container_1421076019070_0156_01_000004
> Exit code: 255
> Stack trace: ExitCodeException exitCode=255:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> at org.apache.hadoop.util.Shell.run(Shell.java:455)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:196)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:299)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 255
> ], AttemptID:attempt_1421076019070_0156_1_01_000000_3 Info:Container
> container_1421076019070_0156_01_000005 COMPLETED with diagnostics set to
> [Exception from container-launch.
> Container id: container_1421076019070_0156_01_000005
> Exit code: 255
> Stack trace: ExitCodeException exitCode=255:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> at org.apache.hadoop.util.Shell.run(Shell.java:455)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:196)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:299)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 255
> ]], Vertex failed as one or more tasks failed. failedTasks:1]
> Vertex killed, vertexName=Reducer 2, vertexId=vertex_1421076019070_0156_1_00,
> diagnostics=[Vertex received Kill while in RUNNING state., Vertex killed as
> other vertex failed. failedTasks:0]
> DAG failed due to vertex failure. failedVertices:1 killedVertices:1
> FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.tez.TezTask
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
