[
https://issues.apache.org/jira/browse/MAPREDUCE-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145309#comment-13145309
]
Vinod Kumar Vavilapalli commented on MAPREDUCE-3345:
----------------------------------------------------
Copying pasting the test-logs just in case Jenkins deletes them.
{code}
{2011-11-03 07:09:07,511 INFO [AsyncDispatcher event handler]
attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(476)) -
appattempt_1320304139196_0003_000001 State change from NEW to SUBMITTED
2011-11-03 07:09:07,512 INFO [Node Status Updater]
nodemanager.NodeStatusUpdaterImpl
(NodeStatusUpdaterImpl.java:getNodeStatus(210)) - Sending out status for
container: container_id {, app_attempt_id {, application_id {, id: 2,
cluster_timestamp: 1320304139196, }, attemptId: 1, }, id: 1, }, state:
C_RUNNING, diagnostics: "Container killed by the ApplicationMaster.\n",
exit_status: -1000,
2011-11-03 07:09:07,511 INFO [main] resourcemanager.RMAuditLogger
(RMAuditLogger.java:logSuccess(140)) - USER=jenkins OPERATION=Submit
Application Request TARGET=ClientRMService RESULT=SUCCESS
APPID=application_1320304139196_0003
2011-11-03 07:09:07,512 INFO [AsyncDispatcher event handler] rmnode.RMNodeImpl
(RMNodeImpl.java:handle(293)) - Processing asf005.sp2.ygridcore.net:44653 of
type STATUS_UPDATE
2011-11-03 07:09:07,512 INFO [ResourceManager Event Processor]
fifo.FifoScheduler (FifoScheduler.java:addApplication(288)) - Application
Submission: application_1320304139196_0003 from jenkins, currently active: 1
2011-11-03 07:09:07,513 INFO [main] server.TestContainerManagerSecurity
(TestContainerManagerSecurity.java:submitAndRegisterApplication(373)) - Waiting
for applicationAttempt to be created..
2011-11-03 07:09:07,513 INFO [AsyncDispatcher event handler]
attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(464)) - Processing event
for appattempt_1320304139196_0003_000001 of type APP_ACCEPTED
2011-11-03 07:09:07,513 INFO [ResourceManager Event Processor]
fifo.FifoScheduler (FifoScheduler.java:nodeUpdate(571)) - Node heartbeat
asf005.sp2.ygridcore.net:44653 available resource = memory: 4096
2011-11-03 07:09:07,515 INFO [ResourceManager Event Processor]
rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(195)) - Processing
container_1320304139196_0003_01_000001 of type START
2011-11-03 07:09:07,515 INFO [ResourceManager Event Processor]
rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(207)) -
container_1320304139196_0003_01_000001 Container Transitioned from NEW to
ALLOCATED
2011-11-03 07:09:07,516 INFO [ResourceManager Event Processor]
resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) -
USER=jenkins OPERATION=AM Allocated Container TARGET=SchedulerApp
RESULT=SUCCESS APPID=application_1320304139196_0003
CONTAINERID=container_1320304139196_0003_01_000001
2011-11-03 07:09:07,516 INFO [ResourceManager Event Processor]
scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(103)) - Assigned
container container_1320304139196_0003_01_000001 of capacity memory: 1024 on
host asf005.sp2.ygridcore.net:44653, which currently has 1 containers, memory:
1024 used and memory: 3072 available
2011-11-03 07:09:07,516 INFO [ResourceManager Event Processor]
fifo.FifoScheduler (FifoScheduler.java:nodeUpdate(576)) - Node after allocation
asf005.sp2.ygridcore.net:44653 resource = memory: 3072
2011-11-03 07:09:07,516 INFO [AsyncDispatcher event handler]
rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(195)) - Processing
container_1320304139196_0003_01_000001 of type ACQUIRED
2011-11-03 07:09:07,517 INFO [AsyncDispatcher event handler]
rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(207)) -
container_1320304139196_0003_01_000001 Container Transitioned from ALLOCATED to
ACQUIRED
2011-11-03 07:09:07,517 WARN [ContainersLauncher #0]
nodemanager.DefaultContainerExecutor
(DefaultContainerExecutor.java:launchContainer(184)) - Exit code from task is :
143
2011-11-03 07:09:07,517 INFO [AsyncDispatcher event handler]
attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(476)) -
appattempt_1320304139196_0003_000001 State change from SUBMITTED to SCHEDULED
2011-11-03 07:09:07,517 INFO [ContainersLauncher #0]
nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(154)) -
2011-11-03 07:09:07,517 INFO [AsyncDispatcher event handler] rmapp.RMAppImpl
(RMAppImpl.java:handle(416)) - Processing event for
application_1320304139196_0003 of type APP_ACCEPTED
2011-11-03 07:09:07,518 INFO [ContainersLauncher #0] container.Container
(ContainerImpl.java:handle(818)) - Processing
container_1320304139196_0002_01_000001 of type UPDATE_DIAGNOSTICS_MSG
2011-11-03 07:09:07,518 INFO [AsyncDispatcher event handler] rmapp.RMAppImpl
(RMAppImpl.java:handle(428)) - application_1320304139196_0003 State change from
SUBMITTED to ACCEPTED
2011-11-03 07:09:07,518 INFO [AsyncDispatcher event handler]
attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(464)) - Processing event
for appattempt_1320304139196_0003_000001 of type CONTAINER_ALLOCATED
2011-11-03 07:09:07,519 ERROR [AsyncDispatcher event handler]
resourcemanager.ResourceManager (ResourceManager.java:handle(380)) - Error in
handling event type CONTAINER_ALLOCATED for applicationAttempt
application_1320304139196_0003
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at java.util.ArrayList.RangeCheck(ArrayList.java:547)
at java.util.ArrayList.get(ArrayList.java:322)
at
org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AMContainerAllocatedTransition.transition(RMAppAttemptImpl.java:614)
at
org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AMContainerAllocatedTransition.transition(RMAppAttemptImpl.java:603)
at
org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:357)
at
org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:298)
at
org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
at
org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:443)
at
org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:469)
at
org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:80)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:378)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:359)
at
org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:116)
at
org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75)
at java.lang.Thread.run(Thread.java:662)
2011-11-03 07:09:07,519 INFO [AsyncDispatcher event handler]
attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(464)) - Processing event
for appattempt_1320304139196_0003_000001 of type CONTAINER_ACQUIRED
2011-11-03 07:09:07,520 ERROR [AsyncDispatcher event handler]
attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(471)) - Can't handle
this event at current state
org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event:
CONTAINER_ACQUIRED at SCHEDULED
at
org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:301)
at
org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
at
org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:443)
at
org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:469)
at
org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:80)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:378)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:359)
at
org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:116)
at
org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75)
at java.lang.Thread.run(Thread.java:662)
2011-11-03 07:09:07,526 INFO [AsyncDispatcher event handler]
container.Container (ContainerImpl.java:handle(818)) - Processing
container_1320304139196_0002_01_000001 of type KILL_CONTAINER
2011-11-03 07:09:07,526 WARN [AsyncDispatcher event handler]
containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(495)) -
Event EventType: KILL_CONTAINER sent to absent container
container_1320304139196_0002_01_000002
2011-11-03 07:09:07,526 INFO [AsyncDispatcher event handler]
application.Application (ApplicationImpl.java:handle(376)) - Processing
application_1320304139196_0002 of type FINISH_APPLICATION
2011-11-03 07:09:07,526 INFO [AsyncDispatcher event handler]
application.Application (ApplicationImpl.java:handle(387)) - Application
application_1320304139196_0002 transitioned from RUNNING to
FINISHING_CONTAINERS_WAIT
2011-11-03 07:09:07,527 INFO [AsyncDispatcher event handler]
container.Container (ContainerImpl.java:handle(818)) - Processing
container_1320304139196_0002_01_000001 of type CONTAINER_KILLED_ON_REQUEST
2011-11-03 07:09:07,527 INFO [AsyncDispatcher event handler]
container.Container (ContainerImpl.java:handle(830)) - Container
container_1320304139196_0002_01_000001 transitioned from KILLING to
CONTAINER_CLEANEDUP_AFTER_KILL
2011-11-03 07:09:07,527 INFO [AsyncDispatcher event handler]
container.Container (ContainerImpl.java:handle(818)) - Processing
container_1320304139196_0002_01_000001 of type KILL_CONTAINER
2011-11-03 07:09:07,527 INFO [AsyncDispatcher event handler]
localizer.LocalizedResource (LocalizedResource.java:handle(184)) - Processing
file:/home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/target/org.apache.hadoop.yarn.server.TestContainerManagerSecurity-localDir/testFile-application_1320304139196_0002
of type RELEASE
2011-11-03 07:09:07,528 INFO [DeletionService #3]
nodemanager.DefaultContainerExecutor
(DefaultContainerExecutor.java:deleteAsUser(265)) - Deleting absolute path :
/home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/target/org.apache.hadoop.yarn.server.TestContainerManagerSecurity/org.apache.hadoop.yarn.server.TestContainerManagerSecurity-localDir-nm-0/usercache/jenkins/appcache/application_1320304139196_0002/container_1320304139196_0002_01_000001
2011-11-03 07:09:07,528 INFO [AsyncDispatcher event handler]
container.Container (ContainerImpl.java:handle(818)) - Processing
container_1320304139196_0002_01_000001 of type CONTAINER_RESOURCES_CLEANEDUP
2011-11-03 07:09:07,528 INFO [AsyncDispatcher event handler]
nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=jenkins
OPERATION=Container Finished - Killed TARGET=ContainerImpl
RESULT=SUCCESS APPID=application_1320304139196_0002
CONTAINERID=container_1320304139196_0002_01_000001
2011-11-03 07:09:07,528 INFO [AsyncDispatcher event handler]
container.Container (ContainerImpl.java:handle(830)) - Container
container_1320304139196_0002_01_000001 transitioned from
CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2011-11-03 07:09:07,529 INFO [AsyncDispatcher event handler]
application.Application (ApplicationImpl.java:handle(376)) - Processing
application_1320304139196_0002 of type APPLICATION_CONTAINER_FINISHED
{code}
> Race condition in ResourceManager causing TestContainerManagerSecurity to
> fail sometimes
> ----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3345
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3345
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Hitesh Shah
> Fix For: 0.23.1
>
>
> See
> https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1247//testReport/org.apache.hadoop.yarn.server/TestContainerManagerSecurity/testUnauthorizedUser/
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
