[
https://issues.apache.org/jira/browse/MAPREDUCE-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
stack resolved MAPREDUCE-5721.
------------------------------
Resolution: Not a Problem
Configuration issue. Resolving as 'not a problem'.
> RM occur exception while unregistering
> --------------------------------------
>
> Key: MAPREDUCE-5721
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5721
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: resourcemanager
> Affects Versions: 2.2.0
> Environment: rhel 5.8_x86 ;jrockit 1.6.0_31-R28.2.3-4.1.0;hadoop 2.2.0
> Reporter: chillon_m
>
> when i run WORDCOUNT EXAMPLES,it occur.
> [hadoop@namenode0 ~]$ hadoop jar
> hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar
> wordcount /wordcount-input /wordcount-output
> 14/01/10 14:42:58 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/01/10 14:43:01 INFO client.RMProxy: Connecting to ResourceManager at
> namenode0/192.168.0.133:8032
> 14/01/10 14:43:03 INFO input.FileInputFormat: Total input paths to process : 2
> 14/01/10 14:43:03 INFO mapreduce.JobSubmitter: number of splits:2
> 14/01/10 14:43:03 INFO Configuration.deprecation: user.name is deprecated.
> Instead, use mapreduce.job.user.name
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.jar is deprecated.
> Instead, use mapreduce.job.jar
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.output.value.class
> is deprecated. Instead, use mapreduce.job.output.value.class
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapreduce.combine.class is
> deprecated. Instead, use mapreduce.job.combine.class
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapreduce.map.class is
> deprecated. Instead, use mapreduce.job.map.class
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.job.name is
> deprecated. Instead, use mapreduce.job.name
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapreduce.reduce.class is
> deprecated. Instead, use mapreduce.job.reduce.class
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.input.dir is
> deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.map.tasks is
> deprecated. Instead, use mapreduce.job.maps
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.output.key.class is
> deprecated. Instead, use mapreduce.job.output.key.class
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.working.dir is
> deprecated. Instead, use mapreduce.job.working.dir
> 14/01/10 14:43:03 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1389336130986_0001
> 14/01/10 14:43:05 INFO impl.YarnClientImpl: Submitted application
> application_1389336130986_0001 to ResourceManager at
> namenode0/192.168.0.133:8032
> 14/01/10 14:43:05 INFO mapreduce.Job: The url to track the job:
> http://namenode0:8088/proxy/application_1389336130986_0001/
> 14/01/10 14:43:05 INFO mapreduce.Job: Running job: job_1389336130986_0001
> 14/01/10 14:43:16 INFO mapreduce.Job: Job job_1389336130986_0001 running in
> uber mode : false
> 14/01/10 14:43:16 INFO mapreduce.Job: map 0% reduce 0%
> 14/01/10 14:44:20 INFO mapreduce.Job: map 50% reduce 0%
> 14/01/10 14:44:34 INFO mapreduce.Job: map 100% reduce 0%
> 14/01/10 14:44:51 INFO mapreduce.Job: map 100% reduce 100%
> 14/01/10 14:44:58 INFO ipc.Client: Retrying connect to server:
> datanode0.hadoop/192.168.0.134:43052. Already tried 0 time(s); retry policy
> is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1 SECONDS)
> 14/01/10 14:44:59 INFO ipc.Client: Retrying connect to server:
> datanode0.hadoop/192.168.0.134:43052. Already tried 1 time(s); retry policy
> is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1 SECONDS)
> 14/01/10 14:45:00 INFO ipc.Client: Retrying connect to server:
> datanode0.hadoop/192.168.0.134:43052. Already tried 2 time(s); retry policy
> is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1 SECONDS)
> 14/01/10 14:45:01 INFO ipc.Client: Retrying connect to server:
> datanode0.hadoop/192.168.0.134:43052. Already tried 0 time(s); retry policy
> is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1 SECONDS)
> 14/01/10 14:45:02 INFO ipc.Client: Retrying connect to server:
> datanode0.hadoop/192.168.0.134:43052. Already tried 1 time(s); retry policy
> is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1 SECONDS)
> 14/01/10 14:45:03 INFO ipc.Client: Retrying connect to server:
> datanode0.hadoop/192.168.0.134:43052. Already tried 2 time(s); retry policy
> is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1 SECONDS)
> 14/01/10 14:45:17 INFO mapreduce.Job: map 0% reduce 0%
> 14/01/10 14:45:17 INFO mapreduce.Job: Job job_1389336130986_0001 failed with
> state FAILED due to: Application application_1389336130986_0001 failed 2
> times due to AM Container for appattempt_1389336130986_0001_000002 exited
> with exitCode: 1 due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
> at org.apache.hadoop.util.Shell.run(Shell.java:380)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:590)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:139)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:909)
> at java.lang.Thread.run(Thread.java:662)
> .Failing this attempt.. Failing the application.
> 14/01/10 14:45:17 INFO mapreduce.Job: Counters: 0
> [hadoop@namenode0 ~]$
> LOGS
> Hadoop:
> 2014-01-10 16:21:45,987 WARN org.apache.hadoop.hdfs.StateChange: DIR*
> FSDirectory.unprotectedRenameTo: failed to rename
> /mr-history/tmp/hadoop/job_1389341658181_0001.summary_tmp to
> /mr-history/tmp/hadoop/job_1389341658181_0001.summary because destination
> exists
> 2014-01-10 16:21:45,988 INFO BlockStateChange: BLOCK* addStoredBlock:
> blockMap updated: 192.168.0.135:50010 is added to blk_1073742140_1320 size
> 76810
> 2014-01-10 16:21:46,000 WARN org.apache.hadoop.hdfs.StateChange: DIR*
> FSDirectory.unprotectedRenameTo: failed to rename
> /mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml_tmp to
> /mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml because destination
> exists
> 2014-01-10 16:21:46,005 WARN org.apache.hadoop.hdfs.StateChange: DIR*
> FSDirectory.unprotectedRenameTo: failed to rename
> /mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist_tmp
> to
> /mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist
> because destination exists
> 2014-01-10 16:21:46,005 INFO
> org.apache.hadoop.hdfs.server.namenode.EditLogFileOutputStream: Nothing to
> flush
> 2014-01-10 16:21:46,152 INFO BlockStateChange: BLOCK* addToInvalidates:
> blk_1073742126_1306 192.168.0.135:50010 192.168.0.134:50010
> 2014-01-10 16:21:46,153 INFO BlockStateChange: BLOCK* addToInvalidates:
> blk_1073742127_1307 192.168.0.135:50010 192.168.0.134:50010
> 2014-01-10 16:21:46,153 INFO BlockStateChange: BLOCK* addToInvalidates:
> blk_1073742128_1308 192.168.0.135:50010 192.168.0.134:50010
> 2014-01-10 16:21:46,153 INFO BlockStateChange: BLOCK* addToInvalidates:
> blk_1073742129_1309 192.168.0.135:50010 192.168.0.134:50010
> 2014-01-10 16:21:46,153 INFO BlockStateChange: BLOCK* addToInvalidates:
> blk_1073742131_1311 192.168.0.134:50010 192.168.0.135:50010
> 2014-01-10 16:21:46,153 INFO BlockStateChange: BLOCK* addToInvalidates:
> blk_1073742130_1310 192.168.0.134:50010 192.168.0.135:50010
> 2014-01-10 16:21:46,153 INFO BlockStateChange: BLOCK* addToInvalidates:
> blk_1073742137_1317 192.168.0.135:50010 192.168.0.134:50010
> 2014-01-10 16:21:46,153 INFO BlockStateChange: BLOCK* addToInvalidates:
> blk_1073742136_1316 192.168.0.135:50010 192.168.0.134:50010
> 2014-01-10 16:21:48,901 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
> InvalidateBlocks: ask 192.168.0.134:50010 to delete [blk_1073742128_1308,
> blk_1073742129_1309, blk_1073742130_1310, blk_1073742131_1311,
> blk_1073742136_1316, blk_1073742137_1317, blk_1073742126_1306,
> blk_1073742127_1307]
> 2014-01-10 16:21:51,904 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
> InvalidateBlocks: ask 192.168.0.135:50010 to delete [blk_1073742128_1308,
> blk_1073742129_1309, blk_1073742130_1310, blk_1073742131_1311,
> blk_1073742136_1316, blk_1073742137_1317, blk_1073742126_1306,
> blk_1073742127_1307]
> RM:
> 2014-01-10 16:21:47,006 INFO
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler:
> Application appattempt_1389341658181_0001_000002 released container
> container_1389341658181_0001_02_000001 on node: host: datanode1.hadoop:56467
> #containers=0 available=8192 used=0 with event: FINISHED
> 2014-01-10 16:21:47,006 INFO
> org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService:
> Unregistering app attempt : appattempt_1389341658181_0001_000002
> 2014-01-10 16:21:47,006 INFO
> org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl:
> appattempt_1389341658181_0001_000002 State change from RUNNING to FAILED
> 2014-01-10 16:21:47,007 INFO
> org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Application
> application_1389341658181_0001 failed 2 times due to AM Container for
> appattempt_1389341658181_0001_000002 exited with exitCode: 1 due to:
> Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
> at org.apache.hadoop.util.Shell.run(Shell.java:380)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:590)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:139)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:909)
> at java.lang.Thread.run(Thread.java:662)
> .Failing this attempt.. Failing the application.
> 2014-01-10 16:21:47,010 INFO
> org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl:
> application_1389341658181_0001 State change from RUNNING to FAILED
> 2014-01-10 16:21:47,012 INFO
> org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing
> info for app: application_1389341658181_0001
> 2014-01-10 16:21:47,016 WARN
> org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hadoop
> OPERATION=Application Finished - Failed TARGET=RMAppManager
> RESULT=FAILURE DESCRIPTION=App failed with state: FAILED
> PERMISSIONS=Application application_1389341658181_0001 failed 2 times due to
> AM Container for appattempt_1389341658181_0001_000002 exited with exitCode:
> 1 due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
> at org.apache.hadoop.util.Shell.run(Shell.java:380)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:590)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:139)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:909)
> at java.lang.Thread.run(Thread.java:662)
> .Failing this attempt.. Failing the application.
> APPID=application_1389341658181_0001
> 2014-01-10 16:21:47,019 INFO
> org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary:
> appId=application_1389341658181_0001,name=word
> count,user=hadoop,queue=default,state=FAILED,trackingUrl=namenode0:8088/cluster/app/application_1389341658181_0001,appMasterHost=,startTime=1389341979049,finishTime=1389342107008,finalStatus=FAILED
> 2014-01-10 16:21:47,021 INFO
> org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning
> master appattempt_1389341658181_0001_000002
> 2014-01-10 16:21:47,012 INFO
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler:
> Application appattempt_1389341658181_0001_000002 is done. finalState=FAILED
> 2014-01-10 16:21:47,022 INFO
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo:
> Application application_1389341658181_0001 requests cleared
> 2014-01-10 16:21:47,022 INFO
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue:
> Application removed - appId: application_1389341658181_0001 user: hadoop
> queue: default #user-pending-applications: 0 #user-active-applications: 0
> #queue-pending-applications: 0 #queue-active-applications: 0
> 2014-01-10 16:21:47,022 INFO
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue:
> Application removed - appId: application_1389341658181_0001 user: hadoop
> leaf-queue of parent: root #applications: 0
> datanode0-syslog:
> 2014-01-10 16:21:09,369 INFO [Socket Reader #1 for port 39047]
> SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
> job_1389341658181_0001 (auth:SIMPLE)
> 2014-01-10 16:21:09,405 INFO [IPC Server handler 11 on 39047]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
> jvm_1389341658181_0001_r_000004 asked for a task
> 2014-01-10 16:21:09,405 INFO [IPC Server handler 11 on 39047]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
> jvm_1389341658181_0001_r_000004 given task:
> attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:10,012 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received
> completed container container_1389341658181_0001_01_000002
> 2014-01-10 16:21:10,012 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling:
> PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1
> CompletedMaps:2 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:2 RackLocal:0
> 2014-01-10 16:21:10,012 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics
> report from attempt_1389341658181_0001_m_000000_0: Container killed by the
> ApplicationMaster.
> Container killed on request. Exit code is 143
> 2014-01-10 16:21:10,578 INFO [IPC Server handler 12 on 39047]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: MapCompletionEvents request
> from attempt_1389341658181_0001_r_000000_0. startIndex 0 maxEvents 10000
> 2014-01-10 16:21:11,593 INFO [IPC Server handler 13 on 39047]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: MapCompletionEvents request
> from attempt_1389341658181_0001_r_000000_0. startIndex 2 maxEvents 10000
> 2014-01-10 16:21:12,003 INFO [IPC Server handler 14 on 39047]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Status update from
> attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,003 INFO [IPC Server handler 14 on 39047]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt
> attempt_1389341658181_0001_r_000000_0 is : 0.0
> 2014-01-10 16:21:12,077 INFO [IPC Server handler 15 on 39047]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Status update from
> attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,077 INFO [IPC Server handler 15 on 39047]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt
> attempt_1389341658181_0001_r_000000_0 is : 0.0
> 2014-01-10 16:21:12,698 INFO [IPC Server handler 16 on 39047]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update
> from attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,699 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1389341658181_0001_r_000000_0 TaskAttempt Transitioned from RUNNING
> to COMMIT_PENDING
> 2014-01-10 16:21:12,700 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> attempt_1389341658181_0001_r_000000_0 given a go for committing the task
> output.
> 2014-01-10 16:21:12,702 INFO [IPC Server handler 16 on 39047]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request
> from attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,703 INFO [IPC Server handler 16 on 39047]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for
> attempt_1389341658181_0001_r_000000_0:true
> 2014-01-10 16:21:12,776 INFO [IPC Server handler 18 on 39047]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Status update from
> attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,777 INFO [IPC Server handler 18 on 39047]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt
> attempt_1389341658181_0001_r_000000_0 is : 1.0
> 2014-01-10 16:21:12,779 INFO [IPC Server handler 18 on 39047]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from
> attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,780 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1389341658181_0001_r_000000_0 TaskAttempt Transitioned from
> COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
> 2014-01-10 16:21:12,785 INFO [ContainerLauncher #5]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing
> the event EventType: CONTAINER_REMOTE_CLEANUP for container
> container_1389341658181_0001_01_000004 taskAttempt
> attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,785 INFO [ContainerLauncher #5]
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING
> attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,867 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
> attempt_1389341658181_0001_r_000000_0 TaskAttempt Transitioned from
> SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
> 2014-01-10 16:21:12,867 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with
> attempt attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,867 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
> task_1389341658181_0001_r_000000 Task Transitioned from RUNNING to SUCCEEDED
> 2014-01-10 16:21:12,867 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 3
> 2014-01-10 16:21:12,867 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> job_1389341658181_0001Job Transitioned from RUNNING to COMMITTING
> 2014-01-10 16:21:12,870 INFO [CommitterEvent Processor #1]
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing
> the event EventType: JOB_COMMIT
> 2014-01-10 16:21:12,974 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler for
> JobFinishedEvent
> 2014-01-10 16:21:12,976 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
> job_1389341658181_0001Job Transitioned from COMMITTING to SUCCEEDED
> 2014-01-10 16:21:12,978 INFO [Thread-69]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so
> this is the last retry
> 2014-01-10 16:21:12,978 INFO [Thread-69]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator
> isAMLastRetry: true
> 2014-01-10 16:21:12,979 INFO [Thread-69]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator
> notified that shouldUnregistered is: true
> 2014-01-10 16:21:12,979 INFO [Thread-69]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry:
> true
> 2014-01-10 16:21:12,979 INFO [Thread-69]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> JobHistoryEventHandler notified that forceJobCompletion is true
> 2014-01-10 16:21:12,979 INFO [Thread-69]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the
> services
> 2014-01-10 16:21:12,983 INFO [Thread-69]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping
> JobHistoryEventHandler. Size of the outstanding queue size is 1
> 2014-01-10 16:21:13,021 INFO [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
> Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0
> AssignedReds:1 CompletedMaps:2 CompletedReds:1 ContAlloc:3 ContRel:0
> HostLocal:2 RackLocal:0
> 2014-01-10 16:21:13,094 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
> hdfs://namenode0:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001/job_1389341658181_0001_1.jhist
> to
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist_tmp
> 2014-01-10 16:21:13,140 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done
> location:
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist_tmp
> 2014-01-10 16:21:13,143 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
> hdfs://namenode0:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001/job_1389341658181_0001_1_conf.xml
> to
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml_tmp
> 2014-01-10 16:21:13,210 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done
> location:
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml_tmp
> 2014-01-10 16:21:13,214 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to
> done:
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001.summary_tmp
> to hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001.summary
> 2014-01-10 16:21:13,215 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to
> done:
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml_tmp
> to
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml
> 2014-01-10 16:21:13,216 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to
> done:
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist_tmp
> to
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist
> 2014-01-10 16:21:13,219 INFO [Thread-69]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped
> JobHistoryEventHandler. super.stop()
> 2014-01-10 16:21:13,226 INFO [Thread-69]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Setting job
> diagnostics to
> 2014-01-10 16:21:13,229 ERROR [Thread-69]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Exception while
> unregistering
> java.lang.NullPointerException
> at
> org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithoutScheme(MRWebAppUtil.java:133)
> at
> org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithScheme(MRWebAppUtil.java:148)
> at
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.doUnregistration(RMCommunicator.java:207)
> at
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.unregister(RMCommunicator.java:177)
> at
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.serviceStop(RMCommunicator.java:250)
> at
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.serviceStop(RMContainerAllocator.java:255)
> at
> org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
> at
> org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
> at
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.serviceStop(MRAppMaster.java:817)
> at
> org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
> at
> org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
> at
> org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80)
> at
> org.apache.hadoop.service.CompositeService.stop(CompositeService.java:159)
> at
> org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
> at
> org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
> at
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster.shutDownJob(MRAppMaster.java:548)
> at
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler$1.run(MRAppMaster.java:599)
> 2014-01-10 16:21:13,234 INFO [Thread-69]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats:
> PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1
> CompletedMaps:2 CompletedReds:1 ContAlloc:3 ContRel:0 HostLocal:2 RackLocal:0
> 2014-01-10 16:21:13,234 INFO [Thread-69]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Skipping cleaning up the
> staging dir. assuming AM will be retried.
> 2014-01-10 16:21:13,235 INFO [Thread-69] org.apache.hadoop.ipc.Server:
> Stopping server on 39047
> 2014-01-10 16:21:13,241 INFO [IPC Server Responder]
> org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> 2014-01-10 16:21:13,242 INFO [TaskHeartbeatHandler PingChecker]
> org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler
> thread interrupted
> 2014-01-10 16:21:13,243 INFO [IPC Server listener on 39047]
> org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 39047
> 2014-01-10 16:21:18,243 INFO [Thread-69] org.apache.hadoop.ipc.Server:
> Stopping server on 41351
> 2014-01-10 16:21:18,272 INFO [Thread-69] org.mortbay.log: Stopped
> [email protected]:0
> 2014-01-10 16:21:18,274 INFO [IPC Server listener on 41351]
> org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 41351
> 2014-01-10 16:21:18,275 INFO [IPC Server Responder]
> org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> 2014-01-10 16:21:18,378 INFO [Thread-69]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Exiting MR AppMaster..GoodBye!
> 2014-01-10 16:21:18,390 INFO [Thread-1]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster received a
> signal. Signaling RMCommunicator and JobHistoryEventHandler.
> 2014-01-10 16:21:18,390 INFO [Thread-1]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator
> notified that iSignalled is: true
> 2014-01-10 16:21:18,390 INFO [Thread-1]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator
> isAMLastRetry: false
> 2014-01-10 16:21:18,390 INFO [Thread-1]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator
> notified that shouldUnregistered is: false
> 2014-01-10 16:21:18,390 INFO [Thread-1]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry:
> false
> 2014-01-10 16:21:18,390 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> JobHistoryEventHandler notified that forceJobCompletion is false
> datanode1-syslog：
> 014-01-10 16:21:39,815 INFO [Main Thread]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Will not try to recover.
> recoveryEnabled: true recoverySupportedByCommitter: false numReduceTasks: 1
> shuffleKeyValidForRecovery: true ApplicationAttemptID: 2
> 2014-01-10 16:21:39,871 INFO [Main Thread]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Previous history file is at
> hdfs://namenode0:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001/job_1389341658181_0001_1.jhist
> 2014-01-10 16:21:41,503 INFO [Main Thread]
> org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
> org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
> 2014-01-10 16:21:41,752 INFO [Main Thread]
> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
> hadoop-metrics2.properties
> 2014-01-10 16:21:42,641 INFO [Main Thread]
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
> at 10 second(s).
> 2014-01-10 16:21:42,641 INFO [Main Thread]
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system
> started
> 2014-01-10 16:21:42,777 INFO [Main Thread]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> nodeBlacklistingEnabled:true
> 2014-01-10 16:21:42,777 INFO [Main Thread]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> maxTaskFailuresPerNode is 3
> 2014-01-10 16:21:42,777 INFO [Main Thread]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
> blacklistDisablePercent is 33
> 2014-01-10 16:21:42,896 INFO [Main Thread]
> org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at
> namenode0/192.168.0.133:8030
> 2014-01-10 16:21:43,123 INFO [Main Thread]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> maxContainerCapability: 8192
> 2014-01-10 16:21:43,183 INFO [Main Thread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryCopyService: History file is
> at
> hdfs://namenode0:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001/job_1389341658181_0001_1.jhist
> 2014-01-10 16:21:43,413 ERROR [Main Thread]
> org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
> as:hadoop (auth:SIMPLE) cause:java.io.IOException: Was asked to shut down.
> 2014-01-10 16:21:43,414 FATAL [Main Thread]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
> java.io.IOException: Was asked to shut down.
> at
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.run(MRAppMaster.java:1447)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
> at
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1452)
> at
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1374)
> 2014-01-10 16:21:43,454 INFO [Thread-1]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster received a
> signal. Signaling RMCommunicator and JobHistoryEventHandler.
> 2014-01-10 16:21:43,455 INFO [Thread-1]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator
> notified that iSignalled is: true
> 2014-01-10 16:21:43,456 INFO [Thread-1]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator
> isAMLastRetry: true
> 2014-01-10 16:21:43,457 INFO [Thread-1]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator
> notified that shouldUnregistered is: true
> 2014-01-10 16:21:43,457 INFO [Thread-1]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry:
> true
> 2014-01-10 16:21:43,457 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
> JobHistoryEventHandler notified that forceJobCompletion is true
> 2014-01-10 16:21:43,470 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping
> JobHistoryEventHandler. Size of the outstanding queue size is 17
> 2014-01-10 16:21:43,543 INFO [eventHandlingThread]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer
> setup for JobId: job_1389341658181_0001, File:
> hdfs://namenode0:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001/job_1389341658181_0001_2.jhist
> 2014-01-10 16:21:43,657 INFO [eventHandlingThread]
> org.apache.hadoop.conf.Configuration.deprecation: user.name is deprecated.
> Instead, use mapreduce.job.user.name
> 2014-01-10 16:21:44,698 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event AM_STARTED
> 2014-01-10 16:21:44,700 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event JOB_SUBMITTED
> 2014-01-10 16:21:44,705 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event JOB_INITED
> 2014-01-10 16:21:44,707 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event JOB_INFO_CHANGED
> 2014-01-10 16:21:44,708 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event TASK_STARTED
> 2014-01-10 16:21:44,708 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event TASK_STARTED
> 2014-01-10 16:21:44,708 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event TASK_STARTED
> 2014-01-10 16:21:44,708 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event MAP_ATTEMPT_STARTED
> 2014-01-10 16:21:44,710 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event MAP_ATTEMPT_STARTED
> 2014-01-10 16:21:44,710 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event MAP_ATTEMPT_FINISHED
> 2014-01-10 16:21:44,763 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event TASK_FINISHED
> 2014-01-10 16:21:44,767 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event REDUCE_ATTEMPT_STARTED
> 2014-01-10 16:21:44,767 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event MAP_ATTEMPT_FINISHED
> 2014-01-10 16:21:44,769 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event TASK_FINISHED
> 2014-01-10 16:21:44,771 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event REDUCE_ATTEMPT_FINISHED
> 2014-01-10 16:21:44,775 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event TASK_FINISHED
> 2014-01-10 16:21:44,777 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop,
> writing event JOB_FINISHED
> 2014-01-10 16:21:44,886 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
> hdfs://namenode0:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001/job_1389341658181_0001_2.jhist
> to
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist_tmp
> 2014-01-10 16:21:45,005 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done
> location:
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist_tmp
> 2014-01-10 16:21:45,008 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
> hdfs://namenode0:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001/job_1389341658181_0001_2_conf.xml
> to
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml_tmp
> 2014-01-10 16:21:45,079 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done
> location:
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml_tmp
> 2014-01-10 16:21:45,103 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to
> done:
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001.summary_tmp
> to hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001.summary
> 2014-01-10 16:21:45,108 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to
> done:
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml_tmp
> to
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml
> 2014-01-10 16:21:45,110 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to
> done:
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist_tmp
> to
> hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist
> 2014-01-10 16:21:45,110 INFO [Thread-1]
> org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped
> JobHistoryEventHandler. super.stop()
> 2014-01-10 16:21:45,122 INFO [Thread-1]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Setting job
> diagnostics to We crashed after successfully committing. Recovering.
> 2014-01-10 16:21:45,198 ERROR [Thread-1]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Exception while
> unregistering
> java.lang.NullPointerException
> at
> org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithoutScheme(MRWebAppUtil.java:133)
> at
> org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithScheme(MRWebAppUtil.java:148)
> at
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.doUnregistration(RMCommunicator.java:207)
> at
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.unregister(RMCommunicator.java:177)
> at
> org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.serviceStop(RMCommunicator.java:250)
> at
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.serviceStop(RMContainerAllocator.java:255)
> at
> org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
> at
> org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
> at
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.serviceStop(MRAppMaster.java:817)
> at
> org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
> at
> org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
> at
> org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80)
> at
> org.apache.hadoop.service.CompositeService.stop(CompositeService.java:159)
> at
> org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
> at
> org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
> at
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$MRAppMasterShutdownHook.run(MRAppMaster.java:1399)
> at
> org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
> 2014-01-10 16:21:45,199 INFO [Thread-1]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats:
> PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:0
> CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
> 2014-01-10 16:21:45,203 INFO [Thread-1]
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory
> hdfs://namenode0:9000
> /tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
