[
https://issues.apache.org/jira/browse/MAPREDUCE-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yeshavora updated MAPREDUCE-5413:
---------------------------------
Description:
Run a MR job and kill it as soon as jobId is known. After killing the job, try
to kill its attempts.
Steps:
1) start a map reduce job
hadoop jar hadoop-mapreduce-client-jobclient-tests.jar sleep -m 10 -r 10 -mt
50000 -rt 50000
2)Kill the job
hadoop job -kill <job-id>
3)Try to kill the attempts for above job.
Result:
mapred job was not able to shut down properly. Attaching syslog. It does not
kill its attempts also.
Above steps leads to below exception,
org.apache.hadoop.util.ShutdownHookManager: ShutdownHook
'MRAppMasterShutdownHook' failed, java.lang.NullPointerException
java.lang.NullPointerException
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.setSignalled(MRAppMaster.java:811)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$MRAppMasterShutdownHook.run(MRAppMaster.java:1249)
at
org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
was:
Run a MR job and kill it as soon as jobId is known. After killing the job, try
to kill its attempts.
Steps:
1) start a map reduce job
/usr/lib/hadoop/bin/hadoop jar
/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.0.3.22-alpha-tests.jar
sleep -m 10 -r 10 -mt 50000 -rt 50000
2)Kill the job
/usr/bin/mapred -kill <job-id>
3)Try to kill the attempts for above job.
Result:
mapred job was not able to shut down properly. Attaching syslog. It does not
kill its attempts also.
Above steps leads to below exception,
org.apache.hadoop.util.ShutdownHookManager: ShutdownHook
'MRAppMasterShutdownHook' failed, java.lang.NullPointerException
java.lang.NullPointerException
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.setSignalled(MRAppMaster.java:811)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$MRAppMasterShutdownHook.run(MRAppMaster.java:1249)
at
org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
> Killing mapred job in Initial stage leads to java.lang.NullPointerException
> ---------------------------------------------------------------------------
>
> Key: MAPREDUCE-5413
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5413
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: yeshavora
> Assignee: Omkar Vinit Joshi
> Attachments: syslog_MapredKillTask.docx
>
>
> Run a MR job and kill it as soon as jobId is known. After killing the job,
> try to kill its attempts.
> Steps:
> 1) start a map reduce job
> hadoop jar hadoop-mapreduce-client-jobclient-tests.jar sleep -m 10 -r 10 -mt
> 50000 -rt 50000
> 2)Kill the job
> hadoop job -kill <job-id>
> 3)Try to kill the attempts for above job.
> Result:
> mapred job was not able to shut down properly. Attaching syslog. It does not
> kill its attempts also.
> Above steps leads to below exception,
> org.apache.hadoop.util.ShutdownHookManager: ShutdownHook
> 'MRAppMasterShutdownHook' failed, java.lang.NullPointerException
> java.lang.NullPointerException
> at
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.setSignalled(MRAppMaster.java:811)
> at
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$MRAppMasterShutdownHook.run(MRAppMaster.java:1249)
> at
> org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
