[
https://issues.apache.org/jira/browse/MAPREDUCE-2761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13076122#comment-13076122
]
Ravi Gummadi commented on MAPREDUCE-2761:
-----------------------------------------
Here is the Exception message there in TT logs:
011-07-21 09:55:56,194 INFO org.apache.hadoop.mapred.LinuxTaskController:
Output from LinuxTaskController's launchTaskJVM follows:
2011-07-21 09:55:56,194 INFO org.apache.hadoop.mapred.LinuxTaskController: main
: command provided 3
2011-07-21 09:55:56,194 INFO org.apache.hadoop.mapred.LinuxTaskController: main
: user is user1
2011-07-21 09:55:56,194 INFO org.apache.hadoop.mapred.LinuxTaskController:
run_process_as_user launching a JVM for task :attempt
_201107210950_0001_m_000017_2.
2011-07-21 09:55:56,194 WARN org.apache.hadoop.mapred.LinuxTaskController:
Output from task-contoller is :
2011-07-21 09:55:56,195 WARN org.apache.hadoop.mapred.LinuxTaskController:
Exception thrown while sending kill to the Task VM
{noformat}java.io.IOException: java.lang.NullPointerException
at
org.apache.hadoop.mapred.LinuxTaskController.signalTask(LinuxTaskController.java:615)
at
org.apache.hadoop.mapred.LinuxTaskController.terminateTask(LinuxTaskController.java:622)
at
org.apache.hadoop.mapred.TaskController.destroyTaskJVM(TaskController.java:154)
at
org.apache.hadoop.mapred.JvmManager$JvmManagerForType$JvmRunner.kill(JvmManager.java:522)
at
org.apache.hadoop.mapred.JvmManager$JvmManagerForType$JvmRunner.runChild(JvmManager.java:480)
at
org.apache.hadoop.mapred.JvmManager$JvmManagerForType$JvmRunner.run(JvmManager.java:462)
Caused by: java.lang.NullPointerException
at java.lang.ProcessBuilder.start(ProcessBuilder.java:442)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:206)
at org.apache.hadoop.util.Shell.run(Shell.java:188)
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:381)
at
org.apache.hadoop.mapred.LinuxTaskController.signalTask(LinuxTaskController.java:612)
... 5 more{noformat}
> New TaskController code doesn't run on Windows
> ----------------------------------------------
>
> Key: MAPREDUCE-2761
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2761
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task-controller, tasktracker
> Affects Versions: 0.20.204.0, 0.23.0
> Reporter: Todd Lipcon
>
> After MAPREDUCE-2178, TaskController assumes that pids are always available.
> The shell executor object that's used to launch a JVM isn't retained, but
> rather the pid is set when the task heartbeats. On Windows, there are no
> pids, and since the ShellCommandExecutor object is no longer around, we can't
> call process.destroy(). So, the TaskController doesn't work on Cygwin anymore.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira