[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13076122#comment-13076122
 ] 

Ravi Gummadi commented on MAPREDUCE-2761:
-----------------------------------------

Here is the Exception message there in TT logs:


011-07-21 09:55:56,194 INFO org.apache.hadoop.mapred.LinuxTaskController: 
Output from LinuxTaskController's launchTaskJVM follows:
2011-07-21 09:55:56,194 INFO org.apache.hadoop.mapred.LinuxTaskController: main 
: command provided 3
2011-07-21 09:55:56,194 INFO org.apache.hadoop.mapred.LinuxTaskController: main 
: user is user1
2011-07-21 09:55:56,194 INFO org.apache.hadoop.mapred.LinuxTaskController: 
run_process_as_user launching a JVM for task :attempt
_201107210950_0001_m_000017_2.
2011-07-21 09:55:56,194 WARN org.apache.hadoop.mapred.LinuxTaskController: 
Output from task-contoller is :
2011-07-21 09:55:56,195 WARN org.apache.hadoop.mapred.LinuxTaskController: 
Exception thrown while sending kill to the Task VM 
{noformat}java.io.IOException: java.lang.NullPointerException
        at 
org.apache.hadoop.mapred.LinuxTaskController.signalTask(LinuxTaskController.java:615)
        at 
org.apache.hadoop.mapred.LinuxTaskController.terminateTask(LinuxTaskController.java:622)
        at 
org.apache.hadoop.mapred.TaskController.destroyTaskJVM(TaskController.java:154)
        at 
org.apache.hadoop.mapred.JvmManager$JvmManagerForType$JvmRunner.kill(JvmManager.java:522)
        at 
org.apache.hadoop.mapred.JvmManager$JvmManagerForType$JvmRunner.runChild(JvmManager.java:480)
        at 
org.apache.hadoop.mapred.JvmManager$JvmManagerForType$JvmRunner.run(JvmManager.java:462)
Caused by: java.lang.NullPointerException
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:442)
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:206)
        at org.apache.hadoop.util.Shell.run(Shell.java:188)
        at 
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:381)
        at 
org.apache.hadoop.mapred.LinuxTaskController.signalTask(LinuxTaskController.java:612)
        ... 5 more{noformat}

> New TaskController code doesn't run on Windows
> ----------------------------------------------
>
>                 Key: MAPREDUCE-2761
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2761
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: task-controller, tasktracker
>    Affects Versions: 0.20.204.0, 0.23.0
>            Reporter: Todd Lipcon
>
> After MAPREDUCE-2178, TaskController assumes that pids are always available. 
> The shell executor object that's used to launch a JVM isn't retained, but 
> rather the pid is set when the task heartbeats. On Windows, there are no 
> pids, and since the ShellCommandExecutor object is no longer around, we can't 
> call process.destroy(). So, the TaskController doesn't work on Cygwin anymore.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to