[
https://issues.apache.org/jira/browse/HADOOP-14846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuqi Wang updated HADOOP-14846:
-------------------------------
Description:
*Hadoop may hide shell failures (including start container and fs operation
failures), such as:
*
ContainerExitDiagnostics:
{code:java}
Exception from container-launch. Container id:
container_e5620_1503888150197_2979_01_003320
*Exit code: 0*
Exception message:
Cannot run program "D:\data\hadoop.latest\bin\winutils.exe" (in directory
"\data\yarnnm\local\usercache\hadoop\appcache\application_1503888150197_2979\container_e5620_1503888150197_2979_01_003320"):
CreateProcess error=2, The system cannot find the file specified
Stack trace: java.io.IOException: Cannot run program
"D:\data\hadoop.latest\bin\winutils.exe" (in directory
"\data\yarnnm\local\usercache\hadoop\appcache\application_1503888150197_2979\container_e5620_1503888150197_2979_01_003320"):
CreateProcess error=2, The system cannot find the file specified
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:517)
at org.apache.hadoop.util.Shell.run(Shell.java:490)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:756)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:329)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:86)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{code}
was:
Hadoop may hide shell failures (including start container and fs operation
failures), such as:
ContainerExitDiagnostics:
{code:java}
Exception from container-launch. Container id:
container_e5620_1503888150197_2979_01_003320
Exit code: 0
Exception message:
Cannot run program "D:\data\hadoop.latest\bin\winutils.exe" (in directory
"\data\yarnnm\local\usercache\hadoop\appcache\application_1503888150197_2979\container_e5620_1503888150197_2979_01_003320"):
CreateProcess error=2, The system cannot find the file specified
Stack trace: java.io.IOException: Cannot run program
"D:\data\hadoop.latest\bin\winutils.exe" (in directory
"\data\yarnnm\local\usercache\hadoop\appcache\application_1503888150197_2979\container_e5620_1503888150197_2979_01_003320"):
CreateProcess error=2, The system cannot find the file specified
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:517)
at org.apache.hadoop.util.Shell.run(Shell.java:490)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:756)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:329)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:86)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{code}
> Wrong shell exit code if the shell process cannot be even started
> -----------------------------------------------------------------
>
> Key: HADOOP-14846
> URL: https://issues.apache.org/jira/browse/HADOOP-14846
> Project: Hadoop Common
> Issue Type: Bug
> Components: util
> Affects Versions: 2.7.1
> Reporter: Yuqi Wang
> Labels: shell
> Fix For: 3.0.0-alpha4
>
>
> *Hadoop may hide shell failures (including start container and fs operation
> failures), such as:
> *
> ContainerExitDiagnostics:
> {code:java}
> Exception from container-launch. Container id:
> container_e5620_1503888150197_2979_01_003320
> *Exit code: 0*
> Exception message:
> Cannot run program "D:\data\hadoop.latest\bin\winutils.exe" (in directory
> "\data\yarnnm\local\usercache\hadoop\appcache\application_1503888150197_2979\container_e5620_1503888150197_2979_01_003320"):
>
> CreateProcess error=2, The system cannot find the file specified
> Stack trace: java.io.IOException: Cannot run program
> "D:\data\hadoop.latest\bin\winutils.exe" (in directory
> "\data\yarnnm\local\usercache\hadoop\appcache\application_1503888150197_2979\container_e5620_1503888150197_2979_01_003320"):
> CreateProcess error=2, The system cannot find the file specified
> at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:517)
> at org.apache.hadoop.util.Shell.run(Shell.java:490)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:756)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:329)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:86)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
