Jens Rabe created MAPREDUCE-6322:
------------------------------------
Summary: MapReduce Integration tests with mini cluster fail on
Jenkins when path to workspace contains characters which need to be escaped in
shell scripts
Key: MAPREDUCE-6322
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6322
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 2.4.0
Environment: Jenkins on Linux
Reporter: Jens Rabe
When building a project with Jenkins which contains integration tests for
Map/Reduce jobs, the tests fail when the path to the workspace Jenkins builds
in contains characters which need to be escaped in shell scripts, like
whitespaces or parentheses.
Example output:
{code}
/application_1429525168682_0001/container_1429525168682_0001_02_000001/default_container_executor.sh:
line 3: `echo $$ > /home/jenkins/data/workspace/Some project with whitespaces
(and
parentheses)/path/to/com.example.someproject/target/test-cluster-cff13b33-ab3f-443d-9e50-c28ce37e9a2a/test-cluster-cff13b33-ab3f-443d-9e50-c28ce37e9a2a-localDir-nm-1_0/nmPrivate/container_1429525168682_0001_02_000001.pid.tmp'
at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)
at org.apache.hadoop.util.Shell.run(Shell.java:418)
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 2
.Failing this attempt.. Failing the application.
{code}
The script default_container_executor.sh should be generated in a way that such
characters are escaped.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
