[
https://issues.apache.org/jira/browse/MAPREDUCE-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christian Kunz reopened MAPREDUCE-1286:
---------------------------------------
I would vote to declare this as blocker for 0.20.
It not only affects hadoop streaming, but also system calls using the hadoop
command line utility will fail like:
Exception in thread "main" java.lang.NoClassDefFoundError:
"-Dhadoop/tasklog/taskid=attempt_201006181908_0498_m_000000_0
Caused by: java.lang.ClassNotFoundException:
"-Dhadoop.tasklog.taskid=attempt_201006181908_0498_m_000000_0
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
Could not find the main class:
"-Dhadoop.tasklog.taskid=attempt_201006181908_0498_m_000000_0. Program will
exit.
> Quotes in environment HADOOP_CLIENT_OPTS confuse parsing if this env is
> concatenated with something else
> --------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1286
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1286
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Affects Versions: 0.20.2
> Environment: Linux F12; streaming
> Reporter: Yuri Pradkin
> Assignee: Yuri Pradkin
> Attachments: mr-1286
>
>
> I use streaming and in the perl-reducer I write to hdfs using a pipe to hdfs
> -put - .... It turns out that because TaskRunner sets the environment
> HADOOP_CLIENT_OPTS in double quotes, when hdfs shell script concatenates
> these with something else, the command fails: .e.g java -Dblah=x -Dfoo=y
> "-Dhadoop.tasklog.taskid=z -Dhadoop.tasklog.totalLogFileSize=s"...
> Since I don't see any reason to have these double quotes in the original
> code; I propose they're removed.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
