FileInputFormat.setInputPaths() has sideffects on the passed conf besides
setting the input.dir path
----------------------------------------------------------------------------------------------------
Key: MAPREDUCE-1745
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1745
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Dick King
it sets other props, like {{mapred.working.dir}} , it sets this using the
current user (which may be the superuser), then
the job submission for a proxy user fails because the {{mapred.working.dir}} is
not the right one for the proxy user.
This is observed when using relative directories, they are resolved to the
homeDir of the superuser instead of the
proxy user.
I did not check, but I suspect the {{FileOutputForamt.setOutputPath()}} may
have similar side effects
There is a workaround, setting up the {{mapred.input.dir}} and
{{mapred.output.dir}} directly by hand in the conf instead using
the methods above
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
