mapreduce.jobtracker.staging.root.dir default is unreasonable
-------------------------------------------------------------
Key: MAPREDUCE-2181
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2181
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: job submission, jobtracker
Affects Versions: 0.22.0
Reporter: Todd Lipcon
The default for mapreduce.jobtracker.staging.root.dir is set to
${hadoop.tmp.dir}/mapred/staging, which doesn't really work on a normal
cluster. hadoop.tmp.dir is overloaded in different places where sometimes it is
a local path and sometimes it is a path on HDFS, which makes things even more
confusing.
We should change the default for the staging directory to /user (as is
suggested by the description of that configuration) and then fix LocalJobRunner
to use a different configuration -- perhaps
mapreduce.localjobrunner.staging.root.dir -- to make it clear that it's a
*local* path. That one could legitimately default to something inside
hadoop.tmp.dir.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
