Default value for hadoop.job.history.location is broken
-------------------------------------------------------
Key: HADOOP-2872
URL: https://issues.apache.org/jira/browse/HADOOP-2872
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.17.0
Reporter: Owen O'Malley
Assignee: Amareshwari Sri Ramadasu
Fix For: 0.17.0
The default value for hadoop.job.history.location is currently:
file://${hadoop.log.dir}/history
which assumes that hadoop.log.dir is an absolute path. If the path is relative,
the job tracker dies with:
08/02/21 23:43:04 FATAL mapred.JobTracker: java.lang.IllegalArgumentException:
Wrong FS: file://./logs/history, expected: file:///
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:268)
at
org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:54)
at
org.apache.hadoop.fs.RawLocalFileSystem.exists(RawLocalFileSystem.java:223)
at
org.apache.hadoop.fs.FilterFileSystem.exists(FilterFileSystem.java:147)
at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:124)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:706)
at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:124)
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:2146)
I think that the right fix is to make the default value:
"history"
and when building, use the Path code:
{code}
new Path(get("hadoop.log.dir", conf), get("hadoop.job.history.location"));
{code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
