[
https://issues.apache.org/jira/browse/HADOOP-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amareshwari Sriramadasu updated HADOOP-2178:
--------------------------------------------
Release Note:
This feature provides facility to store job history on DFS. Now cluster admin
can provide either localFS location or DFS location using configuration
property "mapred.job.history.location" to store job histroy. History will be
logged in user specified location also. User can specify history location using
configuration property "mapred.job.history.user.location" .
The classes org.apache.hadoop.mapred.DefaultJobHistoryParser.MasterIndex and
org.apache.hadoop.mapred.DefaultJobHistoryParser.MasterIndexParseListener, and
public method org.apache.hadoop.mapred.DefaultJobHistoryParser.parseMasterIndex
are not available.
The signature of public method
org.apache.hadoop.mapred.DefaultJobHistoryParser.parseJobTasks(File
jobHistoryFile, JobHistory.JobInfo job) is changed to
DefaultJobHistoryParser.parseJobTasks(String jobHistoryFile, JobHistory.JobInfo
job, FileSystem fs).
The signature of public method
org.apache.hadoop.mapred.JobHistory.parseHistory(File path, Listener l) is
changed to JobHistory.parseHistoryFromFS(String path, Listener l, FileSystem fs)
was:This feature provides facility to store job history on DFS. Now cluster
admin can provide either localFS location or DFS location using configuration
property "mapred.job.history.location" to store job histroy. History will be
logged in user specified location also. User can specify history location using
configuration property "mapred.job.history.user.location" .
Hadoop Flags: [Incompatible change]
> Job history on HDFS
> -------------------
>
> Key: HADOOP-2178
> URL: https://issues.apache.org/jira/browse/HADOOP-2178
> Project: Hadoop Core
> Issue Type: Improvement
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Fix For: 0.17.0
>
> Attachments: patch-2178.2.txt, patch-2178.txt, patch-2178.txt,
> patch-2178.txt, patch-2178.txt, patch-2178.txt, patch-2178.txt
>
>
> This issue addresses the following items :
> 1. Check for accuracy of job tracker history logs.
> 2. After completion of the job, copy the JobHistory.log(Master index file)
> and the job history files to the DFS.
> 3. User can load the history with commands
> bin/hadoop job -history <directory>
> or
> bin/hadoop job -history <jobid>
> This will start a stand-alone jetty and load jsps
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
