[
https://issues.apache.org/jira/browse/HADOOP-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amareshwari Sri Ramadasu updated HADOOP-2178:
---------------------------------------------
Status: Patch Available (was: Open)
Submiting patch with Devaraj's comments incorporated.
Along with the comments, This patch addresses couple of things:
1. User can stop logging to output directory by giving value "none" to config
item "hadoop.job.history.user.location".
2. Adds a class OutputLogFilter to mapred package, the path filter, which
filters the paths containing logs.
> Job history on HDFS
> -------------------
>
> Key: HADOOP-2178
> URL: https://issues.apache.org/jira/browse/HADOOP-2178
> Project: Hadoop Core
> Issue Type: Improvement
> Components: mapred
> Reporter: Amareshwari Sri Ramadasu
> Assignee: Amareshwari Sri Ramadasu
> Fix For: 0.16.0
>
> Attachments: patch-2178.txt, patch-2178.txt, patch-2178.txt
>
>
> This issue addresses the following items :
> 1. Check for accuracy of job tracker history logs.
> 2. After completion of the job, copy the JobHistory.log(Master index file)
> and the job history files to the DFS.
> 3. User can load the history with commands
> bin/hadoop job -history <directory>
> or
> bin/hadoop job -history <jobid>
> This will start a stand-alone jetty and load jsps
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
