[
https://issues.apache.org/jira/browse/HADOOP-3708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia updated HADOOP-3708:
----------------------------------
Attachment: history-scripts-0.18.tgz
Here are some modified scripts for 0.18 too. It looks like some naming in the
history log changed slightly, unfortunately (e.g. task attempts being called
task_someting instead of tip_something, or counters being written as key:value
instead of key=value). Are you guys planning to finalize the history log format
sometime? It would make it easier to do accounting after the fact using tools
like this.
> Provide accounting functionality for Hadoop resource manager
> ------------------------------------------------------------
>
> Key: HADOOP-3708
> URL: https://issues.apache.org/jira/browse/HADOOP-3708
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/capacity-sched
> Reporter: Hemanth Yamijala
> Assignee: Hemanth Yamijala
> Fix For: 0.20.0
>
> Attachments: history-scripts-0.16.tgz, history-scripts-0.18.tgz,
> history-scripts.patch
>
>
> HADOOP-3421 describes requirements for a new resource manager in Hadoop to
> schedule Map/Reduce jobs. In production systems, it would be useful to
> produce accounting information related to the scheduling - such as job start
> and run times, resources used, etc. This information can be consumed by other
> systems to build accounting for shared resources. This JIRA is for tracking
> the requirements, approach and implementation for producing accounting
> information.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
