[jira] [Updated] (YARN-3438) add a mode to replay MR job history files to the timeline service

[Junping Du (JIRA)]

 [ 
https://issues.apache.org/jira/browse/YARN-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Junping Du updated YARN-3438:
-
Issue Type: Bug  (was: Sub-task)
Parent: (was: YARN-3378)

> add a mode to replay MR job history files to the timeline service
> -
>
> Key: YARN-3438
> URL: https://issues.apache.org/jira/browse/YARN-3438
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: timelineserver
>Reporter: Sangjin Lee
>Assignee: Sangjin Lee
> Attachments: YARN-3438.000.patch
>
>
> The subtask covers the work on top of YARN-3437 to add a mode to replay MR 
> job history files to the timeline service storage.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (YARN-3438) add a mode to replay MR job history files to the timeline service

[Sangjin Lee (JIRA)]

 [ 
https://issues.apache.org/jira/browse/YARN-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sangjin Lee updated YARN-3438:
--
Attachment: YARN-3438.000.patch

A preliminary patch based on MAPREDUCE-6355.005.patch to solicit reviews.

The idea is to scan an hdfs directory of jobhistory files, and each mapper will 
get a roughly equal share of job history files to process.

Also found a small issue in FileSystemTimelineWriterImpl.java and fixed it (cc 
[~vrushalic]).

Your feedback is greatly appreciated.

> add a mode to replay MR job history files to the timeline service
> -
>
> Key: YARN-3438
> URL: https://issues.apache.org/jira/browse/YARN-3438
> Project: Hadoop YARN
>  Issue Type: Sub-task
>  Components: timelineserver
>Reporter: Sangjin Lee
>Assignee: Sangjin Lee
> Attachments: YARN-3438.000.patch
>
>
> The subtask covers the work on top of YARN-3437 to add a mode to replay MR 
> job history files to the timeline service storage.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)