[
https://issues.apache.org/jira/browse/OOZIE-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574889#comment-14574889
]
Rohini Palaniswamy commented on OOZIE-2195:
-------------------------------------------
That would be really good.
[~jaydeepvishwakarma],
Can you make it a generic aggregation framework to aggregate counters of
child jobs for all types of actions into one counter group and do special
aggregation or collection of input/output counters for pig/hive actions? If
you just want to work on the Pig special counters in this jira it is fine, but
make it generic with empty implementation in JavaActionExecutor/LauncherMain
(aggregation of all counters to be added later) and override in
PigActionExecutor/PigMain to add the counters.
> Expose Pig read/write bytes details as counters in Launcher
> -----------------------------------------------------------
>
> Key: OOZIE-2195
> URL: https://issues.apache.org/jira/browse/OOZIE-2195
> Project: Oozie
> Issue Type: New Feature
> Reporter: Jaydeep Vishwakarma
> Assignee: Narayan Periwal
>
> Pig action spawns multiple mr jobs and all the aggregated read/write bytes
> metrics are emitted in logs only. It would be really helpful if we expose
> those information in Launcher as counters. This should not be the default
> behaviour. User can enable this by job level or global
> configuration.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
