[
https://issues.apache.org/jira/browse/MAPREDUCE-7025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16294652#comment-16294652
]
Lantao Jin commented on MAPREDUCE-7025:
---------------------------------------
Oh, I just see there are 4 metrics in TaskCounter:
MAP_PHYSICAL_MEMORY_BYTES_MAX,
MAP_VIRTUAL_MEMORY_BYTES_MAX,
REDUCE_PHYSICAL_MEMORY_BYTES_MAX,
REDUCE_VIRTUAL_MEMORY_BYTES_MAX;
So I think this ticket can be close.
> Avg and Max of memory could be record in TaskCount
> --------------------------------------------------
>
> Key: MAPREDUCE-7025
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7025
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Lantao Jin
> Assignee: Lantao Jin
>
> MapReduce Counter is very helpful tool to do statistics, analysis and tuning
> in industry. One popular way is analysing job historical status of running to
> optimise continuously. But when the job completed, the memory usage in
> counter is a snapshot value {{PHYSICAL_MEMORY_BYTES}}. So if we can also
> record the average value and the max value instead of only the last snapshot
> value, it could be much helpful.
> If you think it' ok. I will contribute the code.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
