[
https://issues.apache.org/jira/browse/MAPREDUCE-7025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lantao Jin updated MAPREDUCE-7025:
----------------------------------
Description:
MapReduce Counter is very helpful tool to do statistics, analysis and tuning in
industry. One popular way is analysing job historical status of running to
optimise continuously. But when the job completed, the memory usage in counter
is a snapshot value {{PHYSICAL_MEMORY_BYTES}}. So if we can also record the
average value and the max value instead of only the last snapshot value, it
could be much helpful.
If you think it' ok. I will contribute the code.
was:
MapReduce Counter is very helpful tool to do statistics, analysis and tuning in
industry. One popular way is analysing job historical status of running to
optimise continuously. But when the job completed, the memory usage in counter
is a snapshot value {{PHYSICAL_MEMORY_BYTES}}. So if we can record the average
value and the max value instead of the last snapshot value, it could be much
helpful.
If you think it' ok. I will contribute the code.
> Avg and Max of memory could be record in TaskCount
> --------------------------------------------------
>
> Key: MAPREDUCE-7025
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7025
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Lantao Jin
> Assignee: Lantao Jin
>
> MapReduce Counter is very helpful tool to do statistics, analysis and tuning
> in industry. One popular way is analysing job historical status of running to
> optimise continuously. But when the job completed, the memory usage in
> counter is a snapshot value {{PHYSICAL_MEMORY_BYTES}}. So if we can also
> record the average value and the max value instead of only the last snapshot
> value, it could be much helpful.
> If you think it' ok. I will contribute the code.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
