Create hard and soft limits for job counters
--------------------------------------------
Key: MAPREDUCE-3779
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3779
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: jobtracker, tasktracker
Affects Versions: 1.0.0, 0.23.0
Reporter: Dave Shine
Priority: Minor
The mapreduce.job.counters.limit is not overridable at the job level. While it
is necessary to limit the number of counters to reduce overhead, there are
times when exceeding the limit is required. Currently, the only solution is to
increase the limit cluster wide.
I would like to see a soft limit set in the mapred-site.xml that can be
overridden at the job level, in addition to the hard limit that exists today.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira