[
https://issues.apache.org/jira/browse/MAPREDUCE-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13600400#comment-13600400
]
Ravi Prakash commented on MAPREDUCE-3779:
-----------------------------------------
What's the point of having a soft limit if it can be over-ridden by the users?
Would it simply trigger a warning message? I don't know if that use case is
compelling enough to merit a change.
> Create hard and soft limits for job counters
> --------------------------------------------
>
> Key: MAPREDUCE-3779
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3779
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: jobtracker, tasktracker
> Affects Versions: 0.23.0, 1.0.0
> Reporter: Dave Shine
> Priority: Minor
>
> The mapreduce.job.counters.limit is not overridable at the job level. While
> it is necessary to limit the number of counters to reduce overhead, there are
> times when exceeding the limit is required. Currently, the only solution is
> to increase the limit cluster wide.
> I would like to see a soft limit set in the mapred-site.xml that can be
> overridden at the job level, in addition to the hard limit that exists today.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira