[ 
https://issues.apache.org/jira/browse/MAPREDUCE-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13600400#comment-13600400
 ] 

Ravi Prakash commented on MAPREDUCE-3779:
-----------------------------------------

What's the point of having a soft limit if it can be over-ridden by the users? 
Would it simply trigger a warning message? I don't know if that use case is 
compelling enough to merit a change.
                
> Create hard and soft limits for job counters
> --------------------------------------------
>
>                 Key: MAPREDUCE-3779
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3779
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: jobtracker, tasktracker
>    Affects Versions: 0.23.0, 1.0.0
>            Reporter: Dave Shine
>            Priority: Minor
>
> The mapreduce.job.counters.limit is not overridable at the job level.  While 
> it is necessary to limit the number of counters to reduce overhead, there are 
> times when exceeding the limit is required.  Currently, the only solution is 
> to increase the limit cluster wide.
> I would like to see a soft limit set in the mapred-site.xml that can be 
> overridden at the job level, in addition to the hard limit that exists today.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to