[ https://issues.apache.org/jira/browse/OOZIE-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
houman babai resolved OOZIE-3604. --------------------------------- Fix Version/s: 5.3.0 Resolution: Duplicate I will upgrade to 5.3.0 > Oozie Luncher & Map-Reduce Action Complete Successfully However Oozie Still > Fails the Action > -------------------------------------------------------------------------------------------- > > Key: OOZIE-3604 > URL: https://issues.apache.org/jira/browse/OOZIE-3604 > Project: Oozie > Issue Type: Bug > Components: core > Affects Versions: 5.1.0 > Environment: 5.1.0-cdh-6.3.1 > 5.1.0-cdh-6.3.2 > Reporter: houman babai > Priority: Major > Fix For: 5.3.0 > > > I am using oozie 5.1.0-cdh6.3.1 > In my workflow I have a mapreduce action, which generates over 300 counters. > The oozie launcher & the mapreduce job successfully complete, however, oozie > reports that: > {code:java} > Error Code: LimitExceededException > LimitExceededException: Too many counters: 121 max=120 > {code} > I have updated mapred-site.xml. > The log for the *mapreduce job* reports success, in fact I can see all the > counters & the actual output of the mapreduce job on hdfs. > In the oozie *launcher log* I can see: > * mapreduce.job.counters.max : 8192 > * mapreduce.job.counters.groups.max : 100 > I set the oozie logs to TRACE, and I can see the following WARN: > {code:java} > WARN org.apache.oozie.command.wf.ActionEndXCommand: SERVER[SERVER-NAME] > USER[MY-NAME] GROUP[-] TOKEN[] APP[APP-NAME] > JOB[0000012-200714223028181-oozie-oozi-W] > ACTION[0000012-200714223028181-oozie-oozi-W@ACTION-NAME] Error ending action > [ACTION-NAME]. ErrorType [ERROR], ErrorCode [LimitExceededException], Message > [LimitExceededException: Too many counters: 121 max=120] > WARN org.apache.oozie.command.wf.ActionEndXCommand: SERVER[SERVER-NAME] > USER[MY-NAME] GROUP[-] TOKEN[] APP[APP-NAME] > JOB[0000012-200714223028181-oozie-oozi-W] > ACTION[0000012-200714223028181-oozie-oozi-W@ACTION-NAME] Setting Action > Status to [ERROR] > {code} > Looking through the oozie source code, I think the issue may be traced to > [line in > MapReduceActionExecutor|https://github.com/apache/oozie/blob/a40ab5361372aa73c9e4aa386a9c81bd21742aa4/core/src/main/java/org/apache/oozie/action/hadoop/MapReduceActionExecutor.java#L250] > I am guessing that for some reason, the context or the config passed into the > [createJobClient|https://github.com/apache/oozie/blob/a40ab5361372aa73c9e4aa386a9c81bd21742aa4/core/src/main/java/org/apache/oozie/action/hadoop/MapReduceActionExecutor.java#L242] > lack the mapreduce.job.counters.max configuration. > I tried several other things hoping that it would somehow work: > * I added the mapreduce.job.counters.max as configuration into the action > (inside the workflow) > * I added the mapreduce.job.counters.max to action config default.xml > Nothing has helped. -- This message was sent by Atlassian Jira (v8.3.4#803005)