houman babai created OOZIE-3603: ----------------------------------- Summary: Oozie Luncher & Map-Reduce Action Complete Successfully However Oozie Still Fails the Action Key: OOZIE-3603 URL: https://issues.apache.org/jira/browse/OOZIE-3603 Project: Oozie Issue Type: Bug Components: core Affects Versions: 5.1.0 Environment: Oozie Version 5.1.0-CDH6.3.1 Reporter: houman babai
I am using oozie 5.1.0-cdh6.3.1 In my workflow I have a mapreduce action, which generates over 300 counters. The oozie launcher & the mapreduce job successfully complete, however, oozie reports that: {code} Error Code: LimitExceededException LimitExceededException: Too many counters: 121 max=120 {code} I have updated mapred-site.xml. The log for the mapreduce job reports success, in fact I can see all the counters & the actual output of the mapreduce job on hdfs. In the oozie launcher log I can see: * mapreduce.job.counters.max : 8192 * mapreduce.job.counters.groups.max : 100 Furthermore, the oozie launcher log ends with: {code:java} -------------------- Submitting Oozie action Map-Reduce job ======================= <<< Invocation of Main class completed <<< Oozie Launcher, propagating new Hadoop job id to Oozie ======================= job_1594765755382_0035 ======================= Oozie Launcher, uploading action data to HDFS sequence file: hdfs://HDFS/user/MY-ID/oozie-oozi/0000012-200714223028181-oozie-oozi-W/ACTION-NAME--map-reduce/action-data.seq Stopping AM Callback notification attempts left 0 Callback notification trying http://OOZIE-URL:11000/oozie/callback?id=0000012-200714223028181-oozie-oozi-W@ACTION-NAME&status=RUNNING Callback notification to http://OOZIE-URL:11000/oozie/callback?id=0000012-200714223028181-oozie-oozi-W@ACTION-NAME&status=RUNNING succeeded Callback notification succeeded {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)