[
https://issues.apache.org/jira/browse/TEZ-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147505#comment-14147505
]
Alexander Pivovarov commented on TEZ-1344:
------------------------------------------
How to get tez job counters?
I tried to run wordcount from hadoop examples using yarn-tez. Job did not
print any counters at the end
$ hadoop jar hadoop-mapreduce-examples-2.4.1.jar wordcount -D
mapreduce.framework.name=yarn-tez in out
...
14/09/25 00:10:20 INFO mapreduce.Job: Job job_1411625298954_0010 completed
successfully
14/09/25 00:10:20 INFO mapreduce.Job: Counters: 0
> Combiner counters reported by Tez look wrong
> --------------------------------------------
>
> Key: TEZ-1344
> URL: https://issues.apache.org/jira/browse/TEZ-1344
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Cheolsoo Park
> Priority: Minor
>
> Combiner input/output counters reported by a Tez job seems wrong
> {code}
> org.apache.hadoop.mapreduce.TaskCounter:
> COMBINE_OUTPUT_RECORDS 35,977,263,353
> COMBINE_INPUT_RECORDS 1,000,529,333
> {code}
> As can be seen, combiner output records > input records?!
> The same counters from a MR job looks as follows-
> {code}
> Map-Reduce Framework:
> Combine output records 1,000,316,600
> Combine input records 35,977,049,632
> {code}
> Somehow input and output are swapped?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
