[ 
https://issues.apache.org/jira/browse/TEZ-3459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572484#comment-15572484
 ] 

Hitesh Shah edited comment on TEZ-3459 at 10/13/16 4:54 PM:
------------------------------------------------------------

[~kshukla] I guess the impl needs to be changed to use the dagclient and invoke 
the necessary api to obtain the counters. We dont have task level apis as of 
today but we should be able to return back the job level counters as the 
dag/vertex level counters are accessible. 

Similar to what Pig does, I am assuming we will need to take the tez counters 
and convert them to MR counters as part of the impl change. 


was (Author: hitesh):
[~kshukla] I guess the impl needs to be changed to use the dagclient and invoke 
the necessary api to obtain the counters. We dont have task level apis as of 
today but we should be able to return back the job level counters as the 
dag/vertex level counters are accessible. 

> Issues running M/R jobs with Tez
> --------------------------------
>
>                 Key: TEZ-3459
>                 URL: https://issues.apache.org/jira/browse/TEZ-3459
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Manuel Godbert
>         Attachments: colorCount.sh, colorCount.sh, mr-example.jar, 
> mr-example.jar
>
>
> After applying the patch delivered in TEZ-3330, I enriched the 
> MapredColorCount example to reproduce some of the other issues I encountered 
> on the jobs I wish to see running with Tez.
> I am attaching a jar to the JIRA, including source code, and a script file 
> detailing the observed results in comments.
> It adresses 4 issues:
> - the embedded jars in /lib are ignored by Tez, but YARN uses them without 
> additional configuration
> - The use of a combiner causes a NullPointerException
> - The counters incremented in the Reporter objects stay at 0
> - The additional output configured is missing in the final job output folder. 
> It seems the problem occurs at task commit time, as the new output file is 
> not in the same folder as the main output file.
> I am using HDP2.4



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to