[ 
https://issues.apache.org/jira/browse/SQOOP-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496939#comment-13496939
 ] 

Hari Shreedharan commented on SQOOP-671:
----------------------------------------

It seems like Hadoop 1 does not have a way of exposing counters from the output 
format classes, though hadoop 2 does have this functionality. So for now, I am 
removing the bytes transferred part and leaving just rows read. We will revisit 
the bytes transferred later, when it is possible to update counters from the 
output format class. Hope this makes sense. Thanks.
                
> Mapreduce counters are not used in generated mapreduce jobs
> -----------------------------------------------------------
>
>                 Key: SQOOP-671
>                 URL: https://issues.apache.org/jira/browse/SQOOP-671
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 2.0.0
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Hari Shreedharan
>             Fix For: 2.0.0
>
>         Attachments: SQOOP-671-1.patch, SQOOP-671-2.patch, SQOOP-671-3.patch, 
> SQOOP-671-4.patch, SQOOP-671-5.patch
>
>
> As we're using threads to pass data instead of hadoop native way, we're 
> loosing some counters (bytes written, number of entries) that might be 
> interested for end user. We should propagate those counters ourselves.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to