[ 
https://issues.apache.org/jira/browse/SQOOP-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13494786#comment-13494786
 ] 

Hari Shreedharan commented on SQOOP-671:
----------------------------------------

I am not entirely happy with the way we are handling writes to the FS. There is 
too much of uncertainity in the code - especially in the 
SqoopOutputFormatLoadExecutor class. This patch for now provides the byte count 
when the format() method is called - assuming that at that point the data has 
been "transferred."  This patch, like everything else in sqoop 2 currently 
supports only the CSV. I intend to update the way the data is written out in a 
future patch: SQOOP-691.
                
> Mapreduce counters are not used in generated mapreduce jobs
> -----------------------------------------------------------
>
>                 Key: SQOOP-671
>                 URL: https://issues.apache.org/jira/browse/SQOOP-671
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 2.0.0
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Hari Shreedharan
>             Fix For: 2.0.0
>
>         Attachments: SQOOP-671-1.patch, SQOOP-671-2.patch, SQOOP-671-3.patch, 
> SQOOP-671-4.patch, SQOOP-671-5.patch
>
>
> As we're using threads to pass data instead of hadoop native way, we're 
> loosing some counters (bytes written, number of entries) that might be 
> interested for end user. We should propagate those counters ourselves.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to