[
https://issues.apache.org/jira/browse/SQOOP-969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14746530#comment-14746530
]
Senthil Bogana commented on SQOOP-969:
--------------------------------------
I tried multiple times , but I am unable to reproduce the issues.
Could you please reconfirm the issue still exists.
> sqoop export with mysql connector uses more than twice as many mappers as the
> --num-mappers hint
> ------------------------------------------------------------------------------------------------
>
> Key: SQOOP-969
> URL: https://issues.apache.org/jira/browse/SQOOP-969
> Project: Sqoop
> Issue Type: Bug
> Components: connectors
> Affects Versions: 1.4.3
> Reporter: Will McQueen
> Labels: newbie
>
> sudo -u sqoop sqoop export --connect "jdbc:mysql://<hostname>/sqoop"
> --username sqoop --password sqoop --table quicktest --verbose --export-dir
> /user/sqoop/quicktest --num-mappers 12
> ...results in more than twice the number of mappers (according to the logs)
> as the specified '12' hint:
> 13/03/26 16:20:35 INFO mapred.JobClient: Job Counters
> 13/03/26 16:20:35 INFO mapred.JobClient: Launched map tasks=23
> ...and I couldn't help notice that the logs also say:
> 13/03/26 16:19:03 DEBUG mapreduce.ExportInputFormat: Target numMapTasks=12
> 13/03/26 16:19:03 DEBUG mapreduce.ExportInputFormat: Total input bytes=23
> ...where # input bytes maches # launched map tasks. Coincidence, or relation?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)