[
https://issues.apache.org/jira/browse/MAPREDUCE-1017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Kimball updated MAPREDUCE-1017:
-------------------------------------
Status: Patch Available (was: Open)
> Compression and output splitting for Sqoop
> ------------------------------------------
>
> Key: MAPREDUCE-1017
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1017
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/sqoop
> Reporter: Aaron Kimball
> Assignee: Aaron Kimball
> Attachments: MAPREDUCE-1017.2.patch, MAPREDUCE-1017.3.patch,
> MAPREDUCE-1017.4.patch, MAPREDUCE-1017.patch
>
>
> Sqoop "direct mode" writing will generate a single large text file in HDFS.
> It is important to be able to compress this data before it reaches HDFS. Due
> to the difficulty in splitting compressed files in HDFS for use by MapReduce
> jobs, data should also be split at compression time.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
