[
https://issues.apache.org/jira/browse/HIVE-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-1343:
-------------------------------
Attachment: HIVE-1343.1.patch
> add an interface in RCFile to support concatenation of two files without
> (de)compression
> ----------------------------------------------------------------------------------------
>
> Key: HIVE-1343
> URL: https://issues.apache.org/jira/browse/HIVE-1343
> Project: Hadoop Hive
> Issue Type: New Feature
> Affects Versions: 0.6.0
> Reporter: Ning Zhang
> Assignee: He Yongqiang
> Fix For: 0.6.0
>
> Attachments: HIVE-1343.1.patch
>
>
> If two files are concatenated, we need to read each record in these files and
> write them back to the destination file. The IO cost is mostly unavoidable
> due to the lack of append functionality in HDFS. However the CPU cost could
> be significantly reduced by avoiding compression and decompression of the
> files.
> The File Format layer should provide API that implement the block-level
> concatenation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
