[
https://issues.apache.org/jira/browse/HIVE-4221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641242#comment-13641242
]
Phabricator commented on HIVE-4221:
-----------------------------------
sxyuan has commented on the revision "HIVE-4221 [jira] Stripe-level merge for
ORC files
".
INLINE COMMENTS
common/src/java/org/apache/hadoop/hive/conf/HiveConf.java:481-485 Will do.
ql/src/java/org/apache/hadoop/hive/ql/io/merge/BlockMergeOutputFormat.java:33
Will do.
ql/src/test/queries/clientpositive/orcfile_merge1.q:1 I think setting the max
split size to 100 should generate multiple splits despite the small input. I
can check that a merge is actually happening and add comments for the tests.
ql/src/test/queries/clientpositive/orcfile_merge2.q:1 As above.
REVISION DETAIL
https://reviews.facebook.net/D9759
To: kevinwilfong, omalley, sxyuan
Cc: JIRA
> Stripe-level merge for ORC files
> --------------------------------
>
> Key: HIVE-4221
> URL: https://issues.apache.org/jira/browse/HIVE-4221
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor
> Reporter: Samuel Yuan
> Assignee: Samuel Yuan
> Attachments: HIVE-4221.HIVE-4221.HIVE-4221.HIVE-4221.D9759.1.patch
>
>
> As with RC files, we would like to be able to merge ORC files efficiently by
> reading/writing stripes without decompressing/recompressing them. This will
> be similar to the RC file merge, except that footers will have to be updated
> with the stripe positions in the new file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
