[
https://issues.apache.org/jira/browse/HIVE-25990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ayush Saxena resolved HIVE-25990.
---------------------------------
Fix Version/s: 4.0.0
Hadoop Flags: Reviewed
Resolution: Fixed
> Optimise multiple copies in case of CTAS in external tables for Object stores
> -----------------------------------------------------------------------------
>
> Key: HIVE-25990
> URL: https://issues.apache.org/jira/browse/HIVE-25990
> Project: Hive
> Issue Type: Improvement
> Reporter: Ayush Saxena
> Assignee: Ayush Saxena
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> Presently for CTAS with external tables, there are two renames, operations,
> one from tmp to _ext and then from _ext to actual target.
> In case of object stores, the renames lead to actual copy. Avoid renaming by
> avoiding rename from tmp to _ext, but by creating a list of files to be
> copied in that directly, which can be consumed in the move task, to copy
> directly from tmp to actual target.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)