Naveen Gangam created HIVE-21209:
------------------------------------

             Summary: [Improvement] Exchange partitition to be metadata only 
change?
                 Key: HIVE-21209
                 URL: https://issues.apache.org/jira/browse/HIVE-21209
             Project: Hive
          Issue Type: Improvement
          Components: Hive
    Affects Versions: 2.1.1
            Reporter: Naveen Gangam


https://issues.apache.org/jira/browse/HIVE-14560
Current implementation of the above jira is a metadata and a "copy" of the 
partition data on the DFS. Could possibly take a long time to copy the data for 
large partition data especially different storage clusters. When exchanging a 
partition from a HDFS to S3a or vice versa the data is copied and this is 
client copy operation and it can be very slow if the partition is very large.

The customer would like the "exchange partition" operation to purely metadata.  
I would like to start a discussion on whether this improvement is to be made. 
Obviously, the current behavior will be supported but and option for it to be a 
metadata operation only needs to be evaluated.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to