anishek created HIVE-16898:
------------------------------

             Summary: Validation of file after distcp in repl load 
                 Key: HIVE-16898
                 URL: https://issues.apache.org/jira/browse/HIVE-16898
             Project: Hive
          Issue Type: Bug
          Components: HiveServer2
    Affects Versions: 3.0.0
            Reporter: anishek
            Assignee: anishek
             Fix For: 3.0.0


time between deciding the source and destination path for distcp to invoking of 
distcp can have a change of the source file, hence distcp might copy the wrong 
file to destination, hence we should an additional check on the checksum of the 
source file path after distcp finishes to make sure the path didnot change 
during the copy process. if it has take additional steps to delete the previous 
file on destination and copy the new source and repeat the same process as 
above till we copy the correct file. 




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to