Jing Zhao created HADOOP-10608:
----------------------------------

             Summary: Support appending data in DistCp
                 Key: HADOOP-10608
                 URL: https://issues.apache.org/jira/browse/HADOOP-10608
             Project: Hadoop Common
          Issue Type: Improvement
            Reporter: Jing Zhao
            Assignee: Jing Zhao


Currently when doing distcp with -update option, for two files with the same 
file names but with different file length or checksum, we overwrite the whole 
file. It will be good if we can detect the case where (sourceFile = targetFile 
+ appended_data), and only transfer the appended data segment to the target. 
This will be very useful if we're doing incremental distcp.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to