pudidic opened a new pull request, #3582:
URL: https://github.com/apache/hive/pull/3582

   ### What changes were proposed in this pull request?
   Changed FileUtils.copy() to skip identical files on the destination 
directory to improve copy performance. FileUtils.copy() originally just removed 
and recreated the destination directory. This change makes it compare each file 
and directory, and delete only different files and directories.
   
   ### Why are the changes needed?
   In an optimized replication bootstrap scenario, it copies many files from 
source to destination. It can copy thousands of files. If it fails during 
copying process, it retries. Then it has some files already copied, but its 
implementation removes them and copy all of them entirely. It should skip the 
already copied ones.
   
   ### Does this PR introduce _any_ user-facing change?
   No.
   
   ### How was this patch tested?
   It introduced few JUnit test scenarios in TestFileUtils and TestCopyUtils. 
It will be tested with automated regression test suites on the test server.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to