William Lo created GOBBLIN-1973:
-----------------------------------
Summary: Manifest file copy ignores copying files when source file
permissions differ from dest
Key: GOBBLIN-1973
URL: https://issues.apache.org/jira/browse/GOBBLIN-1973
Project: Apache Gobblin
Issue Type: Bug
Components: gobblin-core
Reporter: William Lo
Assignee: Abhishek Tiwari
When Manifest distcp fails to set permissions for any reason, we would expect a
retry of the copy to allow the datasets to reach eventual consistency. However,
the current logic of checking if a file is eligible for copy is to check if the
source file is newer, if so copy, and if the source file is exactly the same
modification time as the destination file, also copy if the permissions are
different. However, in most cases the destination will have a newer
modification time once it is written and set permissions, so the source file
will generally be older but we still want the permissions to match.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
