This is an automated email from the ASF dual-hosted git repository.
wlo pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/gobblin.git
from dcdf8254e [GOBBLIN-2103] GaaS does not update flowgraph or templates
if file lengths remain the same (#3990)
add af4b822a1 [GOBBLIN-2101] Set Owner/Group recursively through ancestors
in manifest distcp when pre-creating folders before commit (#3988)
No new revisions were added by this update.
Summary of changes:
.../data/management/copy/OwnerAndPermission.java | 29 -----
.../gobblin/data/management/copy/CopyableFile.java | 1 +
.../data/management/copy/ManifestBasedDataset.java | 38 +++---
.../management/copy/RecursiveCopyableDataset.java | 12 +-
.../copy/SubsetFilesCopyableDataset.java | 1 +
.../management/copy/hive/HiveCopyEntityHelper.java | 2 +-
.../management/copy/iceberg/IcebergDataset.java | 2 +-
.../copy/publisher/CopyDataPublisher.java | 2 +-
.../writer/FileAwareInputStreamDataWriter.java | 59 +--------
... CreateDirectoryWithPermissionsCommitStep.java} | 47 ++++----
...ommitStep.java => SetPermissionCommitStep.java} | 32 +++--
.../copy/ConcurrentBoundedWorkUnitListTest.java | 1 +
.../copy/CopySourcePrioritizationTest.java | 1 +
.../data/management/copy/CopyableFileTest.java | 1 +
.../data/management/copy/CopyableFileUtils.java | 2 +
.../data/management/copy/TestCopyableDataset.java | 1 +
.../writer/FileAwareInputStreamDataWriterTest.java | 5 +-
.../TarArchiveInputStreamDataWriterTest.java | 2 +-
.../dataset/ManifestBasedDatasetFinderTest.java | 27 +++--
...ateAndSetDirectoryPermissionCommitStepTest.java | 82 -------------
...eateDirectoryWithPermissionsCommitStepTest.java | 134 +++++++++++++++++++++
.../util/commit/SetPermissionCommitStepTest.java | 106 ++++++++++++++++
.../java/org/apache/gobblin/util/HadoopUtils.java | 67 +++++++++++
.../util/filesystem}/OwnerAndPermission.java | 19 +--
24 files changed, 413 insertions(+), 260 deletions(-)
delete mode 100644
gobblin-data-management/src/main/java/gobblin/data/management/copy/OwnerAndPermission.java
copy
gobblin-data-management/src/main/java/org/apache/gobblin/util/commit/{CreateAndSetDirectoryPermissionCommitStep.java
=> CreateDirectoryWithPermissionsCommitStep.java} (59%)
rename
gobblin-data-management/src/main/java/org/apache/gobblin/util/commit/{CreateAndSetDirectoryPermissionCommitStep.java
=> SetPermissionCommitStep.java} (64%)
delete mode 100644
gobblin-data-management/src/test/java/org/apache/gobblin/util/commit/CreateAndSetDirectoryPermissionCommitStepTest.java
create mode 100644
gobblin-data-management/src/test/java/org/apache/gobblin/util/commit/CreateDirectoryWithPermissionsCommitStepTest.java
create mode 100644
gobblin-data-management/src/test/java/org/apache/gobblin/util/commit/SetPermissionCommitStepTest.java
rename
{gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy
=>
gobblin-utility/src/main/java/org/apache/gobblin/util/filesystem}/OwnerAndPermission.java
(92%)
