qijiale76 opened a new pull request, #8579: URL: https://github.com/apache/hadoop/pull/8579
### Description of PR This PR improves how FedBalance builds the DistCp commands it submits. Previously, FedBalance used a mostly fixed DistCp option set. This patch adds operator-facing controls for several DistCp settings: - Add `-skipAclPreserve` to disable ACL preservation. - Add `hdfs.fedbalance.preserve.acl.enabled` to control ACL preservation from configuration. - Preserve ACLs only when both source and destination filesystems support ACLs. - Add `-preserveTimes` to preserve file timestamps. - Add `-distcpStrategy` to pass a DistCp copy strategy. - Add `-numListstatusThreads` to pass DistCp listStatus thread count. - Register `-diffThreshold` in the shared FedBalance CLI options. - Serialize the new options in `FedBalanceContext` so recovered jobs use the same DistCp settings. - Update FedBalance documentation and tests. The default behavior remains conservative: timestamp preservation is disabled unless requested, DistCp strategy and listStatus thread count use DistCp defaults unless specified, and ACL preservation remains enabled only when ACLs are supported on both sides. ### How was this patch tested? Ran the related FedBalance unit tests. This change has also been validated on a production cluster. ### AI Tooling Contains content generated by Codex and Claude Code. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
