huangzhaobo99 opened a new pull request, #8559: URL: https://github.com/apache/hadoop/pull/8559
### Description of PR JIRA: https://issues.apache.org/jira/browse/HDFS-17937 This patch adds **dfs.namenode.checkpoint.parallel.upload.max-threads** to cap fsimage upload concurrency in StandbyCheckpointer when parallel upload is enabled. The limit is needed to avoid excessive simultaneous fsimage uploads in multi-NameNode HA deployments, which can otherwise increase CPU/network/disk pressure and impact checkpoint/upload stability. Effective concurrency is now min(remoteNNAddresses.size(), max-threads), with config/docs updates in DFSConfigKeys, CheckpointConf, and hdfs-default.xml, plus validation that max-threads > 0. ### How was this patch tested? Added TestStandbyCheckpoints#testCheckpointParallelUploadRespectsMaxThreads UT to verify observed upload concurrency does not exceed configured max threads. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
