r7raul1984 opened a new pull request, #3517: URL: https://github.com/apache/celeborn/pull/3517
### What changes were proposed in this pull request? Do not attempt to fetch from any worker that has already been added to fetchExcludedWorkers. Instead, try fetching from a peer worker within the same PartitionLocation. ### Why are the changes needed? With the configuration celeborn.client.fetch.excludeWorkerOnFailure.enabled=true and celeborn.client.push.replicate.enabled=true, when a fetch operation fails for a specific worker, that worker is added to fetchExcludedWorkers. However, subsequent attempts still try to fetch from this worker, causing repeated errors and slowing down shuffle fetch performance. The logic should be modified so that any worker already in fetchExcludedWorkers is completely excluded from further fetch operations. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Manual test by debug -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
