gaoyajun02 opened a new pull request #34231: URL: https://github.com/apache/spark/pull/34231
### What changes were proposed in this pull request? If submits a stage with abundant tasks, rack resolving takes a long time when YarnAllocator add or remove requests with locality preference caused by a mass of loops to execute rack resolving script. since SPARK-13704, spark re-implemented RackResolver and created a separate dnsToSwitchMapping. Here we can change to RackResolver's internal dnsToSwitchMapping to allow YarnAllocator to reuse CachedDNSToSwitchMapping as much as possible. ### How was this patch tested? Tested with unit tests + some internal tests on real cluster. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
