squito commented on issue #24245: [SPARK-13704][CORE][YARN] Reduce rack resolution time URL: https://github.com/apache/spark/pull/24245#issuecomment-478154677 This is an update of https://github.com/apache/spark/pull/23951, to address the last couple review items. All credit still to @LantaoJin. Note that I also removed the skipRackResolution option entirely, rather than moving it to a new conf, because I think this should improve time enough to make that unnecessary. But I haven't tested on a 5k node cluster :)
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
