Ngone51 commented on issue #28168: [SPARK-31395][CORE]reverse preferred location to make schedule more even URL: https://github.com/apache/spark/pull/28168#issuecomment-611579789 @ChenjunZou How can you make sure that front nodes in the reversed list are available to serve tasks? What if others are busy except `xxx.93`? And what if the location lists are ``` [xxx.100 xxx.02 xxx.93] [xxx.102 xxx.04 xxx.93] [xxx.66 xxx.05 xxx.93] ``` then, do you still prefer "reverse" here? IMO, the status of scheduling is quite complex and undermined at runtime. So, I don't think such "reverse" could solve the problem. And I do think that you should try #27207 firstly as it really ease the problem you mentioned here.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
