10110346 commented on issue #22774: [SPARK-25780][CORE]Scheduling the tasks which have no higher level locality first URL: https://github.com/apache/spark/pull/22774#issuecomment-449619598 > > > IIUC, If task1 want to be scheduled on exec1, so, task0 must release exec1 before localityWaits timeout at NODE_LOCAL, right ? So, my concern is whether this change would contribute to a good improvement for locality schedule. Because, as far as I know, localityWaits time is always short. > > BTW, why don't you take RACK_LOCALITY into account, either ? The default value of localityWaits is 3s, I donnot think 3s is short. Yeah, RACK_LOCALITY should be took into account, if NODE_LOCALITY is ok, I will add it, thanks
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
