Ngone51 commented on issue #22774: [SPARK-25780][CORE]Scheduling the tasks which have no higher level locality first URL: https://github.com/apache/spark/pull/22774#issuecomment-449618173 IIUC, If task1 want to be scheduled on exec1, so, task0 must release exec1 before localityWaits timeout at NODE_LOCAL, right ? So, my concern is whether this change would contribute to a good improvement for locality schedule. Because, as far as I know, localityWaits time is always short. BTW, why don't you take RACK_LOCALITY into account, either ?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
