bmarcott edited a comment on issue #27207: [WIP][SPARK-18886][CORE] Make Locality wait time measure resource under utilization due to delay scheduling. URL: https://github.com/apache/spark/pull/27207#issuecomment-583947229 @cloud-fan > Is it possible to centralize the delay scheduling code? Now it's in both `TaskSchedulerImpl` and `TaskSetManager`, which makes it a bit hard to understand as you need to think about the interactions between them. I am not sure a good way to centralize because 1. The TSM is called multiple times with various offers and we need to keep track of what happened across those calls 2. TSM today doesn't differentiate whether it didn't launch a task due to blacklisting or due to delay scheduling, hence the new boolean returned.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
