tgravescs commented on issue #26696: [WIP][SPARK-18886][CORE] Make locality wait time be the time since a TSM's available slots were fully utilized URL: https://github.com/apache/spark/pull/26696#issuecomment-563334543 @squito would be interested in your opinion on when/if we reset the timeout. If we never reset it, which is time from stage submit, that might not wait enough. If we leave it as is you could get a bit of unpredictability. (see my comment: https://github.com/apache/spark/pull/26696#issuecomment-561672267) I don't think any approach we take will be perfect its just finding that balance between waiting to long and not enough. This is something I need to think about some more as well.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
