tgravescs edited a comment on pull request #33941: URL: https://github.com/apache/spark/pull/33941#issuecomment-931402635
A few other concerns here. 1) how does this work with minimum executors, seems easiest enough to not worry about it for this and just reuse if there. 2) how does this apply to executor monitor idle timeout. we don't timeout executors when more tasks to be run, do we take that into account here and keep compatible ones? 3) Does UI show proper/useful information here 4) I don't think this has taken numBarrierSlotsAvailable into account - see calculateAvailableSlots -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
