TopGunViper edited a comment on issue #23509: [SPARK-26588][CORE] Idle executor should properly be removed when no job is su… URL: https://github.com/apache/spark/pull/23509#issuecomment-453722542 > 1. please fix the PR title to follow Spark's way. 2) Can you please figure out which patch introduce this regression? I did remember that this should be OK in my previous test. Hi @jerryshao I guess this problem was introduced by the patch [SPARK-21656](https://github.com/apache/spark/pull/18874). We need to update target number of executors in time before invoking `removeExecutors` in `schedule`.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
