sarutak commented on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-655696048
@mridulm >As soon as we heartbeat to driver, we will start getting task assignment, etc - how does the interact with a plugin which has not yet completed initialization ? Yeah that's right. >Instead of changing order, why not document that inordinate delays in plugin initialization should be avoided and deferred to >seperate thread/managed by plugin. This can be a reasonable compromise. Another solution can be to perform initialization before registering executors and then it's guaranteed that plugins are initialized when tasks start running. What do you think? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
