Ngone51 commented on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-655851569
> As soon as we heartbeat to driver, we will start getting task assignment, etc - how does the interact with a plugin which has not yet completed initialization ? I wonder if this is correct. Executor only gets task assignment after it sends `LaunchedExecutor` to driver: https://github.com/apache/spark/blob/3946b243284fbd3bd98b456115ae194ad49fe8fe/core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala#L156-L158 After heartbeater started, the executor can send heartbeat to the driver asynchronically and the initialization of the plugin can keep going after heartbeater starting. It doesn't matter if it takes a long time because we'd send heartbeat now but no task assignment since `LaunchedExecutor` hasn't been sent. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
