mridulm edited a comment on pull request #33873: URL: https://github.com/apache/spark/pull/33873#issuecomment-914655782
By callback I meant some handler (when provided) which is invoked when a state transition completes. A few examples could be: * When spark context has completed initialization - last thing initialization does. * When spark context has completed shutting down - last thing sc.stop does. This will allow for custom initialization/termination logic to be added without modifying spark in order to support some specific usecase. The default behavior of spark would continue, and users can customize/override how their spark applications behave. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
