tgravescs commented on pull request #33869: URL: https://github.com/apache/spark/pull/33869#issuecomment-910292202
what problem are you seeing if they ctrl-c before spark context is started? Yeah I think the scenario he is saying here is yarn client mode tries to start, they user sees it taking to long (presumably isn't allocating them resources because they are all used) so they ctrl-c out of it before the ApplicationMaster can be scheduled. I believe that would happen at https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SparkContext.scala#L646 I would hope its ok to call stop if it hasn't completely started up because it should just call stop on the individual components if they have been started, but we should double check that all the components handle that properly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
