devaraj-kavali commented on issue #19616: [SPARK-22404][YARN] Provide an option to use unmanaged AM in yarn-client mode URL: https://github.com/apache/spark/pull/19616#issuecomment-457420282 > What's the behavior when the AM fails before the context is stopped? > > From the code I see some stuff is printed to the logs and the YARN app is marked as finished. But does the context remain alive? Or should that event cause the context to be stopped? > > I'm mostly concerned with how clear it is for the user that the jobs start failing because the context is now unusable. If AM fails before the context is stopped, AM reports the FAILED status to the RM and Client receives the FAILED status as part of monitoring and stops the services including the context.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
