akshatb1 commented on pull request #28258: URL: https://github.com/apache/spark/pull/28258#issuecomment-622331662
> I'm not that familiar with standalone mode, so assume we would like to make it behave similar with yarn-cluster. > > How it behaves if supervise option is specified? In yarn-cluster mode it waits till the application has been killed - submit process would wait even the case of relaunching of AM. Does it work like so? > > And given the flag only affects the standalone mode and yarn has the same flag having prefix, it would be better to add prefix (`spark.submit.standalone.`?) to differentiate, but that's only me and others may have better idea. (Or even unifying the config if majority of resource managers are supporting this?) @HeartSaVioR Yes, that's correct. The behaviour is same as yarn-cluster mode. If supervise option is specified, it will wait for driver to be re-launched and continue monitoring. Updated the flag name to spark.submit.standalone.waitAppCompletion. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
