dongjoon-hyun commented on code in PR #45667:
URL: https://github.com/apache/spark/pull/45667#discussion_r1536712746
##########
core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala:
##########
@@ -996,6 +1005,13 @@ private[spark] class SparkSubmit extends Logging {
SparkContext.getActive.foreach(_.stop())
} catch {
case e: Throwable => logError(s"Failed to close SparkContext: $e")
+ } finally {
+ if (SparkContext.getActive.isEmpty) {
+ if (!DriverPodIsNormal) {
+ logError(s"Driver Pod will exit because: $driverThrow")
+ System.exit(EXIT_FAILURE)
Review Comment:
What is the YARN exit code for your case? According to your PR description,
it's not clear, @littlelittlewhite09 . It would be described in the PR
description.
> When spark app runs on yarn-cluster mode, everything is ok. Driver can
terminate normally if encounters exception or err.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
