Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/3771#discussion_r22353308
--- Diff:
yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala ---
@@ -153,6 +153,19 @@ private[spark] class ApplicationMaster(args:
ApplicationMasterArguments,
}
/**
+ * we should distinct the default final status between client and
cluster,
--- End diff --
can we clarify this comment a little. Perhaps something more like below
(feel free to reword)
Set the default final application status for client mode to UNDEFINED to
handle if YARN HA restarts the application so that it properly retries. Set the
final status to SUCCEEDED in cluster mode to handle if the user calls
System.exit from the application code.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
