akshatb1 commented on a change in pull request #28258:
URL: https://github.com/apache/spark/pull/28258#discussion_r426150555
##########
File path: core/src/main/scala/org/apache/spark/deploy/Client.scala
##########
@@ -176,6 +190,25 @@ private class ClientEndpoint(
} else if (!Utils.responseFromBackup(message)) {
System.exit(-1)
}
+
+ case DriverStatusResponse(found, state, _, _, _) =>
+ if (found) {
+ state.get match {
+ case DriverState.FINISHED | DriverState.FAILED |
+ DriverState.ERROR | DriverState.KILLED =>
+ logInfo(s"State of $submittedDriverID is ${state.get}, " +
+ s"exiting spark-submit JVM.")
+ System.exit(0)
+ case _ =>
+ Thread.sleep(REPORT_DRIVER_STATUS_INTERVAL)
+ logInfo(s"State of $submittedDriverID is ${state.get}, " +
+ s"continue monitoring driver status.")
+ asyncSendToMasterAndForwardReply[DriverStatusResponse](
Review comment:
@jiangxb1987 Thanks for reviewing. I have changed it to 10 seconds and
took care of your other comments. Kindly review the PR again.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
