Hi, We are running Spark jobs to Kubernetes (using Spark 2.4.0 and cluster mode). To get the status of the spark job we check the status of the driver pod (using Kubernetes REST API).
Is it okay to assume that spark job is successful if the status of the driver pod is COMPLETED? Thanks, Chandu