grarkydev opened a new pull request #32289: URL: https://github.com/apache/spark/pull/32289
Co-authored-by: hongdd <[email protected]> ### What changes were proposed in this pull request? Supporting SparkAppHandle object to be able to manage a running Spark application on Kubernetes. It can be used to monitor the application changes and to stop the application by pod deletion. This Pull Request has been raised due to a inactivity of a previous one - #30520 ### Why are the changes needed? There is an inconsistency in the Spark application managing with SparkAppHandle object between Kubernetes and other resource managers such as Yarn/Mesos. Currently, this feature is not properly implemented on Kubernetes which may cause some issues. ### Does this PR introduce _any_ user-facing change? Yes, it changes the behavior of `SparkAppHandle` object which the user may use to communicate with the launched Spark application. Its interface is remained as it is. Some missing functionalities have been implemented. ### How was this patch tested? Few unit tests has been added. May be found in org.apache.spark.deploy.k8s.submit package: - `PodStatusWatcherSuite` - new ones - `ClientSuite` - added some -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
