I would like to run Beam functions on Spark cluster created on a Kubernetes using `spark-submit`. However, it is not clear how to integrate Beam's Job Service with non-standalone Spark master (on Kubernetes) launched by `spark-submit`.
Any information is appreciated.
Thanks
