pkrishn6 commented on issue #167: [LIVY-588]: Full support for Spark on Kubernetes URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-541977156 @jahstreet : We currently run spark in standalone mode on a kubernetes cluster with HPA (horizontal pod scaler) and have incubator-livy submit jobs to that . We are in the process of moving to spark native on K8s. Does this PR use the modified spark-submit api that support Kubernetes (http://spark.apache.org/docs/latest/running-on-kubernetes.html#client-mode) or does it need the spark-operator (https://github.com/GoogleCloudPlatform/spark-on-k8s-operator). Apologies, I was not able to gather this piece of information from the PR.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
