jahstreet commented on issue #167: [LIVY-588]: Full support for Spark on Kubernetes URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-542079698 @pkrishn6 It uses Spark as is, you don't need to do any modifications to the Spark code. It uses Spark Submit in [cluster mode](http://spark.apache.org/docs/latest/running-on-kubernetes.html#cluster-mode), well, you can submit a job in a client mode too, but it will not work with Livy as you expect it I guess. It doesn't need spark-operator either. In short: you POST JSON to Livy -> Livy does Spark Submit in cluster mode for you Strongly recommend to try in your case. You may be interested in that [Helm](https://github.com/jahstreet/spark-on-kubernetes-helm) which contains some descriptions as well.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
