comphead commented on code in PR #874: URL: https://github.com/apache/datafusion-comet/pull/874#discussion_r1733223749
########## docs/source/user-guide/kubernetes.md: ########## @@ -33,3 +33,76 @@ docker build -t apache/datafusion-comet -f kube/Dockerfile . The exact syntax will vary depending on the Kubernetes distribution, but an example `spark-submit` command can be found [here](https://github.com/apache/datafusion-comet/tree/main/benchmarks). +## Helm chart + +Install helm Spark operator for Kubernetes +```bash +helm repo add spark-operator https://kubeflow.github.io/spark-operator + +helm repo update + +helm install my-release spark-operator/spark-operator --namespace spark-operator --create-namespace --set webhook.enable=true +```` + +Check the operator is deployed +```bash +helm status --namespace spark-operator my-release + +NAME: my-release +NAMESPACE: spark-operator +STATUS: deployed +REVISION: 1 +TEST SUITE: None +``` + +Create example Spark application file `spark-pi.yaml` +```bash +apiVersion: sparkoperator.k8s.io/v1beta2 +kind: SparkApplication +metadata: + name: spark-pi + namespace: default +spec: + type: Scala + mode: cluster + image: spark:3.5.0 Review Comment: @andygrove please help with public Comet docker image link? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
