pan3793 commented on issue #56353:
URL: https://github.com/apache/spark/issues/56353#issuecomment-4661320035
Spark supports the driver-pod-only mode - launch a Pod and run Spark in
local mode inside, which should meet your expectations.
```
spark-submit \
--master k8s://... \
--deploy-mode cluster \
--driver-cores 4 \
--conf spark.kubernetes.driver.master=local[*] \
...
```
See more details at SPARK-42190
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
