dbtsai commented on a change in pull request #29897:
URL: https://github.com/apache/spark/pull/29897#discussion_r497005230
##########
File path: docs/running-on-kubernetes.md
##########
@@ -307,7 +307,18 @@ And, the claim name of a `persistentVolumeClaim` with
volume name `checkpointpvc
spark.kubernetes.driver.volumes.persistentVolumeClaim.checkpointpvc.options.claimName=check-point-pvc-claim
```
-The configuration properties for mounting volumes into the executor pods use
prefix `spark.kubernetes.executor.` instead of `spark.kubernetes.driver.`. For
a complete list of available options for each supported type of volumes, please
refer to the [Spark Properties](#spark-properties) section below.
+The configuration properties for mounting volumes into the executor pods use
prefix `spark.kubernetes.executor.` instead of `spark.kubernetes.driver.`.
+
+For example, you can mount a dynamically-created persistent volume claim per
executor by using `OnDemand` as a claim name and `storageClass` and `sizeLimit`
options like the following. This is useful in case of [Dynamic
Allocation](configuration.html#dynamic-allocation).
Review comment:
Can you explain why it's useful for DA? Currently, this doesn't support
DA yet. I think the use-case will be for people to use larger shuffle disks in
Kube where larger local disks are not allowed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
