dongjoon-hyun commented on a change in pull request #29897:
URL: https://github.com/apache/spark/pull/29897#discussion_r497284666
##########
File path: docs/running-on-kubernetes.md
##########
@@ -307,7 +307,18 @@ And, the claim name of a `persistentVolumeClaim` with
volume name `checkpointpvc
spark.kubernetes.driver.volumes.persistentVolumeClaim.checkpointpvc.options.claimName=check-point-pvc-claim
```
-The configuration properties for mounting volumes into the executor pods use
prefix `spark.kubernetes.executor.` instead of `spark.kubernetes.driver.`. For
a complete list of available options for each supported type of volumes, please
refer to the [Spark Properties](#spark-properties) section below.
+The configuration properties for mounting volumes into the executor pods use
prefix `spark.kubernetes.executor.` instead of `spark.kubernetes.driver.`.
+
+For example, you can mount a dynamically-created persistent volume claim per
executor by using `OnDemand` as a claim name and `storageClass` and `sizeLimit`
options like the following. This is useful in case of [Dynamic
Allocation](configuration.html#dynamic-allocation).
Review comment:
In short, I made the PVC(and PV) be created at every pod creation in
`ExecutorPodsAllocator.scala`. Please see the original code. For example, if
you kill some pod, new executor is going to be created with a new PVC.
- https://github.com/apache/spark/pull/29846 [SPARK-32971][K8S] Support
dynamic PVC creation/deletion for K8s executors
cc @viirya
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
