Github user madanadit commented on the issue:
https://github.com/apache/spark/pull/21032
@foxish @liyinan926 Thanks for your comments. To make the configuration
more general, here is an initial proposal.
Context:
- volumeMount requires `[name, mountPath, readWriteMode]`
- volume requires `[name, type, [type_specific_optionsâ¦]]`
for `type=hostPath`, `type_specific_options=[path,
type=[Directory,File,â¦]]`
Proposed format :
```properties
spark.kubernetes.executor.volumes.[type].[name].mount=mountPath:readWriteMode
spark.kubernetes.executor.volumes.[type].[name].options.[type_specific_option1]=[value]
```
where, the format for value can be chosen based on the volume type/option.
Nested options can be easily supported using this format. For instance, for
hostPath volumes the config would look like:
```properties
spark.kubernetes.executor.volumes.hostPath.hostPath-1.mount=/opt/domain:ro
spark.kubernetes.executor.volumes.hostPath.hostPath-1.options.path=/tmp/domain
spark.kubernetes.executor.volumes.hostPath.hostPath-1.options.type=Directory
```
Alternatively, the volume type can be a top level property like
`spark.kubernetes.executor.volumes.[name]=[type]`. Thoughts?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
