Enrico Minack created SPARK-49731:
-------------------------------------
Summary: Support Kubernetes subPathExpr and hostPath volume type
options
Key: SPARK-49731
URL: https://issues.apache.org/jira/browse/SPARK-49731
Project: Spark
Issue Type: New Feature
Components: k8s, Kubernetes
Affects Versions: 4.0.0
Reporter: Enrico Minack
Spark on K8S supports mounting volumes to driver and executor pods. It supports
the {{subPath}} but not the {{subPathExpr}} K8S option, which allows using
environment variables for the {{subPath}}. Further, hostPath volumes are always
mounted as default type {{""}}. Providing a different hostPath volume type
allows for more flexibility.
Add the following configuration options:
-
{{spark.kubernetes.executor.volumes.[VolumeType].[VolumeName].mount.subPathExpr}}
- {{spark.kubernetes.executor.volumes.hostPath.[VolumeName].options.type}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
