w4-sjcho opened a new pull request #27364: Adds support for Kubernetes NFS volume mounts. URL: https://github.com/apache/spark/pull/27364 ### What changes were proposed in this pull request? I've added a new feature that enables mounting of Kubernetes NFS volumes. Most of the codes are just slight modifications from the existing codes for EmptyDir/HostDir/PVC support. ### Why are the changes needed? Kubernetes supports various kinds of volumes, but Spark for Kubernetes supports only EmptyDir/HostDir/PVC. By adding support for NFS, we can use Spark for Kubernetes with NFS storage. ### Does this PR introduce any user-facing change? Users can now mount NFS volumes by running commands like: ``` spark-submit \ --conf spark.kubernetes.driver.volumes.nfs.myshare.mount.path=/myshare \ --conf spark.kubernetes.driver.volumes.nfs.myshare.mount.readOnly=false \ --conf spark.kubernetes.driver.volumes.nfs.myshare.options.server=nfs.example.com \ --conf spark.kubernetes.driver.volumes.nfs.myshare.options.path=/storage/myshare \ ... ``` ### How was this patch tested? Test cases were added just like the existing EmptyDir support. Also the code were ran against my Kubernetes and NFS using pyspark.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
