Hi Marius, Spark on Kubernetes does not yet support mounting user-specified volumes natively. But mounting volume is supported in https://github.com/GoogleCloudPlatform/spark-on-k8s-operator. Please see https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/docs/user-guide.md#mounting-volumes .
On Thu, Apr 12, 2018 at 7:50 AM, Marius <m.die0...@gmail.com> wrote: > Hey, > > i have a question regarding the Spark on Kubernetes feature. I would like > to mount a pre-populated Kubernetes volume into the execution pods of > Spark. One of my tools that i invoke using the Sparks pipe command requires > these files to be available on a POSIX compatible FS and they are too large > to justify copying them around using addFile. If this is not possible i > would like to know if the community be interested in such a feature. > > Cheers > > Marius > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
