jahstreet commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-768463208
Hi @JagadeeshNagella , unfortunately it is not possible with the setup you've described. The files should be available for Livy container and be `local` for its FS. So in your case I see several options: - Setup the process to copy .yaml file over to the Livy container and then refer it in the job request - Attach shared folder to Livy container and setup the process to copy files over to it for each user (I hope it is possible to configure ACLs for the share folder subdirectories) - Refer the file from the shared storage (eg.: hdfs or s3), though I'm not sure spark currently supports that This is what I currently can come up with. I would also suggest reaching spark on Kubernetes community for the advice. Best. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
