skonto commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r274732894
########## File path: docs/running-on-kubernetes.md ########## @@ -1054,6 +1075,15 @@ See the [configuration page](configuration.html) for information on Spark config Specify the grace period in seconds when deleting a Spark application using spark-submit. </td> </tr> +<tr> + <td>Client dependencies</td> + <td>Stores a local file to the path defined by <code>spark.kubernetes.file.upload.path</code></td> + <td> + Path to store files at the spark submit side in cluster mode. For example: + <code>spark.kubernetes.file.upload.path=s3a://<s3-bucket>/path</code> + File should specified as <code>client://path/to/file </code> Review comment: I changed the convention to file://. I will update the PR tomorrow with the integration tests based on ceph nano. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
