IceMimosa commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#discussion_r274346318
########## File path: docs/running-on-kubernetes.md ########## @@ -1054,6 +1075,15 @@ See the [configuration page](configuration.html) for information on Spark config Specify the grace period in seconds when deleting a Spark application using spark-submit. </td> </tr> +<tr> + <td>Client dependencies</td> + <td>Stores a local file to the path defined by <code>spark.kubernetes.file.upload.path</code></td> + <td> + Path to store files at the spark submit side in cluster mode. For example: + <code>spark.kubernetes.file.upload.path=s3a://<s3-bucket>/path</code> + File should specified as <code>client://path/to/file </code> Review comment: Is it still necessary to use `client://` now? Or just enough to use `file://`? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
