Github user jimlohse commented on a diff in the pull request:
https://github.com/apache/spark/pull/10890#discussion_r50653981
--- Diff: docs/submitting-applications.md ---
@@ -177,8 +177,9 @@ debugging information by running `spark-submit` with
the `--verbose` option.
# Advanced Dependency Management
When using `spark-submit`, the application jar along with any jars
included with the `--jars` option
-will be automatically transferred to the cluster. Spark uses the following
URL scheme to allow
-different strategies for disseminating jars:
+will be automatically transferred to the cluster. URLs supplied after
--jars must be separated by commas. Each entry points to a specific jar file,
resulting in a comma-separated list of local jars. That list is included on the
driver and executor classpaths. Directory expansion does not work with --jars.
--- End diff --
Oh I didn't catch the first point of your question til now, I think they
are URLS because I think they need the file:// before them, that's an
URL too?
On 01/24/2016 12:24 PM, Sean Owen wrote:
>
> In docs/submitting-applications.md
> <https://github.com/apache/spark/pull/10890#discussion_r50640513>:
>
> > @@ -177,8 +177,9 @@ debugging information by running `spark-submit`
with the `--verbose` option.
> >
> > # Advanced Dependency Management
> > When using `spark-submit`, the application jar along with any jars
included with the `--jars` option
> > -will be automatically transferred to the cluster. Spark uses the
following URL scheme to allow
> > -different strategies for disseminating jars:
> > +will be automatically transferred to the cluster. URLs supplied after
--jars must be separated by commas. Each entry points to a specific jar file,
resulting in a comma-separated list of local jars. That list is included on the
driver and executor classpaths. Directory expansion does not work with --jars.
>
> This seems OK but do they have to be local JARs (I think so)? in which
> case are they really URLs? The second sentence you added seems to say
> the same thing as the first then. You could back-tick |--jars| too for
> consistency.
>
> â
> Reply to this email directly or view it on GitHub
> <https://github.com/apache/spark/pull/10890/files#r50640513>.
>
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
