[
https://issues.apache.org/jira/browse/SPARK-23450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790558#comment-16790558
]
Sujith Chacko commented on SPARK-23450:
---------------------------------------
As pr my understanding the jar will be distributed to the worker nodes. Already
tested a UDF scenario where a custom jar is added to the nodes via --jars and
executed the UDF query and its working fine
> jars option in spark submit is documented in misleading way
> -----------------------------------------------------------
>
> Key: SPARK-23450
> URL: https://issues.apache.org/jira/browse/SPARK-23450
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit
> Affects Versions: 2.2.1
> Reporter: Gregory Reshetniak
> Priority: Major
>
> I am wondering if the {{--jars}} option on spark submit is actually meant for
> distributing the dependency jars onto the nodes in cluster?
>
> In my case I can see it working as a "symlink" of sorts. But the
> documentation is written in the way that suggests otherwise. Please help me
> figure out if this is a bug or just my reading of the docs. Thanks!
> _
>
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
