[
https://issues.apache.org/jira/browse/SPARK-3451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316284#comment-15316284
]
Christian Kurz commented on SPARK-3451:
---------------------------------------
In order to align with best practices of using jars on HDFS, can we have
support for wildcards also for HDFS (not just local FS jar)? --jars
hdfs://external/spark/libs/* ?
> spark-submit should support specifying glob wildcards in the --jars CLI option
> ------------------------------------------------------------------------------
>
> Key: SPARK-3451
> URL: https://issues.apache.org/jira/browse/SPARK-3451
> Project: Spark
> Issue Type: New Feature
> Components: Spark Submit
> Affects Versions: 1.0.2
> Reporter: wolfgang hoschek
> Priority: Minor
>
> spark-submit should support specifying glob wildcards in the --jars CLI
> option, e.g. --jars /opt/myapp/*.jar
> This would simplify usage for enterprise customers, for example in
> combination with being able to specify --jars multiple times as described in
> https://issues.apache.org/jira/browse/SPARK-3450, like so:
> {code}
> my-spark-submit.sh:
> spark-submit --jars /opt/myapp/*.jar "$@"
> {code}
> Example usage:
> {code}
> my-spark-submit.sh --jars myUserDefinedFunction.jar
> {code}
> The relevant enhancement code might go into SparkSubmitArguments.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
