[ https://issues.apache.org/jira/browse/SPARK-3450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell resolved SPARK-3450. ------------------------------------ Resolution: Won't Fix I'd prefer not to do this one, it complicates our parsing substantially. It's possible to just write a bash loop that creates a single long list of jars. > Enable specifiying the --jars CLI option multiple times > ------------------------------------------------------- > > Key: SPARK-3450 > URL: https://issues.apache.org/jira/browse/SPARK-3450 > Project: Spark > Issue Type: Improvement > Components: Deploy > Affects Versions: 1.0.2 > Reporter: wolfgang hoschek > > spark-submit should support specifiying the --jars option multiple time, e.g. > --jars foo.jar,bar.jar --jars baz.jar,oops.jar should be equivalent to --jars > foo.jar,bar.jar,baz.jar,oops.jar > This would allow using wrapper scripts that simplify usage for enterprise > customers along the following lines: > {code} > my-spark-submit.sh: > jars= > for i in /opt/myapp/*.jar; do > if [ $i -gt 0] > then > jars="$jars," > fi > jars="$jars$i" > done > spark-submit --jars "$jars" "$@" > {code} > Example usage: > {code} > my-spark-submit.sh --jars myUserDefinedFunction.jar > {code} > The relevant enhancement code might go into SparkSubmitArguments. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org