Gianmario Spacagna created SPARK-7367:
-----------------------------------------
Summary: CLI --help -h overrides the application arguments
Key: SPARK-7367
URL: https://issues.apache.org/jira/browse/SPARK-7367
Project: Spark
Issue Type: Bug
Components: Spark Submit
Affects Versions: 1.0.0
Reporter: Gianmario Spacagna
Priority: Minor
The spark-submit script will parse the --help argument even if when is provided
as application argument.
E.g.
spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass
/MyLocalJAR.jar --help
or
spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass
/MyLocalJAR.jar -h
If my application is using a parsing library, such as Scallop, then it will
never be able to run the application with --help as argument.
I think the spark-submit script should only print the help message when is
provided as single argument like this:
spark-submit --help
or it should provide a separator for trailing arguments:
spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass
/MyLocalJAR.jar -- --help --arg1 --arg2
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
