[
https://issues.apache.org/jira/browse/SPARK-7367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14532859#comment-14532859
]
Gianmario Spacagna commented on SPARK-7367:
-------------------------------------------
When using CLI libraries like Scallop you can then specify --help or -h as
argument of your application and it will print out the usage of your options
pretty much like Spark does. If I am running my application using spark-submit
and then --help I would like to see my application helper message rather than
how to run a Spark job.
See examples here:
https://github.com/scallop/scallop/wiki/Help-information-printing
> spark-submit CLI --help -h overrides the application arguments
> --------------------------------------------------------------
>
> Key: SPARK-7367
> URL: https://issues.apache.org/jira/browse/SPARK-7367
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit
> Reporter: Gianmario Spacagna
> Priority: Minor
>
> The spark-submit script will parse the --help argument even if is provided as
> application argument.
> E.g.
> spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass
> /MyLocalJAR.jar --help
> or
> spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass
> /MyLocalJAR.jar -h
> If my application is using a parsing library, such as Scallop, then it will
> never be able to run the application with --help as argument.
> I think the spark-submit script should only print the help message when is
> provided as single argument like this:
> spark-submit --help
> or it should provide a separator for trailing arguments:
> spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass
> /MyLocalJAR.jar -- --help --arg1 --arg2
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]