[
https://issues.apache.org/jira/browse/SPARK-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628790#comment-14628790
]
Marcelo Vanzin commented on SPARK-9074:
---------------------------------------
Thanks for filing, this has been on my backburner for a while but I haven't had
the chance to work on it yet.
The only thing is that I don't like the idea of adding specific methods for
these options (e.g. "setPrincipal") - it would be more future proof to have a
generic "addSparkArg" method or something.
Also, some of the args you list might be covered by existing config options
(which can be set via "setConf") but others are definitely not.
> Expose more of the YARN commandline API to the SparkLauncher
> ------------------------------------------------------------
>
> Key: SPARK-9074
> URL: https://issues.apache.org/jira/browse/SPARK-9074
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Affects Versions: 1.4.0
> Reporter: Erick Tryzelaar
>
> It would be helpful if the SparkLauncher was extended to support more of the
> spark commandline options, including but not limited to:
> * {{--proxy-user}}
> * {{--driver-cores}}
> * {{--queue}}
> * {{--archives}}
> * {{--principal}}
> * {{--keytab}}
> * {{--packages}}
> * {{--repositories}}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
