[
https://issues.apache.org/jira/browse/SPARK-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16222996#comment-16222996
]
Apache Spark commented on SPARK-11035:
--------------------------------------
User 'vanzin' has created a pull request for this issue:
https://github.com/apache/spark/pull/19591
> Launcher: allow apps to be launched in-process
> ----------------------------------------------
>
> Key: SPARK-11035
> URL: https://issues.apache.org/jira/browse/SPARK-11035
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Affects Versions: 1.6.0
> Reporter: Marcelo Vanzin
>
> The launcher library is currently restricted to launching apps as child
> processes. That is fine for a lot of cases, especially if the app is running
> in client mode.
> But in certain cases, especially launching in cluster mode, it's more
> efficient to avoid launching a new process, since that process won't be doing
> much.
> We should add support for launching apps in process, even if restricted to
> cluster mode at first. This will require some rework of the launch paths to
> avoid using system properties to propagate configuration.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]