[
https://issues.apache.org/jira/browse/SPARK-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-4506:
------------------------------
Description:
The "Launching Compiled Spark Applications" section of the Spark Standalone
docs claims that standalone mode only supports {{client}} deploy mode:
{quote}
The spark-submit script provides the most straightforward way to submit a
compiled Spark application to the cluster. For standalone clusters, Spark
currently only supports deploying the driver inside the client process that is
submitting the application (client deploy mode).
{quote}
It looks like {{standalone-cluster}} mode actually works (I've used it and have
heard from users that are successfully using it, too).
The current line was added in SPARK-2259 when {{standalone-cluster}} mode
wasn't officially supported. It looks like SPARK-2260 fixed a number of bugs
in {{standalone-cluster}} mode, so we should update the documentation if we're
now ready to officially support it.
was:
Thee "Launching Compiled Spark Applications" section of the Spark Standalone
docs claims that standalone mode only supports {{client}} deploy mode:
{quote}
The spark-submit script provides the most straightforward way to submit a
compiled Spark application to the cluster. For standalone clusters, Spark
currently only supports deploying the driver inside the client process that is
submitting the application (client deploy mode).
{quote}
It looks like {{standalone-cluster}} mode actually works (I've used it and have
heard from users that are successfully using it, too).
The current line was added in SPARK-2259 when {{standalone-cluster}} mode
wasn't officially supported. It looks like SPARK-2260 fixed a number of bugs
in {{standalone-cluster}} mode, so we should update the documentation if we're
now ready to officially support it.
> Update documentation to clarify whether standalone-cluster mode is now
> officially supported
> -------------------------------------------------------------------------------------------
>
> Key: SPARK-4506
> URL: https://issues.apache.org/jira/browse/SPARK-4506
> Project: Spark
> Issue Type: Bug
> Components: Documentation
> Affects Versions: 1.1.0, 1.1.1, 1.2.0
> Reporter: Josh Rosen
> Assignee: Andrew Or
>
> The "Launching Compiled Spark Applications" section of the Spark Standalone
> docs claims that standalone mode only supports {{client}} deploy mode:
> {quote}
> The spark-submit script provides the most straightforward way to submit a
> compiled Spark application to the cluster. For standalone clusters, Spark
> currently only supports deploying the driver inside the client process that
> is submitting the application (client deploy mode).
> {quote}
> It looks like {{standalone-cluster}} mode actually works (I've used it and
> have heard from users that are successfully using it, too).
> The current line was added in SPARK-2259 when {{standalone-cluster}} mode
> wasn't officially supported. It looks like SPARK-2260 fixed a number of bugs
> in {{standalone-cluster}} mode, so we should update the documentation if
> we're now ready to officially support it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
