Josh Rosen created SPARK-4506:
---------------------------------
Summary: Update documentation to clarify whether
standalone-cluster mode is now officially supported
Key: SPARK-4506
URL: https://issues.apache.org/jira/browse/SPARK-4506
Project: Spark
Issue Type: Bug
Components: Documentation
Affects Versions: 1.1.0, 1.1.1, 1.2.0
Reporter: Josh Rosen
Assignee: Andrew Or
Thee "Launching Compiled Spark Applications" section of the Spark Standalone
docs claims that standalone mode only supports {{client}} deploy mode:
{quote}
The spark-submit script provides the most straightforward way to submit a
compiled Spark application to the cluster. For standalone clusters, Spark
currently only supports deploying the driver inside the client process that is
submitting the application (client deploy mode).
{quote}
It looks like {{standalone-cluster}} mode actually works (I've used it and have
heard from users that are successfully using it, too).
The current line was added in SPARK-2259 when {{standalone-cluster}} mode
wasn't officially supported. It looks like SPARK-2260 fixed a number of bugs
in {{standalone-cluster}} mode, so we should update the documentation if we're
now ready to officially support it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]