Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/8968#discussion_r41068987
--- Diff: docs/submitting-applications.md ---
@@ -122,21 +123,23 @@ The master URL passed to Spark can be in one of the
following formats:
<table class="table">
<tr><th>Master URL</th><th>Meaning</th></tr>
-<tr><td> local </td><td> Run Spark locally with one worker thread (i.e. no
parallelism at all). </td></tr>
-<tr><td> local[K] </td><td> Run Spark locally with K worker threads
(ideally, set this to the number of cores on your machine). </td></tr>
-<tr><td> local[*] </td><td> Run Spark locally with as many worker threads
as logical cores on your machine.</td></tr>
-<tr><td> spark://HOST:PORT </td><td> Connect to the given <a
href="spark-standalone.html">Spark standalone
+<tr><td> <code>local</code> </td><td> Run Spark locally with one worker
thread (i.e. no parallelism at all). </td></tr>
+<tr><td> <code>local[K]</code> </td><td> Run Spark locally with K worker
threads (ideally, set this to the number of cores on your machine). </td></tr>
+<tr><td> <code>local[*]</code> </td><td> Run Spark locally with as many
worker threads as logical cores on your machine.</td></tr>
+<tr><td> <code>spark://HOST:PORT</code> </td><td> Connect to the given <a
href="spark-standalone.html">Spark standalone
cluster</a> master. The port must be whichever one your master is
configured to use, which is 7077 by default.
</td></tr>
-<tr><td> mesos://HOST:PORT </td><td> Connect to the given <a
href="running-on-mesos.html">Mesos</a> cluster.
+<tr><td> <code>mesos://HOST:PORT</code> </td><td> Connect to the given <a
href="running-on-mesos.html">Mesos</a> cluster.
The port must be whichever one your is configured to use, which is
5050 by default.
Or, for a Mesos cluster using ZooKeeper, use
<code>mesos://zk://...</code>.
</td></tr>
-<tr><td> yarn-client </td><td> Connect to a <a
href="running-on-yarn.html"> YARN </a> cluster in
-client mode. The cluster location will be found based on the
HADOOP_CONF_DIR or YARN_CONF_DIR variable.
+<tr><td> <code>yarn</code> </td><td> Connect to a <a
href="running-on-yarn.html"> YARN </a> cluster in
+ <code>client</code> or <code>cluster</code> mode depending on the
value of <code>--deploy-mode</code>.
+ The cluster location will be found based on the
<code>HADOOP_CONF_DIR</code> or <code>YARN_CONF_DIR</code> variable.
</td></tr>
-<tr><td> yarn-cluster </td><td> Connect to a <a
href="running-on-yarn.html"> YARN </a> cluster in
-cluster mode. The cluster location will be found based on the
HADOOP_CONF_DIR or YARN_CONF_DIR variable.
+<tr><td> <code>yarn-client</code> </td><td> Equivalent to
<code>yarn</code> with <code>--deploy-mode client</code>
--- End diff --
Although deprecated feels a little strong ... yeah maybe best to sell it
that way. I'd feel funny about completely omitting them as they have been used
widely to date and still fully work.
Oops yes missed an occurrence of yarn-client, will fix
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
