Github user sascala commented on a diff in the pull request:
https://github.com/apache/spark/pull/14059#discussion_r69779900
--- Diff: docs/running-on-mesos.md ---
@@ -180,30 +180,47 @@ Note that jars or python files that are passed to
spark-submit should be URIs re
# Mesos Run Modes
-Spark can run over Mesos in two modes: "coarse-grained" (default) and
"fine-grained".
-
-The "coarse-grained" mode will launch only *one* long-running Spark task
on each Mesos
-machine, and dynamically schedule its own "mini-tasks" within it. The
benefit is much lower startup
-overhead, but at the cost of reserving the Mesos resources for the
complete duration of the
-application.
-
-Coarse-grained is the default mode. You can also set `spark.mesos.coarse`
property to true
-to turn it on explicitly in
[SparkConf](configuration.html#spark-properties):
-
-{% highlight scala %}
-conf.set("spark.mesos.coarse", "true")
-{% endhighlight %}
-
-In addition, for coarse-grained mode, you can control the maximum number
of resources Spark will
-acquire. By default, it will acquire *all* cores in the cluster (that get
offered by Mesos), which
-only makes sense if you run just one application at a time. You can cap
the maximum number of cores
-using `conf.set("spark.cores.max", "10")` (for example).
-
-In "fine-grained" mode, each Spark task runs as a separate Mesos task.
This allows
-multiple instances of Spark (and other frameworks) to share machines at a
very fine granularity,
-where each application gets more or fewer machines as it ramps up and
down, but it comes with an
-additional overhead in launching each task. This mode may be inappropriate
for low-latency
-requirements like interactive queries or serving web requests.
+Spark can run over Mesos in two modes: "coarse-grained" (default) and
+"fine-grained".
+
--- End diff --
## Coarse-Grained Mode
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
