Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/1253#discussion_r15199538
--- Diff: docs/configuration.md ---
@@ -42,13 +42,14 @@ val sc = new SparkContext(new SparkConf())
Then, you can supply configuration values at runtime:
{% highlight bash %}
-./bin/spark-submit --name "My fancy app" --master local[4] myApp.jar
+./bin/spark-submit --name "My app" --master local[4] myApp.jar --conf
spark.shuffle.spill=false
{% endhighlight %}
The Spark shell and
[`spark-submit`](cluster-overview.html#launching-applications-with-spark-submit)
tool support two ways to load configurations dynamically. The first are
command line options,
-such as `--master`, as shown above. Running `./bin/spark-submit --help`
will show the entire list
-of options.
+such as `--master`, as shown above. `spark-submit` can accept any Spark
property, but requires
--- End diff --
Can you say "can accept any Spark property using the `--conf` flag, but
uses special flags for properties that play a pary..." (just a bit more
explicit)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
