This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new c1dad17c48e [SPARK-45961][DOCS] Document `spark.master.*`
configurations
c1dad17c48e is described below
commit c1dad17c48e17d30b284f4d6082766086d1cb7d4
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Thu Nov 16 15:36:05 2023 -0800
[SPARK-45961][DOCS] Document `spark.master.*` configurations
### What changes were proposed in this pull request?
This PR documents `spark.master.*` configurations.
### Why are the changes needed?
Currently, `spark.master.*` configurations are undocumented.
```
$ git grep 'ConfigBuilder("spark.master'
core/src/main/scala/org/apache/spark/internal/config/UI.scala: val
MASTER_UI_DECOMMISSION_ALLOW_MODE =
ConfigBuilder("spark.master.ui.decommission.allow.mode")
core/src/main/scala/org/apache/spark/internal/config/package.scala:
private[spark] val MASTER_REST_SERVER_ENABLED =
ConfigBuilder("spark.master.rest.enabled")
core/src/main/scala/org/apache/spark/internal/config/package.scala:
private[spark] val MASTER_REST_SERVER_PORT =
ConfigBuilder("spark.master.rest.port")
core/src/main/scala/org/apache/spark/internal/config/package.scala:
private[spark] val MASTER_UI_PORT = ConfigBuilder("spark.master.ui.port")
core/src/main/scala/org/apache/spark/internal/config/package.scala:
ConfigBuilder("spark.master.ui.historyServerUrl")
core/src/main/scala/org/apache/spark/internal/config/package.scala:
ConfigBuilder("spark.master.useAppNameAsAppId.enabled")
```
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manual review.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #43848 from dongjoon-hyun/SPARK-45961.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
docs/spark-standalone.md | 52 ++++++++++++++++++++++++++++++++++++++++++++++++
1 file changed, 52 insertions(+)
diff --git a/docs/spark-standalone.md b/docs/spark-standalone.md
index c96839c6e95..ce739cb90b5 100644
--- a/docs/spark-standalone.md
+++ b/docs/spark-standalone.md
@@ -190,6 +190,58 @@ SPARK_MASTER_OPTS supports the following system properties:
<table class="table table-striped">
<thead><tr><th>Property Name</th><th>Default</th><th>Meaning</th><th>Since
Version</th></tr></thead>
+<tr>
+ <td><code>spark.master.ui.port</code></td>
+ <td><code>8080</code></td>
+ <td>
+ Specifies the port number of the Master Web UI endpoint.
+ </td>
+ <td>1.1.0</td>
+</tr>
+<tr>
+ <td><code>spark.master.ui.decommission.allow.mode</code></td>
+ <td><code>LOCAL</code></td>
+ <td>
+ Specifies the behavior of the Master Web UI's /workers/kill endpoint.
Possible choices
+ are: <code>LOCAL</code> means allow this endpoint from IP's that are local
to the machine running
+ the Master, <code>DENY</code> means to completely disable this endpoint,
<code>ALLOW</code> means to allow
+ calling this endpoint from any IP.
+ </td>
+ <td>3.1.0</td>
+</tr>
+<tr>
+ <td><code>spark.master.ui.historyServerUrl</code></td>
+ <td>(None)</td>
+ <td>
+ The URL where Spark history server is running. Please note that this
assumes
+ that all Spark jobs share the same event log location where the history
server accesses.
+ </td>
+ <td>4.0.0</td>
+</tr>
+<tr>
+ <td><code>spark.master.rest.enabled</code></td>
+ <td><code>false</code></td>
+ <td>
+ Whether to use the Master REST API endpoint or not.
+ </td>
+ <td>1.3.0</td>
+</tr>
+<tr>
+ <td><code>spark.master.rest.port</code></td>
+ <td><code>6066</code></td>
+ <td>
+ Specifies the port number of the Master REST API endpoint.
+ </td>
+ <td>1.3.0</td>
+</tr>
+<tr>
+ <td><code>spark.master.useAppNameAsAppId.enabled</code></td>
+ <td><code>false</code></td>
+ <td>
+ (Experimental) If true, Spark master uses the user-provided appName for
appId.
+ </td>
+ <td>4.0.0</td>
+</tr>
<tr>
<td><code>spark.deploy.retainedApplications</code></td>
<td>200</td>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
