Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r190428420
--- Diff: docs/running-on-yarn.md ---
@@ -121,6 +121,40 @@ To use a custom metrics.properties for the application
master and executors, upd
Use lower-case suffixes, e.g. <code>k</code>, <code>m</code>,
<code>g</code>, <code>t</code>, and <code>p</code>, for kibi-, mebi-, gibi-,
tebi-, and pebibytes, respectively.
</td>
</tr>
+<tr>
+ <td><code>spark.yarn.am.resource.{resource-type}</code></td>
+ <td><code>(none)</code></td>
+ <td>
+ Amount of resource to use for the YARN Application Master in client
mode.
+ In cluster mode, use
<code>spark.yarn.driver.resource.<resource-type></code> instead.
+ Please note that this feature can be used only with Yarn 3.0+
+ <p/>
+ Example:
+ To request GPU resources from YARN, use:
<code>spark.yarn.am.resource.yarn.io/gpu</code>
+ </td>
+</tr>
+<tr>
+ <td><code>spark.yarn.driver.resource.{resource-type}</code></td>
+ <td><code>(none)</code></td>
+ <td>
+ Amount of resource to use for the YARN Application Master in cluster
mode.
+ Please note that this feature can be used only with Yarn 3.0+
--- End diff --
YARN
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
