tgravescs commented on a change in pull request #24406: [SPARK-27024] Executor
interface for cluster managers to support GPU and other resources
URL: https://github.com/apache/spark/pull/24406#discussion_r282606941
##########
File path: docs/configuration.md
##########
@@ -221,6 +221,25 @@ of the most common options to set are:
This option is currently supported on YARN and Kubernetes.
</td>
</tr>
+<tr>
+ <td><code>spark.executor.resource.{resourceType}.count</code></td>
+ <td>0</td>
+ <td>
+ The number of a particular resource type to use per executor process.
+ If this is used, you must also specify the
+ <code>spark.executor.resource.{resourceType}.discoveryScript</code>
+ for the executor to find the resource on startup.
+ </td>
+</tr>
+<tr>
+ <td><code>spark.executor.resource.{resourceType}.discoveryScript</code></td>
+ <td>None</td>
+ <td>
+ The script the executor should run to discover a particular resource type.
This should
+ return a JSON string in the format of the ResourceInformation class. This
has a
Review comment:
done
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
