[
https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27024:
----------------------------------
Description: The executor interface shall deal with the resources allocated
to the executor by cluster managers(Standalone, YARN, Kubernetes). The
Executor either needs to be told the resources it was given or it needs to
discover them in order for the executor to sync with the driver to expose
available resources to support task scheduling. (was: The executor interface
shall deal with the resources allocated to the executor by cluster
managers(Standalone, YARN, Kubernetes), so the Spark Executor don’t need to
involve into the GPU discovery and allocation, which shall be handled by
cluster managers. However, an executor need to sync with the driver to expose
available resources to support task scheduling.)
> Executor interface for cluster managers to support GPU resources
> ----------------------------------------------------------------
>
> Key: SPARK-27024
> URL: https://issues.apache.org/jira/browse/SPARK-27024
> Project: Spark
> Issue Type: Story
> Components: Spark Core
> Affects Versions: 3.0.0
> Reporter: Xingbo Jiang
> Assignee: Thomas Graves
> Priority: Major
>
> The executor interface shall deal with the resources allocated to the
> executor by cluster managers(Standalone, YARN, Kubernetes). The Executor
> either needs to be told the resources it was given or it needs to discover
> them in order for the executor to sync with the driver to expose available
> resources to support task scheduling.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
