Thomas Graves created SPARK-27488:
-------------------------------------
Summary: Driver interface to support GPU resources
Key: SPARK-27488
URL: https://issues.apache.org/jira/browse/SPARK-27488
Project: Spark
Issue Type: Story
Components: Spark Core
Affects Versions: 3.0.0
Reporter: Thomas Graves
Assignee: Thomas Graves
We want to have an interface to allow the users on the driver to get what
resources are allocated to them. This is mostly to handle the case the cluster
manager does not launch the driver in an isolated environment and where users
could be sharing hosts. For instance in standalone mode it doesn't support
container isolation so a host may have 4 gpu's, but only 2 of them could be
assigned to the driver. In this case we need an interface for the cluster
manager to specify what gpu's for the driver to use and an interface for the
user to get the resource information
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
