Szilard Nemeth created YARN-9120:
------------------------------------
Summary: Need to have a way to turn off GPU auto-discovery in
GpuDiscoverer
Key: YARN-9120
URL: https://issues.apache.org/jira/browse/YARN-9120
Project: Hadoop YARN
Issue Type: Improvement
Reporter: Szilard Nemeth
Assignee: Szilard Nemeth
GpuDiscoverer.getGpusUsableByYarn either parses the user-defined GPU devices or
should have the value 'auto' (from property:
yarn.nodemanager.resource-plugins.gpu.allowed-gpu-devices)
In some circumstances, users would want to exclude a node from scheduling, so
they should have an option to turn off auto-discovery.
It's straightforward that this is possible by removing the GPU resource-plugin
from YARN's config along with GPU-related config in container-executor.cfg, but
doing that with a dedicated value for
yarn.nodemanager.resource-plugins.gpu.allowed-gpu-devices is a more lightweight
approach.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
