Michael Griffiths created YARN-11452:
----------------------------------------

             Summary: Ability to use GPUs on YARN Nodemanager when running 
inside Docker
                 Key: YARN-11452
                 URL: https://issues.apache.org/jira/browse/YARN-11452
             Project: Hadoop YARN
          Issue Type: Bug
          Components: nodemanager
    Affects Versions: 3.2.4
         Environment: Docker
            Reporter: Michael Griffiths


When running Nodemanagers in docker I have tried to enable GPU support however 
this fails because it seems to require GPU isolation to be enabled.  GPU 
isolation requires cgroups which are not available in Docker containers (I even 
tried using lxcfs to simulate cgroups - but this also fails with an error about 
mounting the /cgroups/devices/hadoop-yarn directory).

Is it possible to configure Nodemanagers so that they can detect/use GPUs 
without enabling GPU isolation?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to