[
https://issues.apache.org/jira/browse/YARN-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16788055#comment-16788055
]
Adam Antal commented on YARN-9337:
----------------------------------
Working in TDD uploaded the patch first (expected to fail).
I believe when the user manually gives the gpu devices by hand, it is no need
to run the script, is that right? If the script is not needed to run, then the
{{yarn.nodemanager.resource-plugins.gpu.path-to-discovery-executables}} config
should not needed as well. The current behaviour is that the path to the
executable must be provided with the configuration, even though the devices are
given manually - so in my interpretation the script (and thus its path) is not
necessary to be given.
[~wangda] and [~snemeth], you have work a lot on this area, could you share
your opinion on this?
> GPU auto-discovery script runs even when the resource is given by hand
> ----------------------------------------------------------------------
>
> Key: YARN-9337
> URL: https://issues.apache.org/jira/browse/YARN-9337
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: yarn
> Affects Versions: 3.2.0
> Reporter: Adam Antal
> Assignee: Adam Antal
> Priority: Major
> Attachments: YARN-9337.001.patch
>
>
> The nvidia-smi script is called even when the gpu configs are given by hand
> (so there's no need for GPU auto-discovery).
> We should mitigate the call of that script, since it has no effect. (The
> configs written by the user is not overwritten by the result of the
> auto-discovery script.)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
