[jira] [Commented] (YARN-10225) Support of AMD ROCm GPUs in Yarn
[ https://issues.apache.org/jira/browse/YARN-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288304#comment-17288304 ] Luca Toscano commented on YARN-10225: - I opened https://github.com/RadeonOpenCompute/ROCm/issues/1391, feel free to follow up in there with a +1 in case :) > Support of AMD ROCm GPUs in Yarn > > > Key: YARN-10225 > URL: https://issues.apache.org/jira/browse/YARN-10225 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Luca Toscano >Priority: Major > > Hi! > I just watched [1] and it seems that Hops supports AMD GPUs natively in Yarn, > so I am wondering if there any plans for Hadoop to do the same. I work at the > Wikimedia foundation and we are currently using AMD GPUs, it would be really > great to have support for them in Hadoop 3.x. > [1][ > https://databricks.com/session/rocm-and-distributed-deep-learning-on-spark-and-tensorflow|https://databricks.com/session/rocm-and-distributed-deep-learning-on-spark-and-tensorflow] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10225) Support of AMD ROCm GPUs in Yarn
[ https://issues.apache.org/jira/browse/YARN-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078368#comment-17078368 ] Luca Toscano commented on YARN-10225: - I see https://issues.apache.org/jira/browse/YARN-8891, nice! > Support of AMD ROCm GPUs in Yarn > > > Key: YARN-10225 > URL: https://issues.apache.org/jira/browse/YARN-10225 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Luca Toscano >Priority: Major > > Hi! > I just watched [1] and it seems that Hops supports AMD GPUs natively in Yarn, > so I am wondering if there any plans for Hadoop to do the same. I work at the > Wikimedia foundation and we are currently using AMD GPUs, it would be really > great to have support for them in Hadoop 3.x. > [1][ > https://databricks.com/session/rocm-and-distributed-deep-learning-on-spark-and-tensorflow|https://databricks.com/session/rocm-and-distributed-deep-learning-on-spark-and-tensorflow] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10225) Support of AMD ROCm GPUs in Yarn
[ https://issues.apache.org/jira/browse/YARN-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078357#comment-17078357 ] Luca Toscano commented on YARN-10225: - Thanks! I am wondering if there is documentation about how to write a plugin, I'll check how it was done for Nvidia in the meantime. Maybe it could be good to involve AMD itself on this? > Support of AMD ROCm GPUs in Yarn > > > Key: YARN-10225 > URL: https://issues.apache.org/jira/browse/YARN-10225 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Luca Toscano >Priority: Major > > Hi! > I just watched [1] and it seems that Hops supports AMD GPUs natively in Yarn, > so I am wondering if there any plans for Hadoop to do the same. I work at the > Wikimedia foundation and we are currently using AMD GPUs, it would be really > great to have support for them in Hadoop 3.x. > [1][ > https://databricks.com/session/rocm-and-distributed-deep-learning-on-spark-and-tensorflow|https://databricks.com/session/rocm-and-distributed-deep-learning-on-spark-and-tensorflow] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10225) Support of AMD ROCm GPUs in Yarn
[ https://issues.apache.org/jira/browse/YARN-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078340#comment-17078340 ] Zhankun Tang commented on YARN-10225: - Not sure if YARN-8851 can help here. You can try to write a plugin for AMD GPU. > Support of AMD ROCm GPUs in Yarn > > > Key: YARN-10225 > URL: https://issues.apache.org/jira/browse/YARN-10225 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Luca Toscano >Priority: Major > > Hi! > I just watched [1] and it seems that Hops supports AMD GPUs natively in Yarn, > so I am wondering if there any plans for Hadoop to do the same. I work at the > Wikimedia foundation and we are currently using AMD GPUs, it would be really > great to have support for them in Hadoop 3.x. > [1][ > https://databricks.com/session/rocm-and-distributed-deep-learning-on-spark-and-tensorflow|https://databricks.com/session/rocm-and-distributed-deep-learning-on-spark-and-tensorflow] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
