Re: Experience on GPU Support?

2024-05-31 Thread Bryan Tiang
Hi All, Thanks so much for the insights, it’s really eye opening. Im wondering, is vGPU for KVM possible? And does it only work with NVIDIA cards? Or has anyone successfully integrated AMD MI300X before (using vGPU KVM)? Regards, Bryan On 12 Mar 2024 at 3:54 AM +0800, Pierre-Luc Dion , wrote: >

Re: Experience on GPU Support?

2024-03-11 Thread Pierre-Luc Dion
There is no issue delivering VM with passthrough GPU with CloudStack, We've been doing this using XenServer as hypervisor. It requires an enterprise license from Citrix to enable the GPU and vGPU support features. As we don't use KVM , I can't say much about it. there is some limitation deliverin

Re: Experience on GPU Support?

2024-02-23 Thread Ivan Kud
Another way to deal with it is to use KVM agent hooks (this is my code implemented specifically to deal with GPUs and VM-dedicated drives): https://github.com/apache/cloudstack/blob/8f6721ed4c4e1b31081a951c62ffbe5331cf16d4/agent/conf/agent.properties#L123 You can implement the logic in Groovy to m

Re: Experience on GPU Support?

2024-02-23 Thread Ivan Kudryavtsev
Another way to deal with it is to use KVM agent hooks: https://github.com/apache/cloudstack/blob/8f6721ed4c4e1b31081a951c62ffbe5331cf16d4/agent/conf/agent.properties#L123 You can implement the logic in Groovy to modify XML during the start to support extra devices out of CloudStack management. On

Re: Experience on GPU Support?

2024-02-23 Thread Jorge Luiz Correa
Hi Bryan! We are using here but in a different way, customized for our environment and using how it is possible the features of CloudStack. In documentation we can see support for some GPU models a little bit old today. We are using pci passthrough. All hosts with GPU are configured to boot with I

Experience on GPU Support?

2024-02-22 Thread Bryan Tiang
Hi Guys, Anyone running Cloudstack with GPU Support in Production? Say NVIDIA H100 or AMD M1300X? Just want to know if there is any support for this still on going, or anyone who is running a cloud business with GPUs. Regards, Bryan