Re: [vfio-users] Installing Catalyst prevents VM from booting.
Interesting fact about pcie and pci buses is that underneath the surface they speak the same language. This in parts lends i440fx the ability to work with pass through pcie devices. I dont think its as simple as that, so you will have to check to be sure. Pcie brings more to the table in addition including ways to scale up the number of devices connected to a topology. The kvm / qemu gets significantly more complicated and hard to follow as well. Im working on a visualization tool to make following a libvirt domxml configuration easier as of late. Mostly because I need some python practice but i cant imagine that the configuration is going to get any better than it is and i think potentially useful. My biggest concern with recommending q35 would just be that i wouldn't want to randomize somebody who doesn’t have the time and patience to put it together and make it work. I have some links and I've been considering putting together a wiki for this, but it always helps to have some time and a back up computer if necessary. It’s worth taking the time to understand a few things which may not be an over and done project for everybody in the audience. Anyway Ive also moved onto another issue, ive managed to get latency issues worked out well enough, and ive been experimenting with nested virtualization. esxi in particular (what a nightmare) Sent from my iPhone > On Dec 28, 2018, at 2:51 PM, Brett Foster wrote: > > Well... that's um... friendly and welcoming piece of feedback. > > Surprisingly, I find this technology surprisingly good which is a > surprisingly good testimonial. Don't mind read interpretation. It is a > testament. > > Anyhow, my apologies for offending Kash's sensibilities. > > Brett > > Sent from my BlackBerry - the most secure mobile device > > Original Message > From: k...@tripleback.net > Sent: December 28, 2018 1:33 PM > To: vfio-users@redhat.com > Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. > > Your anecdotal evidence is meaningless, please, don't encourage others > to use obsolete machine types. Plenty have profiled it and even the > developers tell you that Q35 is the way to go. "Surprisingly stable" is > not a sound endorsement of i440fx. If you couldn't make an AMD GPU work, > that's probably because you didn't create a valid PCIe heirarchy. > > > Kash > >> On 2018-12-28 1:16 p.m., Brett Foster wrote: >> I have no issues using PCIe devices or recent-ish processors. Maybe I'm >> missing out on something, but performance is good, stable. Surprisingly >> stable. Can't speak for hot swapping and more fancy configurations, though. >> >> But most of all, couldn't get AMD cards to work with Q35... so the choice >> was easy. ;) > > > > ___ > vfio-users mailing list > vfio-users@redhat.com > https://www.redhat.com/mailman/listinfo/vfio-users > > ___ > vfio-users mailing list > vfio-users@redhat.com > https://www.redhat.com/mailman/listinfo/vfio-users ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
On Sat, 2018-12-29 at 11:49 +, Patrick O'Callaghan wrote: > On Fri, 2018-12-28 at 16:04 -0500, Kyle Marek wrote: > > q35 is the newer one with better support for more CPUs, PCI-E vs PCI, > > integrated SATA vs integrated IDE emulation, IOMMU emulation, and I > > *think* it is needed for hotplugging CPUs/memory. > > [I wish people wouldn't top-post, but anyway ...] > > I'm interested in switching to Q35 but it isn't entirely trivial. Apologies for hijacking this thread. I'll repost as a new topic. poc ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
On Fri, 2018-12-28 at 16:04 -0500, Kyle Marek wrote: > q35 is the newer one with better support for more CPUs, PCI-E vs PCI, > integrated SATA vs integrated IDE emulation, IOMMU emulation, and I > *think* it is needed for hotplugging CPUs/memory. [I wish people wouldn't top-post, but anyway ...] I'm interested in switching to Q35 but it isn't entirely trivial. Simply editing the machine-type line in the XML file doesn't do it: If I change: hvm to: hvm I get: Error: unsupported configuration: IDE controllers are unsupported for this QEMU binary or machine type I created the VM using Virtual Machine Manager under Fedora over a year ago, so most of the settings were defaults at the time. Is there a Dummy's Guide to changing this, or would it be easier to just create a new VM (keeping the existing storage of course)? The man pages are pretty unhelpful. For completeness I attach the full XML file. poc save-NewWin10.xml Description: XML document ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
But Kash is right. I have a AMD Radeon RX 480 and it works flawlessly with the Q35 chipset. My PCIe hierarchy: qemu-kvm ... \ -M q35 ... -device ioh3420,bus=pcie.0,multifunction=on,port=1,chassis=1,id=root. ... -device vfio-pci,host=01:00.0,id=hostdev0,bus=root.0,multifunction=on -device vfio-pci,host=01:00.1,id=hostdev1,bus=pcie.0 Sorry, I don't remember why the HDMI soundcard (01:00.1) is connected directly to pcie.0, but it works. Javi El vie., 28 dic. 2018 a las 23:52, Brett Foster () escribió: > Well... that's um... friendly and welcoming piece of feedback. > > Surprisingly, I find this technology surprisingly good which is a > surprisingly good testimonial. Don't mind read interpretation. It is a > testament. > > Anyhow, my apologies for offending Kash's sensibilities. > > Brett > > Sent from my BlackBerry - the most secure mobile device > > Original Message > From: k...@tripleback.net > Sent: December 28, 2018 1:33 PM > To: vfio-users@redhat.com > Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. > > Your anecdotal evidence is meaningless, please, don't encourage others > to use obsolete machine types. Plenty have profiled it and even the > developers tell you that Q35 is the way to go. "Surprisingly stable" is > not a sound endorsement of i440fx. If you couldn't make an AMD GPU work, > that's probably because you didn't create a valid PCIe heirarchy. > > > Kash > > On 2018-12-28 1:16 p.m., Brett Foster wrote: > > I have no issues using PCIe devices or recent-ish processors. Maybe I'm > missing out on something, but performance is good, stable. Surprisingly > stable. Can't speak for hot swapping and more fancy configurations, though. > > > > But most of all, couldn't get AMD cards to work with Q35... so the > choice was easy. ;) > > > > ___ > vfio-users mailing list > vfio-users@redhat.com > https://www.redhat.com/mailman/listinfo/vfio-users > > ___ > vfio-users mailing list > vfio-users@redhat.com > https://www.redhat.com/mailman/listinfo/vfio-users > ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
Well... that's um... friendly and welcoming piece of feedback. Surprisingly, I find this technology surprisingly good which is a surprisingly good testimonial. Don't mind read interpretation. It is a testament. Anyhow, my apologies for offending Kash's sensibilities. Brett Sent from my BlackBerry - the most secure mobile device Original Message From: k...@tripleback.net Sent: December 28, 2018 1:33 PM To: vfio-users@redhat.com Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. Your anecdotal evidence is meaningless, please, don't encourage others to use obsolete machine types. Plenty have profiled it and even the developers tell you that Q35 is the way to go. "Surprisingly stable" is not a sound endorsement of i440fx. If you couldn't make an AMD GPU work, that's probably because you didn't create a valid PCIe heirarchy. Kash On 2018-12-28 1:16 p.m., Brett Foster wrote: > I have no issues using PCIe devices or recent-ish processors. Maybe I'm > missing out on something, but performance is good, stable. Surprisingly > stable. Can't speak for hot swapping and more fancy configurations, though. > > But most of all, couldn't get AMD cards to work with Q35... so the choice was > easy. ;) ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
Your anecdotal evidence is meaningless, please, don't encourage others to use obsolete machine types. Plenty have profiled it and even the developers tell you that Q35 is the way to go. "Surprisingly stable" is not a sound endorsement of i440fx. If you couldn't make an AMD GPU work, that's probably because you didn't create a valid PCIe heirarchy. Kash On 2018-12-28 1:16 p.m., Brett Foster wrote: > I have no issues using PCIe devices or recent-ish processors. Maybe I'm > missing out on something, but performance is good, stable. Surprisingly > stable. Can't speak for hot swapping and more fancy configurations, though. > > But most of all, couldn't get AMD cards to work with Q35... so the choice was > easy. ;) ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
I have no issues using PCIe devices or recent-ish processors. Maybe I'm missing out on something, but performance is good, stable. Surprisingly stable. Can't speak for hot swapping and more fancy configurations, though. But most of all, couldn't get AMD cards to work with Q35... so the choice was easy. ;) Sent from my BlackBerry - the most secure mobile device Original Message From: pspps...@gmail.com Sent: December 28, 2018 1:04 PM To: fost...@edgeandvertex.org; erra...@yourstruly.sx; b...@spamcop.net Cc: vfio-users@redhat.com Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. q35 is the newer one with better support for more CPUs, PCI-E vs PCI, integrated SATA vs integrated IDE emulation, IOMMU emulation, and I *think* it is needed for hotplugging CPUs/memory. I thought we were supposed to use it because of the PCI-E part, specifically. On 12/27/18 3:18 PM, Brett Foster wrote: > Why use q35? I always thought that wasn't recommended. At least a couple > years ago, that was my impression. > > > Sent from my BlackBerry - the most secure mobile device > > Original Message > From: erra...@yourstruly.sx > Sent: December 27, 2018 12:12 PM > To: fost...@edgeandvertex.org; b...@spamcop.net > Cc: vfio-users@redhat.com > Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. > > > BTW I think the specific reason you want to separate your pcie endpoints on > q35 from the root complex using a switch or up/downstream ports is due to the > fact that the root complex has direct access to memory. I can't find anything > more specific regarding why that might be problematic but I know that pcie > addressing is different for devices downstream as opposed to being connected > directly to the root complex. I arrived at the conclusion that the amd driver > works now with q35 because changed the topology as per the advice I read > somewhere regarding how it should be done. I'd like to know for sure but I > don't really understand PCIe well enough and I think as far as the driver is > concerned its up to a guess as to why one configuration works and the other > doesn't (unless you have better luck getting the windows remote kernel > debugging to work than I have.) > > From: vfio-users-boun...@redhat.com on behalf > of Brett Foster > Sent: Wednesday, December 26, 2018 11:24:48 AM > To: Bronek Kozicki > Cc: vfio-users > Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. > > I have been using AMD via i440fx for like 5 years or so (across different > hardware and graphics cards). The drivers that work are the ones that come > via Windows Update. The drivers distributed by AMD do not. Not sure why since > presumably they come from the same place. lol. > > On Tue, Dec 25, 2018 at 9:51 AM Bronek Kozicki > mailto:b...@spamcop.net>> wrote: > On Tue, 25 Dec 2018, at 4:21 PM, Paige Thompson wrote: >> Hey, >> >> From what I understand in general connecting devices straight to the >> root complex is problematic and they should be connected to a bridge. I >> was kind of wondering if anybody had any knowledge of this. I find the >> configuration really confusing. I still cant really tell how the >> topology works. > > Hope Alex will shed some light on it when he's back from the holiday break. > > > -- > Bronek Kozicki > b...@spamcop.net<mailto:b...@spamcop.net> > > ___ > vfio-users mailing list > vfio-users@redhat.com<mailto:vfio-users@redhat.com> > https://www.redhat.com/mailman/listinfo/vfio-users > > ___ > vfio-users mailing list > vfio-users@redhat.com > https://www.redhat.com/mailman/listinfo/vfio-users ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
q35 is the newer one with better support for more CPUs, PCI-E vs PCI, integrated SATA vs integrated IDE emulation, IOMMU emulation, and I *think* it is needed for hotplugging CPUs/memory. I thought we were supposed to use it because of the PCI-E part, specifically. On 12/27/18 3:18 PM, Brett Foster wrote: > Why use q35? I always thought that wasn't recommended. At least a couple > years ago, that was my impression. > > > Sent from my BlackBerry - the most secure mobile device > > Original Message > From: erra...@yourstruly.sx > Sent: December 27, 2018 12:12 PM > To: fost...@edgeandvertex.org; b...@spamcop.net > Cc: vfio-users@redhat.com > Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. > > > BTW I think the specific reason you want to separate your pcie endpoints on > q35 from the root complex using a switch or up/downstream ports is due to the > fact that the root complex has direct access to memory. I can't find anything > more specific regarding why that might be problematic but I know that pcie > addressing is different for devices downstream as opposed to being connected > directly to the root complex. I arrived at the conclusion that the amd driver > works now with q35 because changed the topology as per the advice I read > somewhere regarding how it should be done. I'd like to know for sure but I > don't really understand PCIe well enough and I think as far as the driver is > concerned its up to a guess as to why one configuration works and the other > doesn't (unless you have better luck getting the windows remote kernel > debugging to work than I have.) > > From: vfio-users-boun...@redhat.com on behalf > of Brett Foster > Sent: Wednesday, December 26, 2018 11:24:48 AM > To: Bronek Kozicki > Cc: vfio-users > Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. > > I have been using AMD via i440fx for like 5 years or so (across different > hardware and graphics cards). The drivers that work are the ones that come > via Windows Update. The drivers distributed by AMD do not. Not sure why since > presumably they come from the same place. lol. > > On Tue, Dec 25, 2018 at 9:51 AM Bronek Kozicki > mailto:b...@spamcop.net>> wrote: > On Tue, 25 Dec 2018, at 4:21 PM, Paige Thompson wrote: >> Hey, >> >> From what I understand in general connecting devices straight to the >> root complex is problematic and they should be connected to a bridge. I >> was kind of wondering if anybody had any knowledge of this. I find the >> configuration really confusing. I still cant really tell how the >> topology works. > > Hope Alex will shed some light on it when he's back from the holiday break. > > > -- > Bronek Kozicki > b...@spamcop.net<mailto:b...@spamcop.net> > > ___ > vfio-users mailing list > vfio-users@redhat.com<mailto:vfio-users@redhat.com> > https://www.redhat.com/mailman/listinfo/vfio-users > > ___ > vfio-users mailing list > vfio-users@redhat.com > https://www.redhat.com/mailman/listinfo/vfio-users ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
Huh. Good point. Admittedly you might want to reuse very similar VM for both Windows and Linux. -- Bronek Kozicki b...@spamcop.net On Thu, 27 Dec 2018, at 8:25 PM, Brett Foster wrote: > Wait, we're talking about Linux +ati drivers? Alright, then I have no > idea... but if it's windows, try the 440 and see if that helps. > > Brett > > Sent from my BlackBerry - the most secure mobile device > > Original Message > From: b...@spamcop.net > Sent: December 27, 2018 12:21 PM > To: fost...@edgeandvertex.org; erra...@yourstruly.sx; vfio-users@redhat.com > Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. > > Some Linuxes do not boot on 440FX (at least, not for me with booting > with UEFI, which is recommended for GPU passthrough). > > > B. > > > On Thu, 27 Dec 2018, at 8:18 PM, Brett Foster wrote: > > Why use q35? I always thought that wasn't recommended. At least a couple > > years ago, that was my impression. > > > > > > Sent from my BlackBerry - the most secure mobile device > > > > Original Message > > From: erra...@yourstruly.sx > > Sent: December 27, 2018 12:12 PM > > To: fost...@edgeandvertex.org; b...@spamcop.net > > Cc: vfio-users@redhat.com > > Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. > > > > > > BTW I think the specific reason you want to separate your pcie endpoints > > on q35 from the root complex using a switch or up/downstream ports is > > due to the fact that the root complex has direct access to memory. I > > can't find anything more specific regarding why that might be > > problematic but I know that pcie addressing is different for devices > > downstream as opposed to being connected directly to the root complex. I > > arrived at the conclusion that the amd driver works now with q35 because > > changed the topology as per the advice I read somewhere regarding how it > > should be done. I'd like to know for sure but I don't really understand > > PCIe well enough and I think as far as the driver is concerned its up to > > a guess as to why one configuration works and the other doesn't (unless > > you have better luck getting the windows remote kernel debugging to work > > than I have.) > > ____________ > > From: vfio-users-boun...@redhat.com on > > behalf of Brett Foster > > Sent: Wednesday, December 26, 2018 11:24:48 AM > > To: Bronek Kozicki > > Cc: vfio-users > > Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. > > > > I have been using AMD via i440fx for like 5 years or so (across > > different hardware and graphics cards). The drivers that work are the > > ones that come via Windows Update. The drivers distributed by AMD do > > not. Not sure why since presumably they come from the same place. lol. > > > > On Tue, Dec 25, 2018 at 9:51 AM Bronek Kozicki > > mailto:b...@spamcop.net>> wrote: > > On Tue, 25 Dec 2018, at 4:21 PM, Paige Thompson wrote: > > > Hey, > > > > > > From what I understand in general connecting devices straight to the > > > root complex is problematic and they should be connected to a bridge. I > > > was kind of wondering if anybody had any knowledge of this. I find the > > > configuration really confusing. I still cant really tell how the > > > topology works. > > > > > > Hope Alex will shed some light on it when he's back from the holiday break. > > > > > > -- > > Bronek Kozicki > > b...@spamcop.net<mailto:b...@spamcop.net> > > > > ___ > > vfio-users mailing list > > vfio-users@redhat.com<mailto:vfio-users@redhat.com> > > https://www.redhat.com/mailman/listinfo/vfio-users ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
Wait, we're talking about Linux +ati drivers? Alright, then I have no idea... but if it's windows, try the 440 and see if that helps. Brett Sent from my BlackBerry - the most secure mobile device Original Message From: b...@spamcop.net Sent: December 27, 2018 12:21 PM To: fost...@edgeandvertex.org; erra...@yourstruly.sx; vfio-users@redhat.com Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. Some Linuxes do not boot on 440FX (at least, not for me with booting with UEFI, which is recommended for GPU passthrough). B. On Thu, 27 Dec 2018, at 8:18 PM, Brett Foster wrote: > Why use q35? I always thought that wasn't recommended. At least a couple > years ago, that was my impression. > > > Sent from my BlackBerry - the most secure mobile device > > Original Message > From: erra...@yourstruly.sx > Sent: December 27, 2018 12:12 PM > To: fost...@edgeandvertex.org; b...@spamcop.net > Cc: vfio-users@redhat.com > Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. > > > BTW I think the specific reason you want to separate your pcie endpoints > on q35 from the root complex using a switch or up/downstream ports is > due to the fact that the root complex has direct access to memory. I > can't find anything more specific regarding why that might be > problematic but I know that pcie addressing is different for devices > downstream as opposed to being connected directly to the root complex. I > arrived at the conclusion that the amd driver works now with q35 because > changed the topology as per the advice I read somewhere regarding how it > should be done. I'd like to know for sure but I don't really understand > PCIe well enough and I think as far as the driver is concerned its up to > a guess as to why one configuration works and the other doesn't (unless > you have better luck getting the windows remote kernel debugging to work > than I have.) > > From: vfio-users-boun...@redhat.com on > behalf of Brett Foster > Sent: Wednesday, December 26, 2018 11:24:48 AM > To: Bronek Kozicki > Cc: vfio-users > Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. > > I have been using AMD via i440fx for like 5 years or so (across > different hardware and graphics cards). The drivers that work are the > ones that come via Windows Update. The drivers distributed by AMD do > not. Not sure why since presumably they come from the same place. lol. > > On Tue, Dec 25, 2018 at 9:51 AM Bronek Kozicki > mailto:b...@spamcop.net>> wrote: > On Tue, 25 Dec 2018, at 4:21 PM, Paige Thompson wrote: > > Hey, > > > > From what I understand in general connecting devices straight to the > > root complex is problematic and they should be connected to a bridge. I > > was kind of wondering if anybody had any knowledge of this. I find the > > configuration really confusing. I still cant really tell how the > > topology works. > > > Hope Alex will shed some light on it when he's back from the holiday break. > > > -- > Bronek Kozicki > b...@spamcop.net<mailto:b...@spamcop.net> > > ___ > vfio-users mailing list > vfio-users@redhat.com<mailto:vfio-users@redhat.com> > https://www.redhat.com/mailman/listinfo/vfio-users ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
Some Linuxes do not boot on 440FX (at least, not for me with booting with UEFI, which is recommended for GPU passthrough). B. On Thu, 27 Dec 2018, at 8:18 PM, Brett Foster wrote: > Why use q35? I always thought that wasn't recommended. At least a couple > years ago, that was my impression. > > > Sent from my BlackBerry - the most secure mobile device > > Original Message > From: erra...@yourstruly.sx > Sent: December 27, 2018 12:12 PM > To: fost...@edgeandvertex.org; b...@spamcop.net > Cc: vfio-users@redhat.com > Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. > > > BTW I think the specific reason you want to separate your pcie endpoints > on q35 from the root complex using a switch or up/downstream ports is > due to the fact that the root complex has direct access to memory. I > can't find anything more specific regarding why that might be > problematic but I know that pcie addressing is different for devices > downstream as opposed to being connected directly to the root complex. I > arrived at the conclusion that the amd driver works now with q35 because > changed the topology as per the advice I read somewhere regarding how it > should be done. I'd like to know for sure but I don't really understand > PCIe well enough and I think as far as the driver is concerned its up to > a guess as to why one configuration works and the other doesn't (unless > you have better luck getting the windows remote kernel debugging to work > than I have.) > > From: vfio-users-boun...@redhat.com on > behalf of Brett Foster > Sent: Wednesday, December 26, 2018 11:24:48 AM > To: Bronek Kozicki > Cc: vfio-users > Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. > > I have been using AMD via i440fx for like 5 years or so (across > different hardware and graphics cards). The drivers that work are the > ones that come via Windows Update. The drivers distributed by AMD do > not. Not sure why since presumably they come from the same place. lol. > > On Tue, Dec 25, 2018 at 9:51 AM Bronek Kozicki > mailto:b...@spamcop.net>> wrote: > On Tue, 25 Dec 2018, at 4:21 PM, Paige Thompson wrote: > > Hey, > > > > From what I understand in general connecting devices straight to the > > root complex is problematic and they should be connected to a bridge. I > > was kind of wondering if anybody had any knowledge of this. I find the > > configuration really confusing. I still cant really tell how the > > topology works. > > > Hope Alex will shed some light on it when he's back from the holiday break. > > > -- > Bronek Kozicki > b...@spamcop.net<mailto:b...@spamcop.net> > > ___ > vfio-users mailing list > vfio-users@redhat.com<mailto:vfio-users@redhat.com> > https://www.redhat.com/mailman/listinfo/vfio-users ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
Why use q35? I always thought that wasn't recommended. At least a couple years ago, that was my impression. Sent from my BlackBerry - the most secure mobile device Original Message From: erra...@yourstruly.sx Sent: December 27, 2018 12:12 PM To: fost...@edgeandvertex.org; b...@spamcop.net Cc: vfio-users@redhat.com Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. BTW I think the specific reason you want to separate your pcie endpoints on q35 from the root complex using a switch or up/downstream ports is due to the fact that the root complex has direct access to memory. I can't find anything more specific regarding why that might be problematic but I know that pcie addressing is different for devices downstream as opposed to being connected directly to the root complex. I arrived at the conclusion that the amd driver works now with q35 because changed the topology as per the advice I read somewhere regarding how it should be done. I'd like to know for sure but I don't really understand PCIe well enough and I think as far as the driver is concerned its up to a guess as to why one configuration works and the other doesn't (unless you have better luck getting the windows remote kernel debugging to work than I have.) From: vfio-users-boun...@redhat.com on behalf of Brett Foster Sent: Wednesday, December 26, 2018 11:24:48 AM To: Bronek Kozicki Cc: vfio-users Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. I have been using AMD via i440fx for like 5 years or so (across different hardware and graphics cards). The drivers that work are the ones that come via Windows Update. The drivers distributed by AMD do not. Not sure why since presumably they come from the same place. lol. On Tue, Dec 25, 2018 at 9:51 AM Bronek Kozicki mailto:b...@spamcop.net>> wrote: On Tue, 25 Dec 2018, at 4:21 PM, Paige Thompson wrote: > Hey, > > From what I understand in general connecting devices straight to the > root complex is problematic and they should be connected to a bridge. I > was kind of wondering if anybody had any knowledge of this. I find the > configuration really confusing. I still cant really tell how the > topology works. Hope Alex will shed some light on it when he's back from the holiday break. -- Bronek Kozicki b...@spamcop.net<mailto:b...@spamcop.net> ___ vfio-users mailing list vfio-users@redhat.com<mailto:vfio-users@redhat.com> https://www.redhat.com/mailman/listinfo/vfio-users ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
BTW I think the specific reason you want to separate your pcie endpoints on q35 from the root complex using a switch or up/downstream ports is due to the fact that the root complex has direct access to memory. I can't find anything more specific regarding why that might be problematic but I know that pcie addressing is different for devices downstream as opposed to being connected directly to the root complex. I arrived at the conclusion that the amd driver works now with q35 because changed the topology as per the advice I read somewhere regarding how it should be done. I'd like to know for sure but I don't really understand PCIe well enough and I think as far as the driver is concerned its up to a guess as to why one configuration works and the other doesn't (unless you have better luck getting the windows remote kernel debugging to work than I have.) From: vfio-users-boun...@redhat.com on behalf of Brett Foster Sent: Wednesday, December 26, 2018 11:24:48 AM To: Bronek Kozicki Cc: vfio-users Subject: Re: [vfio-users] Installing Catalyst prevents VM from booting. I have been using AMD via i440fx for like 5 years or so (across different hardware and graphics cards). The drivers that work are the ones that come via Windows Update. The drivers distributed by AMD do not. Not sure why since presumably they come from the same place. lol. On Tue, Dec 25, 2018 at 9:51 AM Bronek Kozicki mailto:b...@spamcop.net>> wrote: On Tue, 25 Dec 2018, at 4:21 PM, Paige Thompson wrote: > Hey, > > From what I understand in general connecting devices straight to the > root complex is problematic and they should be connected to a bridge. I > was kind of wondering if anybody had any knowledge of this. I find the > configuration really confusing. I still cant really tell how the > topology works. Hope Alex will shed some light on it when he's back from the holiday break. -- Bronek Kozicki b...@spamcop.net<mailto:b...@spamcop.net> ___ vfio-users mailing list vfio-users@redhat.com<mailto:vfio-users@redhat.com> https://www.redhat.com/mailman/listinfo/vfio-users ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
I have been using AMD via i440fx for like 5 years or so (across different hardware and graphics cards). The drivers that work are the ones that come via Windows Update. The drivers distributed by AMD do not. Not sure why since presumably they come from the same place. lol. On Tue, Dec 25, 2018 at 9:51 AM Bronek Kozicki wrote: > On Tue, 25 Dec 2018, at 4:21 PM, Paige Thompson wrote: > > Hey, > > > > From what I understand in general connecting devices straight to the > > root complex is problematic and they should be connected to a bridge. I > > was kind of wondering if anybody had any knowledge of this. I find the > > configuration really confusing. I still cant really tell how the > > topology works. > > > Hope Alex will shed some light on it when he's back from the holiday break. > > > -- > Bronek Kozicki > b...@spamcop.net > > ___ > vfio-users mailing list > vfio-users@redhat.com > https://www.redhat.com/mailman/listinfo/vfio-users > ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
On Tue, 25 Dec 2018, at 4:21 PM, Paige Thompson wrote: > Hey, > > From what I understand in general connecting devices straight to the > root complex is problematic and they should be connected to a bridge. I > was kind of wondering if anybody had any knowledge of this. I find the > configuration really confusing. I still cant really tell how the > topology works. Hope Alex will shed some light on it when he's back from the holiday break. -- Bronek Kozicki b...@spamcop.net ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
Hey, >From what I understand in general connecting devices straight to the root >complex is problematic and they should be connected to a bridge. I was kind of >wondering if anybody had any knowledge of this. I find the configuration >really confusing. I still cant really tell how the topology works. Paige Sent from my iPhone > On Dec 25, 2018, at 5:06 AM, Bronek Kozicki wrote: > >> On Tue, 25 Dec 2018, at 12:57 PM, Paige Thompson wrote: >> Hi, >> >> As you probably know there is a workaround to use i440fx instead of q35 >> to get the R9 390 working with VFIO. However, I have managed to get it >> working with Q35 by adding a PCIe bridge as well as upstream and >> downstream ports to the configuration. You've probably noticed that the >> R9 390 card works fine with Q35 up until the point in which you install >> the AMD drivers and then it starts crashing. As near as I can tell the >> driver simply doesn't like it if you attach the video card directly to >> the root complex. >> >> Here is a link to the configuration that I am using: >> https://gitlab.com/snippets/1788426#note_127191397 >> qemu command-line rough translation: >> https://gitlab.com/snippets/1788426#note_127194064 >> For the entire work log : https://gitlab.com/snippets/1788426 >> >> I'd also like to point out that this also works with a Linux guest as I >> confirmed a moment ago. I never could get Linux to work with either >> i440fx or q35 before I tried using a pcie bridge in q35. My >> understanding of why Windows would work with i440fx is unclear but I >> know that pcie devices essentially speak the same as pci devices and >> there are no pcie devices on i440fx platforms; still whatever the amd >> drivers check for is somehow circumvented in that particular >> configuration. >> >> I'm surprised nobody knew to suggest this, I sort of figured this out >> based on something I read somewhere about how it's a bad idea to allow >> devices to talk directly as discrete devices to the root complex anyway. >> So, I gave this a try and low and behold it worked. It won't give you >> any performance improvements, but q35 is a more accurate emulation of a >> modern system and may help with other aspects of troubleshooting, it >> just requires more topology complexity to be configured correctly. >> >> Hope that helps, > > > HI Paige > > > thanks for sharing, this is interesting. FWIW I am currently using Ubuntu > Bionic with vfio GPU passthrough but I have given up on AMD cards years ago > and am using nVidia Quadro now, which does not have problems with 440FX. > > > B. > > -- > Bronek Kozicki > b...@spamcop.net > > ___ > vfio-users mailing list > vfio-users@redhat.com > https://www.redhat.com/mailman/listinfo/vfio-users ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
On Tue, 25 Dec 2018, at 12:57 PM, Paige Thompson wrote: > Hi, > > As you probably know there is a workaround to use i440fx instead of q35 > to get the R9 390 working with VFIO. However, I have managed to get it > working with Q35 by adding a PCIe bridge as well as upstream and > downstream ports to the configuration. You've probably noticed that the > R9 390 card works fine with Q35 up until the point in which you install > the AMD drivers and then it starts crashing. As near as I can tell the > driver simply doesn't like it if you attach the video card directly to > the root complex. > > Here is a link to the configuration that I am using: > https://gitlab.com/snippets/1788426#note_127191397 > qemu command-line rough translation: > https://gitlab.com/snippets/1788426#note_127194064 > For the entire work log : https://gitlab.com/snippets/1788426 > > I'd also like to point out that this also works with a Linux guest as I > confirmed a moment ago. I never could get Linux to work with either > i440fx or q35 before I tried using a pcie bridge in q35. My > understanding of why Windows would work with i440fx is unclear but I > know that pcie devices essentially speak the same as pci devices and > there are no pcie devices on i440fx platforms; still whatever the amd > drivers check for is somehow circumvented in that particular > configuration. > > I'm surprised nobody knew to suggest this, I sort of figured this out > based on something I read somewhere about how it's a bad idea to allow > devices to talk directly as discrete devices to the root complex anyway. > So, I gave this a try and low and behold it worked. It won't give you > any performance improvements, but q35 is a more accurate emulation of a > modern system and may help with other aspects of troubleshooting, it > just requires more topology complexity to be configured correctly. > > Hope that helps, HI Paige thanks for sharing, this is interesting. FWIW I am currently using Ubuntu Bionic with vfio GPU passthrough but I have given up on AMD cards years ago and am using nVidia Quadro now, which does not have problems with 440FX. B. -- Bronek Kozicki b...@spamcop.net ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
Re: [vfio-users] Installing Catalyst prevents VM from booting.
Hi, As you probably know there is a workaround to use i440fx instead of q35 to get the R9 390 working with VFIO. However, I have managed to get it working with Q35 by adding a PCIe bridge as well as upstream and downstream ports to the configuration. You've probably noticed that the R9 390 card works fine with Q35 up until the point in which you install the AMD drivers and then it starts crashing. As near as I can tell the driver simply doesn't like it if you attach the video card directly to the root complex. Here is a link to the configuration that I am using: https://gitlab.com/snippets/1788426#note_127191397 qemu command-line rough translation: https://gitlab.com/snippets/1788426#note_127194064 For the entire work log : https://gitlab.com/snippets/1788426 I'd also like to point out that this also works with a Linux guest as I confirmed a moment ago. I never could get Linux to work with either i440fx or q35 before I tried using a pcie bridge in q35. My understanding of why Windows would work with i440fx is unclear but I know that pcie devices essentially speak the same as pci devices and there are no pcie devices on i440fx platforms; still whatever the amd drivers check for is somehow circumvented in that particular configuration. I'm surprised nobody knew to suggest this, I sort of figured this out based on something I read somewhere about how it's a bad idea to allow devices to talk directly as discrete devices to the root complex anyway. So, I gave this a try and low and behold it worked. It won't give you any performance improvements, but q35 is a more accurate emulation of a modern system and may help with other aspects of troubleshooting, it just requires more topology complexity to be configured correctly. Hope that helps, Paige Thompson erra...@yourstruly.sx ___ vfio-users mailing list vfio-users@redhat.com https://www.redhat.com/mailman/listinfo/vfio-users
