Hi Baolu, Daniel, Sorry for the delay. Was offline for the last week.
On Thu, 2020-02-20 at 19:58 +0800, Lu Baolu wrote: > Hi, > > On 2020/2/20 18:06, Daniel Drake wrote: > > > On Wed, Feb 19, 2020 at 11:40 AM Lu Baolu<[email protected]> > > > wrote: > > > > With respect, this is problematical. The parent and all subdevices share > > > > a single translation entry. The DMA mask should be consistent. > > > > > > > > Otherwise, for example, subdevice A has 64-bit DMA capability and uses > > > > an identity domain for DMA translation. While subdevice B has 32-bit DMA > > > > capability and is forced to switch to DMA domain. Subdevice A will be > > > > impacted without any notification. > > Looking closer, this problematic codepath may already be happening for VMD, > > under intel_iommu_add_device(). Consider this function running for a VMD > > subdevice, we hit: > > > > domain = iommu_get_domain_for_dev(dev); > > > > I can't quite grasp the code flow here, but domain->type now always seems > > to return the domain type of the real DMA device, which seems like pretty > > reasonable behaviour. > > > > if (domain->type == IOMMU_DOMAIN_DMA) { > > > > and as detailed in previous mails, the real VMD device seems to be in a DMA > > domain by default, so we continue. > > > > if (device_def_domain_type(dev) == IOMMU_DOMAIN_IDENTITY) { > > > > Now we checked the default domain type of the subdevice. This seems rather > > likely to return IDENTITY because that's effectively the default type... > > > > ret = iommu_request_dm_for_dev(dev); > > if (ret) { > > dmar_remove_one_dev_info(dev); > > dmar_domain->flags |= DOMAIN_FLAG_LOSE_CHILDREN; > > domain_add_dev_info(si_domain, dev); > > dev_info(dev, > > "Device uses a private identity domain.\n"); > > } > > } > > > > and now we're doing the bad stuff that Lu pointed out: we only have one > > mapping shared for all the subdevices, so if we end up changing it for one > > subdevice, we're likely to be breaking another. > > Yes. Agreed. > > By the way, do all subdevices stay in a same iommu group? > > Best regards, > baolu The VMD endpoint and all subdevices in the VMD domain are in the same IOMMU group. The real dma device for VMD (the VMD endpoint) only represents the DMA requester as determined by the PCIe source-id. The VMD endpoint itself doesn't have a DMA engine so only the subdevices matter for mapping. _______________________________________________ iommu mailing list [email protected] https://lists.linuxfoundation.org/mailman/listinfo/iommu
