Re: [PATCH v3 8/8] nvdimm: Fix firmware activation deadlock scenarios

2022-04-23 Thread Dan Williams
On Fri, Apr 22, 2022 at 9:28 PM Ira Weiny  wrote:
>
> On Thu, Apr 21, 2022 at 08:33:51AM -0700, Dan Williams wrote:
> > Lockdep reports the following deadlock scenarios for CXL root device
> > power-management, device_prepare(), operations, and device_shutdown()
> > operations for 'nd_region' devices:
> >
> > ---
> >  Chain exists of:
> >_region_key --> _bus->reconfig_mutex --> 
> > system_transition_mutex
> >
> >   Possible unsafe locking scenario:
> >
> > CPU0CPU1
> > 
> >lock(system_transition_mutex);
> > lock(_bus->reconfig_mutex);
> > lock(system_transition_mutex);
> >lock(_region_key);
> >
> > --
> >
> >  Chain exists of:
> >_nvdimm_bridge_key --> acpi_scan_lock --> _root_key
> >
> >   Possible unsafe locking scenario:
> >
> > CPU0CPU1
> > 
> >lock(_root_key);
> > lock(acpi_scan_lock);
> > lock(_root_key);
> >lock(_nvdimm_bridge_key);
> >
> > ---
> >
> > These stem from holding nvdimm_bus_lock() over hibernate_quiet_exec()
> > which walks the entire system device topology taking device_lock() along
> > the way. The nvdimm_bus_lock() is protecting against unregistration,
> > multiple simultaneous ops callers, and preventing activate_show() from
> > racing activate_store(). For the first 2, the lock is redundant.
> > Unregistration already flushes all ops users, and sysfs already prevents
> > multiple threads to be active in an ops handler at the same time. For
> > the last userspace should already be waiting for its last
> > activate_store() to complete, and does not need activate_show() to flush
> > the write side, so this lock usage can be deleted in these attributes.
> >
>
> I'm sorry if this is obvious but why can't the locking be removed from
> capability_show() and nvdimm_bus_firmware_visible() as well?

It can, that's a good catch, thanks.



Re: [PATCH v3 8/8] nvdimm: Fix firmware activation deadlock scenarios

2022-04-22 Thread Ira Weiny
On Thu, Apr 21, 2022 at 08:33:51AM -0700, Dan Williams wrote:
> Lockdep reports the following deadlock scenarios for CXL root device
> power-management, device_prepare(), operations, and device_shutdown()
> operations for 'nd_region' devices:
> 
> ---
>  Chain exists of:
>_region_key --> _bus->reconfig_mutex --> 
> system_transition_mutex
> 
>   Possible unsafe locking scenario:
> 
> CPU0CPU1
> 
>lock(system_transition_mutex);
> lock(_bus->reconfig_mutex);
> lock(system_transition_mutex);
>lock(_region_key);
> 
> --
> 
>  Chain exists of:
>_nvdimm_bridge_key --> acpi_scan_lock --> _root_key
> 
>   Possible unsafe locking scenario:
> 
> CPU0CPU1
> 
>lock(_root_key);
> lock(acpi_scan_lock);
> lock(_root_key);
>lock(_nvdimm_bridge_key);
> 
> ---
> 
> These stem from holding nvdimm_bus_lock() over hibernate_quiet_exec()
> which walks the entire system device topology taking device_lock() along
> the way. The nvdimm_bus_lock() is protecting against unregistration,
> multiple simultaneous ops callers, and preventing activate_show() from
> racing activate_store(). For the first 2, the lock is redundant.
> Unregistration already flushes all ops users, and sysfs already prevents
> multiple threads to be active in an ops handler at the same time. For
> the last userspace should already be waiting for its last
> activate_store() to complete, and does not need activate_show() to flush
> the write side, so this lock usage can be deleted in these attributes.
>

I'm sorry if this is obvious but why can't the locking be removed from
capability_show() and nvdimm_bus_firmware_visible() as well?

Effectively it sounds like we don't care if the cap read is racing any state
change?  And we know the device can't go away while sysfs is calling those
functions.

Ira

> 
> Fixes: 48001ea50d17 ("PM, libnvdimm: Add runtime firmware activation support")
> Signed-off-by: Dan Williams 
> ---
>  drivers/nvdimm/core.c |4 
>  1 file changed, 4 deletions(-)
> 
> diff --git a/drivers/nvdimm/core.c b/drivers/nvdimm/core.c
> index 144926b7451c..7c7f4a43fd4f 100644
> --- a/drivers/nvdimm/core.c
> +++ b/drivers/nvdimm/core.c
> @@ -395,10 +395,8 @@ static ssize_t activate_show(struct device *dev,
>   if (!nd_desc->fw_ops)
>   return -EOPNOTSUPP;
>  
> - nvdimm_bus_lock(dev);
>   cap = nd_desc->fw_ops->capability(nd_desc);
>   state = nd_desc->fw_ops->activate_state(nd_desc);
> - nvdimm_bus_unlock(dev);
>  
>   if (cap < NVDIMM_FWA_CAP_QUIESCE)
>   return -EOPNOTSUPP;
> @@ -443,7 +441,6 @@ static ssize_t activate_store(struct device *dev,
>   else
>   return -EINVAL;
>  
> - nvdimm_bus_lock(dev);
>   state = nd_desc->fw_ops->activate_state(nd_desc);
>  
>   switch (state) {
> @@ -461,7 +458,6 @@ static ssize_t activate_store(struct device *dev,
>   default:
>   rc = -ENXIO;
>   }
> - nvdimm_bus_unlock(dev);
>  
>   if (rc == 0)
>   rc = len;
> 
>