Verification done on bionic's ESM Infra Updates -staging ("-proposed").

The detailed verification steps as per comment #3
are attached. This is the summary with key steps.

With the packages from -staging, when (re)starting {cinder-volume,tgt}.service,
the cinder-volume service is started _after_ the tgt service, and
the volumes remain with 'in-use' status (no longer 'error' status).

# Reproducer (45-second startup delay in tgt.service)

Before:

... Notice that cinder-volume.service is Started _BEFORE_ tgt.service
... And the 'tgtadm' error _IS_ seen in the logs.
... And volumes are listed with 'error' Status.
 
        root@cinder-bionic:~# dpkg -s cinder-volume | grep Version:
        Version: 2:12.0.10-0ubuntu2.2

        root@cinder-bionic:~# date; systemctl restart cinder-volume.service 
tgt.service; date
        Fri Nov 22 19:02:00 UTC 2024
        Fri Nov 22 19:02:45 UTC 2024
        
        root@cinder-bionic:~# journalctl -b -u cinder-volume.service -u 
tgt.service | grep Start | tail -3
        Nov 22 19:02:00 cinder-bionic systemd[1]: Started OpenStack Cinder 
Volume.
        Nov 22 19:02:00 cinder-bionic systemd[1]: Starting (i)SCSI target 
daemon...
        Nov 22 19:02:45 cinder-bionic systemd[1]: Started (i)SCSI target daemon.

        root@cinder-bionic:~# grep 'ERROR cinder.volume.manager' 
/var/log/cinder/cinder-volume.log | grep tgtadm
        2024-11-22 19:02:04.926 9281 ERROR cinder.volume.manager Command: sudo 
cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode 
target
        2024-11-22 19:02:04.926 9281 ERROR cinder.volume.manager Stderr: 
u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not 
connected\n'

        root@cinder-bionic:~# cinder list
        
+--------------------------------------+--------+-------------+------+-------------+----------+-------------+
        | ID                                   | Status | Name        | Size | 
Volume Type | Bootable | Attached to |
        
+--------------------------------------+--------+-------------+------+-------------+----------+-------------+
        | a07b08d7-1fef-446e-b760-d69bad24aa40 | error  | test-volume | 1    | 
-           | false    |             |
        
+--------------------------------------+--------+-------------+------+-------------+----------+-------------+
        
After:

... Notice that cinder-volume.service is Started *AFTER* tgt.service now
... And now the 'tgtadm' error is *NOT* seen in the logs.
... And the volumes are listed with Status 'in-use' (no longer 'error')

        root@cinder-bionic:~# dpkg -s cinder-volume | grep Version:
        Version: 2:12.0.10-0ubuntu2.2+esm1

        root@cinder-bionic:~# date; systemctl restart cinder-volume.service 
tgt.service; date
        Fri Nov 22 19:20:52 UTC 2024
        Fri Nov 22 19:21:37 UTC 2024

        root@cinder-bionic:~# journalctl -b -u cinder-volume.service -u 
tgt.service | grep Start | tail -3
        Nov 22 19:20:52 cinder-bionic systemd[1]: Starting (i)SCSI target 
daemon...
        Nov 22 19:21:37 cinder-bionic systemd[1]: Started (i)SCSI target daemon.
        Nov 22 19:21:37 cinder-bionic systemd[1]: Started OpenStack Cinder 
Volume.

        (error timestamps are from the previous/non-proposed run)
        root@cinder-bionic:~# grep 'ERROR cinder.volume.manager' 
/var/log/cinder/cinder-volume.log | grep tgtadm
        2024-11-22 19:02:04.926 9281 ERROR cinder.volume.manager Command: sudo 
cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode 
target
        2024-11-22 19:02:04.926 9281 ERROR cinder.volume.manager Stderr: 
u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not 
connected\n'

        root@cinder-bionic:~# cinder list
        
+--------------------------------------+--------+-------------+------+-------------+----------+-------------+
        | ID                                   | Status | Name        | Size | 
Volume Type | Bootable | Attached to |
        
+--------------------------------------+--------+-------------+------+-------------+----------+-------------+
        | a07b08d7-1fef-446e-b760-d69bad24aa40 | in-use | test-volume | 1    | 
-           | false    |             |
        
+--------------------------------------+--------+-------------+------+-------------+----------+-------------+

** Attachment added: "2024-11-22 bionic cinder esm verification"
   
https://bugs.launchpad.net/ubuntu/+source/cinder/+bug/1987663/+attachment/5839540/+files/2024-11-22%20bionic%20cinder%20esm%20verification

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1987663

Title:
  cinder-volume: "Failed to re-export volume, setting to ERROR" with
  "tgtadm: failed to send request hdr to tgt daemon, Transport endpoint
  is not connected" on service startup

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1987663/+subscriptions


-- 
ubuntu-bugs mailing list
[email protected]
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Reply via email to