Public bug reported:

Hello,

We recently encountered an issue when trying to stop nova instances.

| Apr 16 09:35:10 ginzel kernel: [6925958.071665] unregister_netdevice:
waiting for tape3e33cb9-d6 to become free. Usage count = 2

When I try to stop manually the qemu process, it errors
"""
ballot@ginzel:~$ sudo virsh destroy instance-000718af                           
                          
setlocale: No such file or directory                                            
                         
error: Failed to destroy domain instance-000718af                               
                         
error: Failed to terminate process 20953 with SIGKILL: Device or resource busy
"""

The qemu process is in D state because of this
"""
libvirt+ 20953 12.9  0.5 9001400 2925908 ?     D    Apr15  84:25 
/usr/bin/qemu-system-x86_64 -name instance-000718af -S -machine 
pc-i440fx-trusty,accel=kvm,usb=off -cpu 
EPYC-IBPB-2.0,+perfctr_nb,+perfctr_core,+t
opoext,+tce,+wdt,+skinit,+extapic,+cmp_legacy,+osxsave,+ht -m 4096 -realtime 
mlock=off -smp 2,sockets=2,cores=1,threads=1 -uuid 
020ecf87-4c96-47af-8d3f-d86d51b445f4 -smbios type=1,manufacturer=OpenStack 
Foundati
on,product=OpenStack 
Nova,version=2014.1.5,serial=993710e9-0a44-428e-88ec-9210c6dfed55,uuid=020ecf87-4c96-47af-8d3f-d86d51b445f4
 -no-user-config -nodefaults -chardev 
socket,id=charmonitor,path=/var/lib/libvirt/q
emu/instance-000718af.monitor,server,nowait -mon 
chardev=charmonitor,id=monitor,mode=control -rtc base=utc,driftfix=slew -global 
kvm-pit.lost_tick_policy=discard -no-hpet -no-shutdown -boot strict=on -device 
pii
x3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive 
file=/srv/nova/instances/020ecf87-4c96-47af-8d3f-d86d51b445f4/disk,if=none,id=drive-virtio-disk0,format=qcow2,cache=none
 -device virtio-blk-pci,scsi=off,bus=pci.0
,addr=0x4,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -netdev 
tap,fd=24,id=hostnet0,vhost=on,vhostfd=29 -device 
virtio-net-pci,netdev=hostnet0,id=net0,mac=fa:16:3e:eb:99:5e,bus=pci.0,addr=0x3 
-chardev f
ile,id=charserial0,path=/srv/nova/instances/020ecf87-4c96-47af-8d3f-d86d51b445f4/console.log
 -device isa-serial,chardev=charserial0,id=serial0 -chardev pty,id=charserial1 
-device isa-serial,chardev=charserial1,i
d=serial1 -device usb-tablet,id=input0 -vnc 0.0.0.0:4 -k en-us -device 
cirrus-vga,id=video0,bus=pci.0,addr=0x2 -device 
virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5
ballot@ginzel:~$ sudo cat /proc/20953/sta                                       
                         
stack   stat    statm   status
"""

and we can see the stack of the process
"""
ballot@ginzel:~$ sudo cat /proc/20953/stack 
[<0>] msleep+0x2d/0x40                      
[<0>] netdev_run_todo+0x11c/0x320                                               
                         
[<0>] rtnl_unlock+0xe/0x10
[<0>] tun_chr_close+0x28/0x30       
[<0>] __fput+0xea/0x220                                                         
                         
[<0>] ____fput+0xe/0x10                                                         
                         
[<0>] task_work_run+0x9d/0xc0                                                   
                         
[<0>] exit_to_usermode_loop+0xc0/0xd0                                           
                         
[<0>] do_syscall_64+0x115/0x130     
[<0>] entry_SYSCALL_64_after_hwframe+0x3d/0xa2                                  
                         
[<0>] 0xffffffffffffffff
"""

Will attach the relevant files
--- 
AlsaDevices:
 total 0
 crw-rw---- 1 root audio 116,  1 Jan 27 05:43 seq
 crw-rw---- 1 root audio 116, 33 Jan 27 05:43 timer
AplayDevices: Error: [Errno 2] No such file or directory
ApportVersion: 2.14.1-0ubuntu3.29
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', 
'/dev/snd/timer'] failed with exit code 1:
DistroRelease: Ubuntu 14.04
IwConfig: Error: [Errno 2] No such file or directory
MachineType: HPE ProLiant DL385 Gen10
Package: linux (not installed)
PciMultimedia:
 
ProcFB: 0 mgadrmfb
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.15.0-42-generic 
root=UUID=06e712a9-0adb-4078-8976-0c41ce346aa5 ro console=tty0 
console=ttyS0,115200
ProcVersionSignature: Ubuntu 4.15.0-42.45-generic 4.15.18
RelatedPackageVersions:
 linux-restricted-modules-4.15.0-42-generic N/A
 linux-backports-modules-4.15.0-42-generic  N/A
 linux-firmware                             1.127.24
RfKill: Error: [Errno 2] No such file or directory
Tags:  trusty uec-images
Uname: Linux 4.15.0-42-generic x86_64
UpgradeStatus: No upgrade log present (probably fresh install)
UserGroups:
 
_MarkForUpload: True
dmi.bios.date: 10/02/2018
dmi.bios.vendor: HPE
dmi.bios.version: A40
dmi.board.name: ProLiant DL385 Gen10
dmi.board.vendor: HPE
dmi.chassis.type: 23
dmi.chassis.vendor: HPE
dmi.modalias: 
dmi:bvnHPE:bvrA40:bd10/02/2018:svnHPE:pnProLiantDL385Gen10:pvr:rvnHPE:rnProLiantDL385Gen10:rvr:cvnHPE:ct23:cvr:
dmi.product.family: ProLiant
dmi.product.name: ProLiant DL385 Gen10
dmi.sys.vendor: HPE

** Affects: linux (Ubuntu)
     Importance: Undecided
         Status: Confirmed


** Tags: apport-collected trusty uec-images

** Tags added: apport-collected trusty uec-images

** Description changed:

  Hello,
  
  We recently encountered an issue when trying to stop nova instances.
  
  | Apr 16 09:35:10 ginzel kernel: [6925958.071665] unregister_netdevice:
  waiting for tape3e33cb9-d6 to become free. Usage count = 2
  
  When I try to stop manually the qemu process, it errors
  """
  ballot@ginzel:~$ sudo virsh destroy instance-000718af                         
                            
  setlocale: No such file or directory                                          
                           
  error: Failed to destroy domain instance-000718af                             
                           
  error: Failed to terminate process 20953 with SIGKILL: Device or resource busy
  """
  
  The qemu process is in D state because of this
  """
  libvirt+ 20953 12.9  0.5 9001400 2925908 ?     D    Apr15  84:25 
/usr/bin/qemu-system-x86_64 -name instance-000718af -S -machine 
pc-i440fx-trusty,accel=kvm,usb=off -cpu 
EPYC-IBPB-2.0,+perfctr_nb,+perfctr_core,+t
  opoext,+tce,+wdt,+skinit,+extapic,+cmp_legacy,+osxsave,+ht -m 4096 -realtime 
mlock=off -smp 2,sockets=2,cores=1,threads=1 -uuid 
020ecf87-4c96-47af-8d3f-d86d51b445f4 -smbios type=1,manufacturer=OpenStack 
Foundati
  on,product=OpenStack 
Nova,version=2014.1.5,serial=993710e9-0a44-428e-88ec-9210c6dfed55,uuid=020ecf87-4c96-47af-8d3f-d86d51b445f4
 -no-user-config -nodefaults -chardev 
socket,id=charmonitor,path=/var/lib/libvirt/q
  emu/instance-000718af.monitor,server,nowait -mon 
chardev=charmonitor,id=monitor,mode=control -rtc base=utc,driftfix=slew -global 
kvm-pit.lost_tick_policy=discard -no-hpet -no-shutdown -boot strict=on -device 
pii
  x3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive 
file=/srv/nova/instances/020ecf87-4c96-47af-8d3f-d86d51b445f4/disk,if=none,id=drive-virtio-disk0,format=qcow2,cache=none
 -device virtio-blk-pci,scsi=off,bus=pci.0
  ,addr=0x4,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -netdev 
tap,fd=24,id=hostnet0,vhost=on,vhostfd=29 -device 
virtio-net-pci,netdev=hostnet0,id=net0,mac=fa:16:3e:eb:99:5e,bus=pci.0,addr=0x3 
-chardev f
  
ile,id=charserial0,path=/srv/nova/instances/020ecf87-4c96-47af-8d3f-d86d51b445f4/console.log
 -device isa-serial,chardev=charserial0,id=serial0 -chardev pty,id=charserial1 
-device isa-serial,chardev=charserial1,i
  d=serial1 -device usb-tablet,id=input0 -vnc 0.0.0.0:4 -k en-us -device 
cirrus-vga,id=video0,bus=pci.0,addr=0x2 -device 
virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5
  ballot@ginzel:~$ sudo cat /proc/20953/sta                                     
                           
  stack   stat    statm   status
  """
  
  and we can see the stack of the process
  """
  ballot@ginzel:~$ sudo cat /proc/20953/stack 
  [<0>] msleep+0x2d/0x40                      
  [<0>] netdev_run_todo+0x11c/0x320                                             
                           
  [<0>] rtnl_unlock+0xe/0x10
  [<0>] tun_chr_close+0x28/0x30       
  [<0>] __fput+0xea/0x220                                                       
                           
  [<0>] ____fput+0xe/0x10                                                       
                           
  [<0>] task_work_run+0x9d/0xc0                                                 
                           
  [<0>] exit_to_usermode_loop+0xc0/0xd0                                         
                           
  [<0>] do_syscall_64+0x115/0x130     
  [<0>] entry_SYSCALL_64_after_hwframe+0x3d/0xa2                                
                           
  [<0>] 0xffffffffffffffff
  """
  
  Will attach the relevant files
+ --- 
+ AlsaDevices:
+  total 0
+  crw-rw---- 1 root audio 116,  1 Jan 27 05:43 seq
+  crw-rw---- 1 root audio 116, 33 Jan 27 05:43 timer
+ AplayDevices: Error: [Errno 2] No such file or directory
+ ApportVersion: 2.14.1-0ubuntu3.29
+ Architecture: amd64
+ ArecordDevices: Error: [Errno 2] No such file or directory
+ AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', 
'/dev/snd/timer'] failed with exit code 1:
+ DistroRelease: Ubuntu 14.04
+ IwConfig: Error: [Errno 2] No such file or directory
+ MachineType: HPE ProLiant DL385 Gen10
+ Package: linux (not installed)
+ PciMultimedia:
+  
+ ProcFB: 0 mgadrmfb
+ ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.15.0-42-generic 
root=UUID=06e712a9-0adb-4078-8976-0c41ce346aa5 ro console=tty0 
console=ttyS0,115200
+ ProcVersionSignature: Ubuntu 4.15.0-42.45-generic 4.15.18
+ RelatedPackageVersions:
+  linux-restricted-modules-4.15.0-42-generic N/A
+  linux-backports-modules-4.15.0-42-generic  N/A
+  linux-firmware                             1.127.24
+ RfKill: Error: [Errno 2] No such file or directory
+ Tags:  trusty uec-images
+ Uname: Linux 4.15.0-42-generic x86_64
+ UpgradeStatus: No upgrade log present (probably fresh install)
+ UserGroups:
+  
+ _MarkForUpload: True
+ dmi.bios.date: 10/02/2018
+ dmi.bios.vendor: HPE
+ dmi.bios.version: A40
+ dmi.board.name: ProLiant DL385 Gen10
+ dmi.board.vendor: HPE
+ dmi.chassis.type: 23
+ dmi.chassis.vendor: HPE
+ dmi.modalias: 
dmi:bvnHPE:bvrA40:bd10/02/2018:svnHPE:pnProLiantDL385Gen10:pvr:rvnHPE:rnProLiantDL385Gen10:rvr:cvnHPE:ct23:cvr:
+ dmi.product.family: ProLiant
+ dmi.product.name: ProLiant DL385 Gen10
+ dmi.sys.vendor: HPE

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1873352

Title:
  unregister_netdevice: waiting for tape3e33cb9-d6 to become free. Usage
  count = 2

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1873352/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Reply via email to