Public bug reported:
This problem has crippled my file server. This did not happen before an
update. All information I can think to include is below.
Uses LSI 9300-8i in IT mode to an Intel expander to HGST drives, all
healthy and checked extensively via smartctl long and offline tests.
Simply worked perfectly before apt update, and not at all after. Again,
reinstalling has no effect.
Accessing one dataset in particular, even just an "ls", hangs 'updatedb'
and causes cascading hangs in other processes and on NFS connected
clients. Server will not reboot at that point, hanging forever on
attempts to unmount the ZFS pool, forcing a hard shutdown.
# uname -a
Linux shareos 4.8.0-44-generic #47~16.04.1-Ubuntu SMP Wed Mar 22 18:51:56 UTC
2017 x86_64 x86_64 x86_64 GNU/Linux
# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 16.04.2 LTS
Release: 16.04
Codename: xenial
# apt list --installed *zfs*
Listing... Done
libzfs2linux/xenial-updates,now 0.6.5.6-0ubuntu16 amd64 [installed,automatic]
zfs-doc/xenial-updates,xenial-updates,now 0.6.5.6-0ubuntu16 all
[installed,automatic]
zfs-zed/xenial-updates,now 0.6.5.6-0ubuntu16 amd64 [installed,automatic]
zfsutils-linux/xenial-updates,now 0.6.5.6-0ubuntu16 amd64 [installed]
# apt list --installed *zpool*
Listing... Done
libzpool2linux/xenial-updates,now 0.6.5.6-0ubuntu16 amd64 [installed,automatic]
# dmesg (including only pertinent details from log)
[ 0.000000] Linux version 4.8.0-44-generic (buildd@lgw01-17) (gcc version
5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.4) ) #47~16.04.1-Ubuntu SMP Wed Mar
22 18:51:56 UTC 2017 (Ubuntu 4.8.0-44.47~16.04.1-generic 4.8.17)
[ 0.000000] Command line: BOOT_IMAGE=/vmlinuz-4.8.0-44-generic.efi.signed
root=/dev/mapper/ubuntu--vg-root ro quiet splash vt.handoff=7
...
[ 91.074536] zavl: loading out-of-tree module taints kernel.
[ 91.074539] zavl: module license 'CDDL' taints kernel.
[ 91.074540] Disabling lock debugging due to kernel taint
[ 91.080838] SPL: Loaded module v0.6.5.8-2
[ 91.175983] ZFS: Loaded module v0.6.5.8-0ubuntu4.1, ZFS pool version 5000,
ZFS filesystem version 5
[ 96.024363] SPL: using hostid 0x00000000
[ 133.166828] systemd[1]: apt-daily.timer: Adding 8h 8min 39.445565s random
time.
[ 133.350355] systemd[1]: apt-daily.timer: Adding 7h 8min 13.915790s random
time.
[ 484.419820] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 484.419828] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 484.419831] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
message.
[ 484.419833] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876 0x00000000
[ 484.419842] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 484.419846] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 484.419850] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 484.419854] Call Trace:
[ 484.419869] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 484.419879] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 484.419888] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 484.419892] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 484.419996] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 484.420002] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 484.420007] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 484.420009] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 484.420012] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 484.420014] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 484.420019] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 484.420021] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 484.420023] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 484.420026] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 484.420029] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 484.420032] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 484.420035] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 484.420038] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 484.420043] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 605.256081] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 605.256094] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 605.256095] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
message.
[ 605.256099] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876 0x00000000
[ 605.256113] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 605.256116] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 605.256118] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 605.256121] Call Trace:
[ 605.256145] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 605.256170] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 605.256179] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 605.256184] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 605.256401] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 605.256404] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 605.256407] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 605.256408] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 605.256410] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 605.256411] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 605.256414] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 605.256415] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 605.256416] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 605.256417] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 605.256420] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 605.256421] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 605.256423] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 605.256424] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 605.256427] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 726.091707] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 726.091716] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 726.091718] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
message.
[ 726.091721] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876 0x00000000
[ 726.091729] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 726.091733] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 726.091737] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 726.091741] Call Trace:
[ 726.091756] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 726.091767] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 726.091775] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 726.091779] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 726.091887] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 726.091893] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 726.091898] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 726.091900] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 726.091902] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 726.091905] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 726.091910] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 726.091912] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 726.091914] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 726.091916] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 726.091920] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 726.091923] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 726.091926] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 726.091929] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 726.091934] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 846.927188] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 846.927196] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 846.927198] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
message.
[ 846.927200] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876 0x00000000
[ 846.927210] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 846.927215] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 846.927219] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 846.927222] Call Trace:
[ 846.927236] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 846.927245] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 846.927252] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 846.927255] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 846.927340] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 846.927345] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 846.927349] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 846.927351] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 846.927354] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 846.927356] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 846.927360] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 846.927362] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 846.927365] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 846.927367] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 846.927370] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 846.927373] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 846.927376] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 846.927378] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 846.927383] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 967.762549] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 967.762558] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 967.762560] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
message.
[ 967.762563] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876 0x00000000
[ 967.762572] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 967.762576] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 967.762579] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 967.762583] Call Trace:
[ 967.762598] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 967.762609] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 967.762617] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 967.762621] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 967.762730] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 967.762735] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 967.762740] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 967.762742] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 967.762745] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 967.762747] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 967.762752] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 967.762754] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 967.762756] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 967.762759] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 967.762762] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 967.762765] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 967.762769] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 967.762772] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 967.762776] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 1088.597403] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 1088.597411] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 1088.597413] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
message.
[ 1088.597415] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876 0x00000000
[ 1088.597422] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 1088.597426] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 1088.597429] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 1088.597433] Call Trace:
[ 1088.597444] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 1088.597452] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 1088.597458] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 1088.597461] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 1088.597539] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 1088.597543] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 1088.597547] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 1088.597550] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 1088.597552] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 1088.597554] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 1088.597558] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 1088.597560] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 1088.597562] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 1088.597564] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 1088.597567] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 1088.597570] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 1088.597573] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 1088.597576] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 1088.597580] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 1209.431709] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 1209.431717] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 1209.431719] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
message.
[ 1209.431722] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876 0x00000000
[ 1209.431731] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 1209.431735] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 1209.431738] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 1209.431742] Call Trace:
[ 1209.431757] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 1209.431769] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 1209.431776] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 1209.431780] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 1209.431865] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 1209.431870] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 1209.431875] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 1209.431877] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 1209.431880] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 1209.431882] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 1209.431887] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 1209.431889] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 1209.431891] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 1209.431893] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 1209.431897] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 1209.431900] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 1209.431903] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 1209.431906] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 1209.431911] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 1330.266331] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 1330.266339] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 1330.266341] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
message.
[ 1330.266344] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876 0x00000000
[ 1330.266352] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 1330.266357] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 1330.266360] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 1330.266364] Call Trace:
[ 1330.266379] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 1330.266390] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 1330.266398] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 1330.266402] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 1330.266507] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 1330.266512] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 1330.266517] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 1330.266520] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 1330.266522] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 1330.266524] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 1330.266529] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 1330.266531] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 1330.266534] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 1330.266536] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 1330.266540] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 1330.266542] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 1330.266546] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 1330.266549] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 1330.266554] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 1451.101073] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 1451.101080] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 1451.101081] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
message.
[ 1451.101083] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876 0x00000000
[ 1451.101088] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 1451.101090] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 1451.101093] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 1451.101095] Call Trace:
[ 1451.101108] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 1451.101115] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 1451.101120] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 1451.101122] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 1451.101179] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 1451.101182] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 1451.101184] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 1451.101186] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 1451.101187] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 1451.101188] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 1451.101192] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 1451.101193] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 1451.101194] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 1451.101195] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 1451.101197] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 1451.101198] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 1451.101200] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 1451.101202] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 1451.101204] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 1571.940255] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 1571.940272] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 1571.940273] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
message.
[ 1571.940278] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876 0x00000000
[ 1571.940299] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 1571.940304] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 1571.940307] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 1571.940313] Call Trace:
[ 1571.940337] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 1571.940356] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 1571.940372] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 1571.940375] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 1571.940571] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 1571.940579] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 1571.940590] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 1571.940592] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 1571.940594] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 1571.940596] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 1571.940602] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 1571.940603] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 1571.940605] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 1571.940607] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 1571.940611] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 1571.940613] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 1571.940616] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 1571.940619] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 1571.940625] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: libzfs2linux 0.6.5.6-0ubuntu16
ProcVersionSignature: Ubuntu 4.8.0-44.47~16.04.1-generic 4.8.17
Uname: Linux 4.8.0-44-generic x86_64
NonfreeKernelModules: zfs zunicode zcommon znvpair zavl
ApportVersion: 2.20.1-0ubuntu2.5
Architecture: amd64
Date: Tue Mar 28 17:41:11 2017
InstallationDate: Installed on 2017-03-29 (0 days ago)
InstallationMedia: Ubuntu 16.04.2 LTS "Xenial Xerus" - Release amd64
(20170215.2)
ProcEnviron:
LANGUAGE=en_US
TERM=xterm-256color
PATH=(custom, no user)
LANG=en_US.UTF-8
SHELL=/bin/bash
SourcePackage: zfs-linux
UpgradeStatus: No upgrade log present (probably fresh install)
** Affects: zfs-linux (Ubuntu)
Importance: Undecided
Status: New
** Tags: amd64 apport-bug xenial
** Description changed:
- This problem has crippled my file server. Attempts to utilize 16.04.1
- and 16.04.2 have both failed. This did not happen before an update. All
- information I can think to include is below.
+ This problem has crippled my file server. This did not happen before an
+ update. All information I can think to include is below.
Uses LSI 9300-8i in IT mode to an Intel expander to HGST drives, all
healthy and checked extensively via smartctl long and offline tests.
Simply worked perfectly before apt update, and not at all after. Again,
reinstalling has no effect.
Accessing one dataset in particular, even just an "ls", hangs 'updatedb'
and causes cascading hangs in other processes and on NFS connected
clients. Server will not reboot at that point, hanging forever on
attempts to unmount the ZFS pool, forcing a hard shutdown.
# uname -a
Linux shareos 4.8.0-44-generic #47~16.04.1-Ubuntu SMP Wed Mar 22 18:51:56 UTC
2017 x86_64 x86_64 x86_64 GNU/Linux
# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 16.04.2 LTS
Release: 16.04
Codename: xenial
# apt list --installed *zfs*
Listing... Done
libzfs2linux/xenial-updates,now 0.6.5.6-0ubuntu16 amd64 [installed,automatic]
zfs-doc/xenial-updates,xenial-updates,now 0.6.5.6-0ubuntu16 all
[installed,automatic]
zfs-zed/xenial-updates,now 0.6.5.6-0ubuntu16 amd64 [installed,automatic]
zfsutils-linux/xenial-updates,now 0.6.5.6-0ubuntu16 amd64 [installed]
# apt list --installed *zpool*
Listing... Done
libzpool2linux/xenial-updates,now 0.6.5.6-0ubuntu16 amd64
[installed,automatic]
# dmesg (including only pertinent details from log)
[ 0.000000] Linux version 4.8.0-44-generic (buildd@lgw01-17) (gcc version
5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.4) ) #47~16.04.1-Ubuntu SMP Wed Mar
22 18:51:56 UTC 2017 (Ubuntu 4.8.0-44.47~16.04.1-generic 4.8.17)
[ 0.000000] Command line: BOOT_IMAGE=/vmlinuz-4.8.0-44-generic.efi.signed
root=/dev/mapper/ubuntu--vg-root ro quiet splash vt.handoff=7
...
[ 91.074536] zavl: loading out-of-tree module taints kernel.
[ 91.074539] zavl: module license 'CDDL' taints kernel.
[ 91.074540] Disabling lock debugging due to kernel taint
[ 91.080838] SPL: Loaded module v0.6.5.8-2
[ 91.175983] ZFS: Loaded module v0.6.5.8-0ubuntu4.1, ZFS pool version 5000,
ZFS filesystem version 5
[ 96.024363] SPL: using hostid 0x00000000
[ 133.166828] systemd[1]: apt-daily.timer: Adding 8h 8min 39.445565s random
time.
[ 133.350355] systemd[1]: apt-daily.timer: Adding 7h 8min 13.915790s random
time.
[ 484.419820] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 484.419828] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 484.419831] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[ 484.419833] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876
0x00000000
[ 484.419842] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 484.419846] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 484.419850] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 484.419854] Call Trace:
[ 484.419869] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 484.419879] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 484.419888] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 484.419892] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 484.419996] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 484.420002] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 484.420007] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 484.420009] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 484.420012] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 484.420014] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 484.420019] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 484.420021] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 484.420023] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 484.420026] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 484.420029] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 484.420032] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 484.420035] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 484.420038] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 484.420043] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 605.256081] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 605.256094] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 605.256095] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[ 605.256099] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876
0x00000000
[ 605.256113] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 605.256116] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 605.256118] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 605.256121] Call Trace:
[ 605.256145] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 605.256170] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 605.256179] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 605.256184] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 605.256401] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 605.256404] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 605.256407] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 605.256408] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 605.256410] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 605.256411] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 605.256414] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 605.256415] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 605.256416] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 605.256417] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 605.256420] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 605.256421] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 605.256423] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 605.256424] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 605.256427] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 726.091707] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 726.091716] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 726.091718] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[ 726.091721] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876
0x00000000
[ 726.091729] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 726.091733] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 726.091737] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 726.091741] Call Trace:
[ 726.091756] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 726.091767] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 726.091775] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 726.091779] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 726.091887] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 726.091893] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 726.091898] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 726.091900] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 726.091902] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 726.091905] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 726.091910] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 726.091912] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 726.091914] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 726.091916] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 726.091920] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 726.091923] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 726.091926] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 726.091929] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 726.091934] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 846.927188] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 846.927196] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 846.927198] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[ 846.927200] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876
0x00000000
[ 846.927210] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 846.927215] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 846.927219] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 846.927222] Call Trace:
[ 846.927236] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 846.927245] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 846.927252] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 846.927255] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 846.927340] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 846.927345] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 846.927349] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 846.927351] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 846.927354] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 846.927356] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 846.927360] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 846.927362] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 846.927365] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 846.927367] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 846.927370] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 846.927373] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 846.927376] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 846.927378] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 846.927383] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 967.762549] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 967.762558] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 967.762560] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[ 967.762563] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876
0x00000000
[ 967.762572] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 967.762576] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 967.762579] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 967.762583] Call Trace:
[ 967.762598] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 967.762609] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 967.762617] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 967.762621] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 967.762730] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 967.762735] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 967.762740] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 967.762742] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 967.762745] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 967.762747] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 967.762752] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 967.762754] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 967.762756] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 967.762759] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 967.762762] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 967.762765] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 967.762769] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 967.762772] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 967.762776] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 1088.597403] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 1088.597411] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 1088.597413] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[ 1088.597415] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876
0x00000000
[ 1088.597422] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 1088.597426] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 1088.597429] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 1088.597433] Call Trace:
[ 1088.597444] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 1088.597452] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 1088.597458] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 1088.597461] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 1088.597539] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 1088.597543] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 1088.597547] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 1088.597550] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 1088.597552] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 1088.597554] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 1088.597558] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 1088.597560] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 1088.597562] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 1088.597564] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 1088.597567] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 1088.597570] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 1088.597573] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 1088.597576] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 1088.597580] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 1209.431709] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 1209.431717] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 1209.431719] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[ 1209.431722] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876
0x00000000
[ 1209.431731] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 1209.431735] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 1209.431738] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 1209.431742] Call Trace:
[ 1209.431757] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 1209.431769] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 1209.431776] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 1209.431780] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 1209.431865] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 1209.431870] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 1209.431875] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 1209.431877] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 1209.431880] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 1209.431882] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 1209.431887] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 1209.431889] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 1209.431891] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 1209.431893] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 1209.431897] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 1209.431900] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 1209.431903] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 1209.431906] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 1209.431911] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 1330.266331] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 1330.266339] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 1330.266341] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[ 1330.266344] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876
0x00000000
[ 1330.266352] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 1330.266357] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 1330.266360] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 1330.266364] Call Trace:
[ 1330.266379] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 1330.266390] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 1330.266398] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 1330.266402] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 1330.266507] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 1330.266512] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 1330.266517] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 1330.266520] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 1330.266522] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 1330.266524] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 1330.266529] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 1330.266531] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 1330.266534] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 1330.266536] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 1330.266540] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 1330.266542] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 1330.266546] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 1330.266549] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 1330.266554] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 1451.101073] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 1451.101080] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 1451.101081] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[ 1451.101083] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876
0x00000000
[ 1451.101088] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 1451.101090] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 1451.101093] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 1451.101095] Call Trace:
[ 1451.101108] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 1451.101115] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 1451.101120] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 1451.101122] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 1451.101179] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 1451.101182] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 1451.101184] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 1451.101186] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 1451.101187] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 1451.101188] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 1451.101192] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 1451.101193] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 1451.101194] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 1451.101195] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 1451.101197] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 1451.101198] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 1451.101200] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 1451.101202] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 1451.101204] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
[ 1571.940255] INFO: task updatedb.mlocat:18877 blocked for more than 120
seconds.
[ 1571.940272] Tainted: P O 4.8.0-44-generic
#47~16.04.1-Ubuntu
[ 1571.940273] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[ 1571.940278] updatedb.mlocat D ffff90c3341b7aa0 0 18877 18876
0x00000000
[ 1571.940299] ffff90c3341b7aa0 ffff90c33357a800 ffff90d3393dac40
ffff90c335303b00
[ 1571.940304] 0000000000000000 ffff90c3341b8000 ffff90d2ed964a18
ffffffffa23ec8d0
[ 1571.940307] ffff90c335303b00 ffff90c33784e180 ffff90c3341b7ab8
ffffffffa1a95fb5
[ 1571.940313] Call Trace:
[ 1571.940337] [<ffffffffa1a95fb5>] schedule+0x35/0x80
[ 1571.940356] [<ffffffffa144e3ca>] d_alloc_parallel+0x3ca/0x4a0
[ 1571.940372] [<ffffffffa12aeff0>] ? wake_up_q+0x70/0x70
[ 1571.940375] [<ffffffffa144e6d0>] d_add_ci+0x60/0xe0
[ 1571.940571] [<ffffffffc09ed159>] zpl_lookup+0x159/0x1e0 [zfs]
[ 1571.940579] [<ffffffffa14561a2>] ? legitimize_mnt+0x12/0x60
[ 1571.940590] [<ffffffffa143f6d5>] lookup_slow+0xa5/0x160
[ 1571.940592] [<ffffffffa143fe0c>] walk_component+0x1ec/0x310
[ 1571.940594] [<ffffffffa1440eed>] path_lookupat+0x5d/0x110
[ 1571.940596] [<ffffffffa14438a1>] filename_lookup+0xb1/0x180
[ 1571.940602] [<ffffffffa140ab3e>] ? kmem_cache_alloc+0x16e/0x1b0
[ 1571.940603] [<ffffffffa14434a6>] ? getname_flags+0x56/0x1f0
[ 1571.940605] [<ffffffffa14434c2>] ? getname_flags+0x72/0x1f0
[ 1571.940607] [<ffffffffa1443a46>] user_path_at_empty+0x36/0x40
[ 1571.940611] [<ffffffffa1438276>] vfs_fstatat+0x66/0xc0
[ 1571.940613] [<ffffffffa1438831>] SYSC_newlstat+0x31/0x60
[ 1571.940616] [<ffffffffa144a221>] ? SyS_poll+0x71/0x130
[ 1571.940619] [<ffffffffa143896e>] SyS_newlstat+0xe/0x10
[ 1571.940625] [<ffffffffa1a9a7f6>] entry_SYSCALL_64_fastpath+0x1e/0xa8
ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: libzfs2linux 0.6.5.6-0ubuntu16
ProcVersionSignature: Ubuntu 4.8.0-44.47~16.04.1-generic 4.8.17
Uname: Linux 4.8.0-44-generic x86_64
NonfreeKernelModules: zfs zunicode zcommon znvpair zavl
ApportVersion: 2.20.1-0ubuntu2.5
Architecture: amd64
Date: Tue Mar 28 17:41:11 2017
InstallationDate: Installed on 2017-03-29 (0 days ago)
InstallationMedia: Ubuntu 16.04.2 LTS "Xenial Xerus" - Release amd64
(20170215.2)
ProcEnviron:
- LANGUAGE=en_US
- TERM=xterm-256color
- PATH=(custom, no user)
- LANG=en_US.UTF-8
- SHELL=/bin/bash
+ LANGUAGE=en_US
+ TERM=xterm-256color
+ PATH=(custom, no user)
+ LANG=en_US.UTF-8
+ SHELL=/bin/bash
SourcePackage: zfs-linux
UpgradeStatus: No upgrade log present (probably fresh install)
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1677073
Title:
ZFS pools are unstable after round of updates
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/zfs-linux/+bug/1677073/+subscriptions
--
ubuntu-bugs mailing list
[email protected]
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
