On Tue, Jun 28, 2016 at 10:16:58AM +0200, Peter Becker wrote:
> Cause of kernel bugs was a defective HDD (/dev/sdd).

Thanks for reporting this bug, I can reproduce it, it's due to the fact
that we cannot read a valid btree node from the underlying disks, which
comes from a defective HDD in your case, but no worry, I'll send a patch
to return -EIO to the command line. :)

BTW, we're luck that we can still mount it which means the major part of
metadata are valid.

Thanks,

-liubo

> 
> The kernel BUG:
> 
> May 16 07:41:38 nas kernel: [37168.832800]
> btrfs_dev_stat_print_on_error: 470 callbacks suppressed
> May 16 07:41:38 nas kernel: [37168.832806] BTRFS error (device sdd):
> bdev /dev/sdb errs: wr 49293, rd 567248, flush 0, corrupt 0, gen 0
> May 16 07:41:38 nas kernel: [37168.832843] BTRFS error (device sdd):
> bdev /dev/sdf errs: wr 0, rd 537544, flush 0, corrupt 0, gen 0
> May 16 07:41:38 nas kernel: [37168.832887] BTRFS error (device sdd):
> bdev /dev/sdb errs: wr 49293, rd 567249, flush 0, corrupt 0, gen 0
> May 16 07:41:38 nas kernel: [37168.832893] BTRFS error (device sdd):
> bdev /dev/sdf errs: wr 0, rd 537545, flush 0, corrupt 0, gen 0
> May 16 07:41:38 nas kernel: [37168.832969] BTRFS error (device sdd):
> bdev /dev/sdb errs: wr 49293, rd 567250, flush 0, corrupt 0, gen 0
> May 16 07:41:38 nas kernel: [37168.832977] BTRFS error (device sdd):
> bdev /dev/sdf errs: wr 0, rd 537546, flush 0, corrupt 0, gen 0
> May 16 07:41:38 nas kernel: [37168.832987] BTRFS error (device sdd):
> bdev /dev/sdb errs: wr 49293, rd 567251, flush 0, corrupt 0, gen 0
> May 16 07:41:38 nas kernel: [37168.832992] BTRFS error (device sdd):
> bdev /dev/sdf errs: wr 0, rd 537547, flush 0, corrupt 0, gen 0
> May 16 07:41:38 nas kernel: [37168.862127] BTRFS error (device sdd):
> bdev /dev/sdf errs: wr 0, rd 537548, flush 0, corrupt 0, gen 0
> May 16 07:41:38 nas kernel: [37168.862188] BTRFS error (device sdd):
> bdev /dev/sdb errs: wr 49293, rd 567252, flush 0, corrupt 0, gen 0
> May 16 07:41:42 nas kernel: [37173.103386] ------------[ cut here 
> ]------------
> May 16 07:41:42 nas kernel: [37173.103414] kernel BUG at
> /home/kernel/COD/linux/fs/btrfs/ctree.c:5201!
> May 16 07:41:42 nas kernel: [37173.103434] invalid opcode: 0000 [#1] SMP
> May 16 07:41:42 nas kernel: [37173.103450] Modules linked in: cpuid
> xt_nat veth xt_addrtype xt_conntrack br_netfilter dm_thin_pool
> dm_persistent_data dm_bio_prison dm_bufio libcrc32c nvram msr
> input_leds joydev hid_generic usbhid hid xt_CHECKSUM iptable_mangle
> ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4
> nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack xt_tcpudp bridge stp
> llc iptable_filter ip_tables x_tables autofs4 eeepc_wmi asus_wmi
> sparse_keymap intel_rapl x86_pkg_temp_thermal intel_powerclamp kvm
> irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel cryptd
> dm_multipath serio_raw snd_hda_codec_hdmi snd_hda_codec_realtek
> snd_hda_codec_generic snd_hda_intel snd_hda_codec bnep rfcomm
> snd_hda_core bluetooth snd_hwdep snd_pcm snd_seq_midi
> snd_seq_midi_event snd_rawmidi lpc_ich snd_seq snd_seq_device mei_me
> snd_timer mei snd soundcore mac_hid shpchp nfsd auth_rpcgss parport_pc
> nfs_acl ppdev nfs nct6775 hwmon_vid binfmt_misc coretemp lockd grace
> lp parport sunrpc fscache btrfs xor raid6_pq nls_iso8859_1 dm_mirror
> dm_region_hash dm_log uas usb_storage i915 e1000e psmouse ahci libahci
> i2c_algo_bit drm_kms_helper ptp pps_core syscopyarea sysfillrect
> sysimgblt fb_sys_fops drm video fjes wmi
> May 16 07:41:42 nas kernel: [37173.103893] CPU: 1 PID: 17784 Comm:
> btrfs Tainted: G     U  W       4.5.4-040504-generic #201605120823
> May 16 07:41:42 nas kernel: [37173.103916] Hardware name: ASUS All
> Series/H87I-PLUS, BIOS 2003 11/05/2014
> May 16 07:41:42 nas kernel: [37173.103932] task: ffff88020501c240 ti:
> ffff880161f18000 task.ti: ffff880161f18000
> May 16 07:41:42 nas kernel: [37173.103950] RIP:
> 0010:[<ffffffffc02f4bdd>]  [<ffffffffc02f4bdd>]
> btrfs_search_forward+0x24d/0x330 [btrfs]
> May 16 07:41:42 nas kernel: [37173.103995] RSP: 0018:ffff880161f1bc38
> EFLAGS: 00010246
> May 16 07:41:42 nas kernel: [37173.104009] RAX: 0000000000000000 RBX:
> 0000000000000000 RCX: 0000000000000001
> May 16 07:41:42 nas kernel: [37173.104029] RDX: 0000000000000001 RSI:
> 0000091572628000 RDI: ffff8801ff2fa368
> May 16 07:41:42 nas kernel: [37173.104048] RBP: ffff880161f1bc98 R08:
> 0000091571c00000 R09: 00000915b1c00000
> May 16 07:41:42 nas kernel: [37173.104067] R10: ffff880161f1ba30 R11:
> 0000000000000000 R12: ffff8801d71b6930
> May 16 07:41:42 nas kernel: [37173.104086] R13: 0000000000000001 R14:
> 0000000000000000 R15: 0000000000000000
> May 16 07:41:42 nas kernel: [37173.104106] FS:  00007ff94d968900(0000)
> GS:ffff88021fb00000(0000) knlGS:0000000000000000
> May 16 07:41:42 nas kernel: [37173.104129] CS:  0010 DS: 0000 ES: 0000
> CR0: 0000000080050033
> May 16 07:41:42 nas kernel: [37173.104144] CR2: 00007ff94ca80a00 CR3:
> 0000000214a96000 CR4: 00000000000406e0
> May 16 07:41:42 nas kernel: [37173.104164] Stack:
> May 16 07:41:42 nas kernel: [37173.104173]  00ff880100000000
> ffff880161f1bcd7 ffff8800d7699800 c3ff880100000001
> May 16 07:41:42 nas kernel: [37173.104203]  0100000000000019
> 0000000000000000 000000007539a5b8 ffff8801d71b6930
> May 16 07:41:42 nas kernel: [37173.104233]  ffff880161f1bd30
> 0000000000000000 ffff880161f1bcd7 0000000000000000
> May 16 07:41:42 nas kernel: [37173.104262] Call Trace:
> May 16 07:41:42 nas kernel: [37173.104329]  [<ffffffffc034d81d>]
> search_ioctl+0xed/0x1b0 [btrfs]
> May 16 07:41:42 nas kernel: [37173.104388]  [<ffffffffc034d952>]
> btrfs_ioctl_tree_search+0x72/0xc0 [btrfs]
> May 16 07:41:42 nas kernel: [37173.104434]  [<ffffffffc0351f47>]
> btrfs_ioctl+0x3f7/0x1ea0 [btrfs]
> May 16 07:41:42 nas kernel: [37173.104457]  [<ffffffff811c20d9>] ?
> handle_mm_fault+0x1349/0x1ae0
> May 16 07:41:42 nas kernel: [37173.104481]  [<ffffffff81228c61>]
> do_vfs_ioctl+0xa1/0x5b0
> May 16 07:41:42 nas kernel: [37173.104500]  [<ffffffff81228c61>] ?
> do_vfs_ioctl+0xa1/0x5b0
> May 16 07:41:42 nas kernel: [37173.104521]  [<ffffffff8106aa94>] ?
> __do_page_fault+0x1b4/0x400
> May 16 07:41:42 nas kernel: [37173.104540]  [<ffffffff812291e9>]
> SyS_ioctl+0x79/0x90
> May 16 07:41:42 nas kernel: [37173.104562]  [<ffffffff81820f72>]
> entry_SYSCALL_64_fastpath+0x16/0x71
> May 16 07:41:42 nas kernel: [37173.104579] Code: 8b 4d a0 48 8b 55 a8
> 4d 89 f8 48 8b 7d b0 4c 89 e6 e8 78 fb ff ff 85 c0 0f 85 bf 00 00 00
> 4c 89 e7 e8 58 80 ff ff e9 fa fd ff ff <0f> 0b 48 8d 04 92 43 89 54 ac
> 40 48 8d 75 bf b9 11 00 00 00 48
> May 16 07:41:42 nas kernel: [37173.104746] RIP  [<ffffffffc02f4bdd>]
> btrfs_search_forward+0x24d/0x330 [btrfs]
> May 16 07:41:42 nas kernel: [37173.104804]  RSP <ffff880161f1bc38>
> May 16 07:41:42 nas kernel: [37173.111041] ---[ end trace c5e9746835476803 
> ]---
> 
> # uname -a
> Linux nas 4.5.4-040504-generic #201605120823 SMP Thu May 12 12:25:28
> UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
> 
> #   btrfs --version
> btrfs-progs v4.5.3
> 
> #   btrfs fi show
> Label: 'RAID'  uuid: 3247737b-87f9-4e8c-8db3-2beed50fb104
> Total devices 4 FS bytes used 4.21TiB
> devid    1 size 2.73TiB used 1.66TiB path /dev/sde
> devid    2 size 2.73TiB used 1.66TiB path /dev/sdb
> devid    3 size 2.73TiB used 1.66TiB path /dev/sdd
> devid    4 size 4.55TiB used 3.48TiB path /dev/sdc
> 
> Label: 'BACKUP'  uuid: 6e20fe0c-d4ea-4583-96e4-4f4b9634cb8f
> Total devices 1 FS bytes used 17.44GiB
> devid    1 size 232.89GiB used 38.02GiB path /dev/sdf
> 
> #   btrfs fi df /media/RAID/
> Data, RAID1: total=4.23TiB, used=4.21TiB
> System, RAID1: total=32.00MiB, used=624.00KiB
> Metadata, RAID1: total=6.00GiB, used=4.67GiB
> GlobalReserve, single: total=512.00MiB, used=0.00B
> 
> # btrfs scrub status /media/RAID/
> scrub status for 3247737b-87f9-4e8c-8db3-2beed50fb104
> scrub started at Mon May 16 15:26:35 2016 and finished after 07:13:34
> total bytes scrubbed: 8.42TiB with 266185 errors
> error details: verify=354 csum=265831
> corrected errors: 266057, uncorrectable errors: 128, unverified errors: 0
> --
> To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
> the body of a message to majord...@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Reply via email to