btrfs: error -5 while searching for dev_stats item for device
Hey list! Here's another backtrace observed while deduplicating my snapshotted btrfs backup volume... https://gist.github.com/kakra/26b377cccfc66ab870e4 [58198.314804] btrfs: error -5 while searching for dev_stats item for device /dev/sdd1! [58198.314807] [ cut here ] [58198.314812] WARNING: at fs/btrfs/transaction.c:913 commit_cowonly_roots+0xb4/0x22b() [58198.314813] Hardware name: To Be Filled By O.E.M. [58198.314814] Modules linked in: bnep bluetooth ipt_MASQUERADE nf_conntrack_netbios_ns nf_conntrack_broadcast xt_tcpudp ip6table_mangle ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables iptable_nat nf_nat_ipv4 nf_nat iptable_mangle ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ip_tables x_tables af_packet vmblock(O) vsock vmmon(O) vmci(O) vmnet(O) reiserfs snd_usb_audio snd_usbmidi_lib snd_rawmidi snd_seq_device gspca_sonixj gspca_main gpio_ich videodev coretemp hwmon kvm_intel kvm crc32_pclmul crc32c_intel lpc_ich mfd_core i2c_i801 r8169 microcode pcspkr evdev usb_storage zram(C) unix [58198.314841] Pid: 13751, comm: umount Tainted: G C O 3.9.2-gentoo #1 [58198.314842] Call Trace: [58198.314847] [8102f11d] ? warn_slowpath_common+0x78/0x8e [58198.314849] [8117ef77] ? commit_cowonly_roots+0xb4/0x22b [58198.314852] [8104f6b8] ? should_resched+0x5/0x23 [58198.314854] [811808a8] ? btrfs_commit_transaction+0x452/0x845 [58198.314857] [81049e3a] ? add_wait_queue+0x3c/0x3c [58198.314859] [811815d1] ? btrfs_attach_transaction_barrier+0x15/0x38 [58198.314862] [8111a5fd] ? __sync_filesystem+0x32/0x44 [58198.314865] [810f9366] ? generic_shutdown_super+0x26/0xbf [58198.314867] [810f9467] ? kill_anon_super+0x9/0x11 [58198.314870] [8115bfe8] ? btrfs_kill_super+0xd/0x16 [58198.314872] [810f9517] ? deactivate_locked_super+0x2c/0x56 [58198.314875] [8110df45] ? sys_umount+0x2d1/0x303 [58198.314879] [81516792] ? system_call_fastpath+0x16/0x1b [58198.314880] ---[ end trace 2657d62297fa95d1 ]--- [58198.314907] [ cut here ] [58198.314910] WARNING: at fs/btrfs/super.c:255 __btrfs_abort_transaction+0x4b/0xd2() [58198.314911] Hardware name: To Be Filled By O.E.M. [58198.314912] btrfs: Transaction aborted [58198.314913] Modules linked in: bnep bluetooth ipt_MASQUERADE nf_conntrack_netbios_ns nf_conntrack_broadcast xt_tcpudp ip6table_mangle ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables iptable_nat nf_nat_ipv4 nf_nat iptable_mangle ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ip_tables x_tables af_packet vmblock(O) vsock vmmon(O) vmci(O) vmnet(O) reiserfs snd_usb_audio snd_usbmidi_lib snd_rawmidi snd_seq_device gspca_sonixj gspca_main gpio_ich videodev coretemp hwmon kvm_intel kvm crc32_pclmul crc32c_intel lpc_ich mfd_core i2c_i801 r8169 microcode pcspkr evdev usb_storage zram(C) unix [58198.314931] Pid: 13751, comm: umount Tainted: GWC O 3.9.2-gentoo #1 [58198.314932] Call Trace: [58198.314934] [8102f11d] ? warn_slowpath_common+0x78/0x8e [58198.314936] [8102f1cb] ? warn_slowpath_fmt+0x45/0x4a [58198.314938] [81160f10] ? __btrfs_abort_transaction+0x4b/0xd2 [58198.314940] [8116d8e4] ? __btrfs_free_extent+0x5d8/0x605 [58198.314942] [81170901] ? run_clustered_refs+0x765/0x80a [58198.314945] [8117372f] ? btrfs_run_delayed_refs+0x215/0x39c [58198.314948] [811cde40] ? btrfs_dev_replace_unlock+0x8a/0x99 [58198.314949] [811cea5f] ? btrfs_run_dev_replace+0x41/0x2a6 [58198.314951] [8117efbf] ? commit_cowonly_roots+0xfc/0x22b [58198.314953] [8104f6b8] ? should_resched+0x5/0x23 [58198.314955] [811808a8] ? btrfs_commit_transaction+0x452/0x845 [58198.314957] [81049e3a] ? add_wait_queue+0x3c/0x3c [58198.314959] [811815d1] ? btrfs_attach_transaction_barrier+0x15/0x38 [58198.314961] [8111a5fd] ? __sync_filesystem+0x32/0x44 [58198.314963] [810f9366] ? generic_shutdown_super+0x26/0xbf [58198.314965] [810f9467] ? kill_anon_super+0x9/0x11 [58198.314967] [8115bfe8] ? btrfs_kill_super+0xd/0x16 [58198.314968] [810f9517] ? deactivate_locked_super+0x2c/0x56 [58198.314971] [8110df45] ? sys_umount+0x2d1/0x303 [58198.314973] [81516792] ? system_call_fastpath+0x16/0x1b [58198.314974] ---[ end trace 2657d62297fa95d2 ]--- [58198.314976] BTRFS error (device sdd1) in __btrfs_free_extent:5394: IO failure [58198.314977] btrfs is forced readonly [58198.314978] btrfs: run_one_delayed_ref returned -5 [58198.314980] BTRFS error (device sdd1) in btrfs_run_delayed_refs:2565: IO failure [58198.314987] [ cut here ] [58198.315010] kernel BUG at fs/btrfs/transaction.c:922! [58198.315031] invalid opcode: [#1] SMP [58198.315052] Modules
Re: btrfs: error -5 while searching for dev_stats item for device
Actually, it seems to be the result of some USB hickup: [50463.744357] device label usb-backup devid 1 transid 11907 /dev/sdd1 [58191.598683] xhci_hcd :05:00.0: Timeout while waiting for address device command [58196.801878] xhci_hcd :05:00.0: Timeout while waiting for address device command [58197.005195] usb 4-1: device not accepting address 2, error -62 [58197.088600] usb 4-1: USB disconnect, device number 2 [58197.091862] scsi 6:0:0:0: rejecting I/O to offline device [58197.091868] scsi 6:0:0:0: [sdd] killing request [58197.091874] btrfs: bdev /dev/sdd1 errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [58197.091883] btrfs: bdev /dev/sdd1 errs: wr 0, rd 2, flush 0, corrupt 0, gen 0 [58197.091888] btrfs: bdev /dev/sdd1 errs: wr 0, rd 3, flush 0, corrupt 0, gen 0 [58197.091892] btrfs: bdev /dev/sdd1 errs: wr 0, rd 4, flush 0, corrupt 0, gen 0 [58197.091899] btrfs: bdev /dev/sdd1 errs: wr 0, rd 5, flush 0, corrupt 0, gen 0 [58197.091905] btrfs: bdev /dev/sdd1 errs: wr 0, rd 6, flush 0, corrupt 0, gen 0 [58197.091909] btrfs: bdev /dev/sdd1 errs: wr 0, rd 7, flush 0, corrupt 0, gen 0 [58197.091913] btrfs: bdev /dev/sdd1 errs: wr 0, rd 8, flush 0, corrupt 0, gen 0 [58197.091917] btrfs: bdev /dev/sdd1 errs: wr 0, rd 9, flush 0, corrupt 0, gen 0 [58197.091922] btrfs: bdev /dev/sdd1 errs: wr 0, rd 10, flush 0, corrupt 0, gen 0 [58197.092211] scsi 6:0:0:0: [sdd] Unhandled error code [58197.092213] scsi 6:0:0:0: [sdd] [58197.092214] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [58197.092215] scsi 6:0:0:0: [sdd] CDB: [58197.092216] Read(10): 28 00 19 b8 47 a0 00 00 f0 00 [58197.09] end_request: I/O error, dev sdd, sector 431507360 [58197.102223] xhci_hcd :05:00.0: xHCI xhci_drop_endpoint called with disabled ep 880407a2df80 [58197.102225] xhci_hcd :05:00.0: xHCI xhci_drop_endpoint called with disabled ep 880407a2dfc0 [58197.171953] xhci_hcd :05:00.0: Bad Slot ID 1 [58197.171959] xhci_hcd :05:00.0: Could not allocate xHCI USB device data structures [58197.171966] hub 3-0:1.0: couldn't allocate port 1 usb_device [58198.311938] zcache: destroyed local pool id=2 [58198.314804] btrfs: error -5 while searching for dev_stats item for device /dev/sdd1! Kai Krakow hurikhan77+bt...@gmail.com schrieb: Hey list! Here's another backtrace observed while deduplicating my snapshotted btrfs backup volume... https://gist.github.com/kakra/26b377cccfc66ab870e4 [58198.314804] btrfs: error -5 while searching for dev_stats item for [device /dev/sdd1! [58198.314807] [ cut here ] [58198.314812] WARNING: at fs/btrfs/transaction.c:913 commit_cowonly_roots+0xb4/0x22b() [58198.314813] Hardware name: To Be Filled By O.E.M. [58198.314814] Modules linked in: bnep bluetooth ipt_MASQUERADE nf_conntrack_netbios_ns nf_conntrack_broadcast xt_tcpudp ip6table_mangle ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables iptable_nat nf_nat_ipv4 nf_nat iptable_mangle ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ip_tables x_tables af_packet vmblock(O) vsock vmmon(O) vmci(O) vmnet(O) reiserfs snd_usb_audio snd_usbmidi_lib snd_rawmidi snd_seq_device gspca_sonixj gspca_main gpio_ich videodev coretemp hwmon kvm_intel kvm crc32_pclmul crc32c_intel lpc_ich mfd_core i2c_i801 r8169 microcode pcspkr evdev usb_storage zram(C) unix [58198.314841] Pid: 13751, comm: umount Tainted: G C O [3.9.2-gentoo #1 [58198.314842] Call Trace: [58198.314847] [8102f11d] ? warn_slowpath_common+0x78/0x8e [58198.314849] [8117ef77] ? commit_cowonly_roots+0xb4/0x22b [58198.314852] [8104f6b8] ? should_resched+0x5/0x23 [58198.314854] [811808a8] ? [btrfs_commit_transaction+0x452/0x845 [58198.314857] [81049e3a] ? add_wait_queue+0x3c/0x3c [58198.314859] [811815d1] ? btrfs_attach_transaction_barrier+0x15/0x38 [58198.314862] [8111a5fd] ? __sync_filesystem+0x32/0x44 [58198.314865] [810f9366] ? generic_shutdown_super+0x26/0xbf [58198.314867] [810f9467] ? kill_anon_super+0x9/0x11 [58198.314870] [8115bfe8] ? btrfs_kill_super+0xd/0x16 [58198.314872] [810f9517] ? deactivate_locked_super+0x2c/0x56 [58198.314875] [8110df45] ? sys_umount+0x2d1/0x303 [58198.314879] [81516792] ? system_call_fastpath+0x16/0x1b [58198.314880] ---[ end trace 2657d62297fa95d1 ]--- [58198.314907] [ cut here ] [58198.314910] WARNING: at fs/btrfs/super.c:255 __btrfs_abort_transaction+0x4b/0xd2() [58198.314911] Hardware name: To Be Filled By O.E.M. [58198.314912] btrfs: Transaction aborted [58198.314913] Modules linked in: bnep bluetooth ipt_MASQUERADE nf_conntrack_netbios_ns nf_conntrack_broadcast xt_tcpudp ip6table_mangle ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables iptable_nat nf_nat_ipv4 nf_nat iptable_mangle ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4
btrfs error -5
Hi, I had an error the other day, and I either fail at Google, or Google has nothing helpful to give me, so I thought I would ask here if anyone had any information that will help me figure out what has gone wrong and, hopefully, how to fix it. (Either a go here and ask or if answers through here.) I am totally willing to live with Well, you're hosed, hope you had a backup! (It was working on that, but hadn't finished yet. That'll teach me to not keep a closer eye on the device.) The other day I noticed my CrashPlan clients could no longer backup to my fileserver. I didn't think too much of it, and attempted to restart CrashPlan. That spit out an error that I didn't think to write down, but being that it uses Java, I shrugged it off, and asked the machine to reboot. A bit later, I noticed that the machine still was not responding, fired up the console in vSphere and saw the error: btrfs: could not do orphan cleanup -5 btrfs: open_ctree failed There are a few other errors about the parent transid verification failing before those, and (since I didn't have copy/paste) I have transcribed them at http://pastebin.com/6smrqPkP I ran btrfsck on the device, and put the output of that at http://pastebin.com/HcQxy6a1 I also ran btrfs-debug-tree on the device, but it created a 9.4 gig file, so, I haven't tried to drop that on pastebin, but I can throw them somewhere if someone would like to see them. (I'm hoping there is some specific bit I can search for on my end and put that somewhere helpful.) Some information about my system: Operating System: Ubuntu 12.04.1 LTS Kernel: Linux 3.2.0-29-generic btrfsck tells me it is Btrfs Btrfs v0.19 The filesystem is on a 10 disk raid 6 array that does not appear to be unhappy. All of my btrfs tools came from Ubuntu's default repos. The system is a virtual machine running under a VMware ESXi 5.0.0 host, with the 10 drives passed through to the guest OS. I have allocated 8GB of memory to the guest. -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
