Package: bcache-tools Version: 1.0.4-1 Severity: normal Dear Maintainer,
I'm using bcache to provide storage (through nfs) for virtual machines .The server was working for a month without any problems however last friday i got a bcache error that made the bcache device unusable. I couldn't detach the device from the cache and had to reboot. I got the following error from syslog: Jun 27 10:00:00 storage kernel: [859662.906019] BUG: unable to handle kernel NULL pointer dereference at 0000000000000008 Jun 27 10:00:00 storage kernel: [859662.906073] IP: [<ffffffffa01b7771>] bch_btree_node_read_done+0x41/0x440 [bcache] Jun 27 10:00:00 storage kernel: [859662.906123] PGD 0 Jun 27 10:00:00 storage kernel: [859662.906135] Oops: 0002 [#1] SMP Jun 27 10:00:00 storage kernel: [859662.906154] Modules linked in: iscsi_trgt(O) crc32c nfsd auth_rpcgss oid_registry nfs_acl nfs lockd fscache sunrpc 8021q garp stp mrp llc bonding loop intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul iTCO_wdt ast iTCO_vendor_support ttm drm_kms_helper drm crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul lpc_ich i2c_algo_bit ioatdma i2c_i801 i2c_core joydev evdev psmouse dca ipmi_si glue_helper acpi_cpufreq serio_raw pcspkr parport_pc ipmi_msghandler parport i7core_edac mfd_core edac_core ablk_helper cryptd processor thermal_sys button ext4 crc16 mbcache jbd2 dm_mod raid1 md_mod bcache sg sd_mod sr_mod crc_t10dif crct10dif_common cdrom hid_generic usbhid hid ahci libahci libata uhci_hcd ehci_pci ehci_hcd e1000e ptp pps_core 3w_sas usbcore usb_common scsi_mod Jun 27 10:00:00 storage kernel: [859662.906578] CPU: 1 PID: 23117 Comm: kworker/1:2 Tainted: G IO 3.14-0.bpo.1-amd64 #1 Debian 3.14.4-1~bpo70+1 Jun 27 10:00:00 storage kernel: [859662.906624] Hardware name: empty empty/S7002, BIOS 'V1.08E ' 10/19/2010 Jun 27 10:00:00 storage kernel: [859662.906659] Workqueue: bcache bch_data_insert_keys [bcache] Jun 27 10:00:00 storage kernel: [859662.906686] task: ffff8800ba0752f0 ti: ffff880002724000 task.ti: ffff880002724000 Jun 27 10:00:00 storage kernel: [859662.906719] RIP: 0010:[<ffffffffa01b7771>] [<ffffffffa01b7771>] bch_btree_node_read_done+0x41/0x440 [bcache] Jun 27 10:00:00 storage kernel: [859662.906769] RSP: 0018:ffff880002725b58 EFLAGS: 00010246 Jun 27 10:00:00 storage kernel: [859662.906794] RAX: 0000000000001000 RBX: ffff880135f59000 RCX: ffff8801b5e40000 Jun 27 10:00:00 storage kernel: [859662.906825] RDX: 0000000000000000 RSI: 0000000000000246 RDI: 0000000000000246 Jun 27 10:00:00 storage kernel: [859662.906857] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000f58 Jun 27 10:00:00 storage kernel: [859662.906888] R10: 0000000000001770 R11: 0000000000000000 R12: ffff8800b8a00000 Jun 27 10:00:00 storage kernel: [859662.906919] R13: ffff8801088c0020 R14: ffff8800ba0752f0 R15: 0000000000000000 Jun 27 10:00:00 storage kernel: [859662.906951] FS: 0000000000000000(0000) GS:ffff8801bf220000(0000) knlGS:0000000000000000 Jun 27 10:00:00 storage kernel: [859662.906987] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b Jun 27 10:00:00 storage kernel: [859662.907013] CR2: 0000000000000008 CR3: 000000000180c000 CR4: 00000000000007e0 Jun 27 10:00:00 storage kernel: [859662.907044] Stack: Jun 27 10:00:00 storage kernel: [859662.907055] ffff880135f59000 ffff8800b88804e8 00030ddbdda6790d ffff8801088c0020 Jun 27 10:00:00 storage kernel: [859662.907093] ffff8800ba0752f0 ffffffffa01b7cc0 000000B0000000000 ffff8800ba0752f0 Jun 27 10:00:00 storage kernel: [859662.907130] 0000000000000000 0000000000000000 0000000000000000 00000000a0000001 Jun 27 10:00:00 storage kernel: [859662.907168] Call Trace: Jun 27 10:00:00 storage kernel: [859662.907189] [<ffffffffa01b7cc0>] ? bch_btree_node_read+0x150/0x180 [bcache] Jun 27 10:00:00 storage kernel: [859662.907226] [<ffffffffa01b9034>] ? bch_btree_node_get+0x134/0x280 [bcache] Jun 27 10:00:00 storage kernel: [859662.907262] [<ffffffffa01b93eb>] ? bch_btree_map_nodes_recurse+0x10b/0x180 [bcache] Jun 27 10:00:00 storage kernel: [859662.907301] [<ffffffffa01bb050>] ? bch_btree_insert_node+0x2e0/0x2e0 [bcache] Jun 27 10:00:00 storage kernel: [859662.907337] [<ffffffff813bdf6b>] ? cpufreq_notify_transition+0x3b/0x190 Jun 27 10:00:00 storage kernel: [859662.907371] [<ffffffffa02a676c>] ? acpi_cpufreq_target+0x10c/0x210 [acpi_cpufreq] Jun 27 10:00:00 storage kernel: [859662.907410] [<ffffffffa01bc6bd>] ? __bch_btree_map_nodes+0x18d/0x1c0 [bcache] Jun 27 10:00:00 storage kernel: [859662.907447] [<ffffffffa01bb050>] ? bch_btree_insert_node+0x2e0/0x2e0 [bcache] Jun 27 10:00:00 storage kernel: [859662.907484] [<ffffffffa01bc7cf>] ? bch_btree_insert+0xdf/0x150 [bcache] Jun 27 10:00:00 storage kernel: [859662.907518] [<ffffffff810a6730>] ? __e_up_sync+0x10/0x10 Jun 27 10:00:00 storage kernel: [859662.907550] [<ffffffffa01c3c1f>] ? bch_data_insert_keys+0x2f/0x140 [bcache] Jun 27 10:00:00 storage kernel: [859662.907584] [<ffffffff8107f3a5>] ? process_one_work+0x155/0x450 Jun 27 10:00:00 storage kernel: [859662.907613] [<ffffffff81080984>] ? worker_thread+0x114/0x370 Jun 27 10:00:00 storage kernel: [859662.907641] [<ffffffff81080870>] ? manage_workers.isra.21+0x2c0/0x2c0 Jun 27 10:00:00 storage kernel: [859662.907672] [<ffffffff81086c1c>] ? kthread+0xbc/0xe0 Jun 27 10:00:00 storage kernel: [859662.908834] [<ffffffff81086b60>] ? flush_kthread_worker+0xa0/0xa0 Jun 27 10:00:00 storage kernel: [859662.909955] [<ffffffff814f96cc>] ? ret_from_fork+0x7c/0xb0 Jun 27 10:00:00 storage kernel: [859662.911074] [<ffffffff81086b60>] ? flush_kthread_worker+0xa0/0xa0 Jun 27 10:00:00 storage kernel: [859662.911877] Code: a7 e0 00 00 00 48 8b b8 58 cb 00 00 e8 c9 8a f7 e0 48 8b 8b 80 00 00 00 48 89 c5 31 d2 0f b7 81 32 04 00 00 66 f7 b1 30 04 00 00 <48> c7 45 08 00 00 00 00 0f b7 c0 48 89 45 00 49 8b 54 24 10 48 Jun 27 10:00:00 storage kernel: [859662.913564] RIP [<ffffffffa01b7771>] bch_btree_node_read_done+0x41/0x440 [bcache] Jun 27 10:00:00 storage kernel: [859662.914401] RSP <ffff880002725b58> Jun 27 10:00:00 storage kernel: [859662.915223] CR2: 0000000000000008 Jun 27 10:00:00 storage kernel: [859662.930337] ---[ end trace 4b928b30b7add348 ]---Jun 27 10:00:00 storage kernel: [859662.931493] BUG: unable to handle kernel paging request at ffffffffffffffd8 Jun 27 10:00:21 storage kernel: [859662.932591] IP: [<ffffffff81086ee7>] kthread_data+0x7/0x10 Jun 27 10:00:21 storage kernel: [859662.933655] PGD 180f067 PUD 1811067 PMD 0 Jun 27 10:00:21 storage kernel: [859662.934692] Oops: 0000 [#2] SMP Jun 27 10:00:21 storage kernel: [859662.935692] Modules linked in: iscsi_trgt(O) crc32c nfsd auth_rpcgss oid_registry nfs_acl nfs lockd fscache sunrpc 8021q garp stp mrp llc bonding loop intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul iTCO_wdt ast iTCO_vendor_support ttm drm_kms_helper drm crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul lpc_ich i2c_algo_bit ioatdma i2c_i801 i2c_core joydev evdev psmouse dca ipmi_si glue_helper acpi_cpufreq serio_raw pcspkr parport_pc ipmi_msghandler parport i7core_edac mfd_core edac_core ablk_helper cryptd processor thermal_sys button ext4 crc16 mbcache jbd2 dm_mod raid1 md_mod bcache sg sd_mod sr_mod crc_t10dif crct10dif_common cdrom hid_generic usbhid hid ahci libahci libata uhci_hcd ehci_pci ehci_hcd e1000e ptp pps_core 3w_sas usbcore usb_common scsi_mod Jun 27 10:00:21 storage kernel: [859662.943325] CPU: 1 PID: 23117 Comm: kworker/1:2 Tainted: G D IO 3.14-0.bpo.1-amd64 #1 Debian 3.14.4-1~bpo70+1 Jun 27 10:00:21 storage kernel: [859662.944461] Hardware name: empty empty/S7002, BIOS 'V1.08E ' 10/19/2010 Jun 27 10:00:21 storage kernel: [859662.945619] task: ffff8800ba0752f0 ti: ffff880002724000 task.ti: ffff880002724000 Jun 27 10:00:21 storage kernel: [859662.946789] RIP: 0010:[<ffffffff81086ee7>] [<ffffffff81086ee7>] kthread_data+0x7/0x10 Jun 27 10:00:21 storage kernel: [859662.947973] RSP: 0018:ffff880002725810 EFLAGS: 00010096 Jun 27 10:00:21 storage kernel: [859662.949144] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff819f7d00 Jun 27 10:00:21 storage kernel: [859662.950319] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff8800ba0752f0 Jun 27 10:00:21 storage kernel: [859662.951483] RBP: 0000000000000001 R08: 0000000000000000 R09: 00000000000002e4 Jun 27 10:00:21 storage kernel: [859662.952634] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001 Jun 27 10:00:21 storage kernel: [859662.953767] R13: ffff8800ba075710 R14: ffff8800ba075608 R15: ffff8800ba0752e0 Jun 27 10:00:21 storage kernel: [859662.954904] FS: 0000000000000000(0000) GS:ffff8801bf220000(0000) knlGS:0000000000000000 Jun 27 10:00:21 storage kernel: [859662.956056] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b Jun 27 10:00:21 storage kernel: [859662.957197] CR2: 0000000000000028 CR3: 000000000180c000 CR4: 00000000000007e0 Jun 27 10:00:21 storage kernel: [859662.958341] Stack: Jun 27 10:00:21 storage kernel: [859662.959475] ffffffff81080dbf ffff8800ba075710 ffff8801bf234340 ffff8800ba0752f0 Jun 27 10:00:21 storage kernel: [859662.960648] ffffffff814edfd2 ffff8800b819c178 0000000000000086 0000000000014340 Jun 27 10:00:21 storage kernel: [859662.961824] ffff880002725fd8 0000000000014340 ffff8800ba0752f0 ffff8800ba0752e0 Jun 27 10:00:21 storage kernel: [859662.963001] Call Trace: Jun 27 10:00:21 storage kernel: [859662.964159] [<ffffffff81080dbf>] ? wq_worker_sleeping+0xf/0x90 Jun 27 10:00:21 storage kernel: [859662.965331] [<ffffffff814edfd2>] ? __schedule+0x482/0x760 Jun 27 10:00:21 storage kernel: [859662.966503] [<ffffffff810674b5>] ? do_exit+0x6e5/0xa70 Jun 27 10:00:21 storage kernel: [859662.967674] [<ffffffff814f2530>] ? oops_end+0xa0/0xe0 Jun 27 10:00:21 storage kernel: [859662.968838] [<ffffffff814e7e94>] ? no_context+0x279/0x288 Jun 27 10:00:21 storage kernel: [859662.969996] [<ffffffff814f4f16>] ? __do_page_fault+0x3a6/0x520 Jun 27 10:00:21 storage kernel: [859662.971153] [<ffffffff8117d015>] ? kmem_getpages+0x75/0x170 Jun 27 10:00:21 storage kernel: [859662.972308] [<ffffffff8117e908>] ? fallback_alloc+0x168/0x220 Jun 27 10:00:21 storage kernel: [859662.973462] [<ffffffff814f1948>] ? page_fault+0x28/0x30 Jun 27 10:00:21 storage kernel: [859662.974618] [<ffffffffa01b7771>] ? bch_btree_node_read_done+0x41/0x440 [bcache] Jun 27 10:00:21 storage kernel: [859662.975789] [<ffffffffa01b7757>] ? bch_btree_node_read_done+0x27/0x440 [bcache] Jun 27 10:00:21 storage kernel: [859662.976948] [<ffffffffa01b7cc0>] ? bch_btree_node_read+0x150/0x180 [bcache] Jun 27 10:00:21 storage kernel: [859662.978104] [<ffffffffa01b9034>] ? bch_btree_node_get+0x134/0x280 [bcache] Jun 27 10:00:21 storage kernel: [859662.979235] [<ffffffffa01b93eb>] ? bch_btree_map_nodes_recurse+0x10b/0x180 [bcache] Jun 27 10:00:21 storage kernel: [859662.980349] [<ffffffffa01bb050>] ? bch_btree_insert_node+0x2e0/0x2e0 [bcache] Jun 27 10:00:21 storage kernel: [859662.981442] [<ffffffff813bdf6b>] ? cpufreq_notify_transition+0x3b/0x190 Jun 27 10:00:21 storage kernel: [859662.982529] [<ffffffffa02a676c>] ? acpi_cpufreq_target+0x10c/0x210 [acpi_cpufreq] Jun 27 10:00:21 storage kernel: [859662.983635] [<ffffffffa01bc6bd>] ? __bch_btree_map_nodes+0x18d/0x1c0 [bcache] Jun 27 10:00:21 storage kernel: [859662.984744] [<ffffffffa01bb050>] ? bch_btree_insert_node+0x2e0/0x2e0 [bcache] Jun 27 10:00:21 storage kernel: [859662.985844] [<ffffffffa01bc7cf>] ? bch_btree_insert+0xdf/0x150 [bcache] Jun 27 10:00:21 storage kernel: [859662.986924] [<ffffffff810a6730>] ? __wake_up_sync+0x10/0x10 Jun 27 10:00:21 storage kernel: [859662.988006] [<ffffffffa01c3c1f>] ? bch_data_insert_keys+0x2f/0x140 [bcache] Jun 27 10:00:21 storage kernel: [859662.989094] [<ffffffff8107f3a5>] ? process_one_work+0x155/0x450 Jun 27 10:00:21 storage kernel: [859662.990157] [<ffffffff81080984>] ? worker_thread+0x114/0x370 Jun 27 10:00:21 storage kernel: [859662.991191] [<ffffffff81080870>] ? manage_workers.isra.21+0x2c0/0x2c0 Jun 27 10:00:21 storage kernel: [859662.992199] [<ffffffff81086c1c>] ? kthread+0xbc/0xe0 Jun 27 10:00:21 storage kernel: [859662.993175] [<ffffffff81086b60>] ? flush_kthread_worker+0xa0/0xa0 Jun 27 10:00:21 storage kernel: [859662.994124] [<ffffffff814f96cc>] ? ret_from_fork+0x7c/0xb0 Jun 27 10:00:21 storage kernel: [859662.995045] [<ffffffff81086b60>] ? flush_kthread_worker+0xa0/0xa0 Jun 27 10:00:21 storage kernel: [859662.995937] Code: ff ff 66 90 65 48 8b 04 25 40 c8 00 00 48 8b 80 c8 03 00 00 48 8b 40 c8 48 c1 e8 02 83 e0 01 c3 0f 1f 40 00 48 8b 87 c8 03 00 00 <48> 8b 40 d8 c3 0f 1f 40 00 48 83 ec 18 48 8b b7 c8 03 00 00 ba Jun 27 10:00:21 storage kernel: [859662.997856] RIP [<ffffffff81086ee7>] kthread_data+0x7/0x10 Jun 27 10:00:21 storage kernel: [859662.998749] RSP <ffff880002725810> Jun 27 10:00:21 storage kernel: [859662.999620] CR2: ffffffffffffffd8 Jun 27 10:00:21 storage kernel: [859663.000476] ---[ end trace 4b928b30b7add349 ]--- Jun 27 10:00:21 storage kernel: [859663.001331] Fixing recursive fault but reboot is needed! [....] Thanks, -- Bruno Macedo -- System Information: Debian Release: 7.5 APT prefers stable APT policy: (650, 'stable') Architecture: amd64 (x86_64) Kernel: Linux 3.14-0.bpo.1-amd64 (SMP w/8 CPU cores) Locale: LANG=pt_PT.UTF-8, LC_CTYPE=pt_PT.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /bin/dash Versions of packages bcache-tools depends on: ii initramfs-tools 0.113~bpo70+1 ii libblkid1 2.20.1-5.3 ii libc6 2.18-7 ii libuuid1 2.20.1-5.3 bcache-tools recommends no packages. bcache-tools suggests no packages. -- no debconf information -- To UNSUBSCRIBE, email to [email protected] with a subject of "unsubscribe". Trouble? Contact [email protected]

