Using the same process (kill the peer and mount the filesystem on spare node)
gave us another stack trace today:
Nov 16 11:46:03 wab2 kernel: [ 376.733674] ocfs2_dlm: Nodes in domain
("57A2D6D463094E759EBEAB9D0775A4BB"): 6
Nov 16 11:46:03 wab2 kernel: [ 376.779332] ocfs2: Mounting device (147,1) on
(node 6, slot 1) with ordered data mode.
Nov 16 11:46:03 wab2 kernel: [ 376.779795] ------------[ cut here ]------------
Nov 16 11:46:03 wab2 kernel: [ 376.781394] kernel BUG at
/build/buildd-linux-2.6_2.6.32-38-i386-G9QRBd/linux-2.6-2.6.32/debian/build/source_i386_none/fs/ocfs2/journal.c:1702!
Nov 16 11:46:03 wab2 kernel: [ 376.783299] invalid opcode: 0000 [#1] SMP
Nov 16 11:46:03 wab2 kernel: [ 376.783299] last sysfs file:
/sys/module/drbd/parameters/cn_idx
Nov 16 11:46:03 wab2 kernel: [ 376.783299] Modules linked in: ocfs2 jbd2
quota_tree sha1_generic drbd lru_cache cn fuse ocfs2_dlmfs ocfs2_stack_o2cb
ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue configfs nfs lockd fscache nfs_acl
auth_rpcgss sunrpc ext2 loop snd_pcm snd_timer snd i2c_piix4 parport_pc
soundcore snd_page_alloc parport psmouse button processor pcspkr evdev i2c_core
serio_raw ext3 jbd mbcache dm_mod sg sr_mod cdrom sd_mod crc_t10dif ata_generic
ata_piix thermal libata floppy thermal_sys 8139too 8139cp mii scsi_mod [last
unloaded: scsi_wait_scan]
Nov 16 11:46:03 wab2 kernel: [ 376.783299]
Nov 16 11:46:03 wab2 kernel: [ 376.783299] Pid: 2186, comm: ocfs2rec Not
tainted (2.6.32-5-686 #1) Bochs
Nov 16 11:46:03 wab2 kernel: [ 376.783299] EIP: 0060:[<e15cc47a>] EFLAGS:
00010246 CPU: 0
Nov 16 11:46:03 wab2 kernel: [ 376.783299] EIP is at
__ocfs2_recovery_thread+0x3af/0x146d [ocfs2]
Nov 16 11:46:03 wab2 kernel: [ 376.783299] EAX: 00000006 EBX: ddca0800 ECX:
00000001 EDX: 00000001
Nov 16 11:46:03 wab2 kernel: [ 376.783299] ESI: 00000001 EDI: df9ca408 EBP:
00000000 ESP: de6cded4
Nov 16 11:46:03 wab2 kernel: [ 376.783299] DS: 007b ES: 007b FS: 00d8 GS: 00e0
SS: 0068
Nov 16 11:46:03 wab2 kernel: [ 376.783299] Process ocfs2rec (pid: 2186,
ti=de6cc000 task=ddfdc880 task.ti=de6cc000)
Nov 16 11:46:03 wab2 kernel: [ 376.783299] Stack:
Nov 16 11:46:03 wab2 kernel: [ 376.783299] ddfdc880 ddfdc880 ddca089c 00000006
00000001 ddca0800 df9ca408 df9ca400
Nov 16 11:46:03 wab2 kernel: [ 376.783299] <0> 00000002 c1c08138 c1025617
ddfdc880 df88fb80 c1001f10 c1c05e20 00000000
Nov 16 11:46:03 wab2 kernel: [ 376.783299] <0> df88fbb4 df88fbac c1c08138
c1c08100 df88fb80 df88fbac df88fbac 007eb000
Nov 16 11:46:03 wab2 kernel: [ 376.783299] Call Trace:
Nov 16 11:46:03 wab2 kernel: [ 376.783299] [<c1025617>] ?
dequeue_entity+0x15/0x14c
Nov 16 11:46:03 wab2 WAB(root)[1184]: OK
Nov 16 11:46:03 wab2 kernel: [ 376.783299] [<c1001f10>] ?
__switch_to+0xcf/0x141
Nov 16 11:46:03 wab2 kernel: [ 376.783299] [<c102b636>] ?
finish_task_switch+0x34/0x95
Nov 16 11:46:03 wab2 kernel: [ 376.783299] [<c126d68e>] ? schedule+0x78f/0x7dc
Nov 16 11:46:03 wab2 kernel: [ 376.783299] [<c102d4f4>] ?
try_to_wake_up+0x2a7/0x2b3
Nov 16 11:46:03 wab2 kernel: [ 376.783299] [<c10207c5>] ?
__wake_up_common+0x34/0x59
Nov 16 11:46:03 wab2 kernel: [ 376.783299] [<e15cc0cb>] ?
__ocfs2_recovery_thread+0x0/0x146d [ocfs2]
Nov 16 11:46:03 wab2 kernel: [ 376.783299] [<c1043dfc>] ? kthread+0x61/0x66
Nov 16 11:46:03 wab2 kernel: [ 376.783299] [<c1043d9b>] ? kthread+0x0/0x66
Nov 16 11:46:03 wab2 kernel: [ 376.783299] [<c1003d47>] ?
kernel_thread_helper+0x7/0x10
Nov 16 11:46:03 wab2 kernel: [ 376.783299] Code: 00 00 68 24 a7 60 e1 50 ff b2
2c 01 00 00 68 49 37 61 e1 e8 22 09 ca df 83 c4 20 8b 5c 24 14 8b 44 24 0c 39
83 bc 00 00 00 75 04 <0f> 0b eb fe 8d 84 24 d0 00 00 00 c7 84 24 d0 00 00 00 00
00 00
Nov 16 11:46:03 wab2 kernel: [ 376.783299] EIP: [<e15cc47a>]
__ocfs2_recovery_thread+0x3af/0x146d [ocfs2] SS:ESP 0068:de6cded4
Nov 16 11:46:03 wab2 kernel: [ 376.828911] ---[ end trace 06d533c2f6318b49 ]---
