On Fri, 7 Nov 2008, Jerker Nyberg wrote: > On Fri, 7 Nov 2008, Sage Weil wrote: > > Do you mean that 'rm' segfaulted, or one of the daemons segfaults, or the > > kernel oopsed? > > The command 'rm' segfaulted. I can still reboot the machine with the > command "/sbin/reboot -f -n". > > The file system, all of it it seems, can still be accessed from the other > nodes. On the node where the segfault appeared the directory /ceph (the > mount point) can be accessed but not the directory /ceph/tmp (into which I > was writing the files).
Ah, ok, makes sense. Can you describe the workload leading up to the rm a bit? Is it this something you can reproduce? I can see where it bugged, but that's unfortuantely a long way off from the root of the problem (which looks like a missing ref count on the dentry). thanks- sage > > When the segmentation fault appeared on the node I was launching the > commands from I got the output below. > > --jerker > > > > bash: line 1: 14100 Segmentation fault rm -f tmp.xp2 KNOPP.bench.xp2 > > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: ------------[ cut here ]------------ > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: invalid opcode: 0000 [#1] SMP Launching on xp7... > > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: Process rm (pid: 14100, ti=f715c000 task=f20544c0 > task.ti=f715c000) > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: Stack: c047946c f267742c c04794a8 f257d114 fffffffe c047a152 > f2687a6c c0473ce6 > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: f781eb00 f267742c 3eca6a0f 00000007 f7066000 00000010 > 00000000 00000000 Launching on > xp8... > > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: 0000000a 40000003 f71689b0 b7f2c4a0 00000000 f715cfb8 > 00000000 00000000 > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: Call Trace: > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: [<c047946c>] d_free+0x15/0x2e > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: [<c04794a8>] d_kill+0x23/0x32 > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: [<c047a152>] dput+0xb1/0xb8 > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: [<c0473ce6>] do_unlinkat+0xb3/0x136 > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: [<c0408e91>] do_syscall_trace+0x10e/0x152 > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: [<c040388e>] syscall_call+0x7/0xb > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: [<c0610000>] powernowk8_cpu_init+0x434/0xac5 > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: ======================= > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: Code: 01 00 89 c3 89 f8 e8 ca ed 00 00 5e eb 05 bb a1 ff ff ff > 83 c4 10 89 d8 5b 5e 5f 5d c3 90 90 b8 01 00 00 00 c3 83 78 54 00 74 04 > <0f> 0b eb fe c3 55 57 56 53 83 ec 18 89 54 24 04 89 0c 24 8b 50 > Message from syslogd@ at Fri Nov 7 21:11:17 2008 ... > xp2 kernel: EIP: [<f8b8d6ac>] ceph_dentry_release+0x6/0xb [ceph] SS:ESP > 0068:f715cf34bash: line 1: 8534 Segmentation fault rm -f tmp.xp5 > KNOPP.bench.xp5 > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Ceph-devel mailing list > Ceph-devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/ceph-devel > > ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Ceph-devel mailing list Ceph-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ceph-devel
