Hi all, After a long copying a large number of files, I get it from kernel:
kernel: ------------[ cut here ]------------ Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: invalid opcode: 0000 [#1] SMP Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: Process kswapd0 (pid: 160, ti=df8f1000 task=decbc000 task.ti=df8f1000) Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: Stack: df8f1ec0 c04909da df406330 df8f1ed0 c0490a35 df363c3c dba4a660 df8f1edc Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: c0490adb df363c3c df8f1ef8 c0490be3 00000000 00000067 ffffffff 00000064 Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: 000000a8 df8f1f04 c0490c3b c071f158 df8f1f38 c046a3b5 00000030 00000000 Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: Call Trace: Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: [<c04909da>] ? d_free+0x18/0x4d Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: [<c0490a35>] ? d_kill+0x26/0x36 Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: [<c0490adb>] ? prune_one_dentry+0x96/0xa9 Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: [<c0490be3>] ? prune_dcache+0xf5/0x137 Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: [<c0490c3b>] ? shrink_dcache_memory+0x16/0x34 Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: [<c046a3b5>] ? shrink_slab+0xda/0x134 Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: [<c046a730>] ? kswapd+0x321/0x423 Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: [<c0469413>] ? isolate_pages_global+0x0/0x3e Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: [<c0437b2b>] ? autoremove_wake_function+0x0/0x33 Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: [<c042059e>] ? complete+0x34/0x3e Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: [<c046a40f>] ? kswapd+0x0/0x423 Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: [<c04378c9>] ? kthread+0x3b/0x61 Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: [<c043788e>] ? kthread+0x0/0x61 Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: [<c0406823>] ? kernel_thread_helper+0x7/0x10 Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: ======================= Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: Code: eb 07 c7 45 c8 00 00 00 00 8b 45 c8 8d 65 f4 5b 5e 5f 5d c3 c7 45 c8 00 00 00 00 e9 a5 f3 ff ff 90 90 83 78 54 00 55 89 e5 74 04 <0f> 0b eb fe 5d c3 55 89 e5 57 56 53 89 c3 8b 40 18 8b 78 0c a1 Message from [EMAIL PROTECTED] at Aug 1 16:28:36 ... kernel: EIP: [<e0ac7e4d>] ceph_dentry_release+0x9/0xf [ceph] SS:ESP 0068:df8f1eb4 Probably it happened because disk space for MDS, ODSs and MON log files ended. I have no logs with debug information from this deamons, sorry. After it, I clean disk spase and restarted deamons, but OSDs not running: 080801.172323.838078 osd2 5 pg[2x0.33( empty ec=3 les=5 5/5/5) r=0 (log bound mismatch, actual=[5'1,5'87] len=87) pct 0'0] read_log 4928 5'88 m 10000004ef8.00000000 by client2.1:90428 080801.172324.419781 osd2 5 load_pgs loaded pg[2x0.33( empty ec=3 les=5 5/5/5) r=0 (log bound mismatch, actual=[5'1,5'88] len=88) pct 0'0] log(0'0,0'0] 080801.172324.426867 osd2 5 pg[2x1.12( empty ec=3 les=5 5/4/4) r=0 pct 0'0] read_log [0,0) 080801.172324.426887 osd2 5 load_pgs loaded pg[2x1.12( empty ec=3 les=5 5/4/4) r=1] log(0'0,0'0] 080801.172324.437768 osd2 5 pg[4x0.a1( empty ec=3 les=5 5/5/5) r=0 pct 0'0] read_log [0,0) 080801.172324.437788 osd2 5 load_pgs loaded pg[4x0.a1( empty ec=3 les=5 5/5/5) r=0 pct 0'0] log(0'0,0'0] 080801.172324.444511 osd2 5 pg[2x1.18( empty ec=3 les=5 5/4/4) r=0 pct 0'0] read_log [0,0) 080801.172324.444530 osd2 5 load_pgs loaded pg[2x1.18( empty ec=3 les=5 5/4/4) r=1] log(0'0,0'0] 080801.172324.453107 osd2 5 pg[2x1.19( empty ec=3 les=5 5/4/4) r=0 pct 0'0] read_log [0,0) 080801.172324.453126 osd2 5 load_pgs loaded pg[2x1.19( empty ec=3 les=5 5/4/4) r=1] log(0'0,0'0] 080801.172324.453444 osd2 5 pg[2x1.1d( empty ec=3 les=5 5/4/4) r=0 pct 0'0] read_log [0,0) 080801.172324.453464 osd2 5 load_pgs loaded pg[2x1.1d( empty ec=3 les=5 5/4/4) r=1] log(0'0,0'0] 080801.172324.453941 osd2 5 pg[3x1.7d( empty ec=3 les=5 5/5/5) r=0 pct 0'0] read_log [0,0) 080801.172324.453961 osd2 5 load_pgs loaded pg[3x1.7d( empty ec=3 les=5 5/5/5) r=0 pct 0'0] log(0'0,0'0] cosd: osd/PG.cc:1250: void PG::read_log(ObjectStore*): Assertion `r == sizeof(ondisklog.bottom)' failed. Cmon running successully and write to log: 080801.173300.365849 mon0(leader).osd e5 e5: 4 osds: 3 up, 3 in 080801.173300.365868 mon0(leader).mds e6 e6: 1 nodes: 1 up:replay 080801.173300.365891 mon0(leader).pg v2612 v2612: 2304 pgs: 2304 active+clean; 59 GB used, 835 GB / 894 GB free although all osds is down. -- John A. Khvatov. ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Ceph-devel mailing list Ceph-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ceph-devel