Quoting r. amit byron <[EMAIL PROTECTED]>: > Subject: Re: sdp with kernel 2.6.16.14 > > > Michael, > > netperf works with sdp. > > slabinfo output: > slabinfo - version: 2.1 (statistics) > # name <active_objs> <num_objs> <objsize> <objperslab> > <pagesperslab> : tunables <limit> <batchcount> <sharedfactor> : slabdata > <active_slabs> <num_slabs> <sharedavail> : globalstat <listallocs> <maxobjs> > <grown> <reaped> <error> <maxfreeable> <nodeallocs> <remotefrees> : cpustat > <allochit> <allocmiss> <freehit> <freemiss> > SDP 0 0 1172 6 2 : tunables 24 12 8 : > slabdata 0 0 0 : globalstat 104 18 11 11 > 0 0 0 0 : cpustat 3 17 20 0 > fib6_nodes 7 92 40 92 1 : tunables 32 16 8 : > slabdata 1 1 0 : globalstat 32 21 1 0 > 0 0 0 0 : cpustat 5 2 0 0 > ip6_dst_cache 9 17 228 17 1 : tunables 32 16 8 : > slabdata 1 1 0 : globalstat 36 17 1 0 > 0 0 0 0 : cpustat 14 3 8 0 > ndisc_cache 2 22 180 22 1 : tunables 32 16 8 : > slabdata 1 1 0 : globalstat 32 17 1 0 > 0 0 0 0 : cpustat 3 2 3 0 > RAWv6 7 11 712 11 2 : tunables 32 16 8 : > slabdata 1 1 0 : globalstat 11 11 1 0 > 0 0 0 0 : cpustat 6 1 0 0 > UDPv6 1 11 684 11 2 : tunables 32 16 8 : > slabdata 1 1 0 : globalstat 52 22 2 1 > 0 0 0 0 : cpustat 10 5 14 0 > > Amit > > "Michael S. Tsirkin" <[EMAIL PROTECTED]> wrote: > > Quoting r. amit byron : > > Subject: sdp with kernel 2.6.16.14 > > > > > > hi, > > > > i'm trying to get sdp work between point-to-point connected > > machines running kernel 2.6.16.24. i have configured ipoib > > and trying to run iperf using sdp. > > > > the client machine has an entry in its libsdp.conf: > > match destination 192.168.1.2 > > > > the server machine has na entry in its libsdp.conf: > > match listen *:5001 > > > > iperf is started on the server machine using command: > > LD_PRELOAD=/usr/local/lib/libsdp.so iperf -s > > > > iperf client is started on the client machine using command: > > LD_PRELOAD=/usr/local/lib/libsdp.so iperf -c 192.168.1.2 > > > > the server machine panics with following messages: > > > > oom-killer: gfp_mask=0xd0, order=0 > > [] oom-killer: gfp_mask=0xd0, order=0 > > [] out_of_memory+0x155/0x180 > > [] __alloc_pages+0x2a5/0x320 > > [] __get_free_pages+0x1e/0x40 > > [] __pollwait+0x80/0xd0 > > [] pipe_poll+0xcd/0xe0 > > [] do_select+0x212/0x480 > > [] cache_free_debugcheck+0x135/0x230 > > [] __pollwait+0x0/0xd0 > > [] core_sys_select+0x1ce/0x2e0 > > [] sys_select+0x51/0x1c0 > > [] sysenter_past_esp+0x54/0x75 > > DMA per-cpu: > > cpu 0 hot: high 0, batch 1 used:0 > > cpu 0 cold: high 0, batch 1 used:0 > > cpu 1 hot: high 0, batch 1 used:0 > > cpu 1 cold: high 0, batch 1 used:0 > > cpu 2 hot: high 0, batch 1 used:0 > > cpu 2 cold: high 0, batch 1 used:0 > > cpu 3 hot: high 0, batch 1 used:0 > > cpu 3 cold: high 0, batch 1 used:0 > > DMA32 per-cpu: empty > > Normal per-cpu: > > cpu 0 hot: high 186, batch 31 used:103 > > cpu 0 cold: high 62, batch 15 used:61 > > cpu 1 hot: high 186, batch 31 used:183 > > cpu 1 cold: high 62, batch 15 used:53 > > cpu 2 hot: high 186, batch 31 used:28 > > cpu 2 cold: high 62, batch 15 used:54 > > cpu 3 hot: high 186, batch 31 used:63 > > cpu 3 cold: high 62, batch 15 used:60 > > HighMem per-cpu: > > cpu 0 hot: high 186, batch 31 used:176 > > cpu 0 cold: high 62, batch 15 used:13 > > cpu 1 hot: high 186, batch 31 used:169 > > cpu 1 cold: high 62, batch 15 used:1 > > cpu 2 hot: high 186, batch 31 used:157 > > cpu 2 cold: high 62, batch 15 used:0 > > cpu 3 hot: high 186, batch 31 used:174 > > cpu 3 cold: high 62, batch 15 used:6 > > Free pages: 7366104kB (7358760kB HighMem) > > Active:5351 inactive:4885 dirty:0 writeback:0 unstable:0 free:1841526 > slab:8970 mapped:4565 pagetables:238 > > DMA free:3588kB min:68kB low:84kB high:100kB active:0kB inactive:0kB > present:16384kB pages_scanned:8 all_unreclaimable? yes > > lowmem_reserve[]: 0 0 880 8623 > > DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB > present:0kB pages_scanned:0 all_unreclaimable? no > > lowmem_reserve[]: 0 0 880 8623 > > Normal free:3756kB min:3756kB low:4692kB high:5632kB active:232kB > inactive:0kB present:901 > > 120kB pages_scanned:314 all_unreclaimable? yes > > lowmem_reserve[]: 0 0 0 61951 > > HighMem free:7358760kB min:512kB low:8780kB high:17052kB active:21172kB > inactive:19540kB present:7929852kB pages_scanned:0 all_unreclaimable? no > > lowmem_reserve[]: 0 0 0 0 > > DMA: 1*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB > 1*2048kB 0*4096kB = 3588kB > > DMA32: empty > > Normal: 13*4kB 1*8kB 1*16kB 3*32kB 0*64kB 0*128kB 0*256kB 1*512kB > 1*1024kB 1*2048kB 0*4096kB = 3756kB > > HighMem: 1672*4kB 1103*8kB 581*16kB 308*32kB 129*64kB 65*128kB 29*256kB > 12*512kB 7*1024kB 2*2048kB 1778*4096kB = 7358760kB > > Swap cache: add 0, delete 0, find 0/0, race 0+0 > > Free swap = 0kB > > Total swap = 0kB > > Out of Memory: Kill process 2037 (mDNSResponder) score 2847 and > children. > > Out of memory: Killed process 2037 (mDNSResponder). > > oom-killer: gfp_mask=0xd0, order=0 > > [] out_of_memory+0x155/0x180 > > [] __alloc_pages+0x2a5/0x320 > > [] __get_free_pages+0x1e/0x40 > > [] __pollwait+0x80/0xd0 > > [] pipe_poll+0xcd/0xe0 > > [] do_select+0x212/0x480 > > [] cache_free_debugcheck+0x135/0x230 > > [] __pollwait+0x0/0xd0 > > [] core_sys_select+0x1ce/0x2e0 > > [] sys_select+0x51/0x1c0 > > [] sysenter_past_esp+0x54/0x75 > > DMA per-cpu: > > cpu 0 hot: high 0, batch 1 used:0 > > cpu 0 cold: high 0, batch 1 used:0 > > cpu 1 hot: high 0, batch 1 used:0 > > cpu 1 cold: high 0, batch 1 used:0 > > cpu 2 hot: high 0, batch 1 used:0 > > cpu 2 cold: high 0, batch 1 used:0 > > cpu 3 hot: high 0, batch 1 used:0 > > cpu 3 cold: high 0, batch 1 used:0 > > DMA32 per-cpu: empty > > Normal per-cpu: > > cpu 0 hot: high 186, batch 31 used:103 > > cpu 0 cold: high 62, batch 15 used:61 > > cpu 1 hot: high 186, batch 31 used:183 > > cpu 1 cold: high 62, batch 15 used:53 > > cpu 2 hot: high 186, batch 31 used:29 > > cpu 2 cold: high 62, batch 15 used:54 > > cpu 3 hot: high 186, batch 31 used:63 > > cpu 3 cold: high 62, batch 15 used:60 > > HighMem per-cpu: > > cpu 0 hot: high 186, batch 31 used:176 > > cpu 0 cold: high 62, batch 15 used:13 > > cpu 1 hot: high 186, batch 31 used:169 > > cpu 1 cold: high 62, batch 15 used:1 > > cpu 2 hot: high 186, batch 31 used:179 > > cpu 2 cold: high 62, batch 15 used:0 > > cpu 3 hot: high 186, batch 31 used:174 > > cpu 3 cold: high 62, batch 15 used:6 > > Free pages: 7366476kB (7359132kB HighMem) > > Active:5273 inactive:4855 dirty:0 writeback:0 unstable:0 free:1841619 > slab:8970 mapped:4423 pagetables:232 > > DMA free:3588kB min:68kB low:84kB high:100kB active:0kB inactive:0kB > present:16384kB pages_scanned:8 all_unreclaimable? yes > > lowmem_reserve[]: 0 0 880 8623 > > DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB > present:0kB pages_scanned:0 all_unreclaimable? no > > lowmem_reserve[]: 0 0 880 8623 > > Normal free:3756kB min:3756kB low:4692kB high:5632kB active:232kB > inactive:0kB present:901120kB pages_scanned:314 all_unreclaimable? yes > > lowmem_reserve[]: 0 0 0 61951 > > HighMem free:7359132kB min:512kB low:8780kB high:17052kB active:20860kB > inactive:19420kB present:7929852kB pages_scanned:0 all_unreclaimable? no > > lowmem_reserve[]: 0 0 0 0 > > DMA: 1*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB > 1*2048kB 0*4096kB = 3588kB > > DMA32: empty > > Normal: 13*4kB 1*8kB 1*16kB 3*32kB 0*64kB 0*128kB 0*256kB 1*512kB > 1*1024kB 1*2048kB 0*4096kB = 3756kB > > HighMem: 1621*4kB 1073*8kB 562*16kB 303*32kB 137*64kB 69*128kB 30*256kB > 12*512kB 7*1024kB 2*2048kB 1778*4096kB = 7359132kB > > Swap cache: add 0, delete 0, find 0/0, race 0+0 > > Free swap = 0kB > > Total swap = 0kB > > Out of Memory: Kill process 2134 (sendmail) score 1741 and children. > > Out of memory: Killed process 2134 (sendmail). > > oom-killer: gfp_mask=0xd0, order=0 > > [] out_of_memory+0x155/0x180 > > [] __alloc_pages+0x2a5/0x320 > > [] __get_free_pages+0x1e/0x40 > > [] __pollwait+0x80/0xd0 > > [] pipe_poll+0xcd/0xe0 > > [] do_select+0x212/0x480 > > [] cache_free_debugcheck+0x135/0x230 > > [] __pollwait+0x0/0xd0 > > [] core_sys_select+0x1ce/0x2e0 > > [] sys_select+0x51/0x1c0 > > [] sysenter_past_esp+0x54/0x75 > > > > openib source were retrieved with: > > svn co https://openib.org/svn/gen2/trunk > > > > anybody ran into similar problem, are there any sdp > > patches available? > > > > thanks, > > Amit > > Netperf is running here fine. Can you try that to verify its not > a setup problem? I'll try iperf later. > Hmm. Where did all the memory go? can you > cat /proc/slabinfo > > -- > MST
OK, I think I see a problem. Stay tuned for a patch. -- MST _______________________________________________ openib-general mailing list [email protected] http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
