[openib-general] Re: sdp with kernel 2.6.16.14
Michael S. Tsirkin
mst at mellanox.co.il
Tue May 16 08:08:55 PDT 2006
Quoting r. amit byron <amit_byron at yahoo.com>:
> Subject: Re: sdp with kernel 2.6.16.14
>
>
> Michael,
>
> netperf works with sdp.
>
> slabinfo output:
> slabinfo - version: 2.1 (statistics)
> # name <active_objs> <num_objs> <objsize> <objperslab> <pagesperslab> : tunables <limit> <batchcount> <sharedfactor> : slabdata <active_slabs> <num_slabs> <sharedavail> : globalstat <listallocs> <maxobjs> <grown> <reaped> <error> <maxfreeable> <nodeallocs> <remotefrees> : cpustat <allochit> <allocmiss> <freehit> <freemiss>
> SDP 0 0 1172 6 2 : tunables 24 12 8 : slabdata 0 0 0 : globalstat 104 18 11 11 0 0 0 0 : cpustat 3 17 20 0
> fib6_nodes 7 92 40 92 1 : tunables 32 16 8 : slabdata 1 1 0 : globalstat 32 21 1 0 0 0 0 0 : cpustat 5 2 0 0
> ip6_dst_cache 9 17 228 17 1 : tunables 32 16 8 : slabdata 1 1 0 : globalstat 36 17 1 0 0 0 0 0 : cpustat 14 3 8 0
> ndisc_cache 2 22 180 22 1 : tunables 32 16 8 : slabdata 1 1 0 : globalstat 32 17 1 0 0 0 0 0 : cpustat 3 2 3 0
> RAWv6 7 11 712 11 2 : tunables 32 16 8 : slabdata 1 1 0 : globalstat 11 11 1 0 0 0 0 0 : cpustat 6 1 0 0
> UDPv6 1 11 684 11 2 : tunables 32 16 8 : slabdata 1 1 0 : globalstat 52 22 2 1 0 0 0 0 : cpustat 10 5 14 0
>
> Amit
>
> "Michael S. Tsirkin" <mst at mellanox.co.il> wrote:
>
> Quoting r. amit byron :
> > Subject: sdp with kernel 2.6.16.14
> >
> >
> > hi,
> >
> > i'm trying to get sdp work between point-to-point connected
> > machines running kernel 2.6.16.24. i have configured ipoib
> > and trying to run iperf using sdp.
> >
> > the client machine has an entry in its libsdp.conf:
> > match destination 192.168.1.2
> >
> > the server machine has na entry in its libsdp.conf:
> > match listen *:5001
> >
> > iperf is started on the server machine using command:
> > LD_PRELOAD=/usr/local/lib/libsdp.so iperf -s
> >
> > iperf client is started on the client machine using command:
> > LD_PRELOAD=/usr/local/lib/libsdp.so iperf -c 192.168.1.2
> >
> > the server machine panics with following messages:
> >
> > oom-killer: gfp_mask=0xd0, order=0
> > [] oom-killer: gfp_mask=0xd0, order=0
> > [] out_of_memory+0x155/0x180
> > [] __alloc_pages+0x2a5/0x320
> > [] __get_free_pages+0x1e/0x40
> > [] __pollwait+0x80/0xd0
> > [] pipe_poll+0xcd/0xe0
> > [] do_select+0x212/0x480
> > [] cache_free_debugcheck+0x135/0x230
> > [] __pollwait+0x0/0xd0
> > [] core_sys_select+0x1ce/0x2e0
> > [] sys_select+0x51/0x1c0
> > [] sysenter_past_esp+0x54/0x75
> > DMA per-cpu:
> > cpu 0 hot: high 0, batch 1 used:0
> > cpu 0 cold: high 0, batch 1 used:0
> > cpu 1 hot: high 0, batch 1 used:0
> > cpu 1 cold: high 0, batch 1 used:0
> > cpu 2 hot: high 0, batch 1 used:0
> > cpu 2 cold: high 0, batch 1 used:0
> > cpu 3 hot: high 0, batch 1 used:0
> > cpu 3 cold: high 0, batch 1 used:0
> > DMA32 per-cpu: empty
> > Normal per-cpu:
> > cpu 0 hot: high 186, batch 31 used:103
> > cpu 0 cold: high 62, batch 15 used:61
> > cpu 1 hot: high 186, batch 31 used:183
> > cpu 1 cold: high 62, batch 15 used:53
> > cpu 2 hot: high 186, batch 31 used:28
> > cpu 2 cold: high 62, batch 15 used:54
> > cpu 3 hot: high 186, batch 31 used:63
> > cpu 3 cold: high 62, batch 15 used:60
> > HighMem per-cpu:
> > cpu 0 hot: high 186, batch 31 used:176
> > cpu 0 cold: high 62, batch 15 used:13
> > cpu 1 hot: high 186, batch 31 used:169
> > cpu 1 cold: high 62, batch 15 used:1
> > cpu 2 hot: high 186, batch 31 used:157
> > cpu 2 cold: high 62, batch 15 used:0
> > cpu 3 hot: high 186, batch 31 used:174
> > cpu 3 cold: high 62, batch 15 used:6
> > Free pages: 7366104kB (7358760kB HighMem)
> > Active:5351 inactive:4885 dirty:0 writeback:0 unstable:0 free:1841526 slab:8970 mapped:4565 pagetables:238
> > DMA free:3588kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:8 all_unreclaimable? yes
> > lowmem_reserve[]: 0 0 880 8623
> > DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
> > lowmem_reserve[]: 0 0 880 8623
> > Normal free:3756kB min:3756kB low:4692kB high:5632kB active:232kB inactive:0kB present:901
> > 120kB pages_scanned:314 all_unreclaimable? yes
> > lowmem_reserve[]: 0 0 0 61951
> > HighMem free:7358760kB min:512kB low:8780kB high:17052kB active:21172kB inactive:19540kB present:7929852kB pages_scanned:0 all_unreclaimable? no
> > lowmem_reserve[]: 0 0 0 0
> > DMA: 1*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3588kB
> > DMA32: empty
> > Normal: 13*4kB 1*8kB 1*16kB 3*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3756kB
> > HighMem: 1672*4kB 1103*8kB 581*16kB 308*32kB 129*64kB 65*128kB 29*256kB 12*512kB 7*1024kB 2*2048kB 1778*4096kB = 7358760kB
> > Swap cache: add 0, delete 0, find 0/0, race 0+0
> > Free swap = 0kB
> > Total swap = 0kB
> > Out of Memory: Kill process 2037 (mDNSResponder) score 2847 and children.
> > Out of memory: Killed process 2037 (mDNSResponder).
> > oom-killer: gfp_mask=0xd0, order=0
> > [] out_of_memory+0x155/0x180
> > [] __alloc_pages+0x2a5/0x320
> > [] __get_free_pages+0x1e/0x40
> > [] __pollwait+0x80/0xd0
> > [] pipe_poll+0xcd/0xe0
> > [] do_select+0x212/0x480
> > [] cache_free_debugcheck+0x135/0x230
> > [] __pollwait+0x0/0xd0
> > [] core_sys_select+0x1ce/0x2e0
> > [] sys_select+0x51/0x1c0
> > [] sysenter_past_esp+0x54/0x75
> > DMA per-cpu:
> > cpu 0 hot: high 0, batch 1 used:0
> > cpu 0 cold: high 0, batch 1 used:0
> > cpu 1 hot: high 0, batch 1 used:0
> > cpu 1 cold: high 0, batch 1 used:0
> > cpu 2 hot: high 0, batch 1 used:0
> > cpu 2 cold: high 0, batch 1 used:0
> > cpu 3 hot: high 0, batch 1 used:0
> > cpu 3 cold: high 0, batch 1 used:0
> > DMA32 per-cpu: empty
> > Normal per-cpu:
> > cpu 0 hot: high 186, batch 31 used:103
> > cpu 0 cold: high 62, batch 15 used:61
> > cpu 1 hot: high 186, batch 31 used:183
> > cpu 1 cold: high 62, batch 15 used:53
> > cpu 2 hot: high 186, batch 31 used:29
> > cpu 2 cold: high 62, batch 15 used:54
> > cpu 3 hot: high 186, batch 31 used:63
> > cpu 3 cold: high 62, batch 15 used:60
> > HighMem per-cpu:
> > cpu 0 hot: high 186, batch 31 used:176
> > cpu 0 cold: high 62, batch 15 used:13
> > cpu 1 hot: high 186, batch 31 used:169
> > cpu 1 cold: high 62, batch 15 used:1
> > cpu 2 hot: high 186, batch 31 used:179
> > cpu 2 cold: high 62, batch 15 used:0
> > cpu 3 hot: high 186, batch 31 used:174
> > cpu 3 cold: high 62, batch 15 used:6
> > Free pages: 7366476kB (7359132kB HighMem)
> > Active:5273 inactive:4855 dirty:0 writeback:0 unstable:0 free:1841619 slab:8970 mapped:4423 pagetables:232
> > DMA free:3588kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:8 all_unreclaimable? yes
> > lowmem_reserve[]: 0 0 880 8623
> > DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
> > lowmem_reserve[]: 0 0 880 8623
> > Normal free:3756kB min:3756kB low:4692kB high:5632kB active:232kB inactive:0kB present:901120kB pages_scanned:314 all_unreclaimable? yes
> > lowmem_reserve[]: 0 0 0 61951
> > HighMem free:7359132kB min:512kB low:8780kB high:17052kB active:20860kB inactive:19420kB present:7929852kB pages_scanned:0 all_unreclaimable? no
> > lowmem_reserve[]: 0 0 0 0
> > DMA: 1*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3588kB
> > DMA32: empty
> > Normal: 13*4kB 1*8kB 1*16kB 3*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3756kB
> > HighMem: 1621*4kB 1073*8kB 562*16kB 303*32kB 137*64kB 69*128kB 30*256kB 12*512kB 7*1024kB 2*2048kB 1778*4096kB = 7359132kB
> > Swap cache: add 0, delete 0, find 0/0, race 0+0
> > Free swap = 0kB
> > Total swap = 0kB
> > Out of Memory: Kill process 2134 (sendmail) score 1741 and children.
> > Out of memory: Killed process 2134 (sendmail).
> > oom-killer: gfp_mask=0xd0, order=0
> > [] out_of_memory+0x155/0x180
> > [] __alloc_pages+0x2a5/0x320
> > [] __get_free_pages+0x1e/0x40
> > [] __pollwait+0x80/0xd0
> > [] pipe_poll+0xcd/0xe0
> > [] do_select+0x212/0x480
> > [] cache_free_debugcheck+0x135/0x230
> > [] __pollwait+0x0/0xd0
> > [] core_sys_select+0x1ce/0x2e0
> > [] sys_select+0x51/0x1c0
> > [] sysenter_past_esp+0x54/0x75
> >
> > openib source were retrieved with:
> > svn co https://openib.org/svn/gen2/trunk
> >
> > anybody ran into similar problem, are there any sdp
> > patches available?
> >
> > thanks,
> > Amit
>
> Netperf is running here fine. Can you try that to verify its not
> a setup problem? I'll try iperf later.
> Hmm. Where did all the memory go? can you
> cat /proc/slabinfo
>
> --
> MST
OK, I think I see a problem. Stay tuned for a patch.
--
MST
More information about the general
mailing list