[openib-general] Re: sdp with kernel 2.6.16.14

amit byron amit_byron at yahoo.com
Mon May 15 14:03:09 PDT 2006 

Michael,

netperf works with sdp.

slabinfo output:
slabinfo - version: 2.1 (statistics)
# name            <active_objs> <num_objs> <objsize> <objperslab> <pagesperslab> : tunables <limit> <batchcount> <sharedfactor> : slabdata <active_slabs> <num_slabs> <sharedavail> : globalstat <listallocs> <maxobjs> <grown> <reaped> <error> <maxfreeable> <nodeallocs> <remotefrees> : cpustat <allochit> <allocmiss> <freehit> <freemiss>
SDP                    0      0   1172    6    2 : tunables   24   12    8 : slabdata      0      0      0 : globalstat     104     18    11   11               0    0    0    0 : cpustat      3     17     20      0
fib6_nodes             7     92     40   92    1 : tunables   32   16    8 : slabdata      1      1      0 : globalstat      32     21     1    0               0    0    0    0 : cpustat      5      2      0      0
ip6_dst_cache          9     17    228   17    1 : tunables   32   16    8 : slabdata      1      1      0 : globalstat      36     17     1    0               0    0    0    0 : cpustat     14      3      8      0
ndisc_cache            2     22    180   22    1 : tunables   32   16    8 : slabdata      1      1      0 : globalstat      32     17     1    0               0    0    0    0 : cpustat      3      2      3      0
RAWv6                  7     11    712   11    2 : tunables   32   16    8 : slabdata      1      1      0 : globalstat      11     11     1    0               0    0    0    0 : cpustat      6      1      0      0
UDPv6                  1     11    684   11    2 : tunables   32   16    8 : slabdata      1      1      0 : globalstat      52     22     2    1               0    0    0    0 : cpustat     10      5     14      0

Amit

"Michael S. Tsirkin" <mst at mellanox.co.il> wrote: Quoting r. amit byron :
> Subject: sdp with kernel 2.6.16.14
> 
> 
> hi,
> 
> i'm trying to get sdp work between point-to-point connected
> machines running kernel 2.6.16.24. i have configured ipoib
> and trying to run iperf using sdp.
> 
> the client machine has an entry in its libsdp.conf:
> match destination 192.168.1.2
> 
> the server machine has na entry in its libsdp.conf:
> match listen *:5001
> 
> iperf is started on the server machine using command:
> LD_PRELOAD=/usr/local/lib/libsdp.so  iperf -s
> 
> iperf client is started on the client machine using command:
> LD_PRELOAD=/usr/local/lib/libsdp.so  iperf -c 192.168.1.2
> 
> the server machine panics with following messages:
> 
> oom-killer: gfp_mask=0xd0, order=0
>  [] oom-killer: gfp_mask=0xd0, order=0
>  [] out_of_memory+0x155/0x180
>  [] __alloc_pages+0x2a5/0x320
>  [] __get_free_pages+0x1e/0x40
>  [] __pollwait+0x80/0xd0
>  [] pipe_poll+0xcd/0xe0
>  [] do_select+0x212/0x480
>  [] cache_free_debugcheck+0x135/0x230
>  [] __pollwait+0x0/0xd0
>  [] core_sys_select+0x1ce/0x2e0
>  [] sys_select+0x51/0x1c0
>  [] sysenter_past_esp+0x54/0x75
> DMA per-cpu:
> cpu 0 hot: high 0, batch 1 used:0
> cpu 0 cold: high 0, batch 1 used:0
> cpu 1 hot: high 0, batch 1 used:0
> cpu 1 cold: high 0, batch 1 used:0
> cpu 2 hot: high 0, batch 1 used:0
> cpu 2 cold: high 0, batch 1 used:0
> cpu 3 hot: high 0, batch 1 used:0
> cpu 3 cold: high 0, batch 1 used:0
> DMA32 per-cpu: empty
> Normal per-cpu:
> cpu 0 hot: high 186, batch 31 used:103
> cpu 0 cold: high 62, batch 15 used:61
> cpu 1 hot: high 186, batch 31 used:183
> cpu 1 cold: high 62, batch 15 used:53
> cpu 2 hot: high 186, batch 31 used:28
> cpu 2 cold: high 62, batch 15 used:54
> cpu 3 hot: high 186, batch 31 used:63
> cpu 3 cold: high 62, batch 15 used:60
> HighMem per-cpu:
> cpu 0 hot: high 186, batch 31 used:176
> cpu 0 cold: high 62, batch 15 used:13
> cpu 1 hot: high 186, batch 31 used:169
> cpu 1 cold: high 62, batch 15 used:1
> cpu 2 hot: high 186, batch 31 used:157
> cpu 2 cold: high 62, batch 15 used:0
> cpu 3 hot: high 186, batch 31 used:174
> cpu 3 cold: high 62, batch 15 used:6
> Free pages:     7366104kB (7358760kB HighMem)
> Active:5351 inactive:4885 dirty:0 writeback:0 unstable:0 free:1841526 slab:8970 mapped:4565 pagetables:238
> DMA free:3588kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:8 all_unreclaimable? yes
> lowmem_reserve[]: 0 0 880 8623
> DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
> lowmem_reserve[]: 0 0 880 8623
> Normal free:3756kB min:3756kB low:4692kB high:5632kB active:232kB inactive:0kB present:901
> 120kB pages_scanned:314 all_unreclaimable? yes
> lowmem_reserve[]: 0 0 0 61951
> HighMem free:7358760kB min:512kB low:8780kB high:17052kB active:21172kB inactive:19540kB present:7929852kB pages_scanned:0 all_unreclaimable? no
> lowmem_reserve[]: 0 0 0 0
> DMA: 1*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3588kB
> DMA32: empty
> Normal: 13*4kB 1*8kB 1*16kB 3*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3756kB
> HighMem: 1672*4kB 1103*8kB 581*16kB 308*32kB 129*64kB 65*128kB 29*256kB 12*512kB 7*1024kB 2*2048kB 1778*4096kB = 7358760kB
> Swap cache: add 0, delete 0, find 0/0, race 0+0
> Free swap  = 0kB
> Total swap = 0kB
> Out of Memory: Kill process 2037 (mDNSResponder) score 2847 and children.
> Out of memory: Killed process 2037 (mDNSResponder).
> oom-killer: gfp_mask=0xd0, order=0
>  [] out_of_memory+0x155/0x180
>  [] __alloc_pages+0x2a5/0x320
>  [] __get_free_pages+0x1e/0x40
>  [] __pollwait+0x80/0xd0
>  [] pipe_poll+0xcd/0xe0
>  [] do_select+0x212/0x480
>  [] cache_free_debugcheck+0x135/0x230
>  [] __pollwait+0x0/0xd0
>  [] core_sys_select+0x1ce/0x2e0
>  [] sys_select+0x51/0x1c0
>  [] sysenter_past_esp+0x54/0x75
> DMA per-cpu:
> cpu 0 hot: high 0, batch 1 used:0
> cpu 0 cold: high 0, batch 1 used:0
> cpu 1 hot: high 0, batch 1 used:0
> cpu 1 cold: high 0, batch 1 used:0
> cpu 2 hot: high 0, batch 1 used:0
> cpu 2 cold: high 0, batch 1 used:0
> cpu 3 hot: high 0, batch 1 used:0
> cpu 3 cold: high 0, batch 1 used:0
> DMA32 per-cpu: empty
> Normal per-cpu:
> cpu 0 hot: high 186, batch 31 used:103
> cpu 0 cold: high 62, batch 15 used:61
> cpu 1 hot: high 186, batch 31 used:183
> cpu 1 cold: high 62, batch 15 used:53
> cpu 2 hot: high 186, batch 31 used:29
> cpu 2 cold: high 62, batch 15 used:54
> cpu 3 hot: high 186, batch 31 used:63
> cpu 3 cold: high 62, batch 15 used:60
> HighMem per-cpu:
> cpu 0 hot: high 186, batch 31 used:176
> cpu 0 cold: high 62, batch 15 used:13
> cpu 1 hot: high 186, batch 31 used:169
> cpu 1 cold: high 62, batch 15 used:1
> cpu 2 hot: high 186, batch 31 used:179
> cpu 2 cold: high 62, batch 15 used:0
> cpu 3 hot: high 186, batch 31 used:174
> cpu 3 cold: high 62, batch 15 used:6
> Free pages:     7366476kB (7359132kB HighMem)
> Active:5273 inactive:4855 dirty:0 writeback:0 unstable:0 free:1841619 slab:8970 mapped:4423 pagetables:232
> DMA free:3588kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:8 all_unreclaimable? yes
> lowmem_reserve[]: 0 0 880 8623
> DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
> lowmem_reserve[]: 0 0 880 8623
> Normal free:3756kB min:3756kB low:4692kB high:5632kB active:232kB inactive:0kB present:901120kB pages_scanned:314 all_unreclaimable? yes
> lowmem_reserve[]: 0 0 0 61951
> HighMem free:7359132kB min:512kB low:8780kB high:17052kB active:20860kB inactive:19420kB present:7929852kB pages_scanned:0 all_unreclaimable? no
> lowmem_reserve[]: 0 0 0 0
> DMA: 1*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3588kB
> DMA32: empty
> Normal: 13*4kB 1*8kB 1*16kB 3*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3756kB
> HighMem: 1621*4kB 1073*8kB 562*16kB 303*32kB 137*64kB 69*128kB 30*256kB 12*512kB 7*1024kB 2*2048kB 1778*4096kB = 7359132kB
> Swap cache: add 0, delete 0, find 0/0, race 0+0
> Free swap  = 0kB
> Total swap = 0kB
> Out of Memory: Kill process 2134 (sendmail) score 1741 and children.
> Out of memory: Killed process 2134 (sendmail).
> oom-killer: gfp_mask=0xd0, order=0
>  [] out_of_memory+0x155/0x180
>  [] __alloc_pages+0x2a5/0x320
>  [] __get_free_pages+0x1e/0x40
>  [] __pollwait+0x80/0xd0
>  [] pipe_poll+0xcd/0xe0
>  [] do_select+0x212/0x480
>  [] cache_free_debugcheck+0x135/0x230
>  [] __pollwait+0x0/0xd0
>  [] core_sys_select+0x1ce/0x2e0
>  [] sys_select+0x51/0x1c0
>  [] sysenter_past_esp+0x54/0x75
> 
> openib source were retrieved with:
> svn co https://openib.org/svn/gen2/trunk
> 
> anybody ran into similar problem, are there any sdp
> patches available?
> 
> thanks,
> Amit

Netperf is running here fine. Can you try that to verify its not
a setup problem? I'll try iperf later.
Hmm. Where did all the memory go? can you
cat /proc/slabinfo

-- 
MST


__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20060515/cc8aae13/attachment.html>

More information about the general mailing list