[openib-general] Re: sdp with kernel 2.6.16.14

Michael S. Tsirkin mst at mellanox.co.il
Mon May 15 13:41:47 PDT 2006 

Quoting r. amit byron <amit_byron at yahoo.com>:
> Subject: sdp with kernel 2.6.16.14
> 
> 
> hi,
> 
> i'm trying to get sdp work between point-to-point connected
> machines running kernel 2.6.16.24. i have configured ipoib
> and trying to run iperf using sdp.
> 
> the client machine has an entry in its libsdp.conf:
> match destination 192.168.1.2
> 
> the server machine has na entry in its libsdp.conf:
> match listen *:5001
> 
> iperf is started on the server machine using command:
> LD_PRELOAD=/usr/local/lib/libsdp.so  iperf -s
> 
> iperf client is started on the client machine using command:
> LD_PRELOAD=/usr/local/lib/libsdp.so  iperf -c 192.168.1.2
> 
> the server machine panics with following messages:
> 
> oom-killer: gfp_mask=0xd0, order=0
>  [<c014ed15>] oom-killer: gfp_mask=0xd0, order=0
>  [<c014ed15>] out_of_memory+0x155/0x180
>  [<c0150fa5>] __alloc_pages+0x2a5/0x320
>  [<c01512ce>] __get_free_pages+0x1e/0x40
>  [<c0181bd0>] __pollwait+0x80/0xd0
>  [<c017aa6d>] pipe_poll+0xcd/0xe0
>  [<c0181e32>] do_select+0x212/0x480
>  [<c0168e15>] cache_free_debugcheck+0x135/0x230
>  [<c0181b50>] __pollwait+0x0/0xd0
>  [<c01828ae>] core_sys_select+0x1ce/0x2e0
>  [<c0182d21>] sys_select+0x51/0x1c0
>  [<c0104173>] sysenter_past_esp+0x54/0x75
> DMA per-cpu:
> cpu 0 hot: high 0, batch 1 used:0
> cpu 0 cold: high 0, batch 1 used:0
> cpu 1 hot: high 0, batch 1 used:0
> cpu 1 cold: high 0, batch 1 used:0
> cpu 2 hot: high 0, batch 1 used:0
> cpu 2 cold: high 0, batch 1 used:0
> cpu 3 hot: high 0, batch 1 used:0
> cpu 3 cold: high 0, batch 1 used:0
> DMA32 per-cpu: empty
> Normal per-cpu:
> cpu 0 hot: high 186, batch 31 used:103
> cpu 0 cold: high 62, batch 15 used:61
> cpu 1 hot: high 186, batch 31 used:183
> cpu 1 cold: high 62, batch 15 used:53
> cpu 2 hot: high 186, batch 31 used:28
> cpu 2 cold: high 62, batch 15 used:54
> cpu 3 hot: high 186, batch 31 used:63
> cpu 3 cold: high 62, batch 15 used:60
> HighMem per-cpu:
> cpu 0 hot: high 186, batch 31 used:176
> cpu 0 cold: high 62, batch 15 used:13
> cpu 1 hot: high 186, batch 31 used:169
> cpu 1 cold: high 62, batch 15 used:1
> cpu 2 hot: high 186, batch 31 used:157
> cpu 2 cold: high 62, batch 15 used:0
> cpu 3 hot: high 186, batch 31 used:174
> cpu 3 cold: high 62, batch 15 used:6
> Free pages:     7366104kB (7358760kB HighMem)
> Active:5351 inactive:4885 dirty:0 writeback:0 unstable:0 free:1841526 slab:8970 mapped:4565 pagetables:238
> DMA free:3588kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:8 all_unreclaimable? yes
> lowmem_reserve[]: 0 0 880 8623
> DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
> lowmem_reserve[]: 0 0 880 8623
> Normal free:3756kB min:3756kB low:4692kB high:5632kB active:232kB inactive:0kB present:901
> 120kB pages_scanned:314 all_unreclaimable? yes
> lowmem_reserve[]: 0 0 0 61951
> HighMem free:7358760kB min:512kB low:8780kB high:17052kB active:21172kB inactive:19540kB present:7929852kB pages_scanned:0 all_unreclaimable? no
> lowmem_reserve[]: 0 0 0 0
> DMA: 1*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3588kB
> DMA32: empty
> Normal: 13*4kB 1*8kB 1*16kB 3*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3756kB
> HighMem: 1672*4kB 1103*8kB 581*16kB 308*32kB 129*64kB 65*128kB 29*256kB 12*512kB 7*1024kB 2*2048kB 1778*4096kB = 7358760kB
> Swap cache: add 0, delete 0, find 0/0, race 0+0
> Free swap  = 0kB
> Total swap = 0kB
> Out of Memory: Kill process 2037 (mDNSResponder) score 2847 and children.
> Out of memory: Killed process 2037 (mDNSResponder).
> oom-killer: gfp_mask=0xd0, order=0
>  [<c014ed15>] out_of_memory+0x155/0x180
>  [<c0150fa5>] __alloc_pages+0x2a5/0x320
>  [<c01512ce>] __get_free_pages+0x1e/0x40
>  [<c0181bd0>] __pollwait+0x80/0xd0
>  [<c017aa6d>] pipe_poll+0xcd/0xe0
>  [<c0181e32>] do_select+0x212/0x480
>  [<c0168e15>] cache_free_debugcheck+0x135/0x230
>  [<c0181b50>] __pollwait+0x0/0xd0
>  [<c01828ae>] core_sys_select+0x1ce/0x2e0
>  [<c0182d21>] sys_select+0x51/0x1c0
>  [<c0104173>] sysenter_past_esp+0x54/0x75
> DMA per-cpu:
> cpu 0 hot: high 0, batch 1 used:0
> cpu 0 cold: high 0, batch 1 used:0
> cpu 1 hot: high 0, batch 1 used:0
> cpu 1 cold: high 0, batch 1 used:0
> cpu 2 hot: high 0, batch 1 used:0
> cpu 2 cold: high 0, batch 1 used:0
> cpu 3 hot: high 0, batch 1 used:0
> cpu 3 cold: high 0, batch 1 used:0
> DMA32 per-cpu: empty
> Normal per-cpu:
> cpu 0 hot: high 186, batch 31 used:103
> cpu 0 cold: high 62, batch 15 used:61
> cpu 1 hot: high 186, batch 31 used:183
> cpu 1 cold: high 62, batch 15 used:53
> cpu 2 hot: high 186, batch 31 used:29
> cpu 2 cold: high 62, batch 15 used:54
> cpu 3 hot: high 186, batch 31 used:63
> cpu 3 cold: high 62, batch 15 used:60
> HighMem per-cpu:
> cpu 0 hot: high 186, batch 31 used:176
> cpu 0 cold: high 62, batch 15 used:13
> cpu 1 hot: high 186, batch 31 used:169
> cpu 1 cold: high 62, batch 15 used:1
> cpu 2 hot: high 186, batch 31 used:179
> cpu 2 cold: high 62, batch 15 used:0
> cpu 3 hot: high 186, batch 31 used:174
> cpu 3 cold: high 62, batch 15 used:6
> Free pages:     7366476kB (7359132kB HighMem)
> Active:5273 inactive:4855 dirty:0 writeback:0 unstable:0 free:1841619 slab:8970 mapped:4423 pagetables:232
> DMA free:3588kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:8 all_unreclaimable? yes
> lowmem_reserve[]: 0 0 880 8623
> DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
> lowmem_reserve[]: 0 0 880 8623
> Normal free:3756kB min:3756kB low:4692kB high:5632kB active:232kB inactive:0kB present:901120kB pages_scanned:314 all_unreclaimable? yes
> lowmem_reserve[]: 0 0 0 61951
> HighMem free:7359132kB min:512kB low:8780kB high:17052kB active:20860kB inactive:19420kB present:7929852kB pages_scanned:0 all_unreclaimable? no
> lowmem_reserve[]: 0 0 0 0
> DMA: 1*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3588kB
> DMA32: empty
> Normal: 13*4kB 1*8kB 1*16kB 3*32kB 0*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3756kB
> HighMem: 1621*4kB 1073*8kB 562*16kB 303*32kB 137*64kB 69*128kB 30*256kB 12*512kB 7*1024kB 2*2048kB 1778*4096kB = 7359132kB
> Swap cache: add 0, delete 0, find 0/0, race 0+0
> Free swap  = 0kB
> Total swap = 0kB
> Out of Memory: Kill process 2134 (sendmail) score 1741 and children.
> Out of memory: Killed process 2134 (sendmail).
> oom-killer: gfp_mask=0xd0, order=0
>  [<c014ed15>] out_of_memory+0x155/0x180
>  [<c0150fa5>] __alloc_pages+0x2a5/0x320
>  [<c01512ce>] __get_free_pages+0x1e/0x40
>  [<c0181bd0>] __pollwait+0x80/0xd0
>  [<c017aa6d>] pipe_poll+0xcd/0xe0
>  [<c0181e32>] do_select+0x212/0x480
>  [<c0168e15>] cache_free_debugcheck+0x135/0x230
>  [<c0181b50>] __pollwait+0x0/0xd0
>  [<c01828ae>] core_sys_select+0x1ce/0x2e0
>  [<c0182d21>] sys_select+0x51/0x1c0
>  [<c0104173>] sysenter_past_esp+0x54/0x75
> 
> openib source were retrieved with:
> svn co https://openib.org/svn/gen2/trunk
> 
> anybody ran into similar problem, are there any sdp
> patches available?
> 
> thanks,
> Amit

Netperf is running here fine. Can you try that to verify its not
a setup problem? I'll try iperf later.
Hmm. Where did all the memory go? can you
cat /proc/slabinfo

-- 
MST

More information about the general mailing list