[openib-general] why sdp connections cost so much memory

[zhu shi song]

(1) my change:
    SDP_TX_SIZE=0x4 
    SDP_RX_SIZE=0x4
    use your patch
(2) memory consumed by SDP connection is ok
    But ab always only complete 256 requests
successfully.  Results are showed as following:
    # SIMPLE_LIBSDP=1
LD_PRELOAD=/usr/local/ofed/lib64/libsdp.so ab -c 300
-n 300 -X 193.12.10.14:3129
http://http://www.sse.com.cn/sseportal/ps/zhs/home.shtml
   # This is ApacheBench, Version 2.0.41-dev
<$Revision: 1.141 $> apache-2.0
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd,
http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software
Foundation, http://www.apache.org/

Benchmarking www.sse.com.cn [through
193.12.10.14:3129] (be patient)
Completed 100 requests
Completed 200 requests
apr_recv: Connection refused (111)
Total of 256 requests completed

(3) one time linux kernel on the client crashed. I
copy the output from the screen.
Process sdp (pid:4059, threadinfo 0000010036384000
task 000001003ea10030)
Call
Trace:<ffffffffa0205011>{:ib_sdp:sdp_destroy_workto}
<ffffffffa02041ae> {:ib_sdp:sdp_destroy_qp+77}
<ffffffffa02044da>{:ib_sdp:sdp_destruct+279}<ffffffff802a42d2>{sk_free+28}
<ffffffff80146e1e>{worker_thread+419}<ffffffff801333c8>{default_wake_function+0}
<ffffffff801333c8>{default_wake_function+0}<ffffffff8014aabc>{keventd_create_kthread+0}
<ffffffff80146c76>{worker_thread+0}<ffffffff8014aabc>{keventd_create_kthread+0}
<ffffffff8014aa93>{kthread+200}<ffffffff80110e17>{child_rip+8}
<ffffffff8014aabc>{keventd_create_kthread+0}<ffffffff8014a9cb>{kthread+0}<ffffffff80110e0f>{child_rip+0}
Code:8b 40 04 41 39 c6 89 44 24 0c 7d 3b 45 31 ff 45
31 ed 4c 89
RIP:<ffffffffa0208437>{:ib_sdp:sdp_recv_completion+127}RSP<0000010036385dc8>
CR2:0000000000000004
<0>kernel panic-not syncing:Oops

zhu



--- "Michael S. Tsirkin" <mst at mellanox.co.il> wrote:

> Quoting r. zhu shi song <zhushisongzhu at yahoo.com>:
> > Subject: Re: why sdp connections cost so much
> memory
> > 
> > I have changed SDP_RX_SIZE from 0x40 to 1 and
> rebuilt
> > ib_sdp.ko. But kernel always crashed.
> 
> Weird. How about this patch:
> 
> diff --git a/drivers/infiniband/ulp/sdp/sdp_bcopy.c
> b/drivers/infiniband/ulp/sdp/sdp_bcopy.c
> index c35a4da..2fd79a0 100644
> --- a/drivers/infiniband/ulp/sdp/sdp_bcopy.c
> +++ b/drivers/infiniband/ulp/sdp/sdp_bcopy.c
> @@ -234,7 +234,7 @@ void sdp_post_recvs(struct
> sdp_sock *ssk
>  	while ((likely(ssk->rx_head - ssk->rx_tail <
> SDP_RX_SIZE) &&
>  		(ssk->rx_head - ssk->rx_tail - SDP_MIN_BUFS) *
>  		SDP_MAX_SEND_SKB_FRAGS * PAGE_SIZE + rmem <
> -		ssk->isk.sk.sk_rcvbuf * 0x10) ||
> +		ssk->isk.sk.sk_rcvbuf) ||
>  	       unlikely(ssk->rx_head - ssk->rx_tail <
> SDP_MIN_BUFS))
>  		sdp_post_recv(ssk);
>  }
> 
> -- 
> MST
> 


__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam
protection around 
http://mail.yahoo.com 

__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com