[openib-general] why sdp connections cost so much memory

[Michael S. Tsirkin]

We will have a work-around in OFED 1.1.

Quoting r. zhu shi song <zhushisongzhu at yahoo.com>:
Subject: Re: why sdp connections cost so much memory

If it's spec bug is it difficult to solve?  And how
long will it take you to complete the bugfix?  I
really hope SDP can work as stably as TCP.

zhu


--- "Michael S. Tsirkin" <mst at mellanox.co.il> wrote:

> I did - this is the spec bug we are discussing with
> Sean.
> 
> Quoting r. zhu shi song <zhushisongzhu at yahoo.com>:
> > Subject: Re: why sdp connections cost so much
> memory
> > 
> > Have you resolved the problem?
> > zhu
> > 
> > --- "Michael S. Tsirkin" <mst at mellanox.co.il>
> wrote:
> > 
> > > Yes, I have reproduced the connection refusal
> > > problem and I am looking into it.
> > > Thanks!
> > > 
> > > MST
> > > 
> > > Quoting r. zhu shi song
> <zhushisongzhu at yahoo.com>:
> > > Subject: Re: why sdp connections cost so much
> memory
> > > 
> > > I haven't met kernel crashes using rc2.  But
> there
> > > always occurred connection refusal when max
> > > concurrent
> > > connections set above 200. All is right when max
> > > concurrent connections is set to below 200.  (
> If
> > > using TCP to take the same test, there is no
> > > problem.)
> > > (1)
> > > This is ApacheBench, Version 2.0.41-dev
> <$Revision:
> > > 1.141 $> apache-2.0
> > > Copyright (c) 1996 Adam Twiss, Zeus Technology
> Ltd,
> > > http://www.zeustech.net/
> > > Copyright (c) 1998-2002 The Apache Software
> > > Foundation, http://www.apache.org/
> > > 
> > > Benchmarking www.google.com [through
> > > 193.12.10.14:3129] (be patient)
> > > Completed 100 requests
> > > Completed 200 requests
> > > apr_recv: Connection refused (111)
> > > Total of 257 requests completed
> > > (2)
> > > This is ApacheBench, Version 2.0.41-dev
> <$Revision:
> > > 1.141 $> apache-2.0
> > > Copyright (c) 1996 Adam Twiss, Zeus Technology
> Ltd,
> > > http://www.zeustech.net/
> > > Copyright (c) 1998-2002 The Apache Software
> > > Foundation, http://www.apache.org/
> > > 
> > > Benchmarking www.google.com [through
> > > 193.12.10.14:3129] (be patient)
> > > Completed 100 requests
> > > Completed 200 requests
> > > apr_recv: Connection refused (111)
> > > Total of 256 requests completed
> > > [root at IB-TEST squid.test]#
> > > 
> > > zhu
> > > 
> > > 
> > > 
> > > 
> > > --- "Michael S. Tsirkin" <mst at mellanox.co.il>
> wrote:
> > > 
> > > > Quoting r. zhu shi song
> <zhushisongzhu at yahoo.com>:
> > > > > --- "Michael S. Tsirkin"
> <mst at mellanox.co.il>
> > > > wrote:
> > > > > 
> > > > > > Quoting r. zhu shi song
> > > > <zhushisongzhu at yahoo.com>:
> > > > > > > (3) one time linux kernel on the client
> > > > crashed. I
> > > > > > > copy the output from the screen.
> > > > > > > Process sdp (pid:4059, threadinfo
> > > > 0000010036384000
> > > > > > > task 000001003ea10030)
> > > > > > > Call
> > > > > > >
> > > > > >
> > > >
> > >
> Trace:<ffffffffa0205011>{:ib_sdp:sdp_destroy_workto}
> > > > > > > <ffffffffa02041ae>
> > > {:ib_sdp:sdp_destroy_qp+77}
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
<ffffffffa02044da>{:ib_sdp:sdp_destruct+279}<ffffffff802a42d2>{sk_free+28}
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
<ffffffff80146e1e>{worker_thread+419}<ffffffff801333c8>{default_wake_function+0}
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
<ffffffff801333c8>{default_wake_function+0}<ffffffff8014aabc>{keventd_create_kthread+0}
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
<ffffffff80146c76>{worker_thread+0}<ffffffff8014aabc>{keventd_create_kthread+0}
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
<ffffffff8014aa93>{kthread+200}<ffffffff80110e17>{child_rip+8}
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
<ffffffff8014aabc>{keventd_create_kthread+0}<ffffffff8014a9cb>{kthread+0}<ffffffff80110e0f>{child_rip+0}
> > > > > > > Code:8b 40 04 41 39 c6 89 44 24 0c 7d 3b
> 45
> > > 31
> > > > ff
> > > > > > 45
> > > > > > > 31 ed 4c 89
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
RIP:<ffffffffa0208437>{:ib_sdp:sdp_recv_completion+127}RSP<0000010036385dc8>
> > > > > > > CR2:0000000000000004
> > > > > > > <0>kernel panic-not syncing:Oops
> > > > > > > 
> > > > > > > zhu
> > > > > > 
> > > > > > Hmm, the stack dump does not match my
> sources.
> > > > Is
> > > > > > this OFED rc1?
> > > > > > Could you send me the sdp_main.o and
> > > sdp_main.c
> > > > > > files from your system please?
> > > > 
> > > > ---
> > > > 
> > > > > Subject: Re: why sdp connections cost so
> much
> > > > memory
> > > > > 
> > > > > please see the attachment.
> > > > > zhu
> > > > 
> > > > Ugh, so its crashing inside sdp_bcopy ...
> > > > 
> > > > By the way, could you please re-test with OFED
> > > rc2?
> > > > We've solved a couple of bugs there ...
> > > > 
> > > > If this still crashes, could you please post
> the
> > > > whole
> > > > sdp directory, with .o and .c files?
> > > > 
> > > > Thanks,
> 
> -- 
> MST
> 


__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com 

-- 
MST