[openib-general] OFED RC4 also can't support >2000 connections

[zhu shi song]

I modified squid to let it listening on sdp socket
directly. 
Client Side:
  SIMPLE_LIBSDP=1 LD_PRELOAD=libsdp.so ./lt-ab -c 1000
-n 1000 -X 193.12.10.l4:3129
http://www.google.com/index.html
Server Side:
   ./squid -d 10 -f squid.conf (listening on http_port
193.12.10.14:3129, socket is opened in sdp way)
The test results are:
(1) no kernel panic
(2) when concurrent connections is 100, performance is
not stable. sometimes is ok. sometimes is slower than
TCP.
(3) when connections are set to 1000, there always
100~300 requests failure.
(4) when connections are set to 2000, there are many
"ib_sdp WARN: Failed to allocate buffer page" warnings
(5) at last, when connections are set to 3000, "Cannot
allocate Memory(12)" error occurred and never build
connection to server.  SDP can't work forever.

I think there is some bugs, now I'm looking up the
source code, But I'm not so familiar about the code,so
I think I can't solve the problem fast.  I hope
someone who is responsible sdp development to test sdp
intensively and correct the bug, then sdp will be some
product grade and not just stay conceptual stage.

  tks
  zhu

--- Eitan Zahavi <eitan at mellanox.co.il> wrote:

> Hi Zhu,
> 
> If you are using libsdp.conf to select which ports
> should map to SDP and
> which to TCP you might run out of resources for
> tracking the opened
> sockets. 
> 
> Try increasing the following constant in libsdp:
> libsdp/src/port.c line 48:
> #define MAPPED_SOCKET_MAX	1024
> to something like:
> #define MAPPED_SOCKET_MAX	10000
> 
> Or, if you can use SDP sockets only (your config
> file is empty anyway):
> SIMPLE_LIBSDP=1 LD_PRELOAD=libsdp.so squid -d 10 -f
> squid.conf
> SIMPLE_LIBSDP=1 LD_PRELOAD=libsdp.so ./lt-ab -c 2000
> -n 2000 -X
> 193.12.10.14:3129
> 
> Hope this fixes the issue you see
> 
> Eitan Zahavi
> Senior Engineering Director, Software Architect
> Mellanox Technologies LTD
> Tel:+972-4-9097208
> Fax:+972-4-9593245
> P.O. Box 586 Yokneam 20692 ISRAEL
> 
> 
> > -----Original Message-----
> > From: openib-general-bounces at openib.org
> [mailto:openib-general-
> > bounces at openib.org] On Behalf Of zhu shi song
> > Sent: Wednesday, May 17, 2006 3:17 PM
> > To: openib-general at openib.org
> > Subject: [openib-general] OFED RC4 also can't
> support >2000
> connections
> > 
> > I have installed OFED RC4 on my RHEL 4.3(2.6.9-34
> > kernel). I use the same method I told in previous
> > mail.  When increasing concurrent sdp connection
> to
> > 2000. sdp refuse connection in server side. And
> client
> > can't connect to server through sdp connection
> > forever.
> > 
> > OS: RHEL 4.3 (2.6.9-34)
> > IB: OFED RC4
> > Test Method:
> >     Server: LD_PRELOAD=libsdp.so squid -d 10 -f
> > squid.conf( sdp listening on IB0:
> 193.12.10.14:3129)
> >     Client: LD_PRELOAD=libsdp.so ./lt-ab -c 2000
> -n
> > 2000 -X 193.12.10.14:3129
> > http://www.google.com/index.html ( IB0:
> 193.12.10.24)
> > 
> > 
> >     Who know what's wrong with sdp many concurrent
> > connections?  I have bought the cards for about 3
> > weeks, but I can't make them work correctly. 
> Urgent!
> > 
> >     tks
> >     zhu
> > 
> > 
> > 
> > 
> > __________________________________________________
> > Do You Yahoo!?
> > Tired of spam?  Yahoo! Mail has the best spam
> > protection around
> > http://mail.yahoo.com
> > 
> > __________________________________________________
> > Do You Yahoo!?
> > Tired of spam?  Yahoo! Mail has the best spam
> protection around
> > http://mail.yahoo.com
> > _______________________________________________
> > openib-general mailing list
> > openib-general at openib.org
> > http://openib.org/mailman/listinfo/openib-general
> > 
> > To unsubscribe, please visit
> http://openib.org/mailman/listinfo/openib-general
> 


__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam
protection around 
http://mail.yahoo.com 

__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com