[openib-general] SDP Protocol Issue Was: Configuration of sdp

[Eitan Zahavi]

Hi Sean,

Now I remember that if you go back enough with SDP (I think MST should
know how far) the Address Family in the address given to SDP used to be
required to be of type AF_INET_SDP. The new libsdp code does not do that
and works with the new SDP requirement to only create the socket with
AF_INET_SDP and later use AF_INET for the address (used for
bind/connect). 

So you should try and move to newest SDP too.

Eitan Zahavi
Senior Engineering Director, Software Architect
Mellanox Technologies LTD
Tel:+972-4-9097208
Fax:+972-4-9593245
P.O. Box 586 Yokneam 20692 ISRAEL


> -----Original Message-----
> From: Sean Hubbell [mailto:shubbell at dbresearch.net]
> Sent: Wednesday, November 29, 2006 7:53 PM
> To: Eitan Zahavi; openib-general at openib.org
> Subject: Re: [openib-general] SDP Protocol Issue Was: Configuration of
sdp
> 
> Eitan Zahavi wrote:
> > Sean Hubbell wrote:
> >> Ok, after futher inverstigation, here is what I have found:
> >>
> >> socket failed: Address family not supported by protocol
> >>
> > Do yo u have sdp loaded. Please try:
> > lsmod | grep ib_sdp
> Yes.
> >> I am assuming when sdp "exchanges" the AF_INET sockets to AF_SDP
> >> sockets that the current code that I am running has a issue or I
> >> don't know how to configure things...
> >>
> >> I have running libsdp v. 0.9.0 x86_64 as the rpm from downloaded
from
> >> mirror.centos.org running kernel 2.6.9-42.0.3.plus.c4smp
> >>
> >>
> > I would recommend upgrading libsdp only to the one available from
the
> > git tree at git clone
> > git://staging.openfabrics.org/git/~eitan/libsdp.git
> >
> > or still fom SVN:
> > https://openib.org/svn/gen2/trunk/src/userspace/libsdp
> >
> >> Also, my /etc/libsdp.conf file has the following:
> >>
> >> log min-level 1 destination syslog
> >> #use both server * *:*
> >> #use both client * *:*
> >> use sdp client * 10.10.0.0/16:*
> >> use sdp server * 10.10.0.0/16:*
> >>
> >> and seems to break all of my TCP connections, regardless if the
> >> interface is 10.10.* Is my configuration correct?
> >>
> > The "both" would have been better in preserving TCP based services
as
> > it falls back to use TCP if SDP does not work.
> I tried that originally and received the same results (things did not
fall back to
> using tcp), so I attempted to isolate this to my infiniband
connection... I'll
> change it to both.
> 
> >> What would you recommend my next step to be? Upgrading my kernel as
> >> well as libsdp to the latest? Also, currently without using sdp I
am
> >> getting 941 MBps, what do you get when you run using sdp, Karun
> >> mentioned that he is getting double the performance, which is where
I
> >> am at; needing better performance from my apps?
> >>
> > Depends on your apps. If you have many connections of large messages
> > SDP is a clear win.
> Yes, so it looks like this would be a valid upgrade. I'll try the git
tree.
> 
> Thanks Eitan,
> 
> Sean