[openib-general] SDP Protocol Issue Was: Configuration of sdp

[Sean Hubbell]

Sounds like the problem I am having as I downloaded the lastest and 
tried but still get the error 97 which is protocol family. I'll upgrade 
the latest ib modules, but to do that I have to upgrade my kernel first...

Thanks...

Sean

Eitan Zahavi wrote:
> Hi Sean,
>
> Now I remember that if you go back enough with SDP (I think MST should
> know how far) the Address Family in the address given to SDP used to be
> required to be of type AF_INET_SDP. The new libsdp code does not do that
> and works with the new SDP requirement to only create the socket with
> AF_INET_SDP and later use AF_INET for the address (used for
> bind/connect). 
>
> So you should try and move to newest SDP too.
>
> Eitan Zahavi
> Senior Engineering Director, Software Architect
> Mellanox Technologies LTD
> Tel:+972-4-9097208
> Fax:+972-4-9593245
> P.O. Box 586 Yokneam 20692 ISRAEL
>
>
>   
>> -----Original Message-----
>> From: Sean Hubbell [mailto:shubbell at dbresearch.net]
>> Sent: Wednesday, November 29, 2006 7:53 PM
>> To: Eitan Zahavi; openib-general at openib.org
>> Subject: Re: [openib-general] SDP Protocol Issue Was: Configuration of
>>     
> sdp
>   
>> Eitan Zahavi wrote:
>>     
>>> Sean Hubbell wrote:
>>>       
>>>> Ok, after futher inverstigation, here is what I have found:
>>>>
>>>> socket failed: Address family not supported by protocol
>>>>
>>>>         
>>> Do yo u have sdp loaded. Please try:
>>> lsmod | grep ib_sdp
>>>       
>> Yes.
>>     
>>>> I am assuming when sdp "exchanges" the AF_INET sockets to AF_SDP
>>>> sockets that the current code that I am running has a issue or I
>>>> don't know how to configure things...
>>>>
>>>> I have running libsdp v. 0.9.0 x86_64 as the rpm from downloaded
>>>>         
> from
>   
>>>> mirror.centos.org running kernel 2.6.9-42.0.3.plus.c4smp
>>>>
>>>>
>>>>         
>>> I would recommend upgrading libsdp only to the one available from
>>>       
> the
>   
>>> git tree at git clone
>>> git://staging.openfabrics.org/git/~eitan/libsdp.git
>>>
>>> or still fom SVN:
>>> https://openib.org/svn/gen2/trunk/src/userspace/libsdp
>>>
>>>       
>>>> Also, my /etc/libsdp.conf file has the following:
>>>>
>>>> log min-level 1 destination syslog
>>>> #use both server * *:*
>>>> #use both client * *:*
>>>> use sdp client * 10.10.0.0/16:*
>>>> use sdp server * 10.10.0.0/16:*
>>>>
>>>> and seems to break all of my TCP connections, regardless if the
>>>> interface is 10.10.* Is my configuration correct?
>>>>
>>>>         
>>> The "both" would have been better in preserving TCP based services
>>>       
> as
>   
>>> it falls back to use TCP if SDP does not work.
>>>       
>> I tried that originally and received the same results (things did not
>>     
> fall back to
>   
>> using tcp), so I attempted to isolate this to my infiniband
>>     
> connection... I'll
>   
>> change it to both.
>>
>>     
>>>> What would you recommend my next step to be? Upgrading my kernel as
>>>> well as libsdp to the latest? Also, currently without using sdp I
>>>>         
> am
>   
>>>> getting 941 MBps, what do you get when you run using sdp, Karun
>>>> mentioned that he is getting double the performance, which is where
>>>>         
> I
>   
>>>> am at; needing better performance from my apps?
>>>>
>>>>         
>>> Depends on your apps. If you have many connections of large messages
>>> SDP is a clear win.
>>>       
>> Yes, so it looks like this would be a valid upgrade. I'll try the git
>>     
> tree.
>   
>> Thanks Eitan,
>>
>> Sean
>>     
>
>
>