[openib-general] Re: [uDAPL] dat.conf generator

[James Lentini]

On Mon, 24 Apr 2006, Dotan Barak wrote:

> On Monday 24 April 2006 17:33, James Lentini wrote:
> > 
> > On Sun, 23 Apr 2006, Dotan Barak wrote:
> > 
> > > 
> > > If in automatic way i will create a dat.conf that will have the following lines (on a machine with 2 HCAs, 2 port in each HCA):
> > > 
> > > OpenIB-cma u1.2 nonthreadsafe default /usr/lib/libdaplcma.so mv_dapl.1.2 "ib0 0" ""
> > > OpenIB-cma0 u1.2 nonthreadsafe default /usr/lib/libdaplcma.so mv_dapl.1.2 "ib0 0" ""
> > > OpenIB-cma1 u1.2 nonthreadsafe default /usr/lib/libdaplcma.so mv_dapl.1.2 "ib1 0" ""
> > > OpenIB-cma2 u1.2 nonthreadsafe default /usr/lib/libdaplcma.so mv_dapl.1.2 "ib2 0" ""
> > > OpenIB-cma3 u1.2 nonthreadsafe default /usr/lib/libdaplcma.so mv_dapl.1.2 "ib3 0" ""
> > > 
> > > In this file, there is a dapl provider name for every IPoIB I/F, and 
> > > still there is a default entry (the first I/F).
> > > 
> > > Is this is usefull?
> > 
> > Arlin was pointing out that the uDAPL CMA provider requires an IP 
> > address value, not a device name string:
> > 
> > OpenIB-cma u1.2 nonthreadsafe default libdapl.so of_udapl.1.2 "192.168.0.47 1" ""
> > 
> > The uDAPL CMA provider only uses the port value to check the device 
> > attributes, so the IP addr is the most important way to specify the 
> > device.
> > 
> > Naming the uDAPL providers OpenIB-cma0, OpenIB-cma1, OpenIB-cma2, ... 
> > makes sense, but remember that it is the IP address that will 
> > determine which device they map to.
> > 
> > Having a default provider, OpenIB-cma, is useful.
> 
> o.k,, so the generated file will have the following line for all of the IPoIB I/Fs:
> OpenIB-cmaX u1.2 nonthreadsafe default libdapl.so of_udapl.1.2 "192.168.0.47 1" ""  (X run from 0 to n)
> and a default OpenIB-cma which will be the first IPoIB I/F that was found.
> 
> i have 2 more questions:
> 1) what is the number after the IP? (ib port? starts from which value?)

Device port. This is the value passed to ibv_query_port(). These 
should start at 1.

> 2) do you need any lines with the scm ? (if the answer is yes, can 
> you please send me an example line?)

I'd make the script check for the cma and scm library, for each 
installed library create the appropriate entries.

Here's an example entry:

OpenIB-scm1 u1.2 nonthreadsafe default /usr/lib/libdaplscm.so of_udapl.1.2 "mthca0 1" ""

The first IA param is the device name and the second is the device 
port.