[openib-general] IB initialization

[Hal Rosenstock]

Hi again Chris,

On Fri, 2006-04-14 at 10:39, Chris Worley wrote:
> Hal,
> 
> You're correct... the results of the scans are in /var/log/osm.log.  I
> was expecting the "-console" mode to show more.
> 
> In looking at the /var/log/osm.log I'm seeing a lot of:
>
> Reporting Generic Notice type:4 num:144
> 
> For different GUIDs.

What's a lot ? One for each GUID ? What's the capability mask indicated
?

>   Is there a place to look these up?

Yes, the IBA spec (volume 1). Trap 144 indicates that the capability
mask at the indicated LID has changed.

> I still don't have IPoIB running, and ibv_devinfo says I'm not setup
> right either (couldn't open a device).

I'm not sure why not.

-- Hal

> Thanks,
> 
> Chris
> On 14 Apr 2006 10:22:22 -0400, Hal Rosenstock <halr at voltaire.com> wrote:
> > Hi Chris,
> >
> > On Fri, 2006-04-14 at 10:19, Chris Worley wrote:
> > > I installed the SuSE 10 OpenIB RC2 RPMS.
> > >
> > > The installation went well, but I'm stuck at the startup.
> > >
> > > As an IBGD user, I'm used to an init file in /etc/init.d... but there was none.
> > >
> > > >From the wiki, I was able to glean:
> > >
> > >             Make the udev file:
> > >
> > > # cat > /etc/udev/rules.d/40-infiniband.rules
> > > KERNEL="umad*", NAME="infiniband/%k"
> > > KERNEL="issm*", NAME="infiniband/%k"
> > >
> > >              Install some modules:
> > >
> > > modprobe ib_ucm
> > > modprobe ib_cm
> > > modprobe ib_uverbs
> > > modprobe ib_umad
> > >
> > > And make sure udev is running, and start the opensm.
> > >
> > > I've done this on all nodes, and ibstat shows I have a link up and
> > > running on every node.  Opensm doesn't show any scanning.  It's been
> > > hung all night at:
> > >
> > > # opensm --console
> > > -------------------------------------------------
> > > OpenSM Rev:openib-1.2.0
> > > Based on OpenIB svn Exported revision
> > > Command Line Arguments:
> > >  Enabling OpenSM interactive console
> > >  Log File: /var/log/osm.log
> > > -------------------------------------------------
> > > OpenSM Rev:openib-1.2.0 OpenIB svn Exported revision
> > >
> > > Using default guid 0x2c9020020c3ce
> > >
> > > OpenSM Console
> > >
> > > $ Entering MASTER state
> > >
> > > SUBNET UP
> >
> > Looks like everything is fine from the OpenSM standpoint.
> >
> > I see no indication that OpenSM is hung. You are in the console.
> >
> > Also, why do you say OpenSM isn't "scanning" ?
> >
> > What is in /var/log/osm.log ? Any errors ?
> >
> > If you want more verbose messages start OpenSM with -V.
> >
> > -- Hal
> >
> > > IPoIB isn't up.  ibv_rc_pingpong doesn't work.  Neither does ibv_devinfo.
> > >
> > > Is there a definitive guide on the initialization of the drivers and fabric?
> > >
> > > Also, is there an MVAPICH2 for SuSE 10 RPM?
> > >
> > > Thanks,
> > >
> > > Chris
> > > _______________________________________________
> > > openib-general mailing list
> > > openib-general at openib.org
> > > http://openib.org/mailman/listinfo/openib-general
> > >
> > > To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
> >
> >
> _______________________________________________
> openib-general mailing list
> openib-general at openib.org
> http://openib.org/mailman/listinfo/openib-general
> 
> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general