[Users] Another ibdiagnet question...

Todd Wilde Todd at Mellanox.com
Mon Sep 17 17:26:34 PDT 2012


Ira,

There may be bug here.   I've always used '-i mlx4_0' in the past and it works.     

-Todd

> -----Original Message-----
> From: Ira Weiny [mailto:weiny2 at llnl.gov]
> Sent: Monday, September 17, 2012 4:04 PM
> To: Todd Wilde
> Cc: users at lists.openfabrics.org
> Subject: Re: [Users] Another ibdiagnet question...
> 
> On Mon, 17 Sep 2012 22:40:13 +0000
> Todd Wilde <Todd at Mellanox.com> wrote:
> 
> > Hi Ira,
> >
> > Try 'ibdiagnet -i mlx4_0 -p 2'
> >
> > -Todd
> 
> I tried that:
> 
> bash-4.1# ibdiagnet -i mlx4_0 -p 2
> Loading IBDIAGNET from: /usr/lib64/ibdiagnet1.5.7
> 
> -E- Illegal argument: Illegal value for -i option: mlx4_0
>     (Legal value: a positive integer number).
>     Exiting.
> 
> SYNOPSYS
>   ibdiagnet [-c <count>] [-v] [-r] [-u] [-o <out-dir>]
>      [-t <topo-file>] [-s <sys-name>] [-i <dev-index>] [-p <port-num>] [-wt]
>      [-pm] [-pc] [-P <<PM>=<Value>>]
>      [-lw <1x|4x|12x>] [-ls <2.5|5|10>]
>      [-skip <ibdiag check>] [-load_db <db_file>] [-csv] [-vlr]
> 
> This is with the RHEL 6 ibutils.
> 
> bash-4.1# rpm -qf `which ibdiagnet`
> ibutils-1.5.7-6.el6.x86_64
> 
> Perhaps there is a bug?
> 
> Ira
> 
> >
> >
> >
> > > -----Original Message-----
> > > From: users-bounces at lists.openfabrics.org [mailto:users-
> > > bounces at lists.openfabrics.org] On Behalf Of Ira Weiny
> > > Sent: Monday, September 17, 2012 3:36 PM
> > > To: users at lists.openfabrics.org
> > > Subject: [Users] Another ibdiagnet question...
> > >
> > >
> > > Does anyone understand the "-i <dev-index>" option?
> > >
> > > I have a system with 3 cards in it like this (summary from ibstat)[*]:
> > >
> > > mlx4_0 (IB)
> > > 	port 1: down
> > > 	port 2: up
> > > mlx4_1 (Eth)
> > > 	port 1: up
> > > 	port 2: down
> > > qib0 (IB)
> > > 	port 1: up
> > >
> > > The "-i" option to ibdiagnet wants (from the man page):
> > >
> > > "the index of the device of the port used to connect to the IB
> > > fabric (in case of multiple devices on the local system)"
> > >
> > > I don't quite understand what that means.  I _thought_ it would mean
> > > that
> > > mlx4_0 == 1, mlx4_1 == 2, qib0 ==3.
> > >
> > > so I tried:
> > >
> > > bash-4.1# ibdiagnet -i 1 -p 2
> > > Loading IBDIAGNET from: /usr/lib64/ibdiagnet1.5.7
> > > -W- Topology file is not specified.
> > >     Reports regarding cluster links will use direct routes.
> > > Loading IBDM from: /usr/lib64/ibdm1.5.7
> > >
> > > -E- Device number: 1 does not have port number: 2.
> > >     Exiting.
> > >
> > >
> > > So perhaps it is zero based?
> > >
> > > bash-4.1# ibdiagnet -i 0 -p 2
> > > Loading IBDIAGNET from: /usr/lib64/ibdiagnet1.5.7
> > >
> > > -E- Illegal argument: Illegal value for -i option: 0
> > >     (Legal value: a positive integer number).
> > >     Exiting.
> > >
> > > SYNOPSYS
> > >   ibdiagnet [-c <count>] [-v] [-r] [-u] [-o <out-dir>]
> > >      [-t <topo-file>] [-s <sys-name>] [-i <dev-index>] [-p <port-num>] [-
> wt]
> > >      [-pm] [-pc] [-P <<PM>=<Value>>]
> > >      [-lw <1x|4x|12x>] [-ls <2.5|5|10>]
> > >      [-skip <ibdiag check>] [-load_db <db_file>] [-csv] [-vlr]
> > >
> > > Nope...  What am I missing?
> > >
> > > Ira
> > >
> > >
> > > [*] full output from ibstat:
> > >
> > > bash-4.1# ibstat
> > > CA 'mlx4_0'
> > >         CA type: MT26428
> > >         Number of ports: 2
> > >         Firmware version: 2.8.600
> > >         Hardware version: b0
> > >         Node GUID: 0x0002c903004bebda
> > >         System image GUID: 0x0002c903004bebdd
> > >         Port 1:
> > >                 State: Down
> > >                 Physical state: Polling
> > >                 Rate: 68
> > >                 Base lid: 0
> > >                 LMC: 0
> > >                 SM lid: 0
> > >                 Capability mask: 0x02510868
> > >                 Port GUID: 0x0002c903004bebdb
> > >                 Link layer: InfiniBand
> > >         Port 2:
> > >                 State: Active
> > >                 Physical state: LinkUp
> > >                 Rate: 40
> > >                 Base lid: 2
> > >                 LMC: 0
> > >                 SM lid: 1
> > >                 Capability mask: 0x02510868
> > >                 Port GUID: 0x0002c903004bebdc
> > >                 Link layer: InfiniBand CA 'mlx4_1'
> > >         CA type: MT26448
> > >         Number of ports: 2
> > >         Firmware version: 2.7.0
> > >         Hardware version: a0
> > >         Node GUID: 0xffffffffffffffff
> > >         System image GUID: 0xffffffffffffffff
> > >         Port 1:
> > >                 State: Active
> > >                 Physical state: LinkUp
> > >                 Rate: 10
> > >                 Base lid: 0
> > >                 LMC: 0
> > >                 SM lid: 0
> > >                 Capability mask: 0x00010000
> > >                 Port GUID: 0x0202c9fffe02c593
> > >                 Link layer: Ethernet
> > >         Port 2:
> > >                 State: Down
> > >                 Physical state: Disabled
> > >                 Rate: 10
> > >                 Base lid: 0
> > >                 LMC: 0
> > >                 SM lid: 0
> > >                 Capability mask: 0x00010000
> > >                 Port GUID: 0x0202c9fffe02c594
> > >                 Link layer: Ethernet CA 'qib0'
> > >         CA type: InfiniPath_QLE7340
> > >         Number of ports: 1
> > >         Firmware version:
> > >         Hardware version: 1
> > >         Node GUID: 0x001175000079da38
> > >         System image GUID: 0x001175000079da38
> > >         Port 1:
> > >                 State: Active
> > >                 Physical state: LinkUp
> > >                 Rate: 20
> > >                 Base lid: 1
> > >                 LMC: 0
> > >                 SM lid: 1
> > >                 Capability mask: 0x0761086a
> > >                 Port GUID: 0x001175000079da38
> > >                 Link layer: InfiniBand
> > >
> > >
> > > _______________________________________________
> > > Users mailing list
> > > Users at lists.openfabrics.org
> > > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/users
> 
> 
> --
> Ira Weiny
> Member of Technical Staff
> Lawrence Livermore National Lab
> 925-423-8008
> weiny2 at llnl.gov



More information about the Users mailing list