[ofa-general] MPI IB Errors

John Leidel john.leidel at gmail.com
Thu Aug 23 04:08:01 PDT 2007


lspci output is ::
07:00.0 InfiniBand: Mellanox Technologies MT25208 InfiniHost III Ex (Tavor
compatibility mode) (rev a0)
        Subsystem: Mellanox Technologies MT25208 InfiniHost III Ex (Tavor
compatibility mode)
        Flags: bus master, fast devsel, latency 0, IRQ 193
        Memory at dc000000 (64-bit, non-prefetchable) [size=1M]
        Memory at d8000000 (64-bit, prefetchable) [size=8M]
        Memory at d0000000 (64-bit, prefetchable) [size=128M]
        Capabilities: [40] Power Management version 2
        Capabilities: [48] Vital Product Data
        Capabilities: [90] Message Signalled Interrupts: 64bit+ Queue=0/5
Enable-
        Capabilities: [84] MSI-X: Enable- Mask- TabSize=32
        Capabilities: [60] Express Endpoint IRQ 0

Loaded modules are :
ib_ipoib               60440  0
ib_mthca              151056  0
ib_umad                19888  0
ib_ucm                 21000  0
ib_uverbs              46000  1 ib_ucm
ib_cm                  40744  1 ib_ucm
ib_sa                  17684  2 ib_ipoib,ib_cm
ib_mad                 42408  4 ib_mthca,ib_umad,ib_cm,ib_sa
ib_core                60032  8
ib_ipoib,ib_mthca,ib_umad,ib_ucm,ib_uverbs,ib_cm,ib_sa,ib_mad


OFED config details from /etc/infiniband/ofed/ ::
#!/bin/bash

echo prefix=/usr/local/ofed
echo Kernel=2.6.9-42.ELsmp
echo
echo "Configure options: --with-ipoib-mod --with-mthca-mod --with-sdp-mod
--with-srp-mod --with-core-mod --with-user_mad-mod --with-user_access-mod
--with-addr_trans-mod --with-madeye-mod"
echo

cheers
john

On 8/23/07, Tziporet Koren <tziporet at dev.mellanox.co.il> wrote:
>
> John Leidel wrote:
> > All, in adding two new blade centers full of machines to my existing
> > cluster install, I'm getting the following errors in trying to run MPI
> > jobs over MVAPICH ::
> >
> > libibverbs: Fatal: no infiniband class devices found.
> > No IB device found
> >
> >
> Please send the output of lspci -v for the IB card.
>
> Also - to see which kernel modules are loaded please run: lsmod | grep ib
>
> If you have OFED installed on the system you can find the prefix running
> the script: /etc/infiniband/info
>
> The binaries are installed under <prefix>/bin
>
> Tziporet
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20070823/d9d1ee4d/attachment.html>


More information about the general mailing list