[ofa-general] MPI question for OFED 1.2

Scott Weitzenkamp (sweitzen) sweitzen at cisco.com
Wed Mar 7 16:56:52 PST 2007


MVAPICH and MVAPICH2 use 64-bit, and Open MPI should too.  MVAPICH and
MVAPICH2 only support 64-bit linking in this environment (they don't
build 32-bit MPI libs), at least they way they compile from OFED
install.sh.

[releng at svbu-qa1850-3 tmp]$ cat /etc/SuSE-release
SUSE Linux Enterprise Server 10 (x86_64)
VERSION = 10

MVAPICH

[releng at svbu-qa1850-3 tmp]$
/usr/local/ofed/mpi/gcc/mvapich-0.9.9/bin/mpicc -o osu_latency.mvapich
osu_latency.c
[releng at svbu-qa1850-3 tmp]$ ldd osu_latency.mvapich
        libmpich.so.1.0 => not found
        libibverbs.so.1 => /usr/local/ofed/lib64/libibverbs.so.1
(0x00002b0a2e0d
7000)
        libibumad.so.1 => /usr/local/ofed/lib64/libibumad.so.1
(0x00002b0a2e1e20
00)
        libibcommon.so.1 => /usr/local/ofed/lib64/libibcommon.so.1
(0x00002b0a2e
2ed000)
        libpthread.so.0 => /lib64/libpthread.so.0 (0x00002b0a2e3f0000)
        librt.so.1 => /lib64/librt.so.1 (0x00002b0a2e506000)
        libc.so.6 => /lib64/libc.so.6 (0x00002b0a2e610000)
        libdl.so.2 => /lib64/libdl.so.2 (0x00002b0a2e840000)
        /lib64/ld-linux-x86-64.so.2 (0x00002b0a2dfba000)
[releng at svbu-qa1850-3 tmp]$
/usr/local/ofed/mpi/gcc/mvapich-0.9.9/bin/mpicc -m32
 -o osu_latency.mvapich.32 osu_latency.c
/usr/lib64/gcc/x86_64-suse-linux/4.1.0/../../../../x86_64-suse-linux/bin
/ld: ski
pping incompatible
/usr/local/ofed/mpi/gcc/mvapich-0.9.9/lib/shared/libmpich.so
when searching for -lmpich
/usr/lib64/gcc/x86_64-suse-linux/4.1.0/../../../../x86_64-suse-linux/bin
/ld: ski
pping incompatible /usr/local/ofed/mpi/gcc/mvapich-0.9.9/lib/libmpich.a
when sea
rching for -lmpich
/usr/lib64/gcc/x86_64-suse-linux/4.1.0/../../../../x86_64-suse-linux/bin
/ld: can
not find -lmpich
collect2: ld returned 1 exit status

MVAPICH2: 

[releng at svbu-qa1850-3 tmp]$
/usr/local/ofed/mpi/gcc/mvapich2-0.9.8-7/bin/mpicc -o
osu_latency.mvapich2 osu_latency.c
[releng at svbu-qa1850-3 tmp]$ ldd osu_latency.mvapich2
        libmpich.so =>
/usr/local/ofed/mpi/gcc/mvapich2-0.9.8-7/lib/libmpich.so
(0x00002abaef60e000)
        librdmacm.so => /usr/local/ofed/lib64/librdmacm.so
(0x00002abaef8bb000)
        libibverbs.so.1 => /usr/local/ofed/lib64/libibverbs.so.1
(0x00002abaef9c
0000)
        libibumad.so.1 => /usr/local/ofed/lib64/libibumad.so.1
(0x00002abaefacb0
00)
        libpthread.so.0 => /lib64/libpthread.so.0 (0x00002abaefbd6000)
        librt.so.1 => /lib64/librt.so.1 (0x00002abaefcec000)
        libc.so.6 => /lib64/libc.so.6 (0x00002abaefdf5000)
        libdl.so.2 => /lib64/libdl.so.2 (0x00002abaf0026000)
        libibcommon.so.1 => /usr/local/ofed/lib64/libibcommon.so.1
(0x00002abaf0
12a000)
        /lib64/ld-linux-x86-64.so.2 (0x00002abaef4f1000)
[releng at svbu-qa1850-3 tmp]$
/usr/local/ofed/mpi/gcc/mvapich2-0.9.8-7/bin/mpicc -m32 -o
osu_latency.mvapich2.32 osu_latency.c
/usr/lib64/gcc/x86_64-suse-linux/4.1.0/../../../../x86_64-suse-linux/bin
/ld: ski
pping incompatible
/usr/local/ofed/mpi/gcc/mvapich2-0.9.8-7/lib/libmpich.so when
 searching for -lmpich
/usr/lib64/gcc/x86_64-suse-linux/4.1.0/../../../../x86_64-suse-linux/bin
/ld: ski
pping incompatible
/usr/local/ofed/mpi/gcc/mvapich2-0.9.8-7/lib/libmpich.a when
searching for -lmpich
/usr/lib64/gcc/x86_64-suse-linux/4.1.0/../../../../x86_64-suse-linux/bin
/ld: can
not find -lmpich
collect2: ld returned 1 exit status


Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems
 

> -----Original Message-----
> From: general-bounces at lists.openfabrics.org 
> [mailto:general-bounces at lists.openfabrics.org] On Behalf Of 
> Jeff Squyres (jsquyres)
> Sent: Wednesday, March 07, 2007 12:08 PM
> To: OpenFabrics General
> Subject: [ofa-general] MPI question for OFED 1.2
> 
> When both the 32 and 64 bit versions of libibverbs are 
> present, which  
> should the MPI build against?
> 
> What do MVAPICH / MVAPICH2?
> 
> -- 
> Jeff Squyres
> Server Virtualization Business Unit
> Cisco Systems
> 
> _______________________________________________
> general mailing list
> general at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
> 
> To unsubscribe, please visit 
> http://openib.org/mailman/listinfo/openib-general
> 



More information about the general mailing list