[ofa-general] MPI question for OFED 1.2

[Jeff Squyres]

Ok, thanks.

On Mar 7, 2007, at 7:56 PM, Scott Weitzenkamp ((sweitzen)) wrote:

> MVAPICH and MVAPICH2 use 64-bit, and Open MPI should too.  MVAPICH and
> MVAPICH2 only support 64-bit linking in this environment (they don't
> build 32-bit MPI libs), at least they way they compile from OFED
> install.sh.
>
> [releng at svbu-qa1850-3 tmp]$ cat /etc/SuSE-release
> SUSE Linux Enterprise Server 10 (x86_64)
> VERSION = 10
>
> MVAPICH
>
> [releng at svbu-qa1850-3 tmp]$
> /usr/local/ofed/mpi/gcc/mvapich-0.9.9/bin/mpicc -o osu_latency.mvapich
> osu_latency.c
> [releng at svbu-qa1850-3 tmp]$ ldd osu_latency.mvapich
>         libmpich.so.1.0 => not found
>         libibverbs.so.1 => /usr/local/ofed/lib64/libibverbs.so.1
> (0x00002b0a2e0d
> 7000)
>         libibumad.so.1 => /usr/local/ofed/lib64/libibumad.so.1
> (0x00002b0a2e1e20
> 00)
>         libibcommon.so.1 => /usr/local/ofed/lib64/libibcommon.so.1
> (0x00002b0a2e
> 2ed000)
>         libpthread.so.0 => /lib64/libpthread.so.0 (0x00002b0a2e3f0000)
>         librt.so.1 => /lib64/librt.so.1 (0x00002b0a2e506000)
>         libc.so.6 => /lib64/libc.so.6 (0x00002b0a2e610000)
>         libdl.so.2 => /lib64/libdl.so.2 (0x00002b0a2e840000)
>         /lib64/ld-linux-x86-64.so.2 (0x00002b0a2dfba000)
> [releng at svbu-qa1850-3 tmp]$
> /usr/local/ofed/mpi/gcc/mvapich-0.9.9/bin/mpicc -m32
>  -o osu_latency.mvapich.32 osu_latency.c
> /usr/lib64/gcc/x86_64-suse-linux/4.1.0/../../../../x86_64-suse- 
> linux/bin
> /ld: ski
> pping incompatible
> /usr/local/ofed/mpi/gcc/mvapich-0.9.9/lib/shared/libmpich.so
> when searching for -lmpich
> /usr/lib64/gcc/x86_64-suse-linux/4.1.0/../../../../x86_64-suse- 
> linux/bin
> /ld: ski
> pping incompatible /usr/local/ofed/mpi/gcc/mvapich-0.9.9/lib/ 
> libmpich.a
> when sea
> rching for -lmpich
> /usr/lib64/gcc/x86_64-suse-linux/4.1.0/../../../../x86_64-suse- 
> linux/bin
> /ld: can
> not find -lmpich
> collect2: ld returned 1 exit status
>
> MVAPICH2:
>
> [releng at svbu-qa1850-3 tmp]$
> /usr/local/ofed/mpi/gcc/mvapich2-0.9.8-7/bin/mpicc -o
> osu_latency.mvapich2 osu_latency.c
> [releng at svbu-qa1850-3 tmp]$ ldd osu_latency.mvapich2
>         libmpich.so =>
> /usr/local/ofed/mpi/gcc/mvapich2-0.9.8-7/lib/libmpich.so
> (0x00002abaef60e000)
>         librdmacm.so => /usr/local/ofed/lib64/librdmacm.so
> (0x00002abaef8bb000)
>         libibverbs.so.1 => /usr/local/ofed/lib64/libibverbs.so.1
> (0x00002abaef9c
> 0000)
>         libibumad.so.1 => /usr/local/ofed/lib64/libibumad.so.1
> (0x00002abaefacb0
> 00)
>         libpthread.so.0 => /lib64/libpthread.so.0 (0x00002abaefbd6000)
>         librt.so.1 => /lib64/librt.so.1 (0x00002abaefcec000)
>         libc.so.6 => /lib64/libc.so.6 (0x00002abaefdf5000)
>         libdl.so.2 => /lib64/libdl.so.2 (0x00002abaf0026000)
>         libibcommon.so.1 => /usr/local/ofed/lib64/libibcommon.so.1
> (0x00002abaf0
> 12a000)
>         /lib64/ld-linux-x86-64.so.2 (0x00002abaef4f1000)
> [releng at svbu-qa1850-3 tmp]$
> /usr/local/ofed/mpi/gcc/mvapich2-0.9.8-7/bin/mpicc -m32 -o
> osu_latency.mvapich2.32 osu_latency.c
> /usr/lib64/gcc/x86_64-suse-linux/4.1.0/../../../../x86_64-suse- 
> linux/bin
> /ld: ski
> pping incompatible
> /usr/local/ofed/mpi/gcc/mvapich2-0.9.8-7/lib/libmpich.so when
>  searching for -lmpich
> /usr/lib64/gcc/x86_64-suse-linux/4.1.0/../../../../x86_64-suse- 
> linux/bin
> /ld: ski
> pping incompatible
> /usr/local/ofed/mpi/gcc/mvapich2-0.9.8-7/lib/libmpich.a when
> searching for -lmpich
> /usr/lib64/gcc/x86_64-suse-linux/4.1.0/../../../../x86_64-suse- 
> linux/bin
> /ld: can
> not find -lmpich
> collect2: ld returned 1 exit status
>
>
> Scott Weitzenkamp
> SQA and Release Manager
> Server Virtualization Business Unit
> Cisco Systems
>
>
>> -----Original Message-----
>> From: general-bounces at lists.openfabrics.org
>> [mailto:general-bounces at lists.openfabrics.org] On Behalf Of
>> Jeff Squyres (jsquyres)
>> Sent: Wednesday, March 07, 2007 12:08 PM
>> To: OpenFabrics General
>> Subject: [ofa-general] MPI question for OFED 1.2
>>
>> When both the 32 and 64 bit versions of libibverbs are
>> present, which
>> should the MPI build against?
>>
>> What do MVAPICH / MVAPICH2?
>>
>> -- 
>> Jeff Squyres
>> Server Virtualization Business Unit
>> Cisco Systems
>>
>> _______________________________________________
>> general mailing list
>> general at lists.openfabrics.org
>> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>>
>> To unsubscribe, please visit
>> http://openib.org/mailman/listinfo/openib-general
>>


-- 
Jeff Squyres
Server Virtualization Business Unit
Cisco Systems