[openib-general] mvapich2 ofed 1.2 problem

[Steve Wise]

So this program doesn't work:

> [mpi at vic20 ~]$ ldd IMB_2.3/src/IMB-MPI1
>         libmpich.so => /usr/local/ofed/mpi/gcc/mvapich2-0.9.8-3/lib/libmpich.so (0x00002b0d7cefb000)
>         librdmacm.so => /usr/local/ofed/lib64/librdmacm.so (0x00002b0d7d1b3000)
>         libibverbs.so.1 => /usr/local/ofed/lib64/libibverbs.so.1 (0x00002b0d7d2b8000)
>         libibumad.so.1 => /usr/local/ofed/lib64/libibumad.so.1 (0x00002b0d7d3c3000)
>         libpthread.so.0 => /lib64/tls/libpthread.so.0 (0x0000003e07000000)
>         librt.so.1 => /lib64/tls/librt.so.1 (0x0000003e0ba00000)
>         libc.so.6 => /lib64/tls/libc.so.6 (0x0000003e06500000)
>         libsysfs.so.1 => /usr/lib64/libsysfs.so.1 (0x0000003e06a00000)
>         libdl.so.2 => /lib64/libdl.so.2 (0x0000003e06300000)
>         libibcommon.so.1 => /usr/local/ofed/lib64/libibcommon.so.1 (0x00002b0d7d4cf000)
>         /lib64/ld-linux-x86-64.so.2 (0x0000003e06100000)
> 

And this one does:

[root at vic20 ~]# ldd /usr/local/ofed/mpi/gcc/mvapich2-0.9.8-3/examples/cpi
        libm.so.6 => /lib64/tls/libm.so.6 (0x0000003e06800000)
        librdmacm.so => /usr/local/ofed/lib64/librdmacm.so (0x00002b1353b65000)
        libibverbs.so.1 => /usr/local/ofed/lib64/libibverbs.so.1 (0x00002b1353c6a000)
        libibumad.so.1 => /usr/local/ofed/lib64/libibumad.so.1 (0x00002b1353d75000)
        libpthread.so.0 => /lib64/tls/libpthread.so.0 (0x0000003e07000000)
        librt.so.1 => /lib64/tls/librt.so.1 (0x0000003e0ba00000)
        libc.so.6 => /lib64/tls/libc.so.6 (0x0000003e06500000)
        libdl.so.2 => /lib64/libdl.so.2 (0x0000003e06300000)
        libsysfs.so.1 => /usr/lib64/libsysfs.so.1 (0x0000003e06a00000)
        libibcommon.so.1 => /usr/local/ofed/lib64/libibcommon.so.1 (0x00002b1353e81000)
        /lib64/ld-linux-x86-64.so.2 (0x0000003e06100000)


Note the cpi program doesn't dynamically link with libmpich.so.  That
appears to be the difference...