[ofa-general] Re: ofed-1.4.1 dapl and intel mpi 3.2.1

[Steve Wise]

Davis, Arlin R wrote:
>  
> Steve,
>
>   
>> Hey Arlin,
>>
>> Have you seen this?  I'm unable to get IMPI running over dapl.  dtest 
>> works with provider chelsio2, but IMPI is failing to load the libs:
>>
>> [impi at r1 ~]$ mpiexec -ppn 1 -genv I_MPI_DEVICE rdma:chelsio2 -env 
>> I_MPI_DEBUG 2 -n 2 
>> /opt/intel/impi/3.2.1/tests/IMB-3.1/IMB-MPI1 pingpong
>> [0] MPI startup(): cannot open dynamic library libdat.so
>> [0] MPI startup(): cannot open dynamic library libdat2.so
>> [1] MPI startup(): cannot open dynamic library libdat.so
>> [1] MPI startup(): cannot open dynamic library libdat2.so
>> [1] MPI startup(): DAPL provider <NULL on rank 0:r1-iw differs from 
>> <NULL string> on rank 1:r2-iw
>> [0] MPI startup(): socket data transfer mode
>> [1] MPI startup(): socket data transfer mode
>>     
>
> Hmmm, having problems finding libdat.so
>
> What packages are installed?
> # rpm -qa | grep dapl
> dapl-2.0.17-1
> compat-dapl-devel-1.2.14-1
> dapl-utils-2.0.17-1
> compat-dapl-1.2.14-1
> dapl-devel-2.0.17-1
> dapl-debuginfo-2.0.17-1
> dapl-devel-static-2.0.14-1
>
> can you verify libdat is in library path..
>
> # ldconfig -p | grep libdat
>         libdat2.so.2 (libc6,x86-64) => /usr/lib64/libdat2.so.2
>         libdat2.so (libc6,x86-64) => /usr/lib64/libdat2.so
>         libdat.so.1 (libc6,x86-64) => /usr/lib64/libdat.so.1
>         libdat.so (libc6,x86-64) => /usr/lib64/libdat.so
>
> -arlin


I was building IMB 32bit and didn't have the 32b dapl installed...

I modified the mpitests Makefiles to point to the intel 64b 
compiler/includes/libs and it all works now.

Thanks!

Steve.