[openib-general] mvapich2 ofed 1.2 problem

[Steve Wise]

On Tue, 2007-02-13 at 09:07 -0800, Roland Dreier wrote:
>  > Does this stack indicate that libibverbs is accessing a 1.0 provider?
>  > cxgb3 shouldn't be 1.0 right?
> 
>  > #1  0x00002b832d4d4381 in __ibv_alloc_pd_1_0 (context=0x617830)
>  >     at src/compat-1_0.c:572
>  > #2  0x00002b832cfef04e in rdma_cm_init_pd_cq ()
>  >    from /usr/local/ofed/mpi/gcc/mvapich2-0.9.8-3/lib/libmpich.so
> 
> This means that the app (or maybe the RDMA CM library?) is linked
> against the 1.0 API -- which should work even with cxgb3 actually.
> But maybe mvapich is built against the 1.1 API and the RDMA CM is
> built against 1.0 or something?
> 

How do I tell?  Can I tell from the .so files?

I can build a non-mpi app against the librdmacm and libibverbs that got
installed and things work ok.  So maybe libmpich is balled up somehow.

Interestingly, the mpi example program, cpi, that gets built with the
rpm works.  Its just mpi programs that I build using the mpicc which
links to the libmpich.so

Steve.