[openib-general] mvapich2 ofed 1.2 problem

[Steve Wise]

On Tue, 2007-02-13 at 13:01 -0500, Shaun Rowland wrote:
> Roland Dreier wrote:
> >  > How do I tell?  Can I tell from the .so files?
> > 
> > ldd on the .so and the app would probably give you good info.
> > 
> > I'm pretty sure that mpicc must be linking against an libibverbs 1.0
> > from somewhere.
> > 
> >  - R.
> 
> When I build using the OFED-1.2-20070208-1508, libibverbs 1.0 is what is
> built, at least by looking at the .so file result:
> 
> [rowland at z0 ~]$ ls /usr/local/ofed/lib64/ |grep ibverbs libibverbs.a
> libibverbs.so
> libibverbs.so.1
> libibverbs.so.1.0.0
> 
> This seems odd. Is it correct? I have updated the MVAPICH2 SRPM and sent
> a new patch for the OFED install scripts. This won't be reflected until
> the alpha1 release. Still, does the above seem strange? I noticed this
> recently. I see symbols for both versions though:
> 
> 0000000000005a50 T ibv_detach_mcast at IBVERBS_1.0
> 00000000000082c0 T ibv_detach_mcast@@IBVERBS_1.1
> 0000000000000000 A IBVERBS_1.0
> 0000000000000000 A IBVERBS_1.1
> 
> Our code links to these libraries, and by default mpicc
> should use what's in /usr/local/ofed/lib[64] in the -L path itself
> directly too. Is this an issue in the library? The libmpich.so file
> should not be any different when built. We will investigate this.
> 
> I can provide a patch against the latest OFED tar.gz to use the
> mvapich2-0.9.8-3.src.rpm once I download the release if that would help,
> as we have changed some things since the -2 SRPM release. Again, this
> should be reflected in the alpha1 release.


I was hoping to sniff-test mvapich2 over OFA/iWARP.  So if you can get
something that works I'll try it out.

Steve.