[ewg] RE: OFED libraries - on the web at last

Todd Rimmer todd.rimmer at qlogic.com
Wed Jun 17 10:22:51 PDT 2009


Here is the change needed to mvapich as included in OFED 1.4.1

However end users will need some notice to rebuild their apps.  Especially ISVs.  I'm not sure what the OFED policy is for ABI changes, but at least 1-2 year notice seems the minimum (in QLogic's past efforts we try to maintain ABIs much longer than that as we still have some customers running 2-3 year old applications).

--- mvapich.spec-orig   2009-06-17 11:32:48.000000000 -0400
+++ mvapich.spec        2009-06-17 11:33:20.000000000 -0400
@@ -47,7 +47,7 @@
 Distribution: %{?_distribution:%{_distribution}}%{!?_distribution:%{_vendor}}
 URL: http://nowlab.cse.ohio-state.edu/projects/mpi-iba/index.html
 Prefix: %{_prefix}
-Requires: libibverbs libibumad libibcommon
+Requires: libibverbs libibumad
 %if %{use_mpi_selector}
 Requires: %{mpi_selector_rpm_name}
 %endif
@@ -268,7 +268,7 @@
 export F90FLAGS="$F90FLAGS $EXTRA_CFLAG"
 export CONFIG_FLAGS
 export MPIRUN_CFLAGS="$MPIRUN_CFLAGS -DPARAM_GLOBAL=\\\"%{_prefix}/etc/$conffil
e\\\" -DLD_LIBRARY_PATH_MPI=\\\"%{_prefix}/lib/shared\\\" -DMPI_PREFIX=\\\"%{_pr
efix}/\\\" $DEF_BUILDID"
-./configure --enable-sharedlib --with-device=%{mpi_device} --with-arch=LINUX --
prefix=%{build_root}%{_prefix} $CONFIG_ENABLE_F77 $CONFIG_ENABLE_F90 $COMPILER_C
ONFIG -lib="-L$IB_LIB $device_lib -libverbs -libumad -libcommon -lpthread $EXTRA
_CFLAG" $MPE_FLAGS $CONFIG_FLAGS
+./configure --enable-sharedlib --with-device=%{mpi_device} --with-arch=LINUX --
prefix=%{build_root}%{_prefix} $CONFIG_ENABLE_F77 $CONFIG_ENABLE_F90 $COMPILER_C
ONFIG -lib="-L$IB_LIB $device_lib -libverbs -libumad -lpthread $EXTRA_CFLAG" $MP
E_FLAGS $CONFIG_FLAGS
 %{__make}

 #############################################################################

Todd Rimmer
Chief Architect 
QLogic Network Systems Group
Voice: 610-233-4852     Fax: 610-233-4777
Todd.Rimmer at QLogic.com  www.QLogic.com
 

> -----Original Message-----
> From: Jonathan Perkins [mailto:perkinjo at cse.ohio-state.edu]
> Sent: Wednesday, June 17, 2009 1:17 PM
> To: Sasha Khapyorsky
> Cc: Todd Rimmer; ewg at lists.openfabrics.org
> Subject: Re: [ewg] RE: OFED libraries - on the web at last
> 
> On Wed, Jun 17, 2009 at 06:32:08PM +0300, Sasha Khapyorsky wrote:
> > On 08:14 Wed 17 Jun     , Todd Rimmer wrote:
> > >
> > > The issue isn't with the management tree.  It's with the mvapich
> included in OFED 1.4.1 and previous versions.
> >
> > Then it should be fixed.
> >
> > > It links with libibcommon and as a result,
> >
> > Do you know why exactly was it linked (and how)? I searched over
> > mvapich source and didn't find any references in sources and
> > makefiles. It is only mentioned in spec files. So is there any issue
> really?
> 
> When we link against ibumad this dependency is brought in.  Once ibumad
> stops referencing ibcommon then we will no longer have this dependency.
> You can see that ibcommon isn't even mentioned in the mvapich2 spec
> file.
> 
> >
> > > ALL end user and ISV apps linked with mvapich also link with
> libibcommon.
> > >
> > > This means that in moving to OFED 1.5 end users and ISVs would have
> to recompile all their apps.  Such a change should not be taken
> lightly.  Instead we should provide what is needed in OFED 1.5 such
> that existing app binaries will continue to work (might be as simple as
> stubbed library).  Then we can issue notice to end users and ISVs that
> their apps will need to be rebuilt and allow them at least 1 release to
> accomplish that.
> > >
> >
> > AFAIR libibcommon removal was discussed on the list couple of times
> > before, during and after OFED-1.4.
> >
> > Sasha
> > _______________________________________________
> > ewg mailing list
> > ewg at lists.openfabrics.org
> > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
> 
> --
> Jonathan Perkins
> http://www.cse.ohio-state.edu/~perkinjo



More information about the ewg mailing list