[openib-general] OFED-1.1-rc6 fails to build ibutils on PPC64

[Sasha Khapyorsky]

Hi,

Recently I've played with PPC64/SLES10 machine and found that it fails
to build ibutils package. The build log says:

  gcc -DHAVE_CONFIG_H -I. -I. -I.. -I/usr/include -I/var/tmp/OFED/usr/local/ofed/include/infiniband -I/var/tmp/OFED/usr/local/ofed/include -DOSM_VENDOR_INTF_OPENIB -DOSM_BUILD_OPENIB -D_XOPEN_SOURCE=600 -D_BSD_SOURCE=1 -O2 -Wall -fno-strict-aliasing -fPIC -O2 -g -fmessage-length=0 -D_FORTIFY_SOURCE=2 -MT ibis_wrap.lo -MD -MP -MF .deps/ibis_wrap.Tpo -c ibis_wrap.c -o ibis_wrap.o >/dev/null 2>&1
  /bin/sh ../libtool --tag=CC --mode=link gcc -I/usr/include -I/var/tmp/OFED/usr/local/ofed/include/infiniband -I/var/tmp/OFED/usr/local/ofed/include  -DOSM_VENDOR_INTF_OPENIB  -DOSM_BUILD_OPENIB -D_XOPEN_SOURCE=600 -D_BSD_SOURCE=1 -O2 -Wall -fno-strict-aliasing -fPIC -O2 -g -fmessage-length=0 -D_FORTIFY_SOURCE=2   -o libibis.la -rpath /usr/local/ofed/lib64 -version-info "1:0:0" -no-undefined -Wl,-rpath -Wl,/var/tmp/OFED/usr/local/ofed/lib64 -L/var/tmp/OFED/usr/local/ofed/lib64 -lopensm -losmvendor -losmcomp -libumad -libcommon -L/usr/lib64 -ltcl8.4 -ldl  -lm ibis_wrap.lo ibbbm.lo ibcr.lo ibis.lo ibis_gsi_mad_ctrl.lo ibpm.lo ibsac.lo ibsm.lo ibvs.lo  
  libtool: link: warning: `/var/tmp/OFED/usr/local/ofed/lib64/libibcommon.la' seems to be moved
  libtool: link: warning: `/var/tmp/OFED/usr/local/ofed/lib64/libibcommon.la' seems to be moved
  libtool: link: warning: `/var/tmp/OFED/usr/local/ofed/lib64/libibcommon.la' seems to be moved
  libtool: link: warning: `/var/tmp/OFED/usr/local/ofed/lib64/libibcommon.la' seems to be moved
  libtool: link: warning: library `/var/tmp/OFED/usr/local/ofed/lib64/libibcommon.la' was moved.
  gcc -shared  .libs/ibis_wrap.o .libs/ibbbm.o .libs/ibcr.o .libs/ibis.o .libs/ibis_gsi_mad_ctrl.o .libs/ibpm.o .libs/ibsac.o .libs/ibsm.o .libs/ibvs.o  -Wl,--rpath -Wl,/var/tmp/OFED/usr/local/ofed/lib64 -Wl,--rpath -Wl,/var/tmp/OFED/usr/local/ofed/lib64 -L/var/tmp/OFED/usr/local/ofed/lib64 /var/tmp/OFED/usr/local/ofed/lib64/libopensm.so -L/var/tmp/OFEDRPM/BUILD/openib-1.1/src/userspace/management/libibcommon -L/usr/lib64 -L/var/tmp/OFEDRPM/BUILD/openib-1.1/src/userspace/management/libibumad /var/tmp/OFED/usr/local/ofed/lib64/libosmvendor.so /var/tmp/OFED/usr/local/ofed/lib64/libosmcomp.so /var/tmp/OFED/usr/local/ofed/lib64/libibumad.so /var/tmp/OFED/usr/local/ofed/lib64/libibcommon.so -ltcl8.4 -ldl -lm  -Wl,-rpath -Wl,/var/tmp/OFED/usr/local/ofed/lib64 -Wl,-soname -Wl,libibis.so.1 -o .libs/libibis.so.1.0.0
  /var/tmp/OFED/usr/local/ofed/lib64/libopensm.so: could not read symbols: File in wrong format
  collect2: ld returned 1 exit status
  make[3]: *** [libibis.la] Error 1
  make[3]: Leaving directory `/var/tmp/OFEDRPM/BUILD/ibutils-1.0/ibis/src'
  make[2]: *** [all-recursive] Error 1
  make[2]: Leaving directory `/var/tmp/OFEDRPM/BUILD/ibutils-1.0/ibis'
  make[1]: *** [all] Error 2
  make[1]: Leaving directory `/var/tmp/OFEDRPM/BUILD/ibutils-1.0/ibis'
  make: *** [all-recursive] Error 1
  error: Bad exit status from /var/tmp/rpm-tmp.16324 (%install)


Seems that ibis uses gcc without -m64 flag and then tries to link with
"pure" 64 library:

  $ file /var/tmp/OFED/usr/local/ofed/lib64/libopensm.so.1.1.0 
  /var/tmp/OFED/usr/local/ofed/lib64/libopensm.so.1.1.0: ELF 64-bit MSB shared object, cisco 7500, version 1 (SYSV), not stripped

, and

  $ file ibis_wrap.o
  ibis_wrap.o: ELF 32-bit MSB relocatable, PowerPC or cisco 4500, version 1 (SYSV), not stripped

Other less critical issue is warnings like:

  warning: user vlad does not exist - using root
  warning: group mtl does not exist - using root
  warning: user vlad does not exist - using root
  warning: group mtl does not exist - using root

in the build log (in a different places). I don't think this is PPC64
related.


I can add this report as update to [Bug 241] (PPC64/SLES10 OFED build)
if needed.

Sasha