[openib-general] issues with compilation of ofed 1.2

[Yosef Etigin]

******************************************************************
1. When compiling without ibutils I get the following error:


RPM build errors:
    user vladsk does not exist - using root
    group vladsk does not exist - using root
    user vladsk does not exist - using root
    group vladsk does not exist - using root
    File not found by glob: /var/tmp/OFED/usr/local/ofed/man/man1/ibv_*
    File not found by glob: /var/tmp/OFED/usr/local/ofed/man/man8/opensm*
    File not found by glob: /var/tmp/OFED/usr/local/ofed/man/man8/osmtest*
ERROR: Failed executing "rpmbuild --rebuild --define '_topdir /var/tmp/OFEDRPM' --define '_prefix /usr/local/ofed ' --define 'build_root /var/tmp/OFED ' --define 'configure_options --with-ipoibtools --with-libcxgb3 --with-libibcm --with-libibcommon --with-libibmad --with-libibumad --with-libibverbs --with-libmthca --with-opensm --with-librdmacm --with-libsdp --with-sdpnetstat --with-mstflint --with-perftest --mandir=/usr/local/ofed /man' --define 'configure_options32 %{nil}' --define 'build_32bit 0' /tmp/regtest/OFED-1.2-20070205-1823/SRPMS/ofa_user-1.2-alpha1.src.rpm"

******************************************************************
2. After adding ibutils, compilation passes on RH4 (U4 and U3)
However, when execution application that uses libibverbs, i get ths error:

libibverbs: Warning: couldn't open config directory '/usr/local/ofed/etc/libibverbs.d'.
libibverbs: Warning: no userspace device-specific driver found for /sys/class/infiniband_verbs/uverbs0
No IB devices found

Workaround: copy libibverbs.d from installation of ofed 1.2 from daily build packages to /usr/loca/ofed/etc/


******************************************************************
3. Uninstall script does not always successfully remove libcxgb3 package



******************************************************************
4. When compiling on SLES10 I get this error:

MTHOME directory /var/tmp/OFED/usr/local/ofed does not exist.
Exiting.
error: Bad exit status from /var/tmp/rpm-tmp.37387 (%build)


RPM build errors:
    user rowland does not exist - using root
    group mvapich does not exist - using root
    user rowland does not exist - using root
    group mvapich does not exist - using root
    Bad exit status from /var/tmp/rpm-tmp.37387 (%build)
ERROR: Failed executing "rpmbuild --rebuild --define '_topdir /var/tmp/OFEDRPM' --define '_name mvapich2_gcc' --define '_prefix /usr/local/ofed/mpi/gcc/mvapich2-0.9.8-1' --define 'build_root /var/tmp/OFED' --define 'open_ib_home /usr/local/ofed' --define 'ofed_build_root /var/tmp/OFED' --define 'comp_env CC=gcc CXX=g++ F77=gfortran' --define 'iwarp 0' --define 'romio 1' --define 'shared_libs 1' --define 'auto_req 1' /tmp/OFED-1.2-20070205-1823/SRPMS/mvapich2-0.9.8-1.src.rpm"

******************************************************************
5. When compiling on SLES10 SP1 I get this error:

In file included from /usr/src/linux-2.6.16.37-0.9/include/linux/inetdevice.h:7,
                 from /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2/drivers/infiniband/core/addr.c:32:
/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2/kernel_addons/backport/2.6.16_sles10/include/linux/netdevice.h:7: error: redefinition of ‘netif_tx_lock’
/usr/src/linux-2.6.16.37-0.9/include/linux/netdevice.h:927: error: previous definition of ‘netif_tx_lock’ was here
/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2/kernel_addons/backport/2.6.16_sles10/include/linux/netdevice.h: In function ‘netif_tx_lock’:
/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2/kernel_addons/backport/2.6.16_sles10/include/linux/netdevice.h:8: error: ‘struct net_device’ has no member named ‘xmit_lock’
/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2/kernel_addons/backport/2.6.16_sles10/include/linux/netdevice.h: At top level:
/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2/kernel_addons/backport/2.6.16_sles10/include/linux/netdevice.h:13: error: redefinition of ‘netif_tx_unlock’
/usr/src/linux-2.6.16.37-0.9/include/linux/netdevice.h:947: error: previous definition of ‘netif_tx_unlock’ was here
/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2/kernel_addons/backport/2.6.16_sles10/include/linux/netdevice.h: In function ‘netif_tx_unlock’:
/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2/kernel_addons/backport/2.6.16_sles10/include/linux/netdevice.h:15: error: ‘struct net_device’ has no member named ‘xmit_lock’
/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2/drivers/infiniband/core/addr.c: At top level:
/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2/drivers/infiniband/core/addr.c:61: warning: initialization from incompatible pointer type
make[6]: *** [/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2/drivers/infiniband/core/addr.o] Error 1



******************************************************************
6. On [PPC64/Sles10] I get this compilaton error:

make[2]: Entering directory `/var/tmp/OFEDRPM/BUILD/ofa_user-1.2/src/userspace/librdmacm'
if /bin/sh ./libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I. -I. -I./include  -I../libibverbs/include -g -Wall -D_GNU_SOURCE -m64 -g -O2 -MT cma.lo -MD -MP -MF ".deps/cma.Tpo" -c -o cma.lo `test -f 'src/cma.c' || echo './'`src/cma.c; \
then mv -f ".deps/cma.Tpo" ".deps/cma.Plo"; else rm -f ".deps/cma.Tpo"; exit 1; fi
mkdir .libs
 gcc -DHAVE_CONFIG_H -I. -I. -I. -I./include -I../libibverbs/include -g -Wall -D_GNU_SOURCE -m64 -g -O2 -MT cma.lo -MD -MP -MF .deps/cma.Tpo -c src/cma.c  -fPIC -DPIC -o .libs/cma.o
/bin/sh ./libtool --tag=CC --mode=link gcc -g -Wall -D_GNU_SOURCE -m64 -g -O2 -L../libibverbs/src -libverbs -lsysfs -L. -o src/librdmacm.la -rpath /usr/local/ofed/lib64 -avoid-version -Wl,--version-script=./src/librdmacm.map cma.lo  
mkdir src/.libs
gcc -shared  .libs/cma.o  -Wl,--rpath -Wl,/var/tmp/OFEDRPM/BUILD/ofa_user-1.2/src/userspace/libibverbs/src/.libs /var/tmp/OFEDRPM/BUILD/ofa_user-1.2/src/userspace/libibverbs/src/.libs/libibverbs.so /usr/lib/libsysfs.so -L/var/tmp/OFEDRPM/BUILD/ofa_user-1.2/src/userspace/librdmacm  -m64 -Wl,--version-script=./src/librdmacm.map -Wl,-soname -Wl,librdmacm.so -o src/.libs/librdmacm.so
/usr/lib/libsysfs.so: could not read symbols: File in wrong format
collect2: ld returned 1 exit status
make[2]: *** [src/librdmacm.la] Error 1
make[2]: Leaving directory `/var/tmp/OFEDRPM/BUILD/ofa_user-1.2/src/userspace/librdmacm'
make[1]: *** [all] Error 2

************************
7. On RHAS5 beta 2, the setup requires sysfstuils-devel RPM which is not included in this distro.


--
Yosef Etigin
Alex Tabachnik