[ofa-general] XenIB: Error inserting ib_core: Invalid module format

[dwelp at mail.uni-paderborn.de]

Hi,

for some reason I cannot load the ib_core module, any help or comment  
would be greatly appreciated!
The system runs an UbuntuServer 6.10 (2.6.17-10) paravirtualized with  
Xen-3.0.0 (XenIB) from OSU [as described in Panda: High Performance  
VMM-Bypass I/O in Virtual Machines (Usenix 06)]. The Xen is from the  
http://xenbits.xensource.com/ext/xen-smartio.hg repository. It is  
configured with Infiniband support and successfully builded the  
enclosed modules.

root at ic13:~# uname -a
Linux ic13 2.6.16-rc3-xen0 #1 Tue Jan 20 16:43:16 CET 2009 x86_64 GNU/Linux

I downloaded and untared:
http://www.openfabrics.org/~vlad/builds/ofa_1_2_user/ofa_1_2_user-20070623-0200.tgz
http://www.openfabrics.org/~vlad/builds/ofa_1_2_kernel/ofa_1_2_kernel-20070822-0100.tgz

userspace went through perfectly with the following flow:
root at ic13:~# ./configure --with-libibverbs --with-mthca --with-libibcm  
--with-librdmacm --with-management-libs --with-openib-diags  
--with-opensm --with-ipoibtools
root at ic13:~# make & make install

constructing the modules runs without any errors:
root at ic13:~# ./configure --with-core-mod --with-ipoib-mod  
--with-ipoib-cm --with-user_mad-mod --with-user_access-mod  
--with-addr_trans-mod --with-mthca-mod
root at ic13:~# make & make install & depmod

the config-file:
root at ic13:~/ofed/ofa_1_2_kernel-20070822-0100# vim configure.mk.kernel
# Current working directory
CWD=/home/dwelp/ofed/ofa_1_2_kernel-20070822-0100

# Kernel level
KVERSION=2.6.16-rc3-xen0
ARCH=x86_64
EXTRAVERSION=-rc3-xen0
MODULES_DIR=/lib/modules/2.6.16-rc3-xen0/updates
KSRC=/lib/modules/2.6.16-rc3-xen0/build
BACKPORT_INCLUDES=-I/home/dwelp/ofed/ofa_1_2_kernel-20070822-0100/kernel_addons/backport/2.6.16/include/

AUTOCONF_H=/home/dwelp/ofed/ofa_1_2_kernel-20070822-0100/include/linux/autoconf.h
WITH_MEMTRACK=no

WITH_MAKE_PARAMS=

CONFIG_INFINIBAND=m
CONFIG_INFINIBAND_IPOIB=m
CONFIG_INFINIBAND_IPOIB_CM=y
CONFIG_INFINIBAND_SDP=
CONFIG_INFINIBAND_SRP=

CONFIG_INFINIBAND_USER_MAD=m
CONFIG_INFINIBAND_USER_ACCESS=m
CONFIG_INFINIBAND_ADDR_TRANS=y
CONFIG_INFINIBAND_MTHCA=m

CONFIG_INFINIBAND_IPOIB_DEBUG=y
CONFIG_INFINIBAND_ISER=
CONFIG_SCSI_ISCSI_ATTRS=
CONFIG_ISCSI_TCP=
CONFIG_INFINIBAND_EHCA=
CONFIG_INFINIBAND_EHCA_SCALING=
CONFIG_RDS=
CONFIG_RDS_IB=
CONFIG_RDS_TCP=
CONFIG_RDS_DEBUG=
CONFIG_INFINIBAND_MADEYE=
CONFIG_INFINIBAND_VNIC=
CONFIG_INFINIBAND_CXGB3=
CONFIG_CHELSIO_T3=

CONFIG_INFINIBAND_IPOIB_DEBUG_DATA=
CONFIG_INFINIBAND_SDP_SEND_ZCOPY=
CONFIG_INFINIBAND_SDP_RECV_ZCOPY=
CONFIG_INFINIBAND_SDP_DEBUG=
CONFIG_INFINIBAND_SDP_DEBUG_DATA=
CONFIG_INFINIBAND_IPATH=
CONFIG_INFINIBAND_MTHCA_DEBUG=y
CONFIG_INFINIBAND_VNIC_DEBUG=
CONFIG_INFINIBAND_VNIC_STATS=
CONFIG_INFINIBAND_CXGB3_DEBUG=


but when I try to load them it results in this:

root at ic13:~# modprobe ib_mthca
WARNING: Error inserting ib_core  
(/lib/modules/2.6.16-rc3-xen0/updates/kernel/drivers/infiniband/core/ib_core.ko): Invalid module  
format
WARNING: Error inserting ib_mad  
(/lib/modules/2.6.16-rc3-xen0/updates/kernel/drivers/infiniband/core/ib_mad.ko): Unknown symbol in module, or unknown parameter (see  
dmesg)
FATAL: Error inserting ib_mthca  
(/lib/modules/2.6.16-rc3-xen0/updates/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko): Unknown symbol in module, or unknown parameter (see  
dmesg)

the dmesg shows:
ib_core: exports duplicate symbol ib_unpack (owned by kernel)
ib_mad: Unknown symbol rdma_node_get_transport
ib_mad: Unknown symbol ib_get_cached_lmc
ib_mthca: Unknown symbol mult_to_ib_rate
ib_mthca: Unknown symbol ib_modify_qp_is_ok
ib_mthca: Unknown symbol ib_rate_to_mult
ib_mthca: Unknown symbol dma_get_cache_alignment

root at ic13:~# modinfo ib_core
filename:        
/lib/modules/2.6.16-rc3-xen0/updates/kernel/drivers/infiniband/core/ib_core.ko
license:        Dual BSD/GPL
description:    core kernel InfiniBand API
author:         Roland Dreier
depends:
vermagic:       2.6.16-rc3-xen0 gcc-3.4


Any ideas? Thanks in advance!

Daniel Welp