[ewg] trouble getting NFS/RDMA modules to load

[John Fitzgerald]

I've been trying to get NFS/RDMA setup and working on a Linux client, 
but have been hitting some roadblocks.
I'm using a 2.6.26 kernel, and have gotten NFS on setup as a client 
working over TCP/Ethernet, and working TCP/IB, but can't get RDMA 
modules to load.

The errors are the same as listed in an old posting (shown below) except 
with "svcrdma" the module not loading:
svcrdma: disagrees about version of symbol ib_create_cq
svcrdma: Unknown symbol ib_create_cq
...

I get the same errors if I try to load xprtrdma.  I searched around for 
a solution to the problem below but struck out.  The posting below is 
old (OFED 1.2), I'm using OFED 1.4, and see the same thing with rc1 and rc5.

Any advice?

Thanks,
John.
john.fitzgerald at sun.com


Old posting shown here:

[openfabrics-ewg] bug 355 - problems building modules that depend on the 
ofed 1.2 modules
Steve Wise swise at opengridcomputing.com
Thu Feb 15 09:12:06 PST 2007

     * Previous message: [ewg] IPoIB_HA not working properly with 
OFED1.2-alpha
     * Next message: [openfabrics-ewg] kernel_addons patch for ipath support
     * Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

All,

I've run into the following problem.  Bug 335 opened to track this...

I install the alpha1 ofed 1.2 rpms on a RHEL5b2 system with its
2.6.18-1.2747.el5 kernel.

Then I build a module outside of the kernel that uses the IB verbs and
RDMA CM kernel interface.  (krping).  This module builds and loads ok on
a stock 2.6.20 system with ofed1.2 installed, but it fails to load on
the rhel5b2 system with a version symbol problem.  Here is a snipit of
the errors:

rdma_krping: disagrees about version of symbol ib_create_cq
rdma_krping: Unknown symbol ib_create_cq
rdma_krping: disagrees about version of symbol rdma_resolve_addr
rdma_krping: Unknown symbol rdma_resolve_addr
rdma_krping: disagrees about version of symbol ib_dereg_mr
rdma_krping: Unknown symbol ib_dereg_mr

I'm wondering if maybe the ofed modules are _not_ being build with src
versioning even if the kernel has it turned on?

We see similar problems with NFS-RDMA trying to use OFED 1.2 modules.
And the NFS-RDMA works with OFED 1.1 modules, so I _think_ something is
whacked with the OFED 1.2 build process.