[ofa-general] iw_cxgb3.ko needs unknown symbol dev2t3cdev

[Steve Wise]

Brian J. Murrell wrote:
> When I run a depmod -ae -F <System.map> on my resulting installation of
> OFED 1.3 I get the following error:
>
> WARNING: /lib/modules/2.6.18-53.1.14.el5_lustre.1.6.4.55.20080411125046smp/kernel/drivers/infiniband/hw/cxgb3/iw_cxgb3.ko needs unknown symbol dev2t3cdev
>
> What I can't seem to figure out is why this symbol is not being exported
> by kernel/drivers/net/cxgb3/cxgb3.ko.  The source shows it being defined
> and exported in drivers/net/cxgb3/cxgb3_offload.c:
>
> /* Get the t3cdev associated with a net_device */
> struct t3cdev *dev2t3cdev(struct net_device *dev)
> {
> 	const struct port_info *pi = netdev_priv(dev);
>
> 	return (struct t3cdev *)pi->adapter;
> }
>
> EXPORT_SYMBOL(dev2t3cdev);
>
> However the resulting cxgb3.ko clearly does not have it defined:
>
> # nm /lib/modules/2.6.18-53.1.14.el5_lustre.1.6.4.55.20080411125046smp/kernel/drivers/net/cxgb3/cxgb3.ko | grep dev2t3cdev
> #
>
> My build output shows the build of cxgb3_offload.c and the linking of it
> into cxgb3.o:
>
>   gcc -Wp,-MD,/cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3/.cxgb3_offload.o.d  -nostdinc -isystem /usr/lib/gcc/x86_64-redhat-linux/4.1.1/include \
> -include include/linux/autoconf.h \
> -include /cache/build/BUILD/ofa_kernel-1.3/include/linux/autoconf.h \
> -I/cache/build/BUILD/ofa_kernel-1.3/kernel_addons/backport/2.6.18-EL5.1/include/ \
>  \
>  \
> -I/cache/build/BUILD/ofa_kernel-1.3/include \
> -I/cache/build/BUILD/ofa_kernel-1.3/drivers/infiniband/debug \
> -I/usr/local/include/scst \
> -I/cache/build/BUILD/ofa_kernel-1.3/drivers/infiniband/ulp/srpt \
> -I/cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3 \
> -Iinclude \
>  \
>  -D__KERNEL__ \
> -include include/linux/autoconf.h \
> -include /cache/build/BUILD/ofa_kernel-1.3/include/linux/autoconf.h \
> -I/cache/build/BUILD/ofa_kernel-1.3/kernel_addons/backport/2.6.18-EL5.1/include/ \
>  \
>  \
> -I/cache/build/BUILD/ofa_kernel-1.3/include \
> -I/cache/build/BUILD/ofa_kernel-1.3/drivers/infiniband/debug \
> -I/usr/local/include/scst \
> -I/cache/build/BUILD/ofa_kernel-1.3/drivers/infiniband/ulp/srpt \
> -I/cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3 \
> -Iinclude \
>  \
>   -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs -fno-strict-aliasing -fno-common -Wstrict-prototypes -Wundef -Werror-implicit-function-declaration -Os  -mtune=generic -m64 -mno-red-zone -mcmodel=kernel -pipe -fno-reorder-blocks -Wno-sign-compare -fno-asynchronous-unwind-tables -funit-at-a-time -mno-sse -mno-mmx -mno-sse2 -mno-3dnow -fomit-frame-pointer -g  -fno-stack-protector -Wdeclaration-after-statement -Wno-pointer-sign   -DMODULE -D"KBUILD_STR(s)=#s" -D"KBUILD_BASENAME=KBUILD_STR(cxgb3_offload)"  -D"KBUILD_MODNAME=KBUILD_STR(cxgb3)" -c -o /cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3/.tmp_cxgb3_offload.o /cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3/cxgb3_offload.c
>   ld -m elf_x86_64  -r -o /cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3/cxgb3.o /cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3/cxgb3_main.o /cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3/ael1002.o /cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3/vsc8211.o /cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3/t3_hw.o /cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3/mc5.o /cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3/xgmac.o /cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3/sge.o /cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3/l2t.o /cache/build/BUILD/ofa_kernel-1.3/drivers/net/cxgb3/cxgb3_offload.o
>
> Any ideas what the problem could be?
>
>   

I believe the cxgb3 module you are looking at in /lib/modules/`uname 
-r`/kernel/* isn't the one you are building.  ofed installs its modules 
in /lib/modules/`uname -r`/updates/*.  The cxgb3 module in 
/lib/modules/`uname -r`/kernel/* is from your kernel tree I think.

Are you doing a 'make install' from the ofed tree? 


Are you using only the ofed tree or are you also using chelsio's TOE kit?

Thanks,

STeve.