[ofa-general] OFED 1.2 & 1.2.5 on SLES 10 SP1 with Xen -- FIXED[Scanned]

Arif Ali aali at ocf.co.uk
Fri Aug 17 08:39:23 PDT 2007 

Arif Ali wrote:
>
> Arif Ali wrote:
> > Hi all,
> >
> > I am currently trying to install/compile OFED on SLES 10 SP1 with the
> > xen kernel and each time the compilation errors out at the same place.
> >
> > kernel: 2.6.16.46-0.12-xen
> > OS: SLES 10 SP1 x86_64
> >
> > build All applications via the build.sh script
> >
> > the last few lines from the OFED.log file
> >
> > gcc
> > 
> -Wp,-MD,/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/vnic/.vnic_sys.o.d
> > -nostdinc -isystem /usr/lib64/gcc/x86_64-suse-linux/4.1.2/include
> > -Iinclude2/asm/mach-xen -D__KERNEL__
> > 
> -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/kernel_addons/backport/2.6.16_sles10_sp1/include/
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/include
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/include
> > -Iinclude -Iinclude2 -I/usr/src/linux-2.6.16.46-0.12/include -include
> > include/linux/autoconf.h -include
> > /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/include/linux/autoconf.h
> > -D__XEN_INTERFACE_VERSION__=0x00030203
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/vnic
> > -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs
> > -Werror-implicit-function-declaration -fno-strict-aliasing -fno-common
> > -ffreestanding -Os -mtune=generic -m64 -mno-red-zone -mcmodel=kernel
> > -pipe -fno-reorder-blocks -Wno-sign-compare
> > -fno-asynchronous-unwind-tables -funit-at-a-time -mno-sse -mno-mmx
> > -mno-sse2 -mno-3dnow -fomit-frame-pointer -fno-stack-protector
> > -Wdeclaration-after-statement -Wno-pointer-sign
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/include
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/include
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/ipoib
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/debug
> > 
> -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/hw/cxgb3/core
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/net/cxgb3
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/net/rds
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/net/mlx4
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/hw/mlx4
> > -DMODULE -D"KBUILD_STR(s)=#s" -D"KBUILD_BASENAME=KBUILD_STR(vnic_sys)"
> > -D"KBUILD_MODNAME=KBUILD_STR(ib_vnic)" -c -o
> > 
> /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/vnic/.tmp_vnic_sys.o
> > 
> /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/vnic/vnic_sys.c
> >
> > ld -m elf_x86_64 -r -o
> > 
> /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/vnic/ib_vnic.o
> > 
> /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/vnic/vnic_main.o
> > 
> /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/vnic/vnic_ib.o
> > 
> /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/vnic/vnic_viport.o
> > 
> /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/vnic/vnic_control.o
> > 
> /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/vnic/vnic_data.o
> > 
> /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/vnic/vnic_netpath.o
> > 
> /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/vnic/vnic_config.o
> > 
> /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/vnic/vnic_sys.o
> >
> > make -f /usr/src/linux-2.6.16.46-0.12/scripts/Makefile.build
> > obj=/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/net/cxgb3
> > gcc
> > 
> -Wp,-MD,/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/net/cxgb3/.cxgb3_main.o.d
> > -nostdinc -isystem /usr/lib64/gcc/x86_64-suse-linux/4.1.2/include
> > 
> -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/kernel_addons/backport/2.6.16_sles10_sp1/include/
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/include
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/include
> > -Iinclude -Iinclude2 -I/usr/src/linux-2.6.16.46-0.12/include -include
> > include/linux/autoconf.h -include
> > /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/include/linux/autoconf.h
> > -Iinclude2/asm/mach-xen -D__KERNEL__
> > 
> -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/kernel_addons/backport/2.6.16_sles10_sp1/include/
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/include
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/include
> > -Iinclude -Iinclude2 -I/usr/src/linux-2.6.16.46-0.12/include -include
> > include/linux/autoconf.h -include
> > /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/include/linux/autoconf.h
> > -D__XEN_INTERFACE_VERSION__=0x00030203
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/net/cxgb3 -Wall
> > -Wundef -Wstrict-prototypes -Wno-trigraphs
> > -Werror-implicit-function-declaration -fno-strict-aliasing -fno-common
> > -ffreestanding -Os -mtune=generic -m64 -mno-red-zone -mcmodel=kernel
> > -pipe -fno-reorder-blocks -Wno-sign-compare
> > -fno-asynchronous-unwind-tables -funit-at-a-time -mno-sse -mno-mmx
> > -mno-sse2 -mno-3dnow -fomit-frame-pointer -fno-stack-protector
> > -Wdeclaration-after-statement -Wno-pointer-sign
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/include
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/include
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/ulp/ipoib
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/debug
> > 
> -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/hw/cxgb3/core
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/net/cxgb3
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/net/rds
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/net/mlx4
> > -I/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/infiniband/hw/mlx4
> > -DMODULE -D"KBUILD_STR(s)=#s"
> > -D"KBUILD_BASENAME=KBUILD_STR(cxgb3_main)"
> > -D"KBUILD_MODNAME=KBUILD_STR(cxgb3)" -c -o
> > 
> /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/net/cxgb3/.tmp_cxgb3_main.o
> > /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/net/cxgb3/cxgb3_main.c
> > In file included from include2/asm/smp.h:20,
> > from /usr/src/linux-2.6.16.46-0.12/include/linux/smp.h:19,
> > from /usr/src/linux-2.6.16.46-0.12/include/linux/sched.h:26,
> > from /usr/src/linux-2.6.16.46-0.12/include/linux/module.h:10,
> > from
> > 
> /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/net/cxgb3/cxgb3_main.c:32:
> >
> > include2/asm/io_apic.h: In function ‘io_apic_read’:
> > include2/asm/io_apic.h:171: error: implicit declaration of function
> > ‘HYPERVISOR_physdev_op’
> > In file included from
> > /usr/src/linux-2.6.16.46-0.12/include/linux/smp.h:19,
> > from /usr/src/linux-2.6.16.46-0.12/include/linux/sched.h:26,
> > from /usr/src/linux-2.6.16.46-0.12/include/linux/module.h:10,
> > from
> > 
> /var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/net/cxgb3/cxgb3_main.c:32:
> >
> > include2/asm/smp.h: In function ‘hard_smp_processor_id’:
> > include2/asm/smp.h:79: error: implicit declaration of function
> > ‘GET_APIC_ID’
> > include2/asm/smp.h:79: error: ‘APIC_BASE’ undeclared (first use in
> > this function)
> > include2/asm/smp.h:79: error: (Each undeclared identifier is reported
> > only once
> > include2/asm/smp.h:79: error: for each function it appears in.)
> > include2/asm/smp.h:79: error: ‘APIC_ID’ undeclared (first use in this
> > function)
> > include2/asm/smp.h: In function ‘logical_smp_processor_id’:
> > include2/asm/smp.h:137: error: implicit declaration of function
> > ‘GET_APIC_LOGICAL_ID’
> > include2/asm/smp.h:137: error: ‘APIC_BASE’ undeclared (first use in
> > this function)
> > include2/asm/smp.h:137: error: ‘APIC_LDR’ undeclared (first use in
> > this function)
> > make[5]: ***
> > [/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/net/cxgb3/cxgb3_main.o]
> > Error 1
> > make[4]: ***
> > [/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5/drivers/net/cxgb3] Error 2
> > make[3]: *** [_module_/var/tmp/OFEDRPM/BUILD/ofa_kernel-1.2.5] Error 2
> > make[2]: *** [modules] Error 2
> > make[1]: *** [modules] Error 2
> > make[1]: Leaving directory 
> `/usr/src/linux-2.6.16.46-0.12-obj/x86_64/xen'
> > make: *** [kernel] Error 2
> > error: Bad exit status from /var/tmp/rpm-tmp.87108 (%install)
> >
> >
> > RPM build errors:
> > user vlad does not exist - using root
> > group vlad does not exist - using root
> > user vlad does not exist - using root
> > group vlad does not exist - using root
> > Bad exit status from /var/tmp/rpm-tmp.87108 (%install)
> > ERROR: Failed executing "rpmbuild --rebuild --define '_topdir
> > /var/tmp/OFEDRPM' --define '_prefix /usr' --define 'build_root
> > /var/tmp/OFED' --define 'configure_options --with-cxgb3-mod
> > --with-ipath_inf-mod --with-ipoib-mod --with-iser-mod --with-mthca-mod
> > --with-sdp-mod --with-srp-mod --with-core-mod --with-user_mad-mod
> > --with-user_access-mod --with-addr_trans-mod --with-mlx4-mod
> > --with-rds-mod --with-vnic-mod ' --define 'KVERSION
> > 2.6.16.46-0.12-xen' --define 'KSRC
> > /lib/modules/2.6.16.46-0.12-xen/build' --define 'build_kernel_ib 1'
> > --define 'build_kernel_ib_devel 1' --define 'NETWORK_CONF_DIR
> > /etc/sysconfig/network' --define 'modprobe_update 1' --define
> > 'include_ipoib_conf 1' 
> /root/OFED-1.2.5/SRPMS/ofa_kernel-1.2.5-0.src.rpm"
> >
> Hi All,
>
> I have successfully compiled the OFED 1.2 under SLES 10 GA in Xen
> (2.6.16.21-0.8-xen), but the customer would like SP1 as that has Xen
> 3.1. Any info/fixes would be greatly appreciated
>
> thanks in advance
>
> --
> regards,
> Arif Ali
> Software Engineer
> OCF plc
>
> Mobile: +44 (0)7970 148 122
> Office: +44 (0)114 257 2200
> Fax:    +44 (0)114 257 0022
> Email:  aali at ocf.co.uk
> Web:    http://www.ocf.co.uk
>
> Support Phone:   +44 (0)845 702 3829
> Support E-mail:  support at ocf.co.uk
>
> Skype:  arif_ali80
> MSN:    aali at ocf.co.uk
>
> This email is confidential in that it is intended for the exclusive
> attention of the addressee(s) indicated. If you are not the intended
> recipient, this email should not be read or disclosed to any other person.
> Please notify the sender immediately and delete this email from your
> computer system. Any opinions expressed are not necessarily those of the
> company from which this email was sent and, whilst to the best of our
> knowledge no viruses or defects exist, no responsibility can be 
> accepted for
> any loss or damage arising from its receipt or subsequent use of this 
> email.
>
The fix here is to
* compile the OFED in normal kernel i.e. not in Xen
* install the driver via install install.sh
* reboot into Xen kernel
You will now have a machine with IB and Xen working

-- 
regards,
Arif Ali
Software Engineer
OCF plc

Mobile: +44 (0)7970 148 122
Office: +44 (0)114 257 2200
Fax:    +44 (0)114 257 0022
Email:  aali at ocf.co.uk
Web:    http://www.ocf.co.uk

Support Phone:   +44 (0)845 702 3829
Support E-mail:  support at ocf.co.uk

Skype:  arif_ali80
MSN:    aali at ocf.co.uk

This email is confidential in that it is intended for the exclusive 
attention of the addressee(s) indicated. If you are not the intended 
recipient, this email should not be read or disclosed to any other person. 
Please notify the sender immediately and delete this email from your 
computer system. Any opinions expressed are not necessarily those of the 
company from which this email was sent and, whilst to the best of our 
knowledge no viruses or defects exist, no responsibility can be accepted for
any loss or damage arising from its receipt or subsequent use of this email.

More information about the general mailing list