[ewg] Failure to build OFED 4.8 on RHEL 7.2 with native kernel

Sun Nov 27 23:03:34 PST 2016

Thanks Rupert. I'll study the notes and look for the postings.

Ram

From: Rupert Dance [mailto:rsdance at soft-forge.com]
Sent: Monday, November 28, 2016 6:13 AM
To: Amrani, Ram <Ram.Amrani at cavium.com>; ewg at lists.openfabrics.org
Cc: Elior, Ariel <Ariel.Elior at cavium.com>; Rahman, Ameen <Ameen.Rahman at cavium.com>
Subject: FW: [ewg] Failure to build OFED 4.8 on RHEL 7.2 with native kernel

Hi Ram,
We have made some changes to our process in our transition from OFED 3.18-x to OFED 4.8. I have attached my old process notes from OFED 3.18-x which may be helpful but please realize that I need to update these to reflect the changes we have made for OFED 4.8.

Here are a few things that may help:

1.     Many of the OFED User packages have been moved.

a.      Previous location for everything: http://www.openfabrics.org/downloads/

b.     New location for some: (https://github.com/linux-rdma/rdma-core)

2.     Check out the attached ofed.conf-example file

a.      You can use this file to select which packages you do not want to install.

3.     Check out the attached Readme file and OFED Tips (dated wrong but has 4.8 info in it)

4.     Use the new installation flag '--without-<package>' to eliminate things that are not working for you.

a.      For example ./install.pl --all --without-ocrdma --without-nfsrdma

5.     Review Vladimir Sokolovsky postings to the EWG reflector (see one attached)

Thanks

Rupert

From: Amrani, Ram [mailto:Ram.Amrani at cavium.com]
Sent: Sunday, November 27, 2016 12:05 PM
To: Rupert Dance; ewg at lists.openfabrics.org<mailto:ewg at lists.openfabrics.org>
Cc: Elior, Ariel; Rahman, Ameen
Subject: RE: [ewg] Failure to build OFED 4.8 on RHEL 7.2 with native kernel

Thanks Rupert, I was now able to build compat-rdma.

However I'm uncertain about my process -

1.      I've ran install.pl excluding compat-rdma, compat-rdma-devel (and vendors)

2.      I've extracted the compat-rdma rpm, configured it as you suggested and ran 'make install'

I observed that after the installation I got quite a few symbol version problems with - iser/t (but iSER was included), xprtrdma and svcrdma (that I don't even see how can they be included or excluded).
And also after this process, I'm lacking the source placed under /usr/src/compat-rdma-4.8/ prevents me from building our own driver.
Is there a better process to build OFED, with sources , and perhaps one that will work well with the above modules?

Ram

From: Rupert Dance [mailto:rsdance at soft-forge.com]
Sent: Sunday, November 27, 2016 6:09 PM
To: Amrani, Ram <Ram.Amrani at cavium.com<mailto:Ram.Amrani at cavium.com>>; ewg at lists.openfabrics.org<mailto:ewg at lists.openfabrics.org>
Cc: Elior, Ariel <Ariel.Elior at cavium.com<mailto:Ariel.Elior at cavium.com>>; Rahman, Ameen <Ameen.Rahman at cavium.com<mailto:Ameen.Rahman at cavium.com>>
Subject: RE: [ewg] Failure to build OFED 4.8 on RHEL 7.2 with native kernel

Hi Ram,

There are still some backports that are not complete and qib is one of them. Here is a suggested work around from Vlad back on 11/2/2016

________________________________

There are no QIB backports yet in OFED-4.8.

If you work on RHEL7.2 then use the following configuration parameters:

# ./configure --with-core-mod --with-user_mad-mod --with-user_access-mod --with-addr_trans-mod --with-mlx4-mod --with-mlx4_en-mod --with-ipoib-mod

________________________________

There may be some other modules that have been added since 11/2/2016 but this should get you started.

Here is what I see for srpms listed in OFED-4.8-20161120-0830.tgz

srpms in OFED-4.8-20161120-0830.tgz

Inside rdma_core

[cid:image001.png at 01D248DF.DE8969A0]

[cid:image002.png at 01D248DF.DE8969A0]

srpms in OFED-3.18-2.tgz

[cid:image003.png at 01D248DF.DE8969A0]

Hope this helps

Rupert

-----Original Message-----

From: ewg [mailto:ewg-bounces at lists.openfabrics.org] On Behalf Of Amrani, Ram

Sent: Sunday, November 27, 2016 9:42 AM

To: ewg at lists.openfabrics.org<mailto:ewg at lists.openfabrics.org>

Cc: Elior, Ariel; Rahman, Ameen

Subject: [ewg] Failure to build OFED 4.8 on RHEL 7.2 with native kernel

Hi All,

I have downloaded the latest OFED build OFED-4.8-20161120-0830 and tried to install it on RHEL 7.2, with native kernel 3.10.0-327.el7.x86_64.

I was expecting it to build well since the readme states under section "1.2 Supported Platforms and Operating Systems":

  o   Linux Operating Systems:

        - RedHat EL7.2          3.10.0-327.el7

        - SLES12                3.12.28-4

        - SLES12.1              3.12.49-11.1

        - kernel.org            4.8    *

The build failed on 'qib', and when I disabled all vendors it still failed but this time on iser.

The iSER failure:

    /var/tmp/OFED_topdir/BUILD/compat-rdma-4.8/drivers/infiniband/ulp/iser/iscsi_iser.h:51:23: fatal error: scsi/iser.h: No such file or directory

    #include <scsi/iser.h>

This hints that a kernel version higher than 4.4  is required because that specific file was first introduced in kernel 4.5.

(the qib failure was similar - implicit declaration for a function introduced in a newer kernel).

Perhaps there's a step I've missed in the installation?

Is this combination supposed to work? Has anyone tried it?

Thanks,

Ram

_______________________________________________

ewg mailing list

ewg at lists.openfabrics.org<mailto:ewg at lists.openfabrics.org>

http://lists.openfabrics.org/mailman/listinfo/ewg
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/ewg/attachments/20161128/998d3c9a/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 15219 bytes
Desc: image001.png
URL: <http://lists.openfabrics.org/pipermail/ewg/attachments/20161128/998d3c9a/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 3196 bytes
Desc: image002.png
URL: <http://lists.openfabrics.org/pipermail/ewg/attachments/20161128/998d3c9a/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 21680 bytes
Desc: image003.png
URL: <http://lists.openfabrics.org/pipermail/ewg/attachments/20161128/998d3c9a/attachment-0002.png>