[ofa-general] Supported list of Kernels
John Russo
john.russo at qlogic.com
Tue Jun 19 08:19:46 PDT 2007
The list below shows the same kernel for 3 versions of RedHat
- RedHat EL4 up4: 2.6.9-42.ELsmp
- RedHat EL4 up5: 2.6.9-42.ELsmp
- RedHat EL5: 2.6.9-42.ELsmp
The kernels that exist "out of the box" for each release are
- RedHat EL4 up4: 2.6.9-42.ELsmp (no change)
- RedHat EL4 up5: 2.6.9-55.ELsmp
- RedHat EL5: 2.6.18-8.ELsmp
Is 2.6.9-42 really the only kernel supported/tested or is this a
cut-and-paste mistake:
-----Original Message-----
From: general-bounces at lists.openfabrics.org
[mailto:general-bounces at lists.openfabrics.org] On Behalf Of
general-request at lists.openfabrics.org
Sent: Tuesday, June 19, 2007 11:06 AM
To: general at lists.openfabrics.org
Subject: general Digest, Vol 5, Issue 67
Send general mailing list submissions to
general at lists.openfabrics.org
To subscribe or unsubscribe via the World Wide Web, visit
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
or, via email, send a message with subject or body 'help' to
general-request at lists.openfabrics.org
You can reach the person managing the list at
general-owner at lists.openfabrics.org
When replying, please edit your Subject line so it is more specific
than "Re: Contents of general digest..."
Today's Topics:
1. Re: Build error 1.2rc5 (Erez Zilber)
2. [PATCH] libmlx4: fix adjustments for minimum qp capabilities
in mlx4_create_qp (Jack Morgenstein)
3. RE: Build error 1.2rc5 (Baur, Eric)
4. Anouncement: OFED 1.2 rc6 is avilable (Tziporet Koren)
5. Re: Anouncement: OFED 1.2 rc6 is avilable (Mahmoud Hanafi)
----------------------------------------------------------------------
Message: 1
Date: Tue, 19 Jun 2007 16:45:03 +0300
From: Erez Zilber <erezz at voltaire.com>
Subject: Re: [ofa-general] Build error 1.2rc5
To: MAHMOUD HANAFI <hanafim.ctr at asc.hpc.mil>
Cc: general at lists.openfabrics.org
Message-ID: <4677DDDF.9080109 at voltaire.com>
Content-Type: text/plain; charset=ISO-8859-1
MAHMOUD HANAFI wrote:
> Any one else seen these build error with 1.2rc5?
Try to send this to ewg at lists.openfabrics.org.
Erez
------------------------------
Message: 2
Date: Tue, 19 Jun 2007 16:47:41 +0300
From: Jack Morgenstein <jackm at dev.mellanox.co.il>
Subject: [ofa-general] [PATCH] libmlx4: fix adjustments for minimum qp
capabilities in mlx4_create_qp
To: Roland Dreier <rdreier at cisco.com>
Cc: general at lists.openfabrics.org
Message-ID: <200706191647.41336.jackm at dev.mellanox.co.il>
Content-Type: text/plain; charset="us-ascii"
Need to adjust minimum qp capability values prior to size and max
resource
calculations.
Correct the rq values afterwards (as before) if have an srq.
Signed-off-by: Jack Morgenstein <jackm at dev.mellanox.co.il>
Index: new_connectx_user/src/userspace/libmlx4/src/verbs.c
===================================================================
--- new_connectx_user.orig/src/userspace/libmlx4/src/verbs.c
2007-06-18 09:33:04.000000000 +0300
+++ new_connectx_user/src/userspace/libmlx4/src/verbs.c 2007-06-19
09:47:10.000000000 +0300
@@ -355,6 +355,12 @@ struct ibv_qp *mlx4_create_qp(struct ibv
if (!qp)
return NULL;
+ /* adjust minimum cap values */
+ attr->cap.max_recv_wr = attr->cap.max_recv_wr ?
attr->cap.max_recv_wr : 1;
+ attr->cap.max_recv_sge = attr->cap.max_recv_sge ?
attr->cap.max_recv_sge : 1;
+ attr->cap.max_send_wr = attr->cap.max_send_wr ?
attr->cap.max_send_wr : 1;
+ attr->cap.max_send_sge = attr->cap.max_send_sge ?
attr->cap.max_send_sge : 1;
+
mlx4_calc_sq_wqe_size(&attr->cap, attr->qp_type, qp);
/*
@@ -366,9 +372,7 @@ struct ibv_qp *mlx4_create_qp(struct ibv
qp->rq.wqe_cnt = align_queue_size(attr->cap.max_recv_wr);
if (attr->srq)
- attr->cap.max_recv_wr = qp->rq.wqe_cnt = 0;
- else if (attr->cap.max_recv_sge < 1)
- attr->cap.max_recv_sge = 1;
+ attr->cap.max_recv_wr = attr->cap.max_recv_sge =
qp->rq.wqe_cnt = 0;
if (mlx4_alloc_qp_buf(pd, &attr->cap, attr->qp_type, qp))
goto err;
------------------------------
Message: 3
Date: Tue, 19 Jun 2007 10:25:52 -0400
From: "Baur, Eric" <Eric.Baur at gs.com>
Subject: RE: [ofa-general] Build error 1.2rc5
To: <general at lists.openfabrics.org>
Message-ID:
<4DCBAA39733E8048992FB7737126041902829564 at gsmbnbp23es.firmwide.corp.gs.c
om>
Content-Type: text/plain; charset="us-ascii"
Yes. The issue seems to be caused by the fact that both 32-bit and
64-bit libs are written to /usr/lib rather than /usr/lib and
/usr/lib64/.
A quick workaround is to modify ofed.conf to only build 64 bit
(build_32bit=0).
-Eric
-----Original Message-----
From: general-bounces at lists.openfabrics.org
[mailto:general-bounces at lists.openfabrics.org] On Behalf Of MAHMOUD
HANAFI
Sent: Tuesday, June 19, 2007 9:31 AM
To: general at lists.openfabrics.org
Subject: [ofa-general] Build error 1.2rc5
Any one else seen these build error with 1.2rc5?
RPM build errors:
user vlad does not exist - using root
group vlad does not exist - using root
user vlad does not exist - using root
group vlad does not exist - using root
File listed twice: /usr/lib/libibverbs.so.1
File listed twice: /usr/lib/libibverbs.so.1.0.0
File listed twice: /usr/lib/libibverbs.a
File listed twice: /usr/lib/libibverbs.so
File listed twice: /usr/lib/libibcm.so.1
File listed twice: /usr/lib/libibcm.so.1.0
File listed twice: /usr/lib/libibcm.so.1.0.0
File listed twice: /usr/lib/libibcm.so
File listed twice: /usr/lib/libmthca-rdmav2.so
File listed twice: /usr/lib/libmthca.so
File listed twice: /usr/lib/libmthca.a
File listed twice: /usr/lib/libcxgb3-rdmav2.so
File listed twice: /usr/lib/libcxgb3.so
File listed twice: /usr/lib/libcxgb3.a
File listed twice: /usr/lib/libipathverbs-rdmav2.so
File listed twice: /usr/lib/libipathverbs.so
File listed twice: /usr/lib/libipathverbs.a
File listed twice: /usr/lib/libsdp.so
File listed twice: /usr/lib/libsdp.so.1
File listed twice: /usr/lib/libsdp.so.1.0.0
File listed twice: /usr/lib/libibcommon.so.1
File listed twice: /usr/lib/libibcommon.so.1.0.0
File listed twice: /usr/lib/libibcommon.a
File listed twice: /usr/lib/libibcommon.so
File listed twice: /usr/lib/libibmad.so.1
File listed twice: /usr/lib/libibmad.so.1.2.0
File listed twice: /usr/lib/libibmad.a
File listed twice: /usr/lib/libibmad.so
File listed twice: /usr/lib/libibumad.so.1
File listed twice: /usr/lib/libibumad.so.1.0.0
File listed twice: /usr/lib/libibumad.a
File listed twice: /usr/lib/libibumad.so
File listed twice: /usr/lib/libosmcomp.so.1
File listed twice: /usr/lib/libosmcomp.so.1.0.1
File listed twice: /usr/lib/libosmcomp-2.1.3.so
File listed twice: /usr/lib/libosmcomp.a
File listed twice: /usr/lib/libosmcomp.so
File listed twice: /usr/lib/libopensm.so.1
File listed twice: /usr/lib/libopensm.so.1.1.0
File listed twice: /usr/lib/libopensm-2.1.4.so
File listed twice: /usr/lib/libopensm.a
File listed twice: /usr/lib/libopensm.so
File listed twice: /usr/lib/libosmvendor.so.2
File listed twice: /usr/lib/libosmvendor.so.2.0.0
File listed twice: /usr/lib/libosmvendor-2.1.3.so
File listed twice: /usr/lib/libosmvendor.a
File listed twice: /usr/lib/libosmvendor.so
File listed twice: /usr/lib/libosmvendor_openib.so
File listed twice: /usr/lib/librdmacm.so.1
File listed twice: /usr/lib/librdmacm.so.1.0.0
File listed twice: /usr/lib/librdmacm.so.1.0.1
File listed twice: /usr/lib/librdmacm.so
File not found: /var/tmp/OFED/etc/dat.conf
File listed twice: /usr/lib/libdaplcma.a
File listed twice: /usr/lib/libdat.a
ERROR: Failed executing "rpmbuild --rebuild --define '_topdir
/var/tmp/OFEDRPM' --define '_prefix
/usr' --define 'build_root /var/tmp/OFED' --define 'configure_options
--with-dapl --with-ipoibtools
--with-libcxgb3 --with-libibcm --with-libibcommon --with-libibmad
--with-libibumad --with-libibverbs
--with-libipathverbs --with-libmthca --with-opensm --with-librdmacm
--with-libsdp
--with-openib-diags --with-qlvnictools --with-sdpnetstat --with-srptools
--with-mstflint
--with-perftest --with-tvflash --sysconfdir=/usr/etc --mandir=/usr/man'
--define
'configure_options32 --with-dapl --with-ipoibtools --with-libcxgb3
--with-libibcm --with-libibcommon
--with-libibmad --with-libibumad --with-libibverbs --with-libipathverbs
--with-libmthca
--with-opensm --with-librdmacm --with-libsdp --with-openib-diags
--with-qlvnictools
--with-sdpnetstat --with-srptools --sysconfdir=/usr/etc
--mandir=/usr/man' --define 'build_32bit 1'
--define '_mandir /usr/man'
/tmp/OFED-1.2-rc5/SRPMS/ofa_user-1.2-rc5.src.rpm"
--
Mahmoud Hanafi
Senior System Administrator
ASC/MSRC
www.asc.hpc.mil
2435 5th Street
WPAFB, OHIO 45433
(937) 255-1536
_______________________________________________
general mailing list
general at lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
To unsubscribe, please visit
http://openib.org/mailman/listinfo/openib-general
------------------------------
Message: 4
Date: Tue, 19 Jun 2007 17:47:43 +0300
From: "Tziporet Koren" <tziporet at mellanox.co.il>
Subject: [ofa-general] Anouncement: OFED 1.2 rc6 is avilable
To: <ewg at lists.openfabrics.org>
Cc: general at lists.openfabrics.org
Message-ID:
<6C2C79E72C305246B504CBA17B5500C9015636A9 at mtlexch01.mtl.com>
Content-Type: text/plain; charset="us-ascii"
Hi,
OFED 1.2-RC6 is available on
http://www.openfabrics.org/builds/ofed-1.2/
File: OFED-1.2-rc6.tgz
To get BUILD_ID run ofed_info
Please report any issues in bugzilla https://bugs.openfabrics.org/
The GA release is expected this Friday (June 22)
I attach the OFED RN - please review and send me comments to the final
release
Thanks,
Tziporet
========================================================================
Release information:
OS support:
Novell:
- SLES 9.0 SP3
- SLES10
- SLES10 SP1 RC5
Redhat:
- Redhat EL4 up3, up4 and up5
- Redhat EL5
kernel.org:
- 2.6.20
- 2.6.19
Note: Kernel 2.6.21, Fedora C6 and SuSE Pro 10 are not part of the
official list.
We keep the backport patches for these OSes and make sure OFED compile
and loaded properly but will not do full QA cycle.
Systems:
* x86_64
* x86
* ia64
* ppc64
Main changes from OFED-1.1-rc5:
===============================
1. Fixed 6 bugs (see attached for fixed issues)
See bugzilla for all open issues.
Tasks that should be completed for the GA release:
1. Complete all documentation (release notes, README, etc.)
2. Run all QA tests on all platforms
-------------- next part --------------
A non-text attachment was scrubbed...
Name: rc6_fixed_bugs.csv
Type: application/octet-stream
Size: 636 bytes
Desc: rc6_fixed_bugs.csv
Url :
http://lists.openfabrics.org/pipermail/general/attachments/20070619/ad94
d792/rc6_fixed_bugs-0001.obj
-------------- next part --------------
Open Fabrics Enterprise Distribution (OFED)
Version 1.2
Release Notes
June 2007
========================================================================
=======
Table of Contents
========================================================================
=======
1. Overview, which includes:
- OFED Distribution Rev 1.2 Contents
- Supported Platforms and Operating Systems
- Supported HCA and RNIC Adapter Cards and Firmware Versions
- Tested Switch Platforms
- Third party Test Packages
- OFED sources
2. Main Changes from OFED 1.1
3. Fixed Bugs
4. Known Issues
========================================================================
=======
1. Overview
========================================================================
=======
These are the release notes of OpenFabrics Enterprise Distribution
(OFED)
release 1.2. The OFED software package is composed of several software
modules,
and is intended for use on a computer cluster constructed as an
InfiniBand
subnet or iWARP network.
Note: If you plan to upgrade the OFED package on your cluster, please
upgrade
all of its nodes to this new version.
1.1 OFED 1.2 Contents
---------------------
The OFED package contains the following components:
o OpenFabrics core and ULPs:
- IB HCA drivers (mthca, ipath, ehca)
- iWARP RNIC driver (cxgb3)
- core
- Upper Layer Protocols: IPoIB, SDP, SRP Initiator, iSER Host,
RDS,
uDAPL and VNIC.
o OpenFabrics utilities:
- OpenSM (OSM): InfiniBand Subnet Manager
- Diagnostic tools
- Performance tests
o MPI:
- OSU MPI stack supporting the InfiniBand and iWARP interface
- Open MPI stack supporting the InfiniBand and iWARP interface
- OSU MVAPICH2 stack supporting the InfiniBand and iWARP
interface
- MPI benchmark tests (OSU benchmarks, Intel MPI benchmarks,
Presta)
o Extra packages:
- open-iscsi: open-iscsi initiator with iSER support
- ib-bonding: Bonding driver for IPoIB interface
o Sources of all software modules (under conditions mentioned in the
modules'
LICENSE files)
o Documentation
Notes:
1. The cxgb3 driver is in technology preview state.
2. The Virtual NIC (VNIC) driver is presented as a technology preview on
OFED 1.2.
3. All other OFED components are of production quality.
4. See release notes for each package in the docs directory.
5. Any Topspin copyright belongs to Cisco Systems, Inc.
1.2 Supported Platforms and Operating Systems
---------------------------------------------
o CPU architectures:
- x86_64
- x86
- ia64
- ppc64
o Linux Operating Systems:
- RedHat EL4 up3: 2.6.9-34.ELsmp
- RedHat EL4 up4: 2.6.9-42.ELsmp
- RedHat EL4 up5: 2.6.9-42.ELsmp
- RedHat EL5: 2.6.9-42.ELsmp
- SLES9 SP3: 2.6.5-7.244-smp
- SLES10: 2.6.16.21-0.8-smp
- kernel.org: 2.6.19.x and 2.6.20.x
1.3 HCAs and RNICs Supported
----------------------------
This release supports IB HCAs by Mellanox Technologies, Qlogic and IBM
as
well as iWARP RNICs by Chelsio Communications.
o Mellanox Technologies HCAs:
- InfiniHost (fw-23108 Rev 3.5.000)
- InfiniHost III Ex (MemFree: fw-25218 Rev 5.2.000
with memory: fw-25208 Rev 4.8.200)
- InfiniHost III Lx (fw-25204 Rev 1.2.000)
The SDR and DDR modes of the InfiniHost III family are
supported.
For official firmware versions please see:
http://www.mellanox.com/support/firmware_table.php
o Qlogic HCAs:
- QHT6040 (PathScale InfiniPath HT-460)
- QHT6140 (PathScale InfiniPath HT-465)
- QLE6140 (PathScale InfiniPath PE-880)
o IBM HCAs:
- GX Dual-port 4x IB HCA
- GX Dual-port 12x IB HCA
o Chelsio RNICs:
- S310/S320 10GbE Storage Accelerators
- R310E 10GbE iWARP Adapters
1.4 Switches Supported
----------------------
This release was tested with switches and gateways provided by the
following
companies:
- Cisco
- Voltaire
- Qlogic
- Flextronics
1.5 Third Party Packages
------------------------
The following third party packages have been tested with OFED 1.2:
1. Intel MPI, Version 3.0 - Package ID: l_mpi_p_3.0.043
2. HP MPI, Version 2.2.5
1.6 OFED Sources
----------------
Source repositories:
http://www.openfabrics.org/git/
Kernel sources: ~vlad/ofed_1_2/.git
User level Sources are located in all git trees starting with: ofed_1_2/
The kernel sources are based on Linux 2.6.20 mainline kernel. Its
patches
are included in the OFED sources directory.
For details see HOWTO.build_ofed.
========================================================================
=======
2. Main Changes from OFED 1.1
========================================================================
=======
Note: For details regarding the various changes, please see the release
notes
for each package in the docs directory.
2.1 General changes
o Kernel code based on 2.6.20
o New kernel modules: SA Cache, RDS, VNIC, bonding
o High availability of SRP and IPoIB in GA level
o Added iWARP support (with Chelsio driver)
o MAN pages for libraries (libibverbs and librdmacm)
2.1 IPoIB
o IPoIB Connected Mode
o High availability support using the bonding module.
2.2 SDP
o netstat is now available
o Improved message BW
- 10X for small messages
- 5X for medium messages
o Scalability
- Added a memory consumption limit
2.3 SRP
o High availability is now supported for all systems.
2.4 iSER
o Testing more platforms (e.g., ppc64 and ia64)
o Updated packages for ISCSI kernel & user components bundled
with OFED.
2.5 uDAPL
o Scalability features needed for Intel MPI
2.6 Libraries
a. libibverbs 1.1
o Fork support (requires apps change)
o Better low-level driver handling, including multiple
drivers linked
in statically
o Documentation: man pages
b. librdmacm (uCMA) 1.0
o Multicast joining from user space
o UD support
o Documentation: man pages
2.7 OSM
o Routing improvements
o Performance improvement to min hop and up/down of over an
order of magnitude
o New fat-tree and LASH algorithms
o SA optional record support "virtually" complete
o IB router enablement
o SA database dump/restore
2.8 Management
o Many diagnostic improvements since OFED 1.1 (see detailed RN)
o ibdiagui: A GUI for ibdiagnet
2.9 Install
o Default prefix directory is now /usr
2.6 MPI:
a. OSU MVAPICH
o Version was updated to 0.9.9
b. Open MPI
o Version was updated to 1.2.1
o See http://www.open-mpi.org/svn/new.php for details
c. OSU MVAPICH2
o MVAPICH2 version 0.98 was added to the OFED package.
d. Common MPI setup sourcing
Simple menu-driven interface to choose which MPI
implementation to set as
the default on a per-user and/or system-wide basis
2.7 iWARP Support
o Chelsio NIC supported
o Verbs and CMA APIs are the same as InfiniBand
o ULPs supported
- MPI (mvapich2 tested)
- uDAPL
o Basic Testing
- uDAPL
- mvapich2
- NFS-RDMA
o Status: Beta
========================================================================
=======
3. Fixed Bugs
========================================================================
=======
1. OFED installation now supports installing lib32 on 64-bit systems.
2. Hotplug removal does not hang the system when the device is used by
the uverbs interface.
3. MVAPICH now works on ppc64.
4. libibcm is now thread safe.
Bugs fixed in each package are reported in the package's release notes.
========================================================================
=======
4. Known Issues
========================================================================
=======
The following is a list of major limitations and known issues of the
various
components of the OFED 1.2 release.
1. Memory registration by theuser is limited according to the
administrator
setting. See "Pinning (Locking) User Memory Pages" in OFED_tips.txt
for
system configuration.
2. Fork support from kernel 2.6.12 and above is available provided
that applications do not use threads. The fork() is supported as long
as the parent process does not run before the child exits or calls
exec().
The former can be achieved by calling wait(childpid), and the latter
can be
achieved by application specific means. The Posix system() call is
supported.
3. The ipath driver is supported only on 64-bit platforms.
4. There are issues using Intel's MPI with the Qlogic card driver that
cause
failures.
Note: See the release notes of each component for additional issues.
------------------------------
Message: 5
Date: Tue, 19 Jun 2007 11:05:50 -0400
From: Mahmoud Hanafi <mhanafi at csc.com>
Subject: Re: [ofa-general] Anouncement: OFED 1.2 rc6 is avilable
To: "Tziporet Koren" <tziporet at mellanox.co.il>
Cc: general-bounces at lists.openfabrics.org, ewg at lists.openfabrics.org,
general at lists.openfabrics.org
Message-ID:
<OFAEAAE34D.6E969F93-ON852572FF.00523E99-852572FF.0052EE81 at csc.com>
Content-Type: text/plain; charset="us-ascii"
Skipped content of type multipart/alternative-------------- next part
--------------
A non-text attachment was scrubbed...
Name: rc6_fixed_bugs.csv
Type: application/octet-stream
Size: 636 bytes
Desc: not available
Url :
http://lists.openfabrics.org/pipermail/general/attachments/20070619/8bf8
57f3/rc6_fixed_bugs.obj
-------------- next part --------------
Open Fabrics Enterprise Distribution (OFED)
Version 1.2
Release Notes
June 2007
========================================================================
=======
Table of Contents
========================================================================
=======
1. Overview, which includes:
- OFED Distribution Rev 1.2 Contents
- Supported Platforms and Operating Systems
- Supported HCA and RNIC Adapter Cards and Firmware Versions
- Tested Switch Platforms
- Third party Test Packages
- OFED sources
2. Main Changes from OFED 1.1
3. Fixed Bugs
4. Known Issues
========================================================================
=======
1. Overview
========================================================================
=======
These are the release notes of OpenFabrics Enterprise Distribution
(OFED)
release 1.2. The OFED software package is composed of several software
modules,
and is intended for use on a computer cluster constructed as an
InfiniBand
subnet or iWARP network.
Note: If you plan to upgrade the OFED package on your cluster, please
upgrade
all of its nodes to this new version.
1.1 OFED 1.2 Contents
---------------------
The OFED package contains the following components:
o OpenFabrics core and ULPs:
- IB HCA drivers (mthca, ipath, ehca)
- iWARP RNIC driver (cxgb3)
- core
- Upper Layer Protocols: IPoIB, SDP, SRP Initiator, iSER Host,
RDS,
uDAPL and VNIC.
o OpenFabrics utilities:
- OpenSM (OSM): InfiniBand Subnet Manager
- Diagnostic tools
- Performance tests
o MPI:
- OSU MPI stack supporting the InfiniBand and iWARP interface
- Open MPI stack supporting the InfiniBand and iWARP interface
- OSU MVAPICH2 stack supporting the InfiniBand and iWARP
interface
- MPI benchmark tests (OSU benchmarks, Intel MPI benchmarks,
Presta)
o Extra packages:
- open-iscsi: open-iscsi initiator with iSER support
- ib-bonding: Bonding driver for IPoIB interface
o Sources of all software modules (under conditions mentioned in the
modules'
LICENSE files)
o Documentation
Notes:
1. The cxgb3 driver is in technology preview state.
2. The Virtual NIC (VNIC) driver is presented as a technology preview on
OFED 1.2.
3. All other OFED components are of production quality.
4. See release notes for each package in the docs directory.
5. Any Topspin copyright belongs to Cisco Systems, Inc.
1.2 Supported Platforms and Operating Systems
---------------------------------------------
o CPU architectures:
- x86_64
- x86
- ia64
- ppc64
o Linux Operating Systems:
- RedHat EL4 up3: 2.6.9-34.ELsmp
- RedHat EL4 up4: 2.6.9-42.ELsmp
- RedHat EL4 up5: 2.6.9-42.ELsmp
- RedHat EL5: 2.6.9-42.ELsmp
- SLES9 SP3: 2.6.5-7.244-smp
- SLES10: 2.6.16.21-0.8-smp
- kernel.org: 2.6.19.x and 2.6.20.x
1.3 HCAs and RNICs Supported
----------------------------
This release supports IB HCAs by Mellanox Technologies, Qlogic and IBM
as
well as iWARP RNICs by Chelsio Communications.
o Mellanox Technologies HCAs:
- InfiniHost (fw-23108 Rev 3.5.000)
- InfiniHost III Ex (MemFree: fw-25218 Rev 5.2.000
with memory: fw-25208 Rev 4.8.200)
- InfiniHost III Lx (fw-25204 Rev 1.2.000)
The SDR and DDR modes of the InfiniHost III family are
supported.
For official firmware versions please see:
http://www.mellanox.com/support/firmware_table.php
o Qlogic HCAs:
- QHT6040 (PathScale InfiniPath HT-460)
- QHT6140 (PathScale InfiniPath HT-465)
- QLE6140 (PathScale InfiniPath PE-880)
o IBM HCAs:
- GX Dual-port 4x IB HCA
- GX Dual-port 12x IB HCA
o Chelsio RNICs:
- S310/S320 10GbE Storage Accelerators
- R310E 10GbE iWARP Adapters
1.4 Switches Supported
----------------------
This release was tested with switches and gateways provided by the
following
companies:
- Cisco
- Voltaire
- Qlogic
- Flextronics
1.5 Third Party Packages
------------------------
The following third party packages have been tested with OFED 1.2:
1. Intel MPI, Version 3.0 - Package ID: l_mpi_p_3.0.043
2. HP MPI, Version 2.2.5
1.6 OFED Sources
----------------
Source repositories:
http://www.openfabrics.org/git/
Kernel sources: ~vlad/ofed_1_2/.git
User level Sources are located in all git trees starting with: ofed_1_2/
The kernel sources are based on Linux 2.6.20 mainline kernel. Its
patches
are included in the OFED sources directory.
For details see HOWTO.build_ofed.
========================================================================
=======
2. Main Changes from OFED 1.1
========================================================================
=======
Note: For details regarding the various changes, please see the release
notes
for each package in the docs directory.
2.1 General changes
o Kernel code based on 2.6.20
o New kernel modules: SA Cache, RDS, VNIC, bonding
o High availability of SRP and IPoIB in GA level
o Added iWARP support (with Chelsio driver)
o MAN pages for libraries (libibverbs and librdmacm)
2.1 IPoIB
o IPoIB Connected Mode
o High availability support using the bonding module.
2.2 SDP
o netstat is now available
o Improved message BW
- 10X for small messages
- 5X for medium messages
o Scalability
- Added a memory consumption limit
2.3 SRP
o High availability is now supported for all systems.
2.4 iSER
o Testing more platforms (e.g., ppc64 and ia64)
o Updated packages for ISCSI kernel & user components bundled
with OFED.
2.5 uDAPL
o Scalability features needed for Intel MPI
2.6 Libraries
a. libibverbs 1.1
o Fork support (requires apps change)
o Better low-level driver handling, including multiple
drivers linked
in statically
o Documentation: man pages
b. librdmacm (uCMA) 1.0
o Multicast joining from user space
o UD support
o Documentation: man pages
2.7 OSM
o Routing improvements
o Performance improvement to min hop and up/down of over an
order of magnitude
o New fat-tree and LASH algorithms
o SA optional record support "virtually" complete
o IB router enablement
o SA database dump/restore
2.8 Management
o Many diagnostic improvements since OFED 1.1 (see detailed RN)
o ibdiagui: A GUI for ibdiagnet
2.9 Install
o Default prefix directory is now /usr
2.6 MPI:
a. OSU MVAPICH
o Version was updated to 0.9.9
b. Open MPI
o Version was updated to 1.2.1
o See http://www.open-mpi.org/svn/new.php for details
c. OSU MVAPICH2
o MVAPICH2 version 0.98 was added to the OFED package.
d. Common MPI setup sourcing
Simple menu-driven interface to choose which MPI
implementation to set as
the default on a per-user and/or system-wide basis
2.7 iWARP Support
o Chelsio NIC supported
o Verbs and CMA APIs are the same as InfiniBand
o ULPs supported
- MPI (mvapich2 tested)
- uDAPL
o Basic Testing
- uDAPL
- mvapich2
- NFS-RDMA
o Status: Beta
========================================================================
=======
3. Fixed Bugs
========================================================================
=======
1. OFED installation now supports installing lib32 on 64-bit systems.
2. Hotplug removal does not hang the system when the device is used by
the uverbs interface.
3. MVAPICH now works on ppc64.
4. libibcm is now thread safe.
Bugs fixed in each package are reported in the package's release notes.
========================================================================
=======
4. Known Issues
========================================================================
=======
The following is a list of major limitations and known issues of the
various
components of the OFED 1.2 release.
1. Memory registration by theuser is limited according to the
administrator
setting. See "Pinning (Locking) User Memory Pages" in OFED_tips.txt
for
system configuration.
2. Fork support from kernel 2.6.12 and above is available provided
that applications do not use threads. The fork() is supported as long
as the parent process does not run before the child exits or calls
exec().
The former can be achieved by calling wait(childpid), and the latter
can be
achieved by application specific means. The Posix system() call is
supported.
3. The ipath driver is supported only on 64-bit platforms.
4. There are issues using Intel's MPI with the Qlogic card driver that
cause
failures.
Note: See the release notes of each component for additional issues.
------------------------------
_______________________________________________
general mailing list
general at lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
End of general Digest, Vol 5, Issue 67
**************************************
More information about the general
mailing list