[openib-general] OFED-1.0-rc6 is available

Wed Jun 7 07:58:32 PDT 2006

Hi All,

We have prepared OFED 1.0 RC6.

Release location: https://openib.org/svn/gen2/branches/1.0/ofed/releases

File: OFED-1.0-rc6.tgz

Note: This release is the code freeze release for OFED 1.0. Only
showstopper bugs will be fixed.

BUILD_ID:

OFED-1.0-rc6

openib-1.0 (REV=7772)

# User space

https://openib.org/svn/gen2/branches/1.0/src/userspace

# Kernel space

https://openib.org/svn/gen2/branches/1.0/ofed/tags/rc6/linux-kernel

Git:

ref: refs/heads/for-2.6.17

commit d9ec5ad24ce80b7ef69a0717363db661d13aada5

# MPI

mpi_osu-0.9.7-mlx2.1.0.tgz

openmpi-1.1b1-1.src.rpm

mpitests-1.0-0.src.rpm 

OSes:

    * RH EL4 up2: 2.6.9-22.ELsmp

    * RH EL4 up3: 2.6.9-34.ELsmp

    * Fedora C4: 2.6.11-1.1369_FC4

    * SLES10 RC2: 2.6.16.16-1.6-smp

    * SUSE 10 Pro: 2.6.13-15-smp

    * kernel.org: 2.6.16.x

Systems:

    * x86_64

    * x86

    * ia64

    * ppc64

Main changes from RC5:

1.       SDP - libsdp implementation of RFC proposed by Eitan Zahavi;
bug fixes in kernel module. See details below.

2.       SRP - bug fixes

3.       Open MPI - new package based on 1.1b1-1

4.       OSU-MPI - See details below.

5.       iSER: Enhanced to support SLES 10 RC1.

6.      IPoIB default configuration changed:

a.       IPoIB configuration at install time is now optional.

b.       The default configuration of IPoIB interfaces (if performed at
install time) is DHCP; it can be changed during interactive
installation.

c.       For unattended installation one can give a new configuration
file. See the example below.

7.       Bug Fixes.

Package limitations:

1.       The ipath driver does not compile/load on most systems. To be
fixed in final release. 
Meanwhile, one must work with custom build and not choose ipath driver,
or change in the conf file: ib_ipath=n.
I attached a reference ofed-no_ipath.conf file. 
Once Qlogic fixes the backport patches I will publish them on the
release page so any one interested can use them with this release.

2.       iSER is working on SuSE SLES 10 RC1 only

IPoIB configuration file example:

If you are going to install OFED on a 32 node cluster and want to use
static IPoIB configuration based on Ethernet device configuration follow
instructions below:

Assume that the Ethernet IP addresses (eth0 interfaces) of the cluster
are: 10.0.0.1 - 10.0.0.32

and you want to assign to ib0 IP addresses in the range: 192.168.0.1 -
192.168.0.32

and to ib1 IP addresses in the range: 172.16.0.1 - 172.16.0.32

Then create the file ofed_net.conf with the following lines:

LAN_INTERFACE_ib0=eth0
IPADDR_ib0=192.168.'*'.'*'
NETMASK_ib0=255.255.0.0
NETWORK_ib0=192.168.0.0
BROADCAST_ib0=192.168.255.255
ONBOOT_ib0=1
LAN_INTERFACE_ib1=eth0
IPADDR_ib1=172.16.'*'.'*'
NETMASK_ib1=255.255.0.0
NETWORK_ib1=172.16.0.0
BROADCAST_ib1=172.16.255.255
ONBOOT_ib1=1

Note: '*' will be replaced by the corresponding octal from the eth0 IP
address.

Assuming that you already have OFED configuration file (ofed.conf) with
selected packages (created by running OFED-1.0/install.sh)

Run:    ./install.sh -c ofed.conf -net ofed_net.conf

OSU MPI:

*        Added mpi_alltoall fine tuning parameters

*        Added default configuration/documentation file
$MPIHOME/etc/mvapich.conf

*        Added shell configuration files  $MPIHOME/etc/mvapich.csh ,
$MPIHOME/etc/mvapich.csh

*        Default MTU was changed back to 2K for InfiniHost III Ex and
InfiniHost III Lx HCAs. For InfiniHost card recommended value is:
VIADEV_DEFAULT_MTU=MTU1024

SDP Details: 

libsdp enhancements according to the RFC:

1.	New config syntax (please see libsdp.conf)
2.	With no config or empty config use SIMPLE_LIBSDP mode
3.	Support listening on both tcp and sdp
4.	Support trying both connections (first SDP then TCP)
5.	Support IPv4 embedded in IPv6 (also convert back address)
6.	Comprehensive verbosity logging
7.	BNF based config parser

Current SDP limitations:

*        SDP currently does not support sending/receiving out of band
data (MSG_OOB).

*        Generally, SDP supports only SOL_SOCKET socket options.

*        The following options can be set but actual support is missing:

o       SO_KEEPALIVE - no keepalives are sent

o       SO_OOBINLINE - out of band data is not supported

o       SDP currently supports setting the following SOL_TCP socket
options:

o       TCP_NODELAY, TCP_CORK - but actual support for these options is
still missing

*         SDP currently does not handle Zcopy mode messages correctly
and does not set MaxAdverts properly in HH/HAH messages.

OFED components tested by Mellanox:

*	Verbs over mthca
*	IPoIB
*	OpenSM
*	OSU-MPI
*	SRP
*	SDP
*	IB administration utils (ibutils)

Please send us any issues you encounter and/or test results.

Thanks

Tziporet & Vlad

Tziporet Koren

Software Director

Mellanox Technologies

mailto: tziporet at mellanox.co.il <mailto:tziporet at mellanox.co.il> 
Tel +972-4-9097200, ext 380

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20060607/ad83deb8/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ofed-no_ipath.conf
Type: application/octet-stream
Size: 646 bytes
Desc: ofed-no_ipath.conf
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20060607/ad83deb8/attachment.obj>