[openfabrics-ewg] Welcoming IBM to EWG (Was: : ehca is not in OFED 1.1-rc1 anymore)
Marcus Eder
MEDER at de.ibm.com
Mon Aug 28 08:15:20 PDT 2006
Hi Tziporet,
how does the OFED supported Sytem-HW&OS matrix look like today (for
example: HW: i686, ppc, ..., OS: SLES9, SLES10, RH4.4 ...)? So far our
main testing was done with a special GEN2 SLES9 SP3 build on POWER5 IBM
HW.
Also is there a writeup how the EWG is organized internally (regular
meetings, how testing is done, expected quality of a release, etc.)?
Mit freundlichen Gruessen / Kind Regards
Marcus Eder
InfiniBand Development
"Tziporet Koren" <tziporet at mellanox.co.il>
22.08.2006 21:10
To
"Sujal Das" <Sujal at Mellanox.com>, "Bill Boas"
<bboas at systemfabricworks.com>, <chetm at us.ibm.com>,
<openfabrics-ewg at openib.org>
cc
Christoph Raisch/Germany/IBM at IBMDE, Hoang-Nam Nguyen/Germany/IBM at IBMDE,
Marcus Eder/Germany/IBM at IBMDE, <shahanse at cisco.com>, "Vladimir Sokolovsky"
<vlad at mellanox.co.il>, "Michael S. Tsirkin" <mst at mellanox.co.il>
Subject
RE: [openfabrics-ewg] Welcoming IBM to EWG (Was: : ehca is not in OFED
1.1-rc1 anymore)
Hi Marcus and Nam,
I am glad to work with you to include IBM driver (ehca) in OFED.
Note that we already created RC2 yesterday and plan to have RC next week
on Aug-30, so if we want to add ehca we need to move fast.
I guess you already understand the way we work ? code should be compiled
against kernel 2.6.18 tree, and we have back-port patches for the
different OSes we support.
Since ehca is not yet in Linux best if you can setup a git tree with ehca
and its backport patches.
To add ehca you will need to work with Vlad (responsible for the build &
install scripts) and with Michael (maintains the kernel git tree).
Please reply if you can setup a git tree, and if not from where we should
take the code & backport patches.
Also we need to know if there are any platforms (HW & OS) that ehca does
not support.
Thanks,
Tziporet
-----Original Message-----
From: openfabrics-ewg-bounces at openib.org
[mailto:openfabrics-ewg-bounces at openib.org] On Behalf Of Sujal Das
Sent: Tuesday, August 22, 2006 7:26 PM
To: Bill Boas; chetm at us.ibm.com; openfabrics-ewg at openib.org
Cc: RAISCH at de.ibm.com; HNGUYEN at de.ibm.com; MEDER at de.ibm.com;
shahanse at cisco.com
Subject: [openfabrics-ewg] Welcoming IBM to EWG (Was: : ehca is not in
OFED 1.1-rc1 anymore)
Now sending this to the EWG email list. Mellanox and Cisco welcomes IBM
to EWG and inclusion of eHCA into OFED. I would like to open this up to
other members of EWG ? Voltaire, SilverStorm, QLogic, for their comments.
Tziporet: Marcus Eder will be IBM's representative to the EWG within
OpenFabrics with Nam Nguyen serving as his back-up. I understand they
will also serve as maintainers of the eHCA driver in OFED.
From: Bill Boas [mailto:bboas at systemfabricworks.com]
Sent: Tuesday, August 22, 2006 8:20 AM
To: Sujal Das; chetm at us.ibm.com
Cc: HNGUYEN at de.ibm.com; jim.ryan at intel.com; MEDER at de.ibm.com;
RAISCH at de.ibm.com; shahanse at cisco.com
Subject: RE: ehca is not in OFED 1.1-rc1 anymore
Sujal,
As we discussed yesterday, when the Board of Directors of the OF Alliance
approved the IWG they did not say they wanted to approve every member of
the group so the IWG is free to constitute itself as it wishes to meet the
tasks and goals the Board approved.
So please bring IBM into IWG ASAP if that is what the IWG members decide
to do.
Bill.
Bill Boas
VP, Business Development | System Fabric Works
bboas at systemfabricworks.com | 510-375-8840
From: Sujal Das [mailto:Sujal at mellanox.com]
Sent: Tuesday, August 22, 2006 7:25 AM
To: chetm at us.ibm.com
Cc: bboas at systemfabricworks.com; HNGUYEN at de.ibm.com; jim.ryan at intel.com;
MEDER at de.ibm.com; RAISCH at de.ibm.com; shahanse at cisco.com
Subject: Re: ehca is not in OFED 1.1-rc1 anymore
Spoke to Bill further on this yesterday. He will respond. The process
may be easier than what I laid out. Stay tuned.
----- Original Message -----
From: Chet Mehta <chetm at us.ibm.com>
To: Sujal Das
Cc: Bill Boas <bboas at systemfabricworks.com>; Hoang-Nam Nguyen
<HNGUYEN at de.ibm.com>; Ryan, Jim <jim.ryan at intel.com>; Marcus Eder
<MEDER at de.ibm.com>; Christoph Raisch <RAISCH at de.ibm.com>; Shawn Hansen
(shahanse) <shahanse at cisco.com>
Sent: Tue Aug 22 06:24:42 2006
Subject: RE: ehca is not in OFED 1.1-rc1 anymore
Thank you Sujal!
As we await IBM's inclusion in the EWG would it be possible for you to
include the ehca driver code in OFED 1.1? The code can be extracted from
Roland's git tree:
git://git.kernel.org/pub/scm/linux/kernel/git/roland/infiniband.git ehca
Thx!
:Chet.
"Sujal Das" <Sujal at mellanox.com>
08/21/2006 06:03 PM
To
Chet Mehta/Austin/IBM at IBMUS, "Shawn Hansen \(shahanse\)"
<shahanse at cisco.com>
cc
"Marcus Eder" <MEDER at de.ibm.com>, "Hoang-Nam Nguyen"
<HNGUYEN at de.ibm.com>, "Christoph Raisch" <RAISCH at de.ibm.com>, "Ryan, Jim"
<jim.ryan at intel.com>, "Bill Boas" <bboas at systemfabricworks.com>
Subject
RE: ehca is not in OFED 1.1-rc1 anymore
Hi Chet,
I am copying Bill Boas and Jim Ryan (co-chair and chair respectively of
OpenFabrics) so that they are informed about this request.
Hi Bill/Jim,
IBM needs to be added as a EWG member so that they can start active work
on OFED releases.
If I recall correctly, the process requires the BOD members to vote and
approve IBMs inclusion into EWG subsequent to IBM?s nomination into EWG.
Shawn has already approved IBM?s inclusion and we support that. Could we
initiate an electronic voting to accomplish this quickly?
Thanks,
Sujal
________________________________
From: Chet Mehta [mailto:chetm at us.ibm.com]
Sent: Monday, August 21, 2006 3:50 PM
To: Sujal Das; Shawn Hansen (shahanse)
Cc: Marcus Eder; Hoang-Nam Nguyen; Christoph Raisch
Subject: RE: ehca is not in OFED 1.1-rc1 anymore
Sujal, Shawn,
I am following up to submit the names of Marcus Eder as IBM's
representative to the EWG within OpenFabrics with Nam Nguyen serving as
his back-up. Marcus's team developed and released the open source ehca
drivers and are best positioned to participate in OFA's EWG to support it
for all future releases.
Shawn, I appreciate your agreeing to support IBM's nomination.
Please copy Marcus & Nam on any necessary follow-ups. Thx!
:Chet.
"Sujal Das" <Sujal at mellanox.com>
08/14/2006 06:53 PM
To
Chet Mehta/Austin/IBM at IBMUS, "Shawn Hansen \(shahanse\)"
<shahanse at cisco.com>
cc
Subject
RE: ehca is not in OFED 1.1-rc1 anymore
Chet,
That is great news. First, IBM should become a member of the Enterprise
Workgroup (EWG) within OpenFabrics and work toward qualifying and
enhancing the driver to meet the release criteria jointly defined by EWG.
There is a voting procedure where board members need to approve. Shawn,
as the chair of EWG, can initiate that process with EWG/OpenFabrics.
After that, you should subscribe to the EWG mailing list and work with the
OFED release coordinator, Tziporet Koren, to get your driver included into
OFED. Given the fact that OFED 1.1 release is imminent (in mid Sept),
there may not be enough time for adequate QA, so there is a possibility
that eHCA support releases as technology preview only in OFED 1.1 and goes
to production status in a future release of OFED. I believe eHCA support
in OFED 1.0 was tech preview only ? I do not recall any of the EWG members
testing the eHCA actively prior to OFED 1.0 release back in June.
Thanks
Sujal
________________________________
From: Chet Mehta [mailto:chetm at us.ibm.com]
Sent: Monday, August 14, 2006 4:31 PM
To: Sujal Das; Shawn Hansen (shahanse)
Subject: Fw: ehca is not in OFED 1.1-rc1 anymore
Sujal, Shawn,
My apologies if you have responded already. If not, could you let us know
what's needed to get our ehca driver included in OFED 1.1? Thx.
:Chet. Mehta
----- Forwarded by Chet Mehta/Austin/IBM on 08/14/2006 06:29 PM -----
Hoang-Nam Nguyen/Germany/IBM
10.08.2006 12:33
To
"Sujal Das" <Sujal at Mellanox.com>, "Shawn Hansen \(shahanse\)"
<shahanse at cisco.com>
cc
Marcus Eder/Germany/IBM at IBMDE, Christoph Raisch/Germany/IBM at IBMDE
Subject
Fw: [openib-general] OFED 1.1-rc1 is available
Hello Shawn and Sujal!
Could you please tell me the prerequisites if any we need to fulfilled in
order to get your approval for including our ehca driver in OFED 1.1?
FYI: Our driver has been contained in OFED 1.0, but not in OFED 1.1-rc1
anymore.
Due to the short timeframe ahead OFED 1.1 I'd appreciate your helps!
Regards
Hoang-Nam Nguyen
email: hnguyen at de.ibm.com
----- Forwarded by Hoang-Nam Nguyen/Germany/IBM on 10.08.2006 12:25 -----
"Tziporet Koren" <tziporet at mellanox.co.il>
09.08.2006 17:29
To
Hoang-Nam Nguyen/Germany/IBM at IBMDE
cc
Marcus Eder/Germany/IBM at IBMDE, Christoph Raisch/Germany/IBM at IBMDE,
"Sujal Das" <Sujal at Mellanox.com>, "Shawn Hansen \(shahanse\)"
<shahanse at cisco.com>
Subject
RE: [openib-general] OFED 1.1-rc1 is available
Hi,
To be part of OFED you need to join the EWG and they need to approve
adding IBM support for the package.
I cc Shawn from Cisco (Chairman of EWG) and Sujal from Mellanox and they
can help in driving this.
After it's approved we can discuss the technical details how to add ehca
support to OFED 1.1
Tziporet
-----Original Message-----
From: Hoang-Nam Nguyen [mailto:HNGUYEN at de.ibm.com]
Sent: Wednesday, August 09, 2006 5:03 PM
To: Tziporet Koren
Cc: Marcus Eder; Christoph Raisch
Subject: Re: [openib-general] OFED 1.1-rc1 is available
Hello Tziporet!
I realized that ehca is not listed and contained in OFED 1.1-rc1. Did we
miss something or can you please tell me what can we do to get ehca in
OFED1.1?
Thanks!
Mit freundlichen Gruessen/Kind Regards
Hoang-Nam Nguyen
email: hnguyen at de.ibm.com
"Tziporet Koren"
<tziporet at mellano
x.co.il> To
Sent by: openfabrics-ewg at openib.org
openib-general-bo cc
unces at openib.org "openib"
<openib-general at openib.org>
Subject
08.08.2006 16:48 [openib-general] OFED 1.1-rc1 is
available
Hi,
In two week delay we publish OFED 1.1-RC1 on
https://openib.org/svn/gen2/branches/1.1/ofed/releases/
File: OFED-1.1-rc1.tgz
Build_id:
OFED-1.1-rc1
openib-1.1 (REV=8849)
# User space
https://openib.org/svn/gen2/branches/1.1/src/userspace
Git:
git://www.mellanox.co.il/~git/infiniband ofed_1_1
ref: refs/heads/ofed_1_1
commit df6aabce49695368fd004e6505102a1519b266a4
# MPI
mpi_osu-0.9.7-mlx2.2.0.tgz
openmpi-1.1-1.src.rpm
mpitests-2.0-0.src.rpm
OS support:
===========
Novell:
- SLES 9.0 SP3*
- SLES10 (official release)*
Redhat:
- Redhat EL4 up3
- Redhat EL4 up4 (was not tested yet)
kernel.org:
- Kernel 2.6.17*
* Changed from 1.0 release
Note: Redhat EL4 up2, Fedora C4 and SuSE Pro 10 were dropped from the
list.
We keep the backport patches for these OSes and make sure OFED compile and
loaded properly but will not do full QA cycle.
Systems:
========
* x86_64 * x86 * ia64 * ppc64
Main changes from OFED-1.0:
===========================
o Bug fixes
o Enabled building 32-bit libraries on x86_64 and ppc64. Note: sysfsutils
and sysfsutils-devel 32-bit required.
o Kernel code based on 2.6.18
o Kernel hot-plug support in uverbs - removing module wait till all user
applications release their HCA resources.
o Package sources (user space and kernel modules) are places under:
<prefix>/src/
Original kernel sources are not replaced
o RDS was removed from the OFED package
o Set options in CMA & uCMA
o OSM new features:
- Partition Manager (Pkey)
- Pre-computed routing load from file
- Primitive QoS - As technology preview
o SDP:
- Improved latency (13 usec with netperf tcprr)
- Implemented Naggle algorithm
- Memory leaks fixes
- Error handling added
o MPI:
- OSU - MVAPICH: Message coalescing to improve message rate
- Open MPI 1.1-1: see changes:
http://svn.open-mpi.org/svn/ompi/trunk/NEWS
- MPI tests: Replace to the new test versions from LLNL,
Intel, OSU
o SRP:
- Stability
o iSER:
- Stability
- Testing more platforms (e.g. ppc64 and ia64)
- Performance improvements
o Management:
- Add saquery tool
- Enhancement to ibnetdiscover tool with grouping function
- New ibutils package:
o Port error counter check
o Port performance counters dump
o Link width and Link Speed check by flag
o uDAPL:
- Scalability features needed for Intel MPI
- Code was updated from trunk
Limitations and known issues:
=============================
1. ipath driver compilation fails on all systems
2. iSER support in install script for SLES 10 is missing
3. SDP:
- 32 bit systems might run out of low memory when opening
hundreds of sockets.
- For Mellanox Sinai HCAs one must use latest FW version
(1.1.000).
Missing features that should be completed for RC2:
==================================================
1. SRP:
- Complete testing with DM (Device Mapper) - for high
availability
- New daemon
2. IPoIB: High availability support using a daemon in user level
3. SDP: support sending/receiving out of band data
4. Add Madeye utility
5. Fatal error support in mthca
Please report any issues in bugzilla http://openib.org/bugzilla/
Tziporet & Vlad
_______________________________________________
openib-general mailing list
openib-general at openib.org
http://openib.org/mailman/listinfo/openib-general
To unsubscribe, please visit
http://openib.org/mailman/listinfo/openib-general
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/ewg/attachments/20060828/1b2defc5/attachment.html>
More information about the ewg
mailing list