<br><font size=2 face="sans-serif">Hi Tziporet,</font>
<br><font size=2 face="sans-serif">how does the OFED supported Sytem-HW&OS
matrix look like today (for example: HW: i686, ppc, ..., OS: SLES9, SLES10,
RH4.4 ...)? So far our main testing was done with a special GEN2 SLES9
SP3 build on POWER5 IBM HW.</font>
<br>
<br><font size=2 face="sans-serif">Also is there a writeup how the EWG
is organized internally (regular meetings, how testing is done, expected
quality of a release, etc.)?</font>
<br><font size=2 face="sans-serif"><br>
Mit freundlichen Gruessen / Kind Regards<br>
<br>
Marcus Eder<br>
InfiniBand Development<br>
</font>
<br>
<br>
<br>
<table width=100%>
<tr valign=top>
<td width=40%><font size=1 face="sans-serif"><b>"Tziporet Koren"
<tziporet@mellanox.co.il></b> </font>
<p><font size=1 face="sans-serif">22.08.2006 21:10</font>
<td width=59%>
<table width=100%>
<tr valign=top>
<td>
<div align=right><font size=1 face="sans-serif">To</font></div>
<td><font size=1 face="sans-serif">"Sujal Das" <Sujal@Mellanox.com>,
"Bill Boas" <bboas@systemfabricworks.com>, <chetm@us.ibm.com>,
<openfabrics-ewg@openib.org></font>
<tr valign=top>
<td>
<div align=right><font size=1 face="sans-serif">cc</font></div>
<td><font size=1 face="sans-serif">Christoph Raisch/Germany/IBM@IBMDE,
Hoang-Nam Nguyen/Germany/IBM@IBMDE, Marcus Eder/Germany/IBM@IBMDE, <shahanse@cisco.com>,
"Vladimir Sokolovsky" <vlad@mellanox.co.il>, "Michael
S. Tsirkin" <mst@mellanox.co.il></font>
<tr valign=top>
<td>
<div align=right><font size=1 face="sans-serif">Subject</font></div>
<td><font size=1 face="sans-serif">RE: [openfabrics-ewg] Welcoming IBM
to EWG (Was: : ehca is not in OFED 1.1-rc1 anymore)</font></table>
<br>
<table>
<tr valign=top>
<td>
<td></table>
<br></table>
<br>
<br>
<br><font size=2 color=#000080 face="Arial">Hi Marcus and Nam,</font>
<br><font size=2 color=#000080 face="Arial">I am glad to work with you
to include IBM driver (ehca) in OFED.</font>
<br><font size=2 color=#000080 face="Arial"> </font>
<br><font size=2 color=#000080 face="Arial">Note that we already created
RC2 yesterday and plan to have RC next week on Aug-30, so if we want to
add ehca we need to move fast.</font>
<br><font size=2 color=#000080 face="Arial">I guess you already understand
the way we work – code should be compiled against kernel 2.6.18 tree,
and we have back-port patches for the different OSes we support.</font>
<br><font size=2 color=#000080 face="Arial"> </font>
<br><font size=2 color=#000080 face="Arial">Since ehca is not yet in Linux
best if you can setup a git tree with ehca and its backport patches. </font>
<br><font size=2 color=#000080 face="Arial"> </font>
<br><font size=2 color=#000080 face="Arial">To add ehca you will need to
work with Vlad (responsible for the build & install scripts) and with
Michael (maintains the kernel git tree).</font>
<br><font size=2 color=#000080 face="Arial"> </font>
<br><font size=2 color=#000080 face="Arial">Please reply if you can setup
a git tree, and if not from where we should take the code & backport
patches.</font>
<br><font size=2 color=#000080 face="Arial">Also we need to know if there
are any platforms (HW & OS) that ehca does not support.</font>
<br><font size=2 color=#000080 face="Arial"> </font>
<br><font size=2 color=#000080 face="Arial">Thanks,</font>
<br><font size=2 color=#000080 face="Arial">Tziporet</font>
<br><font size=2 color=#000080 face="Arial"> </font>
<br><font size=2 color=#000080 face="Arial"> </font>
<br><font size=2 face="Tahoma">-----Original Message-----<b><br>
From:</b> openfabrics-ewg-bounces@openib.org [mailto:openfabrics-ewg-bounces@openib.org]
<b>On Behalf Of </b>Sujal Das<b><br>
Sent:</b> Tuesday, August 22, 2006 7:26 PM<b><br>
To:</b> Bill Boas; chetm@us.ibm.com; openfabrics-ewg@openib.org<b><br>
Cc:</b> RAISCH@de.ibm.com; HNGUYEN@de.ibm.com; MEDER@de.ibm.com; shahanse@cisco.com<b><br>
Subject:</b> [openfabrics-ewg] Welcoming IBM to EWG (Was: : ehca is not
in OFED 1.1-rc1 anymore)</font>
<br><font size=3 face="Times New Roman"> </font>
<br><font size=2 color=#000080 face="Arial">Now sending this to the EWG
email list. Mellanox and Cisco welcomes IBM to EWG and inclusion
of eHCA into OFED. I would like to open this up to other members
of EWG – Voltaire, SilverStorm, QLogic, for their comments.</font>
<br><font size=2 color=#000080 face="Arial"> </font>
<br><font size=2 color=#000080 face="Arial">Tziporet: Marcus Eder will
be IBM's representative to the EWG within OpenFabrics with Nam Nguyen serving
as his back-up. I understand they will also serve as maintainers
of the eHCA driver in OFED.</font>
<br><font size=2 color=#000080 face="Arial"> </font>
<div align=center>
<br>
<hr></div>
<br><font size=2 face="Tahoma"><b>From:</b> Bill Boas [mailto:bboas@systemfabricworks.com]
<b><br>
Sent:</b> Tuesday, August 22, 2006 8:20 AM<b><br>
To:</b> Sujal Das; chetm@us.ibm.com<b><br>
Cc:</b> HNGUYEN@de.ibm.com; jim.ryan@intel.com; MEDER@de.ibm.com; RAISCH@de.ibm.com;
shahanse@cisco.com<b><br>
Subject:</b> RE: ehca is not in OFED 1.1-rc1 anymore</font>
<br><font size=3 face="Times New Roman"> </font>
<br><font size=2 color=#000080 face="Arial">Sujal,</font>
<br><font size=2 color=#000080 face="Arial"> </font>
<br><font size=2 color=#000080 face="Arial">As we discussed yesterday,
when the Board of Directors of the OF Alliance approved the IWG they did
not say they wanted to approve every member of the group so the IWG is
free to constitute itself as it wishes to meet the tasks and goals the
Board approved.</font>
<br><font size=2 color=#000080 face="Arial"> </font>
<br><font size=2 color=#000080 face="Arial">So please bring IBM into IWG
ASAP if that is what the IWG members decide to do.</font>
<br><font size=2 color=#000080 face="Arial"> </font>
<br><font size=2 color=#000080 face="Arial">Bill.</font>
<br><font size=2 color=#000080 face="Arial"> </font>
<br><font size=2 color=#000080 face="Verdana">Bill Boas</font>
<br><font size=2 color=#000080 face="Verdana">VP, Business Development
| System Fabric Works</font>
<br><font size=2 color=#000080 face="Verdana">bboas@systemfabricworks.com
| 510-375-8840</font>
<br><font size=2 color=#000080 face="Arial"> </font>
<div align=center>
<br>
<hr></div>
<br><font size=2 face="Tahoma"><b>From:</b> Sujal Das [mailto:Sujal@mellanox.com]
<b><br>
Sent:</b> Tuesday, August 22, 2006 7:25 AM<b><br>
To:</b> chetm@us.ibm.com<b><br>
Cc:</b> bboas@systemfabricworks.com; HNGUYEN@de.ibm.com; jim.ryan@intel.com;
MEDER@de.ibm.com; RAISCH@de.ibm.com; shahanse@cisco.com<b><br>
Subject:</b> Re: ehca is not in OFED 1.1-rc1 anymore</font>
<br><font size=3 face="Times New Roman"> </font>
<p><font size=2 face="Times New Roman">Spoke to Bill further on this yesterday.
He will respond. The process may be easier than what I laid
out. Stay tuned.<br>
<br>
----- Original Message -----<br>
From: Chet Mehta <chetm@us.ibm.com><br>
To: Sujal Das<br>
Cc: Bill Boas <bboas@systemfabricworks.com>; Hoang-Nam Nguyen <HNGUYEN@de.ibm.com>;
Ryan, Jim <jim.ryan@intel.com>; Marcus Eder <MEDER@de.ibm.com>;
Christoph Raisch <RAISCH@de.ibm.com>; Shawn Hansen (shahanse) <shahanse@cisco.com><br>
Sent: Tue Aug 22 06:24:42 2006<br>
Subject: RE: ehca is not in OFED 1.1-rc1 anymore<br>
<br>
<br>
Thank you Sujal!<br>
<br>
As we await IBM's inclusion in the EWG would it be possible for you to
include the ehca driver code in OFED 1.1? The code can be extracted from
Roland's git tree: git://git.kernel.org/pub/scm/linux/kernel/git/roland/infiniband.git
ehca<br>
<br>
Thx!<br>
:Chet.<br>
<br>
<br>
<br>
"Sujal Das" <Sujal@mellanox.com><br>
<br>
08/21/2006 06:03 PM <br>
To<br>
Chet Mehta/Austin/IBM@IBMUS, "Shawn Hansen
\(shahanse\)" <shahanse@cisco.com><br>
cc<br>
"Marcus Eder" <MEDER@de.ibm.com>,
"Hoang-Nam Nguyen" <HNGUYEN@de.ibm.com>, "Christoph
Raisch" <RAISCH@de.ibm.com>, "Ryan, Jim" <jim.ryan@intel.com>,
"Bill Boas" <bboas@systemfabricworks.com><br>
Subject<br>
RE: ehca is not in OFED 1.1-rc1 anymore<br>
<br>
<br>
<br>
<br>
<br>
<br>
Hi Chet,<br>
<br>
I am copying Bill Boas and Jim Ryan (co-chair and chair respectively of
OpenFabrics) so that they are informed about this request. <br>
<br>
<br>
Hi Bill/Jim,<br>
<br>
IBM needs to be added as a EWG member so that they can start active work
on OFED releases.<br>
<br>
If I recall correctly, the process requires the BOD members to vote and
approve IBMs inclusion into EWG subsequent to IBM’s nomination into EWG.
Shawn has already approved IBM’s inclusion and we support that.
Could we initiate an electronic voting to accomplish this quickly?<br>
<br>
Thanks,<br>
<br>
Sujal<br>
<br>
<br>
________________________________<br>
<br>
<br>
From: Chet Mehta [</font><a href=mailto:chetm@us.ibm.com><font size=2 color=blue face="Times New Roman"><u>mailto:chetm@us.ibm.com</u></font></a><font size=2 face="Times New Roman">]<br>
Sent: Monday, August 21, 2006 3:50 PM<br>
To: Sujal Das; Shawn Hansen (shahanse)<br>
Cc: Marcus Eder; Hoang-Nam Nguyen; Christoph Raisch<br>
Subject: RE: ehca is not in OFED 1.1-rc1 anymore<br>
<br>
<br>
Sujal, Shawn,<br>
<br>
I am following up to submit the names of Marcus Eder as IBM's representative
to the EWG within OpenFabrics with Nam Nguyen serving as his back-up. Marcus's
team developed and released the open source ehca drivers and are best positioned
to participate in OFA's EWG to support it for all future releases.<br>
Shawn, I appreciate your agreeing to support IBM's nomination.<br>
<br>
Please copy Marcus & Nam on any necessary follow-ups. Thx!<br>
<br>
:Chet.<br>
<br>
<br>
"Sujal Das" <Sujal@mellanox.com><br>
<br>
08/14/2006 06:53 PM <br>
<br>
To<br>
Chet Mehta/Austin/IBM@IBMUS, "Shawn Hansen
\(shahanse\)" <shahanse@cisco.com><br>
cc<br>
<br>
Subject<br>
RE: ehca is not in OFED 1.1-rc1 anymore<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
Chet,<br>
<br>
That is great news. First, IBM should become a member of the Enterprise
Workgroup (EWG) within OpenFabrics and work toward qualifying and enhancing
the driver to meet the release criteria jointly defined by EWG. There
is a voting procedure where board members need to approve. Shawn,
as the chair of EWG, can initiate that process with EWG/OpenFabrics. <br>
<br>
After that, you should subscribe to the EWG mailing list and work with
the OFED release coordinator, Tziporet Koren, to get your driver included
into OFED. Given the fact that OFED 1.1 release is imminent (in mid
Sept), there may not be enough time for adequate QA, so there is a possibility
that eHCA support releases as technology preview only in OFED 1.1 and goes
to production status in a future release of OFED. I believe eHCA
support in OFED 1.0 was tech preview only – I do not recall any of the
EWG members testing the eHCA actively prior to OFED 1.0 release back in
June.<br>
<br>
Thanks<br>
<br>
Sujal<br>
<br>
<br>
<br>
<br>
________________________________<br>
<br>
<br>
<br>
From: Chet Mehta [</font><a href=mailto:chetm@us.ibm.com><font size=2 color=blue face="Times New Roman"><u>mailto:chetm@us.ibm.com</u></font></a><font size=2 face="Times New Roman">]<br>
Sent: Monday, August 14, 2006 4:31 PM<br>
To: Sujal Das; Shawn Hansen (shahanse)<br>
Subject: Fw: ehca is not in OFED 1.1-rc1 anymore<br>
<br>
<br>
Sujal, Shawn,<br>
<br>
My apologies if you have responded already. If not, could you let us know
what's needed to get our ehca driver included in OFED 1.1? Thx.<br>
<br>
:Chet. Mehta<br>
----- Forwarded by Chet Mehta/Austin/IBM on 08/14/2006 06:29 PM -----<br>
<br>
Hoang-Nam Nguyen/Germany/IBM<br>
<br>
10.08.2006 12:33 <br>
<br>
<br>
<br>
To<br>
"Sujal Das" <Sujal@Mellanox.com>,
"Shawn Hansen \(shahanse\)" <shahanse@cisco.com><br>
cc<br>
Marcus Eder/Germany/IBM@IBMDE, Christoph Raisch/Germany/IBM@IBMDE<br>
Subject<br>
Fw: [openib-general] OFED 1.1-rc1 is available<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
Hello Shawn and Sujal!<br>
Could you please tell me the prerequisites if any we need to fulfilled
in order to get your approval for including our ehca driver in OFED 1.1?<br>
FYI: Our driver has been contained in OFED 1.0, but not in OFED 1.1-rc1
anymore.<br>
Due to the short timeframe ahead OFED 1.1 I'd appreciate your helps!<br>
Regards<br>
Hoang-Nam Nguyen<br>
email: hnguyen@de.ibm.com<br>
<br>
----- Forwarded by Hoang-Nam Nguyen/Germany/IBM on 10.08.2006 12:25 -----<br>
<br>
"Tziporet Koren" <tziporet@mellanox.co.il><br>
<br>
09.08.2006 17:29 <br>
<br>
<br>
<br>
To<br>
Hoang-Nam Nguyen/Germany/IBM@IBMDE<br>
cc<br>
Marcus Eder/Germany/IBM@IBMDE, Christoph Raisch/Germany/IBM@IBMDE,
"Sujal Das" <Sujal@Mellanox.com>, "Shawn Hansen \(shahanse\)"
<shahanse@cisco.com><br>
Subject<br>
RE: [openib-general] OFED 1.1-rc1 is available<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
Hi,<br>
To be part of OFED you need to join the EWG and they need to approve adding
IBM support for the package.<br>
<br>
I cc Shawn from Cisco (Chairman of EWG) and Sujal from Mellanox and they
can help in driving this.<br>
After it's approved we can discuss the technical details how to add ehca
support to OFED 1.1<br>
<br>
Tziporet<br>
<br>
-----Original Message-----<br>
From: Hoang-Nam Nguyen [</font><a href=mailto:HNGUYEN@de.ibm.com><font size=2 color=blue face="Times New Roman"><u>mailto:HNGUYEN@de.ibm.com</u></font></a><font size=2 face="Times New Roman">]<br>
Sent: Wednesday, August 09, 2006 5:03 PM<br>
To: Tziporet Koren<br>
Cc: Marcus Eder; Christoph Raisch<br>
Subject: Re: [openib-general] OFED 1.1-rc1 is available<br>
<br>
Hello Tziporet!<br>
I realized that ehca is not listed and contained in OFED 1.1-rc1. Did we<br>
miss something or can you please tell me what can we do to get ehca in<br>
OFED1.1?<br>
Thanks!<br>
<br>
Mit freundlichen Gruessen/Kind Regards<br>
Hoang-Nam Nguyen<br>
email: hnguyen@de.ibm.com<br>
<br>
<br>
<br>
<br>
"Tziporet Koren"
<br>
<tziporet@mellano
<br>
x.co.il>
To<br>
Sent by:
openfabrics-ewg@openib.org
<br>
openib-general-bo
cc<br>
unces@openib.org
"openib"
<br>
<openib-general@openib.org>
<br>
Subject<br>
08.08.2006 16:48
[openib-general] OFED 1.1-rc1 is <br>
available
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
Hi,<br>
<br>
In two week delay we publish OFED 1.1-RC1 on</font><font size=2 color=blue face="Times New Roman"><u><br>
</u></font><a href=https://openib.org/svn/gen2/branches/1.1/ofed/releases/><font size=2 color=blue face="Times New Roman"><u>https://openib.org/svn/gen2/branches/1.1/ofed/releases/</u></font></a><font size=2 face="Times New Roman"><br>
File: OFED-1.1-rc1.tgz<br>
<br>
Build_id:<br>
OFED-1.1-rc1<br>
openib-1.1 (REV=8849)<br>
# User space</font><font size=2 color=blue face="Times New Roman"><u><br>
</u></font><a href=https://openib.org/svn/gen2/branches/1.1/src/userspace><font size=2 color=blue face="Times New Roman"><u>https://openib.org/svn/gen2/branches/1.1/src/userspace</u></font></a><font size=2 face="Times New Roman"><br>
Git:<br>
git://www.mellanox.co.il/~git/infiniband ofed_1_1<br>
ref: refs/heads/ofed_1_1<br>
commit df6aabce49695368fd004e6505102a1519b266a4<br>
# MPI<br>
mpi_osu-0.9.7-mlx2.2.0.tgz<br>
openmpi-1.1-1.src.rpm<br>
mpitests-2.0-0.src.rpm<br>
<br>
<br>
OS support:<br>
===========<br>
Novell:<br>
- SLES 9.0 SP3*<br>
- SLES10 (official release)*<br>
Redhat:<br>
- Redhat EL4 up3<br>
- Redhat EL4 up4 (was not tested yet)<br>
kernel.org:<br>
- Kernel 2.6.17*<br>
* Changed from 1.0 release<br>
<br>
Note: Redhat EL4 up2, Fedora C4 and SuSE Pro 10 were dropped from the list.<br>
We keep the backport patches for these OSes and make sure OFED compile
and<br>
loaded properly but will not do full QA cycle.<br>
<br>
Systems:<br>
========<br>
* x86_64 * x86 * ia64 * ppc64<br>
<br>
Main changes from OFED-1.0:<br>
===========================<br>
o Bug fixes<br>
o Enabled building 32-bit libraries on x86_64 and ppc64. Note: sysfsutils<br>
and sysfsutils-devel 32-bit required.<br>
o Kernel code based on 2.6.18<br>
o Kernel hot-plug support in uverbs - removing module wait till all user<br>
applications release their HCA resources.<br>
o Package sources (user space and kernel modules) are places under:<br>
<prefix>/src/<br>
Original kernel sources are not replaced<br>
o RDS was removed from the OFED package<br>
o Set options in CMA & uCMA<br>
o OSM new features:<br>
- Partition Manager (Pkey)<br>
- Pre-computed routing load from file<br>
- Primitive QoS - As technology preview<br>
o SDP:<br>
- Improved latency (13 usec with netperf
tcprr)<br>
- Implemented Naggle algorithm<br>
- Memory leaks fixes<br>
- Error handling added<br>
o MPI:<br>
- OSU - MVAPICH: Message coalescing
to improve message rate<br>
- Open MPI 1.1-1: see changes:</font><font size=2 color=blue face="Times New Roman"><u><br>
</u></font><a href="http://svn.open-mpi.org/svn/ompi/trunk/NEWS"><font size=2 color=blue face="Times New Roman"><u>http://svn.open-mpi.org/svn/ompi/trunk/NEWS</u></font></a><font size=2 face="Times New Roman"><br>
- MPI tests: Replace to the new test
versions from LLNL,<br>
Intel, OSU<br>
o SRP:<br>
- Stability<br>
o iSER:<br>
- Stability<br>
- Testing more platforms (e.g. ppc64
and ia64)<br>
- Performance improvements<br>
o Management:<br>
- Add saquery tool<br>
- Enhancement to ibnetdiscover tool
with grouping function<br>
- New ibutils package:<br>
o Port error counter check<br>
o Port performance counters dump<br>
o Link width and Link Speed check by flag<br>
o uDAPL:<br>
- Scalability features needed for Intel
MPI<br>
- Code was updated from trunk<br>
<br>
<br>
Limitations and known issues:<br>
=============================<br>
1. ipath driver compilation fails on all systems<br>
2. iSER support in install script for SLES 10 is missing<br>
3. SDP:<br>
- 32 bit systems might run out of low
memory when opening<br>
hundreds of sockets.<br>
- For Mellanox Sinai HCAs one must use
latest FW version<br>
(1.1.000).<br>
<br>
Missing features that should be completed for RC2:<br>
==================================================<br>
1. SRP:<br>
- Complete testing with DM (Device Mapper)
- for high<br>
availability<br>
- New daemon<br>
2. IPoIB: High availability support using a daemon in user level<br>
3. SDP: support sending/receiving out of band data<br>
4. Add Madeye utility<br>
5. Fatal error support in mthca<br>
<br>
<br>
Please report any issues in bugzilla </font><a href=http://openib.org/bugzilla/><font size=2 color=blue face="Times New Roman"><u>http://openib.org/bugzilla/</u></font></a><font size=2 face="Times New Roman"><br>
<br>
Tziporet & Vlad<br>
<br>
<br>
_______________________________________________<br>
openib-general mailing list<br>
openib-general@openib.org</font><font size=2 color=blue face="Times New Roman"><u><br>
</u></font><a href="http://openib.org/mailman/listinfo/openib-general"><font size=2 color=blue face="Times New Roman"><u>http://openib.org/mailman/listinfo/openib-general</u></font></a><font size=2 face="Times New Roman"><br>
<br>
To unsubscribe, please visit</font><font size=2 color=blue face="Times New Roman"><u><br>
</u></font><a href="http://openib.org/mailman/listinfo/openib-general"><font size=2 color=blue face="Times New Roman"><u>http://openib.org/mailman/listinfo/openib-general</u></font></a>
<p>