<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<html>
<head>
<meta http-equiv=Content-Type content="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 10 (filtered)">
<title>RE: [openfabrics-ewg] OpenMPI package</title>
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{color:blue;
text-decoration:underline;}
p
{margin-right:0in;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman";}
span.EmailStyle18
{font-family:Arial;
color:navy;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
{page:Section1;}
/* List Definitions */
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
-->
</style>
</head>
<body lang=EN-US link=blue vlink=blue>
<div class=Section1>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'> </span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'> </span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'>-----Original Message-----<br>
<b><span style='font-weight:bold'>From:</span></b> openfabrics-ewg-bounces@openib.org
[mailto:openfabrics-ewg-bounces@openib.org] <b><span style='font-weight:bold'>On
Behalf Of </span></b>Gilad Shainer<br>
<b><span style='font-weight:bold'>Sent:</span></b> </span></font><font size=2 face=Tahoma><span style='font-size:10.0pt;font-family:Tahoma'>Thursday, March
23, 2006</span></font><font size=2 face=Tahoma><span style='font-size:10.0pt;
font-family:Tahoma'> </span></font><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'>7:09 PM</span></font><font size=2
face=Tahoma><span style='font-size:10.0pt;font-family:Tahoma'><br>
<b><span style='font-weight:bold'>To:</span></b> Aviram Gutman; Jeff Squyres
(jsquyres); Moni Levy<br>
<b><span style='font-weight:bold'>Cc:</span></b> Pavel Shamis; Gil Bloch;
openfabrics-ewg@openib.org; Gleb Natapov<br>
<b><span style='font-weight:bold'>Subject:</span></b> RE: [openfabrics-ewg]
OpenMPI package</span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=3 face="Times New Roman"><span
style='font-size:12.0pt'> </span></font></p>
<p style='margin-left:56.25pt;text-indent:-.25in'><font size=2
face="Times New Roman"><span style='font-size:10.0pt'>-<font size=1
face="Times New Roman"><span style='font:7.0pt "Times New Roman"'>
</span></font></span></font><span dir=LTR><font size=2><span style='font-size:
10.0pt'>What is the plan for having 2 MPIs in this distribution -- how will
users/sysadmins choose between them? I.e., are we going to allow both to
be installed and make it a user-level decision which to use? Or will the
sysadmin only pick one to install? >Or ...?</span></font></span></p>
<p><font size=2 color=navy face="Times New Roman"><span style='font-size:10.0pt;
color:navy'>[TK]: the install enable to put both MPIs on the same machine. Of
course the administrator should decide later what is used.<br>
Note it’s all defined in the install document I sent.</span></font></p>
<p><font size=2 color=navy face="Times New Roman"><span style='font-size:10.0pt;
color:navy'> </span></font></p>
<p><font size=2 color=navy face=Arial><span style='font-size:10.0pt;font-family:
Arial;color:navy'> </span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'><Aviram> We need to decide on that. All, how do
you view it?</span></font> </p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'><Gilad> The simplest way is to let the sysadmin
pick one of the two to install. </span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=3 face="Times New Roman"><span
style='font-size:12.0pt'> </span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>-----Original Message-----</span></font> <br>
<font size=2><span style='font-size:10.0pt'>From: Aviram Gutman </span></font><br>
<font size=2><span style='font-size:10.0pt'>Sent: Thursday, March 23, 2006 8:35
AM</span></font> <br>
<font size=2><span style='font-size:10.0pt'>To: Jeff Squyres (jsquyres); Moni
Levy</span></font> <br>
<font size=2><span style='font-size:10.0pt'>Cc: Pavel Shamis; Gil Bloch;
openfabrics-ewg@openib.org; Gleb Natapov</span></font> <br>
<font size=2><span style='font-size:10.0pt'>Subject: RE: [openfabrics-ewg]
OpenMPI package</span></font> </p>
<p class=MsoNormal style='margin-left:.5in'><font size=3 face="Times New Roman"><span
style='font-size:12.0pt'> </span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>Hi Jeff,</span></font> </p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>Welcome aboard. Tziporet is out this week. I tried to
answer most of the questions below. We'll get back to you wit the rest of the
answers by Monday morning. Please See some answers below. </span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=3 face="Times New Roman"><span
style='font-size:12.0pt'> </span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>Regards,</span></font> <br>
<font size=2><span style='font-size:10.0pt'> Aviram</span></font> </p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>-----Original Message-----</span></font> <br>
<font size=2><span style='font-size:10.0pt'>From: Jeff Squyres (jsquyres) [<a
href="mailto:jsquyres@cisco.com">mailto:jsquyres@cisco.com</a>]</span></font> <br>
<font size=2><span style='font-size:10.0pt'>Sent: Thursday, March 23, 2006 3:41
PM</span></font> <br>
<font size=2><span style='font-size:10.0pt'>To: Aviram Gutman; Moni Levy</span></font>
<br>
<font size=2><span style='font-size:10.0pt'>Cc: openfabrics-ewg@openib.org;
Gleb Natapov</span></font> <br>
<font size=2><span style='font-size:10.0pt'>Subject: RE: [openfabrics-ewg]
OpenMPI package</span></font> </p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>Several issues:</span></font> </p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>1. Since I am just entering this effort, I downloaded
RC2 yesterday and poked around inside for details on how Open MPI will need to
be packaged. I sent an off-list mail to Tziporet last night asking a
bunch of technical questions (I probably should have sent this on-list,
sorry). Here are the main questions from that e-mail:</span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>- I downloaded RC2. It looks like you are
distributing source and have some scripts to build RPMs and install the
RPMs. Is that correct / the goal of IBED?</span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'><Aviram> Yes</span></font> </p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>- The README appears to be quite out of date; I assume
you will need some Open MPI-specific information for it. How should I get
this to you?</span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'><Aviram> Just send it and we'll incorporate it.</span></font>
</p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>- It looks like the LICENSE file is incomplete --
shouldn't it contain at least references to the license / copyright information
of the sub-packages? (e.g., MVAPICH and others)</span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'><Aviram> That is good issue. I am not a LICENSE
expert. Who can answer it? Marketing guys? </span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>- I see a bunch of top-level *.sh scripts -- these
will need to be expanded for Open MPI. Who does that -- me or you?</span></font>
</p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'><Aviram> Can you do it and send it over?</span></font>
</p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>- I see SOURCES/mpi_osu...tgz. That contains a
bunch of scripts and the mvapich tarball. I'm assuming that Open MPI
needs to be bundled this way as well...? Is this documented
anywhere? Is there a reason why a tarball contains another tarball?</span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=3 face="Times New Roman"><span
style='font-size:12.0pt'> </span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>- The mpi_osu...tgz file contains several
MPI-independent utilities (PMB, prestal, etc.). Should these be moved out
of the OSU MPI tarball and into an MPI-agnostic tarball, and then compiled
against each MPI that is installed?</span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'><Aviram> Will get back to you on those two.</span></font>
</p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>- What is the plan for having 2 MPIs in this
distribution -- how will users/sysadmins choose between them? I.e., are
we going to allow both to be installed and make it a user-level decision which
to use? Or will the sysadmin only pick one to install? Or ...?</span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'><Aviram> We need to decide on that. All, how do
you view it?</span></font> </p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>2. Some more questions that I did not include in my
mail last night:</span></font> </p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>- Is there a source code repository for IBED
somewhere? What is the model for developers to modify / test IBED?</span></font>
</p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>- What version of MVAPICH is being used? I see
mvapich-0.9.5-mlx2.0.1.tar.gz -- does this mean it's Mellanox's v2.0.1 of
MVAPICH 0.9.5? Are other vendors allowed to modify this? (I ask
because all of our MVAPICH's are slightly different -- fixed bugs specific to
our customers, etc.)</span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'><Aviram> We'll use 0.9.7 It will be incorporated
on the next rc. Yes we can fix and modify it.</span></font> </p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>- There appear to be multiple levels of indirection in
the MVAPICH build scripts -- what directory --prefix is it being installed
to? (this is going to be influenced by the answer to the "2
MPI" question, above)</span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'><Aviram> Will get back to you it.</span></font> </p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>3. I would like to use Open MPI v1.0.2 for the IBED
release (Gleb is on the Open MPI mailing lists and probably saw me send that
intention to the Open MPI team yesterday).</span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'><Aviram> OK. </span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>4. Gleb sent me a proposed spec file for Open MPI --
we'll iterate about this off-list.</span></font> </p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'><Aviram> Who will send us the OpenMPI version to
be integrated?</span></font> </p>
<p class=MsoNormal style='margin-left:.5in'><font size=3 face="Times New Roman"><span
style='font-size:12.0pt'> </span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>> -----Original Message-----</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> From: Aviram Gutman [<a
href="mailto:aviram@mellanox.co.il">mailto:aviram@mellanox.co.il</a>]</span></font>
<br>
<font size=2><span style='font-size:10.0pt'>> Sent: Thursday, March 23, 2006
12:47 AM</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> To: Moni Levy; Jeff Squyres
(jsquyres)</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> Cc:
openfabrics-ewg@openib.org; Gleb Natapov</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> Subject: RE: [openfabrics-ewg]
OpenMPI package</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> </span></font><br>
<font size=2><span style='font-size:10.0pt'>> </span></font><br>
<font size=2><span style='font-size:10.0pt'>> Jeff, Moni,</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> </span></font><br>
<font size=2><span style='font-size:10.0pt'>> We want to integrate to the
IBED package OpenMPI. We need an agreement</span></font> </p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>> on the package. Can we converge on which OpenMPI
version to take this </span></font><br>
<font size=2><span style='font-size:10.0pt'>> week?</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> Thus, we can release a new rc
next week with OpenMPI.</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> </span></font><br>
<font size=2><span style='font-size:10.0pt'>> </span></font><br>
<font size=2><span style='font-size:10.0pt'>> Regards,</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> Aviram</span></font>
<br>
<font size=2><span style='font-size:10.0pt'>> </span></font><br>
<font size=2><span style='font-size:10.0pt'>> -----Original Message-----</span></font>
<br>
<font size=2><span style='font-size:10.0pt'>> From:
openfabrics-ewg-bounces@openib.org</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> [<a
href="mailto:openfabrics-ewg-bounces@openib.org">mailto:openfabrics-ewg-bounces@openib.org</a>]
On Behalf Of Moni Levy</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> Sent: Thursday, March 23, 2006
10:32 AM</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> To: jsquyres@cisco.com</span></font>
<br>
<font size=2><span style='font-size:10.0pt'>> Cc:
openfabrics-ewg@openib.org; Gleb Natapov</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> Subject: [openfabrics-ewg]
OpenMPI package</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> </span></font><br>
<font size=2><span style='font-size:10.0pt'>> Hi, Jeff,</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> I
would like to share with you that there was request for a </span></font><br>
<font size=2><span style='font-size:10.0pt'>> OpenMPI package that will
enable us to test it and later integrate it </span></font><br>
<font size=2><span style='font-size:10.0pt'>> into the build framework for
the next RC of the EOD release. Voltaire </span></font><br>
<font size=2><span style='font-size:10.0pt'>> (Gleb</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> Natapov) picked up the glove
and generated such a package. It may be </span></font><br>
<font size=2><span style='font-size:10.0pt'>> used as a reference for future
packaging that I'm sure you'd like to </span></font><br>
<font size=2><span style='font-size:10.0pt'>> implement.</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> </span></font><br>
<font size=2><span style='font-size:10.0pt'>> Best regards,</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> Moni</span></font> <br>
<font size=2><span style='font-size:10.0pt'>> </span></font></p>
<p class=MsoNormal style='margin-left:.5in'><font size=3 face="Times New Roman"><span
style='font-size:12.0pt'> </span></font></p>
<p style='margin-left:.5in'><font size=2 face="Times New Roman"><span
style='font-size:10.0pt'>_______________________________________________</span></font>
<br>
<font size=2><span style='font-size:10.0pt'>openfabrics-ewg mailing list</span></font>
<br>
<font size=2><span style='font-size:10.0pt'>openfabrics-ewg@openib.org</span></font>
<br>
<font size=2><span style='font-size:10.0pt'><a
href="http://openib.org/mailman/listinfo/openfabrics-ewg" target="_blank">http://openib.org/mailman/listinfo/openfabrics-ewg</a></span></font>
</p>
</div>
</body>
</html>