<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML xmlns:o = "urn:schemas-microsoft-com:office:office"><HEAD><TITLE>WinOF 2.0 installation question</TITLE>
<META http-equiv=Content-Type content="text/html; charset=us-ascii">
<META content="MSHTML 6.00.2900.5512" name=GENERATOR></HEAD>
<BODY>
<DIV><SPAN class=224232107-21072009><FONT face=Arial color=#0000ff size=2>If you
are not sure that you have made reboot while uninstalling Mellanox package, you
can try to clean up with Mellanox installer: </FONT></SPAN></DIV>
<DIV><SPAN class=224232107-21072009><FONT face=Arial color=#0000ff
size=2>install the same Mellanox package once more and then uninstall it WITH
REBOOT!</FONT></SPAN></DIV>
<DIV><SPAN class=224232107-21072009><FONT face=Arial color=#0000ff size=2>It is
to clean up all the installed stuff. </FONT></SPAN></DIV>
<DIV><SPAN class=224232107-21072009><FONT face=Arial color=#0000ff size=2>(i
don't know however whether it is better than ibcleanup.bat)</FONT></SPAN></DIV>
<DIV><SPAN class=224232107-21072009><FONT face=Arial color=#0000ff
size=2></FONT></SPAN> </DIV><BR>
<BLOCKQUOTE dir=ltr
style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px solid; MARGIN-RIGHT: 0px">
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> ofw-bounces@lists.openfabrics.org
[mailto:ofw-bounces@lists.openfabrics.org] <B>On Behalf Of </B>Smith,
Stan<BR><B>Sent:</B> Monday, July 20, 2009 11:02 PM<BR><B>To:</B> Casano,
Warenne<BR><B>Cc:</B> ofw@lists.openfabrics.org<BR><B>Subject:</B> RE: [ofw]
RE: WinOF 2.0 installation question<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2>Hello,</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2> A couple questions and
suggestions:</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2>You do have a Mellanox ConnectX HCA in your system and
not an older Mellanox InfiniHost HCA?</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2>Download a new copy of ibclean.bat</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2>From a privileged administrator cmd window, run
ibcleanup.bat</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2>*** REBOOT ***</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2>Once rebooted - </FONT></SPAN></SPAN><SPAN
class=273380919-20072009><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN class=273380919-20072009>What is the DeviceID for
the Mellanox ConnectX HCA you have installed? Or do you know the model
number?</SPAN></FONT></SPAN></DIV></DIV>
<DIV dir=ltr align=left>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN class=273380919-20072009>run devmgmt.msc from a
command window.</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN class=273380919-20072009>You should see under
'Other Devices' an InfiniBand Controller.</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN class=273380919-20072009>Select properties for the
device.</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN class=273380919-20072009>Details
Tab</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN class=273380919-20072009>Select 'Hardware IDs'
properties</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN class=273380919-20072009>Email 1st 3 lines of
Hardware IDs properties</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009>cancel</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009>file->exit</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009></SPAN></FONT></SPAN></SPAN><SPAN
class=273380919-20072009><FONT face=Arial color=#0000ff
size=2></FONT></SPAN> </DIV></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2>From a privileged administrator cmd window, run
ibscan.bat</FONT></SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN class=273380919-20072009>Ibscan should show no
lingering files and errs in not finding registry
entries.</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN class=273380919-20072009>If this is the case,
then</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN class=273380919-20072009>Install OpenFabrics WinOF
2.0.2 (WinOF_2-0-2_wlh_x64.msi) which you downloaded from <A
href="http://www.openfabrics.org/downloads/WinOF/v2.0.2/Server_2008-Vista-HPC/Installers/">http://www.openfabrics.org/downloads/WinOF/v2.0.2/Server_2008-Vista-HPC/Installers/</A></SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN class=273380919-20072009>There is no reason I can
think of as to why WinOF 2.0.2 should not install, except for lingering files
and/or registry entries left over from previous
installs.</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN class=273380919-20072009>The WinOF error your are
seeing indicates the Mellanox ConnectX bus driver installed, although the
installation of the InfiniBand HCA driver failed; not sure how this occurs as
generally if one installs the other installs and both are
required?</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN class=273380919-20072009>Try the ibcleanup.bat
& reboot, 2.0.2 install and forward the HCA DeviceID before trying
RC2.</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009>thanks,</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009>stan.</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT face=Arial
color=#0000ff size=2><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV><BR>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Casano, Warenne
[mailto:Warenne.Casano@kla-tencor.com] <BR><B>Sent:</B> Monday, July 20, 2009
11:27 AM<BR><B>To:</B> Smith, Stan<BR><B>Cc:</B>
ofw@lists.openfabrics.org<BR><B>Subject:</B> RE: [ofw] RE: WinOF 2.0
installation question<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT face=Calibri
color=#0000ff>Hi,</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT face=Calibri
color=#0000ff></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT face=Calibri
color=#0000ff>Thank you for your response.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT face=Calibri
color=#0000ff></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT face=Calibri
color=#0000ff>I tried to reinstall WinOF again today. Here is what I
did:</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT face=Calibri
color=#0000ff></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT face=Calibri
color=#0000ff>(1) Manually removed "mlx4_* and ipoib*" from
%windir%\system32\DriverStore\Temp.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT face=Calibri
color=#0000ff>(2) Reinstall WinOF 2.0</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT face=Calibri
color=#0000ff>(3) Dialog prompting to install "Mellanox Technologies Ltd"
device driver. Select "install".</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT face=Calibri
color=#0000ff>(4) Installation failed with the following
error:</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009> </SPAN><SPAN
class=384562118-20072009> </SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT color=#0000ff>
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><B
style="mso-bidi-font-weight: normal"><FONT color=#000000><FONT
face=Calibri>Mlx4_hca Install Err(2) cmd.exe /c cd /d C:\Program Files
(x86)\WinOF\IBcore & devman.exe update mlx4_hca.inf
PCI\VEN_15B3<o:p></o:p></FONT></FONT></B></P>
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><B
style="mso-bidi-font-weight: normal"><o:p><FONT face=Calibri
color=#000000> </FONT></o:p></B></P>
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><o:p><SPAN
class=384562118-20072009><FONT face=Calibri>Do you know what this error
means? I think I'll wait for </FONT><FONT face=Arial size=2>WinOF 2.1
RC2 and try again.</FONT></SPAN></o:p></P>
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><o:p><SPAN
class=384562118-20072009><FONT face=Arial
size=2></FONT></SPAN></o:p> </P>
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><o:p><SPAN
class=384562118-20072009><FONT face=Arial
size=2>Thanks</FONT></SPAN></o:p></P>
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><o:p><SPAN
class=384562118-20072009><FONT face=Arial
size=2>Warenne</FONT></SPAN></o:p></FONT></SPAN></P></DIV><BR>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> ofw-bounces@lists.openfabrics.org
[mailto:ofw-bounces@lists.openfabrics.org] <B>On Behalf Of </B>Smith,
Stan<BR><B>Sent:</B> Monday, July 20, 2009 10:30 AM<BR><B>To:</B> Casano,
Warenne<BR><B>Cc:</B> ofw@lists.openfabrics.org<BR><B>Subject:</B> [ofw] RE:
WinOF 2.0 installation question<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV dir=ltr align=left><SPAN class=490360317-20072009><FONT face=Arial
color=#0000ff size=2>Hello,</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=490360317-20072009><FONT face=Arial
color=#0000ff size=2> Please see below.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=490360317-20072009><FONT face=Arial
color=#0000ff size=2></FONT></SPAN> </DIV><FONT face=Arial color=#0000ff
size=2></FONT><FONT face=Arial color=#0000ff size=2></FONT><BR>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> wwg-bounces@lists.openfabrics.org
[mailto:wwg-bounces@lists.openfabrics.org] <B>On Behalf Of </B>Casano,
Warenne<BR><B>Sent:</B> Monday, July 20, 2009 9:59 AM<BR><B>To:</B>
wwg@lists.openfabrics.org<BR><B>Subject:</B> [Wwg] WinOF 2.0 installation
question<BR></FONT><BR></DIV>
<DIV></DIV><!-- Converted from text/rtf format -->
<P><FONT face=Calibri>Hi,</FONT> </P>
<P><FONT face=Calibri>I am migrating an MPI application from Linux to Windows
(Intel Xeon platform with</FONT> <BR><FONT face=Calibri>Windows 2008
server). At first, I installed Mellanox WinOF 2.0 and tried to use
it</FONT> <BR><FONT face=Calibri>with Intel MPI Library. The Intel MPI
library requires DAT runtime library which was</FONT> <BR><FONT
face=Calibri>not part of the Mellanox WinOF 2.0 installation. So, I
uninstalled Mellanox WinOF 2.0.</FONT> <BR><FONT face=Calibri>I downloaded
WinOF 2.0 and tried to install. However, the installation failed.
</FONT><BR><FONT face=Calibri>From the release notes, installation may fail if
the certain files</FONT> <BR><FONT face=Calibri>are in DriverStore\Temp
directory. I could not removed those files even when I'm</FONT>
<BR><FONT face=Calibri>logged in as "administrator". </FONT><FONT
face=Arial color=#0000ff size=2><SPAN
class=490360317-20072009> </SPAN></FONT></P>
<P><FONT face=Calibri>I need to know how to remove those files from
DriverStore\Temp directory. I</FONT> <BR><FONT face=Calibri>tried using
ibcleanup; but that did not remove the files in
DriverStore\Temp.</FONT> <SPAN class=490360317-20072009><FONT face=Arial
color=#0000ff size=2> </FONT></SPAN></P><SPAN class=490360317-20072009>
<P><FONT face=Arial size=2><SPAN class=490360317-20072009><FONT
color=#0000ff><FONT face=Calibri size=3><Stan> Latest version of
ibcleanup.bat @ </FONT> </FONT><FONT face=Calibri size=3><A
href="http://www.openfabrics.org/downloads/WinOF/etc/"><FONT
color=#0000ff>http://www.openfabrics.org/downloads/WinOF/etc/</FONT></A><FONT
color=#0000ff> know how to remove these files.<BR>Are you sure the
Mellanox WinOF 2.0 installation is removed? Check device manager
(devmgr.msc)<BR></FONT></FONT></SPAN></FONT><FONT face=Arial size=2><SPAN
class=490360317-20072009><FONT face=Calibri color=#0000ff size=3> (You
did reboot after Mellanox uninstall?)<BR>Take a look at how ibcleanup.bat
removes DriverStore folders if per-chance if does not work for
you; perform task manually from privileged cmd
window.</FONT></SPAN></FONT></SPAN></P>
<P><FONT face=Calibri>I am new in this area; so I would like to know how I
could verify whether dapltest</FONT> <BR><FONT face=Calibri>works or
not. What I need is a sample output of when dapltest works after</FONT>
<BR><FONT face=Calibri>WinOF is installed properly.</FONT> <SPAN
class=490360317-20072009><FONT face=Arial color=#0000ff
size=2> </FONT></SPAN></P>
<P><SPAN class=490360317-20072009><FONT face=Arial color=#0000ff size=2>From a
head-node WinOF cmd window (Start->All Programs-->Windows
OpenFabrics->Command Window</FONT></SPAN><SPAN
class=490360317-20072009> <FONT face=Arial color=#0000ff size=2><BR>start
a dapl2test server; type 'dt-svr<Enter>'<BR>The dapl2test svr is
listening on the IPv4 address you assigned to your IPoIB instance.<BR>You will
need that IPoIB IPv4 address in the next step; ipconfig will reveal if you're
not sure.</FONT></SPAN></P>
<P><SPAN class=490360317-20072009><FONT face=Arial color=#0000ff size=2>From
another WinOF cmd window, type 'dt-cli IPoIB-IPv4-address conn' for a simple
node local connection test; 'dt-cli' with no args gives help
message.<BR>Example: If 10.104.200 is assigned to your 1st IPoIB instance @
'Local Area Connection 3' or in HPC speak 'Application
Network'</FONT></SPAN></P>
<P><SPAN class=490360317-20072009><FONT face=Arial color=#0000ff
size=2> dt-svr<Enter> #
dapl2test server is listening on 10.10.4.200<BR><BR> dt-cli
10.10.4.200 conn<Enter><BR> dt-cli
10.10.4.200 transmet # a more
complicated test<BR> dt-cli 10.10.4.200
stop #
causes dap2test server to stop; otherwise it is persistent.</FONT></SPAN></P>
<P><SPAN class=490360317-20072009><FONT face=Arial color=#0000ff size=2>Now
that you have proven Dapl2test is functional on the head-node, make sure the
dapl2test server is still running on the head-node.<BR>using clurun run
dapltest clients from compute nodes; from the head-node command window type
'clusrun /nodes:n1,n2,n3 dt-cli 10.10.4.200 conn' for the 1st step.<BR>Expand
at your leisure.</FONT></SPAN></P>
<P><SPAN class=490360317-20072009><FONT face=Arial color=#0000ff size=2>Let me
know how things go.</FONT></SPAN></P>
<P><SPAN class=490360317-20072009><FONT face=Arial color=#0000ff
size=2>Stan.</FONT></SPAN></P>
<P><SPAN class=490360317-20072009><FONT face=Arial color=#0000ff size=2>PS: I
you can wait until Tuesday 7/21 afternoon (PDT) WinOF 2.1 RC2 will be
available - a much cleaner device install/uninstall! Strongly
recommended.<BR>PSS: <A
href="mailto:wwg@lists.openfabrics.org">wwg@lists.openfabrics.org</A> is
a small forum, I changed the reply to much larger audience of
developers.</FONT></SPAN></P>
<P><FONT face=Calibri>Thank you for your help.</FONT> <BR><FONT
face=Calibri>Warenne</FONT> </P></BLOCKQUOTE></BODY></HTML>