<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML xmlns:o = "urn:schemas-microsoft-com:office:office"><HEAD><TITLE>WinOF 2.0 installation question</TITLE>
<META content="text/html; charset=us-ascii" http-equiv=Content-Type>
<META name=GENERATOR content="MSHTML 8.00.6001.18783"></HEAD>
<BODY>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial>Hello,</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial> A couple questions and suggestions:</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial>You do have a Mellanox ConnectX HCA in your system and not an
older Mellanox InfiniHost HCA?</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial>Download a new copy of ibclean.bat</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial>From a privileged administrator cmd window, run
ibcleanup.bat</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial>*** REBOOT ***</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial>Once rebooted - </FONT></SPAN></SPAN><SPAN
class=273380919-20072009><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN class=273380919-20072009>What is the DeviceID for the
Mellanox ConnectX HCA you have installed? Or do you know the model
number?</SPAN></FONT></SPAN></DIV></DIV>
<DIV dir=ltr align=left>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN class=273380919-20072009>run devmgmt.msc from a command
window.</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN class=273380919-20072009>You should see under
'Other Devices' an InfiniBand Controller.</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN class=273380919-20072009>Select properties for the
device.</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN class=273380919-20072009>Details
Tab</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN class=273380919-20072009>Select 'Hardware IDs'
properties</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN class=273380919-20072009>Email 1st 3 lines of Hardware
IDs properties</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009>cancel</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009>file->exit</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009></SPAN></FONT></SPAN></SPAN><SPAN
class=273380919-20072009><FONT color=#0000ff size=2
face=Arial></FONT></SPAN> </DIV></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN class=273380919-20072009><FONT color=#0000ff size=2
face=Arial>From a privileged administrator cmd window, run
ibscan.bat</FONT></SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN class=273380919-20072009>Ibscan should show no lingering
files and errs in not finding registry entries.</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN class=273380919-20072009>If this is the case,
then</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN class=273380919-20072009>Install OpenFabrics WinOF
2.0.2 (WinOF_2-0-2_wlh_x64.msi) which you downloaded from <A
href="http://www.openfabrics.org/downloads/WinOF/v2.0.2/Server_2008-Vista-HPC/Installers/">http://www.openfabrics.org/downloads/WinOF/v2.0.2/Server_2008-Vista-HPC/Installers/</A></SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN class=273380919-20072009>There is no reason I can think
of as to why WinOF 2.0.2 should not install, except for lingering files and/or
registry entries left over from previous installs.</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN class=273380919-20072009>The WinOF error your are seeing
indicates the Mellanox ConnectX bus driver installed, although the
installation of the InfiniBand HCA driver failed; not sure how this occurs as
generally if one installs the other installs and both are
required?</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN class=273380919-20072009>Try the ibcleanup.bat &
reboot, 2.0.2 install and forward the HCA DeviceID before trying
RC2.</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009>thanks,</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009>stan.</SPAN></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=273380919-20072009><FONT color=#0000ff
size=2 face=Arial><SPAN
class=273380919-20072009></SPAN></FONT></SPAN> </DIV><BR>
<DIV dir=ltr lang=en-us class=OutlookMessageHeader align=left>
<HR tabIndex=-1>
<FONT size=2 face=Tahoma><B>From:</B> Casano, Warenne
[mailto:Warenne.Casano@kla-tencor.com] <BR><B>Sent:</B> Monday, July 20, 2009
11:27 AM<BR><B>To:</B> Smith, Stan<BR><B>Cc:</B>
ofw@lists.openfabrics.org<BR><B>Subject:</B> RE: [ofw] RE: WinOF 2.0
installation question<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT color=#0000ff
face=Calibri>Hi,</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT color=#0000ff
face=Calibri></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT color=#0000ff
face=Calibri>Thank you for your response.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT color=#0000ff
face=Calibri></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT color=#0000ff
face=Calibri>I tried to reinstall WinOF again today. Here is what I
did:</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT color=#0000ff
face=Calibri></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT color=#0000ff
face=Calibri>(1) Manually removed "mlx4_* and ipoib*" from
%windir%\system32\DriverStore\Temp.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT color=#0000ff
face=Calibri>(2) Reinstall WinOF 2.0</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT color=#0000ff
face=Calibri>(3) Dialog prompting to install "Mellanox Technologies Ltd" device
driver. Select "install".</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT color=#0000ff
face=Calibri>(4) Installation failed with the following
error:</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009> </SPAN><SPAN
class=384562118-20072009> </SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=384562118-20072009><FONT color=#0000ff>
<P style="MARGIN: 0in 0in 0pt" class=MsoNormal><B
style="mso-bidi-font-weight: normal"><FONT color=#000000><FONT
face=Calibri>Mlx4_hca Install Err(2) cmd.exe /c cd /d C:\Program Files
(x86)\WinOF\IBcore & devman.exe update mlx4_hca.inf
PCI\VEN_15B3<o:p></o:p></FONT></FONT></B></P>
<P style="MARGIN: 0in 0in 0pt" class=MsoNormal><B
style="mso-bidi-font-weight: normal"><o:p><FONT color=#000000
face=Calibri> </FONT></o:p></B></P>
<P style="MARGIN: 0in 0in 0pt" class=MsoNormal><o:p><SPAN
class=384562118-20072009><FONT face=Calibri>Do you know what this error
means? I think I'll wait for </FONT><FONT size=2 face=Arial>WinOF 2.1
RC2 and try again.</FONT></SPAN></o:p></P>
<P style="MARGIN: 0in 0in 0pt" class=MsoNormal><o:p><SPAN
class=384562118-20072009><FONT size=2 face=Arial></FONT></SPAN></o:p> </P>
<P style="MARGIN: 0in 0in 0pt" class=MsoNormal><o:p><SPAN
class=384562118-20072009><FONT size=2 face=Arial>Thanks</FONT></SPAN></o:p></P>
<P style="MARGIN: 0in 0in 0pt" class=MsoNormal><o:p><SPAN
class=384562118-20072009><FONT size=2
face=Arial>Warenne</FONT></SPAN></o:p></FONT></SPAN></P></DIV><BR>
<DIV dir=ltr lang=en-us class=OutlookMessageHeader align=left>
<HR tabIndex=-1>
<FONT size=2 face=Tahoma><B>From:</B> ofw-bounces@lists.openfabrics.org
[mailto:ofw-bounces@lists.openfabrics.org] <B>On Behalf Of </B>Smith,
Stan<BR><B>Sent:</B> Monday, July 20, 2009 10:30 AM<BR><B>To:</B> Casano,
Warenne<BR><B>Cc:</B> ofw@lists.openfabrics.org<BR><B>Subject:</B> [ofw] RE:
WinOF 2.0 installation question<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV dir=ltr align=left><SPAN class=490360317-20072009><FONT color=#0000ff
size=2 face=Arial>Hello,</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=490360317-20072009><FONT color=#0000ff
size=2 face=Arial> Please see below.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=490360317-20072009><FONT color=#0000ff
size=2 face=Arial></FONT></SPAN> </DIV><FONT color=#0000ff size=2
face=Arial></FONT><FONT color=#0000ff size=2 face=Arial></FONT><BR>
<DIV dir=ltr lang=en-us class=OutlookMessageHeader align=left>
<HR tabIndex=-1>
<FONT size=2 face=Tahoma><B>From:</B> wwg-bounces@lists.openfabrics.org
[mailto:wwg-bounces@lists.openfabrics.org] <B>On Behalf Of </B>Casano,
Warenne<BR><B>Sent:</B> Monday, July 20, 2009 9:59 AM<BR><B>To:</B>
wwg@lists.openfabrics.org<BR><B>Subject:</B> [Wwg] WinOF 2.0 installation
question<BR></FONT><BR></DIV>
<DIV></DIV><!-- Converted from text/rtf format -->
<P><FONT face=Calibri>Hi,</FONT> </P>
<P><FONT face=Calibri>I am migrating an MPI application from Linux to Windows
(Intel Xeon platform with</FONT> <BR><FONT face=Calibri>Windows 2008
server). At first, I installed Mellanox WinOF 2.0 and tried to use
it</FONT> <BR><FONT face=Calibri>with Intel MPI Library. The Intel MPI
library requires DAT runtime library which was</FONT> <BR><FONT face=Calibri>not
part of the Mellanox WinOF 2.0 installation. So, I uninstalled Mellanox
WinOF 2.0.</FONT> <BR><FONT face=Calibri>I downloaded WinOF 2.0 and tried to
install. However, the installation failed. </FONT><BR><FONT
face=Calibri>From the release notes, installation may fail if the certain
files</FONT> <BR><FONT face=Calibri>are in DriverStore\Temp directory. I
could not removed those files even when I'm</FONT> <BR><FONT face=Calibri>logged
in as "administrator". </FONT><FONT color=#0000ff size=2 face=Arial><SPAN
class=490360317-20072009> </SPAN></FONT></P>
<P><FONT face=Calibri>I need to know how to remove those files from
DriverStore\Temp directory. I</FONT> <BR><FONT face=Calibri>tried using
ibcleanup; but that did not remove the files in
DriverStore\Temp.</FONT> <SPAN class=490360317-20072009><FONT color=#0000ff
size=2 face=Arial> </FONT></SPAN></P><SPAN class=490360317-20072009>
<P><FONT size=2 face=Arial><SPAN class=490360317-20072009><FONT
color=#0000ff><FONT size=3 face=Calibri><Stan> Latest version of
ibcleanup.bat @ </FONT> </FONT><FONT size=3 face=Calibri><A
href="http://www.openfabrics.org/downloads/WinOF/etc/"><FONT
color=#0000ff>http://www.openfabrics.org/downloads/WinOF/etc/</FONT></A><FONT
color=#0000ff> know how to remove these files.<BR>Are you sure the Mellanox
WinOF 2.0 installation is removed? Check device manager
(devmgr.msc)<BR></FONT></FONT></SPAN></FONT><FONT size=2 face=Arial><SPAN
class=490360317-20072009><FONT color=#0000ff size=3 face=Calibri> (You did
reboot after Mellanox uninstall?)<BR>Take a look at how ibcleanup.bat removes
DriverStore folders if per-chance if does not work for you; perform task
manually from privileged cmd window.</FONT></SPAN></FONT></SPAN></P>
<P><FONT face=Calibri>I am new in this area; so I would like to know how I could
verify whether dapltest</FONT> <BR><FONT face=Calibri>works or not. What I
need is a sample output of when dapltest works after</FONT> <BR><FONT
face=Calibri>WinOF is installed properly.</FONT> <SPAN
class=490360317-20072009><FONT color=#0000ff size=2
face=Arial> </FONT></SPAN></P>
<P><SPAN class=490360317-20072009><FONT color=#0000ff size=2 face=Arial>From a
head-node WinOF cmd window (Start->All Programs-->Windows
OpenFabrics->Command Window</FONT></SPAN><SPAN
class=490360317-20072009> <FONT color=#0000ff size=2 face=Arial><BR>start a
dapl2test server; type 'dt-svr<Enter>'<BR>The dapl2test svr is listening
on the IPv4 address you assigned to your IPoIB instance.<BR>You will need that
IPoIB IPv4 address in the next step; ipconfig will reveal if you're not
sure.</FONT></SPAN></P>
<P><SPAN class=490360317-20072009><FONT color=#0000ff size=2 face=Arial>From
another WinOF cmd window, type 'dt-cli IPoIB-IPv4-address conn' for a simple
node local connection test; 'dt-cli' with no args gives help
message.<BR>Example: If 10.104.200 is assigned to your 1st IPoIB instance @
'Local Area Connection 3' or in HPC speak 'Application
Network'</FONT></SPAN></P>
<P><SPAN class=490360317-20072009><FONT color=#0000ff size=2
face=Arial> dt-svr<Enter>
# dapl2test server is listening on 10.10.4.200<BR><BR> dt-cli
10.10.4.200 conn<Enter><BR> dt-cli
10.10.4.200 transmet # a more
complicated test<BR> dt-cli 10.10.4.200
stop # causes
dap2test server to stop; otherwise it is persistent.</FONT></SPAN></P>
<P><SPAN class=490360317-20072009><FONT color=#0000ff size=2 face=Arial>Now that
you have proven Dapl2test is functional on the head-node, make sure the
dapl2test server is still running on the head-node.<BR>using clurun run dapltest
clients from compute nodes; from the head-node command window type 'clusrun
/nodes:n1,n2,n3 dt-cli 10.10.4.200 conn' for the 1st step.<BR>Expand at your
leisure.</FONT></SPAN></P>
<P><SPAN class=490360317-20072009><FONT color=#0000ff size=2 face=Arial>Let me
know how things go.</FONT></SPAN></P>
<P><SPAN class=490360317-20072009><FONT color=#0000ff size=2
face=Arial>Stan.</FONT></SPAN></P>
<P><SPAN class=490360317-20072009><FONT color=#0000ff size=2 face=Arial>PS: I
you can wait until Tuesday 7/21 afternoon (PDT) WinOF 2.1 RC2 will be available
- a much cleaner device install/uninstall! Strongly recommended.<BR>PSS: <A
href="mailto:wwg@lists.openfabrics.org">wwg@lists.openfabrics.org</A> is a
small forum, I changed the reply to much larger audience of
developers.</FONT></SPAN></P>
<P><FONT face=Calibri>Thank you for your help.</FONT> <BR><FONT
face=Calibri>Warenne</FONT> </P></BODY></HTML>