<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 TRANSITIONAL//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; CHARSET=UTF-8">
<META NAME="GENERATOR" CONTENT="GtkHTML/3.14.3">
</HEAD>
<BODY LINK="#0000ff">
All connections are running at SDR speed due to the switch being SDR even though they are DDR HCAs. <BR>
<BR>
Remote access is not an option due to confidentiality of the data as well as IT policies.<BR>
<BR>
Any Cisco persons on this forum using a similar setup or who would care to chime in? Is there a way to dumb this switch down by disabling the embedded SM?<BR>
<BR>
On Tue, 2007-09-04 at 00:02 +0300, Tzachi Dar wrote:
<BLOCKQUOTE TYPE=CITE>
<FONT SIZE="2"><FONT COLOR="#0000ff">Hi,</FONT></FONT>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<FONT COLOR="#000000"> </FONT>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<FONT SIZE="2"><FONT COLOR="#0000ff">Can you please check if there are any messages in the event log of the windows machines that are related to IPOIB?</FONT></FONT>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<FONT COLOR="#000000"> </FONT>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<FONT SIZE="2"><FONT COLOR="#0000ff">By the way, are all your systems using the same IB speed? (that is is there a mixture between SDR and DDR?)</FONT></FONT>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<FONT COLOR="#000000"> </FONT>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<FONT SIZE="2"><FONT COLOR="#0000ff">Unfortunately, we don't have access to such a switch, so will you be able to allow us to have a remote access to your system?</FONT></FONT>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<FONT COLOR="#000000"> </FONT>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<FONT SIZE="2"><FONT COLOR="#0000ff">Thanks</FONT></FONT>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<FONT SIZE="2"><FONT COLOR="#0000ff">Tzachi</FONT></FONT>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BR>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<HR>
<BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">From:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> ofw-bounces@lists.openfabrics.org [mailto:ofw-bounces@lists.openfabrics.org] </FONT></FONT><FONT COLOR="#000000"><B><FONT SIZE="2">On Behalf Of </FONT></B></FONT><FONT COLOR="#000000"><FONT SIZE="2">Stanley Sufficool</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">Sent:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> Friday, August 31, 2007 7:08 PM</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">To:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> Tzachi Dar</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">Cc:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> ofw</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">Subject:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> RE: [ofw] Windows Update and IB stack versions</FONT></FONT><BR>
<BR>
<BR>
</BLOCKQUOTE>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<BR>
</BLOCKQUOTE>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<FONT COLOR="#000000">This switch does not seem to allow for disabling of the embedded SM. This embedded SM would and has caused conflicts with OpenSM in managing the ports.</FONT><BR>
<BR>
<FONT COLOR="#000000">I've had more success with the Win to Lin IPoIB connectivity than Win to Win connectivity. However, I'm unable to establish a pattern of failure.</FONT><BR>
<BR>
<FONT COLOR="#000000">2 each Gentoo Linux, AMD Opteron 1GB, HP Lion Cub 128 MB, Gentoo kernel 2.6.22.x IB Drivers & ULPs</FONT><BR>
<FONT COLOR="#000000">8 each Windows x64, AMD Opteron 2GB, Voltaire 400Ex-D 128MB, WinIB gen1 (Mellanox Distro) Drivers & ULPs</FONT><BR>
<FONT COLOR="#000000">2 Each Cisco 7000P 24 - Port SFS IB Switch</FONT><BR>
<BR>
<FONT COLOR="#000000">On Fri, 2007-08-31 at 12:04 +0300, Tzachi Dar wrote: </FONT><BR>
<BLOCKQUOTE TYPE=CITE>
<FONT SIZE="2"><FONT COLOR="#0000ff">Hi,</FONT></FONT><FONT COLOR="#000000"> </FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">So far the testing of WinIB and Linux gen2 have been done using opensm and not managment switch. So if possibale, can you please try to run opensm and see if it solves your problem?</FONT></FONT><FONT COLOR="#000000"> </FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">In any case, can you please give us more details about the problem. I'm interested in the following:</FONT></FONT><FONT COLOR="#000000"> </FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">1) Is the windows to windows connectivity not working or only Linux-windows?</FONT></FONT><FONT COLOR="#000000"> </FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">2) Can you look at the event log of the windows machines and let us know if there is data there ?</FONT></FONT><FONT COLOR="#000000"> </FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Thanks</FONT></FONT><FONT COLOR="#000000"> </FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Tzachi</FONT></FONT><FONT COLOR="#000000"> </FONT><BR>
<BR>
<BLOCKQUOTE>
<HR>
<BR>
<BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">From:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> ofw-bounces@lists.openfabrics.org [mailto:ofw-bounces@lists.openfabrics.org] </FONT></FONT><FONT COLOR="#000000"><B><FONT SIZE="2">On Behalf Of </FONT></B></FONT><FONT COLOR="#000000"><FONT SIZE="2">ssufficool</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">Sent:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> Friday, August 31, 2007 8:42 AM</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">To:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> ofw</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">Subject:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> RE: [ofw] Windows Update and IB stack versions</FONT></FONT><BR>
<BR>
<BR>
<BR>
<FONT COLOR="#000000">I'm having Sporadic connectivity with IPoIB using the WinIB stack on MLX Infinihost II Ex HCAs and Cisco 7000P switches with integrated SM (on the switch). Is there a specific power on sequence I should be using or other considerations?</FONT><BR>
<BR>
<FONT COLOR="#000000">Also, are there any compatibility issues with using OFED gen2 and WinIB gen1 stacks? I have been having nothing but headaches with IPoIB and SRP.</FONT><BR>
<BR>
<FONT COLOR="#000000">Please help. Thank you.</FONT><BR>
<BR>
<FONT COLOR="#000000">On Sun, 2007-08-26 at 12:43 +0300, Leonid Keller wrote: </FONT><BR>
<BLOCKQUOTE TYPE=CITE>
<FONT SIZE="2"><FONT COLOR="#0000ff">Hi,</FONT></FONT><FONT COLOR="#000000"> </FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">The version of WHQL'ed drivers are 1.3.0.1984.</FONT></FONT><FONT COLOR="#000000"> </FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Inrease minor version to 4 and rebuild the drivers you are using to get 1.4.0.X version.</FONT></FONT><FONT COLOR="#000000"> </FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Then WU won't trouble you more.</FONT></FONT><FONT COLOR="#000000"> </FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Leonid</FONT></FONT><FONT COLOR="#000000"> </FONT><BR>
<HR>
<BR>
<BR>
<BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">From:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> ofw-bounces@lists.openfabrics.org [mailto:ofw-bounces@lists.openfabrics.org] </FONT></FONT><FONT COLOR="#000000"><B><FONT SIZE="2">On Behalf Of </FONT></B></FONT><FONT COLOR="#000000"><FONT SIZE="2">Jan Bottorff</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">Sent:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> Friday, August 24, 2007 1:44 PM</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">To:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> Tzachi Dar; ofw@lists.openfabrics.org</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">Subject:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> RE: [ofw] Windows Update and IB stack versions</FONT></FONT><BR>
<BR>
<BR>
<BLOCKQUOTE>
<BR>
<FONT SIZE="2"><FONT COLOR="#000080">Hi,</FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000080"> </FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000080">As far as I can tell, Windows Update should offer mthca and probably the IB bus driver (although at the moment they don’t seem to show up). It basically matches on PnP id and driver date. The if PnP is the same as what’s installed, and the WU driver date is newer, WU offers it as an update. The paper at </FONT></FONT><FONT SIZE="2"><FONT COLOR="#000000"><A HREF="http://www.microsoft.com/whdc/maintain/WU_logic.mspx">http://www.microsoft.com/whdc/maintain/WU_logic.mspx</A> explains the logic.</FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000000"> </FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000000">Windows Update I don’t believe will force a driver update on you, but it does offer it if you select custom (which I always do just see what MSFT thinks they should do to my system before they do it). Some users will just periodically install whatever has been updated (good for security patches, bad in this driver case).</FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000000"> </FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000000">Jan</FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000080"> </FONT></FONT><BR>
<BR>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<DIV ALIGN=center>
<HR>
</DIV>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<B><FONT SIZE="2"><FONT COLOR="#000000">From:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> Tzachi Dar [mailto:tzachid@mellanox.co.il] </FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">Sent:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> Friday, August 24, 2007 12:27 AM</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">To:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> Jan Bottorff; ofw@lists.openfabrics.org</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">Subject:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> RE: [ofw] Windows Update and IB stack versions</FONT></FONT><BR>
<BR>
<BR>
<BR>
<BR>
<FONT COLOR="#000000"> </FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Is the problem you are seeing specific to IPOIB or does it happen also for other drivers?</FONT></FONT><BR>
<BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">What I mean is this: It seems that one can easily solve the problem for ipoib but what happens for the bus driver and the low level driver (mthca.sys). Are they also replaced by windows update?</FONT></FONT><BR>
<BR>
<BR>
<BR>
<BR>
<BR>
<FONT COLOR="#000000"> </FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">It seems that solving the problem for IPOIB can be done, but what about other components?</FONT></FONT><BR>
<BR>
<BR>
<BR>
<BR>
<BR>
<FONT COLOR="#000000"> </FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Thanks</FONT></FONT><BR>
<BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Tzachi</FONT></FONT><BR>
<BR>
<BR>
<BLOCKQUOTE>
<BR>
<BR>
<FONT COLOR="#000000"> </FONT>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<BLOCKQUOTE>
<DIV ALIGN=center>
<HR>
</DIV>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
</BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<BLOCKQUOTE TYPE=CITE>
<BLOCKQUOTE>
<BLOCKQUOTE>
<B><FONT SIZE="2"><FONT COLOR="#000000">From:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> ofw-bounces@lists.openfabrics.org [mailto:ofw-bounces@lists.openfabrics.org] </FONT></FONT><FONT COLOR="#000000"><B><FONT SIZE="2">On Behalf Of </FONT></B></FONT><FONT COLOR="#000000"><FONT SIZE="2">Jan Bottorff</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">Sent:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> Wednesday, August 22, 2007 5:30 AM</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">To:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> ofw@lists.openfabrics.org</FONT></FONT><BR>
<B><FONT SIZE="2"><FONT COLOR="#000000">Subject:</FONT></FONT></B><FONT COLOR="#000000"><FONT SIZE="2"> [ofw] Windows Update and IB stack versions</FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000000">I see the WHQL signed IPoIB drivers are on Windows Update now. This brings to light a problem in the IB stack.</FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000000"> </FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000000">The issue is the PnP hardware id’s generated by the IB bus for virtual devices are not version specific. This means if I install the latest IB stack build, Windows Update will still offer to update my IPoIB drivers, even though they probably would be incompatible with the other IB stack components. The WHQL drivers are approximately build 614, and I know the IBAL interface has new functions and a new version number in the current build. There is absolutely nothing to tell Windows Update that drivers for PnP hardware id “IBA\IPoIB” in version 614 of the IB stack will not work on a stack looking for say the 758 build of the PnP hardware id “IBA\IPoIB”.</FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000000"> </FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000000">It seems like some version number and optionally a vendor unique id needs to be part of all the PnP id’s generated, to assure updates only happen between compatible components. </FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000000"> </FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000000">Jan</FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000000"> </FONT></FONT><BR>
<BR>
</BLOCKQUOTE>
</BLOCKQUOTE>
<PRE>
<FONT COLOR="#000000">_______________________________________________</FONT>
<FONT COLOR="#000000">ofw mailing list</FONT>
<FONT COLOR="#000000"><A HREF="mailto:ofw@lists.openfabrics.org">ofw@lists.openfabrics.org</A></FONT>
<FONT COLOR="#000000"><A HREF="http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ofw">http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ofw</A></FONT>
</PRE>
</BLOCKQUOTE>
</BLOCKQUOTE>
<PRE>
<FONT COLOR="#000000">_______________________________________________</FONT>
<FONT COLOR="#000000">ofw mailing list</FONT>
<FONT COLOR="#000000"><A HREF="mailto:ofw@lists.openfabrics.org">ofw@lists.openfabrics.org</A></FONT>
<FONT COLOR="#000000"><A HREF="http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ofw">http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ofw</A></FONT>
</PRE>
</BLOCKQUOTE>
</BLOCKQUOTE>
<PRE>
<FONT COLOR="#000000">_______________________________________________</FONT>
<FONT COLOR="#000000">ofw mailing list</FONT>
<FONT COLOR="#000000"><A HREF="mailto:ofw@lists.openfabrics.org">ofw@lists.openfabrics.org</A></FONT>
<FONT COLOR="#000000"><A HREF="http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ofw">http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ofw</A></FONT>
</PRE>
</BLOCKQUOTE>
</BODY>
</HTML>