[ofw] Setting up Infiniband over WinXp- Help Needed

Leonid Keller leonid at mellanox.co.il
Thu Jun 11 07:00:33 PDT 2009


Hi Ashwath,
 
If you still have problems, send us, please, the output of 'vstat -v'
and 'ipconfig /all' on both machines.
 
TIA
Leonid


________________________________

	From: ofw-bounces at lists.openfabrics.org
[mailto:ofw-bounces at lists.openfabrics.org] On Behalf Of Tzachi Dar
	Sent: Thursday, June 11, 2009 4:43 PM
	To: Ashwath Narasimhan; Fab Tillier
	Cc: ofw at lists.openfabrics.org
	Subject: RE: [ofw] Setting up Infiniband over WinXp- Help Needed
	
	
	Hi Ashwath,

	There are a few things that I would like you to try:

	1) Please run some low level IB test to see that traffic is
indeed ok. On one computer please run 

	ib_send_bw -a

	and on the other computer please run

	ib_send_bw -a 192.168.0.x        (where x is the ip of the
remote side. Please start this test with the Ethernet addresses of the
ports).
	 
	2) Assuming all works well please try to disable and enable the
network interfaces (ipoib) on both ports. Please see if this helps.
	 
	3) If this doesn't help, you will probably need to change the
parameter of "Guid bitwise mask" to e7. To do this, please open the
device manager, than go to "network adapters" select the ipoib
interfaces and than right click properties. Select the "Guid bitwise
mask" and change it to e7.
	 
	If all doesn't help, can you give me remote access to these
stations?
	 
	Thanks
	Tzachi


________________________________

		From: ofw-bounces at lists.openfabrics.org
[mailto:ofw-bounces at lists.openfabrics.org] On Behalf Of Ashwath
Narasimhan
		Sent: Thursday, June 11, 2009 5:04 AM
		To: Fab Tillier
		Cc: ofw at lists.openfabrics.org
		Subject: Re: [ofw] Setting up Infiniband over WinXp-
Help Needed
		
		
		Hi Fab,
		
		             I restarted opensm on the other node. I ran
both opensm and ibdiagnet on the other node (not on the node where
opensm is running). The logs are similar to the one I attached in my
previous mail. (Computer 1 :-192.168.0.1 logs in my previous mail). I
have disabled firewall settings on both nodes.  However, I still cannot
get it to work. I cannot access the shared folder of each node from the
other.  Is there something else I can try?
		
		p.s. There is a typo in my previous mail. I had opensm
running on computer 2 and not computer 1.
		
		regards,
		Ashwath
		
		
		On Wed, Jun 10, 2009 at 9:42 PM, Fab Tillier
<ftillier at windows.microsoft.com> wrote:
		

			Hi Ashwath,
			

			>I am new to the world of infiniband and I am
trying to set up an
			>infiniband network between two Lenovo x86
Desktops (Windows Xp).
			
			
			Welcome!
			

			>Problem:-
			>I am able to ping 192.168.0.2 from 192.168.0.1
however ping does not
			>work the other way around i.e. from 192.168.0.2
to 192.168.0.1. I don't
			>understand why this is not happening. I see
that the "bind" fails but I
			>dont understand why. Shouldn't it be two way?
(I am using one cable to
			>connect the two adaptors) Please help me.
Thanks.
			
			
			Check your firewall settings on the 192.168.0.1
box.  Can you access the administrative share on each node from the
other (\\192.168.0.1\c$, and \\192.168.0.2\c$?)
			

	
>=======================================================================
=
			>Computer No2: 192.168.0.2
			>when I ran osmtest here:
			>
			> C:\<mydirectory>osmtest -f -a
			>Command Line Arguments
			>Done with args
			>        Flow = All Validations
			>Using default guid 0x5ad000004e7c6
			>[17:59:17:437][0388] -> osm_vendor_bind:
Binding to port
			>0x5ad000004e7c6.
			>[17:59:17:437][0388] -> osm_vendor_bind: ERR
3B21: Unable to register
			>QP0 MAD se
			>rvice (IB_INSUFFICIENT_MEMORY).
			>[17:59:17:437][0388] -> osmv_bind_sa: ERR 0506:
Fail to bind to vendor
			>SMI.
			>[17:59:17:437][0388] -> osmtest_bind: ERR 0137:
Unable to bind to SA
			
			
			You probably have OpenSM running on this node,
yes?  You can't run osmtest on the same port where OpenSM is running.
			

			>when I ran ibdiagnet here
			>
			>C:\<my directory>ibdiagnet
			>Loading IBIS from: C:/Program
	
>Files/Mellanox/MLNX_WinOF/Tools/ibdiagnet.exe/lib/
			>ibis1.0
			>Loading IBDM from: C:/Program
	
>Files/Mellanox/MLNX_WinOF/Tools/ibdiagnet.exe/lib/
			>ibdm1.0
			>-W- Topology file is not specified.
			>    Reports regarding cluster links will use
direct routes.
			>-I- Using port 2 as the local port.
			>-E- Fail to ibsac_bind.
			
			
			Don't know the details of this tool, maybe it's
running into the same problems as osmtest?  Try running OpenSM on the
other node and see if the problem follows the SM or not.
			
			-Fab
			




		-- 
		regards,
		Ashwath
		

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/ofw/attachments/20090611/877a2e0b/attachment.html>


More information about the ofw mailing list