[ofw] Setting up Infiniband over WinXp- Help Needed

Ashwath Narasimhan nashwath at gmail.com
Wed Jun 10 18:14:37 PDT 2009


Hello,

I am new to the world of infiniband and I am trying to set up an infiniband
network between two Lenovo x86 Desktops (Windows Xp).

*Description*:-
The hardware I am using is a Mellanox Infinihost III Adaptor (MT25208). I
have downloaded and installed the required drivers for windows Xp from the
mellanox website. I verified the successful installation by looking at the
Device Manager where the Adaptor gets listed and detected. I then assigned
static ip addresses to both the Desktops one as 192.168.0.1 and the other as
192.168.0.2. After this I run the subnet manager as "sc start opensm". My
windows xp shows that the connection is successful. Both Yellow LED's and
Green Led's glow signifying a logical and physical link being established. I
also verified if the ports were active through "vstat".

*Problem*:-
I am able to ping 192.168.0.2 from 192.168.0.1 however ping does not work
the other way around i.e. from 192.168.0.2 to 192.168.0.1. I don't
understand why this is not happening. I see that the "*bind"* fails but I
dont understand why. Shouldn't it be two way? (I am using one cable to
connect the two adaptors) Please help me. Thanks.

*MoreInfo:*
*
============================================================================
*
I ran *osmtest -f -a* on both the computers and these are the results

*Computer No 1: 192.168.0.1* (I started the subnet manager service on this)

C:\<my directory>\>osmtest -f a
Command Line Arguments
Done with args
        Flow = All Validations
Using default guid 0x5ad000004e625
[20:40:19:718][0C2C] -> osm_vendor_bind: Binding to port 0x5ad000004e625.
[20:40:19:718][0C2C] -> osmtest_validate_sa_class_port_info:
-----------------------------
SA Class Port Info:
 base_ver:1
 class_ver:2
 cap_mask:0x2202
 resp_time_val:0x1F
-----------------------------
[20:40:19:718][0C2C] -> osmtest_create_db: ERR 0130: Unable to open
inventory fi
le (osmtest.dat)
[20:40:19:718][0C2C] -> osmtest_run: ERR 0145: Database creation failed
(IB_REMO
TE_ERROR)
OSMTEST: TEST "All Validations" FAIL

*Results of ibdiagnet on the same computer*

C:\<mydirectory>ibdiagnet
Loading IBIS from: C:/Program
Files/Mellanox/MLNX_WinOF/Tools/ibdiagnet.exe/lib
ibis1.0
Loading IBDM from: C:/Program
Files/Mellanox/MLNX_WinOF/Tools/ibdiagnet.exe/lib
ibdm1.0
-W- Topology file is not specified.
    Reports regarding cluster links will use direct routes.
-I- Using port 1 as the local port.
-I- Discovering the subnet ... 2 nodes (0 Switches & 2 CA-s) discovered.

-I---------------------------------------------------
-I- Links With Logical State = INIT
-I---------------------------------------------------
-I- No bad Links (with logical state = INIT) were found
-I---------------------------------------------------
-I- PM Counters Info
-I---------------------------------------------------
-W- lid=0x0003 guid=0x0005ad000004e7c6 dev=25208 Topspin/U/P2
      Performence Monitor counter : Value
      symbol_error_counter        : 0xffff (overflow)
-I---------------------------------------------------
-I- Bad Links Info
-I---------------------------------------------------
-I- No bad link were found
-I- Done. Run time was 0 seconds.

=========================================================================================
*Computer No2: 192.168.0.2*
*when I ran osmtest here:*
**
 C:\<mydirectory>osmtest -f -a
Command Line Arguments
Done with args
        Flow = All Validations
Using default guid 0x5ad000004e7c6
[17:59:17:437][0388] -> osm_vendor_bind: Binding to port 0x5ad000004e7c6.
[17:59:17:437][0388] -> osm_vendor_bind: ERR 3B21: Unable to register QP0
MAD se
rvice (IB_INSUFFICIENT_MEMORY).
[17:59:17:437][0388] -> osmv_bind_sa: ERR 0506: Fail to bind to vendor SMI.
[17:59:17:437][0388] -> osmtest_bind: ERR 0137: Unable to bind to SA

*when I ran ibdiagnet here*

C:\<my directory>ibdiagnet
Loading IBIS from: C:/Program
Files/Mellanox/MLNX_WinOF/Tools/ibdiagnet.exe/lib/
ibis1.0
Loading IBDM from: C:/Program
Files/Mellanox/MLNX_WinOF/Tools/ibdiagnet.exe/lib/
ibdm1.0
-W- Topology file is not specified.
    Reports regarding cluster links will use direct routes.
-I- Using port 2 as the local port.
-E- Fail to ibsac_bind.


=========================================================================================
thank you,

regards,
Ashwath
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/ofw/attachments/20090610/be2a4f95/attachment.html>


More information about the ofw mailing list