[ofa-general] Fedora 11, kernel 2.6.31

[Jack Morgenstein]

On Tuesday 22 September 2009 21:58, Nathan Stratton wrote:
> 
> Having an issue with getting verbs working on 2.6.31. I am running Fedora 
> 11 with 2.6.31 and 1.1.2-0.1.gb00dc7d libibverbs. Everything looks great 
> until I run ibv_srq_pingpong to the server. It shows local/remote address 
> a bunch of times and then freezes.
>
You do have the latest firmware installed for your HCA.

You are using the OFED user libraries with a non-OFED kernel.  While I am surprised
that it is giving you problems with libmthca, this combination has not been tested.

You might try using the FC11 native userspace libs (libibverbs, libmthca), which you can find 
under
http://cvs.fedoraproject.org/viewvc/F-11/

-Jack

> I wanted to try OFED, but it does not work with 2.6.31. :(
> 
> [root at xen1 src]# lsmod
> Module                  Size  Used by
> ib_ucm                 13752  0
> rdma_ucm               12112  0
> ib_uverbs              32256  2 ib_ucm,rdma_ucm
> 8021q                  21200  0
> bonding                87140  0
> fuse                   60016  0
> bridge                 40488  0
> stp                     2588  1 bridge
> llc                     6240  2 bridge,stp
> ib_ipoib               68880  0
> igb                    80620  0
> ib_mthca              123700  0
> 3w_9xxx                33092  0
> rng_core                4688  0
> 
> [root at xen1 src]# ibv_devices
>      device          	   node GUID
>      ------          	----------------
>      mthca0          	0005ad00000327e8
> [root at xen1 src]# ibv_devinfo
> hca_id:	mthca0
>  	fw_ver:				3.5.0
>  	node_guid:			0005:ad00:0003:27e8
>  	sys_image_guid:			0005:ad00:0100:d050
>  	vendor_id:			0x02c9
>  	vendor_part_id:			23108
>  	hw_ver:				0xA1
>  	board_id:			MT_0270110001
>  	phys_port_cnt:			2
>  		port:	1
>  			state:			PORT_ACTIVE (4)
>  			max_mtu:		2048 (4)
>  			active_mtu:		2048 (4)
>  			sm_lid:			2
>  			port_lid:		11
>  			port_lmc:		0x00
> 
>  		port:	2
>  			state:			PORT_DOWN (1)
>  			max_mtu:		2048 (4)
>  			active_mtu:		512 (2)
>  			sm_lid:			0
>  			port_lid:		0
>  			port_lmc:		0x00
> 
> [root at xen1 src]# ibv_srq_pingpong 10.13.0.220
>    local address:  LID 0x000b, QPN 0x470406, PSN 0x697578
>    local address:  LID 0x000b, QPN 0x470407, PSN 0x4eb139
>    local address:  LID 0x000b, QPN 0x470408, PSN 0x41b959
>    local address:  LID 0x000b, QPN 0x470409, PSN 0x3e0cfd
>    local address:  LID 0x000b, QPN 0x47040a, PSN 0x3aff03
>    local address:  LID 0x000b, QPN 0x47040b, PSN 0x212873
>    local address:  LID 0x000b, QPN 0x47040c, PSN 0xecd920
>    local address:  LID 0x000b, QPN 0x47040d, PSN 0xb9fb63
>    local address:  LID 0x000b, QPN 0x47040e, PSN 0xa76195
>    local address:  LID 0x000b, QPN 0x47040f, PSN 0x9c74bc
>    local address:  LID 0x000b, QPN 0x470410, PSN 0x5644e6
>    local address:  LID 0x000b, QPN 0x470411, PSN 0x5b2db8
>    local address:  LID 0x000b, QPN 0x470412, PSN 0x18420e
>    local address:  LID 0x000b, QPN 0x470413, PSN 0x6a2a6c
>    local address:  LID 0x000b, QPN 0x470414, PSN 0xd70ff0
>    local address:  LID 0x000b, QPN 0x470415, PSN 0xe3ac2a
>    remote address: LID 0x0004, QPN 0x5d0406, PSN 0xd6f70e
>    remote address: LID 0x0004, QPN 0x5d0407, PSN 0x2d2ee0
>    remote address: LID 0x0004, QPN 0x5d0408, PSN 0x4bb6aa
>    remote address: LID 0x0004, QPN 0x5d0409, PSN 0x3821b1
>    remote address: LID 0x0004, QPN 0x5d040a, PSN 0xc91470
>    remote address: LID 0x0004, QPN 0x5d040b, PSN 0xd2a912
>    remote address: LID 0x0004, QPN 0x5d0418, PSN 0x19ea09
>    remote address: LID 0x0004, QPN 0x5d0419, PSN 0x5df7ce
>    remote address: LID 0x0004, QPN 0x5d041a, PSN 0x5c705a
>    remote address: LID 0x0004, QPN 0x5d041b, PSN 0x0b2fd4
>    remote address: LID 0x0004, QPN 0x5d041c, PSN 0x3d0ae8
>    remote address: LID 0x0004, QPN 0x5d041d, PSN 0xe4d55b
>    remote address: LID 0x0004, QPN 0x5d041e, PSN 0x0b87ab
>    remote address: LID 0x0004, QPN 0x5d041f, PSN 0xbc4f7c
>    remote address: LID 0x0004, QPN 0x5d0420, PSN 0x66c48a
>    remote address: LID 0x0004, QPN 0x5d0421, PSN 0xd77a86
> 
> 
> 
> 
> ><>
> Nathan Stratton                                CTO, BlinkMind, Inc.
> nathan at robotics.net                         nathan at blinkmind.com
> http://www.robotics.net                        http://www.blinkmind.com
> _______________________________________________
> general mailing list
> general at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
> 
> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>