[ofa-general] NFSRDMA connectathon prelim. testing status,

Vu Pham vuhuong at mellanox.com
Sat Feb 21 01:33:19 PST 2009


Hi Tom,

I have both nfsrdma client and server on 2.6.29-rc5 kernel, 
nfs-utils-1.1.4. I'm using both Infinihost III (ib_mthca) and ConnectX 
(mlx4_ib) HCAs
I have seen several problems during my testing at NFS Connectathon 2009

1. When I used ConnectX (mlx4_ib) HCAs on both client and server, the 
client can not mount. Talking to Tom Talpey and scanning the code, I saw 
that xprtrdma module is using ib_reg_phys_mr() and mlx4_ib verbs 
provider does not have the implementation for this verb.
If I have client on mlx4_ib and server on ib_mthca, I hit the following 
crash because of bad error handling in xprtrdma (see file attached - 
mlx4_mount_problem.log)

Because of this problem, I use InfiniHost III (ib_mthca) for all of my 
tests at Connectathon

2. Testing Linux nfsrdma client against both Linux and OpenSolaris 
nfsrdma servers, I hit the process hung problem during the 
connectathon's lock test (seeing sync_page_1.log and sync_page_2.log 
attached files). I can only reproduce it when I ran connectathon more 
than 500 iterations (-N 1000)
I can NOT reproduce the problem with nfs client/server over IPoIB

3. Testing openSolaris nfsrdma client against linux nfsrdma server, I 
hit the following BUG_ON() right away(see file attached - svcrdma_send.log)

thanks,
-vu
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: mlx4_mount_problem.log
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20090221/c3e9d764/attachment.ksh>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: sync_page_1.log
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20090221/c3e9d764/attachment-0001.ksh>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: sync_page_2.log
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20090221/c3e9d764/attachment-0002.ksh>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: svcrdma_send.log
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20090221/c3e9d764/attachment-0003.ksh>


More information about the general mailing list