[Fwd: Re: [ofa-general] [NFS/RDMA] Can't mount NFS/RDMA partition]]

Celine Bourde celine.bourde at ext.bull.net
Thu Apr 23 03:48:56 PDT 2009


There was a mistake in my last email.
My last nfs mount test with no rdma was not correct, I've retried with

[root at my_host ] #mount -o rw 192.168.0.215:/vol0 /mnt/

My nfs partition is mounted and everything is correct, which confirms that 
the problem comes from rdma connection manager.

Céline.


 Celine Bourde wrote:

> Hi,
>   
>
> I've updated nfs-utils package:
>   
> [root at my_host ~]# mount.nfs -V
>   
> mount.nfs (linux nfs-utils 1.1.6)
>   
>   
>> [root at my_host ~]# strace  mount.nfs
>> 192.168.0.215:/vol0 /mnt/ -o rdma,port=2050
>>     
>> Does it work without rdma?
>>     
>
> The problem is exactly the same without rdma:
>   
>
> [root at my_host ~]# strace  mount.nfs 192.168.0.215:/vol0 /mnt/ -o
> rw,port=2050
>   
> [..]
>   
> socket(PF_INET, SOCK_DGRAM, IPPROTO_UDP) = 3
>   
> bind(3, {sa_family=AF_INET, sin_port=htons(0),
> sin_addr=inet_addr("0.0.0.0")}, 16) = 0
>   
> fcntl(3, F_GETFL)                       = 0x2 (flags O_RDWR)
>   
> fcntl(3, F_SETFL, O_RDWR|O_NONBLOCK)    = 0
>   
> connect(3, {sa_family=AF_INET, sin_port=htons(997),
> sin_addr=inet_addr("127.0.0.1")}, 16) = 0
>   
> fcntl(3, F_SETFL, O_RDWR)               = 0
>   
> connect(3, {sa_family=AF_UNSPEC,
> sa_data="\0o\177\0\0\1\0\0\0\0\0\0\0\0"}, 16) = 0
>   
> sendto(3,
> "\0308\310\272\0\0\0\0\0\0\0\2\0\1\206\270\0\0\0\1\0\0\0\0\0\0\0\0\0\0\0\0"...,
> 40, 0, {sa_family=AF_INET, sin_port=htons(997),
> sin_addr=inet_addr("127.0.0.1")}, 16) = 40
>   
> poll([{fd=3, events=POLLIN}], 1, 3000)  = 1 ([{fd=3, revents=POLLIN}])
>   
> recvfrom(3, "\0308\310\272\0\0\0\1\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0",
> 400, MSG_DONTWAIT, {sa_family=AF_INET, sin_port=htons(997),
> sin_addr=inet_addr("127.0.0.1")}, [16]) = 24
>   
> close(3)                                = 0
>   
> mount("192.168.0.215:/vol0", "/mnt", "nfs", 0,
> "port=2050,addr=192.168.0.215"
>   
>
> .. and it blocks !
>   
>
> [root at my_host ~]# dmesg
>   
> rpcrdma: connection to 192.168.0.215:2050 on mlx4_0, memreg 5 slots 32
> ird 16
>   
> rpcrdma: connection to 192.168.0.215:2050 closed (-103)
>   
> rpcrdma: connection to 192.168.0.215:2050 on mlx4_0, memreg 5 slots 32
> ird 16
>   
> rpcrdma: connection to 192.168.0.215:2050 closed (-103)
>   
>   
>> Celine,  can you establish regular rdma
>> connections over your IB link?  Like rping?
>>     
>
> I can't etablish rdma connection, following errors occur with rping :
>   
>
> [root at my_host ~]# rping -c 192.168.0.214
>   
> cq completion failed status 5
>   
> wait for CONNECTED state 10
>   
> connect error -1
>   
> cma event RDMA_CM_EVENT_REJECTED, error 8
>   
>
> My kernel is a 2.6.27 kernel.org build on a Red Hat Distribution : Red
> Hat Enterprise Linux Server release 5.3 Beta (Tikanga).
>   
>   
> Céline.
>   
>
> _______________________________________________
>   
> general mailing list
>   
> general at lists.openfabrics.org
>   
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>   
>
> To unsubscribe, please visit
> http://openib.org/mailman/listinfo/openib-general
>   
>   




More information about the general mailing list