[ofa-general] [NFS/RDMA] Can't mount NFS/RDMA partition]

[Jeff Becker]

Salut Celine!

Jeff Becker wrote:
> Jon Mason wrote:
>   
>> On Wed, Apr 22, 2009 at 04:41:37PM +0200, Celine Bourde wrote:
>>   
>>     
>>>> On the server did you remember to:
>>>> echo rdma 2050 > /proc/fs/nfsd/portlist
>>>>       
>>>>         
>>> Yes.
>>>
>>> My nfs utils version :
>>>
>>> [root at my_host]#/sbin/mount.nfs -V
>>> mount.nfs (linux nfs-utils 1.1.4)
>>>
>>> If I try mount.nfs command :
>>>
>>> [root at my_host ~]# strace  mount.nfs 192.168.0.215:/vol0 /mnt/ -o rdma,port=2050
>>>     
>>>       
>> Does it work without rdma?
>>   
>>     
>
> Since I have 2.6.27.3 installed on my test machines, I'll reboot and
> check it out.
>
> -jeff
>
>   

I was able to bring up an RDMA mount on 2.6.27.3, and run the basic
connectathon
tests successfully. One difference, is my nfs-utils is 1.1.6 but I doubt
that should
matter.

-jeff

>>   
>>     
>>> [..]
>>> socket(PF_INET, SOCK_DGRAM, IPPROTO_UDP) = 3
>>> bind(3, {sa_family=AF_INET, sin_port=htons(0), sin_addr=inet_addr("0.0.0.0")}, 16) = 0
>>> fcntl(3, F_GETFL)                       = 0x2 (flags O_RDWR)
>>> fcntl(3, F_SETFL, O_RDWR|O_NONBLOCK)    = 0
>>> connect(3, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, 16) = 0
>>> fcntl(3, F_SETFL, O_RDWR)               = 0
>>> connect(3, {sa_family=AF_UNSPEC, sa_data="\0o\177\0\0\1\0\0\0\0\0\0\0\0"}, 16) = 0
>>> sendto(3, "uw\211\257\0\0\0\0\0\0\0\2\0\1\206\270\0\0\0\1\0\0\0\0\0\0\0\0\0\0\0\0"..., 40, 0, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, 16) = 40
>>> poll([{fd=3, events=POLLIN}], 1, 3000)  = 1 ([{fd=3, revents=POLLIN}])
>>> recvfrom(3, "uw\211\257\0\0\0\1\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 400, MSG_DONTWAIT, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, [16]) = 24
>>> close(3)                                = 0
>>> mount("192.168.0.215:/vol0", "/mnt", "nfs", 0, "rdma,port=2050,addr=192.168.0.21"
>>>
>>> and it blocks again.
>>>
>>>     
>>>       
>>>>> ? Also, make sure that none of the stock 2.6.27 NFS modules are loaded -
>>>>> they should all
>>>>> be from OFED 1.4.1
>>>>>         
>>>>>           
>>> All nfs modules (OFED 1.4.1) are loaded (and dependencies).
>>> Modules are listed bellow -> updates directory means it
>>> comes from OFED version and no kernel version)
>>>
>>> [root at my_host ~]# modinfo ib_ipoib
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko
>>>
>>> [root at my_host ~]# modinfo ib_sa
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_sa.ko
>>>
>>> [root at my_host ~]# modinfo iw_cm
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/iw_cm.ko
>>>
>>> [root at my_host ~]# modinfo ib_addr
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_addr.ko
>>>
>>> [root at my_host ~]# modinfo mlx4_core
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/net/mlx4/mlx4_core.ko
>>>
>>> [root at my_host ~]# modinfo ib_core
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_core.ko
>>>
>>> [root at my_host ~]# modinfo ib_cm
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_cm.ko
>>>
>>> [root at my_host ~]# modinfo rdma_cm
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/rdma_cm.ko
>>>
>>> [root at my_host ~]# modinfo xprtrdma
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/xprtrdma/xprtrdma.ko
>>>
>>> [root at my_host ~]# modinfo svcrdma
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/xprtrdma/svcrdma.ko
>>>
>>> [root at my_host ofa_kernel-1.4.1]# modinfo nfsd
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/nfsd/nfsd.ko
>>>
>>> [root at my_host ofa_kernel-1.4.1]# modinfo lockd
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/lockd/lockd.ko
>>>
>>> [root at my_host ofa_kernel-1.4.1]# modinfo nfs_acl
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/nfs_common/nfs_acl.ko
>>>
>>> [root at my_host ofa_kernel-1.4.1]# modinfo sunrpc
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/sunrpc.ko
>>>
>>> root at my_host ofa_kernel-1.4.1]# modinfo exportfs
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/exportfs/exportfs.ko
>>>
>>> [root at my_host ofa_kernel-1.4.1]# modinfo auth_rpcgss
>>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko
>>>
>>> Any other Idea ?
>>>     
>>>       
>> Does dmesg say anything interesting?
>>
>>   
>>     
>>> Thanks.
>>>
>>> Céline.
>>>
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> general mailing list
>>> general at lists.openfabrics.org
>>> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>>>
>>> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>>>     
>>>       
>
> _______________________________________________
> general mailing list
> general at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>
> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>