[ofa-general] [NFS/RDMA] Can't mount NFS/RDMA partition]

[Jeff Becker]

Jon Mason wrote:
> On Wed, Apr 22, 2009 at 04:41:37PM +0200, Celine Bourde wrote:
>   
>>> On the server did you remember to:
>>> echo rdma 2050 > /proc/fs/nfsd/portlist
>>>       
>> Yes.
>>
>> My nfs utils version :
>>
>> [root at my_host]#/sbin/mount.nfs -V
>> mount.nfs (linux nfs-utils 1.1.4)
>>
>> If I try mount.nfs command :
>>
>> [root at my_host ~]# strace  mount.nfs 192.168.0.215:/vol0 /mnt/ -o rdma,port=2050
>>     
>
> Does it work without rdma?
>   

Since I have 2.6.27.3 installed on my test machines, I'll reboot and
check it out.

-jeff

>   
>> [..]
>> socket(PF_INET, SOCK_DGRAM, IPPROTO_UDP) = 3
>> bind(3, {sa_family=AF_INET, sin_port=htons(0), sin_addr=inet_addr("0.0.0.0")}, 16) = 0
>> fcntl(3, F_GETFL)                       = 0x2 (flags O_RDWR)
>> fcntl(3, F_SETFL, O_RDWR|O_NONBLOCK)    = 0
>> connect(3, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, 16) = 0
>> fcntl(3, F_SETFL, O_RDWR)               = 0
>> connect(3, {sa_family=AF_UNSPEC, sa_data="\0o\177\0\0\1\0\0\0\0\0\0\0\0"}, 16) = 0
>> sendto(3, "uw\211\257\0\0\0\0\0\0\0\2\0\1\206\270\0\0\0\1\0\0\0\0\0\0\0\0\0\0\0\0"..., 40, 0, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, 16) = 40
>> poll([{fd=3, events=POLLIN}], 1, 3000)  = 1 ([{fd=3, revents=POLLIN}])
>> recvfrom(3, "uw\211\257\0\0\0\1\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 400, MSG_DONTWAIT, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, [16]) = 24
>> close(3)                                = 0
>> mount("192.168.0.215:/vol0", "/mnt", "nfs", 0, "rdma,port=2050,addr=192.168.0.21"
>>
>> and it blocks again.
>>
>>     
>>>> ? Also, make sure that none of the stock 2.6.27 NFS modules are loaded -
>>>> they should all
>>>> be from OFED 1.4.1
>>>>         
>> All nfs modules (OFED 1.4.1) are loaded (and dependencies).
>> Modules are listed bellow -> updates directory means it
>> comes from OFED version and no kernel version)
>>
>> [root at my_host ~]# modinfo ib_ipoib
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko
>>
>> [root at my_host ~]# modinfo ib_sa
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_sa.ko
>>
>> [root at my_host ~]# modinfo iw_cm
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/iw_cm.ko
>>
>> [root at my_host ~]# modinfo ib_addr
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_addr.ko
>>
>> [root at my_host ~]# modinfo mlx4_core
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/net/mlx4/mlx4_core.ko
>>
>> [root at my_host ~]# modinfo ib_core
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_core.ko
>>
>> [root at my_host ~]# modinfo ib_cm
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_cm.ko
>>
>> [root at my_host ~]# modinfo rdma_cm
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/rdma_cm.ko
>>
>> [root at my_host ~]# modinfo xprtrdma
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/xprtrdma/xprtrdma.ko
>>
>> [root at my_host ~]# modinfo svcrdma
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/xprtrdma/svcrdma.ko
>>
>> [root at my_host ofa_kernel-1.4.1]# modinfo nfsd
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/nfsd/nfsd.ko
>>
>> [root at my_host ofa_kernel-1.4.1]# modinfo lockd
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/lockd/lockd.ko
>>
>> [root at my_host ofa_kernel-1.4.1]# modinfo nfs_acl
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/nfs_common/nfs_acl.ko
>>
>> [root at my_host ofa_kernel-1.4.1]# modinfo sunrpc
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/sunrpc.ko
>>
>> root at my_host ofa_kernel-1.4.1]# modinfo exportfs
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/exportfs/exportfs.ko
>>
>> [root at my_host ofa_kernel-1.4.1]# modinfo auth_rpcgss
>> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko
>>
>> Any other Idea ?
>>     
>
> Does dmesg say anything interesting?
>
>   
>> Thanks.
>>
>> Céline.
>>
>>
>>
>>
>>
>> _______________________________________________
>> general mailing list
>> general at lists.openfabrics.org
>> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>>
>> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>>