[ofa-general] [NFS/RDMA] Can't mount NFS/RDMA partition]

[Jon Mason]

On Wed, Apr 22, 2009 at 04:41:37PM +0200, Celine Bourde wrote:
>> On the server did you remember to:
>> echo rdma 2050 > /proc/fs/nfsd/portlist
>
> Yes.
>
> My nfs utils version :
>
> [root at my_host]#/sbin/mount.nfs -V
> mount.nfs (linux nfs-utils 1.1.4)
>
> If I try mount.nfs command :
>
> [root at my_host ~]# strace  mount.nfs 192.168.0.215:/vol0 /mnt/ -o rdma,port=2050

Does it work without rdma?

> [..]
> socket(PF_INET, SOCK_DGRAM, IPPROTO_UDP) = 3
> bind(3, {sa_family=AF_INET, sin_port=htons(0), sin_addr=inet_addr("0.0.0.0")}, 16) = 0
> fcntl(3, F_GETFL)                       = 0x2 (flags O_RDWR)
> fcntl(3, F_SETFL, O_RDWR|O_NONBLOCK)    = 0
> connect(3, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, 16) = 0
> fcntl(3, F_SETFL, O_RDWR)               = 0
> connect(3, {sa_family=AF_UNSPEC, sa_data="\0o\177\0\0\1\0\0\0\0\0\0\0\0"}, 16) = 0
> sendto(3, "uw\211\257\0\0\0\0\0\0\0\2\0\1\206\270\0\0\0\1\0\0\0\0\0\0\0\0\0\0\0\0"..., 40, 0, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, 16) = 40
> poll([{fd=3, events=POLLIN}], 1, 3000)  = 1 ([{fd=3, revents=POLLIN}])
> recvfrom(3, "uw\211\257\0\0\0\1\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 400, MSG_DONTWAIT, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, [16]) = 24
> close(3)                                = 0
> mount("192.168.0.215:/vol0", "/mnt", "nfs", 0, "rdma,port=2050,addr=192.168.0.21"
>
> and it blocks again.
>
>>> ? Also, make sure that none of the stock 2.6.27 NFS modules are loaded -
>>> they should all
>>> be from OFED 1.4.1
>>
>
> All nfs modules (OFED 1.4.1) are loaded (and dependencies).
> Modules are listed bellow -> updates directory means it
> comes from OFED version and no kernel version)
>
> [root at my_host ~]# modinfo ib_ipoib
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko
>
> [root at my_host ~]# modinfo ib_sa
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_sa.ko
>
> [root at my_host ~]# modinfo iw_cm
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/iw_cm.ko
>
> [root at my_host ~]# modinfo ib_addr
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_addr.ko
>
> [root at my_host ~]# modinfo mlx4_core
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/net/mlx4/mlx4_core.ko
>
> [root at my_host ~]# modinfo ib_core
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_core.ko
>
> [root at my_host ~]# modinfo ib_cm
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_cm.ko
>
> [root at my_host ~]# modinfo rdma_cm
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/rdma_cm.ko
>
> [root at my_host ~]# modinfo xprtrdma
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/xprtrdma/xprtrdma.ko
>
> [root at my_host ~]# modinfo svcrdma
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/xprtrdma/svcrdma.ko
>
> [root at my_host ofa_kernel-1.4.1]# modinfo nfsd
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/nfsd/nfsd.ko
>
> [root at my_host ofa_kernel-1.4.1]# modinfo lockd
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/lockd/lockd.ko
>
> [root at my_host ofa_kernel-1.4.1]# modinfo nfs_acl
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/nfs_common/nfs_acl.ko
>
> [root at my_host ofa_kernel-1.4.1]# modinfo sunrpc
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/sunrpc.ko
>
> root at my_host ofa_kernel-1.4.1]# modinfo exportfs
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/exportfs/exportfs.ko
>
> [root at my_host ofa_kernel-1.4.1]# modinfo auth_rpcgss
> filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko
>
> Any other Idea ?

Does dmesg say anything interesting?

> Thanks.
>
> Céline.
>
>
>
>
>
> _______________________________________________
> general mailing list
> general at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>
> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general