[ofa-general] [NFS/RDMA] Can't mount NFS/RDMA partition]

[Celine Bourde]

> On the server did you remember to:
> echo rdma 2050 > /proc/fs/nfsd/portlist

Yes.

My nfs utils version :

[root at my_host]#/sbin/mount.nfs -V
mount.nfs (linux nfs-utils 1.1.4)

If I try mount.nfs command :

[root at my_host ~]# strace  mount.nfs 192.168.0.215:/vol0 /mnt/ -o rdma,port=2050
[..]
socket(PF_INET, SOCK_DGRAM, IPPROTO_UDP) = 3
bind(3, {sa_family=AF_INET, sin_port=htons(0), sin_addr=inet_addr("0.0.0.0")}, 16) = 0
fcntl(3, F_GETFL)                       = 0x2 (flags O_RDWR)
fcntl(3, F_SETFL, O_RDWR|O_NONBLOCK)    = 0
connect(3, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, 16) = 0
fcntl(3, F_SETFL, O_RDWR)               = 0
connect(3, {sa_family=AF_UNSPEC, sa_data="\0o\177\0\0\1\0\0\0\0\0\0\0\0"}, 16) = 0
sendto(3, "uw\211\257\0\0\0\0\0\0\0\2\0\1\206\270\0\0\0\1\0\0\0\0\0\0\0\0\0\0\0\0"..., 40, 0, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, 16) = 40
poll([{fd=3, events=POLLIN}], 1, 3000)  = 1 ([{fd=3, revents=POLLIN}])
recvfrom(3, "uw\211\257\0\0\0\1\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 400, MSG_DONTWAIT, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, [16]) = 24
close(3)                                = 0
mount("192.168.0.215:/vol0", "/mnt", "nfs", 0, "rdma,port=2050,addr=192.168.0.21"

and it blocks again.

>> ? Also, make sure that none of the stock 2.6.27 NFS modules are loaded -
>> they should all
>> be from OFED 1.4.1
>

All nfs modules (OFED 1.4.1) are loaded (and dependencies).
Modules are listed bellow -> updates directory means it
comes from OFED version and no kernel version)

[root at my_host ~]# modinfo ib_ipoib
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko

[root at my_host ~]# modinfo ib_sa
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_sa.ko

[root at my_host ~]# modinfo iw_cm
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/iw_cm.ko

[root at my_host ~]# modinfo ib_addr
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_addr.ko

[root at my_host ~]# modinfo mlx4_core
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/net/mlx4/mlx4_core.ko

[root at my_host ~]# modinfo ib_core
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_core.ko

[root at my_host ~]# modinfo ib_cm
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_cm.ko

[root at my_host ~]# modinfo rdma_cm
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/rdma_cm.ko

[root at my_host ~]# modinfo xprtrdma
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/xprtrdma/xprtrdma.ko

[root at my_host ~]# modinfo svcrdma
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/xprtrdma/svcrdma.ko

[root at my_host ofa_kernel-1.4.1]# modinfo nfsd
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/nfsd/nfsd.ko

[root at my_host ofa_kernel-1.4.1]# modinfo lockd
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/lockd/lockd.ko

[root at my_host ofa_kernel-1.4.1]# modinfo nfs_acl
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/nfs_common/nfs_acl.ko

[root at my_host ofa_kernel-1.4.1]# modinfo sunrpc
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/sunrpc.ko

root at my_host ofa_kernel-1.4.1]# modinfo exportfs
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/exportfs/exportfs.ko

[root at my_host ofa_kernel-1.4.1]# modinfo auth_rpcgss
filename:       /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko

Any other Idea ?
Thanks.

Céline.