[ofa-general] [NFS/RDMA] Can't mount NFS/RDMA partition]
Jeff Becker
Jeffrey.C.Becker at nasa.gov
Wed Apr 22 10:22:50 PDT 2009
Jeff Becker wrote:
> Hi Celine
>
> Jeff Becker wrote:
>
>> Jon Mason wrote:
>>
>>
>>> On Wed, Apr 22, 2009 at 04:41:37PM +0200, Celine Bourde wrote:
>>>
>>>
>>>
>>>>> On the server did you remember to:
>>>>> echo rdma 2050 > /proc/fs/nfsd/portlist
>>>>>
>>>>>
>>>>>
>>>> Yes.
>>>>
>>>> My nfs utils version :
>>>>
>>>> [root at my_host]#/sbin/mount.nfs -V
>>>> mount.nfs (linux nfs-utils 1.1.4)
>>>>
>>>> If I try mount.nfs command :
>>>>
>>>> [root at my_host ~]# strace mount.nfs 192.168.0.215:/vol0 /mnt/ -o rdma,port=2050
>>>>
>>>>
>>>>
>>> Does it work without rdma?
>>>
>>>
>>>
>> Since I have 2.6.27.3 installed on my test machines, I'll reboot and
>> check it out.
>>
>>
>
> Is your system SLES11 or kernel.org 2.6.27? I just encountered a build
> problem on my kernel.org
> system. The install.pl script thinks that it's supposed to use the
> SLES11 backport which is wrong, and the
> build fails. I'll see if I can patch the install.pl script.
>
> -jeff
>
>> -jeff
>>
Sorry - my bad. Since my test machines are a SLES base (with alternate
kernels), install.pl
correctly detects this, and causes it to think SLES11. I'll build and
install directly from the
OFED source.
-jeff
>>
>>
>>>
>>>
>>>
>>>> [..]
>>>> socket(PF_INET, SOCK_DGRAM, IPPROTO_UDP) = 3
>>>> bind(3, {sa_family=AF_INET, sin_port=htons(0), sin_addr=inet_addr("0.0.0.0")}, 16) = 0
>>>> fcntl(3, F_GETFL) = 0x2 (flags O_RDWR)
>>>> fcntl(3, F_SETFL, O_RDWR|O_NONBLOCK) = 0
>>>> connect(3, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, 16) = 0
>>>> fcntl(3, F_SETFL, O_RDWR) = 0
>>>> connect(3, {sa_family=AF_UNSPEC, sa_data="\0o\177\0\0\1\0\0\0\0\0\0\0\0"}, 16) = 0
>>>> sendto(3, "uw\211\257\0\0\0\0\0\0\0\2\0\1\206\270\0\0\0\1\0\0\0\0\0\0\0\0\0\0\0\0"..., 40, 0, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, 16) = 40
>>>> poll([{fd=3, events=POLLIN}], 1, 3000) = 1 ([{fd=3, revents=POLLIN}])
>>>> recvfrom(3, "uw\211\257\0\0\0\1\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 400, MSG_DONTWAIT, {sa_family=AF_INET, sin_port=htons(997), sin_addr=inet_addr("127.0.0.1")}, [16]) = 24
>>>> close(3) = 0
>>>> mount("192.168.0.215:/vol0", "/mnt", "nfs", 0, "rdma,port=2050,addr=192.168.0.21"
>>>>
>>>> and it blocks again.
>>>>
>>>>
>>>>
>>>>
>>>>>> ? Also, make sure that none of the stock 2.6.27 NFS modules are loaded -
>>>>>> they should all
>>>>>> be from OFED 1.4.1
>>>>>>
>>>>>>
>>>>>>
>>>> All nfs modules (OFED 1.4.1) are loaded (and dependencies).
>>>> Modules are listed bellow -> updates directory means it
>>>> comes from OFED version and no kernel version)
>>>>
>>>> [root at my_host ~]# modinfo ib_ipoib
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko
>>>>
>>>> [root at my_host ~]# modinfo ib_sa
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_sa.ko
>>>>
>>>> [root at my_host ~]# modinfo iw_cm
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/iw_cm.ko
>>>>
>>>> [root at my_host ~]# modinfo ib_addr
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_addr.ko
>>>>
>>>> [root at my_host ~]# modinfo mlx4_core
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/net/mlx4/mlx4_core.ko
>>>>
>>>> [root at my_host ~]# modinfo ib_core
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_core.ko
>>>>
>>>> [root at my_host ~]# modinfo ib_cm
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/ib_cm.ko
>>>>
>>>> [root at my_host ~]# modinfo rdma_cm
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/drivers/infiniband/core/rdma_cm.ko
>>>>
>>>> [root at my_host ~]# modinfo xprtrdma
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/xprtrdma/xprtrdma.ko
>>>>
>>>> [root at my_host ~]# modinfo svcrdma
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/xprtrdma/svcrdma.ko
>>>>
>>>> [root at my_host ofa_kernel-1.4.1]# modinfo nfsd
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/nfsd/nfsd.ko
>>>>
>>>> [root at my_host ofa_kernel-1.4.1]# modinfo lockd
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/lockd/lockd.ko
>>>>
>>>> [root at my_host ofa_kernel-1.4.1]# modinfo nfs_acl
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/nfs_common/nfs_acl.ko
>>>>
>>>> [root at my_host ofa_kernel-1.4.1]# modinfo sunrpc
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/sunrpc.ko
>>>>
>>>> root at my_host ofa_kernel-1.4.1]# modinfo exportfs
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/fs/exportfs/exportfs.ko
>>>>
>>>> [root at my_host ofa_kernel-1.4.1]# modinfo auth_rpcgss
>>>> filename: /lib/modules/2.6.27_ofa_compil/updates/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko
>>>>
>>>> Any other Idea ?
>>>>
>>>>
>>>>
>>> Does dmesg say anything interesting?
>>>
>>>
>>>
>>>
>>>> Thanks.
>>>>
>>>> Céline.
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> general mailing list
>>>> general at lists.openfabrics.org
>>>> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>>>>
>>>> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>>>>
>>>>
>>>>
>> _______________________________________________
>> general mailing list
>> general at lists.openfabrics.org
>> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>>
>> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>>
>>
>
> _______________________________________________
> general mailing list
> general at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>
> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>
More information about the general
mailing list