[nfs-rdma-devel] [ofa-general] Status of NFS-RDMA ?

[James Lentini]

On Fri, 1 Feb 2008, Pawel Dziekonski wrote:

> On Wed, 30 Jan 2008 at 02:04:17PM -0500, James Lentini wrote:
> 
> > > # mount.rnfs -o rdma=10.2.2.1 10.2.2.1:/scratch /mnt
> > > Doing nfs/rdma mount to 10.2.2.1, mount protocol to 10.2.2.1
> > > nfsmount: Invalid argument
> > 
> > Are you using the mount.nfs command you built from nfs-utils-1.1.1? If 
> > you installed nfs-utils, you should be doing something like this 
> > (mount will redirect to /sbin/mount.nfs if it is present):
> > 
> > /sbin/mount <IPoIB-server-name-or-address>:/<export> /mnt -i -o rdma,port=2050
> > 
> > There is more info here:
> > 
> > http://nfs-rdma.sourceforge.net/Documents/README
> 
> hi,
> 
> according to this page:
> 
> # modprobe svc_rdma
> FATAL: Module svc_rdma not found.
> 
> ???

That is a typo, it should be

# modprobe svcrdma

Tom's tree has the patch I sent here:

 http://article.gmane.org/gmane.linux.nfs/18545/match=

to simplify the NFS/RDMA build process. 

If CONFIG_SUNRPC_XPRT_RDMA is set to M (run 
"grep XPRT_RDMA /your/server/sources/.config" to check), you will need 
to load the module as shown above. If it is Y, you do not. It will be 
built in.

Thanks for drawing this to my attention. I'll update the instructions.

> # mount 10.2.2.1:/scratch /mnt -i -o rdma,port=2050 Unsupported nfs 
> mount option: rdma
> 
> looks like I definitelly need a rdma-enabled mount, which comes in 
> http://www.mellanox.com/downloads/NFSoRDMA/OFED-1.2-NFS-RDMA.gz, so:

If you are using the NFS/RDMA client in 2.6.24, you need the version 
of the mount.nfs command in nfs-utils-1.1.1 or greater.

The "Unsupported nfs mount option: rdma" error message makes me 
suspect you are not using the correct version of mount.nfs. What is 
the output of "mount.nfs -V" and "mount -V"? It may be that the 
version of mount you are using does not automatically invoke mount.nfs 
for nfs mounts. I'd suggest specifying mount.nfs in the command above:

 mount.nfs 10.2.2.1:/scratch /mnt -i -o rdma,port=2050

> # mount.rnfs  -h
> Usage: mount.rnfs [-o rdma[=host][,...] [-t nfs/nfs4]] <host:path> <mnt_point>
> 
> # mount.rnfs -o rdma 10.2.2.1:/scratch /mnt
> Doing nfs/rdma mount to 10.2.2.1, mount protocol to 10.2.2.1
> nfsmount: Invalid argument
> 
> ???
> 
> 
> 
> -- 
> Pawel Dziekonski <pawel.dziekonski at wcss.pl>
> Wroclaw Centre for Networking & Supercomputing, HPC Department
> Politechnika Wr., pl. Grunwaldzki 9, bud. D2/101, 50-377 Wroclaw, POLAND
> phone: +48 71 3202043, fax: +48 71 3225797, http://www.wcss.wroc.pl
>