[nfs-rdma-devel] [ofa-general] Status of NFS-RDMA ?

[James Lentini]

On Wed, 30 Jan 2008, Pawel Dziekonski wrote:

> On Tue, 29 Jan 2008 at 09:53:46AM -0500, James Lentini wrote:
> > 
> > Is your goal to build a kernel with an NFS/RDMA server? If so, the 
> > kernel sources from Tom Tucker's git tree are the ones you want, not 
> > the old OFED 1.2-based packages which are out of date.
> > 
> > Did you try setting up the NFS/RDMA server on the kernel used for your 
> > MPI tests above?
> 
> my goal is to have everything running on my fabric- NFS/RDMA, MPI,
> IPoverIB, SDP.
>
> my current status is:
> 
> - Tom Tucker's git tree compiled and running
> - compiled OFED from
>   http://www.mellanox.com/downloads/NFSoRDMA/OFED-1.2-NFS-RDMA.gz
>   (whatever it is - who knows?) - MPI is working, SDP not.
> 
> - nfs-utils 1.1.1 compiled and:
> 
> nfs server start:
> #!/bin/sh
> /etc/rc.d/init.d/portmap restart
> modprobe nfs
> umount /proc/fs/nfsd
> mount -t nfsd /proc/fs/nfsd
> exportfs -av
> rpc.mountd
> rpc.statd --no-notify
> rpc.nfsd
> sm-notify
> 
> # cat /etc/exports
> /scratch 10.2.2.2(no_subtree_check,insecure,rw,async,no_root_squash)
> 
> nfs client start:
> #!/bin/sh
> /etc/rc.d/init.d/portmap restart
> modprobe nfs
> sm-notify
> 
> # mount.rnfs -o rdma=10.2.2.1 10.2.2.1:/scratch /mnt
> Doing nfs/rdma mount to 10.2.2.1, mount protocol to 10.2.2.1
> nfsmount: Invalid argument

Are you using the mount.nfs command you built from nfs-utils-1.1.1? If 
you installed nfs-utils, you should be doing something like this 
(mount will redirect to /sbin/mount.nfs if it is present):

/sbin/mount <IPoIB-server-name-or-address>:/<export> /mnt -i -o rdma,port=2050

There is more info here:

http://nfs-rdma.sourceforge.net/Documents/README

> :(
> 
> -- 
> Pawel Dziekonski <pawel.dziekonski at wcss.pl>
> Wroclaw Centre for Networking & Supercomputing, HPC Department
> Politechnika Wr., pl. Grunwaldzki 9, bud. D2/101, 50-377 Wroclaw, POLAND
> phone: +48 71 3202043, fax: +48 71 3225797, http://www.wcss.wroc.pl
>