[ewg] NFSoRDMA: Can't restart NFS server

[Jon Mason]

On Wed, Dec 02, 2009 at 06:00:03PM +0800, PN wrote:
> Hi,
> 
> I'm using CentOS 5.4 with OFED-1.5-rc3 and Mellanox ConnectX cards.
> I follow the steps of nfs-rdma.release-notes.txt and can use NFS over RDMA
> successfully in the first time.
> However, after umount the file system and restart the NFS server, it shows
> the following error:
> 
> # /etc/init.d/nfs stop
> Shutting down NFS mountd:                                  [  OK  ]
> Shutting down NFS daemon:                                  [  OK  ]
> Shutting down NFS quotas:                                  [  OK  ]
> Shutting down NFS services:
> 
> # cat /proc/fs/nfsd/portlist
> rdma 20049
> tcp 2049
> udp 2049
> 
> # lsmod |grep rdma
> svcrdma                69184  1
> sunrpc                245544  14 svcrdma,nfsd,nfs,nfs_acl,auth_rpcgss,lockd
> rdma_ucm               47872  0
> rdma_cm                69140  3 svcrdma,rdma_ucm,ib_sdp
> iw_cm                  43656  1 rdma_cm
> ib_addr                43016  1 rdma_cm
> ib_cm                  73000  2 rdma_cm,ib_ipoib
> ib_sa                  75144  3 rdma_cm,ib_ipoib,ib_cm
> ib_uverbs              75696  1 rdma_ucm
> ib_core               109312  15
> svcrdma,rdma_ucm,ib_sdp,rdma_cm,iw_cm,ib_ipoib,ib_cm,ib_sa,ib_uverbs,ib_umad,iw_nes,iw_cxgb3,mlx4_ib,ib_mthca,ib_mad
> 
> # /etc/init.d/nfs start
> Starting NFS services:                                     [  OK  ]
> Starting NFS quotas:                                       [  OK  ]
> Starting NFS daemon:                                       [FAILED]

You want to run the following to restart:
# /etc/init.d/nfs restart

> In /var/log/messages, it shows:
> Dec  2 17:34:30 mgmt nfsd[5106]: nfssvc: Setting version failed: errno 16
> (Device or resource busy)
> Dec  2 17:34:30 mgmt nfsd[5106]: nfssvc: unable to bind UPD socket: errno 98
> (Address already in use)
> 
> And in the client side, I can no longer mount the server again.

This could be a bug, I'll look into it.

> Is there a correct ways to restart the NFS server after configuring
> NFSoRDMA?
> 
> Thanks in advance.
> 
> PN

> _______________________________________________
> ewg mailing list
> ewg at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg