[ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2-rc1

Tue Aug 5 09:56:31 PDT 2014

Although we did add backports for RHEL 7 into OFED-3.5-2-MIC, we only tested the core components, MPI, and IPoIB and not NFS/RDMA or SRP,
so there may be issues with NFS/RMDA that will have to wait till OFED-3.12-1 to get resolved.

From: ewg-bounces at lists.openfabrics.org [mailto:ewg-bounces at lists.openfabrics.org] On Behalf Of Jeff Becker
Sent: Tuesday, August 05, 2014 9:49 AM
To: Steffen Müthing; Cheng, Wendy
Cc: ewg at lists.openfabrics.org
Subject: Re: [ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2-rc1

Hello,

I do the OFED distro ports for NFSRDMA. It will be supported on CENTOS 7 in OFED 3.12.1 (coming soon). Not sure how this relates to MPSS/OFED.

-jeff

On 08/05/2014 09:07 AM, Steffen Müthing wrote:

Hi Wendy,

thanks for the response!

Am 05.08.2014 um 18:04 schrieb Cheng, Wendy <wendy.cheng at intel.com><mailto:wendy.cheng at intel.com>:

Did you mount the NFS share on MIC or on host ? Be aware that 3.3 MPSS/OFED does not support NFS/RDMA yet; that is, mounting NFS/RDMA on MIC is NOT supported at this moment.

I'm aware of that restriction. I was just mounting a host-exported share on a different host.

Steffen

-- Wendy

-----Original Message-----

From: ewg-bounces at lists.openfabrics.org<mailto:ewg-bounces at lists.openfabrics.org> [mailto:ewg-

bounces at lists.openfabrics.org<mailto:bounces at lists.openfabrics.org>] On Behalf Of Steffen Müthing

Sent: Tuesday, August 05, 2014 2:39 AM

To: ewg at lists.openfabrics.org<mailto:ewg at lists.openfabrics.org>

Subject: [ewg] Problem with NFS/RDMA on CentOS 7 with OFED-MIC-3.5-2-

rc1

Hi,

I'm trying to get the new 3.3 MPSS stack to work together with OFED-MIC-

3.5-2-rc1 on CentOS 7, but I've run into a problem with NFS/RDMA: While I

can mount file systems and traverse them, I cannot access any files larger

than about 800 bytes. Trying to cat such a file results in errors like

this:

cat: gcc.lua: Input/output error

or, when copying:

[root at node01 files]# cp test.txt /tmp

cp: error reading 'test.txt': Input/output error

cp: failed to extend '/tmp/test.txt': Input/output error

[root at node01 files]#

At the same time, trying to write a file that is larger than 800 bytes to a server

running CentOS 7 tends to freeze that server, while writing to a CentOS 6.5

server works just fine (I just can't access the data afterwards).

On the other hand, exporting an NFS share on a CentOS 7 server and

mounting it on a CentOS 6.5 client works without any problem.

We are using Mellanox ConnectX-3 VPI adapters (mlx_4 driver) and are

currently running kernel version 3.10.0-123.4.4.el7.x86_64. Does someone

have an idea of what might be going wrong here?

Thank you!

Steffen Müthing

-------------------------------------------------------------------

Steffen Müthing

Interdisciplinary Center for Scientific Computing Heidelberg University

Im Neuenheimer Feld 368

69120 Heidelberg

Germany

+49 6221 54 8888

steffen.muething at iwr.uni-heidelberg.de<mailto:steffen.muething at iwr.uni-heidelberg.de>

_______________________________________________

ewg mailing list

ewg at lists.openfabrics.org<mailto:ewg at lists.openfabrics.org>

http://lists.openfabrics.org/mailman/listinfo/ewg

_______________________________________________

ewg mailing list

ewg at lists.openfabrics.org<mailto:ewg at lists.openfabrics.org>

http://lists.openfabrics.org/mailman/listinfo/ewg

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/ewg/attachments/20140805/bfc5b641/attachment.html>