[libfabric-users] FI_EP_MSG on cray

Biddiscombe, John A. biddisco at cscs.ch
Tue Feb 14 23:14:08 PST 2017


Criterion, I checked out the repo and got the default branch called “bleeding”
-----
commit 33b56d5657b5fe2babbc75158abb2743ffb8a4e9
Author: Franklin "Snaipe" Mathieu <snaipe at diacritic.io>
Date:   Tue Feb 7 23:44:32 2017 +0000

    readme: switched AUR install method from yaourt to pacaur
-----

system info is as follows

cat /etc/opt/cray/release/cle-release
RELEASE=6.0.UP02
BUILD=6.0.2042
DATE=201610120100
ARCH=x86_64
NETWORK=ari

Thanks again. If you need anything else ….

JB


From: Howard Pritchard <hppritcha at gmail.com>
Date: Wednesday, 15 February 2017 at 00:11
To: John Biddiscombe <biddisco at cscs.ch>
Cc: "libfabric-users at lists.openfabrics.org" <libfabric-users at lists.openfabrics.org>
Subject: Re: [libfabric-users] FI_EP_MSG on cray

HI John,

This helps.  Which CLE version and update is the system running?
Also, could you check what version of criterion you are using?

I'd like to try and reproduce the failure you are seeing.

Thanks,

Howard


2017-02-14 16:05 GMT-07:00 Biddiscombe, John A. <biddisco at cscs.ch<mailto:biddisco at cscs.ch>>:

Here it is



daint101:~$ srun -n 1 cat  /sys/class/gni/kgni0/resources



--- PTag: 1 PKey: 0x0 JobId: 0x0 RefCount: 1 Suspend: Idle ---

Name       Used            Limit           HWM

MDD        6               -1              230

CQ         5               -1

FMA        1               -1

SFMA       0               -1

RDMA       0               -1

DIRECT     0               -1

IOMMU      2097152         1073741824

PCI-IOMMU  0               -1

CE         0               -1

DLA        0               -1

non-VMDH   0               -1

SMDD Hold  0               -1

--- PTag: 142 PKey: 0x2c24 JobId: 0x17b RefCount: 1 Suspend: Idle ---

Name       Used            Limit           HWM

MDD        0               3464            0

CQ         0               509

FMA        0               123

SFMA       0               123

RDMA       0               -1

DIRECT     0               -1

IOMMU      0               134217728

PCI-IOMMU  0               -1

CE         0               1

DLA        0               15360

non-VMDH   0               -1

SMDD Hold  0               -1

--- PTag: 143 PKey: 0x2c25 JobId: 0x17b RefCount: 1 Suspend: Idle ---

Name       Used            Limit           HWM

MDD        0               3464            0

CQ         0               509

FMA        0               123

SFMA       0               123

RDMA       0               -1

DIRECT     0               -1

IOMMU      0               134217728

PCI-IOMMU  0               -1

CE         0               1

DLA        0               15360

non-VMDH   0               -1

SMDD Hold  0               -1



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/libfabric-users/attachments/20170215/9eed7180/attachment.html>


More information about the Libfabric-users mailing list