[libfabric-users] FI_EP_MSG on cray

Howard Pritchard hppritcha at gmail.com
Tue Feb 14 15:11:19 PST 2017


HI John,

This helps.  Which CLE version and update is the system running?
Also, could you check what version of criterion you are using?

I'd like to try and reproduce the failure you are seeing.

Thanks,

Howard


2017-02-14 16:05 GMT-07:00 Biddiscombe, John A. <biddisco at cscs.ch>:

> Here it is
>
>
>
> daint101:~$ srun -n 1 cat  /sys/class/gni/kgni0/resources
>
>
>
> --- PTag: 1 PKey: 0x0 JobId: 0x0 RefCount: 1 Suspend: Idle ---
>
> Name       Used            Limit           HWM
>
> MDD        6               -1              230
>
> CQ         5               -1
>
> FMA        1               -1
>
> SFMA       0               -1
>
> RDMA       0               -1
>
> DIRECT     0               -1
>
> IOMMU      2097152         1073741824
>
> PCI-IOMMU  0               -1
>
> CE         0               -1
>
> DLA        0               -1
>
> non-VMDH   0               -1
>
> SMDD Hold  0               -1
>
> --- PTag: 142 PKey: 0x2c24 JobId: 0x17b RefCount: 1 Suspend: Idle ---
>
> Name       Used            Limit           HWM
>
> MDD        0               3464            0
>
> CQ         0               509
>
> FMA        0               123
>
> SFMA       0               123
>
> RDMA       0               -1
>
> DIRECT     0               -1
>
> IOMMU      0               134217728
>
> PCI-IOMMU  0               -1
>
> CE         0               1
>
> DLA        0               15360
>
> non-VMDH   0               -1
>
> SMDD Hold  0               -1
>
> --- PTag: 143 PKey: 0x2c25 JobId: 0x17b RefCount: 1 Suspend: Idle ---
>
> Name       Used            Limit           HWM
>
> MDD        0               3464            0
>
> CQ         0               509
>
> FMA        0               123
>
> SFMA       0               123
>
> RDMA       0               -1
>
> DIRECT     0               -1
>
> IOMMU      0               134217728
>
> PCI-IOMMU  0               -1
>
> CE         0               1
>
> DLA        0               15360
>
> non-VMDH   0               -1
>
> SMDD Hold  0               -1
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/libfabric-users/attachments/20170214/587b79aa/attachment.html>


More information about the Libfabric-users mailing list