[ewg] [ANNOUNCE] dapl-2.1.0-1 release - MIC support

Davis, Arlin R arlin.r.davis at intel.com
Fri Jul 25 10:56:39 PDT 2014


New release for uDAPL v2 (2.1.0) is available at  http://www.openfabrics.org/downloads/dapl

MIC support has been added in this release and is provided with the new MCM provider and MPXYD service. MCM requires the Intel(R) MPSS 3.x (YOCTO) release for Linux to be installed on your system. MPSS 3.x for Linux can be downloaded from:  http://software.intel.com/mic-developer

Vlad, please pull into OFED 3.12-1  

md5sum: 43bd0f2a7e72ef283d27f99f935e615a dapl-2.1.0.tar.gz

For v2.1 package install RPM packages as follow:
 dapl-2.1.0-1
 dapl-utils-2.1.0-1
 dapl-devel-2.1.0-1
 dapl-debuginfo-2.1.0-1

Summary of v2.1 changes:

 Release 2.1.0 (OFED 3.12-1)

 build: add missing NEWS file
 update autogen.sh
 add MCM provider and MPXYD service to build
 mpxyd: service startup script and configuration file
 add readme for MCM provider and MPXYD service
 update Copyright dates
 add new MIC RDMA proxy service daemon (MPXYD)
 add new dapl MIC provider (MCM) to support MIC RDMA proxy services
 MCM: new MIC provider and proxy service definitions
 cleanup build warnings
 common: add CQ,QP,MR abstractions for new MIC provider and data proxy service
 openib: cleanup, use inet_ntop for GIDs, remove some logs, destroy pipes on release
 common: new dapls_evd_cqe_to_event call, cqe to event
 common: init ring_buffer, assign hd/tl pos in range
 allow log level changes during device open
 ucm: fix cm rbuf setup, include grh pad on initialization
 ucm: remove duplicate async_event code, use common async event call
 new lightweight open_query/close_query IB extension for fast attribute query
 dtestcm: add more detailed debug during disconnect phase
 cma: long delays when opening cma provider with no IPoIB configured
 common: new debug levels for low system memory, IA stats, and package info
 build: remove library check for mverbs with --enable-fca
 IB extension: segfault in create collective group with non-vector type IA handle"
 build: change configure help to correctly state collective default=none

MIC support overview:

The new MIC service is designed to provide MIC based DAPL Provider clients with higher bandwidth access to IB fabrics when direct IB fabric access is unavailable or constrained.  It includes a DAPL provider (MCM) and a host based proxy data service (MPXYD) for SND/RCV and RDMA write operations. RDMA write with immediate data is the only IB extension supported. RDMA reads and atomics are not supported. The MCM provider maintains the DAT level API semantics, including ordering requirements of data flow. This new service communicates within a server platform over PCI-E bus using Symmetric Communications Interface (SCI) and a MCM specific MIX (MIC exchange) messaging protocol. On the wire, the MCM provider uses a new CM and WR/WC proxy protocol that can run from either a MIC or HOST. With this new protocol the MCM endpoint send and receive channels are managed separately for optimal data services based on physical locality of each endpoint (see below).  Refer to mpxyd.conf for tunable proxy service attributes. See /etc/dat.conf for MCM provider device definitions. 
    
The following shows connectivity modes and data paths supported:
    
    HST -> HST to HCA
    MSS -> MIC to HCA same socket
    MXS -> MIC to HCA cross socket
    
    1.   HST->HST:    Host->HCA->fabric->HCA->Host              (direct->direct)
           HST<-HST:    Host <-HCA<-fabric<-HCA<-Host             (direct<-direct)
    
    2.  MSS->MSS:    KNC-> Host ->HCA->fabric->HCA->KNC  (proxy->direct)
          MSS<-MSS:    KNC<-HCA<-fabric<-HCA<- Host <-KNC  (direct<-proxy)
    
    3.  MSX->MSX:    KNC-> Host ->HCA->fabric->HCA-> Host ->KNC  (proxy->proxy)
          MSX<-MSX:    KNC<- Host <-HCA<-fabric<-HCA<- Host <-KNC  (proxy<-proxy)
    
    4.  MSS->MSX:    KNC-> Host ->HCA->fabric->HCA-> Host ->KNC  (proxy->proxy)
          MSS<-MXS:    KNC<-HCA<-fabric<-HCA<- Host <-KNC                  (direct<-proxy)
    
    5.  MSS->HST:    KNC-> Host ->HCA->fabric->HCA-> Host (proxy->direct)
          MSS<-HST:    KNC<-HCA<-fabric<-HCA<- Host                  (direct<-direct)
    
    6.  MSX->HST:    KNC-> Host ->HCA->fabric->HCA-> Host (proxy->direct)
         MSX<-HST:    KNC<- Host <-HCA<-fabric<-HCA<- Host (proxy<-direct)


Regards,

Arlin




More information about the ewg mailing list