[ofa-general] RE: minimum sw components requirement for driver/opensm in a single unmanaged switch network

Yicheng Jia YJia at tmriusa.com
Thu Jul 10 15:53:40 PDT 2008


> The opensm node requires ib_core, ib_mad, ib_umad, and ib_mthca.

> The other nodes require ib_core, ib_mad, ib_mthca, plus others,
> depending on you application.  If it is a userspace application, then
> you need ib_uverbs as well.

Can the opensm resides in the end node which does the RDMA operation as 
well?

The ib_core includes ib_sa and ib_cm modules, I use ib_core without these 
two modules, plus ib_mad and ib_mthca, in a single managed switch network, 
they work fine. Now I'm using a unmanaged switch with opensm, can I still 
use the previous driver modules (without ib_sa and ib_cm)? Of cause opensm 
need to be customized as well (no SA and CM?).

The reason I'm doing this is I need to port opensm to QNX, I have to use 
as little modules as possible.

Best,
Yicheng




"Sean Hefty" <sean.hefty at intel.com> 
07/10/2008 03:25 PM

To
"'Yicheng Jia'" <YJia at tmriusa.com>, <general at lists.openfabrics.org>
cc
<halr at voltaire.com>
Subject
RE: minimum sw components requirement for driver/opensm in a single 
unmanaged switch network






> I have a IB network which consists of only a single unmanaged switch,
> all end nodes connecting with the switch only need to do RDMA
> read/write operation with each other. My question is, what are the
> indispensable modules in driver's core and opensm that make the 
> network up and run? 

The opensm node requires ib_core, ib_mad, ib_umad, and ib_mthca.

The other nodes require ib_core, ib_mad, ib_mthca, plus others,
depending on you application.  If it is a userspace application, then
you need ib_uverbs as well.

> I've been using only ib_mad module in driver's core with a managed
> switch before, and the network works fine. So I assume that only the
> ib_mad module in driver's core and SM in opensm are mandatory in my
> network. The LIDs are assigned by them. The SA and CM modules are not
> useful in my case. Am I right? 

You need to establish connections between the nodes, and configure the
QPs.  The QP number and LID information must be exchanged between the
various nodes somehow (over a socket connection, manually entered into
each application, user-defined MADs, whatever).  If the machines also
connect into an Ethernet network, you could exchange the data over
sockets.

- Sean


_____________________________________________________________________________
Scanned by IBM Email Security Management Services powered by MessageLabs. 
For more information please visit http://www.ers.ibm.com
_____________________________________________________________________________



_____________________________________________________________________________
Scanned by IBM Email Security Management Services powered by MessageLabs. For more information please visit http://www.ers.ibm.com
_____________________________________________________________________________
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20080710/4e140018/attachment.html>


More information about the general mailing list