[ewg] Fwd: OpenSM for dual Rail

Atul Yadav atulyadavtech at gmail.com
Sat Jul 26 06:15:27 PDT 2014


Yes my plan is to run opensm on  different machine.(Or Different Smart
Switch .....)




On Sat, Jul 26, 2014 at 5:27 PM, Hal Rosenstock <hal at dev.mellanox.co.il>
wrote:

> Hi Atul,
>
> On 7/26/2014 5:45 AM, Atul Yadav wrote:
> > Dear Admin,
> >
> > In our exiting setup we are having 18 server with dual IB cards.
> > And 2 IB switch.
> >
> > We are planning to use MPI traffic on IB Port1 and Lustre Traffic on IB
> > port 2.
> >
> > IB Port 1             Hostname                IB Port 2
> > IB Switch  1  IP Address      Hostname        IP Address      IB Switch
>  2
> > Port 1        192.168.2.1     Compute-1       192.168.3.1     Port 1
> > Port 2        192.168.2.2     Compute-2       192.168.3.2     Port 2
> > Port 3        192.168.2.3     Compute-3       192.168.3.3     Port 3
> > Port 4        192.168.2.4     Compute-4       192.168.3.4     Port 4
> > Port 5        192.168.2.5     Compute-5       192.168.3.5     Port 5
> > Port 6        192.168.2.6     Compute-6       192.168.3.6     Port 6
> > Port 7        192.168.2.7     Compute-7       192.168.3.7     Port 7
> > Port 8        192.168.2.8     Compute-8       192.168.3.8     Port 8
> > Port 9        192.168.2.9     Compute-9       192.168.3.9     Port 9
> > Port 10       192.168.2.10    Compute-10      192.168.3.10    Port 10
> > Port 11       192.168.2.11    Compute-11      192.168.3.11    Port 11
> > Port 12       192.168.2.12    Compute-12      192.168.3.12    Port 12
> > Port 13       192.168.2.13    Compute-13      192.168.3.13    Port 13
> > Port 14       192.168.2.14    Compute-14      192.168.3.14    Port 14
> > Port 15       192.168.2.15    Compute-15      192.168.3.15    Port 15
> > Port 16       192.168.2.16    Compute-16      192.168.3.16    Port 16
> > Port 17       192.168.2.17    Compute-17      192.168.3.17    Port 17
> > Port 18       192.168.2.18    Compute-18      192.168.3.18    Port 18
> >
> >
> >
> > need your help in opensm configuration and setup ....
>
> You need an SM per subnet. They should be setup to have different subnet
> prefixes.
>
> Do you plan on running OpenSM for each subnet on the same or different
> machines ?
>
> It's a little simpler if it's different machines.
>
> If it's on same machine, basically you need 2 options files (one for
> each subnet/OpenSM) and make the output (/var/log and /var/cache/opensm
> folders) go to separate files/directories. You can do that with the
> various config options.
>
> Also, see:
> https://www.mail-archive.com/linux-rdma@vger.kernel.org/msg03559.html
>
> I don't see OSM_LOG_DIR in recent OpenSMs but there is log_prefix option.
>
> -- Hal
>
> > Thank You
> > Atul Yadav
> >
> >
> >
> > _______________________________________________
> > ewg mailing list
> > ewg at lists.openfabrics.org
> > http://lists.openfabrics.org/mailman/listinfo/ewg
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/ewg/attachments/20140726/cf0d3fee/attachment.html>


More information about the ewg mailing list