[ewg] Fwd: OpenSM for dual Rail

Richard Croucher Richard.Croucher at informatix-sol.com
Sun Jul 27 03:31:19 PDT 2014


Atul,

I've had similar requirements where I had one low latency app and a 
cluster file system.

Rather than lose the resiliency that two ports provide,  I used the QoS 
capabilities to differentiate the services provided to the 
applications,  making one  higher priority than the other.  This way, 
the packets for my low latency application would never get queued behind 
any packets for the cluster file system.

MPI has similar low latency requirements to maximize application 
throughput.

I can provide the setup I used as an example, if you are interested.

On 26/07/14 10:45, Atul Yadav wrote:
> Dear Admin,
>
> In our exiting setup we are having 18 server with dual IB cards.
> And 2 IB switch.
>
> We are planning to use MPI traffic on IB Port1 and Lustre Traffic on 
> IB port 2.
>
> IB Port 1 	
> 	Hostname 	
> 	IB Port 2
> IB Switch  1 	IP Address 	Hostname 	IP Address 	IB Switch  2
> Port 1 	192.168.2.1 	Compute-1 	192.168.3.1 	Port 1
> Port 2 	192.168.2.2 	Compute-2 	192.168.3.2 	Port 2
> Port 3 	192.168.2.3 	Compute-3 	192.168.3.3 	Port 3
> Port 4 	192.168.2.4 	Compute-4 	192.168.3.4 	Port 4
> Port 5 	192.168.2.5 	Compute-5 	192.168.3.5 	Port 5
> Port 6 	192.168.2.6 	Compute-6 	192.168.3.6 	Port 6
> Port 7 	192.168.2.7 	Compute-7 	192.168.3.7 	Port 7
> Port 8 	192.168.2.8 	Compute-8 	192.168.3.8 	Port 8
> Port 9 	192.168.2.9 	Compute-9 	192.168.3.9 	Port 9
> Port 10 	192.168.2.10 	Compute-10 	192.168.3.10 	Port 10
> Port 11 	192.168.2.11 	Compute-11 	192.168.3.11 	Port 11
> Port 12 	192.168.2.12 	Compute-12 	192.168.3.12 	Port 12
> Port 13 	192.168.2.13 	Compute-13 	192.168.3.13 	Port 13
> Port 14 	192.168.2.14 	Compute-14 	192.168.3.14 	Port 14
> Port 15 	192.168.2.15 	Compute-15 	192.168.3.15 	Port 15
> Port 16 	192.168.2.16 	Compute-16 	192.168.3.16 	Port 16
> Port 17 	192.168.2.17 	Compute-17 	192.168.3.17 	Port 17
> Port 18 	192.168.2.18 	Compute-18 	192.168.3.18 	Port 18
>
>
>
> need your help in opensm configuration and setup ....
>
> Thank You
> Atul Yadav
>
>
>
> _______________________________________________
> ewg mailing list
> ewg at lists.openfabrics.org
> http://lists.openfabrics.org/mailman/listinfo/ewg

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/ewg/attachments/20140727/1f201ba6/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 3796 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://lists.openfabrics.org/pipermail/ewg/attachments/20140727/1f201ba6/attachment.bin>


More information about the ewg mailing list