<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Atul, <br>
<br>
I've had similar requirements where I had one low latency app and a
cluster file system.<br>
<br>
Rather than lose the resiliency that two ports provide, I used the
QoS capabilities to differentiate the services provided to the
applications, making one higher priority than the other. This
way, the packets for my low latency application would never get
queued behind any packets for the cluster file system.<br>
<br>
MPI has similar low latency requirements to maximize application
throughput. <br>
<br>
I can provide the setup I used as an example, if you are interested.
<br>
<br>
<div class="moz-cite-prefix">On 26/07/14 10:45, Atul Yadav wrote:<br>
</div>
<blockquote
cite="mid:CAAfGyki9Yjz5cPOdAH95e049dPBQXjTQN+DwakC-25J2uJQ7fw@mail.gmail.com"
type="cite">
<div dir="ltr">
<div class="gmail_quote">
<div dir="ltr">Dear Admin,
<div><br>
</div>
<div>In our exiting setup we are having 18 server with dual
IB cards.</div>
<div>And 2 IB switch.</div>
<div><br>
</div>
<div>We are planning to use MPI traffic on IB Port1 and
Lustre Traffic on IB port 2.</div>
<div><br>
</div>
<div>
<table style="border-collapse:collapse;width:301pt"
border="0" cellpadding="0" cellspacing="0" width="400">
<colgroup><col style="width:58pt" span="2" width="77"> <col
style="width:66pt" width="88"> <col
style="width:58pt" width="77"> <col
style="width:61pt" width="81"> </colgroup><tbody>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;width:58pt" height="19"
width="77">IB Port 1</td>
<td style="width:58pt" width="77"><br>
</td>
<td style="width:66pt" width="88">Hostname</td>
<td style="width:58pt" width="77"><br>
</td>
<td style="width:61pt" width="81">IB Port 2</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">IB Switch 1</td>
<td>IP Address</td>
<td style="border-top-style:none">Hostname</td>
<td>IP Address</td>
<td style="border-top-style:none">IB Switch 2</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 1</td>
<td>192.168.2.1</td>
<td style="border-top-style:none">Compute-1</td>
<td>192.168.3.1</td>
<td style="border-top-style:none">Port 1</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 2</td>
<td>192.168.2.2</td>
<td style="border-top-style:none">Compute-2</td>
<td>192.168.3.2</td>
<td style="border-top-style:none">Port 2</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 3</td>
<td>192.168.2.3</td>
<td style="border-top-style:none">Compute-3</td>
<td>192.168.3.3</td>
<td style="border-top-style:none">Port 3</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 4</td>
<td>192.168.2.4</td>
<td style="border-top-style:none">Compute-4</td>
<td>192.168.3.4</td>
<td style="border-top-style:none">Port 4</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 5</td>
<td>192.168.2.5</td>
<td style="border-top-style:none">Compute-5</td>
<td>192.168.3.5</td>
<td style="border-top-style:none">Port 5</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 6</td>
<td>192.168.2.6</td>
<td style="border-top-style:none">Compute-6</td>
<td>192.168.3.6</td>
<td style="border-top-style:none">Port 6</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 7</td>
<td>192.168.2.7</td>
<td style="border-top-style:none">Compute-7</td>
<td>192.168.3.7</td>
<td style="border-top-style:none">Port 7</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 8</td>
<td>192.168.2.8</td>
<td style="border-top-style:none">Compute-8</td>
<td>192.168.3.8</td>
<td style="border-top-style:none">Port 8</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 9</td>
<td>192.168.2.9</td>
<td style="border-top-style:none">Compute-9</td>
<td>192.168.3.9</td>
<td style="border-top-style:none">Port 9</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 10</td>
<td>192.168.2.10</td>
<td style="border-top-style:none">Compute-10</td>
<td>192.168.3.10</td>
<td style="border-top-style:none">Port 10</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 11</td>
<td>192.168.2.11</td>
<td style="border-top-style:none">Compute-11</td>
<td>192.168.3.11</td>
<td style="border-top-style:none">Port 11</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 12</td>
<td>192.168.2.12</td>
<td style="border-top-style:none">Compute-12</td>
<td>192.168.3.12</td>
<td style="border-top-style:none">Port 12</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 13</td>
<td>192.168.2.13</td>
<td style="border-top-style:none">Compute-13</td>
<td>192.168.3.13</td>
<td style="border-top-style:none">Port 13</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 14</td>
<td>192.168.2.14</td>
<td style="border-top-style:none">Compute-14</td>
<td>192.168.3.14</td>
<td style="border-top-style:none">Port 14</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 15</td>
<td>192.168.2.15</td>
<td style="border-top-style:none">Compute-15</td>
<td>192.168.3.15</td>
<td style="border-top-style:none">Port 15</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 16</td>
<td>192.168.2.16</td>
<td style="border-top-style:none">Compute-16</td>
<td>192.168.3.16</td>
<td style="border-top-style:none">Port 16</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 17</td>
<td>192.168.2.17</td>
<td style="border-top-style:none">Compute-17</td>
<td>192.168.3.17</td>
<td style="border-top-style:none">Port 17</td>
</tr>
<tr style="height:14.25pt" height="19">
<td style="height:14.25pt;border-top-style:none"
height="19">Port 18</td>
<td>192.168.2.18</td>
<td style="border-top-style:none">Compute-18</td>
<td>192.168.3.18</td>
<td style="border-top-style:none">Port 18</td>
</tr>
</tbody>
</table>
</div>
<div><br>
</div>
<div><br>
</div>
<div>need your help in opensm configuration and setup ....</div>
<div><br>
</div>
<div>Thank You</div>
<span class="HOEnZb"><font color="#888888">
<div>Atul Yadav</div>
</font></span></div>
</div>
<br>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
ewg mailing list
<a class="moz-txt-link-abbreviated" href="mailto:ewg@lists.openfabrics.org">ewg@lists.openfabrics.org</a>
<a class="moz-txt-link-freetext" href="http://lists.openfabrics.org/mailman/listinfo/ewg">http://lists.openfabrics.org/mailman/listinfo/ewg</a></pre>
</blockquote>
<br>
</body>
</html>