<div dir="ltr"><div>Dear Richard,</div><div><br></div>Thanks for sharing info...<div>yes i am interested in going through your steps... to achieve my goal.</div><div><br></div><div>Thanks </div><div>Atul yadav</div></div><div class="gmail_extra">

<br><br><div class="gmail_quote">On Sun, Jul 27, 2014 at 4:01 PM, Richard Croucher <span dir="ltr"><<a href="mailto:Richard.Croucher@informatix-sol.com" target="_blank">Richard.Croucher@informatix-sol.com</a>></span> wrote:<br>

<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
  
    
  
  <div bgcolor="#FFFFFF" text="#000000">
    Atul, <br>
    <br>
    I've had similar requirements where I had one low latency app and a
    cluster file system.<br>
    <br>
    Rather than lose the resiliency that two ports provide,  I used the
    QoS capabilities to differentiate the services provided to the
    applications,  making one  higher priority than the other.  This
    way, the packets for my low latency application would never get
    queued behind any packets for the cluster file system.<br>
    <br>
    MPI has similar low latency requirements to maximize application
    throughput. <br>
    <br>
    I can provide the setup I used as an example, if you are interested.
    <br><div><div class="h5">
    <br>
    <div>On 26/07/14 10:45, Atul Yadav wrote:<br>
    </div>
    </div></div><blockquote type="cite"><div><div class="h5">
      <div dir="ltr">
        <div class="gmail_quote">
          <div dir="ltr">Dear Admin,
            <div><br>
            </div>
            <div>In our exiting setup we are having 18 server with dual
              IB cards.</div>
            <div>And 2 IB switch.</div>
            <div><br>
            </div>
            <div>We are planning to use MPI traffic on IB Port1 and
              Lustre Traffic on IB port 2.</div>
            <div><br>
            </div>
            <div>
              <table style="border-collapse:collapse;width:301pt" border="0" cellpadding="0" cellspacing="0" width="400">
                <colgroup><col style="width:58pt" span="2" width="77"> <col style="width:66pt" width="88"> <col style="width:58pt" width="77"> <col style="width:61pt" width="81"> </colgroup><tbody>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;width:58pt" height="19" width="77">IB Port 1</td>
                    <td style="width:58pt" width="77"><br>
                    </td>
                    <td style="width:66pt" width="88">Hostname</td>
                    <td style="width:58pt" width="77"><br>
                    </td>
                    <td style="width:61pt" width="81">IB Port 2</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">IB Switch  1</td>
                    <td>IP Address</td>
                    <td style="border-top-style:none">Hostname</td>
                    <td>IP Address</td>
                    <td style="border-top-style:none">IB Switch  2</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 1</td>
                    <td>192.168.2.1</td>
                    <td style="border-top-style:none">Compute-1</td>
                    <td>192.168.3.1</td>
                    <td style="border-top-style:none">Port 1</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 2</td>
                    <td>192.168.2.2</td>
                    <td style="border-top-style:none">Compute-2</td>
                    <td>192.168.3.2</td>
                    <td style="border-top-style:none">Port 2</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 3</td>
                    <td>192.168.2.3</td>
                    <td style="border-top-style:none">Compute-3</td>
                    <td>192.168.3.3</td>
                    <td style="border-top-style:none">Port 3</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 4</td>
                    <td>192.168.2.4</td>
                    <td style="border-top-style:none">Compute-4</td>
                    <td>192.168.3.4</td>
                    <td style="border-top-style:none">Port 4</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 5</td>
                    <td>192.168.2.5</td>
                    <td style="border-top-style:none">Compute-5</td>
                    <td>192.168.3.5</td>
                    <td style="border-top-style:none">Port 5</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 6</td>
                    <td>192.168.2.6</td>
                    <td style="border-top-style:none">Compute-6</td>
                    <td>192.168.3.6</td>
                    <td style="border-top-style:none">Port 6</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 7</td>
                    <td>192.168.2.7</td>
                    <td style="border-top-style:none">Compute-7</td>
                    <td>192.168.3.7</td>
                    <td style="border-top-style:none">Port 7</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 8</td>
                    <td>192.168.2.8</td>
                    <td style="border-top-style:none">Compute-8</td>
                    <td>192.168.3.8</td>
                    <td style="border-top-style:none">Port 8</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 9</td>
                    <td>192.168.2.9</td>
                    <td style="border-top-style:none">Compute-9</td>
                    <td>192.168.3.9</td>
                    <td style="border-top-style:none">Port 9</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 10</td>
                    <td>192.168.2.10</td>
                    <td style="border-top-style:none">Compute-10</td>
                    <td>192.168.3.10</td>
                    <td style="border-top-style:none">Port 10</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 11</td>
                    <td>192.168.2.11</td>
                    <td style="border-top-style:none">Compute-11</td>
                    <td>192.168.3.11</td>
                    <td style="border-top-style:none">Port 11</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 12</td>
                    <td>192.168.2.12</td>
                    <td style="border-top-style:none">Compute-12</td>
                    <td>192.168.3.12</td>
                    <td style="border-top-style:none">Port 12</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 13</td>
                    <td>192.168.2.13</td>
                    <td style="border-top-style:none">Compute-13</td>
                    <td>192.168.3.13</td>
                    <td style="border-top-style:none">Port 13</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 14</td>
                    <td>192.168.2.14</td>
                    <td style="border-top-style:none">Compute-14</td>
                    <td>192.168.3.14</td>
                    <td style="border-top-style:none">Port 14</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 15</td>
                    <td>192.168.2.15</td>
                    <td style="border-top-style:none">Compute-15</td>
                    <td>192.168.3.15</td>
                    <td style="border-top-style:none">Port 15</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 16</td>
                    <td>192.168.2.16</td>
                    <td style="border-top-style:none">Compute-16</td>
                    <td>192.168.3.16</td>
                    <td style="border-top-style:none">Port 16</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 17</td>
                    <td>192.168.2.17</td>
                    <td style="border-top-style:none">Compute-17</td>
                    <td>192.168.3.17</td>
                    <td style="border-top-style:none">Port 17</td>
                  </tr>
                  <tr style="height:14.25pt" height="19">
                    <td style="height:14.25pt;border-top-style:none" height="19">Port 18</td>
                    <td>192.168.2.18</td>
                    <td style="border-top-style:none">Compute-18</td>
                    <td>192.168.3.18</td>
                    <td style="border-top-style:none">Port 18</td>
                  </tr>
                </tbody>
              </table>
            </div>
            <div><br>
            </div>
            <div><br>
            </div>
            <div>need your help in opensm configuration and setup ....</div>
            <div><br>
            </div>
            <div>Thank You</div>
            <span><font color="#888888">
                <div>Atul Yadav</div>
              </font></span></div>
        </div>
        <br>
      </div>
      <br>
      <fieldset></fieldset>
      <br>
      </div></div><div class=""><pre>_______________________________________________
ewg mailing list
<a href="mailto:ewg@lists.openfabrics.org" target="_blank">ewg@lists.openfabrics.org</a>
<a href="http://lists.openfabrics.org/mailman/listinfo/ewg" target="_blank">http://lists.openfabrics.org/mailman/listinfo/ewg</a></pre>
    </div></blockquote>
    <br>
  </div>

</blockquote></div><br></div>