<div dir="ltr"><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)">Ok so I get to the point where I can see from the IB network the HP BLc 4X QDR switch, but.. the 'internal' switch can't see any of the blades HCA, also the ports on the blades still report a Down State and a Physical Polling state.<br><br># ibstat<br>CA 'qib0'<br> CA type: InfiniPath_QMH7342<br> Number of ports: 2<br> Firmware version: <br> Hardware version: 2<br> Node GUID: 0x0011750000791fec<br> System image GUID: 0x0011750000791fec<br> Port 1:<br> State: Down<br> Physical state: Polling<br> Rate: 40<br> Base lid: 65535<br> LMC: 0<br> SM lid: 65535<br> Capability mask: 0x0761086a<br> Port GUID: 0x0011750000791fec<br> Link layer: InfiniBand<br> Port 2:<br> State: Down<br> Physical state: Polling<br> Rate: 40<br> Base lid: 65535<br> LMC: 0<br> SM lid: 65535<br> Capability mask: 0x0761086a<br> Port GUID: 0x0011750000791fed<br> Link layer: InfiniBand<br><br><br></div><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)">GWIB01: <b>(LID 24) </b>-> SX6036G<b><br></b></div><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)">Infiniscale-IV<b> M</b>ellanox Technologies: <b>(LID 29)</b> -> <span style="color:rgb(255,0,0)">QLogic HP BLc 4X QDR Switch</span><br></div><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)">GWIB02: <b>(LID 23)</b> -> SX6036G<br></div><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)">SWIB01 <b>(LID 2) </b>-> SX6018F<br></div><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)">SWIB02: <b>(LID 1)</b> -> SX6018F<br><br></div><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)">SM running:<br><br></div><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)">SWIB01: with priority 8<br></div><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)">SWIB02: with priority 7<br><br></div><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)">find attach a pdf with the diagram (any other 'best' way to cable them?) advises?<br></div><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)"><br># iblinkinfo<br>CA: MF0;GWIB01:SX60XX/GW:<br> 0xe41d2d030031e9c2 25 1[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 24 37[ ] "MF0;GWIB01:SX6036G/U1" ( )<br><b>Switch: 0x0002c902004b0918 Infiniscale-IV Mellanox Technologies:</b><br> 29 1[ ] ==( 4X 10.0 Gbps Active/ LinkUp)==> 24 9[ ] "MF0;GWIB01:SX6036G/U1" ( )<br> 29 2[ ] ==( 4X 10.0 Gbps Active/ LinkUp)==> 23 9[ ] "MF0;GWIB02:SX6036G/U1" ( )<br> 29 3[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 4[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 5[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 6[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 7[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 8[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 9[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 10[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 11[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 12[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 13[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 14[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 15[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 16[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 17[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 18[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 19[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 20[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 21[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 22[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 23[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 24[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 25[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 26[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 27[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 28[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 29[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 30[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 31[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 29 32[ ] ==( Down/ Polling)==> [ ] "" ( )<br>CA: MF0;GWIB02:SX60XX/GW:<br> 0xe41d2d030031eb42 28 1[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 23 37[ ] "MF0;GWIB02:SX6036G/U1" ( )<br><b>Switch: 0xe41d2d030031e9c1 MF0;GWIB01:SX6036G/U1:</b><br> 24 1[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 2[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 3[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 4[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 5[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 6[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 7[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 8[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 9[ ] ==( 4X 10.0 Gbps Active/ LinkUp)==> 29 1[ ] "Infiniscale-IV Mellanox Technologies" ( )<br> 24 10[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 11[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 12[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 13[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 14[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 15[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 16[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 17[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 18[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 19[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 20[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 21[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 22[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 23[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 24[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 25[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 26[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 27[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 28[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 29[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 30[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 31[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 32[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 24 33[ ] ==( 4X 10.0 Gbps (FDR10) Active/ LinkUp)==> 23 33[ ] "MF0;GWIB02:SX6036G/U1" ( Could be 14.0625 Gbps)<br> 24 34[ ] ==( 4X 10.0 Gbps (FDR10) Active/ LinkUp)==> 1 16[ ] "MF0;SWIB02:SX6018/U1" ( Could be 14.0625 Gbps)<br> 24 35[ ] ==( 4X 10.0 Gbps (FDR10) Active/ LinkUp)==> 23 35[ ] "MF0;GWIB02:SX6036G/U1" ( Could be 14.0625 Gbps)<br> 24 36[ ] ==( 4X 10.0 Gbps (FDR10) Active/ LinkUp)==> 2 18[ ] "MF0;SWIB01:SX6018/U1" ( )<br> 24 37[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 25 1[ ] "MF0;GWIB01:SX60XX/GW" ( )<br><b>Switch: 0xf45214030073f500 MF0;SWIB02:SX6018/U1:</b><br> 1 1[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 13 2[ ] "cibmon01 HCA-1" ( )<br> 1 2[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 14 2[ ] "cibmon02 HCA-1" ( )<br> 1 3[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 12 2[ ] "cibmon03 HCA-1" ( )<br> 1 4[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 20 2[ ] "cibosd01 HCA-1" ( )<br> 1 5[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 17 2[ ] "cibosd02 HCA-1" ( )<br> 1 6[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 22 2[ ] "cibosd03 HCA-1" ( )<br> 1 7[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 18 2[ ] "cibosd04 HCA-1" ( )<br> 1 8[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 7 2[ ] "cibosd05 HCA-1" ( )<br> 1 9[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 27 2[ ] "cibosd06 HCA-1" ( )<br> 1 10[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 15 2[ ] "cibosd07 HCA-1" ( )<br> 1 11[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 6 2[ ] "cibosd08 HCA-1" ( )<br> 1 12[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 1 13[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 1 14[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 1 15[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 1 16[ ] ==( 4X 10.0 Gbps (FDR10) Active/ LinkUp)==> 24 34[ ] "MF0;GWIB01:SX6036G/U1" ( Could be 14.0625 Gbps)<br> 1 17[ ] ==( 4X 10.0 Gbps (FDR10) Active/ LinkUp)==> 2 17[ ] "MF0;SWIB01:SX6018/U1" ( )<br> 1 18[ ] ==( 4X 10.0 Gbps (FDR10) Active/ LinkUp)==> 23 36[ ] "MF0;GWIB02:SX6036G/U1" ( Could be 14.0625 Gbps)<br><b>Switch: 0xe41d2d030031eb41 MF0;GWIB02:SX6036G/U1:</b><br> 23 1[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 2[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 3[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 4[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 5[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 6[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 7[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 8[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 9[ ] ==( 4X 10.0 Gbps Active/ LinkUp)==> 29 2[ ] "Infiniscale-IV Mellanox Technologies" ( )<br> 23 10[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 11[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 12[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 13[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 14[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 15[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 16[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 17[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 18[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 19[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 20[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 21[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 22[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 23[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 24[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 25[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 26[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 27[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 28[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 29[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 30[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 31[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 32[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 23 33[ ] ==( 4X 10.0 Gbps (FDR10) Active/ LinkUp)==> 24 33[ ] "MF0;GWIB01:SX6036G/U1" ( Could be 14.0625 Gbps)<br> 23 34[ ] ==( 4X 10.0 Gbps (FDR10) Active/ LinkUp)==> 2 16[ ] "MF0;SWIB01:SX6018/U1" ( Could be 14.0625 Gbps)<br> 23 35[ ] ==( 4X 10.0 Gbps (FDR10) Active/ LinkUp)==> 24 35[ ] "MF0;GWIB01:SX6036G/U1" ( Could be 14.0625 Gbps)<br> 23 36[ ] ==( 4X 10.0 Gbps (FDR10) Active/ LinkUp)==> 1 18[ ] "MF0;SWIB02:SX6018/U1" ( Could be 14.0625 Gbps)<br> 23 37[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 28 1[ ] "MF0;GWIB02:SX60XX/GW" ( )<br><b>Switch: 0xe41d2d0300097630 MF0;SWIB01:SX6018/U1:</b><br> 2 1[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 4 1[ ] "cibmon01 HCA-1" ( )<br> 2 2[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 5 1[ ] "cibmon02 HCA-1" ( )<br> 2 3[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 3 1[ ] "cibmon03 HCA-1" ( )<br> 2 4[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 19 1[ ] "cibosd01 HCA-1" ( )<br> 2 5[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 10 1[ ] "cibosd02 HCA-1" ( )<br> 2 6[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 21 1[ ] "cibosd03 HCA-1" ( )<br> 2 7[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 11 1[ ] "cibosd04 HCA-1" ( )<br> 2 8[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 16 1[ ] "cibosd05 HCA-1" ( )<br> 2 9[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 26 1[ ] "cibosd06 HCA-1" ( )<br> 2 10[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 8 1[ ] "cibosd07 HCA-1" ( )<br> 2 11[ ] ==( 4X 14.0625 Gbps Active/ LinkUp)==> 9 1[ ] "cibosd08 HCA-1" ( )<br> 2 12[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 2 13[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 2 14[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 2 15[ ] ==( Down/ Polling)==> [ ] "" ( )<br> 2 16[ ] ==( 4X 10.0 Gbps (FDR10) Active/ LinkUp)==> 23 34[ ] "MF0;GWIB02:SX6036G/U1" ( Could be 14.0625 Gbps)<br> 2 17[ ] ==( 4X 10.0 Gbps (FDR10) Active/ LinkUp)==> 1 17[ ] "MF0;SWIB02:SX6018/U1" ( )<br> 2 18[ ] ==( 4X 10.0 Gbps (FDR10) Active/ LinkUp)==> 24 36[ ] "MF0;GWIB01:SX6036G/U1" ( )<br><br></div><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)"># lsmod |grep ib<br>ib_ucm 18450 0 <br>ib_uverbs 46826 1 ib_ucm<br>ib_ipoib 77741 0 <br>ib_cm 42689 2 ib_ucm,ib_ipoib<br>ib_sa 33950 2 ib_cm,ib_ipoib<br>ib_umad 22129 8 <br>ib_mthca 129035 0 <br>ib_qib 390078 1 <br>ib_mad 47486 5 ib_cm,ib_sa,ib_qib,ib_umad,ib_mthca<br>ib_core 88311 9 ib_cm,ib_sa,ib_mad,ib_qib,ib_ucm,ib_umad,ib_uverbs,ib_ipoib,ib_mthca<br>ib_addr 18923 1 ib_core<br>dca 15130 1 ib_qib<br>libiscsi 57233 1 be2iscsi<br>libahci 32190 1 ahci<br>scsi_transport_iscsi 99909 2 be2iscsi,libiscsi<br><br></div><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)">any ideas? I'm really new to ib and can't get the qlogic hp blc 4x qdr ib connectivity,.. don't know if i need to configure anything else or maybe there's a problem with the backplane of the encl,... i really don't know, and sorry if someone is from hp, but hp does not had the 'best' service out there..specially from ib perspective..<br><br></div><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)">thanks in advance,<br><br></div><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;color:rgb(11,83,148)">cheers,<br></div><div class="gmail_extra"><br clear="all"><div><div><div dir="ltr"><div><div dir="ltr"><span><div><div dir="ltr"><p><b><span style="font-size:10pt;font-family:Trebuchet MS,sans-serif;color:rgb(68,68,68)"></span></b></p><span style="color:rgb(68,68,68)"><span style="font-family:trebuchet ms,sans-serif"><font size="2"><b>German</b></font></span></span><span style="color:rgb(68,68,68)"><span style="font-family:trebuchet ms,sans-serif"><font size="2"><font size="1"><a href="mailto:ganders@despegar.com" target="_blank"></a></font></font></span></span></div></div></span></div></div></div></div></div>
<br><div class="gmail_quote">2015-10-07 1:56 GMT-03:00 Weiny, Ira <span dir="ltr"><<a href="mailto:ira.weiny@intel.com" target="_blank">ira.weiny@intel.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div link="blue" vlink="purple" lang="EN-US">
<div>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"Calibri","sans-serif";color:rgb(31,73,125)">I don’t know if Ubuntu includes the ipath verbs packages or not. I would assume so.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"Calibri","sans-serif";color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"Calibri","sans-serif";color:rgb(31,73,125)">If not the ipathverbs packages are available here:<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"Calibri","sans-serif";color:rgb(31,73,125)"><u></u> <u></u></span></p>
<pre><span style="color:black">libipathverbs: Mike Marciniszyn <u></u><u></u></span></pre>
<pre><span style="color:black"><a href="http://www.openfabrics.org/downloads/libipathverbs" target="_blank">http://www.openfabrics.org/downloads/libipathverbs</a><u></u><u></u></span></pre>
<pre><span style="color:black">git://<a href="http://github.com/01org/libipathverbs.git" target="_blank">github.com/01org/libipathverbs.git</a> master<u></u><u></u></span></pre>
<pre><span style="color:black">(<a href="mailto:infinipath@intel.com" target="_blank">infinipath@intel.com</a><mailto:<a href="mailto:infinipath@intel.com" target="_blank">infinipath@intel.com</a>>) <u></u><u></u></span></pre>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"Calibri","sans-serif";color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"Calibri","sans-serif";color:rgb(31,73,125)">Also, if your applications can use it, you will get better performance using PSM which is available here:<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"Calibri","sans-serif";color:rgb(31,73,125)"><u></u> <u></u></span></p>
<pre><span style="color:black">infinipath-psm: CQ Tang<u></u><u></u></span></pre>
<pre><span style="color:black">(<a href="mailto:infinipath@intel.com" target="_blank">infinipath@intel.com</a><mailto:<a href="mailto:infinipath@intel.com" target="_blank">infinipath@intel.com</a>>) <u></u><u></u></span></pre>
<pre><span style="color:black"><a href="http://www.openfabrics.org/downloads/infinipath-psm" target="_blank">http://www.openfabrics.org/downloads/infinipath-psm</a><u></u><u></u></span></pre>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"Calibri","sans-serif";color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"Calibri","sans-serif";color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"Calibri","sans-serif";color:rgb(31,73,125)">Ira<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"Calibri","sans-serif";color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"Calibri","sans-serif";color:rgb(31,73,125)"><u></u> <u></u></span></p>
<div style="border-width:medium medium medium 1.5pt;border-style:none none none solid;border-color:-moz-use-text-color -moz-use-text-color -moz-use-text-color blue;padding:0in 0in 0in 4pt">
<div>
<div style="border-width:1pt medium medium;border-style:solid none none;border-color:rgb(181,196,223) -moz-use-text-color -moz-use-text-color;padding:3pt 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10pt;font-family:"Tahoma","sans-serif""> <a href="mailto:users-bounces@lists.openfabrics.org" target="_blank">users-bounces@lists.openfabrics.org</a> [mailto:<a href="mailto:users-bounces@lists.openfabrics.org" target="_blank">users-bounces@lists.openfabrics.org</a>]
<b>On Behalf Of </b>German Anders<br>
<b>Sent:</b> Tuesday, October 06, 2015 12:32 PM<br>
<b>To:</b> Hal Rosenstock<br>
<b>Cc:</b> <a href="mailto:users@lists.openfabrics.org" target="_blank">users@lists.openfabrics.org</a><span><br>
<b>Subject:</b> Re: [Users] Config errors in IBA7322 QDR InfiniBand HCA<u></u><u></u></span></span></p>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal"><span style="font-family:"Courier New";color:rgb(11,83,148)">Hi Hal,<br>
<u></u><u></u></span></p>
</div><div><div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt"><span style="font-family:"Courier New";color:rgb(11,83,148)">Thanks a lot for the quick response. I'll try those commands and let you know. Regarding the software, is there any 'best soft' to use with Ubuntu and this
kind of adapter? Qlogic<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt"><span style="font-family:"Courier New";color:rgb(11,83,148)">Thanks in advance,<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt"><span style="font-family:"Courier New";color:rgb(11,83,148)">Best regards,<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><br clear="all">
<u></u><u></u></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><b><span style="font-size:10pt;font-family:"Trebuchet MS","sans-serif";color:rgb(68,68,68)">German</span></b><u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">2015-10-06 16:30 GMT-03:00 Hal Rosenstock <<a href="mailto:hal.rosenstock@gmail.com" target="_blank">hal.rosenstock@gmail.com</a>>:<u></u><u></u></p>
<div>
<div>
<p class="MsoNormal">Hi German,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">You can't get at the switches because the local ports are disabled.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Start with enabling these ports. Something like:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">ibportstate -D 0 1 enable<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">ibportstate -D 0 2 enable<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Hopefully that should move the ports out of disabled physical state and if so try ibswitches.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">You appear to be using MOFED distribution. Is there a reason for that ? I'm not sure that it includes packages for libipathverbs or libcxgb4.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">-- Hal<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<div>
<p class="MsoNormal">On Tue, Oct 6, 2015 at 2:48 PM, German Anders <<a href="mailto:ganders@despegar.com" target="_blank">ganders@despegar.com</a>> wrote:<u></u><u></u></p>
</div>
</div>
<blockquote style="border-width:medium medium medium 1pt;border-style:none none none solid;border-color:-moz-use-text-color -moz-use-text-color -moz-use-text-color rgb(204,204,204);padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt"><span style="font-family:"Courier New";color:rgb(11,83,148)">Hi All,<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt"><span style="font-family:"Courier New";color:rgb(11,83,148)">I'm in the middle of a new Infiniband implementation but I'm getting some errors, the basic setup is a HP Enclosure with a IB SW (Infiniscale-IV Mellanox
Technologies), then I've setup a Blade with Ubuntu 14.04 and when trying to configure the IB support I'm getting some errors:<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt"><span style="font-family:"Courier New";color:rgb(11,83,148)"># lscpi<br>
(...)<br>
<b>41:00.0 InfiniBand: QLogic Corp. IBA7322 QDR InfiniBand HCA (rev 02)</b><br>
<br>
<br>
# ibstatus<br>
Infiniband device 'qib0' port 1 status:<br>
default gid: fe80:0000:0000:0000:0011:7500:0079:1ff8<br>
base lid: 0xffff<br>
sm lid: 0xffff<br>
state: 1: DOWN<br>
phys state: 3: Disabled<br>
rate: 40 Gb/sec (4X QDR)<br>
link_layer: InfiniBand<br>
<br>
Infiniband device 'qib0' port 2 status:<br>
default gid: fe80:0000:0000:0000:0011:7500:0079:1ff9<br>
base lid: 0xffff<br>
sm lid: 0xffff<br>
state: 1: DOWN<br>
phys state: 3: Disabled<br>
rate: 40 Gb/sec (4X QDR)<br>
link_layer: InfiniBand<br>
<br>
<a href="mailto:root@e60-host02:~/MLNX_OFED_LINUX-3.0-2.0.1-ubuntu14.04-x86_64#" target="_blank">root@e60-host02:~/MLNX_OFED_LINUX-3.0-2.0.1-ubuntu14.04-x86_64#</a> ibstat<br>
CA 'qib0'<br>
CA type: InfiniPath_QMH7342<br>
Number of ports: 2<br>
Firmware version: <br>
Hardware version: 2<br>
Node GUID: 0x0011750000791ff8<br>
System image GUID: 0x0011750000791ff8<br>
Port 1:<br>
State: Down<br>
Physical state: Disabled<br>
Rate: 40<br>
Base lid: 65535<br>
LMC: 0<br>
SM lid: 65535<br>
Capability mask: 0x07610868<br>
Port GUID: 0x0011750000791ff8<br>
Link layer: InfiniBand<br>
Port 2:<br>
State: Down<br>
Physical state: Disabled<br>
Rate: 40<br>
Base lid: 65535<br>
LMC: 0<br>
SM lid: 65535<br>
Capability mask: 0x07610868<br>
Port GUID: 0x0011750000791ff9<br>
Link layer: InfiniBand<br>
<br>
<br>
# ibstatus<br>
Infiniband device 'qib0' port 1 status:<br>
default gid: fe80:0000:0000:0000:0011:7500:0079:1ff8<br>
base lid: 0xffff<br>
sm lid: 0xffff<br>
state: 1: DOWN<br>
phys state: 3: Disabled<br>
rate: 40 Gb/sec (4X QDR)<br>
link_layer: InfiniBand<br>
<br>
Infiniband device 'qib0' port 2 status:<br>
default gid: fe80:0000:0000:0000:0011:7500:0079:1ff9<br>
base lid: 0xffff<br>
sm lid: 0xffff<br>
state: 1: DOWN<br>
phys state: 3: Disabled<br>
rate: 40 Gb/sec (4X QDR)<br>
link_layer: InfiniBand<br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt"><span style="font-family:"Courier New";color:rgb(11,83,148)">Some of the errors besides that the phys state of the ports is disabled:<br>
<br>
# ibswitches<br>
src/query_smp.c:228; can't open UMAD port ((null):0)<br>
/usr/sbin/ibnetdiscover: iberror: failed: discover failed<br>
<br>
# ibv_devinfo<br>
libibverbs: Warning: couldn't load driver 'ipathverbs': libipathverbs-rdmav2.so: cannot open shared object file: No such file or directory<br>
libibverbs: Warning: couldn't load driver 'cxgb4': libcxgb4-rdmav2.so: cannot open shared object file: No such file or directory<br>
hca_id: qib0<br>
transport: InfiniBand (0)<br>
fw_ver: 0.0.0<br>
node_guid: 0011:7500:0079:1ff8<br>
sys_image_guid: 0011:7500:0079:1ff8<br>
vendor_id: 0x1175<br>
vendor_part_id: 29474<br>
hw_ver: 0x2<br>
board_id: InfiniPath_QMH7342<br>
phys_port_cnt: 2<br>
port: 1<br>
state: PORT_DOWN (1)<br>
max_mtu: 4096 (5)<br>
active_mtu: 4096 (5)<br>
sm_lid: 65535<br>
port_lid: 65535<br>
port_lmc: 0x00<br>
link_layer: InfiniBand<br>
<br>
port: 2<br>
state: PORT_DOWN (1)<br>
max_mtu: 4096 (5)<br>
active_mtu: 4096 (5)<br>
sm_lid: 65535<br>
port_lid: 65535<br>
port_lmc: 0x00<br>
link_layer: InfiniBand<br>
<br>
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt"><span style="font-family:"Courier New";color:rgb(11,83,148)">Also, In what packages are the
<b>ipathverbs</b> and <b>cxgb4</b> contained? Also, does anyone had any experience with HP IB switches?
<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Courier New";color:rgb(11,83,148)">Thanks in advance,<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Courier New";color:rgb(11,83,148)"><br>
<br clear="all">
<u></u><u></u></span></p>
</div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><b><span style="font-size:10pt;font-family:"Trebuchet MS","sans-serif";color:rgb(68,68,68)">German</span></b><u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12pt">_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.openfabrics.org" target="_blank">Users@lists.openfabrics.org</a><br>
<a href="http://lists.openfabrics.org/mailman/listinfo/users" target="_blank">http://lists.openfabrics.org/mailman/listinfo/users</a><u></u><u></u></p>
</blockquote>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div></div></div>
</div>
</div>
</div>
</blockquote></div><br></div></div>