<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:st1="urn:schemas-microsoft-com:office:smarttags" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=US-ASCII">
<meta name=Generator content="Microsoft Word 11 (filtered medium)">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]--><o:SmartTagType
namespaceuri="urn:schemas-microsoft-com:office:smarttags" name="City"
downloadurl="http://www.5iamas-microsoft-com:office:smarttags"/>
<o:SmartTagType namespaceuri="urn:schemas-microsoft-com:office:smarttags"
name="place" downloadurl="http://www.5iantlavalamp.com/"/>
<!--[if !mso]>
<style>
st1\:*{behavior:url(#default#ieooui) }
</style>
<![endif]-->
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{color:blue;
text-decoration:underline;}
pre
{margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
tt
{font-family:"Courier New";}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:Arial;
color:navy;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
{page:Section1;}
-->
</style>
</head>
<body lang=EN-US link=blue vlink=blue>
<div class=Section1>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Hi , <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'> Can you please send “lspci –vv
“ for all Mellanox devices on the system ( the virtual bridge and the simple
device ) .<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<div>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>--- Guy</span></font><o:p></o:p></p>
</div>
<div style='border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt'>
<div>
<div class=MsoNormal align=center style='text-align:center'><font size=3
face="Times New Roman"><span style='font-size:12.0pt'>
<hr size=2 width="100%" align=center tabindex=-1>
</span></font></div>
<p class=MsoNormal><b><font size=2 face=Tahoma><span style='font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><font size=2
face=Tahoma><span style='font-size:10.0pt;font-family:Tahoma'> QiWang, Chen
[mailto:QiWang.Chen@Clustars.CN] <br>
<b><span style='font-weight:bold'>Sent:</span></b> Sunday, September 18, 2005
9:56 AM<br>
<b><span style='font-weight:bold'>To:</span></b> Grant Grundler<br>
<b><span style='font-weight:bold'>Cc:</span></b> openib-general@openib.org<br>
<b><span style='font-weight:bold'>Subject:</span></b> Re: [openib-general]
could not add HCA InfiniHost0</span></font><o:p></o:p></p>
</div>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'><o:p> </o:p></span></font></p>
<p class=MsoNormal><tt><font size=2 face="Courier New"><span style='font-size:
10.0pt'>Hi, Grant</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
I can not change the slot, I only have one slot (BladeServer), </span></font></tt><br>
<br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>--------------------------------------------------------------------</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>lspci -vvs
02:00.0 :</span></font></tt><br>
<br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>02:00.0 PCI
bridge: Mellanox Technologies MT23108 PCI Bridge (rev a1)</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>(prog-if 00
[<st1:City w:st="on"><st1:place w:st="on">Normal</st1:place></st1:City>
decode])</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>ParErr-
Stepping- SERR+ FastB2B-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'><TAbort-
<MAbort- >SERR- <PERR-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Latency: 32, Cache Line Size 08</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Bus: primary=02, secondary=03, subordinate=03, sec-latency=32</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Memory behind bridge: e0000000-efffffff</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Secondary status: 66Mhz+ FastB2B- ParErr- DEVSEL=medium >TAbort-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'><TAbort-
<MAbort- <SERR- <PERR-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
BridgeCtl: Parity- SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Capabilities: [70] PCI-X bridge device.</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Secondary Status: 64bit+, 133MHz+, SCD-, USC-, SCO-,</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>SRD- Freq=3</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Status: Bus=2 Dev=0 Func=0 64bit+ 133MHz+ SCD- USC-,</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>SCO-, SRD-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
: Upstream: Capacity=512, Commitment Limit=512</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
: Downstream: Capacity=128, Commitment Limit=128</span></font></tt><br>
<br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>---------------------------------------------------------------------------------------------------</span></font></tt><br>
<br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>lspci -vvs
02:01.0</span></font></tt><br>
<br>
<br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>02:01.0 PCI
bridge: Mellanox Technologies MT23108 PCI Bridge (rev a1)</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>(prog-if 00
[<st1:City w:st="on"><st1:place w:st="on">Normal</st1:place></st1:City>
decode])</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>ParErr-
Stepping- SERR+ FastB2B-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'><TAbort-
<MAbort- >SERR- <PERR-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Latency: 32, Cache Line Size 08</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Bus: primary=02, secondary=03, subordinate=03, sec-latency=32</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Memory behind bridge: e0000000-efffffff</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Secondary status: 66Mhz+ FastB2B- ParErr- DEVSEL=medium >TAbort-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'><TAbort-
<MAbort- <SERR- <PERR-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
BridgeCtl: Parity- SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Capabilities: [70] PCI-X bridge device.</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Secondary Status: 64bit+, 133MHz+, SCD-, USC-, SCO-,</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>SRD- Freq=3</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
Status: Bus=2 Dev=1 Func=0 64bit+ 133MHz+ SCD- USC-,</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>SCO-, SRD-</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
: Upstream: Capacity=512, Commitment Limit=512</span></font></tt><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>
: Downstream: Capacity=128, Commitment Limit=128</span></font></tt><br>
<br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>-----------------------------------------------------------------------------------------------------</span></font></tt><br>
<br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>Thx</span></font></tt><br>
<br>
On Thu, 2005-09-15 at 08:50 -0700, Grant Grundler wrote: <o:p></o:p></p>
<pre><font size=2 face="Courier New"><span style='font-size:10.0pt'><o:p> </o:p></span></font></pre><pre><font
size=2 color=black face="Courier New"><span style='font-size:10.0pt;color:black'>On Thu, Sep 15, 2005 at 06:11:26PM +0800, QiWang, Chen wrote:</span></font><o:p></o:p></pre><pre><font
size=2 color=black face="Courier New"><span style='font-size:10.0pt;color:black'>> there are some diff:</span></font><o:p></o:p></pre><pre><font
size=2 color=black face="Courier New"><span style='font-size:10.0pt;color:black'>> 02:00.0 --> work</span></font><o:p></o:p></pre><pre><font
size=2 color=black face="Courier New"><span style='font-size:10.0pt;color:black'>> 02:01.0 --> failed</span></font><o:p></o:p></pre><pre><font
size=2 color=black face="Courier New"><span style='font-size:10.0pt;color:black'>> </span></font><o:p></o:p></pre><pre><font
size=2 color=black face="Courier New"><span style='font-size:10.0pt;color:black'>> and first time I install the ib-verbs on node1, It also failed, because </span></font><o:p></o:p></pre><pre><font
size=2 color=black face="Courier New"><span style='font-size:10.0pt;color:black'>> lspci= 02:01.0, an I don not know how i change 02:01.0 to 02:00.0, and </span></font><o:p></o:p></pre><pre><font
size=2 color=black face="Courier New"><span style='font-size:10.0pt;color:black'>> it works fine for me.</span></font><o:p></o:p></pre><pre><font
size=2 face="Courier New"><span style='font-size:10.0pt'><o:p> </o:p></span></font></pre><pre><font
size=2 color=black face="Courier New"><span style='font-size:10.0pt;color:black'>You can only change it by removing the Mellanox card and re-installing</span></font><o:p></o:p></pre><pre><font
size=2 color=black face="Courier New"><span style='font-size:10.0pt;color:black'>in the other slot.</span></font><o:p></o:p></pre><pre><font
size=2 face="Courier New"><span style='font-size:10.0pt'><o:p> </o:p></span></font></pre><pre><font
size=2 color=black face="Courier New"><span style='font-size:10.0pt;color:black'>Can you post "lspci -vvs 02:01.0" output from the machine that failed?</span></font><o:p></o:p></pre><pre><font
size=2 color=black face="Courier New"><span style='font-size:10.0pt;color:black'>Can you post "lspci -vvs 02:00.0" output from the machine that worked?</span></font><o:p></o:p></pre><pre><font
size=2 face="Courier New"><span style='font-size:10.0pt'><o:p> </o:p></span></font></pre><pre><font
size=2 color=black face="Courier New"><span style='font-size:10.0pt;color:black'>grant</span></font><o:p></o:p></pre>
<table class=MsoNormalTable border=0 cellspacing=0 cellpadding=0 width="100%"
style='width:100.0%'>
<tr>
<td style='padding:0in 0in 0in 0in'><pre><font size=2 face="Courier New"><span
style='font-size:10.0pt'><o:p> </o:p></span></font></pre><pre><font
size=2 face="Courier New"><span style='font-size:10.0pt'>-- <o:p></o:p></span></font></pre><pre><font
size=2 face="Courier New"><span style='font-size:10.0pt'>QiWang, Chen <<a
href="mailto:QiWang.Chen@Clustars.CN">QiWang.Chen@Clustars.CN</a>><o:p></o:p></span></font></pre><pre><font
size=2 face="Courier New"><span style='font-size:10.0pt'>Clustars Supercomputing Technology corp.<o:p></o:p></span></font></pre><pre><font
size=2 face="Courier New"><span style='font-size:10.0pt'><a
href="http://www.Clustars.CN">http://www.Clustars.CN</a><o:p></o:p></span></font></pre><pre><font
size=2 face="Courier New"><span style='font-size:10.0pt'>TEL:+86-0816-2546345-815<o:p></o:p></span></font></pre><pre><font
size=2 face="Courier New"><span style='font-size:10.0pt'>FAX:+86-0816-2546370<o:p></o:p></span></font></pre><pre><st1:City
w:st="on"><st1:place w:st="on"><font size=2 face="Courier New"><span
style='font-size:10.0pt'>Mobile</span></font></st1:place></st1:City>:+86-13096497499<o:p></o:p></pre></td>
</tr>
</table>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'><o:p> </o:p></span></font></p>
</div>
</div>
</body>
</html>