<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD><TITLE id=ridTitle>Blank</TITLE>
<META http-equiv=Content-Type content="text/html; charset=us-ascii">
<STYLE>BODY {
MARGIN-TOP: 25px; FONT-SIZE: 10pt; MARGIN-LEFT: 25px; COLOR: #000000; FONT-FAMILY: Arial, Helvetica
}
P.msoNormal {
MARGIN-TOP: 0px; FONT-SIZE: 10pt; MARGIN-LEFT: 0px; COLOR: #ffffcc; FONT-FAMILY: Helvetica, "Times New Roman"
}
LI.msoNormal {
MARGIN-TOP: 0px; FONT-SIZE: 10pt; MARGIN-LEFT: 0px; COLOR: #ffffcc; FONT-FAMILY: Helvetica, "Times New Roman"
}
</STYLE>
<META content="MSHTML 6.00.2800.1528" name=GENERATOR></HEAD>
<BODY id=ridBody background=cid:554490317@08032006-2238>
<DIV>
<DIV>Hello,<BR><BR>I have a problem using different IPoIB network interfaces on
the same HCA with two ports.<BR><BR>I have two hosts with <SPAN
class=554490317-08032006>two port </SPAN>HCAs</DIV>
<DIV><SPAN class=554490317-08032006>Both HCAs are </SPAN>connected to a switch
with both their ports.<BR><BR>I configure ib0 and ib1 interfaces to with
different subnet IPs, just like<BR> <FONT color=#000080> ib0
192.168.3.235, ib1 192.168.4.235</FONT> on the first
machine<BR>and<BR> <FONT color=#000080>ib0 192.168.3.156, ib1
192.168.4.156</FONT> on the second one.<BR>Pings work only via one of the
interfaces. When I begin sending pings via second one, the first interface
stops <SPAN class=554490317-08032006>receiving
</SPAN>replies.<BR>Example:<BR> ping 192.168.3.156 -
OK<BR> ping 192.168.4.156 - OK<BR> ping 192.168.3.156
again - no reply.<BR><BR></DIV>
<DIV><BR>I tried to configure the network interfaces on different IB partitions,
like<BR> <FONT color=#000080> ib0 192.168.3.235, ib1.f1f1
192.168.4.235</FONT> on the first machine<BR>and<BR> <FONT
color=#000080> ib0 192.168.3.156, ib1.f1f1
192.168.4.156</FONT> on the second one.<BR>It worked fine.</DIV>
<DIV> </DIV>
<DIV> </DIV>
<DIV>I also tried to run the first test (the same partition),</DIV>
<DIV>using <SPAN class=554490317-08032006>two </SPAN>HCAs on the same
machine, and connecting one port on every HCA to the switch.</DIV>
<DIV><FONT color=#000080>(</FONT> <FONT color=#000080> ib0
192.168.3.235, ib1 192.168.4.235</FONT> on the first machine</DIV>
<DIV> <FONT color=#000080>ib0 192.168.3.156, <STRONG>ib2
</STRONG>192.168.4.156</FONT> on the second one<SPAN class=554490317-08032006>,
where ib2 is the interface on the second HCA</SPAN> )</DIV>
<DIV>It worked fine too.</DIV>
<DIV> </DIV>
<DIV> </DIV>
<DIV>You could say that configuring different IP subnets on the same physical
networ<SPAN class=554490317-08032006>k</SPAN> isn<SPAN
class=554490317-08032006>'</SPAN>t a good practic<SPAN
class=554490317-08032006>e</SPAN>, and the problem is in the TCP/IP stack,<SPAN
class=554490317-08032006> </SPAN>bu<SPAN class=554490317-08032006>t</SPAN></DIV>
<DIV><SPAN class=554490317-08032006>two network interfaces on
different</SPAN> HCAs<SPAN class=554490317-08032006> </SPAN>worked
fine<SPAN class=554490317-08032006>, while</SPAN></DIV>
<DIV><SPAN class=554490317-08032006><SPAN class=554490317-08032006>two network
interfaces on different ports on the same</SPAN> HCA made
problems.</SPAN></DIV><FONT color=#0000ff></FONT><FONT
color=#0000ff></FONT><FONT color=#0000ff></FONT><FONT color=#0000ff></FONT><FONT
color=#0000ff></FONT><FONT color=#0000ff></FONT>
<DIV><SPAN class=554490317-08032006></SPAN> </DIV>
<DIV><SPAN class=554490317-08032006>Has anyone seen a problem like
this?</SPAN></DIV>
<DIV><SPAN class=554490317-08032006>Any ideas?</SPAN></DIV>
<DIV><SPAN class=554490317-08032006></SPAN> </DIV>
<DIV><SPAN class=554490317-08032006>I run </SPAN></DIV>
<DIV>SUSE Linux Enterprise Server 9.90 Beta5 <SPAN
class=554490317-08032006>distribution,</SPAN></DIV>
<DIV><SPAN class=554490317-08032006>with kernel 2.5.15 installed,,</SPAN></DIV>
<DIV><SPAN class=554490317-08032006>and IB kernel modules from OpenIB SVN,
revision 5337</SPAN></DIV>
<DIV><SPAN class=554490317-08032006>on d</SPAN>ual CPU x86_64 machines<SPAN
class=554490317-08032006>.</SPAN></DIV>
<DIV><SPAN class=554490317-08032006></SPAN> </DIV></DIV>
<DIV>
<DIV><FONT face=Arial><FONT face="Arial Black">Leonid Arsh</FONT></FONT></DIV>
<DIV><FONT face=Arial><FONT face="Arial Black">SW Engineer</FONT></FONT></DIV>
<DIV><FONT face=Arial><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: 'Arial Black'"><A
title=http://www.voltaire.com/ href="http://www.voltaire.com/"><FONT
title=http://www.voltaire.com/ color=#000000>www.voltaire.com</FONT></SPAN><FONT
title=http://www.voltaire.com/><SPAN title=http://www.voltaire.com/
style="FONT-SIZE: 10pt; FONT-FAMILY: 'Arial Black'"></SPAN></FONT></A></FONT></DIV>
<DIV><FONT face=Arial><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: 'Arial Black'">The Grid Interconnect
Company</SPAN></DIV></FONT></DIV>
<P> </P></BODY></HTML>