<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 TRANSITIONAL//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; CHARSET=UTF-8">
<META NAME="GENERATOR" CONTENT="GtkHTML/3.10.3">
</HEAD>
<BODY>
Hi Scott,<BR>
You have an old version of ipoibtools package (ipoib_ha.pl).<BR>
All issues you are talking about were fixed in the new version which will be available in OFED-1.1-rc7.<BR>
You can also download it from SVN: <A HREF="https://openib.org/svn/gen2/branches/1.1/src/userspace/ipoibtools">https://openib.org/svn/gen2/branches/1.1/src/userspace/ipoibtools</A><BR>
<BR>
Thanks,<BR>
<BR>
Regards,<BR>
Vladimir<BR>
<BR>
On Tue, 2006-10-03 at 14:53 -0700, Scott Weitzenkamp (sweitzen) wrote:<BR>
<BLOCKQUOTE TYPE=CITE>
<FONT SIZE="2"><FONT COLOR="#0000ff">Vlad, thaks for the fast response. I have some followup questions about configuring IPoIB HA, see below.</FONT></FONT><BR>
<BR>
<BR>
<FONT COLOR="#000000"> </FONT><FONT COLOR="#000000"><FONT SIZE="2">3) I got IPoIB HA working on SLES 10, but the documentation is a little lacking. Looks like I have to put the same IP address in ifcfg-ib0 and ifcfg-ib1, is this correct?</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#000000"> </FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#000000"> Yes, IP address should be the same. Actually the configuration of the secondary interface does not matter.</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#000000"> The High Availability daemon reads the configuration of the primary interface and migrates it between the interfaces in case of failure.</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#000000"> </FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#000000"> </FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#000000">If I don't have an ifcfg-ib1 file, then ipoib_ha.pl won't start.</FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">If I don't have an ifcfg-ib1, then ipoib_ha.pl won't start. I would prefer to not configure ifcfg-ib1 since I don't plan to use it.</FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"># ipoib_ha.pl --with-arping --with-multicast -v</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Can't open conf /etc/sysconfig/network/ifcfg-ib1: No such file or directory</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Can't open conf /etc/sysconfig/network/ifcfg-ib1: No such file or directory</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Can't open conf /etc/sysconfig/network/ifcfg-ib1: No such file or directory</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Can't open conf /etc/sysconfig/network/ifcfg-ib1: No such file or directory</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Can't open conf /etc/sysconfig/network/ifcfg-ib1: No such file or directory</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">...</FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">If I put different IP addresses in ifcfg-ib0 and ifcfg-ib1, then the ifcfg-ib1 IP address is used for both ib0 and ib1!</FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"># </FONT></FONT><FONT COLOR="#0000ff"><B><FONT SIZE="2">pwd</FONT></B></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">/etc/sysconfig/network</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"># </FONT></FONT><FONT COLOR="#0000ff"><B><FONT SIZE="2">cat ifcfg-ib0</FONT></B></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">DEVICE=ib0</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">BOOTPROTO=static</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">IPADDR=192.168.2.46</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">NETMASK=255.255.255.0</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">ONBOOT=yes</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"># </FONT></FONT><FONT COLOR="#0000ff"><B><FONT SIZE="2">cat ifcfg-ib1</FONT></B></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">DEVICE=ib1</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">BOOTPROTO=static</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">IPADDR=192.168.6.46</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">NETMASK=255.255.255.0</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">ONBOOT=yes</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"># </FONT></FONT><FONT COLOR="#0000ff"><B><FONT SIZE="2">/etc/init.d/openibd start</FONT></B></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Loading HCA driver and Access Layer: [ OK ]</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Setting up InfiniBand network interfaces:</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> ib0 device: Mellanox Technologies MT25208 InfiniHost III Ex (Tavor com</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">patibility mode) (rev 20)</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> ib0 configuration: ib1</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Bringing up interface ib0: [ OK ]</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> ib1 device: Mellanox Technologies MT25208 InfiniHost III Ex (Tavor com</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">patibility mode) (rev 20)</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Bringing up interface ib1: [ OK ]</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Setting up service network . . . [ done ]</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"># </FONT></FONT><FONT COLOR="#0000ff"><B><FONT SIZE="2">ifconfig ib0</FONT></B></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">ib0 Link encap:UNSPEC HWaddr 00-00-04-04-FE-80-00-00-00-00-00-00-00-00-00</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">-00</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> inet addr:192.168.6.46 Bcast:192.168.6.255 Mask:255.255.255.0</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> inet6 addr: fe80::202:c902:21:700d/64 Scope:Link</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> UP BROADCAST RUNNING MULTICAST MTU:2044 Metric:1</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> RX packets:0 errors:0 dropped:0 overruns:0 frame:0</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> TX packets:3 errors:0 dropped:0 overruns:0 carrier:0</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> collisions:0 txqueuelen:128</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> RX bytes:0 (0.0 b) TX bytes:224 (224.0 b)</FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"># </FONT></FONT><FONT COLOR="#0000ff"><B><FONT SIZE="2">ifconfig ib1</FONT></B></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">ib1 Link encap:UNSPEC HWaddr 00-00-04-05-FE-80-00-00-00-00-00-00-00-00-00</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">-00</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> inet addr:192.168.6.46 Bcast:192.168.6.255 Mask:255.255.255.0</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> inet6 addr: fe80::202:c902:21:700e/64 Scope:Link</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> UP BROADCAST RUNNING MULTICAST MTU:2044 Metric:1</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> RX packets:0 errors:0 dropped:0 overruns:0 frame:0</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> TX packets:4 errors:0 dropped:0 overruns:0 carrier:0</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> collisions:0 txqueuelen:128</FONT></FONT><BR>
<FONT SIZE="2"><FONT COLOR="#0000ff"> RX bytes:0 (0.0 b) TX bytes:304 (304.0 b)</FONT></FONT><BR>
<BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Notice how both ib0 and ib1 have the IP address from ifcfg-ib1. This contradicts this info from ipoib_release_notes.txt:</FONT></FONT><BR>
<BR>
<BLOCKQUOTE>
<FONT SIZE="2"><FONT COLOR="#0000ff"> b. The ib1 interface uses the configuration script of ib0.</FONT></FONT><BR>
<BR>
<BR>
</BLOCKQUOTE>
<BR>
<FONT SIZE="2"><FONT COLOR="#0000ff">Scott</FONT></FONT><BR>
<BR>
</BLOCKQUOTE>
<BR>
</BODY>
</HTML>