<br><br><div class="gmail_quote">On Wed, Oct 26, 2011 at 10:03 AM, Hiroyuki Sato <span dir="ltr"><<a href="mailto:hiroysato@gmail.com" target="_blank">hiroysato@gmail.com</a>></span> wrote:<br><blockquote style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;" class="gmail_quote">
Dear members.<br>
<br>
I have some question about Infiniband Partitions.<br>
<br>
I would like to build Linux box with IPoIB Router.<br>
<br>
* Questions<br>
<br>
My Question is the following.<br>
<br>
a) Can I create the following IPoIB network ??<br>
<br>
b) If so, how to setup /etc/opensm/partitions.conf??<br>
<br>
* Problem.<br>
<br>
Ping IB Client to Router : I got the followig error.<br>
<br>
Network is unreachable.<br>
<br>
* Environment<br>
<br>
OFED: OFED-1.5.3.2<br>
OS: Scientific Linux 6.1<br>
<br>
* Linux box (Router)<br>
<br>
1 ethernet interface (eth0)<br>
1 Infiniband interfae (ib0)<br>
Run subnet manager.<br>
<br>
* Ethernet setup<br>
<br>
a) add VLAN ID 120 eth0.120 (<a href="http://192.168.120.0/24" target="_blank">192.168.120.0/24</a>)<br>
b) add VLAN ID 130 eth0.130 (<a href="http://192.168.130.0/24" target="_blank">192.168.130.0/24</a>)<br>
<br>
* Infiniband Setup<br>
a) add subinterface 0 ib0.8000 (<a href="http://192.168.0.0/24" target="_blank">192.168.0.0/24</a>)<br>
b) add subinterface 1 ib0.8001 (<a href="http://192.168.1.0/24" target="_blank">192.168.1.0/24</a>)<br>
c) Run opensm<br>
<br>
<br>
I crated subinterface with the following command.<br>
<br>
echo 0 > /sys/class/net/ib0/create_child<br>
echo 1 > /sys/class/net/ib0/create_child<br></blockquote><div> </div><div>echo 0x8001 > /sys/class/net/ib0/create_child</div><div>echo 0x8002 > /sys/class/net/ib0/create_child</div><div> </div><blockquote style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;" class="gmail_quote">
and assign ip address with ifconfig<br>
<br>
* Logical Diagram<br>
<br>
+----------- <a href="http://192.168.120.0/24" target="_blank">192.168.120.0/24</a> ---<br>
|<br>
| +---- <a href="http://192.168.130.0/24" target="_blank">192.168.130.0/24</a><br>
eth0.120| | eth0.130<br>
+----------+<br>
| Router |<br>
+----------+<br>
ib0.8000| |ib0.8001<br>
192.168.0.1 | +---- <a href="http://192.168.1.0/24" target="_blank">192.168.1.0/24</a><br>
|<br>
+----------- <a href="http://192.168.0.0/24" target="_blank">192.168.0.0/24</a> --- IB Cllient. (ib0.8000)<br>
(192.168.0.2)<br>
<br>
* /etc/opensm/partitions.conf<br>
<br>
Default=0x7fff : ALL=full<br>
Net0=0x00, ipoib : ALL=full<br>
Net1=0x01, ipoib : ALL=full<br></blockquote><div> </div><div>Default=0x7fff: ALL=full</div><div>Net0=0x0001, ipoib: ALL=full</div><div>Net1=0x0002, ipoib: ALL=full</div><div> </div><div> </div><blockquote style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;" class="gmail_quote">
<br>
Coule you please tell me what is wrong??<br></blockquote><div> </div><div>The one thing in the above I'm not sure of is whether the default partition also needs the ipoib flag above so you might need to add that too if the above doesn't work.</div>
<div> </div><div>-- Hal</div><div> </div><blockquote style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;" class="gmail_quote">
<br>
Sincerely.<br>
<font color="#888888"><br>
--<br>
Hiroyuki Sato.<br>
_______________________________________________<br>
ewg mailing list<br>
<a href="mailto:ewg@lists.openfabrics.org" target="_blank">ewg@lists.openfabrics.org</a><br>
<a href="http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg" target="_blank">http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg</a><br>
</font></blockquote></div><br>