[ewg] [Q] how to setup /etc/opensm/partitions.conf??

[Hal Rosenstock]

On Wed, Oct 26, 2011 at 10:03 AM, Hiroyuki Sato <hiroysato at gmail.com> wrote:

> Dear members.
>
> I have some question about Infiniband Partitions.
>
> I would like to build Linux box with IPoIB Router.
>
> * Questions
>
>  My Question is the following.
>
>  a) Can I create the following IPoIB network ??
>
>  b) If so, how to setup /etc/opensm/partitions.conf??
>
> * Problem.
>
>  Ping IB Client to Router : I got the followig error.
>
>  Network is unreachable.
>
> * Environment
>
>  OFED: OFED-1.5.3.2
>  OS:   Scientific Linux 6.1
>
> * Linux box (Router)
>
>  1 ethernet interface  (eth0)
>  1 Infiniband interfae (ib0)
>  Run subnet manager.
>
> * Ethernet setup
>
>  a) add VLAN ID 120 eth0.120 (192.168.120.0/24)
>  b) add VLAN ID 130 eth0.130 (192.168.130.0/24)
>
> * Infiniband Setup
>  a) add subinterface 0 ib0.8000 (192.168.0.0/24)
>  b) add subinterface 1 ib0.8001 (192.168.1.0/24)
>  c) Run opensm
>
>
>  I crated subinterface with the following command.
>
>  echo 0 > /sys/class/net/ib0/create_child
>  echo 1 > /sys/class/net/ib0/create_child
>

echo 0x8001 > /sys/class/net/ib0/create_child
echo 0x8002 > /sys/class/net/ib0/create_child


>  and assign ip address with ifconfig
>
> * Logical Diagram
>
>                 +----------- 192.168.120.0/24 ---
>                 |
>                 |        +---- 192.168.130.0/24
>         eth0.120|        | eth0.130
>                +----------+
>                | Router   |
>                +----------+
>         ib0.8000|        |ib0.8001
>     192.168.0.1 |        +---- 192.168.1.0/24
>                 |
>                 +----------- 192.168.0.0/24 --- IB Cllient. (ib0.8000)
>                                                 (192.168.0.2)
>
> * /etc/opensm/partitions.conf
>
>  Default=0x7fff   : ALL=full
>  Net0=0x00, ipoib : ALL=full
>  Net1=0x01, ipoib : ALL=full
>

Default=0x7fff: ALL=full
Net0=0x0001, ipoib: ALL=full
Net1=0x0002, ipoib: ALL=full



>
> Coule you please tell me what is wrong??
>

The one thing in the above I'm not sure of is whether the default partition
also needs the ipoib flag above so you might need to add that too if the
above doesn't work.

-- Hal


>
> Sincerely.
>
> --
> Hiroyuki Sato.
> _______________________________________________
> ewg mailing list
> ewg at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/ewg/attachments/20111026/e3fef189/attachment.html>