[Users] can someone clarify and help with partitioning?

Johannes Mäulen Maeulen at awp-shop.de
Thu Aug 8 03:47:37 PDT 2013


Hi there!
I've got very little experience with IB so far, and I would like a to ask a
few questions.
Perhaps I can get some help here?
I'd like to use IB for fast Interconnects between four machines, all with
IPoIB.
My setup looks like the following:
I've got a small IB Switch (Flextronics 8port SDR, it has no subnet manager)
and 4 dual port Cards. (2 Voltaire, 2 HP)
Box1 and box2(windows) are connected directly(192.168.1.0/30)via ib0, box3
and box4(debian linux) are connected directly(192.168.3.0/30) via ib0.
Box1,box2,box3,box4 are connected to the Flextronics switch via ib1,
192.168.2.0/24.
All Interfaces are running in Connected Mode with MTU 65520.

I've tried to illustrate it:

box1 ib0----192.168.1.0/30------- ib0   box2
ib1					ib1
|________  			________|
	      |  			|	
		Ib-switch
		192.168.2.0/24
________|			|_______
|				      	|
ib1					ib1
box3 ib0----192.168.3.0/30------- ib0	box4


How many Subnet-Managers do i need to install? 
(currently I have one running on windows and one running on linux)
Do I need to build three partitions?

I read ipoib_release_notes.txt:
[...]
============================================================================
===
3. Known Issues
============================================================================
===
1. If a host has multiple interfaces and (a) each interface belongs to a
   different IP subnet, (b) they all use the same InfiniBand Partition, and
(c)
   they are connected to the same IB Switch, then the host violates the IP
rule
   requiring different broadcast domains. Consequently, the host may build
an
   incorrect ARP table.

   The correct setting of a multi-homed IPoIB host is achieved by using a
   different PKEY for each IP subnet.
[...]

But I'm unsure if this applies to my lab.
Yes, I have multiple hosts with multiple interfaces
(a) CHECK
Yes, right now they use the same IB Partition. As all subnet managers are
running with default config... 		(b) CHECK
YESNO,Parts of it are connected to the same IB Switch.
(c) UNSURE

Many thanks in advance for your help!

Johannes
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 6310 bytes
Desc: not available
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130808/a5e3f1bd/attachment.bin>


More information about the Users mailing list