[ofa-general] IPoIB in Xen guest machine

Hal Rosenstock hal.rosenstock at gmail.com
Fri Jun 5 04:11:11 PDT 2009


On Fri, Jun 5, 2009 at 4:06 AM, Titov Alexander <titoff.a at gmail.com> wrote:
> Hello,
> I work in VDS hosting provider and we want increase our bandwidth with
> Infiniband. I make Infiniband test stand with two machines with
> Mellanox MT26428, switch MTS3600 and SLES11 with Xen.
> How can I connect ip network over IB to Xen guest machine?
> I see two ways:
> 1) I use Qlogic VNIC and bridge virtual xen interface with VNIC ethernet. It
> isn't true way, because data transfers with great overhead ( Maybe I
> mistake?).
> I try this way and I receve error  bad MAD status (110) from lid 0 from
> command  ib_qlgc_vnic_query. I try it with OFED and SLES11, Qlogic OFED+ and
> SLES10SP2, Mellanox OFED and SLES10SP2. I get this error for all
> configurations.

Is an SM running in the IB subnet ?

> 2) I use IPoIB with Ethernet IB bridge (gateway). But I found about it only
> few phrases on openfabrics site. (for
> example http://www.openfabrics.org/OFAReport/article4.htm ). Where can I
> find this code?
> Can you suggest me best solution?

I think there are a few general approaches for IP connectivity between
IB and ethernet:

1. Gateways (Voltaire has one, QLogic may (I forget))
2. VNIC approaches (QLogic, Xsigo, maybe others)
3. Use linux box as IP router with ethernet and IPoIB interfaces

What's best depends on your specific requirements.

-- Hal

> --
> Best regards,
> Titov Alexander
> _______________________________________________
> general mailing list
> general at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>
> To unsubscribe, please visit
> http://openib.org/mailman/listinfo/openib-general
>



More information about the general mailing list