[ewg] RE: [ofa-general] does RHEL5 Xen work with OFED?

[Scott Weitzenkamp (sweitzen)]

Yep, my understanding is IPoIB cannot be used with Xen network bridging
at this time, the bridging can't handle IPoIB ARP addresses.

Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems
 

> -----Original Message-----
> From: G.O. [mailto:gurhan.ozen at gmail.com] 
> Sent: Monday, June 04, 2007 11:47 AM
> To: Michael S. Tsirkin
> Cc: Scott Weitzenkamp (sweitzen); EWG; openib
> Subject: Re: [ofa-general] does RHEL5 Xen work with OFED?
> 
> Hi Michael,
> I am getting "Device ib0 does not seem to be present, delaying
> initialization." warning.
> I tried creating a new network-bridge by using ib0 interface  on Dom-0
> as the net device as well but didn't work.
> 
> Thanks,
> gurhan
> 
> 
> On 4/12/07, G. O. <gurhan.ozen at gmail.com> wrote:
> > On 4/12/07, Michael S. Tsirkin <mst at dev.mellanox.co.il> wrote:
> > > > Quoting G.O. <gurhan.ozen at gmail.com>:
> > > > Subject: Re: [ofa-general] does RHEL5 Xen work with OFED?
> > > >
> > > > On 4/10/07, Michael S. Tsirkin <mst at dev.mellanox.co.il> wrote:
> > > > >> Quoting G.O. <gurhan.ozen at gmail.com>:
> > > > >> Subject: Re: [ofa-general] does RHEL5 Xen work with OFED?
> > > > >>
> > > > >> On 4/5/07, Scott Weitzenkamp (sweitzen) 
> <sweitzen at cisco.com> wrote:
> > > > >> >Can I access OFED IPoIB and SRP/iSER devices from 
> within a Xen virtual
> > > > >> >machine?
> > > > >> >
> > > > >>
> > > > >>    I haven't tested SRP/iSER , but IPoIB works only 
> on dom0 kernel.
> > > > >> You can't use any  infiniband stuff on the guest OSes .
> > > > >>
> > > > >>   Gurhan
> > > > >
> > > > >What doesn't work? I would expect both IPoIB and SRP
> > > > >behave in more or less the same way as any network/storage
> > > > >devices, and get virtualized by Xen.
> > > > >
> > > >
> > > >    Nothing works. Guest kernel didn't even create
> > > > /sys/class/infiniband/* files.  'Far as the guest 
> kernel is concerned,
> > > > HCA doesn't even seem to exist.
> > > >
> > > >   Just as a FYI, I have only tried on paravirtualized 
> guests, didn't
> > > > try it with fully-virtualized guests.
> > >
> > > Why would you want to see /sys/class/infiniband/?
> > > There things are only there for direct HW access, guests 
> do not get that.
> > >
> > > You should be able to use SRP and IPoIB - you set it up 
> in host (dom0)
> > > and guests use it as any other network/storage device through the
> > > virtualization layer.
> > >
> >
> >    Hi Michael,
> >   IIRC, i had got the "can't find device, initialization delayed"
> > errors. I'll play around with it again with the GA release 
> when I get
> > a chance and will let you know. Might happen as early as next week.
> >
> >    Thanks,
> >    Gurhan
> > >
> > > --
> > > MST
> > >
> >
>