[ofa-general] Infiniband with Xen

[anthony garnier]

HI,
I have tried to also to passthrough the pci bridge but It doesn't work, I got that with de dmesg on my Dom0 :

 1297.293367] pciback: vpci: 0000:04:00.0: assign to virtual slot 0     ( this is  HCA)
[ 1297.295538] pciback: vpci: 0000:03:07.1: assign to virtual slot 1    ( This is eth1)
[ 1297.298346] pciback: vpci: 0000:03:08.0: assign to virtual slot 2     ( this is the HCA bridge)
[ 1298.655743] pciback 0000:03:08.0: Driver tried to write to a read-only configuration space field at offset 0x3e, size 2. This may be harmless, but if you have problems with your device:
[ 1298.655747] 1) see permissive attribute in sysfs
[ 1298.655749] 2) report problems to the xen-devel mailing list along with details of your device obtained from lspci.


> From: rdreier at cisco.com
> To: sokar6012 at hotmail.com
> CC: general at lists.openfabrics.org
> Subject: Re: [ofa-general] Infiniband with Xen
> Date: Wed, 20 May 2009 13:55:49 -0700
> 
>  > I'm currently working on the latest version of xen with debian (lenny), and I have done 2 PCI passthrough, the fisrt one is with eth1 and i got no probleme with this one, but the second one is with a infiniband adapter ( MT23108 Cougar revision A1,latest firmware 3.5) => It's not working
>  > I got this message with dmesg on my DomU :
>  > 
>  > [    4.111023] ib_mthca: Mellanox InfiniBand HCA driver v1.0 (April 4, 2008)
>  > [    4.111047] ib_mthca: Initializing 0000:00:00.0
>  > [    4.111501] ib_mthca 0000:00:00.0: enabling device (0000 -> 0002)
>  > [    4.112859] ib_mthca 0000:00:00.0: No bridge found for 0000:00:00.0
>  > [   15.526745] ib_mthca 0000:00:00.0: PCI device did not come back after reset, aborting.
>  > [   15.526765] ib_mthca 0000:00:00.0: Failed to reset HCA, aborting.
>  > 
>  > Do you know if there is a solution like previously with XEN smartio or Xen-IB  (wich is no more developped) to do  High Performance VMM-Bypass I/O in Virtual Machines.
> 
> I'm not sure about smartio or Xen-IB, but you could try assigning both
> HCA PCI devices to your domU and see if it works better (the HCA should
> appear in lspci as both a PCI bridge and an actual HCA device, and the
> driver expects to find both)
> 
>  - R.

_________________________________________________________________
Découvrez toutes les possibilités de communication avec vos proches
http://www.microsoft.com/windows/windowslive/default.aspx
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20090521/43735507/attachment.html>