[ofa-general] Infiniband with Xen

Roland Dreier rdreier at cisco.com
Wed May 20 13:55:49 PDT 2009


 > I'm currently working on the latest version of xen with debian (lenny), and I have done 2 PCI passthrough, the fisrt one is with eth1 and i got no probleme with this one, but the second one is with a infiniband adapter ( MT23108 Cougar revision A1,latest firmware 3.5) => It's not working
 > I got this message with dmesg on my DomU :
 > 
 > [    4.111023] ib_mthca: Mellanox InfiniBand HCA driver v1.0 (April 4, 2008)
 > [    4.111047] ib_mthca: Initializing 0000:00:00.0
 > [    4.111501] ib_mthca 0000:00:00.0: enabling device (0000 -> 0002)
 > [    4.112859] ib_mthca 0000:00:00.0: No bridge found for 0000:00:00.0
 > [   15.526745] ib_mthca 0000:00:00.0: PCI device did not come back after reset, aborting.
 > [   15.526765] ib_mthca 0000:00:00.0: Failed to reset HCA, aborting.
 > 
 > Do you know if there is a solution like previously with XEN smartio or Xen-IB  (wich is no more developped) to do  High Performance VMM-Bypass I/O in Virtual Machines.

I'm not sure about smartio or Xen-IB, but you could try assigning both
HCA PCI devices to your domU and see if it works better (the HCA should
appear in lspci as both a PCI bridge and an actual HCA device, and the
driver expects to find both)

 - R.



More information about the general mailing list