[openib-general] has anyone tried MSI-X on Opteron?

[Hal Rosenstock]

On Thu, 2005-01-13 at 04:02, Tziporet Koren wrote:
> Hi,
> 
> We are seeing problems (not getting the interrupt) when trying to work
> with MSIX on Opteron with Fedora core3.
> Has anyone tried this?

Which FC3 ? I am also using FC3 (for x86_64 dated 11/3) but I installed
2.6.10 and added the OpenIB changes. It is not the latest one mentioned
on the list which includes OpenIB; it is the one before that.
Is that what you are using ? Is it based on 2.6.10-bk5 ?

I do get what could be the same issue when I modprobe mthca with msi_x =
1 on Opteron. The modprobe takes a long time to complete and dmesg
shows:
ib_mthca: Mellanox InfiniBand HCA driver v0.06-pre (November 8, 2004)
ib_mthca: Initializing  (0000:04:00.0)
ACPI: PCI interrupt 0000:04:00.0[A] -> GSI 27 (level, low) -> IRQ 201
MSI INIT SUCCESS
(long delay; several minutes)
ib_mthca 0000:02:00.0: Failed to initialize queue pair table, aborting.
ib_mthca: probe of 0000:02:00.0 failed with error -16

lspci shows:
02:00.0 InfiniBand: Mellanox Technology MT23108 InfiniHost (rev a1)
        Subsystem: Mellanox Technology MT23108 InfiniHost
        Flags: bus master, 66Mhz, medium devsel, latency 64, IRQ 209
        Memory at fc500000 (64-bit, non-prefetchable) [size=1M]
        Memory at ea800000 (64-bit, prefetchable) [size=8M]
        Memory at e0000000 (64-bit, prefetchable) [size=128M]
        Capabilities: [40] MSI-X: Enable+ Mask- TabSize=32
        Capabilities: [50] Vital Product Data
        Capabilities: [60] Message Signalled Interrupts: 64bit+ Queue=0/5 Enable-
        Capabilities: [70] PCI-X non-bridge device.

-- Hal