[ofa-general] Re: Cannot get MSI-X verctors on RHEL5-up1

[Eli Cohen]

I opened a bug in Redhat bugzilla:

https://bugzilla.redhat.com/show_bug.cgi?id=438330

On Thu, 2008-03-20 at 14:31 +0200, Tziporet Koren wrote:
> Hi Doug,
> 
> We found that on RHEL5 up1 we do not succeed to get MSI-X vectors with for ConnectX with the mlx4 driver.
> Note that on RHEL5 we do get them.
> 
> Any help will be appreciated.
> 
> Thanks
> Tziporet
> 
> This is the output of lspci -vv so you can see that the MSI-X is available by the device
> 
> 13:00.0 InfiniBand: Mellanox Technologies MT25418 [ConnectX IB DDR] (rev a0)
>         Subsystem: Mellanox Technologies MT25418 [ConnectX IB DDR]
>         Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR- FastB2B-
>         Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR-
>         Latency: 0, Cache Line Size: 64 bytes
>         Interrupt: pin A routed to IRQ 177
>         Region 0: Memory at fdf00000 (64-bit, non-prefetchable) [size=1M]
>         Region 2: Memory at f7000000 (64-bit, prefetchable) [size=8M]
>         Region 4: Memory at fdef0000 (64-bit, non-prefetchable) [size=8K]
>         Capabilities: [40] Power Management version 3
>                 Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
>                 Status: D0 PME-Enable- DSel=0 DScale=0 PME-
>         Capabilities: [48] Vital Product Data
>         Capabilities: [9c] MSI-X: Enable- Mask- TabSize=256
>                 Vector table: BAR=4 offset=00000000
>                 PBA: BAR=4 offset=00001000
>         Capabilities: [60] Express Endpoint IRQ 0
>                 Device: Supported: MaxPayload 256 bytes, PhantFunc 0, ExtTag+
>                 Device: Latency L0s <64ns, L1 unlimited
>                 Device: AtnBtn- AtnInd- PwrInd-
>                 Device: Errors: Correctable- Non-Fatal+ Fatal+ Unsupported-
>                 Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
>                 Device: MaxPayload 256 bytes, MaxReadReq 4096 bytes
>                 Link: Supported Speed 2.5Gb/s, Width x8, ASPM L0s, Port 8
>                 Link: Latency L0s unlimited, L1 unlimited
>                 Link: ASPM Disabled RCB 64 bytes CommClk- ExtSynch-
>                 Link: Speed 2.5Gb/s, Width x8
>