[openfabrics-ewg] Re: NOP problem in ib_mthca on OFED RC4
Michael S. Tsirkin
mst at mellanox.co.il
Sun May 28 00:18:39 PDT 2006
Quoting r. Don.Albert at bull.com <Don.Albert at bull.com>:
> Subject: Re: NOP problem in ib_mthca on OFED RC4
>
>
> Michael,
>
> Sorry for the long delay in replying, I was on vacation for 10 days, then
> when I returned, the OFED RC5 release was imminent, so I decided to wait to
> install it before persuing this further. Of course, when I did, the problem
> mysteriously went away. The ib_mthca module now initializes correctly on
> both EM64T machines. I noticed some discussion between you and Roland about
> making the parameter "fw_cmd_doorbell=0" the default. Did this occur in RC5?
Yes, we changed fw_cmd_doorbell to 0 by default for now because it seemed
safer. I expect if you load mthca with fw_cmd_doorbell=1 you still get an
error, isn't that right?
> >
> > Could you please give more detail on the exact system that had/has
> > this problem? Model, chipset revision, full lspci -v output, etc.
> > --
> > MST
>
> In case the problem comes back again with RC6, below is some information on the machine that had the problem.
>
> -Don Albert-
>
>
> MODEL x86_64 [type=x86_64]
> CPU 4 x Intel(R) Xeon(TM) CPU 3.00GHz, 64 bits 2992.628 Mhz
> MEM 2055516 kB real memory
> FIRM e820
> OS Red Hat Enterprise Linux AS release 4 (Nahant Update 3) - kernel 2.6.16
>
> [jatoba] (ib) ib> /sbin/lspci -v
> pcilib: Resource 2 in /sys/bus/pci/devices/0000:03:00.0/resource has a 64-bit address, ignoring
> 00:00.0 Host bridge: Intel Corporation E7525 Memory Controller Hub (rev 0c)
> Subsystem: Intel Corporation: Unknown device 3444
> Flags: bus master, fast devsel, latency 0
> Capabilities: [40] Vendor Specific Information
>
> 00:00.1 Class ff00: Intel Corporation E7525/E7520 Error Reporting Registers (rev 0c)
> Subsystem: Intel Corporation: Unknown device 3444
> Flags: fast devsel
>
> 00:02.0 PCI bridge: Intel Corporation E7525/E7520/E7320 PCI Express Port A (rev 0c) (prog-if 00 [Normal decode])
> Flags: bus master, fast devsel, latency 0
> Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
> Capabilities: [50] Power Management version 2
> Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1 Enable-
> Capabilities: [64] Express Root Port (Slot-) IRQ 0
> Capabilities: [100] Advanced Error Reporting
>
> 00:03.0 PCI bridge: Intel Corporation E7525/E7520/E7320 PCI Express Port A1 (rev 0c) (prog-if 00 [Normal decode])
> Flags: bus master, fast devsel, latency 0
> Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
> Capabilities: [50] Power Management version 2
> Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1 Enable-
> Capabilities: [64] Express Root Port (Slot-) IRQ 0
> Capabilities: [100] Advanced Error Reporting
>
> 00:04.0 PCI bridge: Intel Corporation E7525/E7520 PCI Express Port B (rev 0c) (prog-if 00 [Normal decode])
> Flags: bus master, fast devsel, latency 0
> Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
> Memory behind bridge: ded00000-dedfffff
> Prefetchable memory behind bridge: 00000000ff800000-00000000fff00000
> Capabilities: [50] Power Management version 2
> Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1 Enable-
> Capabilities: [64] Express Root Port (Slot+) IRQ 0
> Capabilities: [100] Advanced Error Reporting
>
> 00:1c.0 PCI bridge: Intel Corporation 6300ESB 64-bit PCI-X Bridge (rev 02) (prog-if 00 [Normal decode])
> Flags: bus master, 66Mhz, fast devsel, latency 64
> Bus: primary=00, secondary=04, subordinate=04, sec-latency=48
> Memory behind bridge: dee00000-deefffff
> Capabilities: [50] PCI-X bridge device.
>
> 00:1d.0 USB Controller: Intel Corporation 6300ESB USB Universal Host Controller (rev 02) (prog-if 00 [UHCI])
> Subsystem: Intel Corporation: Unknown device 3444
> Flags: bus master, medium devsel, latency 0, IRQ 169
> I/O ports at d880 [size=32]
>
> 00:1d.1 USB Controller: Intel Corporation 6300ESB USB Universal Host Controller (rev 02) (prog-if 00 [UHCI])
> Subsystem: Intel Corporation: Unknown device 3444
> Flags: bus master, medium devsel, latency 0, IRQ 201
> I/O ports at dc00 [size=32]
>
> 00:1d.4 System peripheral: Intel Corporation 6300ESB Watchdog Timer (rev 02)
> Subsystem: Intel Corporation: Unknown device 3444
> Flags: medium devsel
> Memory at decff800 (32-bit, non-prefetchable) [size=16]
>
> 00:1d.5 PIC: Intel Corporation 6300ESB I/O Advanced Programmable Interrupt Controller (rev 02) (prog-if 20 [IO(X)-APIC])
> Subsystem: Intel Corporation: Unknown device 3444
> Flags: bus master, fast devsel, latency 0
> Capabilities: [50] PCI-X non-bridge device.
>
> 00:1d.7 USB Controller: Intel Corporation 6300ESB USB2 Enhanced Host Controller (rev 02) (prog-if 20 [EHCI])
> Subsystem: Intel Corporation: Unknown device 3444
> Flags: bus master, medium devsel, latency 0, IRQ 193
> Memory at decffc00 (32-bit, non-prefetchable) [size=1K]
> Capabilities: [50] Power Management version 2
> Capabilities: [58] Debug port
>
> 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 0a) (prog-if 00 [Normal decode])
> Flags: bus master, fast devsel, latency 0
> Bus: primary=00, secondary=05, subordinate=05, sec-latency=32
> I/O behind bridge: 0000e000-0000efff
> Memory behind bridge: def00000-dfffffff
> Prefetchable memory behind bridge: 88000000-880fffff
>
> 00:1f.0 ISA bridge: Intel Corporation 6300ESB LPC Interface Controller (rev 02)
> Flags: bus master, medium devsel, latency 0
>
> 00:1f.1 IDE interface: Intel Corporation 6300ESB PATA Storage Controller (rev 02) (prog-if 8a [Master SecP PriP])
> Subsystem: Intel Corporation: Unknown device 3444
> Flags: bus master, medium devsel, latency 0, IRQ 185
> I/O ports at <unassigned>
> I/O ports at <unassigned>
> I/O ports at <unassigned>
> I/O ports at <unassigned>
> I/O ports at fc00 [size=16]
> Memory at 88100000 (32-bit, non-prefetchable) [size=1K]
>
> 00:1f.2 IDE interface: Intel Corporation 6300ESB SATA Storage Controller (rev 02) (prog-if 8f [Master SecP SecO PriP PriO])
> Subsystem: Intel Corporation: Unknown device 3444
> Flags: bus master, 66Mhz, medium devsel, latency 0, IRQ 185
> I/O ports at d800 [size=8]
> I/O ports at d480 [size=4]
> I/O ports at d400 [size=8]
> I/O ports at d080 [size=4]
> I/O ports at d000 [size=16]
>
> 00:1f.3 SMBus: Intel Corporation 6300ESB SMBus Controller (rev 02)
> Subsystem: Intel Corporation: Unknown device 3444
> Flags: medium devsel, IRQ 11
> I/O ports at 0400 [size=32]
>
> 03:00.0 InfiniBand: Mellanox Technologies MT25204 [InfiniHost III Lx HCA] (rev 20)
> Subsystem: Mellanox Technologies MT25204 [InfiniHost III Lx HCA]
> Flags: bus master, fast devsel, latency 0, IRQ 169
> Memory at ded00000 (64-bit, non-prefetchable) [size=1M]
> Memory at <ignored> (64-bit, prefetchable)
> Capabilities: [40] Power Management version 2
> Capabilities: [48] Vital Product Data
> Capabilities: [90] Message Signalled Interrupts: 64bit+ Queue=0/5 Enable-
> Capabilities: [84] MSI-X: Enable- Mask- TabSize=32
> Capabilities: [60] Express Endpoint IRQ 0
>
> 04:02.0 Ethernet controller: Alteon Networks Inc. AceNIC Gigabit Ethernet (rev 01)
> Subsystem: IBM Gigabit Ethernet-SX PCI Adapter
> Flags: bus master, 66Mhz, medium devsel, latency 64, IRQ 177
> Memory at deefc000 (32-bit, non-prefetchable) [size=16K]
>
> 05:02.0 VGA compatible controller: ATI Technologies Inc Rage XL (rev 27) (prog-if 00 [VGA])
> Subsystem: Intel Corporation: Unknown device 3444
> Flags: bus master, stepping, medium devsel, latency 64, IRQ 11
> Memory at df000000 (32-bit, non-prefetchable) [size=16M]
> I/O ports at e800 [size=256]
> Memory at defff000 (32-bit, non-prefetchable) [size=4K]
> Expansion ROM at 88000000 [disabled] [size=128K]
> Capabilities: [5c] Power Management version 2
>
>
--
MST
More information about the ewg
mailing list