[openib-general] Re: NOP problem in ib_mthca on OFED RC4

Michael S. Tsirkin mst at mellanox.co.il
Sun May 28 00:18:39 PDT 2006


Quoting r. Don.Albert at bull.com <Don.Albert at bull.com>:
> Subject: Re: NOP problem in ib_mthca on OFED RC4
> 
> 
> Michael,
> 
> Sorry for the long delay in replying,  I was on vacation for 10 days,  then
> when I returned, the OFED RC5 release was imminent, so I decided to wait to
> install it before persuing this further.  Of course, when I did, the problem
> mysteriously went away.   The ib_mthca module now initializes correctly on
> both EM64T machines.  I noticed some discussion between you and Roland about
> making the parameter "fw_cmd_doorbell=0" the default.  Did this occur in RC5?

Yes, we changed fw_cmd_doorbell to 0 by default for now because it seemed
safer. I expect if you load mthca with fw_cmd_doorbell=1 you still get an
error, isn't that right?


> >
> > Could you please give more detail on the exact system that had/has
> > this problem? Model, chipset revision, full lspci -v output, etc.
> > --
> > MST
> 
> In case the problem comes back again with RC6, below is some information on the machine that had the problem.
> 
>   -Don Albert-
> 
> 
> MODEL x86_64   [type=x86_64]
> CPU   4 x Intel(R) Xeon(TM) CPU 3.00GHz, 64 bits  2992.628 Mhz
> MEM   2055516 kB  real memory
> FIRM  e820
> OS    Red Hat Enterprise Linux AS release 4 (Nahant Update 3) - kernel 2.6.16
> 
> [jatoba] (ib) ib> /sbin/lspci -v
> pcilib: Resource 2 in /sys/bus/pci/devices/0000:03:00.0/resource has a 64-bit address, ignoring
> 00:00.0 Host bridge: Intel Corporation E7525 Memory Controller Hub (rev 0c)
>         Subsystem: Intel Corporation: Unknown device 3444
>         Flags: bus master, fast devsel, latency 0
>         Capabilities: [40] Vendor Specific Information
> 
> 00:00.1 Class ff00: Intel Corporation E7525/E7520 Error Reporting Registers (rev 0c)
>         Subsystem: Intel Corporation: Unknown device 3444
>         Flags: fast devsel
> 
> 00:02.0 PCI bridge: Intel Corporation E7525/E7520/E7320 PCI Express Port A (rev 0c) (prog-if 00 [Normal decode])
>         Flags: bus master, fast devsel, latency 0
>         Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
>         Capabilities: [50] Power Management version 2
>         Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1 Enable-
>         Capabilities: [64] Express Root Port (Slot-) IRQ 0
>         Capabilities: [100] Advanced Error Reporting
> 
> 00:03.0 PCI bridge: Intel Corporation E7525/E7520/E7320 PCI Express Port A1 (rev 0c) (prog-if 00 [Normal decode])
>         Flags: bus master, fast devsel, latency 0
>         Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
>         Capabilities: [50] Power Management version 2
>         Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1 Enable-
>         Capabilities: [64] Express Root Port (Slot-) IRQ 0
>         Capabilities: [100] Advanced Error Reporting
> 
> 00:04.0 PCI bridge: Intel Corporation E7525/E7520 PCI Express Port B (rev 0c) (prog-if 00 [Normal decode])
>         Flags: bus master, fast devsel, latency 0
>         Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
>         Memory behind bridge: ded00000-dedfffff
>         Prefetchable memory behind bridge: 00000000ff800000-00000000fff00000
>         Capabilities: [50] Power Management version 2
>         Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1 Enable-
>         Capabilities: [64] Express Root Port (Slot+) IRQ 0
>         Capabilities: [100] Advanced Error Reporting
> 
> 00:1c.0 PCI bridge: Intel Corporation 6300ESB 64-bit PCI-X Bridge (rev 02) (prog-if 00 [Normal decode])
>         Flags: bus master, 66Mhz, fast devsel, latency 64
>         Bus: primary=00, secondary=04, subordinate=04, sec-latency=48
>         Memory behind bridge: dee00000-deefffff
>         Capabilities: [50] PCI-X bridge device.
> 
> 00:1d.0 USB Controller: Intel Corporation 6300ESB USB Universal Host Controller (rev 02) (prog-if 00 [UHCI])
>         Subsystem: Intel Corporation: Unknown device 3444
>         Flags: bus master, medium devsel, latency 0, IRQ 169
>         I/O ports at d880 [size=32]
> 
> 00:1d.1 USB Controller: Intel Corporation 6300ESB USB Universal Host Controller (rev 02) (prog-if 00 [UHCI])
>         Subsystem: Intel Corporation: Unknown device 3444
>         Flags: bus master, medium devsel, latency 0, IRQ 201
>         I/O ports at dc00 [size=32]
> 
> 00:1d.4 System peripheral: Intel Corporation 6300ESB Watchdog Timer (rev 02)
>         Subsystem: Intel Corporation: Unknown device 3444
>         Flags: medium devsel
>         Memory at decff800 (32-bit, non-prefetchable) [size=16]
> 
> 00:1d.5 PIC: Intel Corporation 6300ESB I/O Advanced Programmable Interrupt Controller (rev 02) (prog-if 20 [IO(X)-APIC])
>         Subsystem: Intel Corporation: Unknown device 3444
>         Flags: bus master, fast devsel, latency 0
>         Capabilities: [50] PCI-X non-bridge device.
> 
> 00:1d.7 USB Controller: Intel Corporation 6300ESB USB2 Enhanced Host Controller (rev 02) (prog-if 20 [EHCI])
>         Subsystem: Intel Corporation: Unknown device 3444
>         Flags: bus master, medium devsel, latency 0, IRQ 193
>         Memory at decffc00 (32-bit, non-prefetchable) [size=1K]
>         Capabilities: [50] Power Management version 2
>         Capabilities: [58] Debug port
> 
> 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 0a) (prog-if 00 [Normal decode])
>         Flags: bus master, fast devsel, latency 0
>         Bus: primary=00, secondary=05, subordinate=05, sec-latency=32
>         I/O behind bridge: 0000e000-0000efff
>         Memory behind bridge: def00000-dfffffff
>         Prefetchable memory behind bridge: 88000000-880fffff
> 
> 00:1f.0 ISA bridge: Intel Corporation 6300ESB LPC Interface Controller (rev 02)
>         Flags: bus master, medium devsel, latency 0
> 
> 00:1f.1 IDE interface: Intel Corporation 6300ESB PATA Storage Controller (rev 02) (prog-if 8a [Master SecP PriP])
>         Subsystem: Intel Corporation: Unknown device 3444
>         Flags: bus master, medium devsel, latency 0, IRQ 185
>         I/O ports at <unassigned>
>         I/O ports at <unassigned>
>         I/O ports at <unassigned>
>         I/O ports at <unassigned>
>         I/O ports at fc00 [size=16]
>         Memory at 88100000 (32-bit, non-prefetchable) [size=1K]
> 
> 00:1f.2 IDE interface: Intel Corporation 6300ESB SATA Storage Controller (rev 02) (prog-if 8f [Master SecP SecO PriP PriO])
>         Subsystem: Intel Corporation: Unknown device 3444
>         Flags: bus master, 66Mhz, medium devsel, latency 0, IRQ 185
>         I/O ports at d800 [size=8]
>         I/O ports at d480 [size=4]
>         I/O ports at d400 [size=8]
>         I/O ports at d080 [size=4]
>         I/O ports at d000 [size=16]
> 
> 00:1f.3 SMBus: Intel Corporation 6300ESB SMBus Controller (rev 02)
>         Subsystem: Intel Corporation: Unknown device 3444
>         Flags: medium devsel, IRQ 11
>         I/O ports at 0400 [size=32]
> 
> 03:00.0 InfiniBand: Mellanox Technologies MT25204 [InfiniHost III Lx HCA] (rev 20)
>         Subsystem: Mellanox Technologies MT25204 [InfiniHost III Lx HCA]
>         Flags: bus master, fast devsel, latency 0, IRQ 169
>         Memory at ded00000 (64-bit, non-prefetchable) [size=1M]
>         Memory at <ignored> (64-bit, prefetchable)
>         Capabilities: [40] Power Management version 2
>         Capabilities: [48] Vital Product Data
>         Capabilities: [90] Message Signalled Interrupts: 64bit+ Queue=0/5 Enable-
>         Capabilities: [84] MSI-X: Enable- Mask- TabSize=32
>         Capabilities: [60] Express Endpoint IRQ 0
> 
> 04:02.0 Ethernet controller: Alteon Networks Inc. AceNIC Gigabit Ethernet (rev 01)
>         Subsystem: IBM Gigabit Ethernet-SX PCI Adapter
>         Flags: bus master, 66Mhz, medium devsel, latency 64, IRQ 177
>         Memory at deefc000 (32-bit, non-prefetchable) [size=16K]
> 
> 05:02.0 VGA compatible controller: ATI Technologies Inc Rage XL (rev 27) (prog-if 00 [VGA])
>         Subsystem: Intel Corporation: Unknown device 3444
>         Flags: bus master, stepping, medium devsel, latency 64, IRQ 11
>         Memory at df000000 (32-bit, non-prefetchable) [size=16M]
>         I/O ports at e800 [size=256]
>         Memory at defff000 (32-bit, non-prefetchable) [size=4K]
>         Expansion ROM at 88000000 [disabled] [size=128K]
>         Capabilities: [5c] Power Management version 2
> 
> 

-- 
MST



More information about the general mailing list