[openib-general] ib_mthca segfault with SVN r3984
Grant Grundler
iod00d at hp.com
Tue Nov 8 10:42:26 PST 2005
Hi Roland,
I'm also trying to catch up on 2.6.14 + openib.org r3984.
"modprobe ib_mthca" is segfaulting.
Console output appended from ia64-linux on HP rx2600.
I saw the firmware update message and will take care of that.
I don't expect it's the root cause of the segfault though.
thanks,
grant
Userspace output:
iota:~# reload_ib
+ IPoIB=30
+ ifconfig ib0 down
ib0: ERROR while getting interface flags: No such device
+ ifconfig ib0 down
ib0: ERROR while getting interface flags: No such device
+ rmmod ib_ipoib ib_uverbs ib_sdp ib_cm ib_sa ib_mthca ib_mad ib_core
ERROR: Module ib_ipoib does not exist in /proc/modules
ERROR: Module ib_uverbs does not exist in /proc/modules
ERROR: Module ib_sdp does not exist in /proc/modules
ERROR: Module ib_cm does not exist in /proc/modules
ERROR: Module ib_sa does not exist in /proc/modules
ERROR: Module ib_mthca does not exist in /proc/modules
ERROR: Module ib_mad does not exist in /proc/modules
ERROR: Module ib_core does not exist in /proc/modules
+ modprobe ib_mthca msi_x=1
/usr/local/bin/reload_ib: line 7: 1590 Segmentation fault modprobe ib_mthca msi_x=1
+ modprobe ib_ipoib
+ modprobe ib_sdp
+ modprobe ib_uverbs
+ ifconfig ib0 10.0.0.30 netmask 255.255.255.0 broadcast 10.0.0.255
SIOCSIFADDR: No such device
ib0: ERROR while getting interface flags: No such device
SIOCSIFNETMASK: No such device
SIOCSIFBRDADDR: No such device
ib0: ERROR while getting interface flags: No such device
+ ifconfig ib1 10.0.1.30 netmask 255.255.255.0 broadcast 10.0.1.255
SIOCSIFADDR: No such device
ib1: ERROR while getting interface flags: No such device
SIOCSIFNETMASK: No such device
SIOCSIFBRDADDR: No such device
ib1: ERROR while getting interface flags: No such device
iota:~#
Console output:
Linux version 2.6.14 (grundler at gsyprf3) (gcc version 4.0.2 (Debian 4.0.2-2)) #3 SMP Mon Nov 7 20:56:52 PST 2005
EFI v1.10 by HP: SALsystab=0x3fb38000 ACPI 2.0=0x3fb2e000 SMBIOS=0x3fb3a000 HCDP=0x3fb2c000
ACPI: RSDP (v002 HP ) @ 0x000000003fb2e000
ACPI: XSDT (v001 HP rx2600 0x00000000 HP 0x00000000) @ 0x000000003fb2e02c
ACPI: FADT (v003 HP rx2600 0x00000000 HP 0x00000000) @ 0x000000003fb36800
ACPI: SPCR (v001 HP rx2600 0x00000000 HP 0x00000000) @ 0x000000003fb36938
ACPI: DBGP (v001 HP rx2600 0x00000000 HP 0x00000000) @ 0x000000003fb36988
ACPI: MADT (v001 HP rx2600 0x00000000 HP 0x00000000) @ 0x000000003fb36a48
ACPI: SPMI (v004 HP rx2600 0x00000000 HP 0x00000000) @ 0x000000003fb369c0
ACPI: CPEP (v001 HP rx2600 0x00000000 HP 0x00000000) @ 0x000000003fb36a10
ACPI: SSDT (v001 HP rx2600 0x00000006 INTL 0x02012044) @ 0x000000003fb33870
ACPI: SSDT (v001 HP rx2600 0x00000006 INTL 0x02012044) @ 0x000000003fb33a50
ACPI: SSDT (v001 HP rx2600 0x00000006 INTL 0x02012044) @ 0x000000003fb33da0
ACPI: SSDT (v001 HP rx2600 0x00000006 INTL 0x02012044) @ 0x000000003fb347c0
ACPI: SSDT (v001 HP rx2600 0x00000006 INTL 0x02012044) @ 0x000000003fb351e0
ACPI: SSDT (v001 HP rx2600 0x00000006 INTL 0x02012044) @ 0x000000003fb35c00
ACPI: SSDT (v001 HP rx2600 0x00000006 INTL 0x02012044) @ 0x000000003fb36620
ACPI: SSDT (v001 HP rx2600 0x00000006 INTL 0x02012044) @ 0x000000003fb36710
ACPI: DSDT (v001 HP rx2600 0x00000007 INTL 0x02012044) @ 0x0000000000000000
warning: skipping physical page 0
SAL 3.1: HP version 2.21
SAL Platform features: None
SAL: AP wakeup using external interrupt vector 0xff
No logical to physical processor mapping available
ACPI: Local APIC address c0000000fee00000
GSI 36 (level, low) -> CPU 0 (0x0000) vector 48
2 CPUs available, 2 CPUs total
MCA related initialization done
On node 0 totalpages: 130372
DMA zone: 130372 pages, LIFO batch:7
Normal zone: 0 pages, LIFO batch:1
HighMem zone: 0 pages, LIFO batch:1
Virtual mem_map starts at 0xa0007fffc7900000
Built 1 zonelists
Kernel command line: BOOT_IMAGE=scsi0:/EFI/debian/boot/vmlinuz-2.6.14 root=/dev/sda3 console=ttyS0,115200 ro
PID hash table entries: 4096 (order: 12, 131072 bytes)
CPU 0: base freq=200.000MHz, ITC ratio=15/2, ITC freq=1500.000MHz+/-750ppm
Console: colour dummy device 80x25
Dentry cache hash table entries: 262144 (order: 7, 2097152 bytes)
Inode-cache hash table entries: 131072 (order: 6, 1048576 bytes)
Memory: 2062672k/2085952k available (7764k code, 22672k reserved, 3329k data, 272k init)
McKinley Errata 9 workaround not needed; disabling it
Calibrating delay loop... 2244.60 BogoMIPS (lpj=4489216)
Mount-cache hash table entries: 1024
Boot processor id 0x0/0x0
softlockup thread 0 started up.
CPU 1: synchronized ITC with CPU 0 (last diff 5 cycles, maxerr 605 cycles)
CPU 1: base freq=200.000MHz, ITC ratio=15/2, ITC freq=1500.000MHz+/-750ppm
Calibrating delay loop... 2244.60 BogoMIPS (lpj=4489216)
Brought up 2 CPUs
Total of 2 processors activated (4489.21 BogoMIPS).
softlockup thread 1 started up.
NET: Registered protocol family 16
ACPI: bus type pci registered
ACPI: Subsystem revision 20050902
ACPI: Interpreter enabled
ACPI: Using IOSAPIC for interrupt routing
ACPI: PCI Root Bridge [PCI0] (0000:00)
ACPI: PCI Interrupt Routing Table [\_SB_.SBA0.PCI0._PRT]
ACPI: PCI Root Bridge [PCI1] (0000:20)
ACPI: PCI Interrupt Routing Table [\_SB_.SBA0.PCI1._PRT]
ACPI: PCI Root Bridge [PCI2] (0000:40)
ACPI: PCI Interrupt Routing Table [\_SB_.SBA0.PCI2._PRT]
ACPI: PCI Root Bridge [PCI3] (0000:60)
ACPI: PCI Interrupt Routing Table [\_SB_.SBA0.PCI3._PRT]
ACPI: PCI Root Bridge [PCI4] (0000:80)
ACPI: PCI Interrupt Routing Table [\_SB_.SBA0.PCI4._PRT]
ACPI: PCI Root Bridge [PCI6] (0000:c0)
ACPI: PCI Interrupt Routing Table [\_SB_.SBA0.PCI6._PRT]
Generic PHY: Registered new driver
SCSI subsystem initialized
usbcore: registered new driver usbfs
usbcore: registered new driver hub
IOC: zx1 2.2 HPA 0xfed01000 IOVA space 1024Mb at 0x40000000
perfmon: version 2.0 IRQ 238
perfmon: Itanium 2 PMU detected, 16 PMCs, 18 PMDs, 4 counters (47 bits)
PAL Information Facility v0.5
perfmon: added sampling format default_format
perfmon_default_smpl: default_format v2.0 registered
Total HugeTLB memory allocated, 0
Installing knfsd (copyright (C) 1996 okir at monad.swb.de).
Initializing Cryptographic API
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
ACPI: Power Button (FF) [PWRF]
ACPI: Sleep Button (FF) [SLPF]
ACPI: CPU0 (power states: C1[C1])
ACPI: CPU1 (power states: C1[C1])
ACPI: Thermal Zone [THM0] (27 C)
EFI Time Services Driver v0.4
Linux agpgart interface v0.101 (c) Dave Jones
Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing disabled
GSI 34 (edge, high) -> CPU 0 (0x0000) vector 49
ttyS0 at MMIO 0xff5e0000 (irq = 49) is a 16550A
GSI 35 (edge, high) -> CPU 1 (0x0100) vector 50
ttyS1 at MMIO 0xff5e2000 (irq = 50) is a 16550A
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered
RAMDISK driver initialized: 16 RAM disks of 4096K size 1024 blocksize
loop: loaded (max 8 devices)
pktcdvd: v0.2.0a 2004-07-14 Jens Axboe (axboe at suse.de) and petero2 at telia.com
Ethernet Channel Bonding Driver: v2.6.4 (September 26, 2005)
bonding: Warning: either miimon or arp_interval and arp_ip_target module parameters must be specified, otherwise bonding will not detect link failures! see bonding.txt for details.
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
CMD649: IDE controller at PCI slot 0000:00:02.0
GSI 21 (level, low) -> CPU 0 (0x0000) vector 51
ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 21 (level, low) -> IRQ 51
CMD649: chipset revision 2
CMD649: 100% native mode on irq 51
ide0: BM-DMA at 0x0d40-0x0d47, BIOS settings: hda:pio, hdb:pio
ide1: BM-DMA at 0x0d48-0x0d4f, BIOS settings: hdc:pio, hdd:pio
Probing IDE interface ide0...
hda: DV-28E-A, ATAPI CD/DVD-ROM drive
ide0 at 0xd58-0xd5f,0xd66 on irq 51
Probing IDE interface ide1...
hda: ATAPI 24X DVD-ROM drive, 512kB Cache, UDMA(33)
Uniform CD-ROM driver Revision: 3.20
Fusion MPT base driver 3.03.03
Copyright (c) 1999-2005 LSI Logic Corporation
Fusion MPT SPI Host driver 3.03.03
GSI 27 (level, low) -> CPU 1 (0x0100) vector 52
ACPI: PCI Interrupt 0000:20:01.0[A] -> GSI 27 (level, low) -> IRQ 52
mptbase: Initiating ioc0 bringup
ioc0: 53C1030: Capabilities={Initiator}
scsi0 : ioc0: LSI53C1030, FwRev=01030600h, Ports=1, MaxQ=255, IRQ=52
Vendor: HP 73.4G Model: ST373453LC Rev: HPC3
Type: Direct-Access ANSI SCSI revision: 03
SCSI device sda: 143374738 512-byte hdwr sectors (73408 MB)
SCSI device sda: drive cache: write through
SCSI device sda: 143374738 512-byte hdwr sectors (73408 MB)
SCSI device sda: drive cache: write through
sda: sda1 sda2 sda3
Attached scsi disk sda at scsi0, channel 0, id 0, lun 0
Vendor: HP 73.4G Model: ST373453LC Rev: HPC3
Type: Direct-Access ANSI SCSI revision: 03
SCSI device sdb: 143374738 512-byte hdwr sectors (73408 MB)
SCSI device sdb: drive cache: write through
SCSI device sdb: 143374738 512-byte hdwr sectors (73408 MB)
SCSI device sdb: drive cache: write through
sdb: sdb1 sdb2
Attached scsi disk sdb at scsi0, channel 0, id 1, lun 0
GSI 28 (level, low) -> CPU 0 (0x0000) vector 53
ACPI: PCI Interrupt 0000:20:01.1[B] -> GSI 28 (level, low) -> IRQ 53
mptbase: Initiating ioc1 bringup
ioc1: 53C1030: Capabilities={Initiator}
scsi1 : ioc1: LSI53C1030, FwRev=01030600h, Ports=1, MaxQ=255, IRQ=53
Vendor: HP 73.4G Model: ST373453LC Rev: HPC3
Type: Direct-Access ANSI SCSI revision: 03
SCSI device sdc: 143374738 512-byte hdwr sectors (73408 MB)
SCSI device sdc: drive cache: write through
SCSI device sdc: 143374738 512-byte hdwr sectors (73408 MB)
SCSI device sdc: drive cache: write through
sdc: unknown partition table
Attached scsi disk sdc at scsi1, channel 0, id 2, lun 0
GSI 18 (level, low) -> CPU 1 (0x0100) vector 54
ACPI: PCI Interrupt 0000:00:01.2[C] -> GSI 18 (level, low) -> IRQ 54
ehci_hcd 0000:00:01.2: EHCI Host Controller
ehci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:01.2: irq 54, io mem 0x80021000
ehci_hcd 0000:00:01.2: USB 2.0 initialized, EHCI 0.95, driver 10 Dec 2004
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 5 ports detected
ohci_hcd: 2005 April 22 USB 1.1 'Open' Host Controller (OHCI) Driver (PCI)
GSI 16 (level, low) -> CPU 0 (0x0000) vector 55
ACPI: PCI Interrupt 0000:00:01.0[A] -> GSI 16 (level, low) -> IRQ 55
ohci_hcd 0000:00:01.0: OHCI Host Controller
ohci_hcd 0000:00:01.0: new USB bus registered, assigned bus number 2
ohci_hcd 0000:00:01.0: irq 55, io mem 0x80023000
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 3 ports detected
GSI 17 (level, low) -> CPU 1 (0x0100) vector 56
ACPI: PCI Interrupt 0000:00:01.1[B] -> GSI 17 (level, low) -> IRQ 56
ohci_hcd 0000:00:01.1: OHCI Host Controller
ohci_hcd 0000:00:01.1: new USB bus registered, assigned bus number 3
ohci_hcd 0000:00:01.1: irq 56, io mem 0x80022000
hub 3-0:1.0: USB hub found
hub 3-0:1.0: 2 ports detected
USB Universal Host Controller Interface driver v2.3
usbcore: registered new driver hiddev
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.6:USB HID core driver
mice: PS/2 mouse device common for all mice
EFI Variables Facility v0.08 2004-May-17
NET: Registered protocol family 2
IP route cache hash table entries: 65536 (order: 5, 524288 bytes)
TCP established hash table entries: 262144 (order: 8, 4194304 bytes)
TCP bind hash table entries: 65536 (order: 6, 1048576 bytes)
TCP: Hash tables configured (established 262144 bind 65536)
TCP reno registered
TCP bic registered
NET: Registered protocol family 1
NET: Registered protocol family 17
SCTP: Hash tables configured (established 65536 bind 65536)
kjournald starting. Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
VFS: Mounted root (ext3 filesystem) readonly.
Freeing unused kernel memory: 272kB freed
Adding 1022944k swap on /dev/sda2. Priority:-1 extents:1 across:1022944k
EXT3 FS on sda3, internal journal
e100: Intel(R) PRO/100 Network Driver, 3.4.14-k2-NAPI
e100: Copyright(c) 1999-2005 Intel Corporation
GSI 20 (level, low) -> CPU 0 (0x0000) vector 57
ACPI: PCI Interrupt 0000:00:03.0[A] -> GSI 20 (level, low) -> IRQ 57
e100: eth0: e100_probe: addr 0x80020000, irq 57, MAC addr 00:30:6E:1E:CE:16
tg3.c:v3.42 (Oct 3, 2005)
GSI 29 (level, low) -> CPU 1 (0x0100) vector 58
ACPI: PCI Interrupt 0000:20:02.0[A] -> GSI 29 (level, low) -> IRQ 58
eth1: Tigon3 [partno(BCM95700A6) rev 0105 PHY(5701)] (PCI:66MHz:64-bit) 10/100/1000BaseT Ethernet 00:30:6e:1e:de:01
eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] Split[0] WireSpeed[1] TSOcap[0]
eth1: dma_rwctrl[76ff2d0f]
GSI 71 (level, low) -> CPU 0 (0x0000) vector 59
ACPI: PCI Interrupt 0000:c0:01.0[A] -> GSI 71 (level, low) -> IRQ 59
eth2: Tigon3 [partno(A6847-60001) rev 0105 PHY(serdes)] (PCI:66MHz:64-bit) 10/100/1000BaseT Ethernet 00:04:76:df:ba:99
eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] Split[0] WireSpeed[0] TSOcap[0]
eth2: dma_rwctrl[76ff2d0f]
Intel(R) PRO/1000 Network Driver - version 6.0.60-k2-NAPI
Copyright (c) 1999-2005 Intel Corporation.
Linux Tulip driver version 1.1.13-NAPI (May 11, 2002)
e100: eth0: e100_watchdog: link up, 100Mbps, full-duplex
tg3: eth1: Link is up at 1000 Mbps, full duplex.
tg3: eth1: Flow control is off for TX and off for RX.
tar(1403): unaligned access to 0x60000fffffac34c4, ip=0x200000000028ba01
tar(1403): unaligned access to 0x60000fffffac34c4, ip=0xa0000001006426f0
tar(1403): unaligned access to 0x60000fffffac34c4, ip=0x200000000028bad1
tar(1403): unaligned access to 0x60000fffffac34b4, ip=0x200000000028ba01
sshd(1569): unaligned access to 0x60000fffffcceb44, ip=0x20000000007ffa01
sshd(1569): unaligned access to 0x60000fffffcceb44, ip=0xa0000001006426f0
sshd(1569): unaligned access to 0x60000fffffcceb44, ip=0x20000000007ffad1
sshd(1569): unaligned access to 0x60000fffffccc184, ip=0x20000000007ffa01
su(1575): unaligned access to 0x60000fffffa537a4, ip=0x20000000002e7a01
su(1575): unaligned access to 0x60000fffffa537a4, ip=0xa0000001006426f0
su(1575): unaligned access to 0x60000fffffa537a4, ip=0x20000000002e7ad1
su(1575): unaligned access to 0x60000fffffa52a04, ip=0x20000000002e7a01
cron(1580): unaligned access to 0x60000fffffcb65a4, ip=0x20000000002bfa01
cron(1580): unaligned access to 0x60000fffffcb65a4, ip=0xa0000001006426f0
cron(1580): unaligned access to 0x60000fffffcb65a4, ip=0x20000000002bfad1
cron(1581): unaligned access to 0x60000fffffcb7374, ip=0x20000000002bfa01
ib_mthca: Mellanox InfiniBand HCA driver v0.06 (June 23, 2005)
ib_mthca: Initializing 0000:81:00.0
GSI 60 (level, low) -> CPU 1 (0x0100) vector 60
ACPI: PCI Interrupt 0000:81:00.0[A] -> GSI 60 (level, low) -> IRQ 60
ib_mthca 0000:81:00.0: HCA FW version 3.3.2 is old (3.3.3 is current).
ib_mthca 0000:81:00.0: If you have problems, try updating your HCA FW.
Unable to handle kernel paging request at virtual address 2e414348000003a1
modprobe[1590]: Oops 11012296146944 [1]
Modules linked in: ib_mthca ib_mad ib_core tulip e1000 tg3 e100
Pid: 1590, CPU 1, comm: modprobe
psr : 0000121008526030 ifs : 8000000000000286 ip : [<a0000002000f6d61>] Not tainted
ip is at mthca_uar_alloc+0x81/0xc0 [ib_mthca]
unat: 0000000000000000 pfs : 0000000000000614 rsc : 0000000000000003
rnat: 000000000000000a bsps: a000000100ad8bd0 pr : 55a1404a4659a965
ldrs: 0000000000000000 ccv : 0000000000000007 fpsr: 0009804c8a70433f
csd : 0000000000000000 ssd : 0000000000000000
b0 : a0000002000cc4a0 b6 : a0000001000d53a0 b7 : a00000010000b1c0
f6 : 1003e0000000000000090 f7 : 1003e20c49ba5e353f7cf
f8 : 1003e000000000000046a f9 : 1003e000000000e251ad8
f10 : 1003e0000000035f56b37 f11 : 1003e431bde82d7b634db
r1 : a0000002000e9100 r2 : 000000000000038a r3 : 0000000000000004
r8 : 0000000000000000 r9 : 0000000000000003 r10 : 0000000000000001
r11 : e00000003f542b40 r12 : e000000005757dd0 r13 : e000000005750000
r14 : 2e414348000003a1 r15 : 0000000000000003 r16 : 0000000000000000
r17 : 0000000000000008 r18 : 0000000000000007 r19 : 0000000000000007
r20 : 000000000000000f r21 : 0000000000000007 r22 : 0000000000000000
r23 : e00000407ee3059c r24 : 0000000000000000 r25 : 0000000000000004
r26 : 0000000000000002 r27 : 0000000000000000 r28 : 0000000000000000
r29 : 0000000000000003 r30 : 0000000000000000 r31 : e00000407ee305a8
Call Trace:
[<a000000100012780>] show_stack+0x80/0xa0
sp=e000000005757970 bsp=e0000000057511f0
[<a0000001000130a0>] show_regs+0x900/0x940
sp=e000000005757b40 bsp=e000000005751198
[<a000000100039a10>] die+0x150/0x200
sp=e000000005757b50 bsp=e000000005751150
[<a000000100792e50>] ia64_do_page_fault+0xd30/0xdc0
sp=e000000005757b50 bsp=e000000005751100
[<a00000010000b9c0>] ia64_leave_kernel+0x0/0x280
sp=e000000005757c00 bsp=e000000005751100
[<a0000002000f6d60>] mthca_uar_alloc+0x80/0xc0 [ib_mthca]
sp=e000000005757dd0 bsp=e0000000057510d0
[<a0000002000cc4a0>] mthca_init_one+0x1180/0x2080 [ib_mthca]
sp=e000000005757dd0 bsp=e000000005751070
[<a000000100363410>] pci_device_probe+0xf0/0x160
sp=e000000005757df0 bsp=e000000005751030
[<a000000100499890>] driver_probe_device+0xd0/0x1a0
sp=e000000005757df0 bsp=e000000005750ff0
[<a000000100499b70>] __driver_attach+0x70/0xc0
sp=e000000005757df0 bsp=e000000005750fc0
[<a000000100498010>] bus_for_each_dev+0xb0/0x120
sp=e000000005757df0 bsp=e000000005750f88
[<a000000100499420>] driver_attach+0x40/0x60
sp=e000000005757e10 bsp=e000000005750f68
[<a0000001004989e0>] bus_add_driver+0xc0/0x2e0
sp=e000000005757e10 bsp=e000000005750f30
[<a00000010049a1c0>] driver_register+0xa0/0xc0
sp=e000000005757e10 bsp=e000000005750f10
[<a0000001003629a0>] pci_register_driver+0x100/0x160
sp=e000000005757e20 bsp=e000000005750ef0
[<a000000200110030>] mthca_init+0x30/0x70 [ib_mthca]
sp=e000000005757e30 bsp=e000000005750ed8
[<a0000001000e50c0>] sys_init_module+0x260/0x600
sp=e000000005757e30 bsp=e000000005750e60
[<a00000010000b820>] ia64_ret_from_syscall+0x0/0x20
sp=e000000005757e30 bsp=e000000005750e60
[<a000000000010620>] __kernel_syscall_via_break+0x0/0x20
sp=e000000005758000 bsp=e000000005750e60
sdp_sk_proto.name = SDP
sdp_sk_proto.obj_size = 1744
sdp_init in_interrupt = 0
sdp_init prot->rsk_prot = 0000000000000000
NET: Registered protocol family 27
More information about the general
mailing list