[openib-general] lockdep warnings
Michael S. Tsirkin
mst at mellanox.co.il
Thu Aug 31 06:10:01 PDT 2006
Hi, Roland!
I got a load of lockdep warnings after loading all modules and configuring
ipoib. This doesn't usually happen, not sure what I changed this time.
I'm a bit too busy this week - could you take a look at the log, please?
Attached.
--
MST
-------------- next part --------------
Bootdata ok (command line is auto BOOT_IMAGE=2.6.18-rc5-gdc7 ro root=806 console=ttyS0,115200n8 console=tty0)
Linux version 2.6.18-rc5-gdc709bd1 (root at sw129.yok.mtl.com) (gcc version 3.4.5 20051201 (Red Hat 3.4.5-2)) #1 SMP Thu Aug 31 15:32:17 IDT 2006
BIOS-provided physical RAM map:
BIOS-e820: 0000000000000000 - 0000000000097800 (usable)
BIOS-e820: 0000000000097800 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000e4000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 00000000bff70000 (usable)
BIOS-e820: 00000000bff70000 - 00000000bff78000 (ACPI data)
BIOS-e820: 00000000bff78000 - 00000000bff80000 (ACPI NVS)
BIOS-e820: 00000000bff80000 - 00000000c0000000 (reserved)
BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
BIOS-e820: 00000000ff800000 - 00000000ffc00000 (reserved)
BIOS-e820: 00000000fffffc00 - 0000000100000000 (reserved)
DMI present.
ACPI: RSDP (v000 PTLTD ) @ 0x00000000000f5da0
ACPI: RSDT (v001 PTLTD RSDT 0x06040000 LTP 0x00000000) @ 0x00000000bff73ce0
ACPI: FADT (v001 INTEL LINDHRST 0x06040000 PTL 0x00000003) @ 0x00000000bff77e2c
ACPI: MADT (v001 PTLTD APIC 0x06040000 LTP 0x00000000) @ 0x00000000bff77ea0
ACPI: BOOT (v001 PTLTD $SBFTBL$ 0x06040000 LTP 0x00000001) @ 0x00000000bff77f48
ACPI: SPCR (v001 PTLTD $UCRTBL$ 0x06040000 PTL 0x00000001) @ 0x00000000bff77f70
ACPI: MCFG (v001 PTLTD MCFG 0x06040000 LTP 0x00000000) @ 0x00000000bff77fc0
ACPI: SSDT (v001 PmRef CpuPm 0x00003000 INTL 0x20030224) @ 0x00000000bff73d1c
ACPI: DSDT (v001 Intel LINDHRST 0x06040000 MSFT 0x0100000e) @ 0x0000000000000000
No NUMA configuration found
Faking a node at 0000000000000000-00000000bff70000
Bootmem setup node 0 0000000000000000-00000000bff70000
On node 0 totalpages: 766620
DMA zone: 1232 pages, LIFO batch:0
DMA32 zone: 765388 pages, LIFO batch:31
ACPI: PM-Timer IO Port: 0x1008
ACPI: Local APIC address 0xfee00000
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Processor #0 15:4 APIC version 20
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x06] enabled)
Processor #6 15:4 APIC version 20
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
Processor #1 15:4 APIC version 20
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x07] enabled)
Processor #7 15:4 APIC version 20
ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
ACPI: IOAPIC (id[0x03] address[0xfec10000] gsi_base[24])
IOAPIC[1]: apic_id 3, version 32, address 0xfec10000, GSI 24-47
ACPI: IOAPIC (id[0x04] address[0xfec80000] gsi_base[48])
IOAPIC[2]: apic_id 4, version 32, address 0xfec80000, GSI 48-71
ACPI: IOAPIC (id[0x05] address[0xfec80400] gsi_base[72])
IOAPIC[3]: apic_id 5, version 32, address 0xfec80400, GSI 72-95
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: IRQ0 used by override.
ACPI: IRQ2 used by override.
ACPI: IRQ9 used by override.
Setting APIC routing to physical flat
Using ACPI (MADT) for SMP configuration information
Allocating PCI resources starting at c2000000 (gap: c0000000:20000000)
SMP: Allowing 4 CPUs, 0 hotplug CPUs
Built 1 zonelists. Total pages: 766620
Kernel command line: auto BOOT_IMAGE=2.6.18-rc5-gdc7 ro root=806 console=ttyS0,115200n8 console=tty0
Initializing CPU#0
PID hash table entries: 4096 (order: 12, 32768 bytes)
time.c: Using 3.579545 MHz WALL PM GTOD PIT/TSC timer.
time.c: Detected 3400.204 MHz processor.
Console: colour VGA+ 80x25
Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar
... MAX_LOCKDEP_SUBCLASSES: 8
... MAX_LOCK_DEPTH: 30
... MAX_LOCKDEP_KEYS: 2048
... CLASSHASH_SIZE: 1024
... MAX_LOCKDEP_ENTRIES: 8192
... MAX_LOCKDEP_CHAINS: 8192
... CHAINHASH_SIZE: 4096
memory used by lock dependency info: 1120 kB
per task-struct memory footprint: 1680 bytes
Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
Checking aperture...
Memory: 3059624k/3145152k available (3378k kernel code, 85108k reserved, 2328k data, 216k init)
Calibrating delay using timer specific routine.. 6808.44 BogoMIPS (lpj=13616891)
Mount-cache hash table entries: 256
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
using mwait in idle threads.
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
CPU0: Thermal monitoring enabled (TM1)
lockdep: not fixing up alternatives.
ACPI: Core revision 20060707
Using local APIC timer interrupts.
result 12500709
Detected 12.500 MHz APIC timer.
lockdep: not fixing up alternatives.
Booting processor 1/4 APIC 0x6
Initializing CPU#1
Calibrating delay using timer specific routine.. 6800.83 BogoMIPS (lpj=13601676)
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU: Physical Processor ID: 3
CPU: Processor Core ID: 0
CPU1: Thermal monitoring enabled (TM1)
Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
lockdep: not fixing up alternatives.
Booting processor 2/4 APIC 0x1
Initializing CPU#2
Calibrating delay using timer specific routine.. 6801.05 BogoMIPS (lpj=13602108)
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
CPU2: Thermal monitoring enabled (TM1)
Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
lockdep: not fixing up alternatives.
Booting processor 3/4 APIC 0x7
Initializing CPU#3
Calibrating delay using timer specific routine.. 6800.84 BogoMIPS (lpj=13601696)
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU: Physical Processor ID: 3
CPU: Processor Core ID: 0
CPU3: Thermal monitoring enabled (TM1)
Intel(R) Xeon(TM) CPU 3.40GHz stepping 01
Brought up 4 CPUs
testing NMI watchdog ... OK.
migration_cost=2,734
checking if image is initramfs... it is
Freeing initrd memory: 744k freed
NET: Registered protocol family 16
ACPI: bus type pci registered
PCI: Using MMCONFIG at e0000000
PCI: No mmconfig possible on device 7:1
ACPI: Interpreter enabled
ACPI: Using IOAPIC for interrupt routing
ACPI: PCI Root Bridge [PCI0] (0000:00)
PCI: Probing PCI hardware (bus 00)
PCI quirk: region 1000-107f claimed by ICH4 ACPI/GPIO/TCO
PCI quirk: region 1180-11bf claimed by ICH4 GPIO
PCI: Ignoring BAR0-3 of IDE controller 0000:00:1f.2
PCI: PXH quirk detected, disabling MSI for SHPC device
PCI: PXH quirk detected, disabling MSI for SHPC device
Boot video device is 0000:07:01.0
PCI: Transparent bridge - 0000:00:1e.0
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX0.PXH0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX0.PXH1._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEY0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEZ0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCIX._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCIB._PRT]
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 *5 6 7 10 11 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 14 15)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 *10 11 14 15)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 10 *11 14 15)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LNKF] (IRQs 4 5 6 7 10 11 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 *10 11 14 15)
ACPI: PCI Interrupt Link [LNKH] (IRQs 4 5 6 7 10 *11 14 15)
Intel 82802 RNG detected
SCSI subsystem initialized
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Using ACPI for IRQ routing
PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report
PCI-GART: No AMD northbridge found.
PCI: Bridge: 0000:01:00.0
IO window: 2000-2fff
MEM window: d0200000-d02fffff
PREFETCH window: disabled.
PCI: Bridge: 0000:01:00.2
IO window: disabled.
MEM window: disabled.
PREFETCH window: disabled.
PCI: Bridge: 0000:00:02.0
IO window: 2000-2fff
MEM window: d0100000-d02fffff
PREFETCH window: disabled.
PCI: Bridge: 0000:00:04.0
IO window: disabled.
MEM window: d0300000-d03fffff
PREFETCH window: d2800000-dfffffff
PCI: Bridge: 0000:00:06.0
IO window: disabled.
MEM window: disabled.
PREFETCH window: disabled.
PCI: Bridge: 0000:00:1c.0
IO window: 3000-3fff
MEM window: d0400000-d04fffff
PREFETCH window: disabled.
PCI: Bridge: 0000:00:1e.0
IO window: 4000-4fff
MEM window: d0500000-d1ffffff
PREFETCH window: c2000000-c20fffff
GSI 16 sharing vector 0xA9 and IRQ 16
ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 16 (level, low) -> IRQ 169
PCI: Setting latency timer of device 0000:00:02.0 to 64
PCI: Setting latency timer of device 0000:01:00.0 to 64
PCI: Setting latency timer of device 0000:01:00.2 to 64
ACPI: PCI Interrupt 0000:00:04.0[A] -> GSI 16 (level, low) -> IRQ 169
PCI: Setting latency timer of device 0000:00:04.0 to 64
ACPI: PCI Interrupt 0000:00:06.0[A] -> GSI 16 (level, low) -> IRQ 169
PCI: Setting latency timer of device 0000:00:06.0 to 64
PCI: Setting latency timer of device 0000:00:1e.0 to 64
NET: Registered protocol family 2
IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
TCP established hash table entries: 65536 (order: 9, 3670016 bytes)
TCP bind hash table entries: 32768 (order: 8, 1835008 bytes)
TCP: Hash tables configured (established 65536 bind 32768)
TCP reno registered
Simple Boot Flag at 0x39 set to 0x80
Total HugeTLB memory allocated, 0
Installing knfsd (copyright (C) 1996 okir at monad.swb.de).
io scheduler noop registered
io scheduler deadline registered
io scheduler cfq registered (default)
PCI: Setting latency timer of device 0000:00:02.0 to 64
Allocate Port Service[0000:00:02.0:pcie00]
Allocate Port Service[0000:00:02.0:pcie01]
PCI: Setting latency timer of device 0000:00:04.0 to 64
Allocate Port Service[0000:00:04.0:pcie00]
Allocate Port Service[0000:00:04.0:pcie01]
PCI: Setting latency timer of device 0000:00:06.0 to 64
Allocate Port Service[0000:00:06.0:pcie00]
Allocate Port Service[0000:00:06.0:pcie01]
ACPI: Power Button (FF) [PWRF]
ACPI: Power Button (CM) [PWRB]
Real Time Clock Driver v1.12ac
Software Watchdog Timer: 0.07 initialized. soft_noboot=0 soft_margin=60 sec (nowayout= 0)
Linux agpgart interface v0.101 (c) Dave Jones
Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing disabled
serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Floppy drive(s): fd0 is 1.44M
FDC 0 is a post-1991 82077
RAMDISK driver initialized: 16 RAM disks of 4096K size 1024 blocksize
loop: loaded (max 8 devices)
Intel(R) PRO/1000 Network Driver - version 7.1.9-k4
Copyright (c) 1999-2006 Intel Corporation.
GSI 17 sharing vector 0xB1 and IRQ 17
ACPI: PCI Interrupt 0000:06:01.0[A] -> GSI 24 (level, low) -> IRQ 177
e1000: 0000:06:01.0: e1000_probe: (PCI:66MHz:32-bit) 00:30:48:74:65:02
e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
GSI 18 sharing vector 0xB9 and IRQ 18
ACPI: PCI Interrupt 0000:06:02.0[A] -> GSI 25 (level, low) -> IRQ 185
e1000: 0000:06:02.0: e1000_probe: (PCI:66MHz:32-bit) 00:30:48:74:65:03
e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
e100: Intel(R) PRO/100 Network Driver, 3.5.10-k2-NAPI
e100: Copyright(c) 1999-2005 Intel Corporation
forcedeth.c: Reverse Engineered nForce ethernet driver. Version 0.56.
tun: Universal TUN/TAP device driver, 1.6
tun: (C) 1999-2004 Max Krasnyansky <maxk at qualcomm.com>
netconsole: not configured, aborting
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
ide0: I/O resource 0x1F0-0x1F7 not free.
ide0: ports already in use, skipping probe
Probing IDE interface ide1...
hdc: CD-224E, ATAPI CD/DVD-ROM drive
ide1 at 0x170-0x177,0x376 on irq 15
hdc: ATAPI 24X CD-ROM drive, 128kB Cache
Uniform CD-ROM driver Revision: 3.20
megaraid cmm: 2.20.2.7 (Release Date: Sun Jul 16 00:01:03 EST 2006)
megaraid: 2.20.4.9 (Release Date: Sun Jul 16 12:27:22 EST 2006)
megasas: 00.00.03.01 Sun May 14 22:49:52 PDT 2006
libata version 2.00 loaded.
ata_piix 0000:00:1f.2: version 2.00
ata_piix 0000:00:1f.2: MAP [ P0 P1 IDE IDE ]
GSI 19 sharing vector 0xC1 and IRQ 19
ACPI: PCI Interrupt 0000:00:1f.2[A] -> GSI 18 (level, low) -> IRQ 193
ata: 0x170 IDE port busy
PCI: Setting latency timer of device 0000:00:1f.2 to 64
ata1: SATA max UDMA/133 cmd 0x1F0 ctl 0x3F6 bmdma 0x1470 irq 14
scsi0 : ata_piix
ata1.00: ATA-6, max UDMA/133, 234441648 sectors: LBA48
ata1.00: ata1: dev 0 multi count 16
ata1.00: configured for UDMA/133
Vendor: ATA Model: WDC WD1200SD-01K Rev: 08.0
Type: Direct-Access ANSI SCSI revision: 05
SCSI device sda: 234441648 512-byte hdwr sectors (120034 MB)
sda: Write Protect is off
sda: Mode Sense: 00 3a 00 00
SCSI device sda: drive cache: write back
SCSI device sda: 234441648 512-byte hdwr sectors (120034 MB)
sda: Write Protect is off
sda: Mode Sense: 00 3a 00 00
SCSI device sda: drive cache: write back
sda: sda1 sda2 sda3 sda4 < sda5 sda6 >
sd 0:0:0:0: Attached scsi disk sda
Fusion MPT base driver 3.04.01
Copyright (c) 1999-2005 LSI Logic Corporation
Fusion MPT SPI Host driver 3.04.01
ieee1394: raw1394: /dev/raw1394 device initialized
GSI 20 sharing vector 0xC9 and IRQ 20
ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ 201
PCI: Setting latency timer of device 0000:00:1d.7 to 64
ehci_hcd 0000:00:1d.7: EHCI Host Controller
ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1d.7: debug port 1
PCI: cache line size of 128 is not supported by device 0000:00:1d.7
ehci_hcd 0000:00:1d.7: irq 201, io mem 0xd0000400
ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 4 ports detected
ohci_hcd: 2005 April 22 USB 1.1 'Open' Host Controller (OHCI) Driver (PCI)
USB Universal Host Controller Interface driver v3.0
ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 169
PCI: Setting latency timer of device 0000:00:1d.0 to 64
uhci_hcd 0000:00:1d.0: UHCI Host Controller
uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
uhci_hcd 0000:00:1d.0: irq 169, io base 0x00001400
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
GSI 21 sharing vector 0xD1 and IRQ 21
ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 209
PCI: Setting latency timer of device 0000:00:1d.1 to 64
uhci_hcd 0000:00:1d.1: UHCI Host Controller
uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
uhci_hcd 0000:00:1d.1: irq 209, io base 0x00001420
usb usb3: configuration #1 chosen from 1 choice
hub 3-0:1.0: USB hub found
hub 3-0:1.0: 2 ports detected
usbcore: registered new driver usblp
drivers/usb/class/usblp.c: v0.13: USB Printer Device Class driver
Initializing USB Mass Storage driver...
usbcore: registered new driver usb-storage
USB Mass Storage support registered.
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.6:USB HID core driver
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
mice: PS/2 mouse device common for all mice
device-mapper: ioctl: 4.7.0-ioctl (2006-06-24) initialised: dm-devel at redhat.com
Intel 810 + AC97 Audio, version 1.01, 15:31:00 Aug 31 2006
oprofile: using NMI interrupt.
TCP bic registered
NET: Registered protocol family 1
NET: Registered protocol family 10
IPv6 over IPv4 tunneling driver
NET: Registered protocol family 17
ACPI: (supports S0 S1 S4 S5)
Freeing unused kernel memory: 216k freed
Write protecting the kernel read-only data: 612k
EXT3-fs: INFO: recovery required on readonly filesystem.
EXT3-fs: write access will be enabled during recovery.
kjournald starting. Commit interval 5 seconds
EXT3-fs: recovery complete.
EXT3-fs: mounted filesystem with ordered data mode.
ib_mthca: Mellanox InfiniBand HCA driver v0.08 (February 14, 2006)
ib_mthca: Initializing 0000:04:00.0
ACPI: PCI Interrupt 0000:04:00.0[A] -> GSI 16 (level, low) -> IRQ 169
PCI: Setting latency timer of device 0000:04:00.0 to 64
ADDRCONF(NETDEV_UP): ib1: link is not ready
ADDRCONF(NETDEV_UP): ib0: link is not ready
EXT3 FS on sda6, internal journal
hdc: packet command error: status=0x51 { DriveReady SeekComplete Error }
hdc: packet command error: error=0x54 { AbortedCommand LastFailedSense=0x05 }
ide: failed opcode was: unknown
kjournald starting. Commit interval 5 seconds
EXT3 FS on sda1, internal journal
EXT3-fs: recovery complete.
EXT3-fs: mounted filesystem with ordered data mode.
Adding 2048248k swap on /dev/sda5. Priority:-1 extents:1 across:2048248k
ADDRCONF(NETDEV_UP): eth0: link is not ready
e1000: eth0: e1000_watchdog: NIC Link is Up 100 Mbps Full Duplex
ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
eth0: no IPv6 routers present
i2c /dev entries driver
hald[6264]: segfault at 00007fff4f041000 rip 0000003711c702da rsp 00007fff4f03f238 error 6
ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
ib0: no IPv6 routers present
======================================================
[ INFO: hard-safe -> hard-unsafe lock order detected ]
------------------------------------------------------
ipoib/3102 [HC0[0]:SC0[0]:HE0:SE1] is trying to acquire:
(&alloc->lock){--..}, at: [<ffffffff8805af1b>] mthca_free+0x24/0x54 [ib_mthca]
and this task is already holding:
(&priv->lock){.+..}, at: [<ffffffff880488cd>] __ipoib_reap_ah+0x37/0xd1 [ib_ipoib]
which would create a new lock dependency:
(&priv->lock){.+..} -> (&alloc->lock){--..}
but this new dependency connects a hard-irq-safe lock:
(&priv->tx_lock){+...}
... which became hard-irq-safe at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff880485f5>] ipoib_ib_completion+0x357/0x422 [ib_ipoib]
[<ffffffff8805cdc4>] mthca_cq_completion+0x68/0x6e [ib_mthca]
[<ffffffff8805b5dc>] mthca_eq_int+0x84/0x3d7 [ib_mthca]
[<ffffffff8805b98d>] mthca_tavor_interrupt+0x5e/0xdc [ib_mthca]
[<ffffffff8025b164>] handle_IRQ_event+0x29/0x62
[<ffffffff8025b24a>] __do_IRQ+0xad/0x11d
[<ffffffff8020c0ee>] do_IRQ+0x106/0x118
[<ffffffff80209d39>] common_interrupt+0x65/0x66
to a hard-irq-unsafe lock:
(&alloc->lock){--..}
... which became hard-irq-unsafe at:
... [<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8805ae8e>] mthca_alloc+0x12/0x7b [ib_mthca]
[<ffffffff8806735c>] mthca_uar_alloc+0x18/0x4d [ib_mthca]
[<ffffffff88056b2e>] mthca_init_one+0x7f9/0xd89 [ib_mthca]
[<ffffffff80361e05>] pci_device_probe+0xee/0x155
[<ffffffff803b5791>] driver_probe_device+0x5d/0xbe
[<ffffffff803b5915>] __driver_attach+0x90/0xcf
[<ffffffff803b4ba8>] bus_for_each_dev+0x49/0x7e
[<ffffffff803b596f>] driver_attach+0x1b/0x1e
[<ffffffff803b516d>] bus_add_driver+0x7b/0x13a
[<ffffffff803b5e5d>] driver_register+0x8c/0x91
[<ffffffff80361bc3>] __pci_register_driver+0x60/0x84
[<ffffffff88077016>] copy_addr+0x16/0x57 [ib_addr]
[<ffffffff80253127>] sys_init_module+0xb6/0x1ce
[<ffffffff80209801>] system_call+0x7d/0x83
other info that might help us debug this:
2 locks held by ipoib/3102:
#0: (&priv->tx_lock){+...}, at: [<ffffffff880488c5>] __ipoib_reap_ah+0x2f/0xd1 [ib_ipoib]
#1: (&priv->lock){.+..}, at: [<ffffffff880488cd>] __ipoib_reap_ah+0x37/0xd1 [ib_ipoib]
the hard-irq-safe lock's dependencies:
-> (&priv->tx_lock){+...} ops: 453 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c69>] _spin_lock_irq+0x27/0x34
[<ffffffff880488c4>] __ipoib_reap_ah+0x2e/0xd1 [ib_ipoib]
[<ffffffff88048975>] ipoib_reap_ah+0xe/0x35 [ib_ipoib]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff880485f5>] ipoib_ib_completion+0x357/0x422 [ib_ipoib]
[<ffffffff8805cdc4>] mthca_cq_completion+0x68/0x6e [ib_mthca]
[<ffffffff8805b5dc>] mthca_eq_int+0x84/0x3d7 [ib_mthca]
[<ffffffff8805b98d>] mthca_tavor_interrupt+0x5e/0xdc [ib_mthca]
[<ffffffff8025b164>] handle_IRQ_event+0x29/0x62
[<ffffffff8025b24a>] __do_IRQ+0xad/0x11d
[<ffffffff8020c0ee>] do_IRQ+0x106/0x118
[<ffffffff80209d39>] common_interrupt+0x65/0x66
}
... key at: [<ffffffff8805319c>] __key.1+0x0/0xffffffffffff8bfb [ib_ipoib]
-> (&priv->lock){.+..} ops: 593 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c69>] _spin_lock_irq+0x27/0x34
[<ffffffff8804a0dd>] ipoib_mcast_start_thread+0x6e/0x87 [ib_ipoib]
[<ffffffff88048a3e>] ipoib_ib_dev_up+0x50/0x56 [ib_ipoib]
[<ffffffff88046066>] ipoib_open+0x66/0x114 [ib_ipoib]
[<ffffffff804c61df>] dev_open+0x37/0x7c
[<ffffffff804c7741>] dev_change_flags+0x5c/0x124
[<ffffffff804ff433>] devinet_ioctl+0x2a7/0x664
[<ffffffff805005ed>] inet_ioctl+0x70/0x8f
[<ffffffff804bcd00>] sock_ioctl+0x17c/0x19f
[<ffffffff80294fc5>] do_ioctl+0x2d/0x78
[<ffffffff8029527e>] vfs_ioctl+0x26e/0x281
[<ffffffff802952d0>] sys_ioctl+0x3f/0x63
[<ffffffff80209801>] system_call+0x7d/0x83
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8804a468>] ipoib_mcast_send+0x28/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff88053194>] __key.0+0x0/0xffffffffffff8c03 [ib_ipoib]
-> (&idr_lock){.+..} ops: 125 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8801d32f>] send_mad+0x40/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff88049d1c>] ipoib_mcast_join+0x166/0x1f8 [ib_ipoib]
[<ffffffff88049fd3>] ipoib_mcast_join_task+0x225/0x2c1 [ib_ipoib]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8801d32f>] send_mad+0x40/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff88021688>] __key.1+0x0/0xffffffffffffc712 [ib_sa]
-> (query_idr.lock){.+..} ops: 142 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8035586e>] free_layer+0x1c/0x3f
[<ffffffff803558c6>] idr_pre_get+0x35/0x42
[<ffffffff8801d315>] send_mad+0x26/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff88049d1c>] ipoib_mcast_join+0x166/0x1f8 [ib_ipoib]
[<ffffffff88049fd3>] ipoib_mcast_join_task+0x225/0x2c1 [ib_ipoib]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8035586e>] free_layer+0x1c/0x3f
[<ffffffff803558c6>] idr_pre_get+0x35/0x42
[<ffffffff8801d315>] send_mad+0x26/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88046f31>] ipoib_path_lookup+0x213/0x223 [ib_ipoib]
[<ffffffff8804706a>] ipoib_start_xmit+0x129/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff804cc339>] neigh_connected_output+0xb2/0xd2
[<ffffffff8050efcf>] ip6_output2+0x24f/0x284
[<ffffffff8051011c>] ip6_output+0x88a/0x89a
[<ffffffff8051dd10>] ndisc_send_rs+0x2eb/0x41c
[<ffffffff80514310>] addrconf_dad_completed+0x8e/0xdb
[<ffffffff805143cd>] addrconf_dad_timer+0x70/0x119
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff88020370>] query_idr+0x30/0xffffffffffffda5a [ib_sa]
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff80355808>] alloc_layer+0x18/0x4d
[<ffffffff80355906>] idr_get_new_above_int+0x33/0x271
[<ffffffff80355b82>] idr_get_new+0x10/0x31
[<ffffffff8801d345>] send_mad+0x56/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff88049d1c>] ipoib_mcast_join+0x166/0x1f8 [ib_ipoib]
[<ffffffff88049fd3>] ipoib_mcast_join_task+0x225/0x2c1 [ib_ipoib]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8801d17d>] ib_sa_cancel_query+0x1b/0x73 [ib_sa]
[<ffffffff8804a12b>] wait_for_mcast_join+0x35/0xd2 [ib_ipoib]
[<ffffffff8804a26c>] ipoib_mcast_stop_thread+0xa4/0xf5 [ib_ipoib]
[<ffffffff8804aa0e>] ipoib_mcast_restart_task+0x4b/0x3e7 [ib_ipoib]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (&mad_agent_priv->lock){.+..} ops: 752 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff880121ca>] ib_post_send_mad+0x477/0x567 [ib_mad]
[<ffffffff8801d3d2>] send_mad+0xe3/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff88049d1c>] ipoib_mcast_join+0x166/0x1f8 [ib_ipoib]
[<ffffffff88049fd3>] ipoib_mcast_join_task+0x225/0x2c1 [ib_ipoib]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff880121ca>] ib_post_send_mad+0x477/0x567 [ib_mad]
[<ffffffff8801d3d2>] send_mad+0xe3/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff8801b484>] __key.4+0x0/0xffffffffffffb0e8 [ib_mad]
-> (base_lock_keys + cpu){++..} ops: 97119 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c69>] _spin_lock_irq+0x27/0x34
[<ffffffff8023b838>] run_timer_softirq+0x43/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8020c0f3>] do_IRQ+0x10b/0x118
[<ffffffff80209d39>] common_interrupt+0x65/0x66
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8023b479>] __mod_timer+0x93/0xc2
[<ffffffff80406dfc>] __ide_set_handler+0x70/0x7a
[<ffffffff80406e40>] ide_set_handler+0x3a/0x56
[<ffffffff80410744>] cdrom_pc_intr+0x200/0x217
[<ffffffff80405d90>] ide_intr+0x169/0x1de
[<ffffffff8025b164>] handle_IRQ_event+0x29/0x62
[<ffffffff8025b24a>] __do_IRQ+0xad/0x11d
[<ffffffff8020c0ee>] do_IRQ+0x106/0x118
[<ffffffff80209d39>] common_interrupt+0x65/0x66
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c69>] _spin_lock_irq+0x27/0x34
[<ffffffff8023b838>] run_timer_softirq+0x43/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8020c0f3>] do_IRQ+0x10b/0x118
[<ffffffff80209d39>] common_interrupt+0x65/0x66
}
... key at: [<ffffffff807f6500>] base_lock_keys+0x0/0x100
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8023b3c0>] lock_timer_base+0x21/0x47
[<ffffffff8023b5b5>] try_to_del_timer_sync+0x18/0x5d
[<ffffffff8023b60b>] del_timer_sync+0x11/0x1e
[<ffffffff88013872>] ib_mad_complete_send_wr+0x109/0x1f6 [ib_mad]
[<ffffffff88013a80>] ib_mad_send_done_handler+0x121/0x176 [ib_mad]
[<ffffffff88014035>] ib_mad_completion_handler+0x560/0x595 [ib_mad]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (base_lock_keys + cpu#2){++..} ops: 64294 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c69>] _spin_lock_irq+0x27/0x34
[<ffffffff8023b838>] run_timer_softirq+0x43/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8023b3c0>] lock_timer_base+0x21/0x47
[<ffffffff8023b560>] del_timer+0x1f/0x5c
[<ffffffff80415e27>] scsi_delete_timer+0x12/0x2e
[<ffffffff804137ed>] scsi_done+0xd/0x1e
[<ffffffff8044b5a0>] ata_scsi_qc_complete+0xc7/0xd9
[<ffffffff80446764>] __ata_qc_complete+0x22a/0x237
[<ffffffff80446840>] ata_qc_complete+0xcf/0xd5
[<ffffffff80446a51>] ata_hsm_qc_complete+0x20b/0x21d
[<ffffffff80447095>] ata_hsm_move+0x632/0x652
[<ffffffff80448a05>] ata_interrupt+0x174/0x1b9
[<ffffffff8025b164>] handle_IRQ_event+0x29/0x62
[<ffffffff8025b24a>] __do_IRQ+0xad/0x11d
[<ffffffff8020c0ee>] do_IRQ+0x106/0x118
[<ffffffff80209d39>] common_interrupt+0x65/0x66
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c69>] _spin_lock_irq+0x27/0x34
[<ffffffff8023b838>] run_timer_softirq+0x43/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff807f6508>] base_lock_keys+0x8/0x100
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8023b479>] __mod_timer+0x93/0xc2
[<ffffffff802425e0>] queue_delayed_work+0x77/0x81
[<ffffffff8801372c>] wait_for_response+0xeb/0xf4 [ib_mad]
[<ffffffff88013828>] ib_mad_complete_send_wr+0xbf/0x1f6 [ib_mad]
[<ffffffff88013a80>] ib_mad_send_done_handler+0x121/0x176 [ib_mad]
[<ffffffff88014035>] ib_mad_completion_handler+0x560/0x595 [ib_mad]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (base_lock_keys + cpu#3){++..} ops: 63714 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c69>] _spin_lock_irq+0x27/0x34
[<ffffffff8023b838>] run_timer_softirq+0x43/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8023b3c0>] lock_timer_base+0x21/0x47
[<ffffffff8023b560>] del_timer+0x1f/0x5c
[<ffffffff80405d7f>] ide_intr+0x158/0x1de
[<ffffffff8025b164>] handle_IRQ_event+0x29/0x62
[<ffffffff8025b24a>] __do_IRQ+0xad/0x11d
[<ffffffff8020c0ee>] do_IRQ+0x106/0x118
[<ffffffff80209d39>] common_interrupt+0x65/0x66
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c69>] _spin_lock_irq+0x27/0x34
[<ffffffff8023b838>] run_timer_softirq+0x43/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff807f6510>] base_lock_keys+0x10/0x100
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8023b479>] __mod_timer+0x93/0xc2
[<ffffffff802425e0>] queue_delayed_work+0x77/0x81
[<ffffffff8801372c>] wait_for_response+0xeb/0xf4 [ib_mad]
[<ffffffff88013766>] ib_reset_mad_timeout+0x31/0x34 [ib_mad]
[<ffffffff880141b1>] ib_modify_mad+0x147/0x163 [ib_mad]
[<ffffffff880141d7>] ib_cancel_mad+0xa/0xd [ib_mad]
[<ffffffff8801d1cc>] ib_sa_cancel_query+0x6a/0x73 [ib_sa]
[<ffffffff8804a12b>] wait_for_mcast_join+0x35/0xd2 [ib_ipoib]
[<ffffffff8804a26c>] ipoib_mcast_stop_thread+0xa4/0xf5 [ib_ipoib]
[<ffffffff8804aa0e>] ipoib_mcast_restart_task+0x4b/0x3e7 [ib_ipoib]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (base_lock_keys + cpu#4){++..} ops: 62147 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c69>] _spin_lock_irq+0x27/0x34
[<ffffffff8023b838>] run_timer_softirq+0x43/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8023b3c0>] lock_timer_base+0x21/0x47
[<ffffffff8023b560>] del_timer+0x1f/0x5c
[<ffffffff80415e27>] scsi_delete_timer+0x12/0x2e
[<ffffffff804137ed>] scsi_done+0xd/0x1e
[<ffffffff8044b5a0>] ata_scsi_qc_complete+0xc7/0xd9
[<ffffffff80446764>] __ata_qc_complete+0x22a/0x237
[<ffffffff80446840>] ata_qc_complete+0xcf/0xd5
[<ffffffff80446a51>] ata_hsm_qc_complete+0x20b/0x21d
[<ffffffff80447095>] ata_hsm_move+0x632/0x652
[<ffffffff80448a05>] ata_interrupt+0x174/0x1b9
[<ffffffff8025b164>] handle_IRQ_event+0x29/0x62
[<ffffffff8025b24a>] __do_IRQ+0xad/0x11d
[<ffffffff8020c0ee>] do_IRQ+0x106/0x118
[<ffffffff80209d39>] common_interrupt+0x65/0x66
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c69>] _spin_lock_irq+0x27/0x34
[<ffffffff8023b838>] run_timer_softirq+0x43/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff807f6518>] base_lock_keys+0x18/0x100
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8023b479>] __mod_timer+0x93/0xc2
[<ffffffff802425e0>] queue_delayed_work+0x77/0x81
[<ffffffff8801372c>] wait_for_response+0xeb/0xf4 [ib_mad]
[<ffffffff88013828>] ib_mad_complete_send_wr+0xbf/0x1f6 [ib_mad]
[<ffffffff88013a80>] ib_mad_send_done_handler+0x121/0x176 [ib_mad]
[<ffffffff88014035>] ib_mad_completion_handler+0x560/0x595 [ib_mad]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8801408e>] ib_modify_mad+0x24/0x163 [ib_mad]
[<ffffffff880141d7>] ib_cancel_mad+0xa/0xd [ib_mad]
[<ffffffff8801d1cc>] ib_sa_cancel_query+0x6a/0x73 [ib_sa]
[<ffffffff8804a12b>] wait_for_mcast_join+0x35/0xd2 [ib_ipoib]
[<ffffffff8804a26c>] ipoib_mcast_stop_thread+0xa4/0xf5 [ib_ipoib]
[<ffffffff8804aa0e>] ipoib_mcast_restart_task+0x4b/0x3e7 [ib_ipoib]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (modlist_lock){.+..} ops: 116 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff802539c0>] module_text_address+0x15/0x3b
[<ffffffff80549c2f>] __register_kprobe+0x4b/0x316
[<ffffffff80549f06>] register_kprobe+0xc/0xf
[<ffffffff80a7b16b>] arch_init_kprobes+0xf/0x12
[<ffffffff80a7ed08>] init_kprobes+0x38/0x4b
[<ffffffff8020718d>] init+0x140/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff802538d4>] is_module_address+0x14/0x80
[<ffffffff8024a198>] static_obj+0x89/0x92
[<ffffffff8024b0bf>] lockdep_init_map+0x60/0xbf
[<ffffffff8035b703>] __spin_lock_init+0x2b/0x4c
[<ffffffff88049384>] ipoib_mcast_alloc+0x96/0xb2 [ib_ipoib]
[<ffffffff8804a545>] ipoib_mcast_send+0x105/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff8069b898>] modlist_lock+0x18/0x40
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff802538d4>] is_module_address+0x14/0x80
[<ffffffff8024a198>] static_obj+0x89/0x92
[<ffffffff8024b0bf>] lockdep_init_map+0x60/0xbf
[<ffffffff8035b703>] __spin_lock_init+0x2b/0x4c
[<ffffffff88049384>] ipoib_mcast_alloc+0x96/0xb2 [ib_ipoib]
[<ffffffff8804ab46>] ipoib_mcast_restart_task+0x183/0x3e7 [ib_ipoib]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (&cwq->lock){++..} ops: 8625 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff80242480>] __queue_work+0x14/0x66
[<ffffffff80242524>] queue_work+0x52/0x5c
[<ffffffff8024244b>] call_usermodehelper_keys+0xe8/0x109
[<ffffffff80356ad4>] kobject_uevent+0x3f8/0x422
[<ffffffff803b69b8>] class_device_add+0x331/0x464
[<ffffffff803b6b00>] class_device_register+0x15/0x1b
[<ffffffff803b6c40>] class_device_create+0x13a/0x163
[<ffffffff80a8682f>] vtconsole_class_init+0x87/0xdb
[<ffffffff8020718d>] init+0x140/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff80242480>] __queue_work+0x14/0x66
[<ffffffff80242524>] queue_work+0x52/0x5c
[<ffffffff80242d00>] schedule_work+0x15/0x18
[<ffffffff803bba47>] schedule_bh+0x21/0x24
[<ffffffff803bc70d>] floppy_interrupt+0x1a7/0x1c2
[<ffffffff803bc73c>] floppy_hardint+0x14/0xc5
[<ffffffff8025b164>] handle_IRQ_event+0x29/0x62
[<ffffffff8025b24a>] __do_IRQ+0xad/0x11d
[<ffffffff8020c0ee>] do_IRQ+0x106/0x118
[<ffffffff80209d39>] common_interrupt+0x65/0x66
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff80242480>] __queue_work+0x14/0x66
[<ffffffff80242566>] delayed_work_timer_fn+0x38/0x3b
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff807f7630>] __key.1+0x0/0x8
-> (&q->lock){++..} ops: 108166 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c69>] _spin_lock_irq+0x27/0x34
[<ffffffff80544c27>] wait_for_completion+0x2d/0xf3
[<ffffffff80245d05>] keventd_create_kthread+0x35/0x6a
[<ffffffff80245e43>] kthread_create+0x109/0x18c
[<ffffffff8022d303>] migration_call+0x60/0x453
[<ffffffff80a7d436>] migration_init+0x24/0x4b
[<ffffffff80207091>] init+0x44/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8022ba28>] __wake_up+0x1f/0x4e
[<ffffffff802424be>] __queue_work+0x52/0x66
[<ffffffff80242524>] queue_work+0x52/0x5c
[<ffffffff80242d00>] schedule_work+0x15/0x18
[<ffffffff803bba47>] schedule_bh+0x21/0x24
[<ffffffff803bc70d>] floppy_interrupt+0x1a7/0x1c2
[<ffffffff803bc73c>] floppy_hardint+0x14/0xc5
[<ffffffff8025b164>] handle_IRQ_event+0x29/0x62
[<ffffffff8025b24a>] __do_IRQ+0xad/0x11d
[<ffffffff8020c0ee>] do_IRQ+0x106/0x118
[<ffffffff80209d39>] common_interrupt+0x65/0x66
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8022bae5>] complete+0x18/0x49
[<ffffffff8024402d>] wakeme_after_rcu+0xc/0xf
[<ffffffff80243c20>] __rcu_process_callbacks+0x154/0x1de
[<ffffffff80243ccc>] rcu_process_callbacks+0x22/0x44
[<ffffffff80237f67>] tasklet_action+0x78/0xc0
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff807f7c78>] __key.0+0x0/0x8
-> (&rq->rq_lock_key){++..} ops: 318932 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8022ca51>] init_idle+0x75/0xa1
[<ffffffff80a7d795>] sched_init+0x1b5/0x1bb
[<ffffffff80a6d6c5>] start_kernel+0x7a/0x22e
[<ffffffff80a6d2ab>] _sinittext+0x2ab/0x2b3
[<ffffffffffffffff>] 0xffffffffffffffff
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff8020d74f>] main_timer_handler+0x20b/0x3c0
[<ffffffff8020d918>] timer_interrupt+0x14/0x2a
[<ffffffff8025b164>] handle_IRQ_event+0x29/0x62
[<ffffffff8025b24a>] __do_IRQ+0xad/0x11d
[<ffffffff8020c0ee>] do_IRQ+0x106/0x118
[<ffffffff80209d39>] common_interrupt+0x65/0x66
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022a11c>] wake_up_process+0xf/0x12
[<ffffffff80237c42>] __do_softirq+0xcb/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff810001046a90>] 0xffff810001046a90
-> (&rq->rq_lock_key#2){++..} ops: 134541 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022bb01>] complete+0x34/0x49
[<ffffffff8024402d>] wakeme_after_rcu+0xc/0xf
[<ffffffff80243c20>] __rcu_process_callbacks+0x154/0x1de
[<ffffffff80243ccc>] rcu_process_callbacks+0x22/0x44
[<ffffffff80237f67>] tasklet_action+0x78/0xc0
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff81000104ea90>] 0xffff81000104ea90
-> (&rq->rq_lock_key#4){++..} ops: 122452 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022ba3e>] __wake_up+0x35/0x4e
[<ffffffff802424be>] __queue_work+0x52/0x66
[<ffffffff80242566>] delayed_work_timer_fn+0x38/0x3b
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff81000105ea90>] 0xffff81000105ea90
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022a6f2>] double_rq_lock+0x2d/0x33
[<ffffffff8022ccea>] __migrate_task+0x65/0xe2
[<ffffffff8022cf21>] migration_thread+0x1ba/0x223
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (&rq->rq_lock_key#3){++..} ops: 299350 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022a11c>] wake_up_process+0xf/0x12
[<ffffffff80237c42>] __do_softirq+0xcb/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff810001056a90>] 0xffff810001056a90
-> (&rq->rq_lock_key#4){++..} ops: 122452 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022ba3e>] __wake_up+0x35/0x4e
[<ffffffff802424be>] __queue_work+0x52/0x66
[<ffffffff80242566>] delayed_work_timer_fn+0x38/0x3b
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff81000105ea90>] 0xffff81000105ea90
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022a6f2>] double_rq_lock+0x2d/0x33
[<ffffffff8022ccea>] __migrate_task+0x65/0xe2
[<ffffffff8022cf21>] migration_thread+0x1ba/0x223
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022a6f2>] double_rq_lock+0x2d/0x33
[<ffffffff8022ccea>] __migrate_task+0x65/0xe2
[<ffffffff8022cf21>] migration_thread+0x1ba/0x223
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022a6f2>] double_rq_lock+0x2d/0x33
[<ffffffff8022ccea>] __migrate_task+0x65/0xe2
[<ffffffff8022cf21>] migration_thread+0x1ba/0x223
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (&rq->rq_lock_key#3){++..} ops: 299350 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022a11c>] wake_up_process+0xf/0x12
[<ffffffff80237c42>] __do_softirq+0xcb/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff810001056a90>] 0xffff810001056a90
-> (&rq->rq_lock_key#4){++..} ops: 122452 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022ba3e>] __wake_up+0x35/0x4e
[<ffffffff802424be>] __queue_work+0x52/0x66
[<ffffffff80242566>] delayed_work_timer_fn+0x38/0x3b
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff81000105ea90>] 0xffff81000105ea90
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022a6f2>] double_rq_lock+0x2d/0x33
[<ffffffff8022ccea>] __migrate_task+0x65/0xe2
[<ffffffff8022cf21>] migration_thread+0x1ba/0x223
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022a6f2>] double_rq_lock+0x2d/0x33
[<ffffffff8022ccea>] __migrate_task+0x65/0xe2
[<ffffffff8022cf21>] migration_thread+0x1ba/0x223
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (&rq->rq_lock_key#4){++..} ops: 122452 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022ba3e>] __wake_up+0x35/0x4e
[<ffffffff802424be>] __queue_work+0x52/0x66
[<ffffffff80242566>] delayed_work_timer_fn+0x38/0x3b
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff81000105ea90>] 0xffff81000105ea90
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022a6f2>] double_rq_lock+0x2d/0x33
[<ffffffff8022ccea>] __migrate_task+0x65/0xe2
[<ffffffff8022cf21>] migration_thread+0x1ba/0x223
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022bb01>] complete+0x34/0x49
[<ffffffff80245c8f>] kthread+0xbb/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (&rq->rq_lock_key#2){++..} ops: 134541 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022bb01>] complete+0x34/0x49
[<ffffffff8024402d>] wakeme_after_rcu+0xc/0xf
[<ffffffff80243c20>] __rcu_process_callbacks+0x154/0x1de
[<ffffffff80243ccc>] rcu_process_callbacks+0x22/0x44
[<ffffffff80237f67>] tasklet_action+0x78/0xc0
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff81000104ea90>] 0xffff81000104ea90
-> (&rq->rq_lock_key#4){++..} ops: 122452 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022ba3e>] __wake_up+0x35/0x4e
[<ffffffff802424be>] __queue_work+0x52/0x66
[<ffffffff80242566>] delayed_work_timer_fn+0x38/0x3b
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff81000105ea90>] 0xffff81000105ea90
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022a6f2>] double_rq_lock+0x2d/0x33
[<ffffffff8022ccea>] __migrate_task+0x65/0xe2
[<ffffffff8022cf21>] migration_thread+0x1ba/0x223
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (&rq->rq_lock_key#3){++..} ops: 299350 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022a11c>] wake_up_process+0xf/0x12
[<ffffffff80237c42>] __do_softirq+0xcb/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff810001056a90>] 0xffff810001056a90
-> (&rq->rq_lock_key#4){++..} ops: 122452 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022ba3e>] __wake_up+0x35/0x4e
[<ffffffff802424be>] __queue_work+0x52/0x66
[<ffffffff80242566>] delayed_work_timer_fn+0x38/0x3b
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff81000105ea90>] 0xffff81000105ea90
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022a6f2>] double_rq_lock+0x2d/0x33
[<ffffffff8022ccea>] __migrate_task+0x65/0xe2
[<ffffffff8022cf21>] migration_thread+0x1ba/0x223
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022a6f2>] double_rq_lock+0x2d/0x33
[<ffffffff8022ccea>] __migrate_task+0x65/0xe2
[<ffffffff8022cf21>] migration_thread+0x1ba/0x223
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022bb01>] complete+0x34/0x49
[<ffffffff8022cf30>] migration_thread+0x1c9/0x223
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (&rq->rq_lock_key#3){++..} ops: 299350 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022a11c>] wake_up_process+0xf/0x12
[<ffffffff80237c42>] __do_softirq+0xcb/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff810001056a90>] 0xffff810001056a90
-> (&rq->rq_lock_key#4){++..} ops: 122452 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022ba3e>] __wake_up+0x35/0x4e
[<ffffffff802424be>] __queue_work+0x52/0x66
[<ffffffff80242566>] delayed_work_timer_fn+0x38/0x3b
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff81000105ea90>] 0xffff81000105ea90
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022a6f2>] double_rq_lock+0x2d/0x33
[<ffffffff8022ccea>] __migrate_task+0x65/0xe2
[<ffffffff8022cf21>] migration_thread+0x1ba/0x223
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022bb01>] complete+0x34/0x49
[<ffffffff8022cf30>] migration_thread+0x1c9/0x223
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (&rq->rq_lock_key#4){++..} ops: 122452 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022ba3e>] __wake_up+0x35/0x4e
[<ffffffff802424be>] __queue_work+0x52/0x66
[<ffffffff80242566>] delayed_work_timer_fn+0x38/0x3b
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff81000105ea90>] 0xffff81000105ea90
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022bb01>] complete+0x34/0x49
[<ffffffff8022cf30>] migration_thread+0x1c9/0x223
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8022ba28>] __wake_up+0x1f/0x4e
[<ffffffff802424be>] __queue_work+0x52/0x66
[<ffffffff80242524>] queue_work+0x52/0x5c
[<ffffffff8024244b>] call_usermodehelper_keys+0xe8/0x109
[<ffffffff80356ad4>] kobject_uevent+0x3f8/0x422
[<ffffffff803b69b8>] class_device_add+0x331/0x464
[<ffffffff803b6b00>] class_device_register+0x15/0x1b
[<ffffffff803b6c40>] class_device_create+0x13a/0x163
[<ffffffff80a8682f>] vtconsole_class_init+0x87/0xdb
[<ffffffff8020718d>] init+0x140/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff80242480>] __queue_work+0x14/0x66
[<ffffffff80242524>] queue_work+0x52/0x5c
[<ffffffff88049b75>] ipoib_mcast_join_complete+0x267/0x2a8 [ib_ipoib]
[<ffffffff8801d9f4>] ib_sa_mcmember_rec_callback+0x4b/0x57 [ib_sa]
[<ffffffff8801da5f>] send_handler+0x50/0xaf [ib_sa]
[<ffffffff8801457f>] timeout_sends+0x199/0x1c0 [ib_mad]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (&on_slab_key){++..} ops: 4526 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8027d294>] cache_alloc_refill+0x84/0x245
[<ffffffff8027d7d1>] kmem_cache_alloc+0xb4/0xf4
[<ffffffff8027fb8b>] kmem_cache_create+0x52d/0x710
[<ffffffff80a80991>] kmem_cache_init+0x250/0x49d
[<ffffffff80a6d7f4>] start_kernel+0x1a9/0x22e
[<ffffffff80a6d2ab>] _sinittext+0x2ab/0x2b3
[<ffffffffffffffff>] 0xffffffffffffffff
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8027d294>] cache_alloc_refill+0x84/0x245
[<ffffffff8027effe>] __kmalloc_track_caller+0xf9/0x138
[<ffffffff804c102d>] __alloc_skb+0x5c/0x125
[<ffffffff804c110c>] __netdev_alloc_skb+0x16/0x34
[<ffffffff803c561e>] e1000_clean_rx_irq+0x206/0x4a9
[<ffffffff803c5349>] e1000_intr+0xac/0xf7
[<ffffffff8025b164>] handle_IRQ_event+0x29/0x62
[<ffffffff8025b24a>] __do_IRQ+0xad/0x11d
[<ffffffff8020c0ee>] do_IRQ+0x106/0x118
[<ffffffff80209d39>] common_interrupt+0x65/0x66
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8027e32c>] cache_flusharray+0x4b/0x103
[<ffffffff8027d9ff>] kfree+0x1ee/0x224
[<ffffffff8029cb3e>] free_fdtable_rcu+0x95/0xfa
[<ffffffff80243c20>] __rcu_process_callbacks+0x154/0x1de
[<ffffffff80243ccc>] rcu_process_callbacks+0x22/0x44
[<ffffffff80237f67>] tasklet_action+0x78/0xc0
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff80a199a0>] on_slab_key+0x0/0x10
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8027d294>] cache_alloc_refill+0x84/0x245
[<ffffffff8027d6bf>] kmem_cache_zalloc+0xb9/0x117
[<ffffffff88049312>] ipoib_mcast_alloc+0x24/0xb2 [ib_ipoib]
[<ffffffff8804ab46>] ipoib_mcast_restart_task+0x183/0x3e7 [ib_ipoib]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (&list->lock#4){.+..} ops: 10 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff804c0dba>] skb_queue_tail+0x1c/0x47
[<ffffffff8804a5d3>] ipoib_mcast_send+0x193/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff804c0dba>] skb_queue_tail+0x1c/0x47
[<ffffffff8804a5d3>] ipoib_mcast_send+0x193/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff880531b4>] __key.0+0x0/0xffffffffffff8be3 [ib_ipoib]
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff804c0dba>] skb_queue_tail+0x1c/0x47
[<ffffffff8804a5d3>] ipoib_mcast_send+0x193/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
-> (&device->client_data_lock){.+..} ops: 70 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff88003f6d>] add_client_context+0x5f/0x97 [ib_core]
[<ffffffff8800424c>] ib_register_device+0x2a7/0x2dd [ib_core]
[<ffffffff88066130>] mthca_register_device+0x3db/0x436 [ib_mthca]
[<ffffffff88056fba>] mthca_init_one+0xc85/0xd89 [ib_mthca]
[<ffffffff80361e05>] pci_device_probe+0xee/0x155
[<ffffffff803b5791>] driver_probe_device+0x5d/0xbe
[<ffffffff803b5915>] __driver_attach+0x90/0xcf
[<ffffffff803b4ba8>] bus_for_each_dev+0x49/0x7e
[<ffffffff803b596f>] driver_attach+0x1b/0x1e
[<ffffffff803b516d>] bus_add_driver+0x7b/0x13a
[<ffffffff803b5e5d>] driver_register+0x8c/0x91
[<ffffffff80361bc3>] __pci_register_driver+0x60/0x84
[<ffffffff88077016>] copy_addr+0x16/0x57 [ib_addr]
[<ffffffff80253127>] sys_init_module+0xb6/0x1ce
[<ffffffff80209801>] system_call+0x7d/0x83
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff88004521>] ib_get_client_data+0x1f/0x65 [ib_core]
[<ffffffff8801d4c8>] ib_sa_mcmember_rec_query+0x31/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff8800f608>] __key.1+0x0/0xffffffffffff665a [ib_core]
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff88004521>] ib_get_client_data+0x1f/0x65 [ib_core]
[<ffffffff8801d4c8>] ib_sa_mcmember_rec_query+0x31/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
-> (&tid_lock){.+..} ops: 54 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8801d2b7>] init_mad+0x2f/0x67 [ib_sa]
[<ffffffff8801d577>] ib_sa_mcmember_rec_query+0xe0/0x17f [ib_sa]
[<ffffffff88049d1c>] ipoib_mcast_join+0x166/0x1f8 [ib_ipoib]
[<ffffffff88049fd3>] ipoib_mcast_join_task+0x225/0x2c1 [ib_ipoib]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8801d2b7>] init_mad+0x2f/0x67 [ib_sa]
[<ffffffff8801d577>] ib_sa_mcmember_rec_query+0xe0/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff88021690>] __key.2+0x0/0xffffffffffffc70a [ib_sa]
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8801d2b7>] init_mad+0x2f/0x67 [ib_sa]
[<ffffffff8801d577>] ib_sa_mcmember_rec_query+0xe0/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
-> (&sa_dev->port[i].ah_lock){.+..} ops: 58 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c69>] _spin_lock_irq+0x27/0x34
[<ffffffff8801d0f5>] update_sm_ah+0xd6/0x10b [ib_sa]
[<ffffffff8801dca8>] ib_sa_add_one+0x19f/0x1ec [ib_sa]
[<ffffffff88004256>] ib_register_device+0x2b1/0x2dd [ib_core]
[<ffffffff88066130>] mthca_register_device+0x3db/0x436 [ib_mthca]
[<ffffffff88056fba>] mthca_init_one+0xc85/0xd89 [ib_mthca]
[<ffffffff80361e05>] pci_device_probe+0xee/0x155
[<ffffffff803b5791>] driver_probe_device+0x5d/0xbe
[<ffffffff803b5915>] __driver_attach+0x90/0xcf
[<ffffffff803b4ba8>] bus_for_each_dev+0x49/0x7e
[<ffffffff803b596f>] driver_attach+0x1b/0x1e
[<ffffffff803b516d>] bus_add_driver+0x7b/0x13a
[<ffffffff803b5e5d>] driver_register+0x8c/0x91
[<ffffffff80361bc3>] __pci_register_driver+0x60/0x84
[<ffffffff88077016>] copy_addr+0x16/0x57 [ib_addr]
[<ffffffff80253127>] sys_init_module+0xb6/0x1ce
[<ffffffff80209801>] system_call+0x7d/0x83
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8801d38c>] send_mad+0x9d/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff88021680>] __key.0+0x0/0xffffffffffffc71a [ib_sa]
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8801d38c>] send_mad+0x9d/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
-> (&mad_queue->lock){.+..} ops: 2586 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff88013555>] ib_mad_post_receive_mads+0xc0/0x1ac [ib_mad]
[<ffffffff88014cde>] ib_mad_init_device+0x3b9/0x559 [ib_mad]
[<ffffffff88004256>] ib_register_device+0x2b1/0x2dd [ib_core]
[<ffffffff88066130>] mthca_register_device+0x3db/0x436 [ib_mthca]
[<ffffffff88056fba>] mthca_init_one+0xc85/0xd89 [ib_mthca]
[<ffffffff80361e05>] pci_device_probe+0xee/0x155
[<ffffffff803b5791>] driver_probe_device+0x5d/0xbe
[<ffffffff803b5915>] __driver_attach+0x90/0xcf
[<ffffffff803b4ba8>] bus_for_each_dev+0x49/0x7e
[<ffffffff803b596f>] driver_attach+0x1b/0x1e
[<ffffffff803b516d>] bus_add_driver+0x7b/0x13a
[<ffffffff803b5e5d>] driver_register+0x8c/0x91
[<ffffffff80361bc3>] __pci_register_driver+0x60/0x84
[<ffffffff88077016>] copy_addr+0x16/0x57 [ib_addr]
[<ffffffff80253127>] sys_init_module+0xb6/0x1ce
[<ffffffff80209801>] system_call+0x7d/0x83
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff880119ef>] ib_send_mad+0xb3/0x170 [ib_mad]
[<ffffffff88012227>] ib_post_send_mad+0x4d4/0x567 [ib_mad]
[<ffffffff8801d3d2>] send_mad+0xe3/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff8801b48c>] __key.2+0x0/0xffffffffffffb0e0 [ib_mad]
-> (&qp->sq.lock){.+..} ops: 156 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c69>] _spin_lock_irq+0x27/0x34
[<ffffffff8805fc42>] mthca_modify_qp+0x68/0xcd8 [ib_mthca]
[<ffffffff88002b07>] ib_modify_qp+0xc/0xf [ib_core]
[<ffffffff88014bfc>] ib_mad_init_device+0x2d7/0x559 [ib_mad]
[<ffffffff88004256>] ib_register_device+0x2b1/0x2dd [ib_core]
[<ffffffff88066130>] mthca_register_device+0x3db/0x436 [ib_mthca]
[<ffffffff88056fba>] mthca_init_one+0xc85/0xd89 [ib_mthca]
[<ffffffff80361e05>] pci_device_probe+0xee/0x155
[<ffffffff803b5791>] driver_probe_device+0x5d/0xbe
[<ffffffff803b5915>] __driver_attach+0x90/0xcf
[<ffffffff803b4ba8>] bus_for_each_dev+0x49/0x7e
[<ffffffff803b596f>] driver_attach+0x1b/0x1e
[<ffffffff803b516d>] bus_add_driver+0x7b/0x13a
[<ffffffff803b5e5d>] driver_register+0x8c/0x91
[<ffffffff80361bc3>] __pci_register_driver+0x60/0x84
[<ffffffff88077016>] copy_addr+0x16/0x57 [ib_addr]
[<ffffffff80253127>] sys_init_module+0xb6/0x1ce
[<ffffffff80209801>] system_call+0x7d/0x83
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff88061757>] mthca_tavor_post_send+0x3c/0x512 [ib_mthca]
[<ffffffff88011a24>] ib_send_mad+0xe8/0x170 [ib_mad]
[<ffffffff88012227>] ib_post_send_mad+0x4d4/0x567 [ib_mad]
[<ffffffff8801d3d2>] send_mad+0xe3/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff880756d8>] __key.2+0x0/0xffffffffffff309e [ib_mthca]
-> (&qp->rq.lock){+...} ops: 2463 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8805fc4a>] mthca_modify_qp+0x70/0xcd8 [ib_mthca]
[<ffffffff88002b07>] ib_modify_qp+0xc/0xf [ib_core]
[<ffffffff88014bfc>] ib_mad_init_device+0x2d7/0x559 [ib_mad]
[<ffffffff88004256>] ib_register_device+0x2b1/0x2dd [ib_core]
[<ffffffff88066130>] mthca_register_device+0x3db/0x436 [ib_mthca]
[<ffffffff88056fba>] mthca_init_one+0xc85/0xd89 [ib_mthca]
[<ffffffff80361e05>] pci_device_probe+0xee/0x155
[<ffffffff803b5791>] driver_probe_device+0x5d/0xbe
[<ffffffff803b5915>] __driver_attach+0x90/0xcf
[<ffffffff803b4ba8>] bus_for_each_dev+0x49/0x7e
[<ffffffff803b596f>] driver_attach+0x1b/0x1e
[<ffffffff803b516d>] bus_add_driver+0x7b/0x13a
[<ffffffff803b5e5d>] driver_register+0x8c/0x91
[<ffffffff80361bc3>] __pci_register_driver+0x60/0x84
[<ffffffff88077016>] copy_addr+0x16/0x57 [ib_addr]
[<ffffffff80253127>] sys_init_module+0xb6/0x1ce
[<ffffffff80209801>] system_call+0x7d/0x83
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff88061c65>] mthca_tavor_post_receive+0x38/0x2ef [ib_mthca]
[<ffffffff8804814a>] ipoib_ib_post_receive+0x81/0xfb [ib_ipoib]
[<ffffffff8804853b>] ipoib_ib_completion+0x29d/0x422 [ib_ipoib]
[<ffffffff8805cdc4>] mthca_cq_completion+0x68/0x6e [ib_mthca]
[<ffffffff8805b5dc>] mthca_eq_int+0x84/0x3d7 [ib_mthca]
[<ffffffff8805b98d>] mthca_tavor_interrupt+0x5e/0xdc [ib_mthca]
[<ffffffff8025b164>] handle_IRQ_event+0x29/0x62
[<ffffffff8025b24a>] __do_IRQ+0xad/0x11d
[<ffffffff8020c0ee>] do_IRQ+0x106/0x118
[<ffffffff80209d39>] common_interrupt+0x65/0x66
}
... key at: [<ffffffff880756e0>] __key.3+0x0/0xffffffffffff3096 [ib_mthca]
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8805fc4a>] mthca_modify_qp+0x70/0xcd8 [ib_mthca]
[<ffffffff88002b07>] ib_modify_qp+0xc/0xf [ib_core]
[<ffffffff88014bfc>] ib_mad_init_device+0x2d7/0x559 [ib_mad]
[<ffffffff88004256>] ib_register_device+0x2b1/0x2dd [ib_core]
[<ffffffff88066130>] mthca_register_device+0x3db/0x436 [ib_mthca]
[<ffffffff88056fba>] mthca_init_one+0xc85/0xd89 [ib_mthca]
[<ffffffff80361e05>] pci_device_probe+0xee/0x155
[<ffffffff803b5791>] driver_probe_device+0x5d/0xbe
[<ffffffff803b5915>] __driver_attach+0x90/0xcf
[<ffffffff803b4ba8>] bus_for_each_dev+0x49/0x7e
[<ffffffff803b596f>] driver_attach+0x1b/0x1e
[<ffffffff803b516d>] bus_add_driver+0x7b/0x13a
[<ffffffff803b5e5d>] driver_register+0x8c/0x91
[<ffffffff80361bc3>] __pci_register_driver+0x60/0x84
[<ffffffff88077016>] copy_addr+0x16/0x57 [ib_addr]
[<ffffffff80253127>] sys_init_module+0xb6/0x1ce
[<ffffffff80209801>] system_call+0x7d/0x83
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff88061757>] mthca_tavor_post_send+0x3c/0x512 [ib_mthca]
[<ffffffff88011a24>] ib_send_mad+0xe8/0x170 [ib_mad]
[<ffffffff88012227>] ib_post_send_mad+0x4d4/0x567 [ib_mad]
[<ffffffff8801d3d2>] send_mad+0xe3/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff88049d1c>] ipoib_mcast_join+0x166/0x1f8 [ib_ipoib]
[<ffffffff88049fd3>] ipoib_mcast_join_task+0x225/0x2c1 [ib_ipoib]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff880119ef>] ib_send_mad+0xb3/0x170 [ib_mad]
[<ffffffff88012227>] ib_post_send_mad+0x4d4/0x567 [ib_mad]
[<ffffffff8801d3d2>] send_mad+0xe3/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
-> (&qp->sq.lock){.+..} ops: 156 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c69>] _spin_lock_irq+0x27/0x34
[<ffffffff8805fc42>] mthca_modify_qp+0x68/0xcd8 [ib_mthca]
[<ffffffff88002b07>] ib_modify_qp+0xc/0xf [ib_core]
[<ffffffff88014bfc>] ib_mad_init_device+0x2d7/0x559 [ib_mad]
[<ffffffff88004256>] ib_register_device+0x2b1/0x2dd [ib_core]
[<ffffffff88066130>] mthca_register_device+0x3db/0x436 [ib_mthca]
[<ffffffff88056fba>] mthca_init_one+0xc85/0xd89 [ib_mthca]
[<ffffffff80361e05>] pci_device_probe+0xee/0x155
[<ffffffff803b5791>] driver_probe_device+0x5d/0xbe
[<ffffffff803b5915>] __driver_attach+0x90/0xcf
[<ffffffff803b4ba8>] bus_for_each_dev+0x49/0x7e
[<ffffffff803b596f>] driver_attach+0x1b/0x1e
[<ffffffff803b516d>] bus_add_driver+0x7b/0x13a
[<ffffffff803b5e5d>] driver_register+0x8c/0x91
[<ffffffff80361bc3>] __pci_register_driver+0x60/0x84
[<ffffffff88077016>] copy_addr+0x16/0x57 [ib_addr]
[<ffffffff80253127>] sys_init_module+0xb6/0x1ce
[<ffffffff80209801>] system_call+0x7d/0x83
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff88061757>] mthca_tavor_post_send+0x3c/0x512 [ib_mthca]
[<ffffffff88011a24>] ib_send_mad+0xe8/0x170 [ib_mad]
[<ffffffff88012227>] ib_post_send_mad+0x4d4/0x567 [ib_mad]
[<ffffffff8801d3d2>] send_mad+0xe3/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff880756d8>] __key.2+0x0/0xffffffffffff309e [ib_mthca]
-> (&qp->rq.lock){+...} ops: 2463 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8805fc4a>] mthca_modify_qp+0x70/0xcd8 [ib_mthca]
[<ffffffff88002b07>] ib_modify_qp+0xc/0xf [ib_core]
[<ffffffff88014bfc>] ib_mad_init_device+0x2d7/0x559 [ib_mad]
[<ffffffff88004256>] ib_register_device+0x2b1/0x2dd [ib_core]
[<ffffffff88066130>] mthca_register_device+0x3db/0x436 [ib_mthca]
[<ffffffff88056fba>] mthca_init_one+0xc85/0xd89 [ib_mthca]
[<ffffffff80361e05>] pci_device_probe+0xee/0x155
[<ffffffff803b5791>] driver_probe_device+0x5d/0xbe
[<ffffffff803b5915>] __driver_attach+0x90/0xcf
[<ffffffff803b4ba8>] bus_for_each_dev+0x49/0x7e
[<ffffffff803b596f>] driver_attach+0x1b/0x1e
[<ffffffff803b516d>] bus_add_driver+0x7b/0x13a
[<ffffffff803b5e5d>] driver_register+0x8c/0x91
[<ffffffff80361bc3>] __pci_register_driver+0x60/0x84
[<ffffffff88077016>] copy_addr+0x16/0x57 [ib_addr]
[<ffffffff80253127>] sys_init_module+0xb6/0x1ce
[<ffffffff80209801>] system_call+0x7d/0x83
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff88061c65>] mthca_tavor_post_receive+0x38/0x2ef [ib_mthca]
[<ffffffff8804814a>] ipoib_ib_post_receive+0x81/0xfb [ib_ipoib]
[<ffffffff8804853b>] ipoib_ib_completion+0x29d/0x422 [ib_ipoib]
[<ffffffff8805cdc4>] mthca_cq_completion+0x68/0x6e [ib_mthca]
[<ffffffff8805b5dc>] mthca_eq_int+0x84/0x3d7 [ib_mthca]
[<ffffffff8805b98d>] mthca_tavor_interrupt+0x5e/0xdc [ib_mthca]
[<ffffffff8025b164>] handle_IRQ_event+0x29/0x62
[<ffffffff8025b24a>] __do_IRQ+0xad/0x11d
[<ffffffff8020c0ee>] do_IRQ+0x106/0x118
[<ffffffff80209d39>] common_interrupt+0x65/0x66
}
... key at: [<ffffffff880756e0>] __key.3+0x0/0xffffffffffff3096 [ib_mthca]
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8805fc4a>] mthca_modify_qp+0x70/0xcd8 [ib_mthca]
[<ffffffff88002b07>] ib_modify_qp+0xc/0xf [ib_core]
[<ffffffff88014bfc>] ib_mad_init_device+0x2d7/0x559 [ib_mad]
[<ffffffff88004256>] ib_register_device+0x2b1/0x2dd [ib_core]
[<ffffffff88066130>] mthca_register_device+0x3db/0x436 [ib_mthca]
[<ffffffff88056fba>] mthca_init_one+0xc85/0xd89 [ib_mthca]
[<ffffffff80361e05>] pci_device_probe+0xee/0x155
[<ffffffff803b5791>] driver_probe_device+0x5d/0xbe
[<ffffffff803b5915>] __driver_attach+0x90/0xcf
[<ffffffff803b4ba8>] bus_for_each_dev+0x49/0x7e
[<ffffffff803b596f>] driver_attach+0x1b/0x1e
[<ffffffff803b516d>] bus_add_driver+0x7b/0x13a
[<ffffffff803b5e5d>] driver_register+0x8c/0x91
[<ffffffff80361bc3>] __pci_register_driver+0x60/0x84
[<ffffffff88077016>] copy_addr+0x16/0x57 [ib_addr]
[<ffffffff80253127>] sys_init_module+0xb6/0x1ce
[<ffffffff80209801>] system_call+0x7d/0x83
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff88061757>] mthca_tavor_post_send+0x3c/0x512 [ib_mthca]
[<ffffffff880487d7>] ipoib_send+0x117/0x1d6 [ib_ipoib]
[<ffffffff8804a832>] ipoib_mcast_send+0x3f2/0x40a [ib_ipoib]
[<ffffffff88046f31>] ipoib_path_lookup+0x213/0x223 [ib_ipoib]
[<ffffffff8804706a>] ipoib_start_xmit+0x129/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff804cc339>] neigh_connected_output+0xb2/0xd2
[<ffffffff8050efcf>] ip6_output2+0x24f/0x284
[<ffffffff8051011c>] ip6_output+0x88a/0x89a
[<ffffffff8051d8f4>] ndisc_send_ns+0x36c/0x49d
[<ffffffff80514455>] addrconf_dad_timer+0xf8/0x119
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
-> (query_idr.lock){.+..} ops: 142 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8035586e>] free_layer+0x1c/0x3f
[<ffffffff803558c6>] idr_pre_get+0x35/0x42
[<ffffffff8801d315>] send_mad+0x26/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff88049d1c>] ipoib_mcast_join+0x166/0x1f8 [ib_ipoib]
[<ffffffff88049fd3>] ipoib_mcast_join_task+0x225/0x2c1 [ib_ipoib]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8035586e>] free_layer+0x1c/0x3f
[<ffffffff803558c6>] idr_pre_get+0x35/0x42
[<ffffffff8801d315>] send_mad+0x26/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88046f31>] ipoib_path_lookup+0x213/0x223 [ib_ipoib]
[<ffffffff8804706a>] ipoib_start_xmit+0x129/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff804cc339>] neigh_connected_output+0xb2/0xd2
[<ffffffff8050efcf>] ip6_output2+0x24f/0x284
[<ffffffff8051011c>] ip6_output+0x88a/0x89a
[<ffffffff8051dd10>] ndisc_send_rs+0x2eb/0x41c
[<ffffffff80514310>] addrconf_dad_completed+0x8e/0xdb
[<ffffffff805143cd>] addrconf_dad_timer+0x70/0x119
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff88020370>] query_idr+0x30/0xffffffffffffda5a [ib_sa]
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff8035586e>] free_layer+0x1c/0x3f
[<ffffffff803558c6>] idr_pre_get+0x35/0x42
[<ffffffff8801d315>] send_mad+0x26/0x142 [ib_sa]
[<ffffffff8801d5e1>] ib_sa_mcmember_rec_query+0x14a/0x17f [ib_sa]
[<ffffffff8804a71d>] ipoib_mcast_send+0x2dd/0x40a [ib_ipoib]
[<ffffffff88046f31>] ipoib_path_lookup+0x213/0x223 [ib_ipoib]
[<ffffffff8804706a>] ipoib_start_xmit+0x129/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff804cc339>] neigh_connected_output+0xb2/0xd2
[<ffffffff8050efcf>] ip6_output2+0x24f/0x284
[<ffffffff8051011c>] ip6_output+0x88a/0x89a
[<ffffffff8051dd10>] ndisc_send_rs+0x2eb/0x41c
[<ffffffff80514310>] addrconf_dad_completed+0x8e/0xdb
[<ffffffff805143cd>] addrconf_dad_timer+0x70/0x119
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff880488cc>] __ipoib_reap_ah+0x36/0xd1 [ib_ipoib]
[<ffffffff88048975>] ipoib_reap_ah+0xe/0x35 [ib_ipoib]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (&list->lock#4){.+..} ops: 10 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff804c0dba>] skb_queue_tail+0x1c/0x47
[<ffffffff8804a5d3>] ipoib_mcast_send+0x193/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff804c0dba>] skb_queue_tail+0x1c/0x47
[<ffffffff8804a5d3>] ipoib_mcast_send+0x193/0x40a [ib_ipoib]
[<ffffffff88047146>] ipoib_start_xmit+0x205/0x4b2 [ib_ipoib]
[<ffffffff804c693f>] dev_hard_start_xmit+0x1af/0x223
[<ffffffff804d3c2d>] __qdisc_run+0xf7/0x1d1
[<ffffffff804c6adf>] dev_queue_xmit+0x12c/0x245
[<ffffffff805254e6>] mld_sendpack+0x13e/0x263
[<ffffffff80527c62>] mld_ifc_timer_expire+0x1df/0x218
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffffffff880531b4>] __key.0+0x0/0xffffffffffff8be3 [ib_ipoib]
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546c31>] _spin_lock_irqsave+0x2b/0x3c
[<ffffffff804c28c5>] skb_dequeue+0x1b/0x5c
[<ffffffff880498da>] ipoib_mcast_sendonly_join_complete+0xdb/0x10f [ib_ipoib]
[<ffffffff8801d9f4>] ib_sa_mcmember_rec_callback+0x4b/0x57 [ib_sa]
[<ffffffff8801dafc>] recv_handler+0x3e/0x4b [ib_sa]
[<ffffffff88013e8e>] ib_mad_completion_handler+0x3b9/0x595 [ib_mad]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
-> (&rq->rq_lock_key#4){++..} ops: 122452 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff8022d337>] migration_call+0x94/0x453
[<ffffffff805494f0>] notifier_call_chain+0x28/0x3b
[<ffffffff8023fb65>] blocking_notifier_call_chain+0x26/0x3d
[<ffffffff8025061b>] cpu_up+0x54/0xf1
[<ffffffff802070d5>] init+0x88/0x30f
[<ffffffff8020a751>] child_rip+0x7/0x12
in-hardirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8022b4e9>] scheduler_tick+0x6b/0x336
[<ffffffff8023ba43>] update_process_times+0x64/0x76
[<ffffffff8021931e>] smp_local_timer_interrupt+0x27/0x4d
[<ffffffff80219398>] smp_apic_timer_interrupt+0x54/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
in-softirq-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022b9a4>] default_wake_function+0xc/0xf
[<ffffffff8022b9e9>] __wake_up_common+0x42/0x62
[<ffffffff8022ba3e>] __wake_up+0x35/0x4e
[<ffffffff802424be>] __queue_work+0x52/0x66
[<ffffffff80242566>] delayed_work_timer_fn+0x38/0x3b
[<ffffffff8023b95d>] run_timer_softirq+0x168/0x1d5
[<ffffffff80237bde>] __do_softirq+0x67/0xf2
[<ffffffff8020aaab>] call_softirq+0x1b/0x28
[<ffffffff8020c20a>] do_softirq+0x35/0x9f
[<ffffffff80237cbf>] irq_exit+0x56/0x59
[<ffffffff8021939d>] smp_apic_timer_interrupt+0x59/0x5e
[<ffffffff8020a422>] apic_timer_interrupt+0x6a/0x70
}
... key at: [<ffff81000105ea90>] 0xffff81000105ea90
... acquired at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff802295bf>] task_rq_lock+0x41/0x74
[<ffffffff80229d60>] try_to_wake_up+0x32/0x3df
[<ffffffff8022a11c>] wake_up_process+0xf/0x12
[<ffffffff80237d14>] raise_softirq_irqoff+0x52/0x55
[<ffffffff804c63fe>] dev_kfree_skb_any+0x66/0x8e
[<ffffffff880498e2>] ipoib_mcast_sendonly_join_complete+0xe3/0x10f [ib_ipoib]
[<ffffffff8801d9f4>] ib_sa_mcmember_rec_callback+0x4b/0x57 [ib_sa]
[<ffffffff8801dafc>] recv_handler+0x3e/0x4b [ib_sa]
[<ffffffff88013e8e>] ib_mad_completion_handler+0x3b9/0x595 [ib_mad]
[<ffffffff80242700>] run_workqueue+0xa7/0xf2
[<ffffffff80242846>] worker_thread+0xfb/0x12f
[<ffffffff80245ca3>] kthread+0xcf/0xfc
[<ffffffff8020a751>] child_rip+0x7/0x12
the hard-irq-unsafe lock's dependencies:
-> (&alloc->lock){--..} ops: 57 {
initial-use at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8805ae8e>] mthca_alloc+0x12/0x7b [ib_mthca]
[<ffffffff8806735c>] mthca_uar_alloc+0x18/0x4d [ib_mthca]
[<ffffffff88056b2e>] mthca_init_one+0x7f9/0xd89 [ib_mthca]
[<ffffffff80361e05>] pci_device_probe+0xee/0x155
[<ffffffff803b5791>] driver_probe_device+0x5d/0xbe
[<ffffffff803b5915>] __driver_attach+0x90/0xcf
[<ffffffff803b4ba8>] bus_for_each_dev+0x49/0x7e
[<ffffffff803b596f>] driver_attach+0x1b/0x1e
[<ffffffff803b516d>] bus_add_driver+0x7b/0x13a
[<ffffffff803b5e5d>] driver_register+0x8c/0x91
[<ffffffff80361bc3>] __pci_register_driver+0x60/0x84
[<ffffffff88077016>] copy_addr+0x16/0x57 [ib_addr]
[<ffffffff80253127>] sys_init_module+0xb6/0x1ce
[<ffffffff80209801>] system_call+0x7d/0x83
softirq-on-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8805ae8e>] mthca_alloc+0x12/0x7b [ib_mthca]
[<ffffffff8806735c>] mthca_uar_alloc+0x18/0x4d [ib_mthca]
[<ffffffff88056b2e>] mthca_init_one+0x7f9/0xd89 [ib_mthca]
[<ffffffff80361e05>] pci_device_probe+0xee/0x155
[<ffffffff803b5791>] driver_probe_device+0x5d/0xbe
[<ffffffff803b5915>] __driver_attach+0x90/0xcf
[<ffffffff803b4ba8>] bus_for_each_dev+0x49/0x7e
[<ffffffff803b596f>] driver_attach+0x1b/0x1e
[<ffffffff803b516d>] bus_add_driver+0x7b/0x13a
[<ffffffff803b5e5d>] driver_register+0x8c/0x91
[<ffffffff80361bc3>] __pci_register_driver+0x60/0x84
[<ffffffff88077016>] copy_addr+0x16/0x57 [ib_addr]
[<ffffffff80253127>] sys_init_module+0xb6/0x1ce
[<ffffffff80209801>] system_call+0x7d/0x83
hardirq-on-W at:
[<ffffffff8024c1ae>] lock_acquire+0x7a/0xa1
[<ffffffff80546bf9>] _spin_lock+0x21/0x2e
[<ffffffff8805ae8e>] mthca_alloc+0x12/0x7b [ib_mthca]
[<ffffffff8806735c>] mthca_uar_alloc+0x18/0x4d [ib_mthca]
[<ffffffff88056b2e>] mthca_init_one+0x7f9/0xd89 [ib_mthca]
[<ffffffff80361e05>] pci_device_probe+0xee/0x155
[<ffffffff803b5791>] driver_probe_device+0x5d/0xbe
[<ffffffff803b5915>] __driver_attach+0x90/0xcf
[<ffffffff803b4ba8>] bus_for_each_dev+0x49/0x7e
[<ffffffff803b596f>] driver_attach+0x1b/0x1e
[<ffffffff803b516d>] bus_add_driver+0x7b/0x13a
[<ffffffff803b5e5d>] driver_register+0x8c/0x91
[<ffffffff80361bc3>] __pci_register_driver+0x60/0x84
[<ffffffff88077016>] copy_addr+0x16/0x57 [ib_addr]
[<ffffffff80253127>] sys_init_module+0xb6/0x1ce
[<ffffffff80209801>] system_call+0x7d/0x83
}
... key at: [<ffffffff880756a8>] __key.0+0x0/0xffffffffffff30ce [ib_mthca]
stack backtrace:
Call Trace:
[<ffffffff8020ad32>] show_trace+0xb8/0x335
[<ffffffff8020afc2>] dump_stack+0x13/0x15
[<ffffffff8024a0fe>] check_usage+0x279/0x28a
[<ffffffff8024ba74>] __lock_acquire+0x956/0xb8e
[<ffffffff8024c1af>] lock_acquire+0x7b/0xa1
[<ffffffff80546bfa>] _spin_lock+0x22/0x2e
[<ffffffff8805af1b>] :ib_mthca:mthca_free+0x24/0x54
[<ffffffff88062c4f>] :ib_mthca:mthca_destroy_ah+0x30/0x55
[<ffffffff88064ad3>] :ib_mthca:mthca_ah_destroy+0x14/0x22
[<ffffffff880028f8>] :ib_core:ib_destroy_ah+0x13/0x1f
[<ffffffff88048925>] :ib_ipoib:__ipoib_reap_ah+0x8f/0xd1
[<ffffffff88048976>] :ib_ipoib:ipoib_reap_ah+0xf/0x35
[<ffffffff80242701>] run_workqueue+0xa8/0xf2
[<ffffffff80242847>] worker_thread+0xfc/0x12f
[<ffffffff80245ca4>] kthread+0xd0/0xfc
[<ffffffff8020a752>] child_rip+0x8/0x12
DWARF2 unwinder stuck at child_rip+0x8/0x12
Leftover inexact backtrace:
[<ffffffff80546f3c>] _spin_unlock_irq+0x29/0x2f
[<ffffffff80209d90>] restore_args+0x0/0x30
[<ffffffff80245bd4>] kthread+0x0/0xfc
[<ffffffff8020a74a>] child_rip+0x0/0x12
BUG: soft lockup detected on CPU#0!
ib0: multicast join failed for ff12:401b:ffff:0000:0000:0000:ffff:ffff, status -22
Call Trace:
[<ffffffff8020ad32>] show_trace+0xb8/0x335
[<ffffffff8020afc2>] dump_stack+0x13/0x15
[<ffffffff8025ab1b>] softlockup_tick+0xd8/0xef
[<ffffffff8023b9dd>] run_local_timers+0x13/0x15
[<ffffffff8023ba28>] update_process_times+0x49/0x76
[<ffffffff8021931f>] smp_local_timer_interrupt+0x28/0x4d
[<ffffffff80219399>] smp_apic_timer_interrupt+0x55/0x5e
[<ffffffff8020a423>] apic_timer_interrupt+0x6b/0x70
[<ffffffff80207f1c>] mwait_idle+0x3f/0x54
[<ffffffff80207eba>] cpu_idle+0x9f/0xc2
[<ffffffff8020702b>] rest_init+0x2b/0x2d
[<ffffffff80a6d877>] start_kernel+0x22c/0x22e
[<ffffffff80a6d2ac>] _sinittext+0x2ac/0x2b3
<IRQ> [<ffffffff8025ab1b>] softlockup_tick+0xd8/0xef
[<ffffffff8023b9dd>] run_local_timers+0x13/0x15
[<ffffffff8023ba28>] update_process_times+0x49/0x76
[<ffffffff8021931f>] smp_local_timer_interrupt+0x28/0x4d
[<ffffffff80219399>] smp_apic_timer_interrupt+0x55/0x5e
[<ffffffff80207edd>] mwait_idle+0x0/0x54
[<ffffffff8020a423>] apic_timer_interrupt+0x6b/0x70
<EOI> [<ffffffff80207f1c>] mwait_idle+0x3f/0x54
[<ffffffff80207eba>] cpu_idle+0x9f/0xc2
[<ffffffff8020702b>] rest_init+0x2b/0x2d
[<ffffffff80a6d877>] start_kernel+0x22c/0x22e
[<ffffffff80a6d2ac>] _sinittext+0x2ac/0x2b3
BUG: soft lockup detected on CPU#3!
Call Trace:
[<ffffffff8020ad32>] show_trace+0xb8/0x335
[<ffffffff8020afc2>] dump_stack+0x13/0x15
[<ffffffff8025ab1b>] softlockup_tick+0xd8/0xef
[<ffffffff8023b9dd>] run_local_timers+0x13/0x15
[<ffffffff8023ba28>] update_process_times+0x49/0x76
[<ffffffff8021931f>] smp_local_timer_interrupt+0x28/0x4d
[<ffffffff80219399>] smp_apic_timer_interrupt+0x55/0x5e
[<ffffffff8020a423>] apic_timer_interrupt+0x6b/0x70
[<ffffffff80207f1c>] mwait_idle+0x3f/0x54
[<ffffffff80207eba>] cpu_idle+0x9f/0xc2
[<ffffffff8021818c>] start_secondary+0x44b/0x45a
<IRQ> [<ffffffff8025ab1b>] softlockup_tick+0xd8/0xef
[<ffffffff8023b9dd>] run_local_timers+0x13/0x15
[<ffffffff8023ba28>] update_process_times+0x49/0x76
[<ffffffff8021931f>] smp_local_timer_interrupt+0x28/0x4d
[<ffffffff80219399>] smp_apic_timer_interrupt+0x55/0x5e
[<ffffffff80207edd>] mwait_idle+0x0/0x54
[<ffffffff8020a423>] apic_timer_interrupt+0x6b/0x70
<EOI> [<ffffffff80207f1c>] mwait_idle+0x3f/0x54
[<ffffffff80207eba>] cpu_idle+0x9f/0xc2
[<ffffffff8021818c>] start_secondary+0x44b/0x45a
BUG: soft lockup detected on CPU#2!
Call Trace:
[<ffffffff8020ad32>] show_trace+0xb8/0x335
[<ffffffff8020afc2>] dump_stack+0x13/0x15
[<ffffffff8025ab1b>] softlockup_tick+0xd8/0xef
[<ffffffff8023b9dd>] run_local_timers+0x13/0x15
[<ffffffff8023ba28>] update_process_times+0x49/0x76
[<ffffffff8021931f>] smp_local_timer_interrupt+0x28/0x4d
[<ffffffff80219399>] smp_apic_timer_interrupt+0x55/0x5e
[<ffffffff8020a423>] apic_timer_interrupt+0x6b/0x70
[<ffffffff80207f1c>] mwait_idle+0x3f/0x54
[<ffffffff80207eba>] cpu_idle+0x9f/0xc2
[<ffffffff8021818c>] start_secondary+0x44b/0x45a
<IRQ> [<ffffffff8025ab1b>] softlockup_tick+0xd8/0xef
[<ffffffff8023b9dd>] run_local_timers+0x13/0x15
[<ffffffff8023ba28>] update_process_times+0x49/0x76
[<ffffffff8021931f>] smp_local_timer_interrupt+0x28/0x4d
[<ffffffff80219399>] smp_apic_timer_interrupt+0x55/0x5e
[<ffffffff80207edd>] mwait_idle+0x0/0x54
[<ffffffff8020a423>] apic_timer_interrupt+0x6b/0x70
<EOI> [<ffffffff80207f1c>] mwait_idle+0x3f/0x54
[<ffffffff80207eba>] cpu_idle+0x9f/0xc2
[<ffffffff8021818c>] start_secondary+0x44b/0x45a
ib0: multicast join failed for ff12:401b:ffff:0000:0000:0000:ffff:ffff, status -22
ib0: multicast join failed for ff12:401b:ffff:0000:0000:0000:ffff:ffff, status -22
ib0: multicast join failed for ff12:401b:ffff:0000:0000:0000:ffff:ffff, status -22
ib0: multicast join failed for ff12:401b:ffff:0000:0000:0000:ffff:ffff, status -22
ib0: multicast join failed for ff12:401b:ffff:0000:0000:0000:ffff:ffff, status -22
ib0: multicast join failed for ff12:401b:ffff:0000:0000:0000:ffff:ffff, status -22
More information about the general
mailing list