[openib-general] uCMA kernel slab corruption and oops

Arlin Davis ardavis at ichips.intel.com
Thu Jun 22 11:12:25 PDT 2006


Sean,

I am running a couple of iMPI/uDAPL benchmarks at the same time and ran 
into this:  (2.6.17 kernel and svn8112)

Jun 22 10:46:51 localhost kernel: Slab corruption: 
start=ffff8100202458f8, len=512
Jun 22 10:46:51 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 10:46:51 localhost kernel: Last user: 
[<ffffffff8807fc41>](rdma_destroy_id+0x188/0x193 [rdma_cm])
Jun 22 10:46:51 localhost kernel: 0f0: 6b 6b 6b 6b 6b 6b 6b 6b 18 be 2d 
37 00 81 ff ff
Jun 22 10:46:51 localhost kernel: Prev obj: start=ffff8100202456e0, len=512
Jun 22 10:46:51 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 10:46:51 localhost kernel: Last user: 
[<ffffffff88086599>](ucma_get_event+0x202/0x21f [rdma_ucm])
Jun 22 10:46:51 localhost kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 10:46:51 localhost kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 10:46:51 localhost kernel: Next obj: start=ffff810020245b10, len=512
Jun 22 10:46:51 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 10:46:51 localhost kernel: Last user: 
[<ffffffff804762c2>](skb_release_data+0x92/0x97)
Jun 22 10:46:51 localhost kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 10:46:51 localhost kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b

Jun 22 10:46:53 localhost kernel: Slab corruption: 
start=ffff8100202458f8, len=512
Jun 22 10:46:53 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 10:46:53 localhost kernel: Last user: 
[<ffffffff804762c2>](skb_release_data+0x92/0x97)
Jun 22 10:46:53 localhost kernel: 0f0: 40 5c 3c 18 00 81 ff ff 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 10:46:53 localhost kernel: Prev obj: start=ffff8100202456e0, len=512
Jun 22 10:46:53 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 10:46:53 localhost kernel: Last user: 
[<ffffffff88086599>](ucma_get_event+0x202/0x21f [rdma_ucm])
Jun 22 10:46:53 localhost kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 10:46:53 localhost kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 10:46:53 localhost kernel: Next obj: start=ffff810020245b10, len=512
Jun 22 10:46:53 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 10:46:53 localhost kernel: Last user: 
[<ffffffff804762c2>](skb_release_data+0x92/0x97)
Jun 22 10:46:53 localhost kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 10:46:53 localhost kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b

Jun 22 11:01:01 localhost kernel: Slab corruption: 
start=ffff8100202458f8, len=512
Jun 22 11:01:01 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:01:01 localhost kernel: Last user: 
[<ffffffff88069831>](ib_destroy_cm_id+0x23b/0x246 [ib_cm])
Jun 22 11:01:01 localhost kernel: 0f0: d0 79 4c 2d 00 81 ff ff 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:01:01 localhost kernel: Prev obj: start=ffff8100202456e0, len=512
Jun 22 11:01:01 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:01:01 localhost kernel: Last user: 
[<ffffffff802a1a8e>](load_elf_interp+0x411/0x423)
Jun 22 11:01:01 localhost kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:01:01 localhost kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:01:01 localhost kernel: Next obj: start=ffff810020245b10, len=512
Jun 22 11:01:01 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:01:01 localhost kernel: Last user: 
[<ffffffff804762c2>](skb_release_data+0x92/0x97)
Jun 22 11:01:01 localhost kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:01:01 localhost kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b

Jun 22 11:22:33 localhost kernel: Slab corruption: 
start=ffff8100202458f8, len=512
Jun 22 11:22:33 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:22:33 localhost kernel: Last user: 
[<ffffffff802a1a8e>](load_elf_interp+0x411/0x423)
Jun 22 11:22:33 localhost kernel: 0f0: a0 83 9e 21 00 81 ff ff 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:33 localhost kernel: Prev obj: start=ffff8100202456e0, len=512
Jun 22 11:22:33 localhost kernel: Redzone: 0x170fc2a5/0x170fc2a5.
Jun 22 11:22:33 localhost kernel: Last user: 
[<ffffffff880346bb>](mthca_create_qp+0x48/0x275 [ib_mthca])
Jun 22 11:22:33 localhost kernel: 000: 00 40 6a 3d 00 81 ff ff 38 96 d4 
3a 00 81 ff ff
Jun 22 11:22:33 localhost kernel: 010: 48 15 64 29 00 81 ff ff 48 15 64 
29 00 81 ff ff
Jun 22 11:22:33 localhost kernel: Next obj: start=ffff810020245b10, len=512
Jun 22 11:22:33 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:22:33 localhost kernel: Last user: 
[<ffffffff802a1a8e>](load_elf_interp+0x411/0x423)
Jun 22 11:22:33 localhost kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:33 localhost kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b

Jun 22 11:22:43 localhost kernel: Slab corruption: 
start=ffff8100202458f8, len=512
Jun 22 11:22:43 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:22:43 localhost kernel: Last user: 
[<ffffffff8803494f>](mthca_destroy_qp+0x67/0x70 [ib_mthca])
Jun 22 11:22:43 localhost kernel: 0f0: d8 cd c0 36 00 81 ff ff 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:43 localhost kernel: Prev obj: start=ffff8100202456e0, len=512
Jun 22 11:22:43 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:22:43 localhost kernel: Last user: 
[<ffffffff8803494f>](mthca_destroy_qp+0x67/0x70 [ib_mthca])
Jun 22 11:22:43 localhost kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b

Jun 22 11:22:49 localhost kernel: Slab corruption: 
start=ffff8100202458f8, len=512
Jun 22 11:22:49 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:22:49 localhost kernel: Last user: 
[<ffffffff88069831>](ib_destroy_cm_id+0x23b/0x246 [ib_cm])
Jun 22 11:22:49 localhost kernel: 0f0: d8 cd c0 36 00 81 ff ff 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:49 localhost kernel: Prev obj: start=ffff8100202456e0, len=512
Jun 22 11:22:49 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:22:49 localhost kernel: Last user: 
[<ffffffff8803494f>](mthca_destroy_qp+0x67/0x70 [ib_mthca])
Jun 22 11:22:49 localhost kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:49 localhost kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:49 localhost kernel: Next obj: start=ffff810020245b10, len=512
Jun 22 11:22:49 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:22:49 localhost kernel: Last user: 
[<ffffffff8803494f>](mthca_destroy_qp+0x67/0x70 [ib_mthca])
Jun 22 11:22:49 localhost kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:49 localhost kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b

Jun 22 11:22:51 localhost kernel: Slab corruption: 
start=ffff8100202458f8, len=512
Jun 22 11:22:51 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:22:51 localhost kernel: Last user: 
[<ffffffff880677bc>](cm_free_work+0x23/0x2a [ib_cm])
Jun 22 11:22:51 localhost kernel: 0f0: d0 79 4c 2d 00 81 ff ff 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:51 localhost kernel: Prev obj: start=ffff8100202456e0, len=512
Jun 22 11:22:51 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:22:51 localhost kernel: Last user: 
[<ffffffff8803494f>](mthca_destroy_qp+0x67/0x70 [ib_mthca])
Jun 22 11:22:51 localhost kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:51 localhost kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:51 localhost kernel: Next obj: start=ffff810020245b10, len=512
Jun 22 11:22:51 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:22:51 localhost kernel: Last user: 
[<ffffffff8803494f>](mthca_destroy_qp+0x67/0x70 [ib_mthca])
Jun 22 11:22:51 localhost kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:51 localhost kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b

Jun 22 11:22:53 localhost kernel: Slab corruption: 
start=ffff8100202458f8, len=512
Jun 22 11:22:53 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:22:53 localhost kernel: Last user: 
[<ffffffff8805c6ac>](__ib_umem_release+0xac/0xd0 [ib_uverbs])
Jun 22 11:22:53 localhost kernel: 0f0: d0 79 4c 2d 00 81 ff ff 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:53 localhost kernel: Prev obj: start=ffff8100202456e0, len=512
Jun 22 11:22:53 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:22:53 localhost kernel: Last user: 
[<ffffffff804762c2>](skb_release_data+0x92/0x97)
Jun 22 11:22:53 localhost kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:53 localhost kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:53 localhost kernel: Next obj: start=ffff810020245b10, len=512
Jun 22 11:22:53 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:22:53 localhost kernel: Last user: 
[<ffffffff8803494f>](mthca_destroy_qp+0x67/0x70 [ib_mthca])
Jun 22 11:22:53 localhost kernel: 000: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:22:53 localhost kernel: 010: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 
6b 6b 6b 6b 6b

Jun 22 11:23:04 localhost kernel: Slab corruption: 
start=ffff8100202458f8, len=512
Jun 22 11:23:04 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:23:04 localhost kernel: Last user: 
[<ffffffff802a29b1>](load_elf_binary+0xf11/0x16ef)
Jun 22 11:23:04 localhost kernel: 0f0: e8 39 17 1c 00 81 ff ff 6b 6b 6b 
6b 6b 6b 6b 6b
Jun 22 11:23:04 localhost kernel: Prev obj: start=ffff8100202456e0, len=512
Jun 22 11:23:04 localhost kernel: Redzone: 0x170fc2a5/0x170fc2a5.
Jun 22 11:23:04 localhost kernel: Last user: 
[<ffffffff8806785e>](cm_create_timewait_info+0x1b/0x6b [ib_cm])
Jun 22 11:23:04 localhost kernel: 000: 00 00 00 00 00 00 00 00 e8 56 24 
20 00 81 ff ff
Jun 22 11:23:04 localhost kernel: 010: e8 56 24 20 00 81 ff ff c5 a4 06 
88 ff ff ff ff
Jun 22 11:23:04 localhost kernel: Next obj: start=ffff810020245b10, len=512
Jun 22 11:23:04 localhost kernel: Redzone: 0x170fc2a5/0x170fc2a5.
Jun 22 11:23:04 localhost kernel: Last user: 
[<ffffffff8806785e>](cm_create_timewait_info+0x1b/0x6b [ib_cm])
Jun 22 11:23:04 localhost kernel: 000: 00 00 00 00 00 00 00 00 18 5b 24 
20 00 81 ff ff
Jun 22 11:23:04 localhost kernel: 010: 18 5b 24 20 00 81 ff ff c5 a4 06 
88 ff ff ff ff


Jun 22 11:23:23 localhost kernel: general protection fault: 0000 [1] SMP
Jun 22 11:23:23 localhost kernel: CPU 0
Jun 22 11:23:23 localhost kernel: Modules linked in: rdma_ucm rdma_cm 
ib_addr ib_local_sa findex ib_ucm ib_cm ib_umad ib_uverbs ib_ipoib 
ib_multicast ib_sa ib_mthca ib_mad ib_core ixgb
Jun 22 11:23:23 localhost kernel: Pid: 4078, comm: ib_cm/0 Not tainted 
2.6.17 #1
Jun 22 11:23:23 localhost kernel: RIP: 0010:[<ffffffff80348315>] 
<ffffffff80348315>{rb_erase+465}
Jun 22 11:23:23 localhost kernel: RSP: 0000:ffff810034ba3d58  EFLAGS: 
00010002
Jun 22 11:23:23 localhost kernel: RAX: 6b6b6b6b6b6b6b6b RBX: 
ffff8100202459d0 RCX: ffff8100202459d0
Jun 22 11:23:23 localhost kernel: RDX: ffff810020245be8 RSI: 
0000000000000000 RDI: 0000000000000000
Jun 22 11:23:23 localhost kernel: RBP: ffff810034ba3d68 R08: 
0000000000000000 R09: 0000000000000000
Jun 22 11:23:23 localhost kernel: R10: ffff8100202458f8 R11: 
0000000000000200 R12: ffffffff8806e750
Jun 22 11:23:23 localhost kernel: R13: ffff810020245b10 R14: 
ffff810020245b10 R15: 0000000000000282
Jun 22 11:23:23 localhost kernel: FS:  0000000000000000(0000) 
GS:ffffffff806ef000(0000) knlGS:0000000000000000
Jun 22 11:23:23 localhost kernel: CS:  0010 DS: 0018 ES: 0018 CR0: 
000000008005003b
Jun 22 11:23:23 localhost kernel: CR2: 0000000000b373f0 CR3: 
000000001ffaf000 CR4: 00000000000006e0
Jun 22 11:23:23 localhost kernel: Process ib_cm/0 (pid: 4078, threadinfo 
ffff810034ba2000, task ffff810034fb03c0)
Jun 22 11:23:23 localhost kernel: Stack: ffff810020245b10 
0000000000000286 ffff810034ba3d88 ffffffff88067828
Jun 22 11:23:23 localhost kernel:        ffff810020245b10 
ffff810020245b18 ffff810034ba3e18 ffffffff8806b4f5
Jun 22 11:23:23 localhost kernel:        ffff810034bf2b70 ffff810034ba2000
Jun 22 11:23:23 localhost kernel: Call Trace: 
<ffffffff88067828>{:ib_cm:cm_cleanup_timewait+101}
Jun 22 11:23:23 localhost kernel:        
<ffffffff8806b4f5>{:ib_cm:cm_work_handler+4144} 
<ffffffff802261f6>{__wake_up+67}
Jun 22 11:23:23 localhost kernel:        
<ffffffff8023bbf1>{run_workqueue+184} 
<ffffffff8806a4c5>{:ib_cm:cm_work_handler+0}
Jun 22 11:23:23 localhost kernel:        
<ffffffff8023bd7c>{worker_thread+313} 
<ffffffff8022613d>{default_wake_function+0}
Jun 22 11:23:23 localhost kernel:        
<ffffffff8022613d>{default_wake_function+0} 
<ffffffff8023bc43>{worker_thread+0}
Jun 22 11:23:23 localhost kernel:        <ffffffff8023efd3>{kthread+215} 
<ffffffff8020a91a>{child_rip+8}
Jun 22 11:23:23 localhost kernel:        <ffffffff8023eefc>{kthread+0} 
<ffffffff8020a912>{child_rip+0}
Jun 22 11:23:23 localhost kernel:
Jun 22 11:23:23 localhost kernel: Code: 44 8b 40 08 48 89 c7 45 85 c0 3e 
75 1d c7 40 08 01 00 00 00
Jun 22 11:23:23 localhost kernel: RIP <ffffffff80348315>{rb_erase+465} 
RSP <ffff810034ba3d58>
Jun 22 11:23:23 localhost kernel:  <3>Slab corruption: 
start=ffff8100202458f8, len=512
Jun 22 11:23:23 localhost kernel: Redzone: 0x5a2cf071/0x5a2cf071.
Jun 22 11:23:23 localhost kernel: Last user: 
[<ffffffff880677bc>](cm_free_work+0x23/0x2a [ib_cm])
Jun 22 11:23:23 localhost kernel: 0e0: 6b 6b 6b 6b 6b 6b 6b 6b 00 00 00 
00 00 00 00 00
Jun 22 11:23:23 localhost kernel: Prev obj: start=ffff8100202456e0, len=512
Jun 22 11:23:23 localhost kernel: Redzone: 0x170fc2a5/0x170fc2a5.
Jun 22 11:23:23 localhost kernel: Last user: 
[<ffffffff8807f2bc>](rdma_create_id+0x25/0xf2 [rdma_cm])
Jun 22 11:23:23 localhost kernel: 000: 00 40 6a 3d 00 81 ff ff f0 88 d4 
3a 00 81 ff ff
Jun 22 11:23:23 localhost kernel: 010: 00 00 00 00 00 00 00 00 27 62 08 
88 ff ff ff ff
Jun 22 11:23:23 localhost kernel: Next obj: start=ffff810020245b10, len=512
Jun 22 11:23:23 localhost kernel: Redzone: 0x170fc2a5/0x170fc2a5.
Jun 22 11:23:23 localhost kernel: Last user: 
[<ffffffff8806785e>](cm_create_timewait_info+0x1b/0x6b [ib_cm])
Jun 22 11:23:23 localhost kernel: 000: 00 00 00 00 00 00 00 00 18 5b 24 
20 00 81 ff ff
Jun 22 11:23:23 localhost kernel: 010: 18 5b 24 20 00 81 ff ff c5 a4 06 
88 ff ff ff ff

Jun 22 11:23:29 localhost kernel: NMI Watchdog detected LOCKUP on CPU 1
Jun 22 11:23:29 localhost kernel: CPU 1 Jun 22 11:23:29 localhost 
kernel: Modules linked in: rdma_ucm rdma_cm ib_addr ib_local_sa findex 
ib_ucm ib_cm ib_umad ib_uverbs ib_ipoib ib_multicast ib_sa ib_mthca 
ib_mad ib_core ixgb
Jun 22 11:23:29 localhost kernel: Pid: 4079, comm: ib_cm/1 Not tainted 
2.6.17 #1
Jun 22 11:23:29 localhost kernel: RIP: 0010:[<ffffffff804fdf3b>] 
<ffffffff804fdf3b>{.text.lock.spinlock+14}
Jun 22 11:23:29 localhost kernel: RSP: 0018:ffff810034989d10  EFLAGS: 
00000086
Jun 22 11:23:29 localhost kernel: RAX: ffff81003d2035e0 RBX: 
000000000005ac69 RCX: ffff810034989ed0
Jun 22 11:23:29 localhost kernel: RDX: ffff81003def5190 RSI: 
000000000005ac69 RDI: ffffffff8806e720
Jun 22 11:23:29 localhost kernel: RBP: ffff810034989d18 R08: 
ffff810034988000 R09: 0000000000000001
Jun 22 11:23:29 localhost kernel: R10: 00000000ffffffff R11: 
0000000000000003 R12: ffff81003d203680
Jun 22 11:23:29 localhost kernel: R13: 000000000005ac68 R14: 
ffff810019b0c4d0 R15: 0000000000000282
Jun 22 11:23:29 localhost kernel: FS:  0000000000000000(0000) 
GS:ffff810037e9e2a8(0000) knlGS:0000000000000000
Jun 22 11:23:29 localhost kernel: CS:  0010 DS: 0018 ES: 0018 CR0: 
000000008005003b
Jun 22 11:23:29 localhost kernel: CR2: 00002b5009e20d10 CR3: 
0000000021544000 CR4: 00000000000006e0
Jun 22 11:23:29 localhost kernel: Process ib_cm/1 (pid: 4079, threadinfo 
ffff810034988000, task ffff810035de50a0)
Jun 22 11:23:29 localhost kernel: Stack: 0000000000000282 
ffff810034989d48 ffffffff880673c2 ffff810021198a48
Jun 22 11:23:29 localhost kernel:        ffff810019b0c4d0 
ffff81003d203680 ffff810019b0c4d0 ffff810034989d88
Jun 22 11:23:29 localhost kernel:        ffffffff88069944 0000000000000000
Jun 22 11:23:29 localhost kernel: Call Trace: 
<ffffffff880673c2>{:ib_cm:cm_acquire_id+30} Jun 22 11:23:29 localhost 
kernel:        <ffffffff88069944>{:ib_cm:cm_dreq_handler+51} 
<ffffffff8806b498>{:ib_cm:cm_work_handler+4051}
Jun 22 11:23:29 localhost kernel:        
<ffffffff8023bbf1>{run_workqueue+184} 
<ffffffff8806a4c5>{:ib_cm:cm_work_handler+0}
Jun 22 11:23:29 localhost kernel:        
<ffffffff8023bd7c>{worker_thread+313} 
<ffffffff8022613d>{default_wake_function+0}
Jun 22 11:23:29 localhost kernel:        
<ffffffff8022613d>{default_wake_function+0} 
<ffffffff8023bc43>{worker_thread+0}
Jun 22 11:23:29 localhost kernel:        <ffffffff8023efd3>{kthread+215} 
<ffffffff8020a91a>{child_rip+8}
Jun 22 11:23:29 localhost kernel:        <ffffffff8023eefc>{kthread+0} 
<ffffffff8020a912>{child_rip+0}
Jun 22 11:23:29 localhost kernel:
Jun 22 11:23:29 localhost kernel: Code: 83 3f 00 7e f9 e9 99 fd ff ff e8 
2a d1 e4 ff e9 bd fd ff ff
Jun 22 11:23:29 localhost kernel: console shuts up ...
Jun 22 11:25:13 localhost kernel:  NMI Watchdog detected LOCKUP on CPU 0
Jun 22 11:43:23 localhost syslogd 1.4.1: restart.





More information about the general mailing list