[openib-general] A couple of kdapltest oopses
Itamar Rabenstein
itamar at mellanox.co.il
Fri Jun 10 08:29:41 PDT 2005
is this new ? did you saw it before ?
do you see the problem with -i 1000 ?
both oops are in the malloc stage.
I have seen in the past problems were dapl tried to malloc a very big
memory.
Itamar
> -----Original Message-----
> From: Hal Rosenstock [mailto:halr at voltaire.com]
> Sent: Friday, June 10, 2005 4:32 PM
> To: James Lentini
> Cc: openib-general at openib.org
> Subject: [openib-general] A couple of kdapltest oopses
>
>
> Hi,
>
> First on the client when running transaction test, I see the
> following:
> kdapltest -T T -s <server IP addr> -D mthca0a -d -i 10000 -w
> 8 client SR server SR
>
> Jun 10 08:58:17 localhost kernel: DT_Mdep_Thread_: page
> allocation failure. order:0, mode:0x20
> Jun 10 08:58:17 localhost kernel: [<c01470f2>]
> __alloc_pages+0x2b2/0x440
> Jun 10 08:58:17 localhost kernel: [<c0111ce8>]
> kernel_map_pages+0x28/0x70
> Jun 10 08:58:17 localhost kernel: [<c014b2e1>]
> kmem_getpages+0x31/0xb0
> Jun 10 08:58:17 localhost kernel: [<c014cd59>] cache_grow+0x139/0x360
> Jun 10 08:58:17 localhost kernel: [<c014d523>]
> cache_alloc_refill+0x153/0x340
> Jun 10 08:58:17 localhost kernel: [<c014ad65>] dbg_redzone1+0x15/0x30
> Jun 10 08:58:17 localhost kernel: [<c014d77e>]
> cache_alloc_debugcheck_after+0x6e/0x1a0
> Jun 10 08:58:17 localhost kernel: [<c014de11>] __kmalloc+0xb1/0xe0
> Jun 10 08:58:17 localhost kernel: [<d0a33995>]
> DT_Mdep_Malloc+0x25/0x60 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<d0a34826>]
> DT_Tdep_PT_Printf+0x16/0x1b0 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<d0a27bdf>]
> DT_Transaction_Run+0x48f/0xb60 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<d0a33b4d>]
> DT_Mdep_wait_object_wakeup+0x1d/0x30 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<d0a26933>]
> DT_Transaction_Main+0x1383/0x21a0 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<c0111ce8>]
> kernel_map_pages+0x28/0x70
> Jun 10 08:58:17 localhost kernel: [<c014d196>]
> cache_free_debugcheck+0x196/0x2d0
> Jun 10 08:58:17 localhost kernel: [<d0a33a4f>]
> DT_Mdep_Thread_Start_Routine+0x1f/0x30 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<d0a33a30>]
> DT_Mdep_Thread_Start_Routine+0x0/0x30 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<c0100875>]
> kernel_thread_helper+0x5/0x10
> Jun 10 08:58:17 localhost kernel: Unable to handle kernel
> NULL pointer dereference at virtual address 00000004
> Jun 10 08:58:17 localhost kernel: printing eip:
> Jun 10 08:58:17 localhost kernel: c022048b
> Jun 10 08:58:17 localhost kernel: *pde = 07cb6067
> Jun 10 08:58:17 localhost kernel: *pte = 00000000
> Jun 10 08:58:17 localhost kernel: Oops: 0002 [#1]
> Jun 10 08:58:17 localhost kernel: DEBUG_PAGEALLOC
> Jun 10 08:58:17 localhost kernel: Modules linked in:
> kdapltest ib_dat_provider ib_cm ib_at dat ib_ipoib ib_sa
> ib_umad ide_cd cdrom lp ipv6 autofs parport_pc parport
> uhci_hcd ehci_hcd ib_mthca ib_mad ib_core ohci_hcd eepro100
> mii evdev usbcore
> Jun 10 08:58:17 localhost kernel: CPU: 0
> Jun 10 08:58:17 localhost kernel: EIP: 0060:[<c022048b>]
> Not tainted VLI
> Jun 10 08:58:17 localhost kernel: EFLAGS: 00010283 (2.6.11.6)
> Jun 10 08:58:17 localhost kernel: EIP is at vsnprintf+0x4b/0x4c0
> Jun 10 08:58:17 localhost kernel: eax: 00000054 ebx:
> c1d17f78 ecx: 00000000 edx: d0a35eef
> Jun 10 08:58:17 localhost kernel: esi: 00000004 edi:
> c1d17f78 ebp: 00000103 esp: ce5bfd84
> Jun 10 08:58:17 localhost kernel: ds: 007b es: 007b ss: 0068
> Jun 10 08:58:17 localhost kernel: Process DT_Mdep_Thread_
> (pid: 6696, threadinfo=ce5be000 task=c3730a90)
> Jun 10 08:58:17 localhost kernel: Stack: cffff740 00000020
> 00000000 d0a33995 00000104 00000000 c1d17f78 d0a33995
> Jun 10 08:58:17 localhost kernel: 00000104 00000020
> c1d17f78 00000000 c1d17f78 c5b58000 d0a3484b 00000004
> Jun 10 08:58:17 localhost kernel: 00000100 d0a35eef
> ce5bfdf4 0000007b ffffff05 c1d17f78 cf34ef78 c60d2060
> Jun 10 08:58:17 localhost kernel: Call Trace:
> Jun 10 08:58:17 localhost kernel: [<d0a33995>]
> DT_Mdep_Malloc+0x25/0x60 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<d0a33995>]
> DT_Mdep_Malloc+0x25/0x60 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<d0a3484b>]
> DT_Tdep_PT_Printf+0x3b/0x1b0 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<d0a27bdf>]
> DT_Transaction_Run+0x48f/0xb60 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<d0a33b4d>]
> DT_Mdep_wait_object_wakeup+0x1d/0x30 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<d0a26933>]
> DT_Transaction_Main+0x1383/0x21a0 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<c0111ce8>]
> kernel_map_pages+0x28/0x70
> Jun 10 08:58:17 localhost kernel: [<c014d196>]
> cache_free_debugcheck+0x196/0x2d0
> Jun 10 08:58:17 localhost kernel: [<d0a33a4f>]
> DT_Mdep_Thread_Start_Routine+0x1f/0x30 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<d0a33a30>]
> DT_Mdep_Thread_Start_Routine+0x0/0x30 [kdapltest]
> Jun 10 08:58:17 localhost kernel: [<c0100875>]
> kernel_thread_helper+0x5/0x10
> Jun 10 08:58:17 localhost kernel: Code: f0 48 39 c5 73 0d 89
> f2 f7 da bd ff ff ff ff 89 54 24 40 8b 54 24 44 80 3a 00 74
> 23 8d 74 26 00 0f b6 02 3c 25 74 3d 39 ee 77 06 <88> 06 8b 54
> 24 44 46 89 d0 42 89 54 24 44 80 78 01 00 75 e1 39
>
> then on the server side, when I try to rmmod kdapltest, I get:
>
> Unable to handle kernel paging request at ffffffff88243a05 RIP:
> [<ffffffff88243a05>]
> PGD 103027 PUD 105027 PMD 3baeb067 PTE 0
> Oops: 0010 [1] SMP
> CPU 1
> Modules linked in: ib_dat_provider ib_cm ib_at dat ib_ipoib
> ib_sa parport_pc lp parport autofs4 sunrpc ipt_REJECT
> ipt_state ip_conntrack iptable_filter ip_tables video button
> battery ac md5 ipv6 ohci_hcd i2c_amd8111 i2c_core hw_random
> ib_mthca ib_mad ib_core e100 mii tg3 floppy dm_snapshot
> dm_zero dm_mirror ext3 jbd dm_mod sata_sil libata sd_mod scsi_mod
> Pid: 9094, comm: kdapltest Not tainted 2.6.11.6
> RIP: 0010:[<ffffffff88243a05>] [<ffffffff88243a05>]
> RSP: 0018:ffff810037787e58 EFLAGS: 00010292
> RAX: 0000000000000061 RBX: ffff810035af6d88 RCX: 0000000000000282
> RDX: ffff810020712308 RSI: 0000000000000282 RDI: ffff810020711ce0
> RBP: ffff810035af6d80 R08: ffff810037786000 R09: 0000000000000000
> R10: 0000000000000000 R11: 0000000000000246 R12: ffff810038daccc0
> R13: 0000000000000001 R14: 0000000000000000 R15: ffff8100234ad008
> FS: 00002aaaaaaccec0(0000) GS:ffffffff804c9f00(0000)
> knlGS:0000000000000000
> CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> CR2: ffffffff88243a05 CR3: 000000003a33a000 CR4: 00000000000006e0
> Process kdapltest (pid: 9094, threadinfo ffff810037786000,
> task ffff81003cd16860)
> Stack: ffff810000002000 0000024000000003 ffff810000000100
> ffff810000000000
> ffff810000000000 0000000000000000 ffff81003d40f4c0
> 0000000100000000
> ffff81001eb44000 ffff8100234ad000
> Call Trace:<ffffffff8010f1c7>{child_rip+8}
> <ffffffff8010f1bf>{child_rip+0}
>
>
> Code: Bad RIP value.
> RIP [<ffffffff88243a05>] RSP <ffff810037787e58>
> CR2: ffffffff88243a05
> <1>Unable to handle kernel paging request at ffffffff8825eac8 RIP:
> <ffffffff8017d419>{filp_close+73}
> PGD 103027 PUD 105027 PMD 3baeb067 PTE 0
> Oops: 0000 [2] SMP
> CPU 1
> Modules linked in: ib_dat_provider ib_cm ib_at dat ib_ipoib
> ib_sa parport_pc lp parport autofs4 sunrpc ipt_REJECT
> ipt_state ip_conntrack iptable_filter ip_tables video button
> battery ac md5 ipv6 ohci_hcd i2c_amd8111 i2c_core hw_random
> ib_mthca ib_mad ib_core e100 mii tg3 floppy dm_snapshot
> dm_zero dm_mirror ext3 jbd dm_mod sata_sil libata sd_mod scsi_mod
> Pid: 9094, comm: kdapltest Not tainted 2.6.11.6
> RIP: 0010:[<ffffffff8017d419>] <ffffffff8017d419>{filp_close+73}
> RSP: 0018:ffff810037787bf8 EFLAGS: 00010286
> RAX: ffffffff8825ea60 RBX: ffff81001f24a8c0 RCX: ffff810019109238
> RDX: ffff810037e58e70 RSI: ffff810037e58d40 RDI: ffff81001f24a8c0
> RBP: 0000000000000000 R08: ffff81003d7ce6c0 R09: ffff810037787bf8
> R10: 0000000000000001 R11: 0000000000000000 R12: ffff810037e58d40
> R13: 0000000000000001 R14: 0000000000000001 R15: ffff81001f278940
> FS: 00002aaaaaaccec0(0000) GS:ffffffff804c9f00(0000)
> knlGS:0000000000000000
> CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> CR2: ffffffff8825eac8 CR3: 000000003a33a000 CR4: 00000000000006e0
> Process kdapltest (pid: 9094, threadinfo ffff810037786000,
> task ffff81003cd16860)
> Stack: 0000000000000003 0000000000000003 ffff810037e58d40
> ffffffff80139723
> 0000000000000009 ffff810037e58d40 ffff81003cd16eb0
> ffff81003cd16860
> 0000000000000009 ffffffff80139eba
> Call Trace:<ffffffff80139723>{put_files_struct+115}
> <ffffffff80139eba>{do_exit+378}
> <ffffffff802433d7>{do_unblank_screen+119}
> <ffffffff80121f0f>{do_page_fault+2047}
> <ffffffff803357ea>{thread_return+42}
> <ffffffff8010f011>{error_exit+0}
> <ffffffff8010f1c7>{child_rip+8}
> <ffffffff8010f1bf>{child_rip+0}
>
>
> Code: 48 8b 40 68 48 85 c0 74 0e 48 89 df ff d0 85 ed 0f 44 e8 66
> RIP <ffffffff8017d419>{filp_close+73} RSP <ffff810037787bf8>
> CR2: ffffffff8825eac8
> <1>Unable to handle kernel paging request at ffffffff88245190 RIP:
> [<ffffffff88245190>]
> PGD 103027 PUD 105027 PMD 3baeb067 PTE 0
> Oops: 0010 [3] SMP
> CPU 0
> Modules linked in: ib_dat_provider ib_cm ib_at dat ib_ipoib
> ib_sa parport_pc lp parport autofs4 sunrpc ipt_REJECT
> ipt_state ip_conntrack iptable_filter ip_tables video button
> battery ac md5 ipv6 ohci_hcd i2c_amd8111 i2c_core hw_random
> ib_mthca ib_mad ib_core e100 mii tg3 floppy dm_snapshot
> dm_zero dm_mirror ext3 jbd dm_mod sata_sil libata sd_mod scsi_mod
> Pid: 9119, comm: DT_Mdep_Thread_ Not tainted 2.6.11.6
> RIP: 0010:[<ffffffff88245190>] [<ffffffff88245190>]
> RSP: 0018:ffff810031907f18 EFLAGS: 00010296
> RAX: 0000000000000000 RBX: ffff81001b770000 RCX: 0000000000000006
> RDX: 0000000000000008 RSI: 0000000000000008 RDI: 0000000000000003
> RBP: ffff81001b77004c R08: ffffffff80508a00 R09: 0000000000000008
> R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000001
> R13: ffff810038daccc0 R14: 0000000000000000 R15: ffff8100234ad008
> FS: 00002aaaaaaccec0(0000) GS:ffffffff804c9e80(0000)
> knlGS:0000000000000000
> CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> CR2: ffffffff88245190 CR3: 000000003d8b3000 CR4: 00000000000006e0
> Process DT_Mdep_Thread_ (pid: 9119, threadinfo
> ffff810031906000, task ffff81003cd16170)
> Stack: ffff810037bde1c0 ffff810035af6d80 ffff810038daccc0
> 0000000000000001
> ffff81001b770000 ffffffff88250ff8 ffff810037bde1c0
> ffffffff8010f1c7
> ffff8100234ad008 ffff81001b770000
> Call Trace:<ffffffff8010f1c7>{child_rip+8}
> <ffffffff8011cdd0>{flat_send_IPI_mask+0}
> <ffffffff8010f1bf>{child_rip+0}
>
> Code: Bad RIP value.
> RIP [<ffffffff88245190>] RSP <ffff810031907f18>
> CR2: ffffffff88245190
>
> -- Hal
>
> _______________________________________________
> openib-general mailing list
> openib-general at openib.org
> http://openib.org/mailman/listinfo/openib-general
>
> To unsubscribe, please visit
> http://openib.org/mailman/listinfo/openib-general
>
More information about the general
mailing list