[openib-general] [Bug 202] New: System hangs on shutdown, build 459

bugzilla-daemon at openib.org bugzilla-daemon at openib.org
Sun Aug 20 17:05:01 PDT 2006 

http://openib.org/bugzilla/show_bug.cgi?id=202

           Summary: System hangs on shutdown, build 459
           Product: OpenFabrics Windows
           Version: unspecified
          Platform: X86-64
        OS/Version: Other
            Status: NEW
          Severity: major
          Priority: P2
         Component: Core
        AssignedTo: bugzilla at openib.org
        ReportedBy: jbottorff at xsigo.com


When running Windows 2003 SP1 checked 64-bit with driver verifier enabled (all
drivers verified with all options except low resource simulation and disk
integrity checking) and I do cyclic shutdown tests, the IBAL driver sometimes
asserts (checked IB stack build). The test script connects via TCP to WMI and
requests a system reboot every 7 minutes. On 32-bit Windows, this assert
happens after just a few reboot cycles. It took 65 reboot cycles on 64-bit
Windows. I'm reporting this on 64-bit Windows because the object reference dump
is useful (it's garbage on 32-bit Windows). This was on a clean OS install with
only the IB drivers (build 459) installed (the OS install CD was the only other
source of running code). The hardware is a dual processor Xeon. IPoIB drivers
were installed on both ports. The host was attached to an IB switch with a
couple of other hosts attached. The IB adapter as reported by vstat is:

hca_idx=0
pci_location={BUS=NA,DEV/FUNC=NA}
uplink={BUS=PCI_E, SPEED=2.5 Gbps, WIDTH=x8}
vendor_id=0x02c9
vendor_part_id=0x6282
hw_ver=0xa0
fw_ver=5.01.0400
PSID=MT_0140000001
node_guid=0002:c902:0040:1d20
num_phys_ports=2
        port=1
        port_state=PORT_ACTIVE (4)
        sm_lid=0x0001
        port_lid=0x000e
        port_lmc=0x0
        max_mtu=2048 (4)

        port=2
        port_state=PORT_ACTIVE (4)
        sm_lid=0x0001
        port_lid=0x0011
        port_lmc=0x0
        max_mtu=2048 (4)


Following is the kernel debugger log that includes the object reference dump
that occurs if you ignore the assert.

TERMSRV: Last WinStation reset
~0:ib_modify_ca() !ERROR!: IB_INVALID_CA_HANDLE
~0:ib_modify_ca() !ERROR!: IB_INVALID_CA_HANDLE
NatTriggerTimer: scheduling DPC
NatTriggerTimer: scheduling DPC


Process.Thread : 0000000000000004.0000000000000038 (System) is trying to create
key: 
        ObjectAttributes = FFFFFADFE4A718D8
The caller should not rely on data written to the registry after shutdown...
GetMaxLana : Failed to open registryNetbios : GetMaxLana failed with status
c0000001
Netbios : device not found
\Device\NetBT_Tcpip_{345D2F3E-23A1-4793-A1FE-D741C4AE0240}
Waiting on: \Driver\VERIFIER_FILTER e6868c40 irp (ce7b4e10) SetPower-Shutdown
status 0
HvpGetCellMapped called after shutdown for Hive = FFFFFA800079A000 Cell = 372b0
Waiting on: \Driver\VERIFIER_FILTER e6868c40 irp (ce7b4e10) SetPower-Shutdown
status 0
Waiting on: \Driver\VERIFIER_FILTER e6868c40 irp (ce7b4e10) SetPower-Shutdown
status 0
HvpGetCellMapped called after shutdown for Hive = FFFFFA800078B000 Cell =
c05238
~1:sync_destroy_obj() !ERROR!: Error waiting for references to be released -
delaying.
~1:print_al_obj() !ERROR!: AL object fffffabec6602b70(AL_OBJ_TYPE_CI_CA),
parent: fffffabec53eee70 ref_cnt: 1
Waiting on: \Driver\VERIFIER_FILTER e6868c40 irp (ce7b4e10) SetPower-Shutdown
status 0
Waiting on: \Driver\VERIFIER_FILTER e6868c40 irp (ce7b4e10) SetPower-Shutdown
status 0


Process.Thread : 0000000000000334.0000000000000410 (wmiprvse.exe) is trying to
create key: 
        ObjectAttributes = 00000000011DE108
The caller should not rely on data written to the registry after shutdown...


Process.Thread : 0000000000000334.0000000000000410 (wmiprvse.exe) is trying to
create key: 
        ObjectAttributes = 00000000011DDFE0
The caller should not rely on data written to the registry after shutdown...
 520: WORK_QUEUE: no work for 180000 ms: committing suicide...
 520: WORK_QUEUE: worker thread exiting
Waiting on: \Driver\VERIFIER_FILTER e6868c40 irp (ce7b4e10) SetPower-Shutdown
status 0

*** Assertion failed: cl_status == CL_SUCCESS
***   Source File: k:\windows-openib\src\winib-459\core\al\al_common.c, line
535

Break repeatedly, break Once, Ignore, terminate Process, or terminate Thread
(boipt)? i
i
~1:sync_destroy_obj() !ERROR!: Forcing object destruction.
~1:print_al_obj() !ERROR!: AL object fffffabec6602b70(AL_OBJ_TYPE_CI_CA),
parent: fffffabec53eee70 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5db2d60(AL_OBJ_TYPE_H_AL),
parent: fffffabec53eee70 ref_cnt: 1037
~1:print_al_obj() !ERROR!: AL object fffffabec5db6e20(AL_OBJ_TYPE_PNP_MGR),
parent: fffffabec53eee70 ref_cnt: 12
~1:print_al_obj() !ERROR!: AL object fffffabec5ddcd00(AL_OBJ_TYPE_H_MAD_POOL),
parent: fffffabec5db2d60 ref_cnt: 3
~1:print_al_obj() !ERROR!: AL object fffffabec5604ca0(AL_OBJ_TYPE_RES_MGR),
parent: fffffabec53eee70 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5dd80a8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5dd8230(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5dd83b8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5dd8540(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5dd86c8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5dd8850(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5dd89d8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5dd8b60(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5dd8ce8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5dd8e70(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec56e60f8(AL_OBJ_TYPE_H_MR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec56e6238(AL_OBJ_TYPE_H_MR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec56e6378(AL_OBJ_TYPE_H_MR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec56e64b8(AL_OBJ_TYPE_H_MR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec56e65f8(AL_OBJ_TYPE_H_MR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec56e6738(AL_OBJ_TYPE_H_MR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec56e6878(AL_OBJ_TYPE_H_MR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec56e69b8(AL_OBJ_TYPE_H_MR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec56e6af8(AL_OBJ_TYPE_H_MR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec56e6c38(AL_OBJ_TYPE_H_MR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec56e6d78(AL_OBJ_TYPE_H_MR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec56e6eb8(AL_OBJ_TYPE_H_MR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffadfe67ce018(AL_OBJ_TYPE_H_FMR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffadfe67ce150(AL_OBJ_TYPE_H_FMR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffadfe67ce288(AL_OBJ_TYPE_H_FMR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffadfe67ce3c0(AL_OBJ_TYPE_H_FMR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffadfe67ce4f8(AL_OBJ_TYPE_H_FMR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffadfe67ce630(AL_OBJ_TYPE_H_FMR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffadfe67ce768(AL_OBJ_TYPE_H_FMR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffadfe67ce8a0(AL_OBJ_TYPE_H_FMR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffadfe67ce9d8(AL_OBJ_TYPE_H_FMR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffadfe67ceb10(AL_OBJ_TYPE_H_FMR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffadfe67cec48(AL_OBJ_TYPE_H_FMR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffadfe67ced80(AL_OBJ_TYPE_H_FMR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffadfe67ceeb8(AL_OBJ_TYPE_H_FMR),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5df0ca0(AL_OBJ_TYPE_SMI), parent:
fffffabec53eee70 ref_cnt: 4
~1:print_al_obj() !ERROR!: AL object fffffabec5c04d70(AL_OBJ_TYPE_H_PNP),
parent: fffffabec5db2d60 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5df4d70(AL_OBJ_TYPE_H_PNP),
parent: fffffabec5db2d60 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5c02ec0(AL_OBJ_TYPE_SA_REQ_SVC),
parent: fffffabec53eee70 ref_cnt: 2
~1:print_al_obj() !ERROR!: AL object fffffabec5c1cd70(AL_OBJ_TYPE_H_PNP),
parent: fffffabec5db2d60 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5c20a40(AL_OBJ_TYPE_CM), parent:
fffffabec53eee70 ref_cnt: 2
~1:print_al_obj() !ERROR!: AL object fffffabec5c32d70(AL_OBJ_TYPE_H_PNP),
parent: fffffabec5db2d60 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5c58ea0(AL_OBJ_TYPE_DM), parent:
fffffabec53eee70 ref_cnt: 3
~1:print_al_obj() !ERROR!: AL object fffffabec5c42d70(AL_OBJ_TYPE_H_PNP),
parent: fffffabec5db2d60 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5c26d70(AL_OBJ_TYPE_H_PNP),
parent: fffffabec5db2d60 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5bc89b0(AL_OBJ_TYPE_IOC_PNP_MGR),
parent: fffffabec53eee70 ref_cnt: 2
~1:print_al_obj() !ERROR!: AL object fffffabec5c4cd70(AL_OBJ_TYPE_H_PNP),
parent: fffffabec5db2d60 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5c62d70(AL_OBJ_TYPE_H_PNP),
parent: fffffabec5db2d60 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec5c9ed70(AL_OBJ_TYPE_H_PNP),
parent: fffffabec5db2d60 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec6602b70(AL_OBJ_TYPE_CI_CA),
parent: fffffabec53eee70 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec660cea0(AL_OBJ_TYPE_H_CA),
parent: fffffabec5db2d60 ref_cnt: 3
~1:print_al_obj() !ERROR!: AL object fffffabec6660e90(AL_OBJ_TYPE_H_PD),
parent: fffffabec660cea0 ref_cnt: 2
~1:print_al_obj() !ERROR!: AL object fffffabec6668e90(AL_OBJ_TYPE_H_PD),
parent: fffffabec660cea0 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec666ae70(AL_OBJ_TYPE_H_POOL_KEY),
parent: fffffabec6660e90 ref_cnt: 1025
~1:print_al_obj() !ERROR!: AL object fffffabec741cd60(AL_OBJ_TYPE_SMI), parent:
fffffabec5df0ca0 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7c86d70(AL_OBJ_TYPE_H_QP),
parent: fffffabec6668e90 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7c90d20(AL_OBJ_TYPE_H_MAD_SVC),
parent: fffffabec7c86d70 ref_cnt: 2
~1:print_al_obj() !ERROR!: AL object fffffabec7ea60a8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7ea6230(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7ea63b8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7ea6540(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7ea66c8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7ea6850(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7ea69d8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7ea6b60(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7ea6ce8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7ea6e70(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f1a0a8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f1a230(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f1a3b8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f1a540(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f1a6c8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f1a850(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f1a9d8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f1ab60(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f1ace8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f1ae70(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f920a8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f92230(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f923b8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f92540(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f926c8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f92850(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f929d8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f92b60(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f92ce8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7f92e70(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec747cd60(AL_OBJ_TYPE_H_AL),
parent: fffffabec53eee70 ref_cnt: 2
~1:print_al_obj() !ERROR!: AL object fffffabec7e7ad70(AL_OBJ_TYPE_H_PNP),
parent: fffffabec747cd60 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabec7e8ad60(AL_OBJ_TYPE_H_AL),
parent: fffffabec53eee70 ref_cnt: 2
~1:print_al_obj() !ERROR!: AL object fffffabec7fe6d70(AL_OBJ_TYPE_H_PNP),
parent: fffffabec7e8ad60 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabecd89c0a8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabecd89c230(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabecd89c3b8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabecd89c540(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabecd89c6c8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabecd89c850(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabecd89c9d8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabecd89cb60(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabecd89cce8(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
~1:print_al_obj() !ERROR!: AL object fffffabecd89ce70(AL_OBJ_TYPE_H_AV),
parent: 0000000000000000 ref_cnt: 1
VideoPortPowerDispatch: ERROR IN MINIPORT!
VideoPortPowerDispatch: Miniport cannot refuse set power request
VideoPortPowerDispatch: ERROR IN MINIPORT!
VideoPortPowerDispatch: Miniport cannot refuse set power request
Shutdown occurred...unloading all symbol tables.




------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

More information about the general mailing list