<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML xmlns="http://www.w3.org/TR/REC-html40" xmlns:v =
"urn:schemas-microsoft-com:vml" xmlns:o =
"urn:schemas-microsoft-com:office:office" xmlns:w =
"urn:schemas-microsoft-com:office:word" xmlns:x =
"urn:schemas-microsoft-com:office:excel" xmlns:p =
"urn:schemas-microsoft-com:office:powerpoint" xmlns:a =
"urn:schemas-microsoft-com:office:access" xmlns:dt =
"uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" xmlns:s =
"uuid:BDC6E3F0-6DA3-11d1-A2A3-00AA00C14882" xmlns:rs =
"urn:schemas-microsoft-com:rowset" xmlns:z = "#RowsetSchema" xmlns:b =
"urn:schemas-microsoft-com:office:publisher" xmlns:ss =
"urn:schemas-microsoft-com:office:spreadsheet" xmlns:c =
"urn:schemas-microsoft-com:office:component:spreadsheet" xmlns:odc =
"urn:schemas-microsoft-com:office:odc" xmlns:oa =
"urn:schemas-microsoft-com:office:activation" xmlns:html =
"http://www.w3.org/TR/REC-html40" xmlns:q =
"http://schemas.xmlsoap.org/soap/envelope/" xmlns:rtc =
"http://microsoft.com/officenet/conferencing" XMLNS:D = "DAV:" XMLNS:Repl =
"http://schemas.microsoft.com/repl/" xmlns:mt =
"http://schemas.microsoft.com/sharepoint/soap/meetings/" xmlns:x2 =
"http://schemas.microsoft.com/office/excel/2003/xml" xmlns:ppda =
"http://www.passport.com/NameSpace.xsd" xmlns:ois =
"http://schemas.microsoft.com/sharepoint/soap/ois/" xmlns:dir =
"http://schemas.microsoft.com/sharepoint/soap/directory/" xmlns:ds =
"http://www.w3.org/2000/09/xmldsig#" xmlns:dsp =
"http://schemas.microsoft.com/sharepoint/dsp" xmlns:udc =
"http://schemas.microsoft.com/data/udc" xmlns:xsd =
"http://www.w3.org/2001/XMLSchema" xmlns:sub =
"http://schemas.microsoft.com/sharepoint/soap/2002/1/alerts/" xmlns:ec =
"http://www.w3.org/2001/04/xmlenc#" xmlns:sp =
"http://schemas.microsoft.com/sharepoint/" xmlns:sps =
"http://schemas.microsoft.com/sharepoint/soap/" xmlns:xsi =
"http://www.w3.org/2001/XMLSchema-instance" xmlns:udcs =
"http://schemas.microsoft.com/data/udc/soap" xmlns:udcxf =
"http://schemas.microsoft.com/data/udc/xmlfile" xmlns:udcp2p =
"http://schemas.microsoft.com/data/udc/parttopart" xmlns:wf =
"http://schemas.microsoft.com/sharepoint/soap/workflow/" xmlns:dsss =
"http://schemas.microsoft.com/office/2006/digsig-setup" xmlns:dssi =
"http://schemas.microsoft.com/office/2006/digsig" xmlns:mdssi =
"http://schemas.openxmlformats.org/package/2006/digital-signature" xmlns:mver =
"http://schemas.openxmlformats.org/markup-compatibility/2006" xmlns:m =
"http://schemas.microsoft.com/office/2004/12/omml" xmlns:mrels =
"http://schemas.openxmlformats.org/package/2006/relationships" xmlns:spwp =
"http://microsoft.com/sharepoint/webpartpages" xmlns:ex12t =
"http://schemas.microsoft.com/exchange/services/2006/types" xmlns:ex12m =
"http://schemas.microsoft.com/exchange/services/2006/messages" xmlns:pptsl =
"http://schemas.microsoft.com/sharepoint/soap/SlideLibrary/" xmlns:spsl =
"http://microsoft.com/webservices/SharePointPortalServer/PublishedLinksService"
XMLNS:Z = "urn:schemas-microsoft-com:" xmlns:st = ""><HEAD>
<META content="text/html; charset=us-ascii" http-equiv=Content-Type>
<META name=GENERATOR content="MSHTML 8.00.6001.18975">
<STYLE>@font-face {
font-family: Cambria Math;
}
@font-face {
font-family: Calibri;
}
@page WordSection1 {size: 8.5in 11.0in; margin: 1.0in 1.25in 1.0in 1.25in; }
P.MsoNormal {
MARGIN: 0in 0in 0pt; FONT-FAMILY: "Calibri","sans-serif"; FONT-SIZE: 11pt
}
LI.MsoNormal {
MARGIN: 0in 0in 0pt; FONT-FAMILY: "Calibri","sans-serif"; FONT-SIZE: 11pt
}
DIV.MsoNormal {
MARGIN: 0in 0in 0pt; FONT-FAMILY: "Calibri","sans-serif"; FONT-SIZE: 11pt
}
A:link {
COLOR: blue; TEXT-DECORATION: underline; mso-style-priority: 99
}
SPAN.MsoHyperlink {
COLOR: blue; TEXT-DECORATION: underline; mso-style-priority: 99
}
A:visited {
COLOR: purple; TEXT-DECORATION: underline; mso-style-priority: 99
}
SPAN.MsoHyperlinkFollowed {
COLOR: purple; TEXT-DECORATION: underline; mso-style-priority: 99
}
SPAN.EmailStyle17 {
FONT-FAMILY: "Calibri","sans-serif"; COLOR: windowtext; mso-style-type: personal-compose
}
.MsoChpDefault {
mso-style-type: export-only
}
DIV.WordSection1 {
page: WordSection1
}
</STYLE>
<!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></HEAD>
<BODY lang=EN-US link=blue vLink=purple>
<DIV dir=ltr lang=en-us class=OutlookMessageHeader align=left>
<HR tabIndex=-1>
<FONT size=2 face=Tahoma><B>From:</B> Uri Habusha [mailto:urih@mellanox.co.il]
<BR><B>Sent:</B> Saturday, November 20, 2010 1:21 PM<BR><B>To:</B> Hefty, Sean;
ofw@lists.openfabrics.org; Smith, Stan<BR><B>Subject:</B> ASSERT in
cl_spinlock_acquire function in OSM<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV class=WordSection1>
<P class=MsoNormal>During our IPoIB regression we got an assert. The reason for
the assert is that the spin lock wasn’t initialized. I take a look on osm_log
object but it’s looks to me corrupted, (the log_file_name is
wrong).<o:p></o:p></P>
<P class=MsoNormal><o:p> </o:p></P>
<P class=MsoNormal>Is it a known issue? <SPAN
class=966165618-21112010><FONT color=#0000ff size=2
face=Arial> </FONT></SPAN></P>
<P class=MsoNormal><SPAN class=966165618-21112010><FONT color=#0000ff size=2
face=Arial></FONT></SPAN> </P>
<P class=MsoNormal><SPAN class=966165618-21112010><FONT color=#0000ff size=2
face=Arial>No.</FONT></SPAN></P>
<P class=MsoNormal><SPAN class=966165618-21112010><FONT color=#0000ff size=2
face=Arial></FONT></SPAN> </P>
<P class=MsoNormal><SPAN class=966165618-21112010><FONT color=#0000ff size=2
face=Arial>Yes, the log filename is corrupted as if the invalid memory access
fault handler is using the osm log file name buffer/memory for it's error log
(sprintf) buffer.</FONT></SPAN></P>
<P class=MsoNormal><SPAN class=966165618-21112010><FONT color=#0000ff size=2
face=Arial>Any idea which module contains the offending address <FONT
color=#000000 size=3 face=Calibri>0x08004633`39010038 <FONT color=#0000ff
size=2 face=Arial>?</FONT></FONT></FONT></SPAN></P>
<P class=MsoNormal><SPAN class=966165618-21112010><FONT color=#0000ff size=2
face=Arial></FONT></SPAN> </P>
<P class=MsoNormal><SPAN class=966165618-21112010><FONT color=#0000ff size=2
face=Arial>The umad_port_id == -1 looks strange.</FONT></SPAN></P>
<P class=MsoNormal><SPAN class=966165618-21112010><FONT color=#0000ff size=2
face=Arial></FONT></SPAN> </P>
<P class=MsoNormal><SPAN class=966165618-21112010><FONT color=#0000ff size=2
face=Arial>How are the test systems configured w.r.t. IB
fabric?</FONT></SPAN></P>
<P class=MsoNormal><SPAN class=966165618-21112010><FONT color=#0000ff size=2
face=Arial>Single IB switch?</FONT></SPAN></P>
<P class=MsoNormal><SPAN class=966165618-21112010><FONT color=#0000ff size=2
face=Arial>How many other systems attached to the switch?</FONT></SPAN></P>
<P class=MsoNormal><SPAN class=966165618-21112010><FONT color=#0000ff size=2
face=Arial>Is there just a single IPoIB transfer going on?</FONT></SPAN></P>
<P class=MsoNormal><SPAN class=966165618-21112010><FONT color=#0000ff size=2
face=Arial>Any cable pulls or system(s) shutting down?</FONT></SPAN></P>
<P class=MsoNormal><SPAN class=966165618-21112010> </SPAN><o:p></o:p></P>
<P class=MsoNormal><o:p> <SPAN class=966165618-21112010><FONT color=#0000ff
size=2 face=Arial>What type of IPoIB transfer was going on? How might others
reproduce this situation?</FONT></SPAN></o:p></P>
<P class=MsoNormal><o:p><SPAN class=966165618-21112010><FONT color=#0000ff
size=2 face=Arial></FONT></SPAN></o:p> </P>
<P class=MsoNormal>Uri<o:p></o:p></P>
<P class=MsoNormal><o:p> </o:p></P>
<P class=MsoNormal>3: kd> kb<o:p></o:p></P>
<P
class=MsoNormal>RetAddr
: Args to
Child
: Call Site<o:p></o:p></P>
<P class=MsoNormal>00000000`754954d9 : 00000000`00000000 00000000`00000000
00000000`00000000 00000000`00000000 : ntdll!DbgBreakPoint<o:p></o:p></P>
<P class=MsoNormal>00000000`fff01b72 : 00000000`007cef18 00000000`00000000
00000000`ffec5758 00000000`00222460 : complibd!cl_spinlock_acquire+0x39
[s:\builds\6861\trunk\inc\user\complib\cl_spinlock_osd.h @ 107]<o:p></o:p></P>
<P class=MsoNormal>00000000`fff62879 : 00000000`007cef10 00000000`00000010
00000000`ffeb652c 00000000`ffed8db8 : opensm!osm_log+0x1c2
[s:\builds\6861\trunk\ulp\opensm\user\opensm\osm_log.c @ 171]<o:p></o:p></P>
<P class=MsoNormal>00000000`fff0247e : 00000000`006127c0 00000000`00000100
00000000`007c6fb0 00000000`0116f9a0 : opensm!osm_vendor_get+0x49
[s:\builds\6861\trunk\ulp\opensm\user\libvendor\osm_vendor_ibumad.c @
995]<o:p></o:p></P>
<P class=MsoNormal>00000000`fff608b3 : 00000000`0024f1b0 00000000`006127c0
00000000`00000100 00000000`0116f9a0 : opensm!osm_mad_pool_get+0xbe
[s:\builds\6861\trunk\ulp\opensm\user\opensm\osm_mad_pool.c @ 95]<o:p></o:p></P>
<P class=MsoNormal>00000000`754a2d0a : 00000000`00612770 00000000`00000000
00000000`00000000 00000000`00000000 : opensm!umad_receiver+0x3b3
[s:\builds\6861\trunk\ulp\opensm\user\libvendor\osm_vendor_ibumad.c @
314]<o:p></o:p></P>
<P class=MsoNormal>00000000`7712be3d : 00000000`00612770 00000000`00000000
00000000`00000000 00000000`00000000 : complibd!cl_thread_callback+0x1a
[s:\builds\6861\trunk\core\complib\user\cl_thread.c @ 49]<o:p></o:p></P>
<P class=MsoNormal>00000000`77266a51 : 00000000`00000000 00000000`00000000
00000000`00000000 00000000`00000000 :
kernel32!BaseThreadInitThunk+0xd<o:p></o:p></P>
<P class=MsoNormal>00000000`00000000 : 00000000`00000000 00000000`00000000
00000000`00000000 00000000`00000000 :
ntdll!RtlUserThreadStart+0x1d<o:p></o:p></P>
<P class=MsoNormal><o:p> </o:p></P>
<P class=MsoNormal>3: kd> ??p_spinlock<o:p></o:p></P>
<P class=MsoNormal>struct _cl_spinlock * 0x00000000`007cef18<o:p></o:p></P>
<P class=MsoNormal> +0x000
crit_sec :
_RTL_CRITICAL_SECTION<o:p></o:p></P>
<P class=MsoNormal> +0x028 initialized
: 0<o:p></o:p></P>
<P class=MsoNormal><o:p> </o:p></P>
<P class=MsoNormal>3: kd> ??p_log<o:p></o:p></P>
<P class=MsoNormal>struct osm_log * 0x00000000`007cef10<o:p></o:p></P>
<P class=MsoNormal> +0x000
level : 0x30
'0'<o:p></o:p></P>
<P class=MsoNormal> +0x008
lock :
_cl_spinlock<o:p></o:p></P>
<P class=MsoNormal> +0x038
count :
0<o:p></o:p></P>
<P class=MsoNormal> +0x03c
max_size : 0<o:p></o:p></P>
<P class=MsoNormal> +0x040
flush :
0<o:p></o:p></P>
<P class=MsoNormal> +0x048
out_port : (null)
<o:p></o:p></P>
<P class=MsoNormal> +0x050 accum_log_file :
0<o:p></o:p></P>
<P class=MsoNormal> +0x054
daemon :
0<o:p></o:p></P>
<P class=MsoNormal> +0x058 log_file_name :
0x08004633`39010038 "--- memory read error at address 0x08004633`39010038
---"<o:p></o:p></P>
<P class=MsoNormal> +0x060
log_prefix : 0x00000000`00222460
"p???"<o:p></o:p></P>
<P class=MsoNormal><o:p> </o:p></P>
<P class=MsoNormal>3: kd> ??p_vend<o:p></o:p></P>
<P class=MsoNormal>struct _osm_vendor * 0x00000000`007cb340<o:p></o:p></P>
<P class=MsoNormal> +0x000
p_log :
0x00000000`007cef10 osm_log<o:p></o:p></P>
<P class=MsoNormal> +0x008
ca_count :
0x7c6590<o:p></o:p></P>
<P class=MsoNormal> +0x010
p_ca_info : (null) <o:p></o:p></P>
<P class=MsoNormal> +0x018
timeout :
0xbb8<o:p></o:p></P>
<P class=MsoNormal> +0x01c max_retries
: 3<o:p></o:p></P>
<P class=MsoNormal> +0x020 agents
: [32] 0x00000000`006127c0
<o:p></o:p></P>
<P class=MsoNormal> +0x120
ca_names : [32] [64]
"ibv_device0"<o:p></o:p></P>
<P class=MsoNormal> +0x920
mtbl :
vendor_match_tbl<o:p></o:p></P>
<P class=MsoNormal> +0x930
umad_port : umad_port<o:p></o:p></P>
<P class=MsoNormal> +0x9f8
cb_mutex : 0x00000000`00000060
<o:p></o:p></P>
<P class=MsoNormal> +0xa00 match_tbl_mutex :
0x00000000`00000064 <o:p></o:p></P>
<P class=MsoNormal> +0xa08 umad_port_id :
-1<o:p></o:p></P>
<P class=MsoNormal> +0xa10
receiver : (null)
<o:p></o:p></P>
<P class=MsoNormal> +0xa18
issmfd :
-1<o:p></o:p></P>
<P class=MsoNormal> +0xa1c
issm_path : [256]
""<o:p></o:p></P></DIV></BODY></HTML>