<HTML xmlns:v = "urn:schemas-microsoft-com:vml" xmlns:o = "urn:schemas-microsoft-com:office:office" xmlns:w = "urn:schemas-microsoft-com:office:word" xmlns:m = "http://schemas.microsoft.com/office/2004/12/omml"><HEAD><TITLE>Samsung Enterprise Portal mySingle</TITLE>
<META content="text/html; charset=utf-8" http-equiv=Content-Type>
<STYLE id=mysingle_style type=text/css>P {
MARGIN-BOTTOM: 5px; FONT-SIZE: 9pt; FONT-FAMILY: Arial, arial; MARGIN-TOP: 5px
}
TD {
MARGIN-BOTTOM: 5px; FONT-SIZE: 9pt; FONT-FAMILY: Arial, arial; MARGIN-TOP: 5px
}
LI {
MARGIN-BOTTOM: 5px; FONT-SIZE: 9pt; FONT-FAMILY: Arial, arial; MARGIN-TOP: 5px
}
BODY {
FONT-SIZE: 9pt; FONT-FAMILY: Arial, arial; MARGIN: 10px; LINE-HEIGHT: 1.4
}
</STYLE>
<META content=IE=5 http-equiv=X-UA-Compatible>
<META content=IE=5 http-equiv=X-UA-Compatible>
<META name=GENERATOR content="MSHTML 11.00.9600.18212"></HEAD>
<BODY>
<P><SPAN class=apple-style-span><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000">Hi all,</SPAN></SPAN><o:p><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000"></SPAN></o:p></P>
<P><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000"></SPAN> </P>
<P><o:p><SPAN class=Apple-style-span style="WHITE-SPACE: normal; WORD-SPACING: 0px; BORDER-COLLAPSE: separate; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); FONT: medium Verdana, Helvetica, Arial; ORPHANS: 2; WIDOWS: 2; LETTER-SPACING: normal; TEXT-INDENT: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px"><SPAN class=Apple-style-span style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000">I am sending the updated patch incorporating feedback from Tom. The changes are listed below. The password is samsungnvme</SPAN></SPAN></o:p></P>
<P><o:p><SPAN class=Apple-style-span style="WHITE-SPACE: normal; WORD-SPACING: 0px; BORDER-COLLAPSE: separate; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); FONT: medium Verdana, Helvetica, Arial; ORPHANS: 2; WIDOWS: 2; LETTER-SPACING: normal; TEXT-INDENT: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px"><SPAN class=Apple-style-span style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000"></SPAN></SPAN></o:p> </P>
<P><o:p><SPAN class=Apple-style-span style="WHITE-SPACE: normal; WORD-SPACING: 0px; BORDER-COLLAPSE: separate; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); FONT: medium Verdana, Helvetica, Arial; ORPHANS: 2; WIDOWS: 2; LETTER-SPACING: normal; TEXT-INDENT: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px"><SPAN class=Apple-style-span style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000">1. Moved the StorPortFreePool() from IoCompletionRoutine() to NvmeInitCallback() - NvmeWaitOnNamespaceReady.</SPAN></SPAN></o:p></P>
<P><o:p><SPAN class=Apple-style-span style="WHITE-SPACE: normal; WORD-SPACING: 0px; BORDER-COLLAPSE: separate; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); FONT: medium Verdana, Helvetica, Arial; ORPHANS: 2; WIDOWS: 2; LETTER-SPACING: normal; TEXT-INDENT: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px"><SPAN class=Apple-style-span style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000"></SPAN></SPAN></o:p><o:p><SPAN class=Apple-style-span style="WHITE-SPACE: normal; WORD-SPACING: 0px; BORDER-COLLAPSE: separate; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); FONT: medium Verdana, Helvetica, Arial; ORPHANS: 2; WIDOWS: 2; LETTER-SPACING: normal; TEXT-INDENT: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px"><SPAN class=Apple-style-span style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000">2. </SPAN><SPAN class=Apple-style-span style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000">In NVMeRunningWaitOnNamespaceReady(), the READ command will be sent only when the NS is ATTACHED and the pLunExt->slotStatus is ONLINE. pLunExt->slotStatus will not be ONLINE if lun extension is zero'ed out.</SPAN></SPAN></o:p></P>
<P><o:p><SPAN class=Apple-style-span style="WHITE-SPACE: normal; WORD-SPACING: 0px; BORDER-COLLAPSE: separate; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); FONT: medium Verdana, Helvetica, Arial; ORPHANS: 2; WIDOWS: 2; LETTER-SPACING: normal; TEXT-INDENT: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px"><SPAN class=Apple-style-span style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000">3. In NvmeInitCallBack(), in case NVMeWaitOnNamespaceReady, the READ will be retried only if SC = 0x82, else move to the next NS. If the NS LBA format is unsupported, miniport sends the READ command, for which device will return SC=0xb, and miniport will move to next NS.</SPAN></SPAN></o:p></P>
<P><o:p><SPAN class=Apple-style-span style="WHITE-SPACE: normal; WORD-SPACING: 0px; BORDER-COLLAPSE: separate; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); FONT: medium Verdana, Helvetica, Arial; ORPHANS: 2; WIDOWS: 2; LETTER-SPACING: normal; TEXT-INDENT: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px"><SPAN class=Apple-style-span style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000"></SPAN></SPAN></o:p> </P>
<P><o:p><SPAN class=Apple-style-span style="WHITE-SPACE: normal; WORD-SPACING: 0px; BORDER-COLLAPSE: separate; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); FONT: medium Verdana, Helvetica, Arial; ORPHANS: 2; WIDOWS: 2; LETTER-SPACING: normal; TEXT-INDENT: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px"><SPAN class=Apple-style-span style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000"><STRONG>To Mandatory reviewers</STRONG>: Can we get feedback or approval for this patch before 7th April.</SPAN></SPAN></o:p></P>
<P><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000"> </SPAN><o:p><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000"></SPAN></o:p></P>
<P><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000">Thanks,</SPAN><o:p><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000"></SPAN></o:p></P>
<P><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #000000">Suman</SPAN><SPAN style="COLOR: black"><o:p></o:p></SPAN></P>
<P> </P>
<P>------- <B>Original Message</B> -------</P>
<P><B>Sender</B> : SUMAN PRAKASH B<suman.p@samsung.com> Senior Chief Engineer/SSIR-SSD Solutions/Samsung Electronics</P>
<P><B>Date</B> : Mar 29, 2016 20:27 (GMT+05:30)</P>
<P><B>Title</B> : Re: RE: [nvmewin] Patch with changes for Optimizing disk initialization performance</P>
<P> </P>
<META content=IE=5 http-equiv=X-UA-Compatible>
<META content=IE=5 http-equiv=X-UA-Compatible>
<META name=GENERATOR content=ActiveSquare>
<META content=IE=5 http-equiv=X-UA-Compatible><X-BODY>
<P><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri">Hi Tom,</SPAN></P>
<P><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri"></SPAN> </P>
<P><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri">Thanks for the review comments. </SPAN><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri">Please find my replies below:</SPAN></P>
<P><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri"></SPAN> </P>
<P><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri">1. nvmeStd.c::IoCompletionRoutine, when checking for NVMeWaitOnNamespaceReady, would it be better to make this check and free the buffer in NvmeInitCallback (when processing NVMeWaitOnNamespaceReady). The check in IoCompletionRoutine is executed during the processing of every IO command, but it will only ever be TRUE during initialization.<BR></SPAN><STRONG><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #0000ff"><U>[Suman]</U> </SPAN></STRONG><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #0000ff">Agreed. We will move the StorPortFreePool to NvmeInitCallback.</SPAN></P>
<P><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri; COLOR: #0000ff"></SPAN> </P>
<P><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri">2.a. With your change, in the method NVMeRunningWaitOnNamespaceReady the driver picks the next lun in the list and issues a READ to that namespace. <BR><SPAN style="COLOR: #0000ff"><STRONG><U>[Suman]</U></STRONG> Following changes are made:<BR>a. In NVMeRunningWaitOnNamespaceReady(), the READ command will be sent only when the NS is ATTACHED and the pLunExt->slotStatus is ONLINE. pLunExt->slotStatus will not be ONLINE if lun extension is zero'ed out.<BR>b. In NvmeInitCallBack(), in case NVMeWaitOnNamespaceReady, the READ will be retried only if SC = 0x82, else move to the next NS. If the NS LBA format is unsupported, miniport sends the READ command, for which device will return SC=0xb, and miniport will move to next NS.</SPAN></SPAN></P>
<P><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri">Let me know if you have any questions.</SPAN></P>
<P><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri"><BR>We will share the modified code once others share their feedback. Can we get feedback from other companies by 5th April?</SPAN></P>
<P><SPAN style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri"><BR>Thanks,<BR>Suman</SPAN><BR></P>
<P> </P>
<P>------- <B>Original Message</B> -------</P>
<P><B>Sender</B> : Thomas Freeman<thomas.freeman@hgst.com></P>
<P><B>Date</B> : Mar 29, 2016 00:48 (GMT+05:30)</P>
<P><B>Title</B> : RE: [nvmewin] Patch with changes for Optimizing disk initialization performance</P>
<P> </P>
<META name=Generator content=ActiveSquare>
<STYLE>v\:* {
BEHAVIOR: url(#default#VML)
}
o\:* {
BEHAVIOR: url(#default#VML)
}
w\:* {
BEHAVIOR: url(#default#VML)
}
.shape {
BEHAVIOR: url(#default#VML)
}
</STYLE>
<STYLE>@font-face {
font-family: Calibri;
}
@font-face {
font-family: Verdana;
}
@page WordSection1 {size: 8.5in 11.0in; margin: 1.0in 1.0in 1.0in 1.0in; }
P.MsoNormal {
FONT-SIZE: 12pt; FONT-FAMILY: "Times New Roman",serif; MARGIN-LEFT: 0in; MARGIN-RIGHT: 0in; mso-margin-top-alt: auto; mso-margin-bottom-alt: auto; mso-believe-normal-left: yes
}
LI.MsoNormal {
FONT-SIZE: 12pt; FONT-FAMILY: "Times New Roman",serif; MARGIN-LEFT: 0in; MARGIN-RIGHT: 0in; mso-margin-top-alt: auto; mso-margin-bottom-alt: auto; mso-believe-normal-left: yes
}
DIV.MsoNormal {
FONT-SIZE: 12pt; FONT-FAMILY: "Times New Roman",serif; MARGIN-LEFT: 0in; MARGIN-RIGHT: 0in; mso-margin-top-alt: auto; mso-margin-bottom-alt: auto; mso-believe-normal-left: yes
}
A:link {
TEXT-DECORATION: underline; COLOR: #0563c1; mso-style-priority: 99
}
SPAN.MsoHyperlink {
TEXT-DECORATION: underline; COLOR: #0563c1; mso-style-priority: 99
}
A:visited {
TEXT-DECORATION: underline; COLOR: #954f72; mso-style-priority: 99
}
SPAN.MsoHyperlinkFollowed {
TEXT-DECORATION: underline; COLOR: #954f72; mso-style-priority: 99
}
P {
FONT-SIZE: 9pt; FONT-FAMILY: "Arial",sans-serif; MARGIN: 3.75pt 0in; mso-style-priority: 99
}
P.MsoListParagraph {
FONT-SIZE: 12pt; FONT-FAMILY: "Times New Roman",serif; MARGIN-LEFT: 0.5in; MARGIN-RIGHT: 0in; mso-margin-top-alt: auto; mso-margin-bottom-alt: auto; mso-style-priority: 34
}
LI.MsoListParagraph {
FONT-SIZE: 12pt; FONT-FAMILY: "Times New Roman",serif; MARGIN-LEFT: 0.5in; MARGIN-RIGHT: 0in; mso-margin-top-alt: auto; mso-margin-bottom-alt: auto; mso-style-priority: 34
}
DIV.MsoListParagraph {
FONT-SIZE: 12pt; FONT-FAMILY: "Times New Roman",serif; MARGIN-LEFT: 0.5in; MARGIN-RIGHT: 0in; mso-margin-top-alt: auto; mso-margin-bottom-alt: auto; mso-style-priority: 34
}
SPAN.apple-style-span {
mso-style-name: apple-style-span
}
SPAN.EmailStyle19 {
FONT-FAMILY: "Calibri",sans-serif; FONT-WEIGHT: normal; COLOR: #1f497d; FONT-STYLE: normal; mso-style-type: personal
}
SPAN.EmailStyle20 {
FONT-FAMILY: "Calibri",sans-serif; FONT-WEIGHT: normal; COLOR: windowtext; FONT-STYLE: normal; mso-style-type: personal-compose
}
.MsoChpDefault {
FONT-SIZE: 10pt; mso-style-type: export-only
}
DIV.WordSection1 {
page: WordSection1
}
</STYLE>
<META content=IE=5 http-equiv=X-UA-Compatible><X-BODY lang=EN-US style="MARGIN: 7.5pt" link="#0563C1" vlink="#954F72">
<DIV class=WordSection1>
<P class=MsoNormal style="MARGIN-BOTTOM: 0pt; MARGIN-LEFT: 0in; MARGIN-RIGHT: 7.5pt; mso-margin-top-alt: 0in"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'>Hi Suman,<o:p></o:p></SPAN></P>
<P class=MsoNormal style="MARGIN-BOTTOM: 0pt; MARGIN-LEFT: 0in; MARGIN-RIGHT: 15pt; mso-margin-top-alt: 0in"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'>It looks good. <o:p></o:p></SPAN></P>
<P class=MsoNormal style="MARGIN-BOTTOM: 0pt; MARGIN-LEFT: 0in; MARGIN-RIGHT: 15pt; mso-margin-top-alt: 0in"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'>I have a few comments here:<o:p></o:p></SPAN></P>
<P class=MsoListParagraph style="MARGIN-BOTTOM: 5pt; MARGIN-LEFT: 10.5pt; MARGIN-RIGHT: 22.5pt; TEXT-INDENT: -0.25in; mso-margin-top-alt: 5.0pt; mso-list: l1 level1 lfo1"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'><SPAN style="mso-list: Ignore">1.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman"; FONT-VARIANT: normal; FONT-STYLE: normal; LINE-HEIGHT: normal'> </SPAN></SPAN></SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'>nvmeStd.c::IoCompletionRoutine, when checking for NVMeWaitOnNamespaceReady, would it be better to make this check and free the buffer in NvmeInitCallback (when processing NVMeWaitOnNamespaceReady). The check in IoCompletionRoutine is executed during the processing of every IO command, but it will only ever be TRUE during initialization.<o:p></o:p></SPAN></P>
<P class=MsoListParagraph style="MARGIN-BOTTOM: 5pt; MARGIN-LEFT: 10.5pt; MARGIN-RIGHT: 37.5pt; TEXT-INDENT: -0.25in; mso-margin-top-alt: 5.0pt; mso-list: l1 level1 lfo1"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'><SPAN style="mso-list: Ignore">2.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman"; FONT-VARIANT: normal; FONT-STYLE: normal; LINE-HEIGHT: normal'> </SPAN></SPAN></SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'>I ran into a few problems, here are the details:<o:p></o:p></SPAN></P>
<P class=MsoListParagraph style="MARGIN-BOTTOM: 5pt; MARGIN-LEFT: 10.5pt; MARGIN-RIGHT: 37.5pt; mso-margin-top-alt: 5.0pt"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'>*My device configuration: I'm testing a device that supports NS management and it has multiple namespaces. Some of those namespaces are not attached. The format of some of those namespaces is not supported by the driver (e.g. LBA contains metadata) <o:p></o:p></SPAN></P>
<P class=MsoListParagraph style="MARGIN-BOTTOM: 5pt; MARGIN-LEFT: 46.5pt; MARGIN-RIGHT: 15pt; TEXT-INDENT: -0.25in; mso-margin-top-alt: 5.0pt; mso-list: l1 level2 lfo1"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'><SPAN style="mso-list: Ignore">a.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman"; FONT-VARIANT: normal; FONT-STYLE: normal; LINE-HEIGHT: normal'> </SPAN></SPAN></SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'>With your change, in the method NVMeRunningWaitOnNamespaceReady the driver picks the next lun in the list and issues a READ to that namespace. <o:p></o:p></SPAN></P>
<P class=MsoListParagraph style="MARGIN-BOTTOM: 5pt; MARGIN-LEFT: 82.5pt; MARGIN-RIGHT: 15pt; TEXT-INDENT: -82.5pt; mso-margin-top-alt: 5.0pt; mso-list: l1 level3 lfo1; mso-text-indent-alt: -9.0pt"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'><SPAN style="mso-list: Ignore"><SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman"; FONT-VARIANT: normal; FONT-STYLE: normal; LINE-HEIGHT: normal'> </SPAN>i.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman"; FONT-VARIANT: normal; FONT-STYLE: normal; LINE-HEIGHT: normal'> </SPAN></SPAN></SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'>If that lun is a detached namespace, the READ fails with a status code of 0xb. The driver attempts to retry until the READ is successful, but the command will never succeed. <o:p></o:p></SPAN></P>
<P class=MsoListParagraph style="MARGIN-BOTTOM: 5pt; MARGIN-LEFT: 82.5pt; MARGIN-RIGHT: 15pt; TEXT-INDENT: -82.5pt; mso-margin-top-alt: 5.0pt; mso-list: l1 level3 lfo1; mso-text-indent-alt: -9.0pt"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'><SPAN style="mso-list: Ignore"><SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman"; FONT-VARIANT: normal; FONT-STYLE: normal; LINE-HEIGHT: normal'> </SPAN>ii.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman"; FONT-VARIANT: normal; FONT-STYLE: normal; LINE-HEIGHT: normal'> </SPAN></SPAN></SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'>During initialization, if the driver detects a namespace that is in an unsupported format, it zero's out that LUN entry, but leaves that zero’ed entry in the LUN extension list. When NVMeRunningWaitOnNamespaceReady is processing the list, it does not recognize this as a zero'ed out entry. Rather is attempts a READ from this namespace (the NSID is 0 since the init code zero'ed out that Lun list entry). The READ and all of its retries fail with a status code of 0xb.<o:p></o:p></SPAN></P>
<P class=MsoNormal style="MARGIN-RIGHT: 7.5pt"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'>Proposed fix:<o:p></o:p></SPAN></P>
<P class=MsoListParagraph style="MARGIN-BOTTOM: 5pt; MARGIN-LEFT: 0.25in; MARGIN-RIGHT: 30pt; TEXT-INDENT: -0.25in; mso-margin-top-alt: 5.0pt; mso-list: l0 level1 lfo2"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'><SPAN style="mso-list: Ignore">1.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman"; FONT-VARIANT: normal; FONT-STYLE: normal; LINE-HEIGHT: normal'> </SPAN></SPAN></SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'>Before issuing a READ, ensure that namespace is attached and a valid format. If not, increment the counters and move to the next Lun. <o:p></o:p></SPAN></P>
<P class=MsoListParagraph style="MARGIN-BOTTOM: 5pt; MARGIN-LEFT: 0.25in; MARGIN-RIGHT: 30pt; TEXT-INDENT: -0.25in; mso-margin-top-alt: 5.0pt; mso-list: l0 level1 lfo2"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'><SPAN style="mso-list: Ignore">2.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman"; FONT-VARIANT: normal; FONT-STYLE: normal; LINE-HEIGHT: normal'> </SPAN></SPAN></SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'>Also, in NVMeInitCallback, when handling the case NVMeWaitOnNamespaceReady, instead of looking for an SC of 0x00, only issue a retry if the command fails with SC = 0x82 (NS not ready). <o:p></o:p></SPAN></P>
<P class=MsoNormal style="MARGIN-RIGHT: 37.5pt"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'>Let me know if you have any questions.<o:p></o:p></SPAN></P>
<DIV>
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><B><SPAN style='FONT-SIZE: 10pt; FONT-FAMILY: "Arial",sans-serif; COLOR: #1f497d'>Tom Freeman<o:p></o:p></SPAN></B></P>
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><B><SPAN style='FONT-SIZE: 10pt; FONT-FAMILY: "Arial",sans-serif; COLOR: #1f497d'>Software Engineer, Device Manager and Driver Development<o:p></o:p></SPAN></B></P>
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><SPAN style='FONT-SIZE: 10pt; FONT-FAMILY: "Arial",sans-serif; COLOR: #1f497d'>Western Digital Corporation<o:p></o:p></SPAN></P>
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><SPAN style='FONT-SIZE: 10pt; FONT-FAMILY: "Arial",sans-serif; COLOR: #1f497d'>e. Thomas.freeman@hgst.com<o:p></o:p></SPAN></P>
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><SPAN style='FONT-SIZE: 10pt; FONT-FAMILY: "Arial",sans-serif; COLOR: #1f497d'>o. +1-507-322-2311<o:p></o:p></SPAN></P>
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'><o:p> </o:p></SPAN></P>
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'><IMG id=Picture_x0020_5 src="cid:9INH0GAN05W5@namo.co.kr" width=150 height=47><o:p></o:p></SPAN></P></DIV>
<P class=MsoNormal><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #1f497d'><o:p> </o:p></SPAN></P>
<DIV>
<DIV style="BORDER-TOP: #e1e1e1 1pt solid; BORDER-RIGHT: medium none; BORDER-BOTTOM: medium none; PADDING-BOTTOM: 0in; PADDING-TOP: 3pt; PADDING-LEFT: 0in; BORDER-LEFT: medium none; PADDING-RIGHT: 0in">
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>From:</SPAN></B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'> nvmewin [mailto:nvmewin-bounces@lists.openfabrics.org] <B>On Behalf Of </B>SUMAN PRAKASH B<BR><B>Sent:</B> Wednesday, March 23, 2016 7:27 AM<BR><B>To:</B> nvmewin@lists.openfabrics.org<BR><B>Cc:</B> Seokhwan Kim <sukka.kim@samsung.com>; MANOJ THAPLIYAL <m.thapliyal@samsung.com>; tru.nguyen@ssi.samsung.com<BR><B>Subject:</B> [nvmewin] Patch with changes for Optimizing disk initialization performance<o:p></o:p></SPAN></P></DIV></DIV>
<P class=MsoNormal><o:p> </o:p></P>
<P><SPAN class=apple-style-span><SPAN style='FONT-SIZE: 11.5pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>Hi all,</SPAN></SPAN><o:p></o:p></P>
<P> <o:p></o:p></P>
<P><SPAN class=apple-style-span><SPAN style='FONT-SIZE: 11.5pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>This patch includes changes for </SPAN></SPAN><SPAN class=apple-style-span><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>optimizing the disk initialization performance and relevant changes.</SPAN></SPAN><o:p></o:p></P>
<P><SPAN class=apple-style-span><SPAN style='FONT-SIZE: 11.5pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>I have made a detailed overview of the changes in the attached doc file(the contents are also copied here below) and the attached zip file contains the source code.</SPAN></SPAN><o:p></o:p></P>
<P> <o:p></o:p></P>
<P><SPAN class=apple-style-span><SPAN style='FONT-SIZE: 11.5pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>Password is samsungnvme</SPAN></SPAN><o:p></o:p></P>
<P> <o:p></o:p></P>
<P><SPAN class=apple-style-span><SPAN style='FONT-SIZE: 11.5pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>Please let me know if you have any questions.<o:p></o:p></SPAN></SPAN></P>
<P> <o:p></o:p></P>
<P><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>Thanks,</SPAN><SPAN style="COLOR: black"><o:p></o:p></SPAN></P>
<P><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>Suman</SPAN><SPAN style="COLOR: black"><o:p></o:p></SPAN></P>
<P> <o:p></o:p></P>
<P><SPAN class=apple-style-span><SPAN style='FONT-SIZE: 11.5pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>******************</SPAN></SPAN><o:p></o:p></P>
<P><SPAN class=apple-style-span><SPAN style='FONT-SIZE: 12pt; FONT-FAMILY: "Verdana",sans-serif; COLOR: black'> <o:p></o:p></SPAN></SPAN></P>
<P><B><U><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Disk Initialization Performance Optimization:</SPAN></U></B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><BR>We can use the StorPortInitializePerfOpts(), PERF_CONFIGURATION_DATA.MessageTargets which provides the array of MSI numbers corresponding to each logical processor. This is an alternative of using the Learning cores logic implemented in the OFA driver.</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Also this will directly reduce the time taken for the disk to be enumerated after a device hot insert.</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>The current OFA driver does the following in its initialization path, let’s say on a server which has 32 logical processors and device which supports 32 queues –</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.25in; mso-add-space: auto"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>1.</SPAN><SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Identify controller</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.25in; mso-add-space: auto"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>2.</SPAN><SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Identify namespace - for N number of namespaces</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.25in; mso-add-space: auto"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>3.</SPAN><SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Set features - Interrupt coalescing, number of queues, lba range type.</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.25in; mso-add-space: auto"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>4.</SPAN><SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Create IO completion queue - 32 commands</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.25in; mso-add-space: auto"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>5.</SPAN><SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Create IO submission queue - 32 commands</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.25in; mso-add-space: auto"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>6.</SPAN><SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>LearnMapping - 32 Read commands</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.25in; mso-add-space: auto"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>7.</SPAN><SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>ReSetupQueues - 32 Delete Sub queues + 32 Delete completion queues</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.25in; mso-add-space: auto"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>8.</SPAN><SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Create IO completion queue - 32 commands</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.25in; mso-add-space: auto"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>9.</SPAN><SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Create IO submission queue - 32 commands</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.25in; mso-add-space: auto"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>10.</SPAN><SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Complete initialization state machine</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P> <SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>As can be observed, during disk initialization, around 224 commands are processed for setting up the IO queues and associate the MSI-x number to each queues. If we use StorPortInitializePerfOpts(), we required only 64 commands instead of 224 commands. On a server which as 120 logical processors, 840 commands are required for setting up the IO queues and associate the MSI-x number to each queues. If learning cores is avoided, only 240 commands are required instead of 840 commands.</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P> <SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Also we can fall back to learning cores if the API StorPortInitiailzePerfOpts() fails.</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P> <SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>We see improved device up time after this change. Also, if the number of queues supported by the device is less than the number of logical processors, the driver does not execute the learning cores, hence there won’t be any improvement even if we use StorPortInitializePerfOpts().</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-BOTTOM: 7.5pt"> <SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<TABLE class=MsoNormalTable style="WIDTH: 371pt; BORDER-COLLAPSE: collapse" cellSpacing=0 cellPadding=0 width=495 border=0>
<TBODY>
<TR style="HEIGHT: 16.6pt">
<TD style="BORDER-TOP: black 1pt solid; HEIGHT: 16.6pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 370.5pt; BACKGROUND: #ffcc99; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: black 1pt solid; PADDING-RIGHT: 0in; border-image: none" vAlign=bottom width=494 colSpan=4>
<P style="TEXT-ALIGN: center" align=center><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: #3f3f76'>Server with 32 logical processors:</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD></TR>
<TR style="HEIGHT: 15pt">
<TD style="BORDER-TOP: 0px; HEIGHT: 15pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 62.25pt; BACKGROUND: #a5a5a5; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: black 1pt solid; PADDING-RIGHT: 0in" rowSpan=3 width=83>
<P style="TEXT-ALIGN: center" align=center><B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: white'>OFA version</SPAN></B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD>
<TD style="BORDER-TOP: 0px; HEIGHT: 15pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 306.75pt; BACKGROUND: #a5a5a5; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: 0px; PADDING-RIGHT: 0in" width=409 colSpan=3>
<P style="TEXT-ALIGN: center" align=center><B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: white'>disk up time in seconds</SPAN></B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD></TR>
<TR style="HEIGHT: 15pt">
<TD style="BORDER-TOP: 0px; HEIGHT: 15pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 205.5pt; BACKGROUND: #a5a5a5; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: 0px; PADDING-RIGHT: 0in" width=274 colSpan=2>
<P style="TEXT-ALIGN: center" align=center><B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: white'>Disk capacity = 400 GB</SPAN></B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD>
<TD style="BORDER-TOP: 0px; HEIGHT: 15pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 100.5pt; BACKGROUND: #a5a5a5; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: 0px; PADDING-RIGHT: 0in" rowSpan=2 width=134>
<P style="TEXT-ALIGN: center" align=center><B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: white'>Disk capacity = 1.6 TB</SPAN></B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD></TR>
<TR style="HEIGHT: 15pt">
<TD style="BORDER-TOP: 0px; HEIGHT: 15pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 111.75pt; BACKGROUND: #a5a5a5; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: 0px; PADDING-RIGHT: 0in" width=149>
<P><B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: white'>Disk from vendor 1</SPAN></B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD>
<TD style="BORDER-TOP: 0px; HEIGHT: 15pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 93pt; BACKGROUND: #a5a5a5; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: 0px; PADDING-RIGHT: 0in" width=124>
<P><B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: white'>Disk from vendor 2</SPAN></B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD></TR>
<TR style="HEIGHT: 15pt">
<TD style="BORDER-TOP: 0px; HEIGHT: 15pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 62.25pt; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: black 1pt solid; PADDING-RIGHT: 0in" vAlign=bottom width=83>
<P><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>Rev 133</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD>
<TD style="BORDER-TOP: 0px; HEIGHT: 15pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 111.75pt; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: 0px; PADDING-RIGHT: 0in" vAlign=bottom width=149>
<P style="TEXT-ALIGN: right" align=right><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>14</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD>
<TD style="BORDER-TOP: 0px; HEIGHT: 15pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 93pt; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: 0px; PADDING-RIGHT: 0in" vAlign=bottom width=124>
<P style="TEXT-ALIGN: right" align=right><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>6.5</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD>
<TD style="BORDER-TOP: 0px; HEIGHT: 15pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 100.5pt; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: 0px; PADDING-RIGHT: 0in" vAlign=bottom width=134>
<P style="TEXT-ALIGN: right" align=right><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>14.5</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD></TR>
<TR style="HEIGHT: 8.05pt">
<TD style="BORDER-TOP: 0px; HEIGHT: 8.05pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 62.25pt; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: black 1pt solid; PADDING-RIGHT: 0in" vAlign=bottom width=83>
<P><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>Latest</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD>
<TD style="BORDER-TOP: 0px; HEIGHT: 8.05pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 111.75pt; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: 0px; PADDING-RIGHT: 0in" vAlign=bottom width=149>
<P style="TEXT-ALIGN: right" align=right><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>5</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD>
<TD style="BORDER-TOP: 0px; HEIGHT: 8.05pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 93pt; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: 0px; PADDING-RIGHT: 0in" vAlign=bottom width=124>
<P style="TEXT-ALIGN: right" align=right><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>5</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD>
<TD style="BORDER-TOP: 0px; HEIGHT: 8.05pt; BORDER-RIGHT: windowtext 1pt solid; WIDTH: 100.5pt; BORDER-BOTTOM: black 1pt solid; PADDING-BOTTOM: 0in; PADDING-TOP: 0in; PADDING-LEFT: 0in; BORDER-LEFT: 0px; PADDING-RIGHT: 0in" vAlign=bottom width=134>
<P style="TEXT-ALIGN: right" align=right><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif; COLOR: black'>13.5</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P></TD></TR></TBODY></TABLE>
<P><B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>PS</SPAN></B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>: data may change for different vendor SSDs</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P> <SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P><B><U><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Code changes:</SPAN></U></B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.25in; mso-add-space: auto">1.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Changes w.r.t StorPortInitializePerfOpts().</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 1in; TEXT-INDENT: -0.25in; mso-add-space: auto">a.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>In NVMeInitialize(), moved the StorPortInitializePerfOpts() after NVMeEnumMsiMessages() to set the LastRedirectionMessageNumber in StorPortInitializePerfOpts().</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 1in; TEXT-INDENT: -0.25in; mso-add-space: auto">b.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Set the flags STOR_PERF_INTERRUPT_MESSAGE_RANGES and STOR_PERF_ADV_CONFIG_LOCALITY, and values FirstRedirectionMessageNumber, LastRedirectionMessageNumber and MessageTargets in StorPortInitializePerfOpts() to get the MSIx-Core mapping in MessageTargets. If this API returns success, the learning cores can be skipped.</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 1in; TEXT-INDENT: -0.25in; mso-add-space: auto">c.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>If the StorPortInitializePerfOpts() fails, in NVMeMsiMapCores(), the mapping of msix to cores in assigned sequentially, and learning cores is executed. During learning cores, in IoCompletionRoutine(), the msix to core is re-mapped. If the StorPortInitializePerfOpts() succeeds, in NVMeMsiMapCores(), the mapping of msix to cores is taken from MessageTargets and learnig cores is skipped.</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 1in; mso-add-space: auto"> <SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.25in; mso-add-space: auto">2.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>When the learning cores is skipped, the controller initialization completes faster. But we have observed that in some devices, the Namespace is not ready to process I/O at this point. And when kernel send I/O, the device returns SC = NAMESPACE_NOT_READY and miniport returns SCSI_SENSEQ_BECOMING_READY, for which storport retries after some time. If the device takes too long to initialize the namespace, the storport gives up and shows as Uninitialized in the disk mgmt.<BR>Hence the controller initialization has to be completed after Namespace is ready. For this, a new state is introduce in the NVMeRunning(), which waits till the NS is ready. </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 1in; TEXT-INDENT: -0.25in; mso-add-space: auto"><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>a.</SPAN><SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Introduced a new state NVMeWaitOnNamespaceReady in NVMeRunning().</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 1in; TEXT-INDENT: -0.25in; mso-add-space: auto">b.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>In IoCompletionRoutine(), determine which CQ to look in based on WaitOnNamespaceReady state.</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 1in; TEXT-INDENT: -0.25in; mso-add-space: auto">c.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>In NVMeInitCallback(), implemented call back for NVMeWaitOnNamespaceReady.</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 1in; TEXT-INDENT: -0.25in; mso-add-space: auto">d.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>In IoCompletionRoutine(), free the read buffer for namespaceready.</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in"><B><U><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Note</SPAN></U></B><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>: </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.75in; TEXT-INDENT: -0.25in; mso-add-space: auto">a.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>We have observed that higher capacity Namespaces take too long to initialize, hence the passiveTimeout value in NVMePassiveInitialize() is not sufficient. We need to increase the timeout value based on vendor requirements. </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.75in; TEXT-INDENT: -0.25in; mso-add-space: auto">b.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>b. Checking for Namespace ready is skipped during dump/hibernation mode and resume from hibernation.</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P> <SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.25in; mso-add-space: auto">3.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>Usually, the number of MSIx supported by device and MSIx granted(StorPortGetMSIInfo) will be number of IO Queue + 1 Admin Queue. But, we share the Admin queue and first I/O queue in core 0, and hence MSIx 0 is shared between admin queue and first I/O queue. Incase of active cores more than Queues supported, one of the MSGID should not be considered. Made changes in In NVMeEnumMsiMessages() accordingly.<BR>For example, cores = 32, Admin + IO queues = 1 + 8, then MsgID(in NVMeEnumMsiMessages()) should be 8.</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; mso-add-space: auto"> <SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.25in; mso-add-space: auto">4.<SPAN style='FONT-SIZE: 7pt; FONT-FAMILY: "Times New Roman",serif'> </SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'>In IoCompletionRoutine(), for learning cores, only if MSIGranted is less than active cores, the QueueNo will be remapped in sequential manner. Otherwise QueueNo remains same as before.</SPAN><SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P style="MARGIN-BOTTOM: 7.5pt"> <SPAN style='FONT-SIZE: 11pt; FONT-FAMILY: "Calibri",sans-serif'><o:p></o:p></SPAN></P>
<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><IMG id=_x0000_i1025 src="http://ext.samsung.net/mailcheck/SeenTimeChecker?do=ffcf397c39a8fbf282cc457579413d8ac3ad024398f8c8597d9badbdf7e30042d1afaaba7860cdcd9564217c646641ad61e16949eaa607501b20909a04efd4d2748cfe1d4e847419cf878f9a26ce15a0"><o:p></o:p></P></DIV>
<P class=p1><SPAN class=s1><STRONG>Western Digital Corporation (and its subsidiaries) E-mail Confidentiality Notice & Disclaimer:</STRONG></SPAN></P>
<P class=MsoNormal></P>
<P class=p1><SPAN class=s1>This e-mail and any files transmitted with it may contain confidential or legally privileged information of WDC and/or its affiliates, and are intended solely for the use of the individual or entity to which they are addressed. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited. If you have received this e-mail in error, please notify the sender immediately and delete the e-mail in its entirety from your system.</SPAN></P></X-BODY>
<P> </P>
<P> </P>
<P> </P>
<P> </P>
<TABLE id=confidentialsignimg>
<TBODY>
<TR>
<TD NAMO_LOCK>
<P><IMG border=0 src="cid:OC322OJWTEAC@namo.co.kr"></P></TD></TR></TBODY></TABLE></BODY></HTML><img src='http://ext.samsung.net/mailcheck/SeenTimeChecker?do=5ffd028a7cd232fe52416a8baedc9679371880470f5f30277d9badbdf7e30042d1afaaba7860cdcd9564217c646641ad61e16949eaa607501b20909a04efd4d2748cfe1d4e847419cf878f9a26ce15a0' border=0 width=0 height=0 style='display:none'>