<span class="Apple-style-span" style="border-collapse: collapse; font-family: arial, sans-serif; font-size: 13px; ">Hi<br><br>Following is our question.<br><br>Thanks<br><br>Suo<br><br>----------------------------------------------------------------------------<br>
--------------------------------------------<br><br><br><br>We already wrote a IOCP and WinSocket based communication program. The<br>testing upon Infiniband indicated that this program still go over the<br>IPOverIP and has the overhead of Windows IP stack.<br>
<br><br><br>We saw this PPT and want to know how our WinSocket based program can fully<br>utilize the capabilities of Inifniband RDMA and how to write code over WSD<br>to avoid the overhead of Windows IP stack.<br><br><br>
<br>We just need a sample code like the source code of tool<br>SDPConnect.exe(within the Mallanox driver tools folder) etc. It showed great<br>performance we can’t achieved by our WinSocket code.<br><br><br><br>We’ve got some progress improvement:<br>
<br>1. By searching the source code in OpenFabric, it turns out that these<br>open source include some tools’ source code, like this c file attached;<br><br>2. There was some code founded in such tool’s source code like:<br>
<br>while (ccnt < user_param->iters || rcnt < user_param->iters ) {<br><br> while (scnt < user_param->iters && (scnt - ccnt) <<br>user_param->tx_depth / 2) {<br><br> ib_send_wr_t *bad_wr;<br>
<br> tposted[scnt] = get_cycles();<br><br> ib_status = ib_post_send(qp, &ctx->wr, &bad_wr);<br><br> if (ib_status != IB_SUCCESS) {<br><br> fprintf(stderr, "Couldn't post send: scnt=%d<br>
ib_status %d\n",<br><br> scnt,ib_status);<br><br> return 1;<br><br> }<br><br> ++scnt;<br><br> PERF_DEBUG("scnt = %d \n",scnt);<br>
<br> }<br><br><br><br>But no document just have to guess from the source code for what “qp”,<br>“ctx” means and how to use them. These “ib_” initiated APIs were<br>absolutely NOT WinSocket APIs. What we asked for is SDK or documents for how<br>
to using such API and which Header files we should include and which lib<br>have to be linked. A sample project will be OK if no such document exists.<br><br><br><br><br></span>Thanks <div><br></div><div>Suo<br><div class="gmail_quote">
2011/1/25 Smith, Stan <span dir="ltr"><<a href="mailto:stan.smith@intel.com">stan.smith@intel.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
<div lang="EN-US" link="blue" vlink="purple"><div><p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D">Please submit modified question to <a href="mailto:ofw@lists.openfabrics.org" target="_blank">ofw@lists.openfabrics.org</a></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D"> </span></p><p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D">Furthermore, please identify which sample code you are referring to in order that someone can respond to your question.</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D"> </span></p><p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D">Which Windows OS and processor (x86,x64,ia64).</span></p><p class="MsoNormal">
<span style="font-size:11.0pt;color:#1F497D"> </span></p><p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D">Generally speaking WSD (WinSock Direct) is not used directly but utilized by opening a socket(AF_INET) which beneath the socket layer that has a WSD provider enabled for the specific address family.</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D">For winOFED 2.3 release, run ‘installsp –l’ to see WSD providers.</span></p><p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D">WSD in no longer enabled by default for svr2008* – see ‘installsp –I’</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D"> </span></p><p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D">Stan.</span></p><p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D"> </span></p><div><p class="MsoNormal" style="margin-bottom:12.0pt">From: <b>Suo Zhang</b> <<a href="mailto:zhangs@bjcarnation.com.cn" target="_blank">zhangs@bjcarnation.com.cn</a>><br>
Date: 2011/1/20<br>Subject: WSD Detail Sample Code<br>To: <a href="mailto:membership@openfabrics.org" target="_blank">membership@openfabrics.org</a></p><div><div><p class="MsoNormal">Hi </p><p class="MsoNormal">When I use WSD in my project, I found the sample code is very difficult to use. Because the sample code is very simple.</p>
<p class="MsoNormal">I want to know where can I get a detail sample code for WSD. Because my application must use zero copy to get good performance.<span style="color:#1F497D"></span></p><p class="MsoNormal">Thanks<span style="color:#1F497D"></span></p>
<p class="MsoNormal">Best regards</p><p class="MsoNormal"> </p><p class="MsoNormal"><span lang="ZH-CN">张锁</span> Suo Zhang</p><p class="MsoNormal">Sales Engineer</p><p class="MsoNormal"><span lang="ZH-CN">北京石竹科技有限公司 </span></p>
<p class="MsoNormal">Beijing Carnation Technologies Limited</p><p class="MsoNormal">Mobile +86-186-1175-6167</p><p class="MsoNormal">Tel<span lang="ZH-CN">:</span>+8610-68587971-8029</p><p class="MsoNormal">Fax<span lang="ZH-CN">:</span>+8610-68587975</p>
<p class="MsoNormal"><a href="http://www.vme.cn/" target="_blank">Http://www.vme.cn</a></p><p class="MsoNormal"> </p></div></div></div><p class="MsoNormal"> </p></div></div></blockquote></div><br></div>