<div dir="ltr"><div class="gmail_default" style="color:rgb(32,18,77)">One more thing we have modified is in the file "drivers/infiniband/hw/rxe/rxe_net.c</div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default" style="color:rgb(32,18,77)">we have commented the <b>line 426</b></div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default"><font color="#b45f06">//struct net_device *ndev = arg;</font></div><div class="gmail_default"><font color="#b45f06"><br></font></div><div class="gmail_default"><font color="#20124d">and added the following</font></div><div class="gmail_default"><font color="#20124d"><br></font></div><div class="gmail_default"><div class="gmail_default"><font color="#b45f06">struct netdev_notifier_info *info =arg;</font></div><div class="gmail_default"><font color="#b45f06">struct net_device *ndev = info->dev;</font></div><div class="gmail_default"><font color="#b45f06"><br></font></div><div class="gmail_default"><font color="#20124d">moreover we have copied "ib_pack.h" from the vanilla(3.0.0+) to latest kernel (4.0.4)</font></div><div class="gmail_default"><font color="#20124d"><br></font></div><div class="gmail_default"><font color="#20124d">please help me... to achieve SoftRoCE in latest kernel</font></div><div style="color:rgb(32,18,77)"><br></div></div><div class="gmail_default" style="color:rgb(32,18,77)"></div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><span style="color:rgb(53,28,117)"><font face="Calibri, sans-serif"><span style="font-size:15px"><span style="background-color:rgb(255,255,255)"><br><b><i>with warm regards</i></b></span></span></font></span></div><div><span style="font-size:15px"><b><font color="#20124d" style="background-color:rgb(255,255,255)" face="trebuchet ms, sans-serif">Dinesh.K.B </font></b></span></div><div><span style="font-size:15px"><font color="#20124d" style="background-color:rgb(255,255,255)" face="garamond, serif">Software Engineer</font><br></span></div><span style="color:rgb(53,28,117)"><font size="2"><b><font face="Calibri, sans-serif"><span></span></font></b></font></span><p style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><img src="https://docs.google.com/uc?export=download&id=0B-bNg2mISfLxMFNSSGFtUktHNUE&revid=0B-bNg2mISfLxeTk5ZnlOeE9wcCszMEhYRGd2Y0F4bnVZNVBNPQ" width="96" height="36"><br></p><p style="margin:0in 0in 0.0001pt;font-size:11pt"><span style="color:rgb(53,28,117)"><font face="monospace, monospace"><b>Cell : </b>+91 9944456867 | <b>Skype :</b> dinesh_kb93</font></span></p></div></div></div></div></div>
<br><div class="gmail_quote">On Tue, Jun 9, 2015 at 1:53 PM, Dinesh Kb <span dir="ltr"><<a href="mailto:dinesh.kb@vvdntech.in" target="_blank">dinesh.kb@vvdntech.in</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="color:rgb(32,18,77)">Hi,</div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default" style="color:rgb(32,18,77)"> <b>"I am new to OFED"</b></div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default" style="color:rgb(32,18,77)">I have downloaded the "<b>Soft-RoCE</b>" which includes the <b>kernel (3.0.0+) </b>and <b>rxe support.</b></div><div class="gmail_default" style="color:rgb(32,18,77)">I have Installed all the packages included in the <b>OFED-1.5.2-rxe </b>except the<b> kernel-ib. </b></div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default"><b style="color:rgb(32,18,77)">In kernel 3.0.0+, </b><font color="#20124d">I am able to run the </font><font color="#e69138">"rping" test successfully and able to perform the benchmark tests, I am comfort with benchmark output.</font></div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default" style="color:rgb(32,18,77)">Now I am in need to perform the RoCE operation in the<b> higher kernel version...say 4.0.4</b></div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default"><span style="color:rgb(32,18,77)">I have downloaded source file for the kernel version 4.0.4 and i have copied </span><font color="#e69138">"driver/infiniband/hw/rxe" </font><font color="#20124d">directory from </font><font color="#e69138">kernel 3.0.0+ and pasted in the 4.0.4 kernel source</font><font color="#20124d"> and I have applied some patch for rxe to work smoothly...</font></div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default" style="color:rgb(32,18,77)">I am facing <b>Kernel crash</b> while running rping...</div><div class="gmail_default" style="color:rgb(32,18,77)">and regarding the <b>benchmark...</b></div><div class="gmail_default" style="color:rgb(32,18,77)"><b><br></b></div><div class="gmail_default"><font color="#b45f06">when running rping as server in the higher kernel version and client in the lower version is hold fine....</font></div><div class="gmail_default"><font color="#b45f06">but its worse(crash) when running vice-versa</font></div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default"><div class="gmail_default" style="color:rgb(32,18,77)">Now i am facing problems, when kernel 4.04 acts as a client...</div><div class="gmail_default"><font color="#20124d">while taking the <b>wireshark </b>output.. the server constantly sends the </font><font color="#b45f06">"read request"</font><font color="#20124d"> and its </font><font color="#b45f06">not getting any response from the client...</font></div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default"><font color="#b45f06">the virtual address and dma length fields are "zero".</font></div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default" style="color:rgb(32,18,77)">Kindly help me.....</div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default" style="color:rgb(32,18,77)"><b style="background-color:rgb(249,203,156)">Is there any possibilities/ perfect patch to make SoftRoCE work fine with higher kernel version (say kernel 3.19+)</b></div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default" style="color:rgb(32,18,77)">I hereby attached the wireshark output for<b> ib_read_bw</b> (when higher version acts as a client and 3.0.0+ acts as a server) and the patch i have applied as an attachment</div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default" style="color:rgb(32,18,77)">the crash in the server is as follows</div><div class="gmail_default" style="color:rgb(32,18,77)"><br></div><div class="gmail_default" style="color:rgb(32,18,77)"><pre style="margin-top:0px;padding:5px;border:0px;font-size:13px;overflow:auto;width:auto;max-height:600px;font-family:Consolas,Menlo,Monaco,'Lucida Console','Liberation Mono','DejaVu Sans Mono','Bitstream Vera Sans Mono','Courier New',monospace,sans-serif;word-wrap:normal;color:rgb(34,34,34);background-color:rgb(238,238,238)"><code style="margin:0px;padding:0px;border:0px;font-family:Consolas,Menlo,Monaco,'Lucida Console','Liberation Mono','DejaVu Sans Mono','Bitstream Vera Sans Mono','Courier New',monospace,sans-serif;white-space:inherit">root@ls2085aqds:/etc/libibverbs.d# rping -s
------------[ cut here ]------------
WARNING: CPU: 0 PID: 810 at kernel/softirq.c:146 __local_bh_enable_ip+0x84/0xc0()
Modules linked in: ib_rxe_net ib_rxe rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr ipv6
CPU: 0 PID: 810 Comm: kworker/0:1 Not tainted 3.16.0-Layerscape2-SDK+g330dd4b #20
Workqueue: ib_cm cm_work_handler [ib_cm]
Call trace:
[<ffffffc000088084>] dump_backtrace+0x0/0x12c
[<ffffffc0000881c0>] show_stack+0x10/0x1c
[<ffffffc000552fa4>] dump_stack+0x74/0xc4
[<ffffffc0000a9b8c>] warn_slowpath_common+0x84/0xac
[<ffffffc0000a9c78>] warn_slowpath_null+0x14/0x20
[<ffffffc0000ae3d0>] __local_bh_enable_ip+0x80/0xc0
[<ffffffc00049fccc>] __dev_queue_xmit+0x1cc/0x408
[<ffffffc00049ff14>] dev_queue_xmit+0xc/0x18
[<ffffffbffc11b620>] send_finish+0x34/0x40 [ib_rxe_net]
[<ffffffbffc11b6b8>] send+0x8c/0xec [ib_rxe_net]
[<ffffffbffc10933c>] $x+0x318/0x334 [ib_rxe]
[<ffffffbffc109be0>] $x+0xa8/0x120 [ib_rxe]
[<ffffffbffc109d54>] rxe_run_task+0x4c/0x90 [ib_rxe]
[<ffffffbffc1093b4>] arbiter_skb_queue+0x5c/0x8c [ib_rxe]
[<ffffffbffc0fffd4>] rxe_requester+0x83c/0xddc [ib_rxe]
[<ffffffbffc109be0>] $x+0xa8/0x120 [ib_rxe]
[<ffffffbffc109d54>] rxe_run_task+0x4c/0x90 [ib_rxe]
[<ffffffbffc104e0c>] rxe_post_send+0x80/0x40c [ib_rxe]
[<ffffffbffc097068>] ib_send_mad+0x288/0x454 [ib_mad]
[<ffffffbffc09759c>] ib_post_send_mad+0x190/0x544 [ib_mad]
[<ffffffbffc0b075c>] ib_send_cm_rej+0xd0/0x194 [ib_cm]
[<ffffffbffc0b19b8>] cm_destroy_id+0x188/0x300 [ib_cm]
[<ffffffbffc0b1e80>] cm_process_work+0x154/0x17c [ib_cm]
[<ffffffbffc0b2600>] cm_req_handler+0x758/0x978 [ib_cm]
[<ffffffbffc0b28ec>] cm_work_handler+0xcc/0x1584 [ib_cm]
[<ffffffc0000c0918>] process_one_work+0x114/0x354
[<ffffffc0000c12f8>] worker_thread+0x13c/0x500
[<ffffffc0000c7034>] kthread+0xd0/0xe8
---[ end trace be7a1b95934c8f03 ]---</code></pre></div></div><div><div><div dir="ltr"><div><div dir="ltr"><div><span style="color:rgb(53,28,117)"><font face="Calibri, sans-serif"><span style="font-size:15px"><span style="background-color:rgb(255,255,255)"><br><b><i>with warm regards</i></b></span></span></font></span></div><div><span style="font-size:15px"><b><font color="#20124d" style="background-color:rgb(255,255,255)" face="trebuchet ms, sans-serif">Dinesh.K.B </font></b></span></div><div><span style="font-size:15px"><font color="#20124d" style="background-color:rgb(255,255,255)" face="garamond, serif">Software Engineer</font><br></span></div><span style="color:rgb(53,28,117)"><font size="2"><b><font face="Calibri, sans-serif"><span></span></font></b></font></span><p style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><img src="https://docs.google.com/uc?export=download&id=0B-bNg2mISfLxMFNSSGFtUktHNUE&revid=0B-bNg2mISfLxeTk5ZnlOeE9wcCszMEhYRGd2Y0F4bnVZNVBNPQ" width="96" height="36"><br></p><p style="margin:0in 0in 0.0001pt;font-size:11pt"><span style="color:rgb(53,28,117)"><font face="monospace, monospace"><b>Cell : </b>+91 9944456867 | <b>Skype :</b> dinesh_kb93</font></span></p></div></div></div></div></div>
</div>
</blockquote></div><br></div>