<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=Content-Type content="text/html; charset=iso-8859-1">
<STYLE></STYLE>
<META content="MSHTML 6.00.2900.3199" name=GENERATOR></HEAD>
<BODY bgColor=#ffffff>
<DIV><FONT face=Arial size=2>Hi Dotan,</FONT></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV><FONT face=Arial size=2>Please see my replies inline.</FONT></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV><FONT face=Arial size=2>Thanks,</FONT></DIV>
<DIV><FONT face=Arial size=2>Diego</FONT></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<BLOCKQUOTE dir=ltr
style="PADDING-RIGHT: 0px; PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #000000 2px solid; MARGIN-RIGHT: 0px">
<DIV style="FONT: 10pt arial">----- Original Message ----- </DIV>
<DIV
style="BACKGROUND: #e4e4e4; FONT: 10pt arial; font-color: black"><B>From:</B>
<A title=dotanb@mellanox.co.il href="mailto:dotanb@mellanox.co.il">Dotan
Barak</A> </DIV>
<DIV style="FONT: 10pt arial"><B>To:</B> <A title=diego.guella@sircomtech.com
href="mailto:diego.guella@sircomtech.com">Diego Guella</A> ; <A
title=tzachid@mellanox.co.il href="mailto:tzachid@mellanox.co.il">Tzachi
Dar</A> ; <A title=ftillier@windows.microsoft.com
href="mailto:ftillier@windows.microsoft.com">Fab Tillier</A> </DIV>
<DIV style="FONT: 10pt arial"><B>Cc:</B> <A title=ofw@lists.openfabrics.org
href="mailto:ofw@lists.openfabrics.org">ofw@lists.openfabrics.org</A> </DIV>
<DIV style="FONT: 10pt arial"><B>Sent:</B> Thursday, November 15, 2007 3:35
PM</DIV>
<DIV style="FONT: 10pt arial"><B>Subject:</B> RE: Completion with bad status:
IBV_WC_RETRY_EXC_ERROR</DIV>
<DIV><BR></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
color=#0000ff size=2>I don't have an available Linux <--> windows setup,
can you please send me the following data:</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
color=#0000ff size=2>* LID values (from ibv_devinfo/vstat)</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>LIDs are 1 for Windows side, and 2 for Linux side. (in host order, as
seen by Linux)</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
color=#0000ff size=2>* the values that you set to the AV.LID (the value that
you set, after fixing/handling endianess)</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>Using the printfs in the code I can see this:</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>### Linux ###<BR></FONT></SPAN><SPAN class=750243114-15112007><FONT
face=Arial size=2>commandline:</FONT></SPAN><SPAN
class=750243114-15112007><FONT face=Arial size=2></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>./verbs_test --ip=193.168.200.5</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>----------</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>QP with number 0x406 was created</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>MR was registered, vaddr=0x0000000000507570, rkey =
0x00003900</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2><<now reads the LID and htons()' it>></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>local LID: 512</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>sizeof cm data: 18</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2><<now exchanges data with other side, and htons()' on the
received LID>></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>Remote data info: lid=1, QP num=0x05040000, vaddr=0x00000000003d7290,
rkey=0x00230000</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>Posting receive request</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>----------</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>And this side blocks here indefinitely, since the other completes with
error.<BR></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>### ###</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>### Windows ###</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>commandline:</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>verbs_test.exe -d</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>----------</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>QP with number 0x5040000 was created<BR>MR was registered,
vaddr=0x00000000003d7290, rkey = 0x00230000<BR>Local LID: 256<BR>sizeof cm
data: 18<BR>Remote data info: lid=512, QP num=0x00000406,
vaddr=0x0000000000507570, rkey=0x00003900<BR>Sending the string 'Hello world'
to the other side<BR>Posting send request<BR>Polling for Completion<BR>Error,
got completion with bad status: IB_WCS_TIMEOUT_RETRY_ERR<BR>Starting
destruction of resources</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>----------<BR></FONT></SPAN><SPAN class=750243114-15112007><FONT
face=Arial size=2></FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>### ###</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
color=#0000ff size=2>* the QP number in each size</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>See above. Note that the QPN changes at every test, this results are
for one particular test</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
color=#0000ff size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
color=#0000ff size=2>* the remote QP number that you set in each
side</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
size=2>Same as above. I do not change endianness of QPN, vaddr,
rkey.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
color=#0000ff size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=750243114-15112007><FONT face=Arial
color=#0000ff size=2>thanks</FONT></SPAN></DIV>
<DIV dir=ltr align=left><FONT face=Arial size=2>Dotan</FONT></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV></BLOCKQUOTE></BODY></HTML>