[openib-general] low number of CQ entries allowed

[Sayantan Sur]

Roland,

* On Jun,8 Roland Dreier<roland at topspin.com> wrote :
>     Sayantan> Hi, Today I upgraded Gen2 drivers to revision 2539. I am
>     Sayantan> seeing that there are CQ & QP creation problems with
>     Sayantan> larger number of CQ entries.
> 
> Are your kernel and userspace versions in sync?
> 
> If so, can you send the output of
> 
>     strace -etrace=write -ewrite=all <command>
> 
> for some <command> that fails?

Thanks for your reply. I have made sure the kernel & userspace versions
are in sync. Whenever I update drivers, I update for both.

Info about code branches:

[surs at q1:userspace] svn info
Path: .
URL: https://openib.org/svn/gen2/trunk/src/userspace
Repository UUID: 21a7a0b7-18d7-0310-8e21-e8b31bdbf5cd
Revision: 2546
Node Kind: directory
Schedule: normal
Last Changed Author: halr
Last Changed Rev: 2546
Last Changed Date: 2005-06-04 05:28:20 -0400 (Sat, 04 Jun 2005)

[surs at q1:linux-kernel] svn info
Path: .
URL: https://openib.org/svn/gen2/trunk/src/linux-kernel
Repository UUID: 21a7a0b7-18d7-0310-8e21-e8b31bdbf5cd
Revision: 2546
Node Kind: directory
Schedule: normal
Last Changed Author: halr
Last Changed Rev: 2533
Last Changed Date: 2005-06-03 09:36:27 -0400 (Fri, 03 Jun 2005)

----------------------------------------------------------------

The ib_pingpong test included with the source fails like this:

[surs at x1:examples] strace -etrace=write -ewrite=all ./ibv_pingpong 
write(3, "\0\0\0\0\4\0\1\0\324\364\377\377\377\177\0\0", 16) = 16
 | 00000  00 00 00 00 04 00 01 00  d4 f4 ff ff ff 7f 00 00  ........
........ |
write(3, "\1\0\0\0\6\0\2\0 \364\377\377\377\177\0\0x\364\377\377"...,
24) = 24
 | 00000  01 00 00 00 06 00 02 00  20 f4 ff ff ff 7f 00 00  ........
....... |
 | 00010  78 f4 ff ff ff 7f 00 00                           x.......
|
write(3, "\6\0\0\0\6\0\1\0\4\364\377\377\377\177\0\0(\364\377\377"...,
24) = 24
 | 00000  06 00 00 00 06 00 01 00  04 f4 ff ff ff 7f 00 00  ........
........ |
 | 00010  28 f4 ff ff ff 7f 00 00                           (.......
|
write(3, "\6\0\0\0\6\0\1\0\224\364\377\377\377\177\0\0\270\364\377"...,
24) = 24
 | 00000  06 00 00 00 06 00 01 00  94 f4 ff ff ff 7f 00 00  ........
........ |
 | 00010  b8 f4 ff ff ff 7f 00 00                           ........
|
write(3, "\f\0\0\0\f\0\3\0P\364\377\377\377\177\0\0\0\260P\0\0\0"...,
48) = 48
 | 00000  0c 00 00 00 0c 00 03 00  50 f4 ff ff ff 7f 00 00  ........
P....... |
 | 00010  00 b0 50 00 00 00 00 00  00 10 00 00 00 00 00 00  ..P.....
........ |
 | 00020  00 b0 50 00 00 00 00 00  01 00 00 00 01 00 00 00  ..P.....
........ |
write(3, "\f\0\0\0\f\0\3\0\260\363\377\377\377\177\0\0\0\340P\0\0"...,
48) = 48
 | 00000  0c 00 00 00 0c 00 03 00  b0 f3 ff ff ff 7f 00 00  ........
........ |
 | 00010  00 e0 50 00 00 00 00 00  00 40 00 00 00 00 00 00  ..P.....
. at ...... |
 | 00020  00 00 00 00 00 00 00 00  00 00 00 00 01 00 00 00  ........
........ |
write(3, "\24\0\0\0\22\0\2\0@\364\377\377\377\177\0\0\240\207P\0"...,
72) = 72
 | 00000  14 00 00 00 12 00 02 00  40 f4 ff ff ff 7f 00 00  ........
@....... |
 | 00010  a0 87 50 00 00 00 00 00  ff 01 00 00 39 00 00 00  ..P.....
....9... |
 | 00020  68 f4 ff ff ff 7f 00 00  00 27 00 08 07 00 02 00  h.......
.'...... |
 | 00030  00 50 51 00 00 00 00 00  00 30 51 00 00 00 00 00  .PQ.....
.0Q..... |
 | 00040  00 00 00 00 ff 7f 00 00                           ........
|
write(3, "\f\0\0\0\f\0\3\0\260\363\377\377\377\177\0\0\0pQ\0\0\0"...,
48) = -1 ENOMEM (Cannot allocate memory)
write(2, "Couldn\'t create QP\n", 19Couldn't create QP
)   = 19
 | 00000  43 6f 75 6c 64 6e 27 74  20 63 72 65 61 74 65 20  Couldn't
create  |
 | 00010  51 50 0a                                          QP.
|

Thanks,
Sayantan.


> 
> Thanks,
>   Roland

-- 
http://www.cse.ohio-state.edu/~surs