[ofa-general] ***SPAM*** Re: iSer tuning guide?

[Chris Worley]

What's version of OFED has both a stable and high performance iSer?

I setup the latest OFED (1.4.1rc3), and the speed kicked in, but using
fio on the initiator using two targets hung quickly on the initiator:

 connection3:0: ping timeout of 5 secs expired, last rx 4557795905,
last ping 4557800905, now 4557805905
 connection3:0: detected conn error (1011)
iser: iscsi_iser_ep_disconnect:ib conn ffff8104dc482ec0 state 2
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
 connection4:0: ping timeout of 5 secs expired, last rx 4557796701,
last ping 4557801701, now 4557806701
 connection4:0: detected conn error (1011)
 connection1:0: ping timeout of 5 secs expired, last rx 4557799350,
last ping 4557804350, now 4557809350
 connection1:0: detected conn error (1011)
 connection2:0: ping timeout of 5 secs expired, last rx 4557800108,
last ping 4557805108, now 4557810108
 connection2:0: detected conn error (1011)
 connection6:0: ping timeout of 5 secs expired, last rx 4557800224,
last ping 4557805224, now 4557810224
 connection6:0: detected conn error (1011)
 connection5:0: ping timeout of 5 secs expired, last rx 4557800231,
last ping 4557805231, now 4557810234
 connection5:0: detected conn error (1011)
iser: iser_cma_handler:event 10 conn ffff8104dc482ec0 id ffff8105b1502800
iser: iser_free_ib_conn_res:freeing conn ffff8104dc482ec0 cma_id
ffff8105b1502800 fmr pool ffff8105f9b555c0 qp ffff81027b346000
iser: iser_device_try_release:device ffff81081bb81640 refcount 5
iser: iscsi_iser_ep_disconnect:ib conn ffff8104dc4824c0 state 2
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
 session3: session recovery timed out after 120 secs
iser: iser_cma_handler:event 10 conn ffff8104dc4824c0 id ffff8107df2ce400
iser: iser_free_ib_conn_res:freeing conn ffff8104dc4824c0 cma_id
ffff8107df2ce400 fmr pool ffff8107f60c90c0 qp ffff8107720d2400
iser: iser_device_try_release:device ffff81081bb81640 refcount 4
iser: iscsi_iser_ep_disconnect:ib conn ffff81081fa521c0 state 2
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
iser: iser_cq_tasklet_fn:comp w. error op 0 status 5
 session4: session recovery timed out after 120 secs


On Fri, Apr 10, 2009 at 8:53 AM, Chris Worley <worleys at gmail.com> wrote:
> I'm running RHEL5.2 w/ the stock OFED RPMs.  I have a target disk that
> run at 800MB/s locally and QDR IB.  I need to get some performance out
> of this, as I'm seeing <300MB/s in my benchmarks.
>
> On the initiator side, I run a test using 1MB block sizes.
>
> On the target side I'm seeing everything in 4K packets.
>
> Any idea who's setting this and why?
>
> Is there a tuning guide available?
>
> Thanks,
>
> Chris
>