[openib-general] NFS over IPoIB performance..

[Troy Benjegerdes]

Well, I'm quite impressed.. I've been running NFS over IPoIB to a server
with a 3ware SATA raid card in it, and nothing's crashed ;)

This is with a 2.4.11.4 kernel and roland-uverbs branch. (although I'm
not using uverbs at the moment)


da0:64bit:~$ ifconfig ib0
ib0       Link encap:UNSPEC  HWaddr 00-00-00-14-FE-80-00-00-00-00-00-00-00-00-00-00
          inet addr:10.0.0.10  Bcast:10.255.255.255  Mask:255.255.0.0
          inet6 addr: fe80::206:6a00:a000:43c/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:2044  Metric:1
          RX packets:209004632 errors:0 dropped:0 overruns:0 frame:0
          TX packets:959650153 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:128
          RX bytes:309422700203 (288.1 GiB)  TX bytes:1863296583515 (1.6 TiB)

My only real problem is there seems to be no good way to set readahead
for the NFS client. I'm averaging 75mb/sec or so, and I've seen peaks of
100MB/sec, with clients from two different machines running the GAMESS
computational chemistry code.