<br><font size=2 face="sans-serif">Steve, all,</font>
<br>
<br><font size=2 face="sans-serif">many thanks for your help!</font>
<br>
<br><font size=2 face="sans-serif">I am running a Fedora provided kernel
(see below) and OFED-1.4.</font>
<br><font size=2 face="sans-serif">Running 'install.pl' in 'custom' mode
did never ask about NFS. Neither</font>
<br><font size=2 face="sans-serif">did setting the 'nfsrdma=y' change anything.
'find' told me that there is</font>
<br><font size=2 face="sans-serif">nothing in OFED-1.4 that contains 'nfs'
but there are nfs files in the release</font>
<br><font size=2 face="sans-serif">candidates.</font>
<br>
<br><font size=2 face="sans-serif">I will first try OFED-1.4.1 on my Fedora
9 (2.6.27.12-78.2.8.fc9.x86_64)</font>
<br><font size=2 face="sans-serif">and move to the 2.6.28 kernel provided
by kernel.org if it does not work.</font>
<br>
<br><font size=2 face="sans-serif">Cheers,</font>
<br><font size=2 face="sans-serif"> Philip</font>
<br>
<br>
<br>
<table width=100%>
<tr valign=top>
<td><font size=1 color=#5f5f5f face="sans-serif">From:</font>
<td><font size=1 face="sans-serif">Steve Wise <swise@opengridcomputing.com></font>
<tr valign=top>
<td><font size=1 color=#5f5f5f face="sans-serif">To:</font>
<td><font size=1 face="sans-serif">Jeff Becker <Jeffrey.C.Becker@nasa.gov></font>
<tr>
<td valign=top><font size=1 color=#5f5f5f face="sans-serif">Cc:</font>
<td><font size=1 face="sans-serif">Philip Frey1 <PHF@zurich.ibm.com>,
Tobias Abt1/Zurich/IBM@IBMCH, "general@lists.openfabrics.org"
<general@lists.openfabrics.org></font>
<tr valign=top>
<td><font size=1 color=#5f5f5f face="sans-serif">Date:</font>
<td><font size=1 face="sans-serif">03/05/2009 04:36 PM</font>
<tr valign=top>
<td><font size=1 color=#5f5f5f face="sans-serif">Subject:</font>
<td><font size=1 face="sans-serif">Re: [ofa-general] NFS over RDMA</font></table>
<br>
<hr noshade>
<br>
<br>
<br><tt><font size=2>The stuff shipped in ofed-1.4 isn't very stable.<br>
<br>
I suggest either ofed-1.4.1-rc1 or just a stock 2.6.28 kernel (see my <br>
earlier email).<br>
<br>
Steve.<br>
<br>
<br>
Jeff Becker wrote:<br>
> Hi. If you use install.pl, I think you need to select custom install<br>
> (not "install all"). This will allow you to pick the nfsrdma
option.<br>
><br>
> -jeff<br>
><br>
> Vu Pham wrote:<br>
> <br>
>> The easiest steps to have nfsrdma up and running:<br>
>> Download OFED-1.4.1-rc1 from <br>
>> </font></tt><a href="http://www.openfabrics.org/downloads/OFED/ofed-1.4.1/"><tt><font size=2>http://www.openfabrics.org/downloads/OFED/ofed-1.4.1/</font></tt></a><tt><font size=2><br>
>> and build/install nfsrdma. It is running on 2.6.27/26/25 and RHEL
5.2 <br>
>> default kernels<br>
>><br>
>> Or<br>
>> + Download kernel 2.6.27 from kernel.org<br>
>> + Build the kernel 2.6.27 with IB driver (and other modules ie.
<br>
>> user_mad, addr_trans, ib_mthca, mlx4_ib... ), nfs client/server,
<br>
>> sunrpc... as modules<br>
>> + Boot up with new kernel<br>
>> + Follow the attached README<br>
>><br>
>> NOTE: You can also download and run nfsrdma on latest development
kernel <br>
>> 2.6.29-rc7; however, it does not work on Mellanox ConnectX HCA
due to a <br>
>> bug on Fast memory registration work request. We are debugging
it now<br>
>><br>
>> -vu<br>
>> <br>
>> <br>
>>> Hello,<br>
>>><br>
>>> I want to try NFS over RDMA. According to the documentation
enclosed<br>
>>> within the OFED-1.4 release, it should be as simple as setting
<br>
>>> "nfsrdma=y".<br>
>>><br>
>>> Unfortunately there is no such option. The interactive menu
offered by<br>
>>> './install.pl' does not mention NFS neither.<br>
>>><br>
>>> Is there an updated version of the documentation on how to
run NFS over<br>
>>> RDMA? I have noticed, that it is part of the vanilla Linux
kernel but <br>
>>> I still did<br>
>>> not manage to get it up and running.<br>
>>><br>
>>> Many thanks for your advice,<br>
>>> Philip<br>
>>><br>
>>> -- <br>
>>> Philip Frey
<br>
>>> IBM Zurich Research Laboratory<br>
>>> Saumerstrasse 4
| Phone: +41 44 <br>
>>> 724 8613<br>
>>> CH-8803 Rueschlikon/Switzerland | Email:
phf@zurich.ibm.com<br>
>>> ------------------------------------------------------------------------<br>
>>><br>
>>> _______________________________________________<br>
>>> general mailing list<br>
>>> general@lists.openfabrics.org<br>
>>> </font></tt><a href="http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general"><tt><font size=2>http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general</font></tt></a><tt><font size=2><br>
>>><br>
>>> To unsubscribe, please visit </font></tt><a href="http://openib.org/mailman/listinfo/openib-general"><tt><font size=2>http://openib.org/mailman/listinfo/openib-general</font></tt></a><tt><font size=2><br>
>>> <br>
>>> <br>
>> <br>
>> <br>
><br>
> _______________________________________________<br>
> general mailing list<br>
> general@lists.openfabrics.org<br>
> </font></tt><a href="http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general"><tt><font size=2>http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general</font></tt></a><tt><font size=2><br>
><br>
> To unsubscribe, please visit </font></tt><a href="http://openib.org/mailman/listinfo/openib-general"><tt><font size=2>http://openib.org/mailman/listinfo/openib-general</font></tt></a><tt><font size=2><br>
> <br>
<br>
_______________________________________________<br>
general mailing list<br>
general@lists.openfabrics.org<br>
</font></tt><a href="http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general"><tt><font size=2>http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general</font></tt></a><tt><font size=2><br>
<br>
To unsubscribe, please visit </font></tt><a href="http://openib.org/mailman/listinfo/openib-general"><tt><font size=2>http://openib.org/mailman/listinfo/openib-general</font></tt></a><tt><font size=2><br>
</font></tt>
<br>
<br>