[ofa-general] max_mr limit

[Rajouri Jammu]

On Wed, Mar 19, 2008 at 10:58 PM, Roland Dreier <rdreier at cisco.com> wrote:

>
>  > kernel: ib_mthca 0000:01:00.0: Profile requires 0x8000000 bytes; won't
> fit
>  > in 0x7a00000 bytes of context memory.
>  > So it's currently using 128MB as context memory?
>  >
>  > I'm using dual-port DDR memfree HCA.
>
> Are you sure it's memfree?  It's acting like it's not.
>

 You are correct. I looked up the model number and looks like this HCA has
128MB on-board memory.


>
> What is the output if you load the ib_mthca module with debug_level=1
> set?  What firmware version do you have installed?


o/p with debug_level=1

 kernel: ib_mthca: Mellanox InfiniBand HCA driver v1.0 (February 28, 2008)
 kernel: ib_mthca: Initializing 0000:01:00.0
 kernel: PCI: Enabling device 0000:01:00.0 (0000 -> 0002)
 kernel: ACPI: PCI Interrupt 0000:01:00.0[A] -> GSI 18 (level, low) -> IRQ
58
 kernel: ib_mthca 0000:01:00.0: Profile requires 0x8000000 bytes; won't fit
in 0x7a00000 bytes of context memory.
 kernel: ACPI: PCI interrupt for device 0000:01:00.0 disabled
 kernel: ib_mthca: probe of 0000:01:00.0 failed with error -12


>
>  > Also, where can I set the module parameter overrides?
>
> You should be able to add parameters using modprobe.conf.  See the
> manpage for modprobe.conf for more details.
>

That worked, thanks!

>
>  > modprobe ib_mtcha num_mpt=262144 num_mtt=2097152
>
> I tried that here and it works, and I get
>
>    ib_mthca 0000:0b:00.0: HCA context memory: reserving 706672 KB
>
> in the debug output.
>

That's good news. I will try and get a mem-free HCA and test with it.

Thanks a lot for the help!

>
>  - R.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20080319/f668021c/attachment.html>