[ofa-general] max_mr limit

[Rajouri Jammu]

Hi,
Is there a way to tell the HCA driver to use more of the system memory as
context memory?
When I tried changing the module load parameters num_mpt and num_mtt I got
the following error.

kernel: ib_mthca 0000:01:00.0: Profile requires 0x8000000 bytes; won't fit
in 0x7a00000 bytes of context memory.
So it's currently using 128MB as context memory?

I'm using dual-port DDR memfree HCA.

Also, where can I set the module parameter overrides?

I added this line to /etc/init.d/openibd but that didn't make any
difference.
if [ "X${MTHCA_LOAD}" == "Xyes" ]; then
        #/sbin/modprobe ib_mthca  > /dev/null 2>&1
        /sbin/modprobe ib_mthca num_mpt=262144 num_mtt=2097152 > /dev/null
2>&1

The only way I could experiment was to disable openibd autostart and
manually run
modprobe ib_mtcha num_mpt=262144 num_mtt=2097152

Any info would be greatly appreciated.


On Tue, Mar 11, 2008 at 6:26 AM, Tziporet Koren <tziporet at dev.mellanox.co.il>
wrote:

> Rajouri Jammu wrote:
> > The HCA I'm using reports max_mr = 131056.
> >
> > Our application needs large number of memory regions, much more than
> > the 128K limit.
> >
> > Is there a way to increase this limit?
> > I suppose it's bound by memory on the HCA. Is there an HCA that can
> > use host memory to increase the number of MRs that can be supported.
> >
> Which HCA you are using?
> In mlx4 and mthca drivers there are modules parameters to change the
> amount of memory regions (by enlarging the number of MPTs and MTTs)
>
> for example:
> mlx4:
>   log_num_mpt:         log maximum number of memory protection table
> entries per HCA (default is 17; max is 20)
>   log_num_mtt:         log maximum number of memory translation table
> segments per HCA (default is 20; max is 20)
>
> mthca:
>  num_mpt               - maximum number of memory protection table
> entries per HCA (int)
>  num_mtt               - maximum number of memory translation table
> segments per HCA (int)
>
> Tziporet
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20080319/91e8051b/attachment.html>