[Users] how to find max memory that can be registered

[Robert D. Russell]

Jagadeesh:

I assume you are using Linux as your operating system.
This error has nothing to do with the HCA, and everything
to do with your OS.  In Linux, there is a file named 
/etc/security/limits.conf that limits the amount of memory
that can be pinned, which is what OFA registration does.
To allow an unlimited amount of memory to be pinned
(i.e., registered), just add the following 2 lines
at the end of this file:
* hard memlock unlimited
* soft memlock unlimited

It works for us.
Have fun,
Bob Russell
rdr at iol.unh.edu


On Tue, 23 Jul 2013, jagadeesh kumar wrote:

> Hi all,
>
>   I am new to InfiniBand, and writting an application(using OFED-1.5.4)
> for Mellanox HCA InfiniHost Ex25208 (board_id : HP_0060000001), which
> registers 16GB memory using ibv_reg_mr but it is failing (returns NULL).
> My machine have sufficient memory (64 GB) and i am able to register less
> than 16GB.
> Is it the HCA which is limiting this and if yes, is there any way to find
> out maximum memory that can be registered.
> I have tried ibv_query_device but it returned max_mr_size as
> 0XFFFFFFFFFFFFFFFF(16 times).
>
> Thanks
> Jagadeesh
>