[ewg] ibv_create_qp fails with enomem

[Shawn Bohrer]

On Fri, Mar 23, 2012 at 01:42:31PM -0700, Ker Can wrote:
>    We updated to MLNX_OFED_LINUX-1.5.3-3.0.0 from OFED-1.5.2_1  recently
>    and we're running into issues where we get a ENOMEM error from
>    ibv_create_qp(). Earlier with this OFED version we were running into a
>    ENOMEM with ibv_reg_mr() but that was resolved by setting log_num_mtt
>    to 24 as described in this link
>    http://h10025.www1.hp.com/ewfrf/wc/document?cc=us&lc=en&dlc=en&docname=
>    c03113904
>    All the other settings in /sys/module/mlx4_core/parameters are the
>    default values.   The node itself has 96GB of memory we're nowhere
>    close to using that. Is there any way to figure out whats going on ?

You probably need to set log_mtts_per_seg=3 on mlx4_core.  That's the
current default in upstream OFED, but I believe
MLNX_OFED_LINUX-1.5.3-3.0.0 defaults it to 0.

--
Shawn

-- 

---------------------------------------------------------------
This email, along with any attachments, is confidential. If you 
believe you received this message in error, please contact the 
sender immediately and delete all copies of the message.  
Thank you.