[ofa-general] OpenSM ran out of LIDs

[Keshetti Mahesh]

Hello all,

I am getting the below errors in OpenSM while simulating a large
Infiniband network using 'ibsim'.

Aug 11 14:28:29 002298 [46E0A960] 0x01 ->
__osm_lid_mgr_find_free_lid_range: ERR 0307: OPENSM RAN OUT OF LIDS!!!
Aug 11 14:28:29 002546 [46E0A960] 0x01 ->
__osm_lid_mgr_find_free_lid_range: ERR 0307: OPENSM RAN OUT OF LIDS!!!
Aug 11 14:28:29 002602 [46E0A960] 0x01 ->
__osm_lid_mgr_find_free_lid_range: ERR 0307: OPENSM RAN OUT OF LIDS!!!
Aug 11 14:28:29 002659 [46E0A960] 0x01 ->
__osm_lid_mgr_find_free_lid_range: ERR 0307: OPENSM RAN OUT OF LIDS!!!
Aug 11 14:28:29 002708 [46E0A960] 0x01 ->
__osm_lid_mgr_find_free_lid_range: ERR 0307: OPENSM RAN OUT OF LIDS!!!
Aug 11 14:28:29 002764 [46E0A960] 0x01 ->
__osm_lid_mgr_find_free_lid_range: ERR 0307: OPENSM RAN OUT OF LIDS!!!
Aug 11 14:28:29 002826 [46E0A960] 0x01 ->
__osm_lid_mgr_find_free_lid_range: ERR 0307: OPENSM RAN OUT OF LIDS!!!
Aug 11 14:28:29 002921 [46E0A960] 0x01 ->
__osm_lid_mgr_find_free_lid_range: ERR 0307: OPENSM RAN OUT OF LIDS!!!
Aug 11 14:28:29 002998 [46E0A960] 0x01 ->
__osm_lid_mgr_find_free_lid_range: ERR 0307: OPENSM RAN OUT OF LIDS!!!

As per my calculation the no. of unicast lids required for the network
(34000) is very much within the
limits (max=48000). What could be the reason for the above failure ?
Can anyone enlighten me about the LID database concept used in OpenSM ?

Also, opensm is not considering the guid2lid provided (with -x) at the time of
starting. Is there any other way to provide persistent guid2lid
mapping to OpenSM ?

-Mahesh