SPAM Re: SPAM Re: [ofa-general] Need help with Infiniband problem

Wed Mar 18 13:56:04 PDT 2009

On Wed, Mar 18, 2009 at 10:45 AM, jeffrey Lang <jrlang at uwyo.edu> wrote:
> I did a soft reset on the switch to see what errors would appear during the
> reboot.  Below is what was in the log after the reboot:
>
> W|2009/03/18 07:36:41.998S: Thread "ssiSpawnDelayedResetCardTask"
> (0x831d8530)
>         Osa: Info, rebooting the local card.
>
> W|2009/03/18 07:36:42.928S: Thread "tChModWkr101" (0x8321acd0)
>         TMS: CMS Warning: Info, slot 101 reboot event has been received!
>
> ================================================================================
>
> I|2009/03/18 14:37:08.010U: Thread "startup" (0x87dbf6c0)
>         Log: Recovered 9621 bytes of log data from persistent store
>
> I|2009/03/18 14:37:08.010U: Thread "startup" (0x87dbf6c0)
>         Log: Recovered 9621 bytes of log data from persistent store
>
> A|2009/03/18 14:37:16.980U: Thread "startup" (0x87dbf6c0)
>         boot: I9K t3 Firmware Booting Version: 3.4.0.11.3
>
> A|2009/03/18 14:37:16.980U: Thread "startup" (0x87dbf6c0)
>         boot: Memory: Physical: 0x8000000 Available: 0x8000000 Reserved: 0x0
>
> A|2009/03/18 14:37:16.980U: Thread "startup" (0x87dbf6c0)
>         boot: Reboot cause (9): Operator requested.
>
> E|2009/03/18 07:37:26.950S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2ocfs HCA-1, Port 0x00066A00A0007E96, LID 0x0002, returning
> status 0x0600 : 0

The IPoIB broadcast group needs to somehow be precreated at the SM.
You'll need to contact your SM vendor as to how that is done.

-- Hal

> E|2009/03/18 07:37:27.050S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o08 HCA-1, Port 0x00066A00A0007E8F, LID 0x0009, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:27.130S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o05 HCA-1, Port 0x00066A00A0007E91, LID 0x0006, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:27.130S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o01 HCA-1, Port 0x00066A00A0007E9C, LID 0x0003, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:27.130S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o06 HCA-1, Port 0x00066A00A0007E8D, LID 0x0007, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:27.130S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o07 HCA-1, Port 0x00066A00A0007E92, LID 0x0008, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:27.130S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o09 HCA-1, Port 0x00066A00A0007E95, LID 0x0013, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:27.130S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o10 HCA-1, Port 0x00066A00A0007E98, LID 0x000A, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:27.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o12 HCA-1, Port 0x00066A00A0007E8E, LID 0x000C, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:27.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o13 HCA-1, Port 0x00066A00A0007E93, LID 0x000D, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:27.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o11 HCA-1, Port 0x00066A00A0007E90, LID 0x000B, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:27.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o15 HCA-1, Port 0x00066A00A0007E8C, LID 0x000E, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:27.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o14 HCA-1, Port 0x00066A00A0007E94, LID 0x0010, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:27.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: (No Memory) : 0
>
> E|2009/03/18 07:37:27.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: (No Memory) : 0
>
> E|2009/03/18 07:37:27.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: (No Memory) : 0
>
> E|2009/03/18 07:37:29.130S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o05 HCA-1, Port 0x00066A00A0007E91, LID 0x0006, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:29.130S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o01 HCA-1, Port 0x00066A00A0007E9C, LID 0x0003, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:29.130S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o06 HCA-1, Port 0x00066A00A0007E8D, LID 0x0007, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:29.130S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o09 HCA-1, Port 0x00066A00A0007E95, LID 0x0013, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:29.130S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o07 HCA-1, Port 0x00066A00A0007E92, LID 0x0008, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:29.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o10 HCA-1, Port 0x00066A00A0007E98, LID 0x000A, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:29.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o13 HCA-1, Port 0x00066A00A0007E93, LID 0x000D, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:29.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o11 HCA-1, Port 0x00066A00A0007E90, LID 0x000B, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:29.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o12 HCA-1, Port 0x00066A00A0007E8E, LID 0x000C, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:29.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o16 HCA-1, Port 0x00066A00A0007E97, LID 0x000F, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:29.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o15 HCA-1, Port 0x00066A00A0007E8C, LID 0x000E, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:29.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: (No Memory) : 0
>
> E|2009/03/18 07:37:29.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: (No Memory) : 0
>
> E|2009/03/18 07:37:29.140S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: (No Memory) : 0
>
> E|2009/03/18 07:37:32.283S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2ocfs HCA-1, Port 0x00066A00A0007E96, LID 0x0002, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:32.383S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o08 HCA-1, Port 0x00066A00A0007E8F, LID 0x0009, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:34.463S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o05 HCA-1, Port 0x00066A00A0007E91, LID 0x0006, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:34.463S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o01 HCA-1, Port 0x00066A00A0007E9C, LID 0x0003, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:34.463S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o09 HCA-1, Port 0x00066A00A0007E95, LID 0x0013, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:34.463S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o06 HCA-1, Port 0x00066A00A0007E8D, LID 0x0007, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:34.463S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o07 HCA-1, Port 0x00066A00A0007E92, LID 0x0008, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:34.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o10 HCA-1, Port 0x00066A00A0007E98, LID 0x000A, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:34.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o12 HCA-1, Port 0x00066A00A0007E8E, LID 0x000C, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:34.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o13 HCA-1, Port 0x00066A00A0007E93, LID 0x000D, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:34.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o11 HCA-1, Port 0x00066A00A0007E90, LID 0x000B, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:34.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o16 HCA-1, Port 0x00066A00A0007E97, LID 0x000F, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:34.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o15 HCA-1, Port 0x00066A00A0007E8C, LID 0x000E, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:34.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: (No Memory) : 0
>
> E|2009/03/18 07:37:34.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: (No Memory) : 0
>
> E|2009/03/18 07:37:34.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: (No Memory) : 0
>
> E|2009/03/18 07:37:40.283S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2ocfs HCA-1, Port 0x00066A00A0007E96, LID 0x0002, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:40.383S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o08 HCA-1, Port 0x00066A00A0007E8F, LID 0x0009, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:42.463S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o05 HCA-1, Port 0x00066A00A0007E91, LID 0x0006, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:42.463S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o01 HCA-1, Port 0x00066A00A0007E9C, LID 0x0003, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:42.463S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o09 HCA-1, Port 0x00066A00A0007E95, LID 0x0013, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:42.463S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o06 HCA-1, Port 0x00066A00A0007E8D, LID 0x0007, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:42.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o07 HCA-1, Port 0x00066A00A0007E92, LID 0x0008, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:42.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o10 HCA-1, Port 0x00066A00A0007E98, LID 0x000A, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:42.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o12 HCA-1, Port 0x00066A00A0007E8E, LID 0x000C, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:42.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o13 HCA-1, Port 0x00066A00A0007E93, LID 0x000D, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:42.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o11 HCA-1, Port 0x00066A00A0007E90, LID 0x000B, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:42.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o15 HCA-1, Port 0x00066A00A0007E8C, LID 0x000E, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:42.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o16 HCA-1, Port 0x00066A00A0007E97, LID 0x000F, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:42.473S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: (No Memory) : 0
>
> E|2009/03/18 07:37:42.483S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: (No Memory) : 0
>
> E|2009/03/18 07:37:42.483S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: (No Memory) : 0
>
> E|2009/03/18 07:37:56.273S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2ocfs HCA-1, Port 0x00066A00A0007E96, LID 0x0002, returning
> status 0x0600 : 0
>
> E|2009/03/18 07:37:56.383S: Thread "esm_sar" (0x832c36a0)
>         ESM: Embedded SM Error: sa_McMemberRecord_Set: Component mask of
> 0x0000000000010083 does not have bits required to create a group
> (0x00000000000130C6) for new MGID of 0xFF12401BFFFF0000:00000000FFFFFFFF for
> request from h2o08 HCA-1, Port 0x00066A00A0007E8F, LID 0x0009, returning
> status 0x0600 : 0
>
> Here's the output of the saquery, this was done after the soft reboot:
>
> [root at h2o01 ~]# saquery -g
> saquery: iba_init failed (status=0x1): FERROR
>
> Does this mean my switch has gone and died?
>
> jeff
>
> Hal Rosenstock wrote:
>
> On Tue, Mar 17, 2009 at 6:22 PM, Hal Rosenstock
> <hal.rosenstock at gmail.com> wrote:
>
>
> Would you also run ibchecknet ?
> What error messages are on the SM side ?
>
>
> What does saquery -g show ?
> You did say this was a switch based SM, right ?
> -- Hal
>

***SPAM*** Re: ***SPAM*** Re: [ofa-general] Need help with Infiniband problem

SPAM Re: SPAM Re: [ofa-general] Need help with Infiniband problem