[ofa-general] multicast join failed for...
Egor Tur
worldeb at ukr.net
Mon Apr 9 15:47:49 PDT 2007
Hi folk.
> > ib1: multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0001, status -22
> > ib0: multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0001, status -22
> >
> > And in osm.log:
> > Apr 09 21:33:50 658439 [42003960] -> __osm_mcmr_rcv_join_mgrp: ERR 1B12: __validate_more_comp_fields,
> > __validate_port_caps, or JoinState = 0 failed from port 0x001708ffffd15099 (HP Lion Cub DDR 128MB),
> > sending IB_SA_MAD_STATUS_REQ_INVALID
> >
> OpenSM ERR 1B12 means that the rate or MTU of the port was incompatible
> with the MC group. You could turn on -V with OpenSM and see more log
> messages as to what is going on wrong from the SM's perspective.
Ok. This from osm.log with -V :
Apr 10 00:56:06 390007 [44007960] -> __osm_sa_mad_ctrl_process: [
Apr 10 00:56:06 390016 [44007960] -> __osm_sa_mad_ctrl_process: Posting Dispatcher message OSM_MSG_MAD_MCMEMBER_RECORD
Apr 10 00:56:06 390027 [44007960] -> __osm_sa_mad_ctrl_process: ]
Apr 10 00:56:06 390033 [44007960] -> __osm_sa_mad_ctrl_rcv_callback: ]
Apr 10 00:56:06 390046 [41001960] -> osm_mcmr_rcv_process: [
Apr 10 00:56:06 390054 [41001960] -> __osm_mcmr_rcv_join_mgrp: [
Apr 10 00:56:06 390060 [41001960] -> __osm_mcmr_rcv_join_mgrp: Dump of incoming record
Apr 10 00:56:06 390065 [41001960] -> MCMember Record dump:
MGID....................0xff12601bffff0000 : 0x0000000000000001
PortGid.................0xfe80000000000000 : 0x001708ffffd1509a
qkey....................0xB1B
mlid....................0x0
mtu.....................0x84
TClass..................0x0
pkey....................0xFFFF
rate....................0x83
pkt_life................0x0
SLFlowLabelHopLimit.....0x0
ScopeState..............0x1
ProxyJoin...............0x0
Apr 10 00:56:06 390084 [41001960] -> __validate_more_comp_fields: Requested RATE 6 is not equal to 3
Apr 10 00:56:06 390090 [41001960] -> __osm_mcmr_rcv_join_mgrp: ERR 1B12: __validate_more_comp_fields, __validate_port_caps, or
JoinState = 0 failed from port 0x001708ffffd1509a (HP Lion Cub DDR 128MB), sending IB_SA_MAD_STATUS_REQ_INVALID
Apr 10 00:56:07 921941 [44007960] -> __osm_sa_mad_ctrl_process: [
Apr 10 00:56:07 921947 [44007960] -> __osm_sa_mad_ctrl_process: Posting Dispatcher message OSM_MSG_MAD_MCMEMBER_RECORD
Apr 10 00:56:07 921955 [44007960] -> __osm_sa_mad_ctrl_process: ]
Apr 10 00:56:07 921960 [42804960] -> osm_mcmr_rcv_process: [
Apr 10 00:56:07 921961 [44007960] -> __osm_sa_mad_ctrl_rcv_callback: ]
Apr 10 00:56:07 921978 [42804960] -> __osm_mcmr_rcv_join_mgrp: [
Apr 10 00:56:07 921994 [42804960] -> __osm_mcmr_rcv_join_mgrp: Dump of incoming record
Apr 10 00:56:07 922000 [42804960] -> MCMember Record dump:
MGID....................0xff12601bffff0000 : 0x0000000000000001
PortGid.................0xfe80000000000000 : 0x001708ffffd15099
qkey....................0xB1B
mlid....................0x0
mtu.....................0x84
TClass..................0x0
pkey....................0xFFFF
rate....................0x83
pkt_life................0x0
SLFlowLabelHopLimit.....0x0
ScopeState..............0x1
ProxyJoin...............0x0
Apr 10 00:56:07 922013 [42804960] -> __validate_more_comp_fields: Requested RATE 6 is not equal to 3
Apr 10 00:56:07 922019 [42804960] -> __osm_mcmr_rcv_join_mgrp: ERR 1B12: __validate_more_comp_fields, __validate_port_caps, or
JoinState = 0 failed from port 0x001708ffffd15099 (HP Lion Cub DDR 128MB), sending IB_SA_MAD_STATUS_REQ_INVALID
>
> What is the GUID for ib0 and ib1 ? That should tell us which port is
> having the issue joing the group.
# ibstat
CA 'mthca0'
CA type: MT25208 (MT23108 compat mode)
Number of ports: 2
Firmware version: 4.7.400
Hardware version: a0
Node GUID: 0x001708ffffd15098
System image GUID: 0x001708ffffd1509b
Port 1:
State: Active
Physical state: LinkUp
Rate: 20
Base lid: 9
LMC: 0
SM lid: 1
Capability mask: 0x02510a68
Port GUID: 0x001708ffffd15099
Port 2:
State: Active
Physical state: LinkUp
Rate: 20
Base lid: 11
LMC: 0
SM lid: 1
Capability mask: 0x02510a68
Port GUID: 0x001708ffffd1509a
# ibstatus
Infiniband device 'mthca0' port 1 status:
default gid: fe80:0000:0000:0000:0017:08ff:ffd1:5099
base lid: 0x9
sm lid: 0x1
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 20 Gb/sec (4X DDR)
Infiniband device 'mthca0' port 2 status:
default gid: fe80:0000:0000:0000:0017:08ff:ffd1:509a
base lid: 0xb
sm lid: 0x1
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 20 Gb/sec (4X DDR)
>
> Are you using IPv6 ?
I don't use IPv6 but kernel was compiled with support IPv6.
Also when I have builded kernel modules for infiniband with --with-ipoib-cm then
module ib_ipoib depends on ipv6.
# modinfo ib_ipoib
filename: /lib/modules/2.6.18/updates/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko
author: Roland Dreier
description: IP-over-InfiniBand net driver
license: Dual BSD/GPL
vermagic: 2.6.18 SMP mod_unload gcc-4.1
depends: ib_cm,ipv6,ib_core,ib_sa,ib_sa,ib_core
If modules was builded with --without-ipoib-cm then ib_ipoib don't depend on ipv6.
But the messages remain the same in log.
Thanx.
More information about the general
mailing list