[ofa-general] ***SPAM*** Unable to get IPoIB working

[Robert Dunkley]

Looks like the Infiniband side of things is fine (Although there are
many more knowledgeable people than me on this list). It might be the
MTU value that is causing the issue, I know at least in the case of
Centos that it does not like values that near to theoretical IP max so
try setting it to 1500 just for testing. Also, since you have the such a
high MTU value I assume you are running IPOIB in "Connected" mode so
maybe you should disable multicast for the adaptor (Connected mode does
not support multicast AFAIK). 

The last possibility I can think of is some sort of default first ID
being assigned to the older Infiniband card in the system or IPOIB
possibly trying to use the other card. If its not needed try removing or
disabling the older card. Otherwise, maybe someone else here can help
you.

Rob

-----Original Message-----
From: Chuck Hartley [mailto:hartlch14 at gmail.com] 
Sent: 26 January 2009 14:30
To: Robert Dunkley
Subject: Re: [ofa-general] ***SPAM*** Unable to get IPoIB working

On Mon, Jan 26, 2009 at 9:24 AM, Robert Dunkley <Robert at saq.co.uk>
wrote:
> Please post the results of ibstat.
>
> Rob

ibstat output:

# ibstat
CA 'mlx4_0'
	CA type: MT26428
	Number of ports: 2
	Firmware version: 2.6.0
	Hardware version: a0
	Node GUID: 0x0002c9030003360c
	System image GUID: 0x0002c9030003360f
	Port 1:
		State: Active
		Physical state: LinkUp
		Rate: 40
		Base lid: 5
		LMC: 0
		SM lid: 4
		Capability mask: 0x02510868
		Port GUID: 0x0002c9030003360d
	Port 2:
		State: Down
		Physical state: Polling
		Rate: 10
		Base lid: 0
		LMC: 0
		SM lid: 0
		Capability mask: 0x02510868
		Port GUID: 0x0002c9030003360e
CA 'mthca0'
	CA type: MT25204
	Number of ports: 1
	Firmware version: 1.2.0
	Hardware version: a0
	Node GUID: 0x003048c64c180000
	System image GUID: 0x003048c64c180003
	Port 1:
		State: Down
		Physical state: Polling
		Rate: 10
		Base lid: 0
		LMC: 0
		SM lid: 0
		Capability mask: 0x02510a68
		Port GUID: 0x003048c64c180001

The SAQ Group

Registered Office: 18 Chapel Street, Petersfield, Hampshire GU32 3DZ
SAQ is the trading name of SEMTEC Limited. Registered in England & Wales
Company Number: 06481952

http://www.saqnet.co.uk AS29219

SAQ Group Delivers high quality, honestly priced communication and I.T. services to UK Business.

Broadband : Domains : Email : Hosting : CoLo : Servers : Racks : Transit : Backups : Managed Networks : Remote Support.

ISPA Member

Find us in http://www.thebestof.co.uk/petersfield