[ofa-general] Tools for Infiniband Performance measurement

Tue Mar 20 12:46:55 PDT 2007

Look in the OFED perftest RPM (documentation is in
/usr/local/ofed/docs/PERF_TEST_README.txt):

# rpm -qli perftest
Name        : perftest                     Relocations: (not
relocatable)
Version     : 1.2                               Vendor: OpenFabrics
Release     : 0                             Build Date: Wed 14 Mar 2007
09:21:36
 AM PDT
Install Date: Thu 15 Mar 2007 08:26:42 PM PDT      Build Host:
svbu-qa1850-1.cis
co.com
Group       : System Environment/Libraries   Source RPM:
ofa_user-1.2-beta1.src.
rpm
Size        : 262469                           License: GPL/BSD
Signature   : (none)
URL         : http://www.openfabrics.org/
Summary     : IB Performance tests
Description :
gen2 uverbs microbenchmarks
/usr/local/ofed/bin/ib_clock_test
/usr/local/ofed/bin/ib_rdma_bw
/usr/local/ofed/bin/ib_rdma_lat
/usr/local/ofed/bin/ib_read_bw
/usr/local/ofed/bin/ib_read_lat
/usr/local/ofed/bin/ib_send_bw
/usr/local/ofed/bin/ib_send_lat
/usr/local/ofed/bin/ib_write_bw
/usr/local/ofed/bin/ib_write_bw_postlist
/usr/local/ofed/bin/ib_write_lat
/usr/local/ofed/bin/runme

Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems

________________________________

	From: general-bounces at lists.openfabrics.org
[mailto:general-bounces at lists.openfabrics.org] On Behalf Of Dukle, Kapil
(GE Healthcare)
	Sent: Tuesday, March 20, 2007 12:44 PM
	To: general at lists.openfabrics.org; openib-general at openib.org
	Subject: [ofa-general] Tools for Infiniband Performance
measurement

	Hi all,

	I was wondering if there are any tools specific for
Infiniband-performance measurement - throughput, round trip time with
adjustable
	packet sizes. 

________________________________

	From: Dukle, Kapil (GE Healthcare) 
	Sent: Monday, March 19, 2007 5:37 PM
	To: general at lists.openfabrics.org; openib-general at openib.org
	Subject: ibping fails in loopback mode

	Hi all,

	I'm having trouble getting ibping to work in loopback node. The
original config is to connect first port of Blade 1 with first port of
Blade 2. 
	For my loopback test, I have connected the Infiniband cable
between the 2 ports on the same Linux blade. 
	Both opensm and ibping (server mode) seem to be running on the
blade. Ping succeeds to the first active port, but fails
	for the second one. See below...

	Why is the ibping to the second active (and linkup) port
failing?  Am I missing something? The version is OFED1.0

	[root at XXXX]# ps -elf | grep opensm
	4 S root      3078     1  0  76   0 - 19039 stext  Mar16 ?
00:00:09 /usr/sbin/opensm
	4 S root      5444  5424  0  77   0 - 13981 pipe_w 17:22 pts/1
00:00:00 grep opensm

	[root at XXXX]# ibping -v -S &
	[1] 5445
	[root at vre sdc]# ibwarn: [5445] ibping_serv: starting to serve...

	[root at XXXX]# ps -elf | grep ibping
	4 S root      5445  5424  0  77   0 -  1454 -      17:22 pts/1
00:00:00 ibping -v -S
	4 S root      5447  5424  0  77   0 - 13982 -      17:22 pts/1
00:00:00 grep ibping

	[root at XXXX]# sminfo
	sminfo: sm lid 0x3 sm guid 0x3ba00010027d9, activity count
203459 priority 1 state SMINFO_MASTER 3

	[root at XXXX]# ibstat
	CA 'mthca0'
	        CA type: MT25208 (MT23108 compat mode)
	        Number of ports: 2
	        Firmware version: 4.7.400
	        Hardware version: a0
	        Node GUID: 0x0003ba00010027d8
	        System image GUID: 0x0003ba00010027db
	        Port 1:
	                State: Active
	                Physical state: LinkUp
	                Rate: 10
	                Base lid: 3
	                LMC: 0
	                SM lid: 3
	                Capability mask: 0x02510a6a
	                Port GUID: 0x0003ba00010027d9
	        Port 2:
	                State: Active
	                Physical state: LinkUp
	                Rate: 10
	                Base lid: 1
	                LMC: 0
	                SM lid: 3
	                Capability mask: 0x02510a68
	                Port GUID: 0x0003ba00010027da

	[root at XXXX]# ibping -v 3
	ibwarn: [5452] ibping: Ping..
	ibwarn: [5445] ibping_serv: Pong: vre.(none)
	Pong from vre.(none) (Lid 0x3): time 0.111 ms
	ibwarn: [5452] ibping: Ping..
	ibwarn: [5445] ibping_serv: Pong: vre.(none)
	Pong from vre.(none) (Lid 0x3): time 0.087 ms
	ibwarn: [5452] ibping: Ping..
	ibwarn: [5445] ibping_serv: Pong: vre.(none)
	Pong from vre.(none) (Lid 0x3): time 0.069 ms
	ibwarn: [5452] report: out due signal 2

	--- vre.(none) (Lid 0x3) ibping statistics ---
	3 packets transmitted, 3 received, 0% packet loss, time 2320 ms
	rtt min/avg/max = 0.069/0.089/0.111 ms

	[root at XXXX]# ibping -v 1
	ibwarn: [5449] ibping: Ping..
	ibwarn: [5449] main: ibping to Lid 0x1 failed
	ibwarn: [5449] ibping: Ping..
	ibwarn: [5449] main: ibping to Lid 0x1 failed
	ibwarn: [5449] ibping: Ping..
	ibwarn: [5449] main: ibping to Lid 0x1 failed
	ibwarn: [5449] report: out due signal 2

	---  (Lid 0x1) ibping statistics ---
	3 packets transmitted, 0 received, 100% packet loss, time 11358
ms
	rtt min/avg/max = 0.000/0.000/0.000 ms

	Thanks,
	Kapil

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20070320/a8973ff9/attachment-0001.html>