[openib-general] building and running IBMgtsim?

[Chris Elmquist]

Hey Guys...

We had pretty good luck with this a week ago or so until we ran into
a problem with the simulator trying to make a MAD library call which
apparently did not exist.  It looked to us like it was trying to make
a call into a 1.2 library even though we are trying to do everything in
an OFED 1.1 context.  We were therefore suspecious that we had grabbed a
GIT tree version of the simulator that had been advanced past something
that was compatible with a generic OFED 1.1 tree.

Can you tell me were I should get (with GIT) an appropriate source tree
for the ibutils (including simulator) that should work with an underlying
generic OFED 1.1 installation?

Thank you.

Chris

On Thursday (12/21/2006 at 04:59PM +0200), Eitan Zahavi wrote:
> Hi Chris,
> 
> Sorry for my late response on this:
> 
> The simulator is a standalone "server" where clients connect to it 
> through a TCP/IP socket.
> 
> OpenSM which is not built with "sim" vendor (using --with-osmv=sim 
> --with-sim=<prefix used for ibmgtsim install>)
> will not try to connect to the simulator but will go to the real IB 
> network instead.
> 
> So you need a second "simulator" install of OpenSM.
> You can simply clone the GIT tree and
> ./autogen.sh
> ./configure --with-osmv=sim --with-sim=<prefix used for ibmgtsim 
> install> --prefix=<somewhere>
> make
> make install
> 
> RunSimTest -f OsmTest.sim.tcl -c OsmTest.check.tcl -t IS1-16.topo -o 
> <somewhere>/bin/opensm
> 
> Actually OsmTest is a test that currently fail (due to last changes in 
> InformInfo),
> but any other *.check.tcl/*.sim.tcl pair should work.
> 
> Eitan
> 
> 
> Chris Elmquist wrote:
> >Folks,
> >
> >I am trying to build and run IBMgtsim so that I can explore some different
> >topologies and system sizes.  But I am having a lot of trouble getting
> >OpenSM to work with the simulator.
> >
> >I pulled down Eitan's ibutils git tree (to get the simulator) and
> >am otherwise using the OFED 1.1 tarball for the rest of the stuff.
> >I suspect I have a problem with OpenSM not being built correctly to use
> >the simulator.
> >
> >Does anyone have a recipe on how to build and install all of these pieces
> >(ie, openib, openSM and ibmgtsim) so that they will work together?
> >
> >I have been just trying to run one of the tests provided with the
> >simulator like this:
> >
> >% cd ~/ibutils/ibmgtsim/tests
> >% RunSimTest -c OsmTest.check.tcl -f OsmTest.sim.tcl -t IS1-16.topo -o 
> >/usr/local/bin/opensm
> >
> >but we get this sort of output:
> >
> >-I- Using random seed:43204
> >-I- Simulation directory is: /tmp/ibmgtsim.29716
> >-I- Calling IBMgtSim -s 43204 -V 0xA3 -t 
> >/root/ibutils/ibmgtsim/tests/IS1-16.top
> >o -f /root/ibutils/ibmgtsim/tests/OsmTest.sim.tcl -l 
> >/tmp/ibmgtsim.29716/sim.log
> >-I- Simulator Ready
> >-I- Connecting to the simulator control server:pcplod.americas.sgi.com 
> >port:3726
> >5 
> >-I- Connected to the simulator control server
> >-I- Defined 51 guids
> >-I- Node H-1 data: 0x0002c90000000008 {0x0002c90000000009 1} 
> >{0x0002c9000000000a
> > 2}
> >-I- Starting: /usr/local/bin/opensm -g 0x0002c90000000009  ...
> >-I- Waiting for OpenSM subnet up ...
> >-I- OpenSM Event:ERR Dec 20 10:53:09 470415 [5100E100] -> 
> >osm_vendor_open_port: ERR 5422: Unable to find requested CA guid 
> >0x2c90000000009
> >-I- New 1 events of /tmp/ibmgtsim.29716/osm.log
> >-I- OpenSM Event:ERR Dec 20 10:53:09 470419 [5100E100] -> osm_vendor_bind: 
> >ERR 5
> >424: Unable to Open Port 0x2c90000000009
> >-I- New 1 events of /tmp/ibmgtsim.29716/osm.log
> >-I- OpenSM Event:ERR Dec 20 10:53:09 470422 [5100E100] -> 
> >osm_sm_mad_ctrl_bind: ERR 3118: Vendor specific bind failed
> >-I- New 1 events of /tmp/ibmgtsim.29716/osm.log
> >-I- OpenSM Event:ERR Dec 20 10:53:09 470427 [5100E100] -> osm_sm_bind: ERR 
> >2E10:
> > SM MAD Controller bind failed (IB_ERROR)
> >-I- New 1 events of /tmp/ibmgtsim.29716/osm.log
> >-I- OpenSM Event:ERR Dec 20 10:53:09 470434 [5100E100] -> 
> >osm_sa_mad_ctrl_unbind
> >: ERR 1A11: No previous bind
> >-I- New 1 events of /tmp/ibmgtsim.29716/osm.log
> >
> >Thank you.
> >
> >Chris
> >SGI Network Engineering
> >  

-- 
Chris Elmquist          mailto:chrise at sgi.com      (651)683-3093
                        Silicon Graphics, Inc.     Eagan, MN