[ofa-general] MT25204 versus MT25208

[Bart Van Assche]

On Jan 17, 2008 4:38 PM, Dotan Barak <dotanb at dev.mellanox.co.il> wrote:
>
> Bart Van Assche wrote:
> >
> > Four hosts are connected through an InfiniBand network, two with a
> > MT25204 HCA and two with a MT25208 HCA. All four hosts communicate
> > fine via IPoIB, and iperf shows the expected results. Until now I only
> > succeeded to run ib_rdma_bw between the MT25204 interfaces. When I run
> > ib_rdma_bw on one of the MT25208 interfaces a strange error message is
> > printed. Any idea how I can fix this ?
> >
> > MT25208 to MT25204:
> > root at 192.168.102.5:~# ib_rdma_bw
> > 6468: | port=18515 | ib_port=1 | size=65536 | tx_depth=100 |
> > iters=1000 | duplex=0 | cma=0 |
> > server read: Success
> > 6468:pp_server_exch_dest: 0/45 Couldn't read remote address
> > root at 192.168.102.100:~# ib_rdma_bw 192.168.102.5
> > 6466: | port=18515 | ib_port=1 | size=65536 | tx_depth=100 |
> > iters=1000 | duplex=0 | cma=0 |
> > 6466:main: Local lid 0x0 detected. Is an SM running?
> >
>
> What is the output of ibv_devinfo in both of those devices?
>
> (maybe you need to specify the IB port value or the device name?)

Thanks, after specifying -i 2 as an argument to ib_rdma_bw the test
runs fine. Would it be possible to let the ib_rdma_bw program
determine this parameter automatically ? In my setup the InfiniBand
cable is connected to the second port of the MT25208 interfaces.

root at 192.168.102.100:~# ibv_devinfo
hca_id: mthca0
        fw_ver:                         4.8.200
        node_guid:                      0008:f104:0399:3474
        sys_image_guid:                 0008:f104:0399:3477
        vendor_id:                      0x08f1
        vendor_part_id:                 25208
        hw_ver:                         0xA0
        board_id:                       VLT0060010001
        phys_port_cnt:                  2
                port:   1
                        state:                  PORT_DOWN (1)
                        max_mtu:                2048 (4)
                        active_mtu:             512 (2)
                        sm_lid:                 0
                        port_lid:               0
                        port_lmc:               0x00

                port:   2
                        state:                  PORT_ACTIVE (4)
                        max_mtu:                2048 (4)
                        active_mtu:             2048 (4)
                        sm_lid:                 1
                        port_lid:               18
                        port_lmc:               0x00

Bart.