[openib-general] ping over IPoIB does not work between 2 cards on the same host

[Kanevsky, Arkady]

I have a host with 2 HCAs (dual port each but I only connected one port
per 
machine) connected to a switch.

When IPoIB configured I ping cards own IP address it works.
I can ping another machines with their HCA cards configured with IPoIB
fine.
And I can ping both local IP addresses from remote machine(s)

Details:

ifconfig ib1 192.168.0.1 netmask 255.255.0.0 ifconfig ib3 192.168.0.3
netmask 255.255.0.0

On remote machine:

ifconfig ib0 192.168.1.0 netmask 255.255.0.0

Locally:

ping -I ib3 192.168.0.3

PING 192.168.0.3 (192.168.97.3) from 192.168.0.3 ib3: 56(84) bytes of
data.

64 bytes from 192.168.0.3: icmp_seq=0 ttl=64 time=0.028 ms

ping -I ib1 192.168.0.1

PING 192.168.0.1 (192.168.97.1) from 192.168.0.1 ib1: 56(84) bytes of
data.

64 bytes from 192.168.0.1: icmp_seq=0 ttl=64 time=0.028 ms

# ping -I ib3 192.168.1.0

PING 192.168.1.0 (192.168.1.0) from 192.168.0.3 ib3: 56(84) bytes of
data.

64 bytes from 192.168.1.0: icmp_seq=0 ttl=64 time=1.81 ms

>From remote host:

# ping -I ib0 192.168.0.1

PING 192.168.0.1 (192.168.0.1) from 192.168.1.0 ib0: 56(84) bytes of
data.

64 bytes from 192.168.0.1: icmp_seq=0 ttl=64 time=0.086 ms

# ping -I ib0 192.168.0.3

PING 192.168.0.3 (192.168.0.3) from 192.168.1.0 ib0: 56(84) bytes of
data.

64 bytes from 192.168.0.1: icmp_seq=0 ttl=64 time=0.086 ms

Locally between 2 cards:# ping -I ib3 192.168.0.1 PING 192.168.0.1
(192.168.0.1) from 192.168.0.3 ib3: 56(84) bytes of data.

>From 192.168.0.3 icmp_seq=1 Destination Host Unreachable From
192.168.0.3 icmp_seq=2 Destination Host Unreachable From 192.168.0.3
icmp_seq=3 Destination Host Unreachable

Arkady

 

Arkady Kanevsky                       email: arkady at netapp.com

Network Appliance Inc.               phone: 781-768-5395

275 Totten Pond Rd.                  Fax: 781-895-1195

Waltham, MA 02451-2010          central phone: 781-768-5300