[ofa-general] IB and iWarp HCA in same node

[Scott A. Friedman]

I have a working IB cluster where I have added a Chelsio iWarp card to 
one node. Another node is connected to that with only an identical iWarp 
card. I cannot seem to get the iWarp cards to come up. They work through 
regular ethernet just fineand the IB stuff still works as well. But, 
when I modprobe iw_cxgb3 and iw_cm utilities like ibstat show the 
following. Which explains why nothing is working.

Question is, why? Am I missing or forgetting something? I just want to 
test the two iWarp cards back to back. Not trying to get some kind of 
auto bridging or routing working.

# ibstat
iWARP RNIC 'cxgb3_0'
         iWARP RNIC type: cxgb3
         Number of ports: 1
         Firmware version: T 4.0.0
         Hardware version: 1
         Node GUID: 0x0007430506ea0000
         System image GUID: 0x0007430506ea0000
         Port 1:
                 State: Active
                 Physical state: No state change
                 Rate: 20
                 Base lid: 0
                 LMC: 0
                 SM lid: 0
                 Capability mask: 0x009f0000
                 Port GUID: 0x0000000000000000
CA 'mthca0'
         CA type: MT25204
         Number of ports: 1
         Firmware version: 1.1.0
         Hardware version: a0
         Node GUID: 0x0002c9020023b990
         System image GUID: 0x0002c9020023b993
         Port 1:
                 State: Active
                 Physical state: LinkUp
                 Rate: 10
                 Base lid: 1
                 LMC: 0
                 SM lid: 28
                 Capability mask: 0x02510a68
                 Port GUID: 0x0002c9020023b991

Any help is appreciated!

Thanks
Scott