[ewg] Does anybody have experience using Mellanox ConnectX cards with Ubuntu?

[Ross Smith]

Hi,

Can anybody lend me a hand getting ConnectX cards working in Ubuntu?
I have it working fine with Infinihost III
Lx cards, but I have just come to test Ubuntu 9.10 on our newer
systems fitted with QDR ConnectX Infiniband cards and I cannot get
ipoib running.

I haven't installed any drivers on this system as my understanding was
that they are already included in the newer kernels, and although I
don't have a lot of linux knowledge, it does appear that mlx4_core is
running:

$ dmesg | grep mlx
[    9.841303] mlx4_core: Mellanox ConnectX core driver v0.01 (May 1, 2007)
[    9.841305] mlx4_core: Initializing 0000:03:00.0
[    9.841328] mlx4_core 0000:03:00.0: PCI INT A -> GSI 16 (level,low) -> IRQ 16
[    9.841340] mlx4_core 0000:03:00.0: setting latency timer to 64
[   11.753906] mlx4_core 0000:03:00.0: irq 35 for MSI/MSI-X
[   11.753912] mlx4_core 0000:03:00.0: irq 36 for MSI/MSI-X
[   11.753917] mlx4_core 0000:03:00.0: irq 37 for MSI/MSI-X
[   11.753923] mlx4_core 0000:03:00.0: irq 38 for MSI/MSI-X
[   11.753928] mlx4_core 0000:03:00.0: irq 39 for MSI/MSI-X
[   11.753934] mlx4_core 0000:03:00.0: irq 40 for MSI/MSI-X
[   11.753939] mlx4_core 0000:03:00.0: irq 41 for MSI/MSI-X
[   11.753945] mlx4_core 0000:03:00.0: irq 42 for MSI/MSI-X
[   11.753950] mlx4_core 0000:03:00.0: irq 43 for MSI/MSI-X

However I have no adapters listed in ifconfig, even if I manually load
ipoib with
$ sudo modprobe ib_ipoib

I'm fairly new to Linux so it may be something obvious I've missed.
Any help would be very much appreciated.

thanks,

Ross