[ofa-general] ConnectX IB HCA with Ubuntu 8.04

[Doug Ledford]

On Sat, 2008-09-06 at 07:18 -0400, Steven Truelove wrote:
> Yes, the DHCP server starts just fine.  The hardware address was
> pulled from the output of ifconfig on the client. Even if the hardware
> address was wrong, or I didn't list the host at all, the 'range'
> setting should ensure that an address is provided from the open pool.
> 
> There is output in the logs to indicate that there is no subnet
> listing for ib1 and eth0, and that it won't be listening on those
> interfaces.  This implies that it is working on eth1 (where DHCP is
> tested working) and ib0 (where no log references to DHCPDISCOVER are
> made, even though the client is sending them).
> 
> That said, am I barking up the wrong tree entirely by even trying to
> make this work?  There are a few references to this being possible
> when I google for 'infiniband dhcp', and this is where I got the
> 'always-broadcast on' setting from.  Apparently this is necessary.
> But I couldn't find anything further to help me.

Did you apply the dhcp patch that's in the OFED distribution to the dhcp
server and recompile?  Without, it doesn't know how to parse IB
broadcast packets (and with it, it still doesn't, but it switches from
raw mode to cooked socket mode where it doesn't have to know the
structure of a raw IPoIB packet).  It would certainly explain the dhcp
server silently dropping the packets, they wouldn't look like dhcp
requests in raw mode.

> Thanks,
> 
> Steven Truelove
> 
> 
> 
> Doug Ledford wrote: 
> > On Fri, 2008-09-05 at 16:09 -0400, Steven Truelove wrote:
> >   
> > > Okay, thanks, I have run opensm and I have gotten IPoIB working as
> > > well, although there is a problem.  IPoIB works fine with static IPs,
> > > but I can't get DHCP to work.  The logs suggest that the DHCP server
> > > simply isn't seeing the DHCPDISCOVERs from the client.  Here is the
> > > relevant chunk of dhcpd.conf:
> > > 
> > > subnet 192.168.200.0 netmask 255.255.255.0 {
> > > 
> > >   always-broadcast on;
> > > 
> > >   range 192.168.200.10 192.168.200.50;
> > > 
> > >   option broadcast-address 192.168.200.255;
> > > }
> > > 
> > > 
> > > host sappsu4-ib {
> > >   hardware ethernet 80:00:04:04:FE:80:00:00:00:00:00:00:00:00:00:00;
> > >   fixed-address 192.168.200.104;
> > > }
> > > 
> > > 
> > > Does this have any chance of working?
> > >     
> > 
> > Will your dhcp server even start up with that hardware ethernet line in
> > it?  None of the patches for the dhcp server that I've seen enable dhcp
> > to parse that big of an ethernet definition.
> > 
> >   
> > > Thanks,
> > > 
> > > Steven Truelove
> > > 
> > > 
> > > 
> > > 
> > > Sasha Khapyorsky wrote: 
> > >     
> > > > On 16:39 Fri 05 Sep     , Bernd Schubert wrote:
> > > >   
> > > >       
> > > > > We just didn't have the time yet to complete all the packaging and to push 
> > > > > it upstream to Debian, here is what we have so far
> > > > > 
> > > > > # Etchy packages, but also should work for hardy
> > > > > deb http://www.pci.uni-heidelberg.de/tc/usr/bernd/downloads/infiniband/etch ./
> > > > > 
> > > > > # Hardy packages, but not recently maintained (only for my workstation)
> > > > > deb http://www.pci.uni-heidelberg.de/tc/usr/bernd/downloads/infiniband/hardy/ ./
> > > > >     
> > > > >         
> > > > Great!
> > > > 
> > > > Sasha
> > > > 
> > > >   
> > > >       
> > > -- 
> > > Steven Truelove
> > > Array Systems Computing, Inc.
> > > 1120 Finch Avenue West, 7th Floor
> > > Toronto, Ontario
> > > M3J 3H7
> > > CANADA
> > > http://www.array.ca
> > > truelove at array.ca
> > > Phone: (416) 736-0900 x307
> > > Fax: (416) 736-4715
> > > _______________________________________________
> > > general mailing list
> > > general at lists.openfabrics.org
> > > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
> > > 
> > > To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
> > >     
-- 
Doug Ledford <dledford at redhat.com>
              GPG KeyID: CFBFF194
              http://people.redhat.com/dledford

Infiniband specific RPMs available at
              http://people.redhat.com/dledford/Infiniband

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20080906/6a627003/attachment.sig>