[Users] Centos 6.4 support

Fri May 24 16:17:59 PDT 2013

I would love to see full Ubuntu support and I am sure many people think the same. 

I have tried the Mellanox ofed 2 drivers on ubuntu and the installation went okay on the 12.04 with 3.2 kernel. However, i've found several issues tha I didn't have time to report. The main issue is that the ipoib connected mode didn't work properly on my "InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] (rev a0)" card. I could get an ICMP reply from other ipoib servers, but any tcp/udp traffic was not getting throught. 

Also, the Mellanox ofed 2 doesn't install ib_qib mobule by default which is a shame (( 

Andrei 
----- Original Message -----

From: "Narayan Desai" <narayan.desai at gmail.com> 
To: "Samantha Jian-Pielak" <samantha.jian-pielak at canonical.com> 
Cc: "Rupert Dance" <rsdance at soft-forge.com>, "Andrei Mikhailovsky" <andrei at arhont.com>, "Peter Kjellström" <cap at nsc.liu.se>, users at lists.openfabrics.org 
Sent: Friday, 24 May, 2013 11:43:33 PM 
Subject: Re: [Users] Centos 6.4 support 

I don't have a problem with the packages I have in my ppa being coped to the ofa-ofed one. What is the long term plan for maintenance of these? 

My big question is whether i keep my archive active or not; I think that really depends on what the canonical plans are for ofed. I'm not sure if you guys will want everything, or will be keeping up to date aggressively or not. 

Also, since mellanox is starting to release bits for ubuntu, how will those fit in? 
thanks. 
-nld 

On Fri, May 24, 2013 at 1:31 PM, Samantha Jian-Pielak < samantha.jian-pielak at canonical.com > wrote: 

Hi, this is my response before I subscribed to the mailing list.. 

Narayan, it would be great if you can copy over those packages you have to https://launchpad.net/~ofa-ofed , any concerns? 

Samantha 

===== 
Hi, 

OFED has been tested against RPM-based distributions only. In the recent OFED developer workshop, there was a discussion about supporting Debian-based distro. So the answer to your question 'is OFED 3.5.1 compatible with Ubuntu' is there is no testing done with Ubuntu. Currently the OFED support on Ubuntu is the same as what have been pushed upstream (Debian). I put together a list of packages in OFED 3.5 and compared the version of those found in 4 Ubuntu releases, from 11.10 to 13.04. It can be downloaded here: https://wiki.ubuntu.com/OFED 

As you pointed out the infiniband PPA from Roland Dreier, Narayan Desai from Argnonne National Lab also packaged some for Ubuntu. After my presentation at the OFED developer workshop last month, I created a launchpad project and team with the goal to be the place for people to share the packages with the Ubuntu community https://launchpad.net/~ofa-ofed . The idea is it would be great if all packages in the OFED are available in the Debian universe repo, but if it takes too long to get in Debian, here is the place to get it. If any (packaging) issues are found, the burden of fixing can be shared with the community. I have started working with Prof. DK Panda from Ohio State U. and Intel PSM team. As a Ubuntu community member, I am interested in helping/facilitating the support of those packages for Ubuntu. If you are looking for the blessing on OFED and Ubuntu, IMHO it should come from the OFED EWG. 

Samantha 
===== 

On 05/24/2013 11:22 AM, Narayan Desai wrote: 

<blockquote>

I've built an ubuntu PPA of a bunch of the system management-related packages from OFED 3.5. It is currently only for 12.04, but i can build for newer distributions if it would be useful. 

The ppa is here: 
https://launchpad.net/~narayan-desai/+archive/infiniband 

Comments, questions, etc, are welcome. 
-nld 

On Fri, May 24, 2013 at 9:39 AM, Rupert Dance < rsdance at soft-forge.com > wrote: 

<blockquote>

Ubuntu has been working with the OFA Interoperability WG and our collaboration has led to RDMA support within their distribution. To my knowledge they have the equivalent of OFED 1.4.1 support right now. OFED 3.5.1 is rpm based and so does not support the Debian package system used by Ubuntu. 

I have ”cc” my main contact from Ubuntu who may be able to provide more details and the current status. 

Thanks 

Rupert 

From: users-bounces at lists.openfabrics.org [mailto: users-bounces at lists.openfabrics.org ] On Behalf Of Andrei Mikhailovsky 
Sent: Friday, May 24, 2013 10:20 AM 
To: Peter Kjellström 
Cc: users at lists.openfabrics.org 

Subject: Re: [Users] Centos 6.4 support 

I will give it a go now and come back. 

P.S. I am an unfortunate owner of HP blade switch with QLogic mezzanine cards which are so crappy, it's unreal! 

I've tried to get them working so many different ways on many linux distros and it seems that they only work on CentOS/RHEL. That's is why I have to stick with CentOS for the time being as I am an Ubuntu guy. 

I've just tried Ubuntu 12.04, 12.10 and 13.04 with infiniband PPA from Roland Dreier and I just can't get this card to work. I've got Mellanox cards working perfectly well with the same set of tools. Perhaps it's another post which I will make shortly. 

By the way, is OFED 3.5.1 compatible with Ubuntu? If so, what version has it been tested with? 

Thanks 

Andrei 

From: "Peter Kjellström" < cap at nsc.liu.se > 
To: users at lists.openfabrics.org 
Sent: Friday, 24 May, 2013 3:00:47 PM 
Subject: Re: [Users] Centos 6.4 support 

On Friday 24 May 2013 07:42:49 Sabuj Pattanayek wrote: 
> I posted about this a month or two ago, I had to downgrade kernel & 
> kernel-devel-2.6.32.279.22.1 to get it to compile, didn't have time to 
> look at patching, still don't :( . 

You are aware that that kernel has a trivial local root hole, right? 

CentOS-6.4 has a quite recent integrated ib-stack so most people won't have to 
install OFED though... 

/Peter 

> On Fri, May 24, 2013 at 7:37 AM, Andrei Mikhailovsky < andrei at arhont.com > 
wrote: 
> > Hello guys, 
> > 
> > I've recently upgraded several of my servers from CentOS 6.3 to 6.4 and 
> > tried to install OFED 3.5. There were issues with compiling compat-rdma 
> > package. I was wondering if there are any patches or release candidates 
> > which work with CentOS 6.4? Can't seems to find much info on the net 
> > regarding it. 
> > 
> > Many thanks 
> > 
> > Andrei 

_______________________________________________ 
Users mailing list 
Users at lists.openfabrics.org 
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/users 

_______________________________________________ 
Users mailing list 
Users at lists.openfabrics.org 
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/users 

</blockquote>

</blockquote>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130525/212b7d53/attachment.html>