<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=utf-8">
<META NAME="Generator" CONTENT="MS Exchange Server version 6.5.7226.0">
<TITLE>Re: [openfabrics-ewg] MVAPICH on PCI-X fails with [0] Abort: Couldn'tmodify SRQ limit</TITLE>
</HEAD>
<BODY>
<!-- Converted from text/plain format -->
<BR>
<P><FONT SIZE=2>Thanks. We are out today and tomorrow but we will take a look at it.<BR>
<BR>
Aviram<BR>
<BR>
Regards,<BR>
Aviram <BR>
<BR>
-----Original Message-----<BR>
From: openfabrics-ewg-bounces@openib.org<BR>
To: Openfabrics-ewg@openib.org<BR>
Sent: Tue May 02 04:36:04 2006<BR>
Subject: [openfabrics-ewg] MVAPICH on PCI-X fails with [0] Abort: Couldn'tmodify SRQ limit<BR>
<BR>
Configuration:- RHEL4U3,ia32,rc3,PCI-X<BR>
<BR>
I have been seeing the following error when I try to run MVAPICH test programs<BR>
----<BR>
[0] Abort: Couldn't modify SRQ limit<BR>
at line 999 in file viainit.c<BR>
-----<BR>
<BR>
On debugging the issue it seems that MVAPICH is being incorrectly compiled for the PCI_EX cards rather than PCI_X cards. From the MPI code it seems that PCI-X cards do not support modifications of SRQs. The source of the problem lies in a bug in the mvapich.make script(new IBED addition) which incorrectly always returns the card as PCI_EX . I have appended a diff with the fix. I am not sure as to how the patch can be correctly generated as the whole MVAPICH is in the form of a zipped tarball.<BR>
<BR>
There seems to be one more issue in the script where it deviates from the MVAPICH build. The script is treating the older PCI_EX cards(cards with the lspci signature of 15b3:6278) as PCI-X. Was this done because these cards also don't support resizing SRQs?<BR>
<BR>
-Amit<BR>
<BR>
-------------------<BR>
diff -u mvapich.make.old mvapich.make<BR>
--- mvapich.make.old 2006-05-02 15:32:11.000000000 +0530<BR>
+++ mvapich.make 2006-05-02 15:33:37.000000000 +0530<BR>
@@ -251,13 +251,13 @@<BR>
DEF_BUILDID="$DEF_BUILDID"<BR>
fi<BR>
fi<BR>
-if (/sbin/lspci -n | grep "15b3:6282" | wc -l | tr -d '[:space:]'); then<BR>
+if (test `/sbin/lspci -n | grep "15b3:6282" | wc -l | tr -d '[:space:]'` -gt 0); then<BR>
# Arbel<BR>
CFLAGS="$CFLAGS -D_PCI_EX_"<BR>
-elif (/sbin/lspci -n | grep -E "15b3:5e8c|15b3:6274" | wc -l | tr -d '[:space:]'); then<BR>
+elif (test `/sbin/lspci -n | grep -E "15b3:5e8c|15b3:6274" | wc -l | tr -d '[:space:]'` -gt 0); then<BR>
# Sinai<BR>
CFLAGS="$CFLAGS -D_PCI_EX_"<BR>
-elif (/sbin/lspci -n | grep -E "15b3:5a44|15b3:6278" | wc -l | tr -d '[:space:]'); then<BR>
+elif (test `/sbin/lspci -n | grep -E "15b3:5a44|15b3:6278" | wc -l | tr -d '[:space:]'` -gt 0); then<BR>
# Tavor<BR>
CFLAGS="$CFLAGS -D_PCI_X_"<BR>
fi<BR>
-----------<BR>
<BR>
<BR>
</FONT>
</P>
</BODY>
</HTML>