<html><body>
<p>> Hi all:<br>
><br>
> I installed OFED 1.3.1 and 1.4 RC1 on my SLES10 SP2 x86_64 servers. dapltest failed to be run as server model. Following error is reported:<br>
><br>
> LS21-05:~ # dapltest -T S -d -D ib0<br>
> Server_Cmd.debug: 1<br>
> Server_Cmd.dapl_name: ib0<br>
> librdmacm: couldn't read ABI version.<br>
> librdmacm: assuming: 4<br>
> CMA: unable to open /dev/infiniband/rdma_cm<br>
> LS21-05:32561: open_hca: ERR - RDMA channel No such file or directory<br>
> LS21-05:32561: dapls_ib_open_hca failed 40000<br>
> DT_cs_Server: Could not open ib0 (DAT_INTERNAL_ERROR )<br>
> DT_cs_Server: Waiting for clients to all go away...<br>
> DT_cs_Server: Cleaning up ...<br>
> DT_cs_Server (ib0): Exiting.<br>
><br>
> File /dev/infiniband/rdma_cm exists on RHEL servers, but not on SLES servers. ib0 can communicate with other servres. Any advice or comments? Thanks in advance!<br>
<br>
Will anyone give some advice? Thanks in advance. Here are the different file locations on my SLES and RHEL nodes.<br>
<br>
SLES:~ # find /sys/ -name abi_*<br>
/sys/class/infiniband_mad/abi_version<br>
/sys/class/infiniband_cm/abi_version<br>
/sys/class/infiniband_verbs/uverbs0/abi_version<br>
/sys/class/infiniband_verbs/abi_version<br>
<br>
[root@RHEL ~]# find /sys -name abi_version<br>
/sys/class/infiniband_verbs/uverbs0/abi_version<br>
/sys/class/infiniband_verbs/abi_version<br>
/sys/class/infiniband_mad/abi_version<br>
/sys/class/misc/rdma_cm/abi_version<br>
<br>
The default file /sys/class/misc/rdma_cm/abi_version does not exist on SLES. Is it one OFED bug, or I missed to load something?<br>
<br>
<br>
SLES:~ # lsmod<br>
Module Size Used by<br>
ib_ipoib 108640 0<br>
ib_srp 51400 0<br>
ib_sdp 101724 0<br>
ib_iser 51960 0<br>
libiscsi 48000 1 ib_iser<br>
rdma_cm 52756 2 ib_sdp,ib_iser<br>
iw_cm 27400 1 rdma_cm<br>
scsi_transport_iscsi 54040 2 ib_iser,libiscsi<br>
ib_umad 33704 0<br>
ib_addr 25992 1 rdma_cm<br>
ib_ucm 34184 0<br>
ib_cm 57768 4 ib_ipoib,ib_srp,rdma_cm,ib_ucm<br>
ib_uverbs 60080 1 ib_ucm<br>
ib_sa 59016 4 ib_ipoib,ib_srp,rdma_cm,ib_cm<br>
mlx4_ib 81216 0<br>
mlx4_core 116592 1 mlx4_ib<br>
ib_ipath 329288 0<br>
ib_mthca 142884 0<br>
ib_mad 55204 5 ib_umad,ib_cm,ib_sa,mlx4_ib,ib_mthca<br>
ib_core 95120 15 ib_ipoib,ib_srp,ib_sdp,ib_iser,rdma_cm,iw_cm,ib_umad,ib_ucm,ib_cm,ib_uverbs,ib_sa,mlx4_ib,ib_ipath,ib_mthca,ib_mad<br>
iptable_filter 19712 0<br>
ip_tables 31048 1 iptable_filter<br>
x_tables 31112 1 ip_tables<br>
nfs 234296 1<br>
lockd 89456 2 nfs<br>
nfs_acl 20224 1 nfs<br>
sunrpc 174024 4 nfs,lockd,nfs_acl<br>
joydev 27520 0<br>
st 55204 0<br>
sr_mod 33060 0<br>
ide_disk 32768 0<br>
ide_cd 57760 0<br>
cdrom 52520 2 sr_mod,ide_cd<br>
ide_core 166148 2 ide_disk,ide_cd<br>
ipv6 339872 21 ib_ipoib<br>
dock 26896 0<br>
button 24352 0<br>
battery 27528 0<br>
ac 22152 0<br>
apparmor 55600 0<br>
loop 33168 0<br>
dm_mod 80400 0<br>
usbhid 61088 0<br>
i2c_piix4 26512 0<br>
i2c_core 39936 1 i2c_piix4<br>
ohci_hcd 38148 0<br>
ehci_hcd 49288 0<br>
usbcore 150312 4 usbhid,ohci_hcd,ehci_hcd<br>
bnx2 201736 0<br>
shpchp 61984 0<br>
pci_hotplug 44800 1 shpchp<br>
mptctl 47112 0<br>
reiserfs 247040 1<br>
sg 53304 0<br>
edd 26760 0<br>
fan 21896 0<br>
thermal 32400 0<br>
processor 53100 1 thermal<br>
mptsas 52112 2<br>
mptscsih 54400 1 mptsas<br>
mptbase 95204 3 mptctl,mptsas,mptscsih<br>
scsi_transport_sas 49536 1 mptsas<br>
sd_mod 37760 3<br>
scsi_mod 170936 12 ib_srp,ib_iser,libiscsi,scsi_transport_iscsi,st,sr_mod,mptctl,sg,mptsas,mptscsih,scsi_transport_sas,sd_mod<br>
<br>
[root@RHEL ~]# lsmod<br>
Module Size Used by<br>
nls_utf8 35137 6<br>
loop 48977 12<br>
nfsd 285193 17<br>
exportfs 38849 1 nfsd<br>
lockd 99057 2 nfsd<br>
nfs_acl 36673 1 nfsd<br>
auth_rpcgss 81889 1 nfsd<br>
autofs4 57289 2<br>
hidp 83521 2<br>
rfcomm 104809 0<br>
l2cap 89281 10 hidp,rfcomm<br>
bluetooth 118597 5 hidp,rfcomm,l2cap<br>
sunrpc 198025 13 nfsd,lockd,nfs_acl,auth_rpcgss<br>
ib_iser 68344 0<br>
iscsi_tcp 58752 0<br>
libiscsi 61952 2 ib_iser,iscsi_tcp<br>
scsi_transport_iscsi 67344 4 ib_iser,iscsi_tcp,libiscsi<br>
rdma_ucm 47232 0<br>
qlgc_vnic 126592 0<br>
ib_sdp 125276 0<br>
rdma_cm 67348 3 ib_iser,rdma_ucm,ib_sdp<br>
iw_cm 43656 1 rdma_cm<br>
ib_addr 41992 1 rdma_cm<br>
ib_ipoib 113248 0<br>
ipoib_helper 35728 2 ib_ipoib<br>
ib_cm 67368 3 qlgc_vnic,rdma_cm,ib_ipoib<br>
ib_sa 74632 4 qlgc_vnic,rdma_cm,ib_ipoib,ib_cm<br>
ib_uverbs 75568 1 rdma_ucm<br>
ib_umad 50600 0<br>
iw_cxgb3 104788 0<br>
cxgb3 154224 1 iw_cxgb3<br>
ib_ipath 346444 0<br>
mlx4_ib 95932 0<br>
ib_mthca 159044 0<br>
ib_mad 70948 5 ib_cm,ib_sa,ib_umad,mlx4_ib,ib_mthca<br>
ib_core 97664 16 ib_iser,rdma_ucm,qlgc_vnic,ib_sdp,rdma_cm,iw_cm,ib_ipoib,ib_cm,ib_sa,ib_uverbs,ib_umad,iw_cxgb3,ib_ipath,mlx4_ib,ib_mthca,ib_mad<br>
dm_multipath 52945 0<br>
video 53197 0<br>
sbs 49921 0<br>
backlight 39873 1 video<br>
i2c_ec 38593 1 sbs<br>
i2c_core 56129 1 i2c_ec<br>
button 40545 0<br>
battery 43849 0<br>
asus_acpi 50917 0<br>
acpi_memhotplug 40133 0<br>
ac 38729 0<br>
ipv6 420481 65 ib_ipoib<br>
xfrm_nalgo 43845 1 ipv6<br>
crypto_api 42177 1 xfrm_nalgo<br>
parport_pc 62313 0<br>
lp 47121 0<br>
parport 73165 2 parport_pc,lp<br>
shpchp 70765 0<br>
sr_mod 50789 0<br>
i5000_edac 42177 0<br>
mlx4_core 109008 1 mlx4_ib<br>
cdrom 68713 1 sr_mod<br>
bnx2 173917 0<br>
edac_mc 60193 1 i5000_edac<br>
sg 69993 0<br>
pcspkr 36289 0<br>
dm_snapshot 50569 0<br>
dm_zero 35265 0<br>
dm_mirror 60489 0<br>
dm_mod 99481 9 dm_multipath,dm_snapshot,dm_zero,dm_mirror<br>
usb_storage 116257 2<br>
ata_piix 54981 0<br>
libata 192345 1 ata_piix<br>
mptsas 69201 2<br>
mptscsih 69569 1 mptsas<br>
mptbase 111461 2 mptsas,mptscsih<br>
scsi_transport_sas 66753 1 mptsas<br>
sd_mod 56257 6<br>
scsi_mod 188665 12 ib_iser,iscsi_tcp,libiscsi,scsi_transport_iscsi,sr_mod,sg,usb_storage,libata,mptsas,mptscsih,scsi_transport_sas,sd_mod<br>
ext3 167249 4<br>
jbd 93873 1 ext3<br>
uhci_hcd 57433 0<br>
ohci_hcd 54493 0<br>
ehci_hcd 65741 0<br>
<br>
Wen Hao Wang<br>
Email: wangwhao@cn.ibm.com<br>
<br>
</body></html>