> ib_mthca 0000:02:00.0: SYS_EN DDR error: syn=4, sock=0, sladdr=0, SPD source=DIMM The HCA is reporting a memory calibration error. Most likely this is a physical hardware problem somewhere in your system. Is it just one system failing like this, or do you have multiple HCAs/systems with the same error message? - R.