Hello Roland, Do you have any suggestions on how to debug this problem? How can we hack the mthca/ipoib code to narrow down the root cause of the problem? >From the behavior it looks like the local resource temp unavailable, but it could be something else. Thanks Shirley