It's not completely trivial to reproduce. I tried loading and unloading ib_ipoib a few times, then I tried to load ib_ipoib and unload ib_mthca, I tried pinging in between loading and unloading, and I didn't see any crashes. - R.