[ewg] How to monitor traffic with IBoE/RoCEE?

[Pradeep Satyanarayana]

With IBoE/RoCEE, the traditional SM in IB clusters is not needed. Most of the current
IB tools rely on the SM and PM to get packet and error statistics and so on. These 
won't be applicable with IBoE/RoCEE. netstat will have no value since the kernel 
has been bypassed. So, how does one monitor traffic in such a cluster?

The possibilities that I can think of are to get information from the switches or if there 
are some special tools to get information from the adapter ports themselves. Are such tools
available with ConnectX adapters? How would one get cluster-wide traffic information when
such a cluster is deployed?

Thanks
Pradeep