[openib-general] APM support in openib stack

[somenath]

Sean Hefty wrote:

>>ib_sa_path_rec_get(
>>                   device,
>>                   HCA_PRM_PORT,           /* first port =1, second
>>port=2 */
>>    
>>
>
>Note that this tells the ib_sa module which port to send the request out on.
>It's separate from the actual path information being requested, which is based
>on the GIDs.
>
>  
>

that's right: so I just verified that by dumping dgid, sgid in primary 
and alternate path
obtained in req_recv_handler(); they look ok to me, but just dumping 
here, in case u find
something here:

for node1:

destination gid=======
gid fe80:0:0:0:5:ad00:3:a801

source gid=======
gid fe80:0:0:0:5:ad00:3:9abd

APM destination gid=======
gid fe80:0:0:0:5:ad00:3:a802

APM source gid=======
gid fe80:0:0:0:5:ad00:3:9abe


===================================================

for node2:
destination gid=======
gid fe80:0:0:0:5:ad00:3:9abd

source gid=======
gid fe80:0:0:0:5:ad00:3:a801

APM destination gid=======
gid fe80:0:0:0:5:ad00:3:9abe

APM source gid=======
gid fe80:0:0:0:5:ad00:3:a802
==================================================

req_handler() {

// create qpairs, connection handle, ...
ib_stat = modifyqp_rtr(connection);;
    if (ib_stat) {
            goto exit;  ================> i get error here
    }

    ib_stat = ib_send_cm_rep(
                connection->cm_id,
                &accept_param);
    if (ib_stat) {
        goto exit;
    }

}

if I do, modifyqp_rtr() after sending ib_send_cm_rep() then REP sending 
(just to try out)
is successful (and other side recvs the REP), however changing state to 
RTR still fails after that.

I must be missing something here: do I have to do anything with:

1.path_mig_state field of ib_qp_attr?
2. when do I set alt_port_num? I do that using ib_modify_qp() using 
IB_QP_PORT attrib mask.
3. how do I set alt_timeout and alt_pkey_index? with what attrib mask? 
   

4. is there any sample working code using APM?

thanks, som.


>>                   &path_rec,
>>                   IB_SA_PATH_REC_DGID | IB_SA_PATH_REC_SGID |
>>                   IB_SA_PATH_REC_NUMB_PATH
>>                   | IB_SA_PATH_REC_PKEY,
>>    
>>
>...
>  
>
>>do you remember when you checked in the working code?
>>I am wondering if the RHEL4 U4 binary distrition of redhat has your changes.
>>    
>>
>
>That, I'm not sure about.  The fact that it works when alt_path = primary_path
>is what's confusing me at the moment.
>
>- Sean
>  
>