> I attempted to use rsockets with ConnectX-EN adapters and the client > receives a "Connection refused" message. I debugged this a bit further > and see that the client is actually receiving an IB_CM_REJ_RECEIVED with > reason being 28 i.e. "Consumer Reject". Could this be because of the > difference in how GIDs are obtained in the case of RoCE? Have you > attempted rsockets on RoCE at all?
I have not tested this on RoCE. Do other librdmacm examples (e.g. ucmatose or rdma_client/server) work in your configuration? > Incidentally this problem also highlights another issue we have > encountered previously. The only way to debug issues like this in RDMA > CM is to modify the kernel module. Currently there is no way we can turn > on (and off) debug and get insights into the connection set up process. > Are you open to considering patches to enhance debug with RDMA CM, > particularly during the address resolution and connection setup process. > That way it should not impact the performance during data transfer. No objection. The rdma_cm shouldn't be considered speed path anyway. Btw, the IB CM exports some counters which can sometimes be helpful in debugging, though, those only report a count of which messages have been sent/received. - Sean -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
