Hi Arlin, There was already a bug logged in openfabrics bugzilla regarding this. Following is a link for the same. http://bugs.openfabrics.org/bugzilla/show_bug.cgi?id=2400
I have assigned this bug to your name. Thanks, Vipul On 01-12-2012 01:46, Davis, Arlin R wrote: > http://openfabrics.org/bugzilla/index.cgi > > >> -----Original Message----- >> From: [email protected] [mailto:linux-rdma- >> [email protected]] On Behalf Of Vipul Pandya >> Sent: Friday, November 30, 2012 7:12 AM >> To: Davis, Arlin R >> Cc: Steve Wise; [email protected]; Kumar A S; Abhishek >> Agrawal; Divy Le Ray >> Subject: Re: Dapltest test error DAT_CONN_QUAL_IN_USE >> >> Arlin, >> >> Can you please refer to which bugzilla I should log a bug? Can you >> please provide me the url? >> >> Thanks, >> Vipul >> >> On 30-11-2012 05:21, Davis, Arlin R wrote: >>> Vipul, >>> >>> Can you submit a bug in bugzilla for tracking? I will try to get to >>> this next couple of days. >>> >>> -arlin >>> >>>> -----Original Message----- >>>> From: Vipul Pandya [mailto:[email protected]] >>>> Sent: Thursday, November 29, 2012 5:34 AM >>>> To: Davis, Arlin R >>>> Cc: Steve Wise; [email protected]; Kumar A S; Abhishek >>>> Agrawal; Divy Le Ray >>>> Subject: Re: Dapltest test error DAT_CONN_QUAL_IN_USE >>>> >>>> Hi Arlin, >>>> >>>> This issue is happening because there is a port collision between >>>> dapltest server port space and host TCP stack. The port collision >>>> happens because rdma_bind_addr is getting called from the two >>>> different places with different port arguments from dapltest. >>>> rdma_bind_addr is getting called from the following two places: >>>> >>>> 1. Once it is getting called from dapls_ib_setup_conn_listener >>>> function with starting port as 45278. Based on number of threads and >>>> eps, in subsequent call of dapls_ib_setup_conn_listener this port >>>> number will keep getting incremented. >>>> >>>> 2. 2nd time it is getting called from dapls_ib_qp_alloc function >> with >>>> port number as always 0. Now, when rdma_bind_addr gets called with >>>> port number 0 it will allocate any free random port number. >>>> >>>> Then when dapls_ib_setup_conn_listener calls the rdma_bind_addr with >>>> fix port number which is already allocate via dapls_ib_qp_alloc >>>> function rdma_bind_addr will return EADDRINUSE error, which in turn >>>> will result in DAT_CONN_QUAL_IN_USE error. >>>> >>>> I think solution here would be to call rdma_bind_addr from both the >>>> location passing port number from the same port range. >>>> >>>> Please let me know your thoughts on this. >>>> >>>> Our testing has been blocked because of this issue. We would like to >>>> get this fixed. Please let us know if we need to log a bug anywhere >>>> for this. >>>> >>>> Thanks, >>>> Vipul >>>> >>>> On 27-11-2012 01:24, Steve Wise wrote: >>>>> Perhaps the port is in use by the host TCP stack? >>>>> >>>>> >>>>> On 11/26/2012 1:30 PM, Davis, Arlin R wrote: >>>>>> dapltest server will start with port 45278 and increase by client >>>> thread count during each new client connection. If you never restart >>>> the server it will continue to increase the listen port based on new >>>> clients connecting. If you restart dapltest it will restart back at >>>> port 45278. I am not familiar with iWarp CM but the error is coming >>>> from rdma_bind_addr (EADDRINUSE|EBUSY|EADDRNOTAVAIL). I will have to >>>> defer to Steve for this error. >>>>>> >>>>>> -arlin >>>>>> >>>>>> >>>>>>> -----Original Message----- >>>>>>> From: [email protected] [mailto:linux-rdma- >>>>>>> [email protected]] On Behalf Of Vipul Pandya >>>>>>> Sent: Friday, November 23, 2012 5:54 AM >>>>>>> To: [email protected] >>>>>>> Cc: Kumar A S; Steve Wise; Abhishek Agrawal; Davis, Arlin R; Divy >>>> Le >>>>>>> Ray >>>>>>> Subject: Dapltest test error DAT_CONN_QUAL_IN_USE >>>>>>> >>>>>>> Hi All, >>>>>>> >>>>>>> I was running dapltest between my client and server machines with >>>>>>> OFED- 3.5. While running the test it dapltest server throws an >>>> error >>>>>>> DAT_CONN_QUAL_IN_USE if I increase number of threads and >> endpoints. >>>>>>> >>>>>>> Dapltest server: >>>>>>> --------------- >>>>>>> dapltest -T S -D chelsio1 >>>>>>> >>>>>>> Dapltest client: >>>>>>> --------------- >>>>>>> dapltest -T T -s 102.1.1.2 -D chelsio1 -R BE -i 1 -t 16 -w 8 >>>>>>> server SR >>>>>>> 8192 4 client SR 8192 4 >>>>>>> >>>>>>> >>>>>>> Once I run the above test i get the following error on server >> side >>>>>>> and client side stalls. >>>>>>> >>>>>>> $# dapltest -T S -D chelsio1 >>>>>>> Dapltest: Service Point Ready - chelsio1 >>>>>>> Test[b13f]: dat_psp_create #6 error: DAT_CONN_QUAL_IN_USE >>>>>>> Test[b13f]: Warning: dat_ep_disconnect (abrupt) #0 error >>>>>>> DAT_INVALID_STATE DAT_INVALID_STATE_EP_UNCONNECTED >>>>>>> Test[b13f]: dat_evd_free (creq) error: DAT_INVALID_STATE >>>>>>> DAT_INVALID_STATE_EVD_IN_USE >>>>>>> Test[b13f]: Warning: dat_ep_disconnect (abrupt) #1 error >>>>>>> DAT_INVALID_STATE DAT_INVALID_STATE_EP_UNCONNECTED >>>>>>> Test[b13f]: dat_evd_free (creq) error: DAT_INVALID_STATE >>>>>>> DAT_INVALID_STATE_EVD_IN_USE >>>>>>> Test[b13f]: Warning: dat_ep_disconnect (abrupt) #2 error >>>>>>> DAT_INVALID_STATE DAT_INVALID_STATE_EP_UNCONNECTED >>>>>>> Test[b13f]: dat_evd_free (creq) error: DAT_INVALID_STATE >>>>>>> DAT_INVALID_STATE_EVD_IN_USE >>>>>>> Test[b13f]: Warning: dat_ep_disconnect (abrupt) #3 error >>>>>>> DAT_INVALID_STATE DAT_INVALID_STATE_EP_UNCONNECTED >>>>>>> Test[b13f]: dat_evd_free (creq) error: DAT_INVALID_STATE >>>>>>> DAT_INVALID_STATE_EVD_IN_USE >>>>>>> Test[b13f]: Warning: dat_ep_disconnect (abrupt) #4 error >>>>>>> DAT_INVALID_STATE DAT_INVALID_STATE_EP_UNCONNECTED >>>>>>> Test[b13f]: dat_evd_free (creq) error: DAT_INVALID_STATE >>>>>>> DAT_INVALID_STATE_EVD_IN_USE >>>>>>> Test[b13f]: Warning: dat_ep_disconnect (abrupt) #5 error >>>>>>> DAT_INVALID_STATE DAT_INVALID_STATE_EP_UNCONNECTED >>>>>>> Test[b13f]: dat_evd_free (creq) error: DAT_INVALID_STATE >>>>>>> DAT_INVALID_STATE_EVD_IN_USE >>>>>>> Test[b13f]: Warning: dat_ep_disconnect (abrupt) #6 error >>>>>>> DAT_INVALID_STATE DAT_INVALID_STATE_EP_UNCONNECTED >>>>>>> >>>>>>> Following link says DAT_CONN_QUAL_IN_USE error can come if >> rdma_cm >>>>>>> returns an error due to bind failure. >>>>>>> http://www.mail-archive.com/linux- >>>> [email protected]/msg01297.html >>>>>>> >>>>>>> rdma_cm from OFED-3.5 does not provide module parameter >>>>>>> 'unify_tcp_port_space'. So, just to narrow down I installed OFED- >>>>>>> 1.5.4.1 and ran the same test with unify_tcp_port_space=1. >> However >>>>>>> with that also I was able to reproduced the same issue. >>>>>>> >>>>>>> Please note that if I decrease the numbers of endpoints to 4 then >>>>>>> test works fine. i.e. If I give '-w 4' instead of '-w 8' in >>>>>>> command line then test runs fine. >>>>>>> >>>>>>> I am using dapltest version 2.0.36 which comes from OFED-3.5. >>>>>>> >>>>>>> Can anyone give any pointers on this? >>>>>>> >>>>>>> >>>>>>> Thanks, >>>>>>> Vipul >>>>>>> -- >>>>>>> To unsubscribe from this list: send the line "unsubscribe linux- >>>> rdma" >>>>>>> in the body of a message to [email protected] More >>>> majordomo >>>>>>> info at http://vger.kernel.org/majordomo-info.html >>>>>> -- >>>>>> To unsubscribe from this list: send the line "unsubscribe linux- >>>> rdma" >>>>>> in the body of a message to [email protected] More >>>>>> majordomo info at http://vger.kernel.org/majordomo-info.html >>>>> >> -- >> To unsubscribe from this list: send the line "unsubscribe linux-rdma" >> in the body of a message to [email protected] More majordomo >> info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
