Gilles, Applying both of your patches to the 1.8.7rc1 tarball appears to give the desired results on both of the systems I tested.
-Paul On Thu, Jul 9, 2015 at 9:39 PM, Paul Hargrove <[email protected]> wrote: > Gilles, > > I see now that your patches aren't applying because they have DOS line > endings (CRLF vs LF). > I need to strip those to get the patches applied. > > I will report results with your patch on both my "old" and "new" systems > as soon as possible. > > -Paul > > On Thu, Jul 9, 2015 at 9:26 PM, Gilles Gouaillardet <[email protected]> > wrote: > >> Paul, >> >> i just applied the patch on the tarball, and it worked for me. >> anyway, the IBV_SRQT_XRC test was misplaced (and i just read you already >> found out ...) >> we need if for XRC_DOMAINS and *not* for XRC >> >> the newly attached patch will (hopefully) fix this >> >> Cheers, >> >> Gilles >> >> >> On 7/10/2015 11:06 AM, Paul Hargrove wrote: >> >> Gilles, >> >> The patch didn't apply to the 1.8.7rc1 tarball. >> So, I made the change manually and ran autogen.pl. >> >> The result is that one fewer configure test runs, but "ConnectX XRC >> support" is still disabled: >> >> Diffing the configure output: >> checking for ibv_resize_cq... yes >> checking for struct ibv_device.transport_type... yes >> checking for ibv_create_xrc_rcv_qp... yes >> -checking for ibv_cmd_open_xrcd... no >> checking whether IBV_SRQT_XRC is declared... no >> checking infiniband/complib/cl_types_osd.h usability... no >> checking infiniband/complib/cl_types_osd.h presence... no >> >> >> You will note that "IBV_SRQT_XRC" did not appear when I grepped for XRC >> in /usr/include/infiniband/verbs.h (in a previous message). >> I am not sure, but suspect that identifier is related to "ConnectIB XRC >> support" (not ConnectX). >> If you look back at the 1.8.4 release you will find only a check for >> ibv_create_xrc_rcv_qp. >> >> -Paul >> >> On Thu, Jul 9, 2015 at 6:17 PM, Gilles Gouaillardet <[email protected]> >> wrote: >> >>> Thanks Paul, >>> >>> i just found an other bug ... >>> (and i should be blamed for it) >>> >>> here is attached a patch. >>> >>> basically, xrc was incorrectly disabled on "older" ofed stacks >>> >>> Cheers, >>> >>> Gilles >>> >>> >>> >>> On 7/10/2015 10:06 AM, Paul Hargrove wrote: >>> >>> Gilles, >>> >>> A bzip2-compressed config.log is attached. >>> >>> I am unsure how to determine the OFED version, because the admins have >>> prevented normal users from reading the RPM database. >>> Perhaps the following helps: >>> >>> $ nm /usr/lib64/libibverbs.a | grep -i xrc >>> 00000000000000e0 T ibv_cmd_close_xrc_domain >>> 0000000000000230 T ibv_cmd_create_xrc_rcv_qp >>> 00000000000003b0 T ibv_cmd_create_xrc_srq >>> 0000000000000a40 T ibv_cmd_modify_xrc_rcv_qp >>> 0000000000000150 T ibv_cmd_open_xrc_domain >>> 0000000000001e30 T ibv_cmd_query_xrc_rcv_qp >>> 0000000000000070 T ibv_cmd_reg_xrc_rcv_qp >>> 0000000000000000 T ibv_cmd_unreg_xrc_rcv_qp >>> 00000000000002b0 T ibv_close_xrc_domain >>> 00000000000002d0 T ibv_create_xrc_rcv_qp >>> 00000000000007a0 T ibv_create_xrc_srq >>> 0000000000000310 T ibv_modify_xrc_rcv_qp >>> 0000000000000280 T ibv_open_xrc_domain >>> 0000000000000340 T ibv_query_xrc_rcv_qp >>> 0000000000000370 T ibv_reg_xrc_rcv_qp >>> 0000000000000390 T ibv_unreg_xrc_rcv_qp >>> >>> $ grep XRC /usr/include/infiniband/verbs.h >>> IBV_DEVICE_XRC = 1 << 20 >>> IBV_XRC_QP_EVENT_FLAG = 0x80000000, >>> IBV_QPT_XRC, >>> [matches in comments have been removed]. >>> >>> When tonight's master tarball is posted (perhaps 10 minutes from now) >>> I will test it and report what I find. >>> >>> -Paul >>> >>> >>> On Thu, Jul 9, 2015 at 5:17 PM, Gilles Gouaillardet <[email protected]> >>> wrote: >>> >>>> Paul, >>>> >>>> can you please compress and post your config.log ? >>>> what is the OFED version you are running ? >>>> >>>> on master, that fix did the trick on mellanox test cluster (recent OFED >>>> version) but did not >>>> enable XRC on lanl test clusters (my best bet is an old OFED library) >>>> >>>> Thanks >>>> >>>> Gilles >>>> >>>> >>>> On 7/10/2015 9:08 AM, Paul Hargrove wrote: >>>> >>>> Preliminary report: >>>> >>>> 1) I find that "ConnectX XRC support" is still not detected as it was >>>> in 1.8.4 and earlier: >>>> >>>> $ grep 'ConnectX XRC support' openmpi-1.*-icc-14/LOG/configure.log| >>>> sort -u >>>> openmpi-1.8-linux-x86_64-icc-14/LOG/configure.log:checking if >>>> ConnectX XRC support is enabled... yes >>>> openmpi-1.8.1-linux-x86_64-icc-14/LOG/configure.log:checking if >>>> ConnectX XRC support is enabled... yes >>>> openmpi-1.8.2-linux-x86_64-icc-14/LOG/configure.log:checking if >>>> ConnectX XRC support is enabled... yes >>>> openmpi-1.8.3-linux-x86_64-icc-14/LOG/configure.log:checking if >>>> ConnectX XRC support is enabled... yes >>>> openmpi-1.8.4-linux-x86_64-icc-14/LOG/configure.log:checking if >>>> ConnectX XRC support is enabled... yes >>>> openmpi-1.8.5-linux-x86_64-icc-14/LOG/configure.log:checking if >>>> ConnectX XRC support is enabled... no >>>> openmpi-1.8.6-linux-x86_64-icc-14/LOG/configure.log:checking if >>>> ConnectX XRC support is enabled... no >>>> openmpi-1.8.7rc1-linux-x86_64-icc-14/LOG/configure.log:checking if >>>> ConnectX XRC support is enabled... no >>>> >>>> >>>> >>>> 2) I noticed a cosmetic "glitch" in the configure output: >>>> >>>> checking for working epoll library interface... checking if epoll can >>>> build... yes >>>> >>>> yes >>>> >>>> This just means AC_MSG_{CHECKING,RESULT} macros are nested when they >>>> shouldn't be. >>>> There is nothing to suggest that the results of the configure probes >>>> are incorrect. >>>> >>>> >>>> -Paul >>>> >>>> On Thu, Jul 9, 2015 at 1:03 PM, Ralph Castain <[email protected]> wrote: >>>> >>>>> In the usual place: >>>>> >>>>> http://www.open-mpi.org/software/ompi/v1.8/ >>>>> >>>>> Please test and let me know of any issues that surface. My intent is >>>>> to release this next week. >>>>> Ralph >>>>> >>>>> >>>>> _______________________________________________ >>>>> devel mailing list >>>>> [email protected] >>>>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel >>>>> Link to this post: >>>>> http://www.open-mpi.org/community/lists/devel/2015/07/17604.php >>>>> >>>> >>>> >>>> >>>> -- >>>> Paul H. Hargrove [email protected] >>>> Computer Languages & Systems Software (CLaSS) Group >>>> Computer Science Department Tel: +1-510-495-2352 >>>> Lawrence Berkeley National Laboratory Fax: +1-510-486-6900 >>>> >>>> >>>> _______________________________________________ >>>> devel mailing [email protected] >>>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel >>>> >>>> Link to this post: >>>> http://www.open-mpi.org/community/lists/devel/2015/07/17606.php >>>> >>>> >>>> >>>> _______________________________________________ >>>> devel mailing list >>>> [email protected] >>>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel >>>> Link to this post: >>>> http://www.open-mpi.org/community/lists/devel/2015/07/17607.php >>>> >>> >>> >>> >>> -- >>> Paul H. Hargrove [email protected] >>> Computer Languages & Systems Software (CLaSS) Group >>> Computer Science Department Tel: +1-510-495-2352 >>> Lawrence Berkeley National Laboratory Fax: +1-510-486-6900 >>> >>> >>> _______________________________________________ >>> devel mailing [email protected] >>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel >>> >>> Link to this post: >>> http://www.open-mpi.org/community/lists/devel/2015/07/17608.php >>> >>> >>> >>> _______________________________________________ >>> devel mailing list >>> [email protected] >>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel >>> Link to this post: >>> http://www.open-mpi.org/community/lists/devel/2015/07/17609.php >>> >> >> >> >> -- >> Paul H. Hargrove [email protected] >> Computer Languages & Systems Software (CLaSS) Group >> Computer Science Department Tel: +1-510-495-2352 >> Lawrence Berkeley National Laboratory Fax: +1-510-486-6900 >> >> >> _______________________________________________ >> devel mailing [email protected] >> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel >> >> Link to this post: >> http://www.open-mpi.org/community/lists/devel/2015/07/17610.php >> >> >> >> _______________________________________________ >> devel mailing list >> [email protected] >> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel >> Link to this post: >> http://www.open-mpi.org/community/lists/devel/2015/07/17612.php >> > > > > -- > Paul H. Hargrove [email protected] > Computer Languages & Systems Software (CLaSS) Group > Computer Science Department Tel: +1-510-495-2352 > Lawrence Berkeley National Laboratory Fax: +1-510-486-6900 > -- Paul H. Hargrove [email protected] Computer Languages & Systems Software (CLaSS) Group Computer Science Department Tel: +1-510-495-2352 Lawrence Berkeley National Laboratory Fax: +1-510-486-6900
