Re: About libtool supporting parallel make install
El vie, 18-03-2011 a las 13:40 -0700, Dan Nicholson escribió: On Thu, Mar 17, 2011 at 11:40 PM, Ralf Wildenhues ralf.wildenh...@gmx.de wrote: * Dan Nicholson wrote on Thu, Mar 17, 2011 at 11:47:38PM CET: On Thu, Mar 17, 2011 at 3:08 AM, Pacho Ramos pa...@gentoo.org wrote: https://bugzilla.gnome.org/show_bug.cgi?id=644896#c2 This seems more legitimate. I looked at the Makefile.am's and they look reasonable to me. You have two libraries, one is in lib_LTLIBRARIES and the other is in pkglib_LTLIBRARIES. The pkglib one depends on the lib one. It seems that make is running install-libLTLIBRARIES and install-pkglibLTLIBRARIES in parallel. Each one of these these rules installs the libraries serially in a loop. However, if libtool is relinking the libraries, it really needs to wait until the prerequisite libraries from _other_ rules are installed. I'd bet if you do this: echo install-pkglibLTLIBRARIES: install-libLTLIBRARIES src/backend/xml/Makefile it will work again. This seems like a bug in automake's libtool support to me, but I don't know how to fix it. Yes, it's a bug in Automake/Libtool, but the workaround isn't quite correct: you'd need something like install-pkglibLTLIBRARIES = install-pkglibLTLIBRARIES $(install-pkglibLTLIBRARIES): install-libLTLIBRARIES because your proposed workaround will cause automake to not emit its install-pkglibLTLIBRARIES rule at all. Yes, depending on automake not seeing through variables when determining target names is ugly, I know. (It's also so widespread by now that we can't easily change that issue.) Oh, I see what you mean. If you add it to the generated Makefile, it would work, though. I've posted some ideas to fix the original bug before, on an automake or libtool list; but nothing finished. :-/ I'd never encountered this issue before, but I hope it is something you can fix. I more or less understand how autoconf and libtool work, but I've never deleved into automake. -- Dan Then, as the bug looks to be in automake/libtool, there is no much gnucash can do to fix this as they don't provide generated Makefile (only Makefile.am and .in), no? Thanks :-) ___ http://lists.gnu.org/mailman/listinfo/libtool
Re: About libtool supporting parallel make install
On Fri 18 Mar 2011 07:40, Ralf Wildenhues ralf.wildenh...@gmx.de writes: * Dan Nicholson wrote on Thu, Mar 17, 2011 at 11:47:38PM CET: On Thu, Mar 17, 2011 at 3:08 AM, Pacho Ramos pa...@gentoo.org wrote: https://bugzilla.gnome.org/show_bug.cgi?id=644896#c2 This seems more legitimate. I looked at the Makefile.am's and they look reasonable to me. You have two libraries, one is in lib_LTLIBRARIES and the other is in pkglib_LTLIBRARIES. The pkglib one depends on the lib one. It seems that make is running install-libLTLIBRARIES and install-pkglibLTLIBRARIES in parallel. Yes, it's a bug in Automake/Libtool Here's an automake bug report for this one: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=7328 I don't know if there was a recorded report before. Andy ___ http://lists.gnu.org/mailman/listinfo/libtool
Re: About libtool supporting parallel make install
El mar, 22-03-2011 a las 12:03 +0100, Andy Wingo escribió: On Fri 18 Mar 2011 07:40, Ralf Wildenhues ralf.wildenh...@gmx.de writes: * Dan Nicholson wrote on Thu, Mar 17, 2011 at 11:47:38PM CET: On Thu, Mar 17, 2011 at 3:08 AM, Pacho Ramos pa...@gentoo.org wrote: https://bugzilla.gnome.org/show_bug.cgi?id=644896#c2 This seems more legitimate. I looked at the Makefile.am's and they look reasonable to me. You have two libraries, one is in lib_LTLIBRARIES and the other is in pkglib_LTLIBRARIES. The pkglib one depends on the lib one. It seems that make is running install-libLTLIBRARIES and install-pkglibLTLIBRARIES in parallel. Yes, it's a bug in Automake/Libtool Here's an automake bug report for this one: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=7328 I don't know if there was a recorded report before. Andy Thanks a lot ___ http://lists.gnu.org/mailman/listinfo/libtool
Re: About libtool supporting parallel make install
On Tue, Mar 22, 2011 at 3:44 AM, Pacho Ramos pachora...@gmail.com wrote: El vie, 18-03-2011 a las 13:40 -0700, Dan Nicholson escribió: On Thu, Mar 17, 2011 at 11:40 PM, Ralf Wildenhues ralf.wildenh...@gmx.de wrote: * Dan Nicholson wrote on Thu, Mar 17, 2011 at 11:47:38PM CET: On Thu, Mar 17, 2011 at 3:08 AM, Pacho Ramos pa...@gentoo.org wrote: https://bugzilla.gnome.org/show_bug.cgi?id=644896#c2 This seems more legitimate. I looked at the Makefile.am's and they look reasonable to me. You have two libraries, one is in lib_LTLIBRARIES and the other is in pkglib_LTLIBRARIES. The pkglib one depends on the lib one. It seems that make is running install-libLTLIBRARIES and install-pkglibLTLIBRARIES in parallel. Each one of these these rules installs the libraries serially in a loop. However, if libtool is relinking the libraries, it really needs to wait until the prerequisite libraries from _other_ rules are installed. I'd bet if you do this: echo install-pkglibLTLIBRARIES: install-libLTLIBRARIES src/backend/xml/Makefile it will work again. This seems like a bug in automake's libtool support to me, but I don't know how to fix it. Yes, it's a bug in Automake/Libtool, but the workaround isn't quite correct: you'd need something like install-pkglibLTLIBRARIES = install-pkglibLTLIBRARIES $(install-pkglibLTLIBRARIES): install-libLTLIBRARIES because your proposed workaround will cause automake to not emit its install-pkglibLTLIBRARIES rule at all. Yes, depending on automake not seeing through variables when determining target names is ugly, I know. (It's also so widespread by now that we can't easily change that issue.) Oh, I see what you mean. If you add it to the generated Makefile, it would work, though. I've posted some ideas to fix the original bug before, on an automake or libtool list; but nothing finished. :-/ I'd never encountered this issue before, but I hope it is something you can fix. I more or less understand how autoconf and libtool work, but I've never deleved into automake. -- Dan Then, as the bug looks to be in automake/libtool, there is no much gnucash can do to fix this as they don't provide generated Makefile (only Makefile.am and .in), no? What they can do is split the libgnc-backend-xml-utils.la into it's own separate subdirectory so that the make rules don't get mixed up with the libgncmod-backend-xml.la ones. Kludgy, but it would work. -- Dan ___ http://lists.gnu.org/mailman/listinfo/libtool
Re: About libtool supporting parallel make install
On 03/22/2011 12:03 PM, Andy Wingo wrote: I don't know if there was a recorded report before. Actually it's a such kind of well-known issue in Fedora, Fedora packagers take automake/libtool-based make -jN install being broken for granted and simply don't use it. Ralf ___ http://lists.gnu.org/mailman/listinfo/libtool
Re: About libtool supporting parallel make install
El mar, 22-03-2011 a las 12:03 +0100, Andy Wingo escribió: On Fri 18 Mar 2011 07:40, Ralf Wildenhues ralf.wildenh...@gmx.de writes: * Dan Nicholson wrote on Thu, Mar 17, 2011 at 11:47:38PM CET: On Thu, Mar 17, 2011 at 3:08 AM, Pacho Ramos pa...@gentoo.org wrote: https://bugzilla.gnome.org/show_bug.cgi?id=644896#c2 This seems more legitimate. I looked at the Makefile.am's and they look reasonable to me. You have two libraries, one is in lib_LTLIBRARIES and the other is in pkglib_LTLIBRARIES. The pkglib one depends on the lib one. It seems that make is running install-libLTLIBRARIES and install-pkglibLTLIBRARIES in parallel. Yes, it's a bug in Automake/Libtool Here's an automake bug report for this one: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=7328 I don't know if there was a recorded report before. Andy Thanks a lot signature.asc Description: This is a digitally signed message part ___ http://lists.gnu.org/mailman/listinfo/libtool
Re: About libtool supporting parallel make install
El mar, 22-03-2011 a las 05:34 -0700, Dan Nicholson escribió: Then, as the bug looks to be in automake/libtool, there is no much gnucash can do to fix this as they don't provide generated Makefile (only Makefile.am and .in), no? What they can do is split the libgnc-backend-xml-utils.la into it's own separate subdirectory so that the make rules don't get mixed up with the libgncmod-backend-xml.la ones. Kludgy, but it would work. -- Dan OK, will suggest it to gnucash people, thanks ___ http://lists.gnu.org/mailman/listinfo/libtool
Re: About libtool supporting parallel make install
* Dan Nicholson wrote on Thu, Mar 17, 2011 at 11:47:38PM CET: On Thu, Mar 17, 2011 at 3:08 AM, Pacho Ramos pa...@gentoo.org wrote: https://bugzilla.gnome.org/show_bug.cgi?id=644896#c2 This seems more legitimate. I looked at the Makefile.am's and they look reasonable to me. You have two libraries, one is in lib_LTLIBRARIES and the other is in pkglib_LTLIBRARIES. The pkglib one depends on the lib one. It seems that make is running install-libLTLIBRARIES and install-pkglibLTLIBRARIES in parallel. Each one of these these rules installs the libraries serially in a loop. However, if libtool is relinking the libraries, it really needs to wait until the prerequisite libraries from _other_ rules are installed. I'd bet if you do this: echo install-pkglibLTLIBRARIES: install-libLTLIBRARIES src/backend/xml/Makefile it will work again. This seems like a bug in automake's libtool support to me, but I don't know how to fix it. Yes, it's a bug in Automake/Libtool, but the workaround isn't quite correct: you'd need something like install-pkglibLTLIBRARIES = install-pkglibLTLIBRARIES $(install-pkglibLTLIBRARIES): install-libLTLIBRARIES because your proposed workaround will cause automake to not emit its install-pkglibLTLIBRARIES rule at all. Yes, depending on automake not seeing through variables when determining target names is ugly, I know. (It's also so widespread by now that we can't easily change that issue.) I've posted some ideas to fix the original bug before, on an automake or libtool list; but nothing finished. :-/ Cheers, Ralf ___ http://lists.gnu.org/mailman/listinfo/libtool
Re: About libtool supporting parallel make install
El jue, 17-03-2011 a las 15:47 -0700, Dan Nicholson escribió: On Thu, Mar 17, 2011 at 3:08 AM, Pacho Ramos pa...@gentoo.org wrote: Hello Downstream on Gentoo we see some package having problems at make install phase using -j2 or more. Reporting to upstream, some of them told us that they think parallel *installation* is not supported: https://bugs.freedesktop.org/show_bug.cgi?id=28108#c1 This is bogus. The problem is that the Makefile has src before libltdl in SUBDIRS. That can't possibly work since things in src need to link to -ltdl. Trying to build the vanilla tarball, it fails even on make -j1. My guess is that the developer has libltdl-devel installed and didn't notice it wasn't linking to the one in the tree. You may just not want to build an ancient canberra, though. https://bugzilla.gnome.org/show_bug.cgi?id=644896#c2 This seems more legitimate. I looked at the Makefile.am's and they look reasonable to me. You have two libraries, one is in lib_LTLIBRARIES and the other is in pkglib_LTLIBRARIES. The pkglib one depends on the lib one. It seems that make is running install-libLTLIBRARIES and install-pkglibLTLIBRARIES in parallel. Each one of these these rules installs the libraries serially in a loop. However, if libtool is relinking the libraries, it really needs to wait until the prerequisite libraries from _other_ rules are installed. I'd bet if you do this: echo install-pkglibLTLIBRARIES: install-libLTLIBRARIES src/backend/xml/Makefile it will work again. This seems like a bug in automake's libtool support to me, but I don't know how to fix it. I would like then to confirm if parallel installation is supported and supposed to work or we should force it to be non-parallel downstream. I've used parallel install with libtoolized packages for years. I've never had bugs with it. I work on the xserver, which has tons of interdependent libtool libraries, and I've never seen a problem like this. -- Dan Thanks a lot for your help We have some downstream opened bugs with similar cases, would you mind asking for help with them here in the future once their respective upstream refuse to fix the issues? Best regards signature.asc Description: This is a digitally signed message part ___ http://lists.gnu.org/mailman/listinfo/libtool
Re: About libtool supporting parallel make install
Hello Pacho, * Pacho Ramos wrote on Fri, Mar 18, 2011 at 11:48:51AM CET: We have some downstream opened bugs with similar cases, would you mind asking for help with them here in the future once their respective upstream refuse to fix the issues? Feel free to come to this mailing list for help about Libtool issues. Cheers, Ralf ___ http://lists.gnu.org/mailman/listinfo/libtool
Re: About libtool supporting parallel make install
Pacho, hope you're reading the list. Mail from me to you bounces because some MTA near your end is over-eagerly using SPF to reject legitimate mail. Rakf * Ralf Wildenhues wrote on Fri, Mar 18, 2011 at 08:43:21PM CET: Hello Pacho, * Pacho Ramos wrote on Fri, Mar 18, 2011 at 11:48:51AM CET: We have some downstream opened bugs with similar cases, would you mind asking for help with them here in the future once their respective upstream refuse to fix the issues? Feel free to come to this mailing list for help about Libtool issues. Cheers, Ralf ___ http://lists.gnu.org/mailman/listinfo/libtool
Re: About libtool supporting parallel make install
On Thu, Mar 17, 2011 at 11:40 PM, Ralf Wildenhues ralf.wildenh...@gmx.de wrote: * Dan Nicholson wrote on Thu, Mar 17, 2011 at 11:47:38PM CET: On Thu, Mar 17, 2011 at 3:08 AM, Pacho Ramos pa...@gentoo.org wrote: https://bugzilla.gnome.org/show_bug.cgi?id=644896#c2 This seems more legitimate. I looked at the Makefile.am's and they look reasonable to me. You have two libraries, one is in lib_LTLIBRARIES and the other is in pkglib_LTLIBRARIES. The pkglib one depends on the lib one. It seems that make is running install-libLTLIBRARIES and install-pkglibLTLIBRARIES in parallel. Each one of these these rules installs the libraries serially in a loop. However, if libtool is relinking the libraries, it really needs to wait until the prerequisite libraries from _other_ rules are installed. I'd bet if you do this: echo install-pkglibLTLIBRARIES: install-libLTLIBRARIES src/backend/xml/Makefile it will work again. This seems like a bug in automake's libtool support to me, but I don't know how to fix it. Yes, it's a bug in Automake/Libtool, but the workaround isn't quite correct: you'd need something like install-pkglibLTLIBRARIES = install-pkglibLTLIBRARIES $(install-pkglibLTLIBRARIES): install-libLTLIBRARIES because your proposed workaround will cause automake to not emit its install-pkglibLTLIBRARIES rule at all. Yes, depending on automake not seeing through variables when determining target names is ugly, I know. (It's also so widespread by now that we can't easily change that issue.) Oh, I see what you mean. If you add it to the generated Makefile, it would work, though. I've posted some ideas to fix the original bug before, on an automake or libtool list; but nothing finished. :-/ I'd never encountered this issue before, but I hope it is something you can fix. I more or less understand how autoconf and libtool work, but I've never deleved into automake. -- Dan ___ http://lists.gnu.org/mailman/listinfo/libtool
