I ran a round of tests of CVS Automake, posting some bug fixes along the way ... could you have guessed? ;-) With those, CVS Automake as of the last couple of months fares as follows on a number of systems. The list is sorted by OS then CPU; duplicate entries denote different computers.
I've been trying to use native tools only, as present, esp. I did usually _not_ have GNU make in $PATH if the native one is different; GNU m4 everywhere, and varying CVS Autoconf versions from during the last few weeks; usually I did not try to ensure that a GCC version was in PATH, even on systems that had it installed somewhere. Systems from the HP testdrive project are marked as such; some of those exhibit issues not found on other installations of similar systems, i.e., same or similar $host value. If some of these can be shown to be system configuration issues, it'd be good to sort them out and report them. Anyways, kudos to HP for providing this service! Logs with VERBOSE=x are available, in case you're interested; most issues should have been reported on one of the automake lists, however. Items marked `fixed' have been fixed since the test run, for issues marked `patch pending', surprisingly, a patch has been posted since. I realize that, because GNU make, gcc, libtool and some other tools required by some of the test are not installed on those systems or need special configuration flags to be accessible, the test suite exposure is less complete that it could have been. Oh well. Cheers, Ralf (*) denotes issues for which no separate report has been posted (yet). powerpc-ibm-aix4.3.3.0 ===================================== 2 of 455 tests failed (136 tests were not run) ===================================== longlin2 fixed mkinst3 fixed powerpc-ibm-aix5.1.0.0 ===================================== 2 of 454 tests failed (137 tests were not run) ===================================== automake.test fixed longlin2.test fixed powerpc-ibm-aix5.2.0.0 ===================================== 1 of 454 tests failed (137 tests were not run) ===================================== automake.test fixed powerpc-ibm-aix5.3.0.0 ======================================================= All 454 tests behaved as expected (3 expected failures) (137 tests were not run) ======================================================= i686-pc-cygwin ===================================== 11 of 552 tests failed (39 tests were not run) ===================================== txinfo3.test txinfo13.test txinfo16.test txinfo18.test txinfo21.test txinfo22.test txinfo23.test txinfo24.test txinfo25.test txinfo28.test version7.test These failures are similar to what Markus Elfring reported here: http://lists.gnu.org/archive/html/bug-automake/2006-04/msg00017.html http://lists.gnu.org/archive/html/bug-automake/2006-05/msg00001.html presumably because the Cygwin TeX installation seems broken. powerpc-apple-darwin8.2.0 ======================================================= All 536 tests behaved as expected (3 expected failures) (55 tests were not run) ======================================================= i386-unknown-freebsd5.4 ======================================================= All 497 tests behaved as expected (3 expected failures) (94 tests were not run) ======================================================= i386-unknown-freebsd5.4 (testdrive) ======================================================= All 502 tests behaved as expected (3 expected failures) (89 tests were not run) ======================================================= ia64-unknown-freebsd6.0 (testdrive) ===================================== 1 of 497 tests failed (94 tests were not run) ===================================== remake4.test NFS oddity? alpha-unknown-freebsd6.0 ======================================================= All 502 tests behaved as expected (3 expected failures) (89 tests were not run) ======================================================= hppa2.0-hp-hpux10.20 ===================================== 1 of 453 tests failed (138 tests were not run) ===================================== distdir.test fixed hppa2.0w-hp-hpux11.00 ===================================== 1 of 453 tests failed (138 tests were not run) ===================================== distdir.test fixed hppa2.0w-hp-hpux11.11 ===================================== 1 of 458 tests failed (133 tests were not run) ===================================== distdir.test fixed hppa2.0w-hp-hpux11.23 ===================================== 1 of 453 tests failed (138 tests were not run) ===================================== distdir.test fixed ia64-hp-hpux11.23 ===================================== 1 of 453 tests failed (138 tests were not run) ===================================== distdir.test fixed mips-sgi-irix6.5 ===================================== 1 of 454 tests failed (137 tests were not run) ===================================== depcomp6.test: patch pending bug with depmode=sgi java.test: fixed (skipped due to nonexistent compiler) x86_64-unknown-linux-gnu (RHEL4) ======================================================= All 533 tests behaved as expected (3 expected failures) (58 tests were not run) ======================================================= x86_64-unknown-linux-gnu (FC3) ======================================================= All 591 tests behaved as expected (3 expected failures) ======================================================= (this is with the gettext patch applied) i686-pc-mingw32 ===================================== 6 of 510 tests failed (82 tests were not run) ===================================== automake.test fixed pr401.test patch pending (perl -i) pr401c.test likewise python11.test likewise symlink.test "ln -s" is emulated by "cp -p" (*) tar.test MinGW tar is too old for ustar (*) i386-unknown-netbsdelf3.0 (testdrive) ===================================== 2 of 505 tests failed (86 tests were not run) ===================================== automake.test fixed remake4.test NFS oddity? i386-unknown-openbsd3.8 ===================================== 1 of 491 tests failed (100 tests were not run) ===================================== depcomp6.test fixed alphaev5-dec-osf4.0d ===================================== 2 of 454 tests failed (137 tests were not run) ===================================== distdir.test fixed acloca18.test patch pending (diff /dev/null) alphaev67-dec-osf5.1 ===================================== 2 of 454 tests failed (137 tests were not run) ===================================== distdir.test fixed acloca18.test patch pending (diff /dev/null) alphaev7-dec-osf5.1b (testdrive) ===================================== 6 of 492 tests failed (99 tests were not run) ===================================== acloca18.test patch pending (diff /dev/null) automake.test fixed distdir.test fixed instspc.test build-/install-failures on ^H, ^M, ^L, (*) pr401.test patch pending LIBOBJDIR and BSD make pr401c.test likewise alphaev68-dec-osf5.1b (testdrive) ===================================== 7 of 457 tests failed (134 tests were not run) ===================================== acloca18.test patch pending (diff /dev/null) automake.test fixed distdir.test fixed missing.test $sleep, NFS oddity? missing2.test likewise missing4.test likewise spy.test non-upating-redirection sparc-sun-solaris2.6 ===================================== 5 of 453 tests failed (138 tests were not run) ===================================== distdir.test VPATH subdir issue (foo/bar, not ./joe) extra6.test likewise pr9.test likewise subpkg3.test likewise java.test fixed sparc-sun-solaris2.7 ======================================================= All 453 tests behaved as expected (3 expected failures) (138 tests were not run) ======================================================= sparc-sun-solaris2.8 ======================================================= All 453 tests behaved as expected (3 expected failures) (138 tests were not run) ======================================================= sparc-sun-solaris2.9 ===================================== 1 of 453 tests failed (138 tests were not run) ===================================== automake.test fixed sparc-sun-solaris2.10 ======================================================= All 454 tests behaved as expected (3 expected failures) (137 tests were not run) =======================================================