Re: [lfs-support] Test failures in automake-1.12.3 : sorted!
On Sun, Sep 30, 2012 at 12:32:22AM +0100, Ken Moffat wrote: and I'll open a ticket for this possible fix to t/python-missing.sh. Normally, I'd just upload the patch, but I'd prefer to get confirmation that it fixes the problem. More on -dev when I've created a ticket. Forget that - the testsuite fix was applied upstream in August, and 1.12.4 came out in September (#3185) so fixing the 1.12.3 tests is a waste of time. However, I do think that perhaps we shouldn't discourage people from running the automake testsuite on modern processors : sure, with -j1 it takes an excessively long time, but with modern SMP it runs much quicker if you use -j4. ?en Hi Ken I'm not sure I understand what's going on here. When I tested automake-1.12.2 *without* python installed I received no such error:- == Testsuite summary for GNU Automake 1.12.2 == # TOTAL: 2852 # PASS: 2648 # SKIP: 164 # XFAIL: 40 # FAIL: 0 # XPASS: 0 # ERROR: 0 == Richard -- http://linuxfromscratch.org/mailman/listinfo/lfs-support FAQ: http://www.linuxfromscratch.org/lfs/faq.html Unsubscribe: See the above information page
Re: [lfs-support] Test failures in automake-1.12.3 : sorted!
Richard Melville wrote: I'm not sure I understand what's going on here. When I tested automake-1.12.2 *without* python installed I received no such error:- == Testsuite summary for GNU Automake 1.12.2 == # TOTAL: 2852 # PASS: 2648 # SKIP: 164 # XFAIL: 40 # FAIL: 0 # XPASS: 0 # ERROR: 0 == I don't recall automake-1.12.2, but we are looking at automake-1.12.4. There was also an intermediate automake-1.12.3 that generated test errors. -- Bruce -- http://linuxfromscratch.org/mailman/listinfo/lfs-support FAQ: http://www.linuxfromscratch.org/lfs/faq.html Unsubscribe: See the above information page
Re: [lfs-support] Test failures in automake-1.12.3 : sorted!
Ken Moffat wrote: On Mon, Aug 20, 2012 at 11:14:11AM +0100, Ken Moffat wrote: make[3]: Leaving directory `/building/automake-1.12.3' Testsuite summary for GNU Automake 1.12.3 # TOTAL: 2823 # PASS: 2640 # SKIP: 145 # XFAIL: 38 # FAIL: 0 # XPASS: 0 # ERROR: 0 I went back and retested 1.12.4 and got: Testsuite summary for GNU Automake 1.12.4 # TOTAL: 2880 # PASS: 2756 # SKIP: 86 # XFAIL: 38 # FAIL: 0 # XPASS: 0 # ERROR: 0 This is not in a Chapter 6 environment, but has python and a lot of BLFS packages (about 260) installed. I think any errors in Chapter 6 can be ignored as test construction errors. Some of the skipped tests are due to missing Microsoft C compiler(4), MinGW(1), vala(7), etags(2), emacs, f77(4), etc. -- Bruce -- http://linuxfromscratch.org/mailman/listinfo/lfs-support FAQ: http://www.linuxfromscratch.org/lfs/faq.html Unsubscribe: See the above information page
Re: [lfs-support] Test failures in automake-1.12.3 : sorted!
On Sun, Sep 30, 2012 at 01:34:45PM +0100, Richard Melville wrote: On Sun, Sep 30, 2012 at 12:32:22AM +0100, Ken Moffat wrote: and I'll open a ticket for this possible fix to t/python-missing.sh. Normally, I'd just upload the patch, but I'd prefer to get confirmation that it fixes the problem. More on -dev when I've created a ticket. Forget that - the testsuite fix was applied upstream in August, and 1.12.4 came out in September (#3185) so fixing the 1.12.3 tests is a waste of time. However, I do think that perhaps we shouldn't discourage people from running the automake testsuite on modern processors : sure, with -j1 it takes an excessively long time, but with modern SMP it runs much quicker if you use -j4. ?en Hi Ken I'm not sure I understand what's going on here. When I tested automake-1.12.2 *without* python installed I received no such error:- == Testsuite summary for GNU Automake 1.12.2 == # TOTAL: 2852 # PASS: 2648 # SKIP: 164 # XFAIL: 40 # FAIL: 0 # XPASS: 0 # ERROR: 0 == Richard I think it might been a new FAIL in 1.12.3 ĸen -- das eine Mal als Tragödie, das andere Mal als Farce -- http://linuxfromscratch.org/mailman/listinfo/lfs-support FAQ: http://www.linuxfromscratch.org/lfs/faq.html Unsubscribe: See the above information page
Re: [lfs-support] Test failures in automake-1.12.3 : sorted!
On Sun, Sep 30, 2012 at 02:26:21PM -0500, Bruce Dubbs wrote: I went back and retested 1.12.4 and got: Testsuite summary for GNU Automake 1.12.4 # TOTAL: 2880 # PASS: 2756 # SKIP: 86 # XFAIL: 38 # FAIL: 0 # XPASS: 0 # ERROR: 0 This is not in a Chapter 6 environment, but has python and a lot of BLFS packages (about 260) installed. I think any errors in Chapter 6 can be ignored as test construction errors. Some of the skipped tests are due to missing Microsoft C compiler(4), MinGW(1), vala(7), etags(2), emacs, f77(4), etc. -- Bruce I don't know if 1.12.4 has made it to LFS-svn - I've been sticking with LFS-7.2 while I rework my build scripts, but I noticed the open ticket for 1.12.4 when I was about to raise a ticket for possibly patching 1.12.3. But, I think that *Errors* in chapter 6 tests (other than the toolchain - or at least least gcc), often benefit from being mentioned - otherwise people run the tests and panic if they don't see perfection. The patch to 1.12.3 fixed a race in the test. Maybe I'm overtuned to Errors in automake tests at the moment, after being bugged by 80+ in previosu 1.12 scripted runs. I don't usually pay any attention to skipped tests, except if I notice that someone here had a skip where mine ran (locales). Similarly, I haven't yet been persuaded to investigate XPASS failures in gcc. ĸen -- das eine Mal als Tragödie, das andere Mal als Farce -- http://linuxfromscratch.org/mailman/listinfo/lfs-support FAQ: http://www.linuxfromscratch.org/lfs/faq.html Unsubscribe: See the above information page
Re: [lfs-support] Test failures in automake-1.12.3 : sorted!
Ken Moffat wrote: I don't know if 1.12.4 has made it to LFS-svn Not yet. I've been sticking with LFS-7.2 while I rework my build scripts, but I noticed the open ticket for 1.12.4 when I was about to raise a ticket for possibly patching 1.12.3. But, I think that *Errors* in chapter 6 tests (other than the toolchain - or at least least gcc), often benefit from being mentioned We do mention that there are example logs on the web site. The only places FAIL occurs in the 7.2 tests are: 079-gcc:FAIL: libmudflap.c++/pass55-frag.cxx ( -O) execution test 079-gcc:FAIL: libmudflap.c++/pass55-frag.cxx ( -O) execution test 101-automake:FAIL: t/python-missing.sh The only place 'Error' shows up and is not associated with the above is: 071-glibc:make[3]: [/sources/glibc-build/posix/annexc.out] Error 1 (ignored) 071-glibc:make[3]: [/sources/glibc-build/conform/run-conformtest.out] Error 1 (ignored) -- Bruce -- http://linuxfromscratch.org/mailman/listinfo/lfs-support FAQ: http://www.linuxfromscratch.org/lfs/faq.html Unsubscribe: See the above information page
[lfs-support] Test failures in automake-1.12.3 : sorted!
On Mon, Aug 20, 2012 at 11:14:11AM +0100, Ken Moffat wrote: (long quotes, for context) - On Sun, Aug 19, 2012 at 08:26:39PM -0500, Bruce Dubbs wrote: Ken Moffat wrote: In this case, I'd appreciate your comments (this list will do) on automake (if you are testing it) - on a completed system, 1.12 and later give me about 4 errors as a regular user (I'd still like to get to grips with those, one day). In a system which boots, but where I've gone back to chroot, and in my results during regular chroot, I get more than 80 failures when running the tests as root. Most of them in t/instspc.tap. In a jhalfs build I have been testing automake-1.12.3. # TOTAL: 2823 # PASS: 2618 # SKIP: 166 # XFAIL: 37 # FAIL: 2 # XPASS: 0 # ERROR: 0 And that's with the broken timezones. FAIL: t/python-missing.sh (well yes, it's missing) FAIL: t/subdir-add2-pr46.sh ??? -- Bruce I'm close to giving up on the automake tests. Last night I had 3 failures in 1.12.3 - but only once I ran the tests as a user. I had that t/python-missing.sh and assumed it was because Python is installed (it's my bootable system, back in chroot). My other two were t/lex-clean-cxx and t/lex-depend-cxx : both undefined reference to `yylex'. I suppose those lex tests are SKIP for you, because LFS has not installed flex when automake is built. First, ISTR that we did something which fixed the lex tests, but I no longer remember what. My main problem (multiple failures in t/instspc.tap) turns out to be because of how my buildscripts work : I pass $SCRIPTS to point ot the root of the scripts (e.g. for my general functions for working out the directory name,for writing the stamp with the SBU calculation, and for logging). Unfortunately, t/instspc.tap breaks if $SCRIPTS is set! There is at least one other place where environment variables have broken a build for me ($ARCH when set to x86_64 in glibc), so I've added this to my don't do that here list :) After all that (about a week of various attempts to fix this), I was *disappointed* to see that the automake testsuite still failed - our old friend t/python-missing.sh. My impression is that the tests are supposed to skip if a dependency is not installed. Google did find something related: http://lists.gnu.org/archive/html/automake-commit/2012-08/msg00033.html I've now (at the end of chapter 6 in chroot) rebuilt automake with that patch and got the following result from the testsuite - make[3]: Leaving directory `/building/automake-1.12.3' Testsuite summary for GNU Automake 1.12.3 # TOTAL: 2823 # PASS: 2640 # SKIP: 145 # XFAIL: 38 # FAIL: 0 # XPASS: 0 # ERROR: 0 make[2]: Leaving directory `/building/automake-1.12.3' make[1]: Leaving directory `/building/automake-1.12.3' root in chroot /building/automake-1.12.3# Unfortunately, the bug report shows the problem was a race, and I'm not yet convinced that the reported bug was necessarily the same as what we've been seeing. So, it worked for me this time, but maybe I jsut got lucky. In a completed system, I *always* have Python installed, so I can only test this in chroot. So, the 80+ failures are sorted (at last!) and I'll open a ticket for this possible fix to t/python-missing.sh. Normally, I'd just upload the patch, but I'd prefer to get confirmation that it fixes the problem. More on -dev when I've created a ticket. ĸen -- das eine Mal als Tragödie, das andere Mal als Farce -- http://linuxfromscratch.org/mailman/listinfo/lfs-support FAQ: http://www.linuxfromscratch.org/lfs/faq.html Unsubscribe: See the above information page
Re: [lfs-support] Test failures in automake-1.12.3 : sorted!
On Sun, Sep 30, 2012 at 12:32:22AM +0100, Ken Moffat wrote: and I'll open a ticket for this possible fix to t/python-missing.sh. Normally, I'd just upload the patch, but I'd prefer to get confirmation that it fixes the problem. More on -dev when I've created a ticket. Forget that - the testsuite fix was applied upstream in August, and 1.12.4 came out in September (#3185) so fixing the 1.12.3 tests is a waste of time. However, I do think that perhaps we shouldn't discourage people from running the automake testsuite on modern processors : sure, with -j1 it takes an excessively long time, but with modern SMP it runs much quicker if you use -j4. ĸen -- das eine Mal als Tragödie, das andere Mal als Farce -- http://linuxfromscratch.org/mailman/listinfo/lfs-support FAQ: http://www.linuxfromscratch.org/lfs/faq.html Unsubscribe: See the above information page
