https://gcc.gnu.org/bugzilla/show_bug.cgi?id=64221
Bug ID: 64221 Summary: contrib/compare_tests confused by c-c++-common/ubsan/shift-5.c Product: gcc Version: 5.0 Status: UNCONFIRMED Severity: normal Priority: P3 Component: testsuite Assignee: unassigned at gcc dot gnu.org Reporter: glisse at gcc dot gnu.org Comparing a log file to itself fails. I already had to use compare_tests for each sum file separately, since, when I enable all languages, trying to use it on the whole tree gives: $ /data/repos/gcc/trunk/contrib/compare_tests /tmp/testgcc/pristine /tmp/testgcc/pristine [...] comm: file 2 is not in sorted order comm: file 1 is not in sorted order comm: file 2 is not in sorted order New tests that FAIL: [many many lines] comm: file 1 is not in sorted order Old tests that failed, that have disappeared: (Eeek!) [the same many many lines] But now it is getting close to useless: $ /data/repos/gcc/trunk/contrib/compare_tests /tmp/testgcc/pristine/build/gcc/testsuite/gcc/gcc.sum /tmp/testgcc/pristine/build/gcc/testsuite/gcc/gcc.sum Tests that now fail, but worked before: c-c++-common/ubsan/shift-5.c -O0 (test for errors, line 11) c-c++-common/ubsan/shift-5.c -O0 (test for errors, line 14) c-c++-common/ubsan/shift-5.c -O0 (test for errors, line 17) c-c++-common/ubsan/shift-5.c -O0 (test for errors, line 20) c-c++-common/ubsan/shift-5.c -O0 (test for errors, line 34) c-c++-common/ubsan/shift-5.c -O0 (test for errors, line 37) c-c++-common/ubsan/shift-5.c -O1 (test for errors, line 11) c-c++-common/ubsan/shift-5.c -O1 (test for errors, line 14) c-c++-common/ubsan/shift-5.c -O1 (test for errors, line 17) c-c++-common/ubsan/shift-5.c -O1 (test for errors, line 20) c-c++-common/ubsan/shift-5.c -O1 (test for errors, line 34) c-c++-common/ubsan/shift-5.c -O1 (test for errors, line 37) c-c++-common/ubsan/shift-5.c -O2 (test for errors, line 11) c-c++-common/ubsan/shift-5.c -O2 (test for errors, line 14) c-c++-common/ubsan/shift-5.c -O2 (test for errors, line 17) c-c++-common/ubsan/shift-5.c -O2 (test for errors, line 20) c-c++-common/ubsan/shift-5.c -O2 (test for errors, line 34) c-c++-common/ubsan/shift-5.c -O2 (test for errors, line 37) c-c++-common/ubsan/shift-5.c -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for errors, line 11) c-c++-common/ubsan/shift-5.c -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for errors, line 14) c-c++-common/ubsan/shift-5.c -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for errors, line 17) c-c++-common/ubsan/shift-5.c -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for errors, line 20) c-c++-common/ubsan/shift-5.c -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for errors, line 34) c-c++-common/ubsan/shift-5.c -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for errors, line 37) c-c++-common/ubsan/shift-5.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects (test for errors, line 11) c-c++-common/ubsan/shift-5.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects (test for errors, line 14) c-c++-common/ubsan/shift-5.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects (test for errors, line 17) c-c++-common/ubsan/shift-5.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects (test for errors, line 20) c-c++-common/ubsan/shift-5.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects (test for errors, line 34) c-c++-common/ubsan/shift-5.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects (test for errors, line 37) c-c++-common/ubsan/shift-5.c -O3 -fomit-frame-pointer (test for errors, line 11) c-c++-common/ubsan/shift-5.c -O3 -fomit-frame-pointer (test for errors, line 14) c-c++-common/ubsan/shift-5.c -O3 -fomit-frame-pointer (test for errors, line 17) c-c++-common/ubsan/shift-5.c -O3 -fomit-frame-pointer (test for errors, line 20) c-c++-common/ubsan/shift-5.c -O3 -fomit-frame-pointer (test for errors, line 34) c-c++-common/ubsan/shift-5.c -O3 -fomit-frame-pointer (test for errors, line 37) c-c++-common/ubsan/shift-5.c -O3 -g (test for errors, line 11) c-c++-common/ubsan/shift-5.c -O3 -g (test for errors, line 14) c-c++-common/ubsan/shift-5.c -O3 -g (test for errors, line 17) c-c++-common/ubsan/shift-5.c -O3 -g (test for errors, line 20) c-c++-common/ubsan/shift-5.c -O3 -g (test for errors, line 34) c-c++-common/ubsan/shift-5.c -O3 -g (test for errors, line 37) c-c++-common/ubsan/shift-5.c -Os (test for errors, line 11) c-c++-common/ubsan/shift-5.c -Os (test for errors, line 14) c-c++-common/ubsan/shift-5.c -Os (test for errors, line 17) c-c++-common/ubsan/shift-5.c -Os (test for errors, line 20) c-c++-common/ubsan/shift-5.c -Os (test for errors, line 34) c-c++-common/ubsan/shift-5.c -Os (test for errors, line 37) Tests that now work, but didn't before: c-c++-common/ubsan/shift-5.c -O0 (test for errors, line 11) c-c++-common/ubsan/shift-5.c -O0 (test for errors, line 14) c-c++-common/ubsan/shift-5.c -O0 (test for errors, line 17) c-c++-common/ubsan/shift-5.c -O0 (test for errors, line 20) c-c++-common/ubsan/shift-5.c -O0 (test for errors, line 34) c-c++-common/ubsan/shift-5.c -O0 (test for errors, line 37) c-c++-common/ubsan/shift-5.c -O1 (test for errors, line 11) c-c++-common/ubsan/shift-5.c -O1 (test for errors, line 14) c-c++-common/ubsan/shift-5.c -O1 (test for errors, line 17) c-c++-common/ubsan/shift-5.c -O1 (test for errors, line 20) c-c++-common/ubsan/shift-5.c -O1 (test for errors, line 34) c-c++-common/ubsan/shift-5.c -O1 (test for errors, line 37) c-c++-common/ubsan/shift-5.c -O2 (test for errors, line 11) c-c++-common/ubsan/shift-5.c -O2 (test for errors, line 14) c-c++-common/ubsan/shift-5.c -O2 (test for errors, line 17) c-c++-common/ubsan/shift-5.c -O2 (test for errors, line 20) c-c++-common/ubsan/shift-5.c -O2 (test for errors, line 34) c-c++-common/ubsan/shift-5.c -O2 (test for errors, line 37) c-c++-common/ubsan/shift-5.c -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for errors, line 11) c-c++-common/ubsan/shift-5.c -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for errors, line 14) c-c++-common/ubsan/shift-5.c -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for errors, line 17) c-c++-common/ubsan/shift-5.c -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for errors, line 20) c-c++-common/ubsan/shift-5.c -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for errors, line 34) c-c++-common/ubsan/shift-5.c -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for errors, line 37) c-c++-common/ubsan/shift-5.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects (test for errors, line 11) c-c++-common/ubsan/shift-5.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects (test for errors, line 14) c-c++-common/ubsan/shift-5.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects (test for errors, line 17) c-c++-common/ubsan/shift-5.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects (test for errors, line 20) c-c++-common/ubsan/shift-5.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects (test for errors, line 34) c-c++-common/ubsan/shift-5.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects (test for errors, line 37) c-c++-common/ubsan/shift-5.c -O3 -fomit-frame-pointer (test for errors, line 11) c-c++-common/ubsan/shift-5.c -O3 -fomit-frame-pointer (test for errors, line 14) c-c++-common/ubsan/shift-5.c -O3 -fomit-frame-pointer (test for errors, line 17) c-c++-common/ubsan/shift-5.c -O3 -fomit-frame-pointer (test for errors, line 20) c-c++-common/ubsan/shift-5.c -O3 -fomit-frame-pointer (test for errors, line 34) c-c++-common/ubsan/shift-5.c -O3 -fomit-frame-pointer (test for errors, line 37) c-c++-common/ubsan/shift-5.c -O3 -g (test for errors, line 11) c-c++-common/ubsan/shift-5.c -O3 -g (test for errors, line 14) c-c++-common/ubsan/shift-5.c -O3 -g (test for errors, line 17) c-c++-common/ubsan/shift-5.c -O3 -g (test for errors, line 20) c-c++-common/ubsan/shift-5.c -O3 -g (test for errors, line 34) c-c++-common/ubsan/shift-5.c -O3 -g (test for errors, line 37) c-c++-common/ubsan/shift-5.c -Os (test for errors, line 11) c-c++-common/ubsan/shift-5.c -Os (test for errors, line 14) c-c++-common/ubsan/shift-5.c -Os (test for errors, line 17) c-c++-common/ubsan/shift-5.c -Os (test for errors, line 20) c-c++-common/ubsan/shift-5.c -Os (test for errors, line 34) c-c++-common/ubsan/shift-5.c -Os (test for errors, line 37)