#5757: zero unexpected failures on all tier 1 platforms
---------------------------------+------------------------------------------
Reporter: simonmar | Owner:
Type: task | Status: new
Priority: highest | Milestone: 7.4.2
Component: Test Suite | Version: 7.2.1
Keywords: | Os: Unknown/Multiple
Architecture: Unknown/Multiple | Failure: None/Unknown
Difficulty: Unknown | Testcase:
Blockedby: | Blocking:
Related: #5785 |
---------------------------------+------------------------------------------
Comment(by nomeata):
Now most other Debian arches have build the testsuite
(https://buildd.debian.org/status/package.php?p=ghc-testsuite), here are
the results:
[https://buildd.debian.org/status/fetch.php?pkg=ghc-testsuite&arch
=kfreebsd-amd64&ver=7.4.1-3&stamp=1329221894 kfreebsd-amd64]:
{{{
OVERALL SUMMARY for test run started at Tue Feb 14 11:44:16 UTC 2012
3036 total tests, which gave rise to
11974 test cases, of which
0 caused framework failures
9215 were skipped
2706 expected passes
44 expected failures
0 unexpected passes
9 unexpected failures
Unexpected failures:
cabal ghcpkg01 [bad stderr] (normal)
codeGen/should_run cgrun025 [exit code non-0] (normal)
deriving/should_run T3087 [exit code non-0] (normal)
lib/Concurrent QSemN001 [bad exit code] (normal)
lib/Regex regex003 [exit code non-0] (normal)
perf/compiler T3064 [stat not good enough] (normal)
rts derefnull [bad stderr] (normal)
rts divbyzero [bad stderr] (normal)
rts exec_signals [bad stdout] (normal)
}}}
[https://buildd.debian.org/status/fetch.php?pkg=ghc-
testsuite&arch=kfreebsd-i386&ver=7.4.1-3&stamp=1329218147 kfreebsd-i386]:
{{{
OVERALL SUMMARY for test run started at Tue Feb 14 09:30:59 UTC 2012
3036 total tests, which gave rise to
11974 test cases, of which
0 caused framework failures
9216 were skipped
2707 expected passes
43 expected failures
0 unexpected passes
8 unexpected failures
Unexpected failures:
cabal ghcpkg05 [bad stderr] (normal)
codeGen/should_run cgrun025 [exit code non-0] (normal)
deriving/should_run T3087 [exit code non-0] (normal)
lib/Concurrent QSemN001 [bad exit code] (normal)
lib/Regex regex003 [exit code non-0] (normal)
rts derefnull [bad stderr] (normal)
rts divbyzero [bad stderr] (normal)
rts exec_signals [bad stdout] (normal)
}}}
[https://buildd.debian.org/status/fetch.php?pkg=ghc-
testsuite&arch=mips&ver=7.4.1-3&stamp=1329221065 mips]:
{{{
OVERALL SUMMARY for test run started at Tue Feb 14 09:42:34 UTC 2012
3035 total tests, which gave rise to
6890 test cases, of which
0 caused framework failures
4479 were skipped
2318 expected passes
68 expected failures
1 unexpected passes
24 unexpected failures
Unexpected passes:
quasiquotation T5204 (normal)
Unexpected failures:
cabal/cabal04 cabal04 [bad exit code] (normal)
codeGen/should_run cgrun025 [exit code non-0] (normal)
deriving/should_run T3087 [exit code non-0] (normal)
driver 5313 [exit code non-0] (normal)
driver/recomp009 recomp009 [bad exit code] (normal)
ghc-api/dynCompileExpr dynCompileExpr [exit code non-0] (normal)
ghci/linking ghcilink001 [bad exit code] (normal)
ghci/linking ghcilink002 [bad exit code] (normal)
ghci/linking ghcilink003 [bad exit code] (normal)
ghci/linking ghcilink004 [bad exit code] (normal)
ghci/linking ghcilink005 [bad exit code] (normal)
ghci/linking ghcilink006 [bad exit code] (normal)
lib/Concurrent QSemN001 [bad exit code] (normal)
lib/Regex regex003 [exit code non-0] (normal)
perf/compiler T4801 [stat too good] (normal)
perf/should_run 3586 [exit code non-0] (normal)
perf/should_run T3736 [bad stderr] (normal)
profiling/should_run T5559 [bad heap profile] (profasm)
rts 4850 [bad exit code] (normal)
rts T2615 [exit code non-0] (normal)
rts T5423 [bad stderr] (normal)
safeHaskell/safeLanguage SafeLang01 [stderr mismatch] (normal)
safeHaskell/safeLanguage SafeLang12 [stderr mismatch] (normal)
safeHaskell/safeLanguage SafeLang16 [stderr mismatch] (normal)
}}}
[https://buildd.debian.org/status/fetch.php?pkg=ghc-
testsuite&arch=mipsel&ver=7.4.1-3&stamp=1329324159 mipsel]:
{{{
OVERALL SUMMARY for test run started at Wed Feb 15 13:53:55 UTC 2012
3035 total tests, which gave rise to
6890 test cases, of which
0 caused framework failures
4479 were skipped
2319 expected passes
68 expected failures
1 unexpected passes
23 unexpected failures
Unexpected passes:
quasiquotation T5204 (normal)
Unexpected failures:
cabal/cabal04 cabal04 [bad exit code] (normal)
codeGen/should_run cgrun025 [exit code non-0] (normal)
deriving/should_run T3087 [exit code non-0] (normal)
driver 5313 [exit code non-0] (normal)
driver/recomp009 recomp009 [bad exit code] (normal)
ghc-api/dynCompileExpr dynCompileExpr [exit code non-0] (normal)
ghci/linking ghcilink001 [bad exit code] (normal)
ghci/linking ghcilink002 [bad exit code] (normal)
ghci/linking ghcilink003 [bad exit code] (normal)
ghci/linking ghcilink004 [bad exit code] (normal)
ghci/linking ghcilink005 [bad exit code] (normal)
ghci/linking ghcilink006 [bad exit code] (normal)
lib/Concurrent QSemN001 [bad exit code] (normal)
lib/Regex regex003 [exit code non-0] (normal)
perf/compiler T4801 [stat too good] (normal)
perf/should_run 3586 [exit code non-0] (normal)
perf/should_run T3736 [bad stderr] (normal)
rts 4850 [bad exit code] (normal)
rts T2615 [exit code non-0] (normal)
rts T5423 [bad stderr] (normal)
safeHaskell/safeLanguage SafeLang01 [stderr mismatch] (normal)
safeHaskell/safeLanguage SafeLang12 [stderr mismatch] (normal)
safeHaskell/safeLanguage SafeLang16 [stderr mismatch] (normal)
}}}
[https://buildd.debian.org/status/fetch.php?pkg=ghc-
testsuite&arch=powerpc&ver=7.4.1-3&stamp=1329212675 powerpc]:
{{{
OVERALL SUMMARY for test run started at Tue Feb 14 09:22:58 UTC 2012
3035 total tests, which gave rise to
11065 test cases, of which
0 caused framework failures
8591 were skipped
2381 expected passes
68 expected failures
1 unexpected passes
24 unexpected failures
Unexpected passes:
quasiquotation T5204 (normal)
Unexpected failures:
cabal/cabal04 cabal04 [bad exit code] (normal)
codeGen/should_compile massive_array [exit code non-0] (normal)
codeGen/should_run cgrun025 [exit code non-0] (normal)
codeGen/should_run cgrun071 [bad exit code] (normal)
deriving/should_run T3087 [exit code non-0] (normal)
driver 5313 [exit code non-0] (normal)
driver/recomp009 recomp009 [bad exit code] (normal)
ghc-api/dynCompileExpr dynCompileExpr [exit code non-0] (normal)
ghci/linking ghcilink001 [bad exit code] (normal)
ghci/linking ghcilink002 [bad exit code] (normal)
ghci/linking ghcilink003 [bad exit code] (normal)
ghci/linking ghcilink004 [bad exit code] (normal)
ghci/linking ghcilink005 [bad exit code] (normal)
ghci/linking ghcilink006 [bad exit code] (normal)
lib/Concurrent QSemN001 [bad exit code] (normal)
lib/Regex regex003 [exit code non-0] (normal)
numeric/should_run arith011 [bad exit code] (normal)
perf/compiler T1969 [stat not good enough] (normal)
perf/compiler T4801 [stat not good enough] (normal)
rts T2615 [exit code non-0] (normal)
rts divbyzero [bad exit code] (normal)
safeHaskell/safeLanguage SafeLang01 [stderr mismatch] (normal)
safeHaskell/safeLanguage SafeLang12 [stderr mismatch] (normal)
safeHaskell/safeLanguage SafeLang16 [stderr mismatch] (normal)
}}}
[https://buildd.debian.org/status/fetch.php?pkg=ghc-
testsuite&arch=s390&ver=7.4.1-3&stamp=1329214953 s390]:
{{{
OVERALL SUMMARY for test run started at Tue Feb 14 09:23:42 UTC 2012
3035 total tests, which gave rise to
6890 test cases, of which
0 caused framework failures
4479 were skipped
2317 expected passes
68 expected failures
1 unexpected passes
25 unexpected failures
Unexpected passes:
quasiquotation T5204 (normal)
Unexpected failures:
cabal/cabal04 cabal04 [bad exit code] (normal)
codeGen/should_run cgrun025 [exit code non-0] (normal)
codeGen/should_run cgrun071 [bad exit code] (normal)
deriving/should_run T3087 [exit code non-0] (normal)
driver 5313 [exit code non-0] (normal)
driver/recomp009 recomp009 [bad exit code] (normal)
ghc-api/dynCompileExpr dynCompileExpr [exit code non-0] (normal)
ghci/linking ghcilink001 [bad exit code] (normal)
ghci/linking ghcilink002 [bad exit code] (normal)
ghci/linking ghcilink003 [bad exit code] (normal)
ghci/linking ghcilink004 [bad exit code] (normal)
ghci/linking ghcilink005 [bad exit code] (normal)
ghci/linking ghcilink006 [bad exit code] (normal)
lib/Concurrent QSemN001 [bad exit code] (normal)
lib/Regex regex003 [exit code non-0] (normal)
perf/compiler T4801 [stat too good] (normal)
perf/should_run 3586 [exit code non-0] (normal)
perf/should_run T3736 [bad stderr] (normal)
rts 4850 [bad exit code] (normal)
rts T2615 [exit code non-0] (normal)
rts T5423 [bad stderr] (normal)
rts testblockalloc [bad exit code] (normal)
safeHaskell/safeLanguage SafeLang01 [stderr mismatch] (normal)
safeHaskell/safeLanguage SafeLang12 [stderr mismatch] (normal)
safeHaskell/safeLanguage SafeLang16 [stderr mismatch] (normal)
}}}
[https://buildd.debian.org/status/fetch.php?pkg=ghc-
testsuite&arch=s390x&ver=7.4.1-3&stamp=1329212908 s390x]:
{{{
OVERALL SUMMARY for test run started at Tue Feb 14 09:22:45 UTC 2012
3035 total tests, which gave rise to
6890 test cases, of which
0 caused framework failures
4479 were skipped
2317 expected passes
68 expected failures
1 unexpected passes
25 unexpected failures
Unexpected passes:
quasiquotation T5204 (normal)
Unexpected failures:
cabal/cabal04 cabal04 [bad exit code] (normal)
codeGen/should_run cgrun025 [exit code non-0] (normal)
codeGen/should_run cgrun071 [bad exit code] (normal)
deriving/should_run T3087 [exit code non-0] (normal)
driver 5313 [exit code non-0] (normal)
driver/recomp009 recomp009 [bad exit code] (normal)
ghc-api/dynCompileExpr dynCompileExpr [exit code non-0] (normal)
ghci/linking ghcilink001 [bad exit code] (normal)
ghci/linking ghcilink002 [bad exit code] (normal)
ghci/linking ghcilink003 [bad exit code] (normal)
ghci/linking ghcilink004 [bad exit code] (normal)
ghci/linking ghcilink005 [bad exit code] (normal)
ghci/linking ghcilink006 [bad exit code] (normal)
lib/Concurrent QSemN001 [bad exit code] (normal)
lib/Regex regex003 [exit code non-0] (normal)
perf/compiler T4801 [stat too good] (normal)
perf/should_run 3586 [exit code non-0] (normal)
perf/should_run T3736 [bad stderr] (normal)
perf/space_leaks space_leak_001 [stat not good enough]
(normal)
rts 4850 [bad exit code] (normal)
rts T2615 [exit code non-0] (normal)
rts T5423 [bad stderr] (normal)
safeHaskell/safeLanguage SafeLang01 [stderr mismatch] (normal)
safeHaskell/safeLanguage SafeLang12 [stderr mismatch] (normal)
safeHaskell/safeLanguage SafeLang16 [stderr mismatch] (normal)
}}}
[https://buildd.debian.org/status/fetch.php?pkg=ghc-
testsuite&arch=sparc&ver=7.4.1-3&stamp=1329226342 sparc]:
{{{
OVERALL SUMMARY for test run started at Tue Feb 14 09:32:35 UTC 2012
3036 total tests, which gave rise to
7795 test cases, of which
0 caused framework failures
5100 were skipped
2617 expected passes
44 expected failures
0 unexpected passes
34 unexpected failures
Unexpected failures:
codeGen/should_run cgrun025 [exit code non-0] (normal)
codeGen/should_run cgrun057 [bad exit code] (profasm)
codeGen/should_run cgrun071 [bad exit code] (normal)
deriving/should_run T3087 [exit code non-0] (normal)
ghci/should_run 3171 [bad stdout] (normal)
lib/Concurrent QSemN001 [bad exit code] (normal)
lib/Regex regex003 [exit code non-0] (normal)
perf/compiler T4801 [stat too good] (normal)
perf/should_run 3586 [exit code non-0] (normal)
perf/should_run T3736 [bad stderr] (normal)
perf/space_leaks space_leak_001 [bad exit code] (normal)
profiling/should_compile prof001 [bad exit code] (normal)
profiling/should_compile prof002 [bad exit code] (normal)
profiling/should_run 2592 [bad exit code] (profasm)
profiling/should_run 5314 [bad exit code] (profasm)
profiling/should_run T2552 [bad exit code] (profasm)
profiling/should_run T3001 [bad exit code] (prof_hb)
profiling/should_run T3001-2 [bad exit code] (prof_hb)
profiling/should_run T5363 [bad exit code] (profasm)
profiling/should_run T5559 [bad exit code] (profasm)
profiling/should_run T680 [bad exit code] (profasm)
profiling/should_run T949 [bad exit code] (profasm)
profiling/should_run callstack001 [bad exit code] (profasm)
profiling/should_run callstack002 [bad exit code] (profasm)
profiling/should_run heapprof001 [bad exit code] (profasm)
profiling/should_run ioprof [bad exit code] (profasm)
profiling/should_run prof-doc-fib [bad exit code] (profasm)
profiling/should_run prof-doc-last [bad exit code] (profasm)
profiling/should_run scc001 [bad exit code] (profasm)
profiling/should_run scc002 [bad exit code] (profasm)
profiling/should_run scc003 [bad exit code] (profasm)
rts 4850 [bad exit code] (normal)
rts T5423 [bad stderr] (normal)
th TH_spliceE5_prof [bad exit code] (normal)
}}}
It seems most of the failures happing on non-IA-architectures are due to
the missing support for Template Haskell, and tests not declaring this
dependency properly.
--
Ticket URL: <http://hackage.haskell.org/trac/ghc/ticket/5757#comment:14>
GHC <http://www.haskell.org/ghc/>
The Glasgow Haskell Compiler
_______________________________________________
Glasgow-haskell-bugs mailing list
Glasgow-haskell-bugs@haskell.org
http://www.haskell.org/mailman/listinfo/glasgow-haskell-bugs
