RE: ./validate --slow results

[Ben Gamari]

Simon Peyton Jones via ghc-devs  writes:

> Wow... 97 unexpected failures is bad.
>
> Ben/David/someone else: might you investigate/characterise them?
>
I periodically run --slow and have opened a number of tickets in
response in the past (#11819 being the one I was able to easily find).
Bartosz, perhaps you could add a comment to that ticket with your
results?

David, do you think you could take a few hours to go through the failing
tests and classify them thematically?

Cheers,

- Ben



signature.asc
Description: PGP signature
___
ghc-devs mailing list
ghc-devs@haskell.org
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs

RE: ./validate --slow results

[Simon Peyton Jones via ghc-devs]

Wow... 97 unexpected failures is bad.

Ben/David/someone else: might you investigate/characterise them?

Simon

|  -Original Message-
|  From: ghc-devs [mailto:ghc-devs-boun...@haskell.org] On Behalf Of Bartosz
|  Nitka
|  Sent: 14 September 2017 13:57
|  To: ghc-devs Devs 
|  Subject: ./validate --slow results
|  
|  Hi all,
|  
|  I happened to run ./validate --slow on my linux machine and I thought it
|  would be useful to share the results.
|  
|  Results:
|  
|  Unexpected results from:
|  TEST="EtaExpandLevPoly PatternSplice StrictPats T10508_api T11627b
|  T12809 T12870a T12870b T12870c T12870d T12870e T12870f T12870g T12870h
|  T12903 T12962 T13366 T13543 T13688 T13780c T13822 T13949 T14137 T2552
|  T2783 T3001-2 T4114c T4114d T4188 T4334 T5129 T5363 T5559 T5611 T680
|  T7411 T7837 T7944 T8025 T8089 T8542 TH_spliceE5_prof_ext UnsafeReenter
|  compact_gc compact_share dsrun014 dynamic-paper haddock.Cabal hpc_fork prof-
|  doc-fib prof-doc-last profinline001 read029 return_mem_to_os
|  rn041 scc001 scc002 scc003 scc005 space_leak_001 tc165 tryReadMVar2"
|  
|  SUMMARY for test run started at Thu Sep 14 04:57:20 2017 PDT
|   0:12:27 spent to go through
|  6091 total tests, which gave rise to
| 24105 test cases, of which
|  4531 were skipped
|  
|   143 had missing libraries
| 19120 expected passes
|   203 expected failures
|  
| 0 caused framework failures
| 0 caused framework warnings
| 6 unexpected passes
|97 unexpected failures
| 5 unexpected stat failures
|  
|  Unexpected passes:
| /tmp/ghctest-e17wqi8b/test
|  spaces/./dependent/should_compile/dynamic-paper.run  dynamic-paper
|  [unexpected] (optasm)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./indexed-types/should_compile/T7837.run  T7837
|  [unexpected] (profasm)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./parser/should_compile/read029.run   read029
|  [unexpected] (optasm)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./rename/should_compile/rn041.run rn041
|  [unexpected] (optasm)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./simplCore/should_fail/T7411.run T7411
|  [unexpected] (hpc)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./typecheck/should_compile/tc165.run  tc165
|  [unexpected] (optasm)
|  
|  Unexpected failures:
| /tmp/ghctest-e17wqi8b/test   spaces/./codeGen/should_run/T5129.run
|   T5129 [bad exit code] (hpc)
| /tmp/ghctest-e17wqi8b/test   spaces/./codeGen/should_run/T5129.run
|   T5129 [bad exit code] (optasm)
| /tmp/ghctest-e17wqi8b/test   spaces/./codeGen/should_run/T5129.run
|   T5129 [bad exit code] (threaded2)
| /tmp/ghctest-e17wqi8b/test   spaces/./codeGen/should_run/T5129.run
|   T5129 [bad exit code] (dyn)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./concurrent/should_run/T5611.runT5611 [bad
|  stdout] (ghci)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./concurrent/should_run/tryReadMVar2.run
|  tryReadMVar2 [bad heap profile] (profasm)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./deSugar/should_run/dsrun014.rundsrun014
|  [bad stderr] (hpc)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./deSugar/should_run/dsrun014.rundsrun014
|  [bad stderr] (optasm)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./deSugar/should_run/dsrun014.rundsrun014
|  [bad stderr] (threaded2)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./deSugar/should_run/dsrun014.rundsrun014
|  [bad stderr] (dyn)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./dependent/should_fail/T13780c.run  T13780c
|  [stderr mismatch] (normal)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./dependent/should_compile/dynamic-paper.run
|  dynamic-paper [exit code non-0] (profasm)
| /tmp/ghctest-e17wqi8b/test   spaces/./driver/T4114d.run
|   T4114d [bad exit code] (ghci)
| /tmp/ghctest-e17wqi8b/test   spaces/./driver/T4114c.run
|   T4114c [bad exit code] (ghci)
| /tmp/ghctest-e17wqi8b/test   spaces/./ghc-api/T10508_api.run
|   T10508_api [bad exit code] (profasm)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./numeric/should_compile/T8542.run   T8542
|  [stderr mismatch] (hpc)
| /tmp/ghctest-e17wqi8b/test   spaces/./ghc-api/T10508_api.run
|   T10508_api [bad exit code] (profthreaded)
| /tmp/ghctest-e17wqi8b/test
|  spaces/./partial-sigs/should_compile/PatternSplice.run
|  PatternSplice [exit code non-0] (profasm)
| /tmp/ghctest-e17wqi8b/test   spaces/./patsyn/should_run/T13688.run
|   T13688 [exit code non-0] (profasm)
| /tmp/ghctest-e17wqi8b/test   spaces/./patsyn/should_run/T13688.run
|   T13688 [exit code non-0] (profthreaded)
| /tmp/ghctest-e17wqi8b/test
|