Unfortunately T13615 is indeed known to be fragile. This is tracked as #17269,
ss you discovered. This is especially scary given that the test tests some
rather subtle RTS logic. It's been on my list of things to investigate but
unfortunately I've not been able to reproduce the failure locally so progress
has been slow.
Given that it seems to fail fairly reliably on CI in some cases we probably
ought to mark it as fragile.
Note that it's not quite true that fragile test outcomes are no longer tracked.
We maintain a database of test outcomes from CI runs which includes both
passing and failing ribs of fragile tests. I've written about this
infrastructure here [1].
Cheers,
- Ben
[1] https://www.haskell.org/ghc/blog/20190708-testsuite-work.html
On October 9, 2019 4:45:57 AM EDT, Richard Eisenberg <[email protected]> wrote:
>Hi devs,
>
>https://gitlab.haskell.org/rae/ghc/-/jobs/173504
><https://gitlab.haskell.org/rae/ghc/-/jobs/173504> tells me that T13615
>failed -- but only in DEBUG mode. My patch is nowhere near this code.
>Is this a new fragile test?
>
>The number of fragile tests seems to be growing quickly. And once a
>test is labeled fragile, we're essentially no longer tracking the test,
>if I understand correctly. So that's a bit unfortunate.
>
>Thanks,
>Richard
--
Sent from my Android device with K-9 Mail. Please excuse my brevity.
_______________________________________________
ghc-devs mailing list
[email protected]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
