This is a regression caused by me ( https://github.com/racket/rackunit/commit/d7665ddc17405b25c7365eda5c560b671340853d). I will try to find a way to fix.
On Thu, Feb 25, 2021 at 3:30 PM jackh...@gmail.com <jackhfi...@gmail.com> wrote: > The test-suite semantics in rackunit are complex, under-specified, and > quite brittle. I recommend avoiding them entirely and sticking entirely to > test cases and test-begin. > > On Monday, February 22, 2021 at 10:19:04 PM UTC-8 William J. Bowman wrote: > >> Below is an example that behaves "correctly", as in all tests run and are >> counted as failured or errors correctly, in Racket 7.8, but which crashes >> in >> Racket 8. >> >> > #lang racket >> > >> > (require >> > rackunit >> > rackunit/log) >> > >> > (define (suite1) >> > (test-suite >> > "" >> > (test-begin >> > (check-not-equal? (error "actual") (error "expected"))))) >> > >> > (define (suite2) >> > (test-suite >> > "" >> > (check-not-equal? (error "actual") (error "expected")))) >> > >> > (module+ test >> > (require rackunit/text-ui) >> > >> > ;; Correctly counts the tests as errors in 7.8 and 8.0 >> > (check-pred >> > integer? >> > (run-tests (suite1))) >> > >> > ;; Counts the tests as errors in 7.8, but crashes in 8.0 >> > (check-pred >> > integer? >> > (run-tests (suite2))) >> > >> > ;; Gets run in 7.8, but not in 8.0 >> > (check-equal? 0 0)) >> >> This has something to do with when test-suite delays a test, which seems >> inconsistent across the Racket versions. >> I'm not sure whether the problem was some undefined behaviour in >> test-suite or >> not. >> >> I'm a bit confused about the semantics of test-suites and tests, since >> the >> documentation claims a test (unlike a check) is delayed, yet test-case >> and >> test-begin do not delay tests, while test-suite does produce a delayed >> suite of >> tests. >> However, test-begin DOES seem to delay a test in the context of a >> test-suite. >> >> I'd appreciate any insight. >> >> -- >> William J. Bowman >> >> -- > You received this message because you are subscribed to the Google Groups > "Racket Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to racket-users+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/racket-users/73510d26-7405-4c0a-a0e3-1b06f77f3576n%40googlegroups.com > <https://groups.google.com/d/msgid/racket-users/73510d26-7405-4c0a-a0e3-1b06f77f3576n%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "Racket Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to racket-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/racket-users/CADcuegsoySbdyd_axOWUXjicijTYbS3-ZJQYkE3cntq_7wjaJQ%40mail.gmail.com.
