Anyone have info or preferences on what are good output conventions for Racket package embedded unit tests?  (For use with all of: `raco test`, package catalog and other builds, DrRacket and other IDEs?)

I intend to reimplement Overeasy ("";) in a way that is even more lightweight in both ease-of-use and in implementation. The syntax and features will be very similar, for now (there's one innovative big feature I might add later), but what I'm not yet sure about is all the details of the output.

For output, here's what I'm currently thinking:

* Most test messages other than fails are sent to logger `debug@test`.

* A test failing unexpectedly (or succeeding unexpectedly) results in a message to stderr.

* Should such a failing message also have some way of click navigating to the test failure in DrRacket, like for exceptions? (Note that the answer to the next might be involved.)

* Should the first failing test raise `exn:fail?`?  Or should `exn:fail?` be raised at the end of all a module's tests if any failed?  Or should `exn:fail?` not be raised at all by the tests?

* Should a test *failing expectedly* (as marked with `:fail`) also result in a message to stderr?  Maybe a `warning@test` logger is better?  (Note that, IIRC, the package catalog will regard output as a failure of tests for the package.  Which can remind us that there is `:fail`, but can also discourage the programmer/qa capturing and tracking the info about the expected-fail tests.)

* For the test-failure messages to stderr, what textual format should they have?  More like the current Racket exception format, or current RackUnit, or Overeasy?  (Or is there a pressing need for a different format?)

You received this message because you are subscribed to the Google Groups "Racket 
Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
For more options, visit

Reply via email to