Hi,
somewhere between automake-1.11 and automake-1.14 the default for handling
"make check" changed from "serial-tests" to "parallel-tests" - which
sounds harmless, but has the interesting side effect of hiding the output
of all (potentially parallel-run) test scripts until the summary at the
end, and even then, only printing the summary, not the detail output.
I can see that this looks much more pretty (and colours, wooh!), but
for my day-to-day regression testing and for analyzing buildbot failures,
this just adds extra steps to figure out what it is doing right now, and
where and why it failed this time - especially in the buildbot case, the
difference is "the reason is right in the mail" vs "I need to login to
the buildbot machine, go to the right build directory (of many), and
grab the log file from there".
Fortunately, there is an automake option for this, which I'd propose to
enable... (well hidden inside "info automake-1.14" -> "Options")
Running the tests in serial and having the failures show up in buildbot
emails makes sense to me. Consider this a feature-ACK.
--
Samuli Seppänen
Community Manager
OpenVPN Technologies, Inc
irc freenode net: mattock
