Jonathan, this progress is excellent news for anybody trying to actively
develop.
Beware of replacing jtreg though, Peter Jones warned there'd be no way
of confirming the regression tests actually worked on another test
framework, because the tests were created to simulate a bug / error,
repeatability was confirmed prior to fixing bugs. We'd have no way of
confirming the failure condition, unless we recreate the bug.
jtreg might be something we should schedule Hudson to run on a regular
basis.
Peter.
Jonathan Costers wrote:
Actually, not *all* tests, just all the categories I configured to run ..
But nearly all tho.
Categories that are still missing (not configured to run by Hudson for now):
- javaspace: found quite some issues running this category (see previous
report)
- txnmanager: one of these tests hangs on me .. finding out why, also some
other issues to work out
- scalability: not sure about the purpose of these tests
- end2end: one test needs Kerberos, for the others I get some other errors
And of course there's the regression tests we have in the jtreg directory.
I am experimenting to port these to either JUnit or QA tests, eventually
removing the dependency on the jtreg tool.
2010/9/17 Sim IJskes - QCG <[email protected]>
On 09/17/2010 11:31 AM, Jonathan Costers wrote:
On the Hudson ubuntu2 node:
[java] # of tests started = 1115
[java] # of tests completed = 1115
[java] # of tests skipped = 41
[java] # of tests passed = 1115
[java] # of tests failed = 0
[java]
[java] -----------------------------------------
[java]
[java] Date finished:
[java] Fri Sep 17 09:25:58 UTC 2010
[java] Time elapsed:
[java] 48907 seconds
[java]
Congrats!
Gr. Sim