Re: Failure with automated tests

[Vikas Mayur]

David, Thanks for bringing up this issue and indeed this is an area that need lot of contribution to make the whole bunch of test suite to a good level.

Robert (and anyone interested), For more information please refer to https://issues.apache.org/jira/browse/OFBIZ-1463 .

Vikas


On Feb 12, 2009, at 1:14 AM, David E Jones wrote:

-David


On Feb 11, 2009, at 10:50 AM, Vikas Mayur wrote:

Yes, that's a good point Vikas, about the "fresh data". One of the issues with the current tests and test infrastructure is cleanup after running, and tools to make cleanup easier too. For the current tests to run successfully you must have a fresh database with the OOTB demo data in place before testing each component. That means something like "ant clean-all; ant run- install; java -jar ofbiz.jar tests component=XXX; ant clean-all; ant run-install; java -jar ...; ...". There are quite a few things that have been discussed but either not developed or just not committed related to testing, so this is definitely an area that needs a lot of love! Since most things are ultimately driven by end-users of OFBiz it would help a lot if end- users pushed for these, but that has only happened approximately 3 times EVER for OFBiz AFAIK, as opposed to many hundreds (perhaps thousands) of times for other functionality and new features.

Well, All the tests supposed to be run successfully. If you see the logs, note that all the test are not failed. The only reason that I can think of is that In some cases, the data for all test cases are not defined properly. I mean few of the test case does not get the desired data and which is when changed by any earlier test causes them to fail.

Vikas

On Feb 11, 2009, at 4:45 AM, Robert Lor wrote:

Other reason could be recent changes in services that are being tested by test case. Also the whole automated test-suite is supposed to run with fresh data each time.

Hi,



1) svn co http://svn.apache.org/repos/asf/ofbiz/trunk ofbiz
2) setup db and modify entityengine.xml appropriately
2) ant run-install
3) java -jar ofbiz.jar -test






Thanks,
Robert
<test_log.tar.gz>

I tried running the automated tests to see if my setup is correct and noticed a number of failures. Here's what I did: Are all the tests supposed to run successfully out of the box or am I missing something in the setup? The errors are slightly different between Postgres & MySQL. Please see the output in the attached file.

smime.p7s
Description: S/MIME cryptographic signature