Re: [Dev] [G-Reg][integration-testing] Interleaving test classes

2014-07-14 Thread Krishantha Samaraweera
We had a debug session to find the root cause. The issue with incorrect usage with depends on annotation in SchemaAddTestCase. Only one test case depends on another case and rest of the test case execution happened in random order. After putting depends on annotation and getting the tests to run

Re: [Dev] [G-Reg][integration-testing] Interleaving test classes

2014-07-14 Thread Tania Mahanama
Noted. Thanks, Tania On Mon, Jul 14, 2014 at 6:44 PM, Krishantha Samaraweera krishan...@wso2.com wrote: We had a debug session to find the root cause. The issue with incorrect usage with depends on annotation in SchemaAddTestCase. Only one test case depends on another case and rest of

Re: [Dev] [G-Reg][integration-testing] Interleaving test classes

2014-07-11 Thread Krishantha Samaraweera
Hi Sameera, It will take bit of time to detect root cause of this problem. So can you disable the interleaving test cases and create TA JIRA to track it. Thanks, Krishantha. On Fri, Jul 11, 2014 at 12:12 AM, Krishantha Samaraweera krishan...@wso2.com wrote: Hi all, You can find reasons

Re: [Dev] [G-Reg][integration-testing] Interleaving test classes

2014-07-11 Thread Sameera Kannangara
HI Krishantha, Please find TA JIRA created at [1] https://wso2.org/jira/browse/TA-857. We will exclude test failing due to interleaving, when taking test summaries. Thank you, SameeraK [1] https://wso2.org/jira/browse/TA-857 On Fri, Jul 11, 2014 at 12:57 PM, Krishantha Samaraweera

[Dev] [G-Reg][integration-testing] Interleaving test classes

2014-07-10 Thread Sameera Kannangara
Hi all, When running G-Reg tests I've encountered several test cases which passes when the containing class executed individually and fails when tests are run as packages. Following are few examples. deleteResources(org.wso2.carbon.registry.metadata.test.schema.SchemaAddTestCase)

Re: [Dev] [G-Reg][integration-testing] Interleaving test classes

2014-07-10 Thread Subash Chaturanga
Adding Krishantha On Thu, Jul 10, 2014 at 3:57 PM, Sameera Kannangara samee...@wso2.com wrote: Hi all, When running G-Reg tests I've encountered several test cases which passes when the containing class executed individually and fails when tests are run as packages. Following are few

Re: [Dev] [G-Reg][integration-testing] Interleaving test classes

2014-07-10 Thread Krishantha Samaraweera
Hi all, You can find reasons for this kind of intermittent issue at TAF wiki - http://docs.wso2.com/display/TA430/FAQ#FAQ-Whydoesmytestmodulecontainintermittenttestfailures? I suspect this issue is something to do with test resource cleanup. Need to check run all tests and do extensive debug