Ideally, tests should not worry about any ordering of the run time engine which invokes them as they should be independent of each other. The tests involves multiple test methods (if any) need to be combined to form a single unit of test(s) so that what ever ordering (or any context switching etc...) would not interfere the result of the test.
Anyway I'm doing another build with the changes from Subash, let's see... On Wed, Apr 4, 2012 at 9:48 PM, Subash Chaturanga <[email protected]> wrote: > > > On Wed, Apr 4, 2012 at 8:20 PM, Afkham Azeez <[email protected]> wrote: > >> >> >> On Wed, Apr 4, 2012 at 5:23 PM, Senaka Fernando <[email protected]> wrote: >> >>> Hi Subash, Vijitha, >>> >>> If possible also try to find the ordering of this on Bamboo and when we >>> build. I have a feeling that Bamboo is running this in some other order. >>> >> > Senaka, I don't think it is a defined order. We can order a set of tests > by adding dependencies (which we already does in GReg testng stuff), and > other than those, AFAIK for testng, its a set of 200+ individual pieces to > run randomly. BTW, is $subject hits in builder machine ? > > >> >> > The order in which tests are executed should not determine the outcome of >> the test, ideally. However, if you want to order tests, you can use the >> "dependsOn" attribute of the @Test annotation. >> > > Yes Azeez, we already using that only in necessary places. For instance in > service test cases the edit service test depends on add service test and > etc. > > Senaka, If order really matters (which is a possible in this case), there > is only *one way to overcome this issue (which will make sure there will be > no failures occur based on the ordering in future.), that is to add > dependencies to each and every methods within each test case (then this > will be similar to the JUnit test class behavior). Because GReg didn't face > such random failures in JUnit time. WDYT ? > > Thanks > . > >> >>> Thanks, >>> Senaka. >>> >>> >>> On Wed, Apr 4, 2012 at 2:00 PM, Vijitha Kumara <[email protected]> wrote: >>> >>>> > Schema Test has excluded not from the pom but from the test class >>>> itself by removing annotations. >>>> >>>> wasn't aware of that, will do as suggested. >>>> >>>> On Wed, Apr 4, 2012 at 1:55 PM, Senaka Fernando <[email protected]>wrote: >>>> >>>>> >>>>> >>>>> On Wed, Apr 4, 2012 at 1:54 PM, Subash Chaturanga <[email protected]>wrote: >>>>> >>>>>> >>>>>> >>>>>> On Wed, Apr 4, 2012 at 1:41 PM, Senaka Fernando <[email protected]>wrote: >>>>>> >>>>>>> Hi Vijitha, >>>>>>> >>>>>>> It should include 233 test cases, IIRC, and you will have to >>>>>>> uncomment the ones that are excluded before you build. >>>>>>> >>>>>> >>>>>> Schema Test has excluded not from the pom but from the test class >>>>>> itself by removing annotations. Seems that is the one missing which has >>>>>> 3,4 >>>>>> test cases. >>>>>> >>>>> >>>>> Oh, that's not done right who ever did that, :(.. >>>>> >>>>> >>>>>> I have refactored it and excluded from the pom. >>>>>> >>>>> >>>>> Great. >>>>> >>>>>> >>>>>> Vijitha, take an up in the integration module, and then remove all >>>>>> excluded stuff locally and build again. Then you'll get #233. >>>>>> BTW, I also able to build all the tests on a full svn up. >>>>>> >>>>> >>>>> +1 >>>>> >>>>> Thanks, >>>>> Senaka. >>>>> >>>>>> >>>>>> >>>>>>> Thanks, >>>>>>> Senaka. >>>>>>> >>>>>>> >>>>>>> On Wed, Apr 4, 2012 at 1:35 PM, Vijitha Kumara <[email protected]>wrote: >>>>>>> >>>>>>>> > I think you did this on a clean repo ? Can you try running all >>>>>>>> 200+ integration tests and check, instead of running only those two ? >>>>>>>> >>>>>>>> Initial build also contained all the 230 tests in GReg as the >>>>>>>> report indicates. >>>>>>>> >>>>>>>> But I'm now trying with including all other products as well to see >>>>>>>> whether it makes any difference. >>>>>>>> >>>>>>>> Regards, >>>>>>>> >>>>>>>> On Tue, Apr 3, 2012 at 5:48 PM, Subash Chaturanga >>>>>>>> <[email protected]>wrote: >>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> On Tue, Apr 3, 2012 at 5:37 PM, Vijitha Kumara >>>>>>>>> <[email protected]>wrote: >>>>>>>>> >>>>>>>>>> All, >>>>>>>>>> >>>>>>>>>> All the tests related to these two classes passed. Attached the >>>>>>>>>> surefire report with this. >>>>>>>>>> >>>>>>>>> >>>>>>>>> Hi Vijitha, >>>>>>>>> >>>>>>>>> I think you did this on a clean repo ? Can you try running all >>>>>>>>> 200+ integration tests and check, instead of running only those two ? >>>>>>>>> >>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> Regards, >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Tue, Apr 3, 2012 at 8:52 AM, Vijitha Kumara >>>>>>>>>> <[email protected]>wrote: >>>>>>>>>> >>>>>>>>>>> Had an issue with the build, Mail @Dev "Platform build error". >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Tue, Apr 3, 2012 at 8:49 AM, Subash Chaturanga < >>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Tue, Apr 3, 2012 at 3:53 AM, Senaka Fernando < >>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi Vijitha/Subash, >>>>>>>>>>>>> >>>>>>>>>>>>> Any update on this? >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> Vijitha was building this on a clean repo. Vijitha , were you >>>>>>>>>>>> able to reproduce this ? >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> Thanks, >>>>>>>>>>>>> Senaka. >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> On Sun, Apr 1, 2012 at 8:10 PM, Vijitha Kumara < >>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> I'm looking into this. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Regards, >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Fri, Mar 30, 2012 at 8:33 PM, Senaka Fernando < >>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Hi Subash, Vijitha, >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Please test this on a clean M2 repo, and before you start to >>>>>>>>>>>>>>> compile edit the POM in the integration tests for G-Reg and >>>>>>>>>>>>>>> make sure you >>>>>>>>>>>>>>> enable the excluded tests. If we can reproduce this issue, it >>>>>>>>>>>>>>> shouldn't be >>>>>>>>>>>>>>> hard figure out how this broke. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>> Senaka. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Fri, Mar 30, 2012 at 8:12 PM, Senaka Fernando < >>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hi all, >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> I have moved it. The new issue can be accessed from >>>>>>>>>>>>>>>> https://wso2.org/jira/browse/CARBON-12758, and also the >>>>>>>>>>>>>>>> old issue ID. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>> Senaka. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Fri, Mar 30, 2012 at 7:53 PM, Sameera Jayasoma < >>>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> +1. Senaka, please create these issues under CARBON >>>>>>>>>>>>>>>>> project as L1s. Otherwise, its hard to track these stuff. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>> Sameera. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> On Fri, Mar 30, 2012 at 7:10 PM, Charitha Kankanamge < >>>>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Hi Senaka, >>>>>>>>>>>>>>>>>> Should not these failures reported as CARBON jira instead >>>>>>>>>>>>>>>>>> of product specific JIRA? Have we changed our process of >>>>>>>>>>>>>>>>>> reporting JIRAs in >>>>>>>>>>>>>>>>>> C4 release? Or am I missing something? >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>>> Charitha >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> On Friday, March 30, 2012, Senaka Fernando wrote: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> FYI, https://wso2.org/jira/browse/REGISTRY-717 >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>>>> Senaka. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> On Fri, Mar 30, 2012 at 5:35 PM, Senaka Fernando < >>>>>>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> Hi Subash, >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> Can you have a look into this? I tried this out with a >>>>>>>>>>>>>>>>>>>> build starting from orbit -> kernel -> platform, and was >>>>>>>>>>>>>>>>>>>> unable to >>>>>>>>>>>>>>>>>>>> reproduce. >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>>>>> Senaka. >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>>>>>> *Senaka Fernando* >>>>>>>>>>>>>>>>>>>> Product Manager - WSO2 Governance Registry; >>>>>>>>>>>>>>>>>>>> Associate Technical Lead; WSO2 Inc.; http://wso2.com* >>>>>>>>>>>>>>>>>>>> Member; Apache Software Foundation; http://apache.org >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> E-mail: senaka AT wso2.com >>>>>>>>>>>>>>>>>>>> **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 >>>>>>>>>>>>>>>>>>>> Linked-In: http://linkedin.com/in/senakafernando >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> *Lean . Enterprise . Middleware >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>>>>> *Senaka Fernando* >>>>>>>>>>>>>>>>>>> Product Manager - WSO2 Governance Registry; >>>>>>>>>>>>>>>>>>> Associate Technical Lead; WSO2 Inc.; http://wso2.com* >>>>>>>>>>>>>>>>>>> Member; Apache Software Foundation; http://apache.org >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> E-mail: senaka AT wso2.com >>>>>>>>>>>>>>>>>>> **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 >>>>>>>>>>>>>>>>>>> Linked-In: http://linkedin.com/in/senakafernando >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> *Lean . Enterprise . Middleware >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>>>> Charitha Kankanamge >>>>>>>>>>>>>>>>>> cell: +94 718 359 265 >>>>>>>>>>>>>>>>>> blog: http://charithaka.blogspot.com <http://wso2.com> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> _______________________________________________ >>>>>>>>>>>>>>>>>> Dev mailing list >>>>>>>>>>>>>>>>>> [email protected] >>>>>>>>>>>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>>> Sameera Jayasoma >>>>>>>>>>>>>>>>> Technical Lead and Product Manager, WSO2 Carbon >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> WSO2, Inc. (http://wso2.com) >>>>>>>>>>>>>>>>> email: [email protected] >>>>>>>>>>>>>>>>> blog: http://tech.jayasoma.org >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Lean . Enterprise . Middleware >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>> *Senaka Fernando* >>>>>>>>>>>>>>>> Product Manager - WSO2 Governance Registry; >>>>>>>>>>>>>>>> Associate Technical Lead; WSO2 Inc.; http://wso2.com* >>>>>>>>>>>>>>>> Member; Apache Software Foundation; http://apache.org >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> E-mail: senaka AT wso2.com >>>>>>>>>>>>>>>> **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 >>>>>>>>>>>>>>>> Linked-In: http://linkedin.com/in/senakafernando >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> *Lean . Enterprise . Middleware >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>> *Senaka Fernando* >>>>>>>>>>>>>>> Product Manager - WSO2 Governance Registry; >>>>>>>>>>>>>>> Associate Technical Lead; WSO2 Inc.; http://wso2.com* >>>>>>>>>>>>>>> Member; Apache Software Foundation; http://apache.org >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> E-mail: senaka AT wso2.com >>>>>>>>>>>>>>> **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 >>>>>>>>>>>>>>> Linked-In: http://linkedin.com/in/senakafernando >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> *Lean . Enterprise . Middleware >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> -- >>>>>>>>>>>>>> Vijitha Kumara >>>>>>>>>>>>>> Senior Software Engineer; WSO2, Inc.; http://wso2.com/ >>>>>>>>>>>>>> email: [email protected] >>>>>>>>>>>>>> >>>>>>>>>>>>>> Lean . Enterprise . Middleware >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>>> *Senaka Fernando* >>>>>>>>>>>>> Product Manager - WSO2 Governance Registry; >>>>>>>>>>>>> Associate Technical Lead; WSO2 Inc.; http://wso2.com* >>>>>>>>>>>>> Member; Apache Software Foundation; http://apache.org >>>>>>>>>>>>> >>>>>>>>>>>>> E-mail: senaka AT wso2.com >>>>>>>>>>>>> **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 >>>>>>>>>>>>> Linked-In: http://linkedin.com/in/senakafernando >>>>>>>>>>>>> >>>>>>>>>>>>> *Lean . Enterprise . Middleware >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> >>>>>>>>>>>> Subash Chaturanga >>>>>>>>>>>> Software Engineer >>>>>>>>>>>> WSO2 Inc. http://wso2.com >>>>>>>>>>>> >>>>>>>>>>>> email - [email protected] >>>>>>>>>>>> phone - 077 2225922 >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> Vijitha Kumara >>>>>>>>>>> Senior Software Engineer; WSO2, Inc.; http://wso2.com/ >>>>>>>>>>> email: [email protected] >>>>>>>>>>> >>>>>>>>>>> Lean . Enterprise . Middleware >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> Vijitha Kumara >>>>>>>>>> Senior Software Engineer; WSO2, Inc.; http://wso2.com/ >>>>>>>>>> email: [email protected] >>>>>>>>>> >>>>>>>>>> Lean . Enterprise . Middleware >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> >>>>>>>>> Subash Chaturanga >>>>>>>>> Software Engineer >>>>>>>>> WSO2 Inc. http://wso2.com >>>>>>>>> >>>>>>>>> email - [email protected] >>>>>>>>> phone - 077 2225922 >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Vijitha Kumara >>>>>>>> Senior Software Engineer; WSO2, Inc.; http://wso2.com/ >>>>>>>> email: [email protected] >>>>>>>> >>>>>>>> Lean . Enterprise . Middleware >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> *Senaka Fernando* >>>>>>> Product Manager - WSO2 Governance Registry; >>>>>>> Associate Technical Lead; WSO2 Inc.; http://wso2.com* >>>>>>> Member; Apache Software Foundation; http://apache.org >>>>>>> >>>>>>> E-mail: senaka AT wso2.com >>>>>>> **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 >>>>>>> Linked-In: http://linkedin.com/in/senakafernando >>>>>>> >>>>>>> *Lean . Enterprise . Middleware >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> >>>>>> Subash Chaturanga >>>>>> Software Engineer >>>>>> WSO2 Inc. http://wso2.com >>>>>> >>>>>> email - [email protected] >>>>>> phone - 077 2225922 >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> *Senaka Fernando* >>>>> Product Manager - WSO2 Governance Registry; >>>>> Associate Technical Lead; WSO2 Inc.; http://wso2.com* >>>>> Member; Apache Software Foundation; http://apache.org >>>>> >>>>> E-mail: senaka AT wso2.com >>>>> **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 >>>>> Linked-In: http://linkedin.com/in/senakafernando >>>>> >>>>> *Lean . Enterprise . Middleware >>>>> >>>>> >>>> >>>> >>>> -- >>>> Vijitha Kumara >>>> Senior Software Engineer; WSO2, Inc.; http://wso2.com/ >>>> email: [email protected] >>>> >>>> Lean . Enterprise . Middleware >>>> >>>> >>> >>> >>> -- >>> *Senaka Fernando* >>> Product Manager - WSO2 Governance Registry; >>> Associate Technical Lead; WSO2 Inc.; http://wso2.com* >>> Member; Apache Software Foundation; http://apache.org >>> >>> E-mail: senaka AT wso2.com >>> **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 >>> Linked-In: http://linkedin.com/in/senakafernando >>> >>> *Lean . Enterprise . Middleware >>> >>> >>> _______________________________________________ >>> Dev mailing list >>> [email protected] >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> *Afkham Azeez* >> Director of Architecture; WSO2, Inc.; http://wso2.com >> Member; Apache Software Foundation; http://www.apache.org/ >> * <http://www.apache.org/>** >> email: **[email protected]* <[email protected]>* cell: +94 77 3320919 >> blog: **http://blog.afkham.org* <http://blog.afkham.org>* >> twitter: **http://twitter.com/afkham_azeez*<http://twitter.com/afkham_azeez> >> * >> linked-in: **http://lk.linkedin.com/in/afkhamazeez* >> >> * >> * >> *Lean . Enterprise . Middleware* >> >> >> _______________________________________________ >> Dev mailing list >> [email protected] >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > > Subash Chaturanga > Software Engineer > WSO2 Inc. http://wso2.com > > email - [email protected] > phone - 077 2225922 > > > _______________________________________________ > Dev mailing list > [email protected] > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Vijitha Kumara Senior Software Engineer; WSO2, Inc.; http://wso2.com/ email: [email protected] Lean . Enterprise . Middleware
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
