Hi, The IS integration test coverage is now 20%. Also following are some tips writing tests, discussed in the review meeting. Please add if I have missed any.
- Avoid using "priority" annotation attribute instead design your tests to use "dependsOnMethods". - Avoid hard coding admin user name and password. Use corresponding methods in UserInfo. eg. userInfo.getUserName() depending on the init(int) used. - Always use valid asserts to test. And provide descriptive unique failure message for each assert statement. - Use CarbonUtils.getCarbonHome() if you need to get the localpath for configuration file operations. - Avoid using Thread.sleeps as much as possible. Instead use methods similar to ISIntegrationTest.waitForUserStoreDeployment(String domain) Thanks, On Mon, Sep 23, 2013 at 3:06 PM, Chamath Gunawardana <[email protected]>wrote: > We are going to have this now @ 7th floor since Garage is occupied. > > > > Thanks, > > > On Mon, Sep 23, 2013 at 2:14 PM, Krishantha Samaraweera < > [email protected]> wrote: > >> +1 >> >> Krishantha Samaraweera >> Senior Technical Lead - Test Automation. >> Mobile: +94 7777 599 18; blog: http://opensource-soa.blogspot.com/ >> WSO2, Inc.; http://wso2.com/ >> lean . enterprise . middlewear. >> >> >> On Mon, Sep 23, 2013 at 2:12 PM, Chamath Gunawardana >> <[email protected]>wrote: >> >>> Hi, >>> >>> We can have this today @ 3pm in 5th floor Garage >>> >>> >>> Thanks, >>> >>> >>> On Mon, Sep 23, 2013 at 12:53 PM, Johann Nallathamby <[email protected]>wrote: >>> >>>> +1 for a meeting today. Good to know the common mistakes and >>>> improvements that can be done early in the process. >>>> >>>> @Chamath: can we have this today? We can also review our progress. >>>> >>>> >>>> On Mon, Sep 23, 2013 at 12:46 PM, Krishantha Samaraweera < >>>> [email protected]> wrote: >>>> >>>>> I have added sample test class for multiple user stores [1]. You can >>>>> extend the sample test case to cover all scenarios on user management API >>>>> with secondary user store. Same test cases can be repeated even after >>>>> changing the domain of new user store. >>>>> >>>>> @Chamath - Shall we organize knowledge sharing session on test case >>>>> writing tips - I see there are some test cases which can be extend >>>>> further >>>>> to achieve greater code coverage and optimized further. >>>>> >>>>> [1] >>>>> https://svn.wso2.org/repos/wso2/people/chamathg/sandbox/4.5.1/modules/integration/tests/src/test/java/org/wso2/carbon/identity/tests/user/store/config/MultipleUserStoreTestCase.java >>>>> >>>>> Krishantha Samaraweera >>>>> Senior Technical Lead - Test Automation. >>>>> Mobile: +94 7777 599 18; blog: http://opensource-soa.blogspot.com/ >>>>> WSO2, Inc.; http://wso2.com/ >>>>> lean . enterprise . middlewear. >>>>> >>>>> >>>>> On Tue, Sep 17, 2013 at 12:36 AM, Prabath Siriwardena < >>>>> [email protected]> wrote: >>>>> >>>>>> Thanks Chamath...! >>>>>> >>>>>> Let's track progress every week... >>>>>> >>>>>> Thanks & regards, >>>>>> -Prabath >>>>>> >>>>>> >>>>>> On Mon, Sep 16, 2013 at 6:08 PM, Chamath Gunawardana < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> On Fri, Sep 13, 2013 at 1:23 AM, Prabath Siriwardena < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> Hi Chamath, >>>>>>>> >>>>>>>> I guess we need to review of the progress of integration test >>>>>>>> writing weekly - in terms of code coverage.. That will help us find out >>>>>>>> where we are and are we in a position to get 60% mark before mid Oct... >>>>>>>> >>>>>>>> Hi Prabath, >>>>>>> >>>>>>> Sorry for the delayed response. Currently the IS integration test >>>>>>> coverage is standing at 16%. Will provide a weekly update. >>>>>>> >>>>>>> >>>>>>>> Thanks & regards, >>>>>>>> -Prabath >>>>>>>> >>>>>>>> >>>>>>>> On Fri, Sep 6, 2013 at 10:34 AM, Chamath Gunawardana < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> Hi, >>>>>>>>> >>>>>>>>> As we need to increase the integration test coverage of IS for the >>>>>>>>> next release we need identify the priority areas/critical paths that >>>>>>>>> we >>>>>>>>> first need to be covered. Hence your input on this will greatly help. >>>>>>>>> Please pitch in.. >>>>>>>>> >>>>>>>>> Please find below some resources and guidelines that you can get >>>>>>>>> familiar with before we start writing the tests next week. >>>>>>>>> >>>>>>>>> * Krishantha and the Automation team have already written IS tests >>>>>>>>> that we can refer to get started in [1]. >>>>>>>>> * Please make your self familiar with automation framework and >>>>>>>>> guidelines on writing tests in [2] if not already. >>>>>>>>> * Use of the TestNG Annotations properly as Krishantha have >>>>>>>>> mentioned in another mail thread since this will avoid simultaneous >>>>>>>>> test >>>>>>>>> runs which will cause tests to be fail. Also make sure you run the >>>>>>>>> TestNG >>>>>>>>> version 6.1.1. >>>>>>>>> * Make server state consistent by cleaning the data after test. >>>>>>>>> >>>>>>>>> Also please find the IS integration test allocations in [3]. >>>>>>>>> >>>>>>>>> [1] - >>>>>>>>> https://svn.wso2.org/repos/wso2/carbon/platform/branches/4.2.0/products/is/4.5.0/modules/integration/src/test/java/org/wso2/identity/integration/tests >>>>>>>>> >>>>>>>>> [2] - >>>>>>>>> http://docs.wso2.org/display/TA100/Best+Practices+for+Writing+Integration+Tests >>>>>>>>> >>>>>>>>> [3] - >>>>>>>>> https://docs.google.com/a/wso2.com/spreadsheet/ccc?key=0AtS5Oii8ega9dEV4Qy05VVhoZ1Vkb2YzaHJWZGZJV3c#gid=1 >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> Thanks, >>>>>>>>> -- >>>>>>>>> Best Regards, >>>>>>>>> Chamath Gunawardana >>>>>>>>> Technical Lead; WSO2 Inc. >>>>>>>>> Mobile : +94776322240 >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Thanks & Regards, >>>>>>>> Prabath >>>>>>>> >>>>>>>> Mobile : +94 71 809 6732 >>>>>>>> >>>>>>>> http://blog.facilelogin.com >>>>>>>> http://RampartFAQ.com >>>>>>>> >>>>>>> >>>>>>> >>>>>>> Thanks, >>>>>>> -- >>>>>>> Best Regards, >>>>>>> Chamath Gunawardana >>>>>>> Technical Lead; WSO2 Inc. >>>>>>> Mobile : +94776322240 >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Thanks & Regards, >>>>>> Prabath >>>>>> >>>>>> Mobile : +94 71 809 6732 >>>>>> >>>>>> http://blog.facilelogin.com >>>>>> http://RampartFAQ.com >>>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> Thanks & Regards, >>>> >>>> *Johann Dilantha Nallathamby* >>>> Senior Software Engineer >>>> Integration Technologies Team >>>> WSO2, Inc. >>>> lean.enterprise.middleware >>>> >>>> Mobile - *+94777776950* >>>> Blog - *http://nallaa.wordpress.com* >>>> >>> >>> >>> >>> -- >>> Best Regards, >>> Chamath Gunawardana >>> Technical Lead; WSO2 Inc. >>> Mobile : +94776322240 >>> >> >> > > > -- > Best Regards, > Chamath Gunawardana > Technical Lead; WSO2 Inc. > Mobile : +94776322240 > -- Best Regards, Chamath Gunawardana Technical Lead; WSO2 Inc. Mobile : +94776322240
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
