Following are the admin services currently use in esb test automation framework.i much appreciate anyone can review this and let us know what are the remaining admin services need to cover in esb test framework.
1. AuthenticationAdmin 2. EndpointAdmin 3. LocalEntryAdmin 4. ProxyServiceAdmin 5. ResourceAdminService 6. SecurityAdminService 7. SequenceAdminService 8. ServiceAdmin 9. ConfigServiceAdmin 10. ThrottleAdminService Thank you, Chamara On Thu, Sep 9, 2010 at 4:18 PM, Samisa Abeysinghe <[email protected]> wrote: > Sounds good! > One more question. Did we use backed admin services' interfaces and wrote > tests to cover all back-end services's operations? > > On Thu, Sep 9, 2010 at 3:36 PM, Thilini Ishaka <[email protected]> wrote: >> >> On Thu, Sep 9, 2010 at 2:48 PM, Samisa Abeysinghe <[email protected]> wrote: >>> >>> >>> On Thu, Sep 9, 2010 at 2:42 PM, Charitha Kankanamge <[email protected]> >>> wrote: >>>> >>>> The scenarios given in this list are covered by both sample tests and >>>> the others. >>> >>> Please treat samples separate and get all >>> these scenarios covered separate, irrespective of the fact that those are >>> already covered with samples or not. That why we have the assurance on >>> complete coverage. >> >> Yes. The esb-sample is a separate category and there are other modules to >> cover almost all the features irrespective of they are covering in the >> sample module or not. >> For a example there are samples to cover throttle mediation (Sample >> 370-372), but we have a separate module called mediators-throttle to handle >> its' functionality which is capable of handling wide range of functionality. >> Using that module we are checking whether the required response are coming >> out or not, entries goes to the esb log correctly, etc (depending on the >> situation). >> >> Those separate categories/modules can be found at [1] with the automation >> status. >> [1] >> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >> [2] >> https://svn.wso2.org/repos/wso2/trunk/commons/qa/component-test-framework/ >> >> Also please find [2] to get a brief idea of how the framework is >> structured. >> Further I will give the module structure of pom.xml to get a clear idea. >> >> <module>authenticator</module> >> <module>common</module> >> <module>servicemanagement</module> >> >> >> <module>resourceadmin</module> >> <module>securitymanagement</module> >> <module>throttleadmin</module> >> <module>synapse-config-admin</module> >> >> >> <module>proxyservices</module> >> <module>sequences</module> >> <module>endpoints</module> >> <module>localentry</module> >> <module>mediators-send</module> >> >> >> <module>mediators-drop</module> >> <module>mediators-sequence</module> >> <module>mediators-inout</module> >> <module>mediators-filter</module> >> >> >> <module>mediators-clone</module> >> <module>mediators-log</module> >> <module>mediators-throttle</module> >> <module>mediators-switch</module> >> >> >> <module>mediators-property</module> >> <module>esb-sample</module> >> >> Here you will see that esb-sample is separated from all the other modules. >> The above list goes bigger. >> >> regards >> Thilini >> >> >>> >>> It would be fine to use bits and pieces of samples to cover each >>> scenario. But covering individual scenarios on their own is a must. >>> You can think of samples as system tests and the individual case covering >>> like som`e unit cases. >>> Samisa... >>>> >>>> Therefore, in order to identify the tests covered beyond the samples, >>>> can you highlight those specific scenarios? >>>> >>>> Btw, the wiki url should be >>>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>>> >>>> /Charitha >>>> >>>> >>>> >>>> On Thu, Sep 9, 2010 at 2:28 PM, Chamara Silva <[email protected]> wrote: >>>>> >>>>> In addition to the esb sample automation,we are covering test >>>>> scenarios mention in the ESB test case document in >>>>> >>>>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios.specially >>>>> mediator test scenarios. WYT ? >>>>> >>>>> thanks, >>>>> chamara >>>>> >>>>> On Thu, Sep 9, 2010 at 2:10 PM, Samisa Abeysinghe <[email protected]> >>>>> wrote: >>>>> > >>>>> > >>>>> > On Thu, Sep 9, 2010 at 9:59 AM, Chamara Silva <[email protected]> >>>>> > wrote: >>>>> >> >>>>> >> As thilini explained we are in the final stage of esb automation.we >>>>> >> can start greg or other product automation from Monday. >>>>> > >>>>> > What are the scenarios covered beyond samples? >>>>> > >>>>> >> >>>>> >> thanks, >>>>> >> chamara >>>>> >> >>>>> >> On Thu, Sep 9, 2010 at 7:34 AM, Thilini Ishaka <[email protected]> >>>>> >> wrote: >>>>> >> > >>>>> >> > >>>>> >> > Yes. We have started covering remaining test scenarios. >>>>> >> > Also the remaining sample tests like JMS, VFS, Mail have been >>>>> >> > automated. >>>>> >> > Will have a small test run tomorrow. >>>>> >> > >>>>> >> > thanks >>>>> >> > >>>>> >> > regards >>>>> >> > Thilini >>>>> >> > >>>>> >> > >>>>> >> > On Wed, Sep 8, 2010 at 10:17 PM, Charitha Kankanamge >>>>> >> > <[email protected]> >>>>> >> > wrote: >>>>> >> >> >>>>> >> >> >>>>> >> >> On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe >>>>> >> >> <[email protected]> >>>>> >> >> wrote: >>>>> >> >>> >>>>> >> >>> Have we started covering the test scenarios that we discussed >>>>> >> >>> beyond >>>>> >> >>> samples to cover the feature list? >>>>> >> >> >>>>> >> >> Yes. It has been started. Chamara, please chime in. >>>>> >> >> >>>>> >> >>> We need to turn to other product automation, like G-Reg soon! So >>>>> >> >>> I am >>>>> >> >>> keen to close the chapter on ESB ASAP! >>>>> >> >> >>>>> >> >> Yes. We should. Chamara/Thilini, we need to accelerate this >>>>> >> >> effort and >>>>> >> >> complete the remaining scenarios listed in >>>>> >> >> >>>>> >> >> >>>>> >> >> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>>>> >> >> >>>>> >> >> >>>>> >> >>> >>>>> >> >>> On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge >>>>> >> >>> <[email protected]> >>>>> >> >>> wrote: >>>>> >> >>>> >>>>> >> >>>> Ok then. Thilini, lets try to find possibilities of automating >>>>> >> >>>> JMS >>>>> >> >>>> scenarios first. You may write a script (shell/ruby/ant or >>>>> >> >>>> python) to >>>>> >> >>>> configure the pre-requisites such as copying activemq libs to >>>>> >> >>>> ESB and >>>>> >> >>>> starting ActiveMQ server. Then, the rest can be done by usual >>>>> >> >>>> Junit >>>>> >> >>>> test >>>>> >> >>>> cases. >>>>> >> >>>> >>>>> >> >>>> Regards >>>>> >> >>>> Charitha >>>>> >> >>>> >>>>> >> >>>> >>>>> >> >>>> On Fri, Sep 3, 2010 at 5:38 AM, Samisa Abeysinghe >>>>> >> >>>> <[email protected]> >>>>> >> >>>> wrote: >>>>> >> >>>>> >>>>> >> >>>>> Folks, IMHO, it is too early to worry about exact coverage. A >>>>> >> >>>>> ball >>>>> >> >>>>> park figure would be sufficient for the moment. >>>>> >> >>>>> This is bevuase we have better things to do like adding other >>>>> >> >>>>> transports and the like. I would rather spend our time and >>>>> >> >>>>> effort on >>>>> >> >>>>> this as of now. >>>>> >> >>>>> >>>>> >> >>>>> I agree that we will need to have Emma in the picture at some >>>>> >> >>>>> point, >>>>> >> >>>>> because some clients might ask for it etc. But later please... >>>>> >> >>>>> >>>>> >> >>>>> On Thursday, September 2, 2010, Charitha Kankanamge >>>>> >> >>>>> <[email protected]> >>>>> >> >>>>> wrote: >>>>> >> >>>>> > >>>>> >> >>>>> > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva >>>>> >> >>>>> > <[email protected]> >>>>> >> >>>>> > wrote: >>>>> >> >>>>> > >>>>> >> >>>>> > For Smoke test perspective, we believe that the framework >>>>> >> >>>>> > covers >>>>> >> >>>>> > 80% >>>>> >> >>>>> > of the functionality. In order to get the exact test >>>>> >> >>>>> > coverage >>>>> >> >>>>> > figure, >>>>> >> >>>>> > we may run Emma or clover in due course. >>>>> >> >>>>> > >>>>> >> >>>>> > Thilini, >>>>> >> >>>>> > Can you please instrument ESB with Emma and try to find the >>>>> >> >>>>> > % >>>>> >> >>>>> > coverage? >>>>> >> >>>>> > >>>>> >> >>>>> > Regards >>>>> >> >>>>> > Charitha >>>>> >> >>>>> > >>>>> >> >>>>> > >>>>> >> >>>>> > >>>>> >> >>>>> > Regards >>>>> >> >>>>> > Chamara >>>>> >> >>>>> > >>>>> >> >>>>> > >>>>> >> >>>>> > >>>>> >> >>>>> > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe >>>>> >> >>>>> > <[email protected]> >>>>> >> >>>>> > wrote: >>>>> >> >>>>> >> Good! How much in terms of % does this cover as of now? >>>>> >> >>>>> >> >>>>> >> >>>>> >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri >>>>> >> >>>>> >> <[email protected]> >>>>> >> >>>>> >> wrote: >>>>> >> >>>>> >>> >>>>> >> >>>>> >>> Hi, >>>>> >> >>>>> >>> >>>>> >> >>>>> >>> We used the framework to smoke test the Alpha3 build and >>>>> >> >>>>> >>> were >>>>> >> >>>>> >>> able >>>>> >> >>>>> >>> to find >>>>> >> >>>>> >>> a few issues of samples through this. The framework works >>>>> >> >>>>> >>> well >>>>> >> >>>>> >>> on >>>>> >> >>>>> >>> Windows as >>>>> >> >>>>> >>> well. >>>>> >> >>>>> >>> >>>>> >> >>>>> >>> Regards, >>>>> >> >>>>> >>> Evanthika >>>>> >> >>>>> >>> >>>>> >> >>>>> >>> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva >>>>> >> >>>>> >>> <[email protected]> >>>>> >> >>>>> >>> wrote: >>>>> >> >>>>> >>>> >>>>> >> >>>>> >>>> ESB test automation framework covered following test >>>>> >> >>>>> >>>> areas >>>>> >> >>>>> >>>> right >>>>> >> >>>>> >>>> now. >>>>> >> >>>>> >>>> >>>>> >> >>>>> >>>> 1. ESB Samples >>>>> >> >>>>> >>>> 2. Functional test - please find the automated test cases >>>>> >> >>>>> >>>> from >>>>> >> >>>>> >>>> [ >>>>> >> >>>>> >>>> >>>>> >> >>>>> >>>> >>>>> >> >>>>> >>>> >>>>> >> >>>>> >>>> >>>>> >> >>>>> >>>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>>>> >> >>>>> >>>> ] >>>>> >> >>>>> >>>> >>>>> >> >>>>> >>>> thanks, >>>>> >> >>>>> >>>> Chamara >>>>> >> >>>>> >>>> -- >>>>> >> >>>>> >>>> Suminda Chamara Silva >>>>> >> >>>>> >>>> Senior Software Engineer - QA >>>>> >> >>>>> >>>> WSO2 Inc. >>>>> >> >>>>> >>>> Mobile: +94 718 302858 >>>>> >> >>>>> >>>> blog: http://chamaras.blogspot.com >>>>> >> >>>>> >>>> >>>>> >> >>>>> >>>> _______________________________________________ >>>>> >> >>>>> >>>> Carbon-dev mailing list >>>>> >> >>>>> >>>> [email protected] >>>>> >> >>>>> >>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>> >> >>>>> >>> >>>>> >> >>>>> >>> >>>>> >> >>>>> >>> _______________________________________________ >>>>> >> >>>>> >>> Carbon-dev mailing list >>>>> >> >>>>> >>> [email protected] >>>>> >> >>>>> >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>> >> >>>>> >>> >>>>> >> >>>>> >> Thanks, >>>>> >> >>>>> >> Samisa... >>>>> >> >>>>> >> >>>>> >> >>>>> >> Samisa Abeysinghe >>>>> >> >>>>> >> VP Engineering >>>>> >> >>>>> >> WSO2 Inc. >>>>> >> >>>>> >> http://wso2.com >>>>> >> >>>>> >> http://wso2.org >>>>> >> >>>>> >> >>>>> >> >>>>> >> >>>>> >> >>>>> >> >>>>> >> >>>>> >> _______________________________________________ >>>>> >> >>>>> >> Carbon-dev mailing list >>>>> >> >>>>> >> [email protected] >>>>> >> >>>>> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>> >> >>>>> >> >>>>> >> >>>>> >> >>>>> >> >>>>> > >>>>> >> >>>>> > >>>>> >> >>>>> > >>>>> >> >>>>> > -- >>>>> >> >>>>> > Suminda Chamara Silva >>>>> >> >>>>> > Senior Software Engineer - QA >>>>> >> >>>>> > WSO2 Inc. >>>>> >> >>>>> > Mobile: +94 718 302858 >>>>> >> >>>>> > blog: http://chamaras.blogspot.com >>>>> >> >>>>> > >>>>> >> >>>>> > _______________________________________________ >>>>> >> >>>>> > Carbon-dev mailing list >>>>> >> >>>>> > [email protected] >>>>> >> >>>>> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>> >> >>>>> > >>>>> >> >>>>> > >>>>> >> >>>>> >>>>> >> >>>>> _______________________________________________ >>>>> >> >>>>> Carbon-dev mailing list >>>>> >> >>>>> [email protected] >>>>> >> >>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>> >> >>>> >>>>> >> >>>> >>>>> >> >>>> _______________________________________________ >>>>> >> >>>> Carbon-dev mailing list >>>>> >> >>>> [email protected] >>>>> >> >>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>> >> >>>> >>>>> >> >>> Thanks, >>>>> >> >>> Samisa... >>>>> >> >>> >>>>> >> >>> Samisa Abeysinghe >>>>> >> >>> VP Engineering >>>>> >> >>> WSO2 Inc. >>>>> >> >>> http://wso2.com >>>>> >> >>> http://wso2.org >>>>> >> >>> >>>>> >> >>> >>>>> >> >>> >>>>> >> >>> _______________________________________________ >>>>> >> >>> Carbon-dev mailing list >>>>> >> >>> [email protected] >>>>> >> >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>> >> >>> >>>>> >> >> >>>>> >> >> >>>>> >> >> _______________________________________________ >>>>> >> >> Carbon-dev mailing list >>>>> >> >> [email protected] >>>>> >> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>> >> >> >>>>> >> > >>>>> >> > >>>>> >> > _______________________________________________ >>>>> >> > Carbon-dev mailing list >>>>> >> > [email protected] >>>>> >> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>> >> > >>>>> >> > >>>>> >> >>>>> >> >>>>> >> >>>>> >> -- >>>>> >> Suminda Chamara Silva >>>>> >> Senior Software Engineer - QA >>>>> >> WSO2 Inc. >>>>> >> Mobile: +94 718 302858 >>>>> >> blog: http://chamaras.blogspot.com >>>>> >> >>>>> >> _______________________________________________ >>>>> >> Carbon-dev mailing list >>>>> >> [email protected] >>>>> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>> > >>>>> > Thanks, >>>>> > Samisa... >>>>> > >>>>> > Samisa Abeysinghe >>>>> > VP Engineering >>>>> > WSO2 Inc. >>>>> > http://wso2.com >>>>> > http://wso2.org >>>>> > >>>>> > >>>>> > >>>>> > _______________________________________________ >>>>> > Carbon-dev mailing list >>>>> > [email protected] >>>>> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>> > >>>>> > >>>>> >>>>> >>>>> >>>>> -- >>>>> Suminda Chamara Silva >>>>> Senior Software Engineer - QA >>>>> WSO2 Inc. >>>>> Mobile: +94 718 302858 >>>>> blog: http://chamaras.blogspot.com >>>>> >>>>> _______________________________________________ >>>>> Carbon-dev mailing list >>>>> [email protected] >>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> >>>> >>>> _______________________________________________ >>>> Carbon-dev mailing list >>>> [email protected] >>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> >>> Thanks, >>> Samisa... >>> >>> Samisa Abeysinghe >>> VP Engineering >>> WSO2 Inc. >>> http://wso2.com >>> http://wso2.org >>> >>> >>> >>> _______________________________________________ >>> Carbon-dev mailing list >>> [email protected] >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >> >> >> _______________________________________________ >> Carbon-dev mailing list >> [email protected] >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> > Thanks, > Samisa... > > Samisa Abeysinghe > VP Engineering > WSO2 Inc. > http://wso2.com > http://wso2.org > > > > _______________________________________________ > Carbon-dev mailing list > [email protected] > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > -- Suminda Chamara Silva Senior Software Engineer - QA WSO2 Inc. Mobile: +94 718 302858 blog: http://chamaras.blogspot.com _______________________________________________ Carbon-dev mailing list [email protected] https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
