On Thu, Sep 9, 2010 at 5:33 PM, Chamara Silva <[email protected]> wrote: > Following are the admin services currently use in esb test automation > framework.i much appreciate anyone can review this and let us know > what are the remaining admin services need to cover in esb test > framework. > > 1. AuthenticationAdmin > 2. EndpointAdmin > 3. LocalEntryAdmin > 4. ProxyServiceAdmin > 5. ResourceAdminService > 6. SecurityAdminService > 7. SequenceAdminService > 8. ServiceAdmin > 9. ConfigServiceAdmin > 10. ThrottleAdminService >
>From the ESB's perspective we need to cover Event Sources Priority Executors Scheduled Tasks Mediation Stats Transport Stats Thanks, Supun.. > Thank you, > Chamara > > On Thu, Sep 9, 2010 at 4:18 PM, Samisa Abeysinghe <[email protected]> wrote: >> Sounds good! >> One more question. Did we use backed admin services' interfaces and wrote >> tests to cover all back-end services's operations? >> >> On Thu, Sep 9, 2010 at 3:36 PM, Thilini Ishaka <[email protected]> wrote: >>> >>> On Thu, Sep 9, 2010 at 2:48 PM, Samisa Abeysinghe <[email protected]> wrote: >>>> >>>> >>>> On Thu, Sep 9, 2010 at 2:42 PM, Charitha Kankanamge <[email protected]> >>>> wrote: >>>>> >>>>> The scenarios given in this list are covered by both sample tests and >>>>> the others. >>>> >>>> Please treat samples separate and get all >>>> these scenarios covered separate, irrespective of the fact that those are >>>> already covered with samples or not. That why we have the assurance on >>>> complete coverage. >>> >>> Yes. The esb-sample is a separate category and there are other modules to >>> cover almost all the features irrespective of they are covering in the >>> sample module or not. >>> For a example there are samples to cover throttle mediation (Sample >>> 370-372), but we have a separate module called mediators-throttle to handle >>> its' functionality which is capable of handling wide range of functionality. >>> Using that module we are checking whether the required response are coming >>> out or not, entries goes to the esb log correctly, etc (depending on the >>> situation). >>> >>> Those separate categories/modules can be found at [1] with the automation >>> status. >>> [1] >>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>> [2] >>> https://svn.wso2.org/repos/wso2/trunk/commons/qa/component-test-framework/ >>> >>> Also please find [2] to get a brief idea of how the framework is >>> structured. >>> Further I will give the module structure of pom.xml to get a clear idea. >>> >>> <module>authenticator</module> >>> <module>common</module> >>> <module>servicemanagement</module> >>> >>> >>> <module>resourceadmin</module> >>> <module>securitymanagement</module> >>> <module>throttleadmin</module> >>> <module>synapse-config-admin</module> >>> >>> >>> <module>proxyservices</module> >>> <module>sequences</module> >>> <module>endpoints</module> >>> <module>localentry</module> >>> <module>mediators-send</module> >>> >>> >>> <module>mediators-drop</module> >>> <module>mediators-sequence</module> >>> <module>mediators-inout</module> >>> <module>mediators-filter</module> >>> >>> >>> <module>mediators-clone</module> >>> <module>mediators-log</module> >>> <module>mediators-throttle</module> >>> <module>mediators-switch</module> >>> >>> >>> <module>mediators-property</module> >>> <module>esb-sample</module> >>> >>> Here you will see that esb-sample is separated from all the other modules. >>> The above list goes bigger. >>> >>> regards >>> Thilini >>> >>> >>>> >>>> It would be fine to use bits and pieces of samples to cover each >>>> scenario. But covering individual scenarios on their own is a must. >>>> You can think of samples as system tests and the individual case covering >>>> like som`e unit cases. >>>> Samisa... >>>>> >>>>> Therefore, in order to identify the tests covered beyond the samples, >>>>> can you highlight those specific scenarios? >>>>> >>>>> Btw, the wiki url should be >>>>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>>>> >>>>> /Charitha >>>>> >>>>> >>>>> >>>>> On Thu, Sep 9, 2010 at 2:28 PM, Chamara Silva <[email protected]> wrote: >>>>>> >>>>>> In addition to the esb sample automation,we are covering test >>>>>> scenarios mention in the ESB test case document in >>>>>> >>>>>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios.specially >>>>>> mediator test scenarios. WYT ? >>>>>> >>>>>> thanks, >>>>>> chamara >>>>>> >>>>>> On Thu, Sep 9, 2010 at 2:10 PM, Samisa Abeysinghe <[email protected]> >>>>>> wrote: >>>>>> > >>>>>> > >>>>>> > On Thu, Sep 9, 2010 at 9:59 AM, Chamara Silva <[email protected]> >>>>>> > wrote: >>>>>> >> >>>>>> >> As thilini explained we are in the final stage of esb automation.we >>>>>> >> can start greg or other product automation from Monday. >>>>>> > >>>>>> > What are the scenarios covered beyond samples? >>>>>> > >>>>>> >> >>>>>> >> thanks, >>>>>> >> chamara >>>>>> >> >>>>>> >> On Thu, Sep 9, 2010 at 7:34 AM, Thilini Ishaka <[email protected]> >>>>>> >> wrote: >>>>>> >> > >>>>>> >> > >>>>>> >> > Yes. We have started covering remaining test scenarios. >>>>>> >> > Also the remaining sample tests like JMS, VFS, Mail have been >>>>>> >> > automated. >>>>>> >> > Will have a small test run tomorrow. >>>>>> >> > >>>>>> >> > thanks >>>>>> >> > >>>>>> >> > regards >>>>>> >> > Thilini >>>>>> >> > >>>>>> >> > >>>>>> >> > On Wed, Sep 8, 2010 at 10:17 PM, Charitha Kankanamge >>>>>> >> > <[email protected]> >>>>>> >> > wrote: >>>>>> >> >> >>>>>> >> >> >>>>>> >> >> On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe >>>>>> >> >> <[email protected]> >>>>>> >> >> wrote: >>>>>> >> >>> >>>>>> >> >>> Have we started covering the test scenarios that we discussed >>>>>> >> >>> beyond >>>>>> >> >>> samples to cover the feature list? >>>>>> >> >> >>>>>> >> >> Yes. It has been started. Chamara, please chime in. >>>>>> >> >> >>>>>> >> >>> We need to turn to other product automation, like G-Reg soon! So >>>>>> >> >>> I am >>>>>> >> >>> keen to close the chapter on ESB ASAP! >>>>>> >> >> >>>>>> >> >> Yes. We should. Chamara/Thilini, we need to accelerate this >>>>>> >> >> effort and >>>>>> >> >> complete the remaining scenarios listed in >>>>>> >> >> >>>>>> >> >> >>>>>> >> >> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>>>>> >> >> >>>>>> >> >> >>>>>> >> >>> >>>>>> >> >>> On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge >>>>>> >> >>> <[email protected]> >>>>>> >> >>> wrote: >>>>>> >> >>>> >>>>>> >> >>>> Ok then. Thilini, lets try to find possibilities of automating >>>>>> >> >>>> JMS >>>>>> >> >>>> scenarios first. You may write a script (shell/ruby/ant or >>>>>> >> >>>> python) to >>>>>> >> >>>> configure the pre-requisites such as copying activemq libs to >>>>>> >> >>>> ESB and >>>>>> >> >>>> starting ActiveMQ server. Then, the rest can be done by usual >>>>>> >> >>>> Junit >>>>>> >> >>>> test >>>>>> >> >>>> cases. >>>>>> >> >>>> >>>>>> >> >>>> Regards >>>>>> >> >>>> Charitha >>>>>> >> >>>> >>>>>> >> >>>> >>>>>> >> >>>> On Fri, Sep 3, 2010 at 5:38 AM, Samisa Abeysinghe >>>>>> >> >>>> <[email protected]> >>>>>> >> >>>> wrote: >>>>>> >> >>>>> >>>>>> >> >>>>> Folks, IMHO, it is too early to worry about exact coverage. A >>>>>> >> >>>>> ball >>>>>> >> >>>>> park figure would be sufficient for the moment. >>>>>> >> >>>>> This is bevuase we have better things to do like adding other >>>>>> >> >>>>> transports and the like. I would rather spend our time and >>>>>> >> >>>>> effort on >>>>>> >> >>>>> this as of now. >>>>>> >> >>>>> >>>>>> >> >>>>> I agree that we will need to have Emma in the picture at some >>>>>> >> >>>>> point, >>>>>> >> >>>>> because some clients might ask for it etc. But later please... >>>>>> >> >>>>> >>>>>> >> >>>>> On Thursday, September 2, 2010, Charitha Kankanamge >>>>>> >> >>>>> <[email protected]> >>>>>> >> >>>>> wrote: >>>>>> >> >>>>> > >>>>>> >> >>>>> > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva >>>>>> >> >>>>> > <[email protected]> >>>>>> >> >>>>> > wrote: >>>>>> >> >>>>> > >>>>>> >> >>>>> > For Smoke test perspective, we believe that the framework >>>>>> >> >>>>> > covers >>>>>> >> >>>>> > 80% >>>>>> >> >>>>> > of the functionality. In order to get the exact test >>>>>> >> >>>>> > coverage >>>>>> >> >>>>> > figure, >>>>>> >> >>>>> > we may run Emma or clover in due course. >>>>>> >> >>>>> > >>>>>> >> >>>>> > Thilini, >>>>>> >> >>>>> > Can you please instrument ESB with Emma and try to find the >>>>>> >> >>>>> > % >>>>>> >> >>>>> > coverage? >>>>>> >> >>>>> > >>>>>> >> >>>>> > Regards >>>>>> >> >>>>> > Charitha >>>>>> >> >>>>> > >>>>>> >> >>>>> > >>>>>> >> >>>>> > >>>>>> >> >>>>> > Regards >>>>>> >> >>>>> > Chamara >>>>>> >> >>>>> > >>>>>> >> >>>>> > >>>>>> >> >>>>> > >>>>>> >> >>>>> > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe >>>>>> >> >>>>> > <[email protected]> >>>>>> >> >>>>> > wrote: >>>>>> >> >>>>> >> Good! How much in terms of % does this cover as of now? >>>>>> >> >>>>> >> >>>>>> >> >>>>> >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri >>>>>> >> >>>>> >> <[email protected]> >>>>>> >> >>>>> >> wrote: >>>>>> >> >>>>> >>> >>>>>> >> >>>>> >>> Hi, >>>>>> >> >>>>> >>> >>>>>> >> >>>>> >>> We used the framework to smoke test the Alpha3 build and >>>>>> >> >>>>> >>> were >>>>>> >> >>>>> >>> able >>>>>> >> >>>>> >>> to find >>>>>> >> >>>>> >>> a few issues of samples through this. The framework works >>>>>> >> >>>>> >>> well >>>>>> >> >>>>> >>> on >>>>>> >> >>>>> >>> Windows as >>>>>> >> >>>>> >>> well. >>>>>> >> >>>>> >>> >>>>>> >> >>>>> >>> Regards, >>>>>> >> >>>>> >>> Evanthika >>>>>> >> >>>>> >>> >>>>>> >> >>>>> >>> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva >>>>>> >> >>>>> >>> <[email protected]> >>>>>> >> >>>>> >>> wrote: >>>>>> >> >>>>> >>>> >>>>>> >> >>>>> >>>> ESB test automation framework covered following test >>>>>> >> >>>>> >>>> areas >>>>>> >> >>>>> >>>> right >>>>>> >> >>>>> >>>> now. >>>>>> >> >>>>> >>>> >>>>>> >> >>>>> >>>> 1. ESB Samples >>>>>> >> >>>>> >>>> 2. Functional test - please find the automated test cases >>>>>> >> >>>>> >>>> from >>>>>> >> >>>>> >>>> [ >>>>>> >> >>>>> >>>> >>>>>> >> >>>>> >>>> >>>>>> >> >>>>> >>>> >>>>>> >> >>>>> >>>> >>>>>> >> >>>>> >>>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>>>>> >> >>>>> >>>> ] >>>>>> >> >>>>> >>>> >>>>>> >> >>>>> >>>> thanks, >>>>>> >> >>>>> >>>> Chamara >>>>>> >> >>>>> >>>> -- >>>>>> >> >>>>> >>>> Suminda Chamara Silva >>>>>> >> >>>>> >>>> Senior Software Engineer - QA >>>>>> >> >>>>> >>>> WSO2 Inc. >>>>>> >> >>>>> >>>> Mobile: +94 718 302858 >>>>>> >> >>>>> >>>> blog: http://chamaras.blogspot.com >>>>>> >> >>>>> >>>> >>>>>> >> >>>>> >>>> _______________________________________________ >>>>>> >> >>>>> >>>> Carbon-dev mailing list >>>>>> >> >>>>> >>>> [email protected] >>>>>> >> >>>>> >>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>>> >> >>>>> >>> >>>>>> >> >>>>> >>> >>>>>> >> >>>>> >>> _______________________________________________ >>>>>> >> >>>>> >>> Carbon-dev mailing list >>>>>> >> >>>>> >>> [email protected] >>>>>> >> >>>>> >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>>> >> >>>>> >>> >>>>>> >> >>>>> >> Thanks, >>>>>> >> >>>>> >> Samisa... >>>>>> >> >>>>> >> >>>>>> >> >>>>> >> Samisa Abeysinghe >>>>>> >> >>>>> >> VP Engineering >>>>>> >> >>>>> >> WSO2 Inc. >>>>>> >> >>>>> >> http://wso2.com >>>>>> >> >>>>> >> http://wso2.org >>>>>> >> >>>>> >> >>>>>> >> >>>>> >> >>>>>> >> >>>>> >> >>>>>> >> >>>>> >> _______________________________________________ >>>>>> >> >>>>> >> Carbon-dev mailing list >>>>>> >> >>>>> >> [email protected] >>>>>> >> >>>>> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>>> >> >>>>> >> >>>>>> >> >>>>> >> >>>>>> >> >>>>> > >>>>>> >> >>>>> > >>>>>> >> >>>>> > >>>>>> >> >>>>> > -- >>>>>> >> >>>>> > Suminda Chamara Silva >>>>>> >> >>>>> > Senior Software Engineer - QA >>>>>> >> >>>>> > WSO2 Inc. >>>>>> >> >>>>> > Mobile: +94 718 302858 >>>>>> >> >>>>> > blog: http://chamaras.blogspot.com >>>>>> >> >>>>> > >>>>>> >> >>>>> > _______________________________________________ >>>>>> >> >>>>> > Carbon-dev mailing list >>>>>> >> >>>>> > [email protected] >>>>>> >> >>>>> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>>> >> >>>>> > >>>>>> >> >>>>> > >>>>>> >> >>>>> >>>>>> >> >>>>> _______________________________________________ >>>>>> >> >>>>> Carbon-dev mailing list >>>>>> >> >>>>> [email protected] >>>>>> >> >>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>>> >> >>>> >>>>>> >> >>>> >>>>>> >> >>>> _______________________________________________ >>>>>> >> >>>> Carbon-dev mailing list >>>>>> >> >>>> [email protected] >>>>>> >> >>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>>> >> >>>> >>>>>> >> >>> Thanks, >>>>>> >> >>> Samisa... >>>>>> >> >>> >>>>>> >> >>> Samisa Abeysinghe >>>>>> >> >>> VP Engineering >>>>>> >> >>> WSO2 Inc. >>>>>> >> >>> http://wso2.com >>>>>> >> >>> http://wso2.org >>>>>> >> >>> >>>>>> >> >>> >>>>>> >> >>> >>>>>> >> >>> _______________________________________________ >>>>>> >> >>> Carbon-dev mailing list >>>>>> >> >>> [email protected] >>>>>> >> >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>>> >> >>> >>>>>> >> >> >>>>>> >> >> >>>>>> >> >> _______________________________________________ >>>>>> >> >> Carbon-dev mailing list >>>>>> >> >> [email protected] >>>>>> >> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>>> >> >> >>>>>> >> > >>>>>> >> > >>>>>> >> > _______________________________________________ >>>>>> >> > Carbon-dev mailing list >>>>>> >> > [email protected] >>>>>> >> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>>> >> > >>>>>> >> > >>>>>> >> >>>>>> >> >>>>>> >> >>>>>> >> -- >>>>>> >> Suminda Chamara Silva >>>>>> >> Senior Software Engineer - QA >>>>>> >> WSO2 Inc. >>>>>> >> Mobile: +94 718 302858 >>>>>> >> blog: http://chamaras.blogspot.com >>>>>> >> >>>>>> >> _______________________________________________ >>>>>> >> Carbon-dev mailing list >>>>>> >> [email protected] >>>>>> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>>> > >>>>>> > Thanks, >>>>>> > Samisa... >>>>>> > >>>>>> > Samisa Abeysinghe >>>>>> > VP Engineering >>>>>> > WSO2 Inc. >>>>>> > http://wso2.com >>>>>> > http://wso2.org >>>>>> > >>>>>> > >>>>>> > >>>>>> > _______________________________________________ >>>>>> > Carbon-dev mailing list >>>>>> > [email protected] >>>>>> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>>> > >>>>>> > >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Suminda Chamara Silva >>>>>> Senior Software Engineer - QA >>>>>> WSO2 Inc. >>>>>> Mobile: +94 718 302858 >>>>>> blog: http://chamaras.blogspot.com >>>>>> >>>>>> _______________________________________________ >>>>>> Carbon-dev mailing list >>>>>> [email protected] >>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>> >>>>> >>>>> _______________________________________________ >>>>> Carbon-dev mailing list >>>>> [email protected] >>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>>> >>>> Thanks, >>>> Samisa... >>>> >>>> Samisa Abeysinghe >>>> VP Engineering >>>> WSO2 Inc. >>>> http://wso2.com >>>> http://wso2.org >>>> >>>> >>>> >>>> _______________________________________________ >>>> Carbon-dev mailing list >>>> [email protected] >>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> >>> >>> >>> _______________________________________________ >>> Carbon-dev mailing list >>> [email protected] >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >> Thanks, >> Samisa... >> >> Samisa Abeysinghe >> VP Engineering >> WSO2 Inc. >> http://wso2.com >> http://wso2.org >> >> >> >> _______________________________________________ >> Carbon-dev mailing list >> [email protected] >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >> > > > > -- > Suminda Chamara Silva > Senior Software Engineer - QA > WSO2 Inc. > Mobile: +94 718 302858 > blog: http://chamaras.blogspot.com > > _______________________________________________ > Carbon-dev mailing list > [email protected] > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > _______________________________________________ Carbon-dev mailing list [email protected] https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
