Sounds good! One more question. Did we use backed admin services' interfaces and wrote tests to cover all back-end services's operations?
On Thu, Sep 9, 2010 at 3:36 PM, Thilini Ishaka <[email protected]> wrote: > > On Thu, Sep 9, 2010 at 2:48 PM, Samisa Abeysinghe <[email protected]> wrote: > >> >> >> On Thu, Sep 9, 2010 at 2:42 PM, Charitha Kankanamge <[email protected]>wrote: >> >>> The scenarios given in this list are covered by both sample tests and the >>> others. >> >> >> Please treat samples separate and get all >> these scenarios covered separate, irrespective of the fact that those are >> already covered with samples or not. That why we have the assurance on >> complete coverage. >> > > Yes. The esb-sample is a separate category and there are other modules to > cover almost all the features irrespective of they are covering in the > sample module or not. > For a example there are samples to cover throttle mediation (Sample > 370-372), but we have a separate module called *mediators-throttle* to > handle its' functionality which is capable of handling wide range of > functionality. Using that module we are checking whether the required > response are coming out or not, entries goes to the esb log correctly, etc > (depending on the situation). > > Those separate categories/modules can be found at [1] with the automation > status. > [1] > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > [2] > https://svn.wso2.org/repos/wso2/trunk/commons/qa/component-test-framework/ > > Also please find [2] to get a brief idea of how the framework is > structured. > Further I will give the module structure of pom.xml to get a clear idea. > > <module>authenticator</module> > <module>common</module> > <module>servicemanagement</module> > > <module>resourceadmin</module> > <module>securitymanagement</module> > <module>throttleadmin</module> > <module>synapse-config-admin</module> > > <module>proxyservices</module> > <module>sequences</module> > <module>endpoints</module> > <module>localentry</module> > <module>mediators-send</module> > > <module>mediators-drop</module> > <module>mediators-sequence</module> > <module>mediators-inout</module> > <module>mediators-filter</module> > > <module>mediators-clone</module> > <module>mediators-log</module> > <module>mediators-throttle</module> > <module>mediators-switch</module> > > <module>mediators-property</module> > <module>esb-sample</module> > > Here you will see that esb-sample is separated from all the other modules. > The above list goes bigger. > > regards > Thilini > > > > >> It would be fine to use bits and pieces of samples to cover each scenario. >> But covering individual scenarios on their own is a must. >> >> You can think of samples as system tests and the individual case covering >> like som`e unit cases. >> >> Samisa... >> >> Therefore, in order to identify the tests covered beyond the samples, can >>> you highlight those specific scenarios? >>> >>> Btw, the wiki url should be >>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>> >>> /Charitha >>> >>> >>> >>> >>> On Thu, Sep 9, 2010 at 2:28 PM, Chamara Silva <[email protected]> wrote: >>> >>>> In addition to the esb sample automation,we are covering test >>>> scenarios mention in the ESB test case document in >>>> >>>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios.specially >>>> mediator test scenarios. WYT ? >>>> >>>> thanks, >>>> chamara >>>> >>>> On Thu, Sep 9, 2010 at 2:10 PM, Samisa Abeysinghe <[email protected]> >>>> wrote: >>>> > >>>> > >>>> > On Thu, Sep 9, 2010 at 9:59 AM, Chamara Silva <[email protected]> >>>> wrote: >>>> >> >>>> >> As thilini explained we are in the final stage of esb automation.we >>>> >> can start greg or other product automation from Monday. >>>> > >>>> > What are the scenarios covered beyond samples? >>>> > >>>> >> >>>> >> thanks, >>>> >> chamara >>>> >> >>>> >> On Thu, Sep 9, 2010 at 7:34 AM, Thilini Ishaka <[email protected]> >>>> wrote: >>>> >> > >>>> >> > >>>> >> > Yes. We have started covering remaining test scenarios. >>>> >> > Also the remaining sample tests like JMS, VFS, Mail have been >>>> automated. >>>> >> > Will have a small test run tomorrow. >>>> >> > >>>> >> > thanks >>>> >> > >>>> >> > regards >>>> >> > Thilini >>>> >> > >>>> >> > >>>> >> > On Wed, Sep 8, 2010 at 10:17 PM, Charitha Kankanamge < >>>> [email protected]> >>>> >> > wrote: >>>> >> >> >>>> >> >> >>>> >> >> On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe < >>>> [email protected]> >>>> >> >> wrote: >>>> >> >>> >>>> >> >>> Have we started covering the test scenarios that we discussed >>>> beyond >>>> >> >>> samples to cover the feature list? >>>> >> >> >>>> >> >> Yes. It has been started. Chamara, please chime in. >>>> >> >> >>>> >> >>> We need to turn to other product automation, like G-Reg soon! So >>>> I am >>>> >> >>> keen to close the chapter on ESB ASAP! >>>> >> >> >>>> >> >> Yes. We should. Chamara/Thilini, we need to accelerate this effort >>>> and >>>> >> >> complete the remaining scenarios listed in >>>> >> >> >>>> >> >> >>>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>>> >> >> >>>> >> >> >>>> >> >>> >>>> >> >>> On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge >>>> >> >>> <[email protected]> >>>> >> >>> wrote: >>>> >> >>>> >>>> >> >>>> Ok then. Thilini, lets try to find possibilities of automating >>>> JMS >>>> >> >>>> scenarios first. You may write a script (shell/ruby/ant or >>>> python) to >>>> >> >>>> configure the pre-requisites such as copying activemq libs to >>>> ESB and >>>> >> >>>> starting ActiveMQ server. Then, the rest can be done by usual >>>> Junit >>>> >> >>>> test >>>> >> >>>> cases. >>>> >> >>>> >>>> >> >>>> Regards >>>> >> >>>> Charitha >>>> >> >>>> >>>> >> >>>> >>>> >> >>>> On Fri, Sep 3, 2010 at 5:38 AM, Samisa Abeysinghe < >>>> [email protected]> >>>> >> >>>> wrote: >>>> >> >>>>> >>>> >> >>>>> Folks, IMHO, it is too early to worry about exact coverage. A >>>> ball >>>> >> >>>>> park figure would be sufficient for the moment. >>>> >> >>>>> This is bevuase we have better things to do like adding other >>>> >> >>>>> transports and the like. I would rather spend our time and >>>> effort on >>>> >> >>>>> this as of now. >>>> >> >>>>> >>>> >> >>>>> I agree that we will need to have Emma in the picture at some >>>> point, >>>> >> >>>>> because some clients might ask for it etc. But later please... >>>> >> >>>>> >>>> >> >>>>> On Thursday, September 2, 2010, Charitha Kankanamge >>>> >> >>>>> <[email protected]> >>>> >> >>>>> wrote: >>>> >> >>>>> > >>>> >> >>>>> > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva < >>>> [email protected]> >>>> >> >>>>> > wrote: >>>> >> >>>>> > >>>> >> >>>>> > For Smoke test perspective, we believe that the framework >>>> covers >>>> >> >>>>> > 80% >>>> >> >>>>> > of the functionality. In order to get the exact test coverage >>>> >> >>>>> > figure, >>>> >> >>>>> > we may run Emma or clover in due course. >>>> >> >>>>> > >>>> >> >>>>> > Thilini, >>>> >> >>>>> > Can you please instrument ESB with Emma and try to find the % >>>> >> >>>>> > coverage? >>>> >> >>>>> > >>>> >> >>>>> > Regards >>>> >> >>>>> > Charitha >>>> >> >>>>> > >>>> >> >>>>> > >>>> >> >>>>> > >>>> >> >>>>> > Regards >>>> >> >>>>> > Chamara >>>> >> >>>>> > >>>> >> >>>>> > >>>> >> >>>>> > >>>> >> >>>>> > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe >>>> >> >>>>> > <[email protected]> >>>> >> >>>>> > wrote: >>>> >> >>>>> >> Good! How much in terms of % does this cover as of now? >>>> >> >>>>> >> >>>> >> >>>>> >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri >>>> >> >>>>> >> <[email protected]> >>>> >> >>>>> >> wrote: >>>> >> >>>>> >>> >>>> >> >>>>> >>> Hi, >>>> >> >>>>> >>> >>>> >> >>>>> >>> We used the framework to smoke test the Alpha3 build and >>>> were >>>> >> >>>>> >>> able >>>> >> >>>>> >>> to find >>>> >> >>>>> >>> a few issues of samples through this. The framework works >>>> well >>>> >> >>>>> >>> on >>>> >> >>>>> >>> Windows as >>>> >> >>>>> >>> well. >>>> >> >>>>> >>> >>>> >> >>>>> >>> Regards, >>>> >> >>>>> >>> Evanthika >>>> >> >>>>> >>> >>>> >> >>>>> >>> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva >>>> >> >>>>> >>> <[email protected]> >>>> >> >>>>> >>> wrote: >>>> >> >>>>> >>>> >>>> >> >>>>> >>>> ESB test automation framework covered following test areas >>>> >> >>>>> >>>> right >>>> >> >>>>> >>>> now. >>>> >> >>>>> >>>> >>>> >> >>>>> >>>> 1. ESB Samples >>>> >> >>>>> >>>> 2. Functional test - please find the automated test cases >>>> from >>>> >> >>>>> >>>> [ >>>> >> >>>>> >>>> >>>> >> >>>>> >>>> >>>> >> >>>>> >>>> >>>> >> >>>>> >>>> >>>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>>> >> >>>>> >>>> ] >>>> >> >>>>> >>>> >>>> >> >>>>> >>>> thanks, >>>> >> >>>>> >>>> Chamara >>>> >> >>>>> >>>> -- >>>> >> >>>>> >>>> Suminda Chamara Silva >>>> >> >>>>> >>>> Senior Software Engineer - QA >>>> >> >>>>> >>>> WSO2 Inc. >>>> >> >>>>> >>>> Mobile: +94 718 302858 >>>> >> >>>>> >>>> blog: http://chamaras.blogspot.com >>>> >> >>>>> >>>> >>>> >> >>>>> >>>> _______________________________________________ >>>> >> >>>>> >>>> Carbon-dev mailing list >>>> >> >>>>> >>>> [email protected] >>>> >> >>>>> >>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> >> >>>>> >>> >>>> >> >>>>> >>> >>>> >> >>>>> >>> _______________________________________________ >>>> >> >>>>> >>> Carbon-dev mailing list >>>> >> >>>>> >>> [email protected] >>>> >> >>>>> >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> >> >>>>> >>> >>>> >> >>>>> >> Thanks, >>>> >> >>>>> >> Samisa... >>>> >> >>>>> >> >>>> >> >>>>> >> Samisa Abeysinghe >>>> >> >>>>> >> VP Engineering >>>> >> >>>>> >> WSO2 Inc. >>>> >> >>>>> >> http://wso2.com >>>> >> >>>>> >> http://wso2.org >>>> >> >>>>> >> >>>> >> >>>>> >> >>>> >> >>>>> >> >>>> >> >>>>> >> _______________________________________________ >>>> >> >>>>> >> Carbon-dev mailing list >>>> >> >>>>> >> [email protected] >>>> >> >>>>> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> >> >>>>> >> >>>> >> >>>>> >> >>>> >> >>>>> > >>>> >> >>>>> > >>>> >> >>>>> > >>>> >> >>>>> > -- >>>> >> >>>>> > Suminda Chamara Silva >>>> >> >>>>> > Senior Software Engineer - QA >>>> >> >>>>> > WSO2 Inc. >>>> >> >>>>> > Mobile: +94 718 302858 >>>> >> >>>>> > blog: http://chamaras.blogspot.com >>>> >> >>>>> > >>>> >> >>>>> > _______________________________________________ >>>> >> >>>>> > Carbon-dev mailing list >>>> >> >>>>> > [email protected] >>>> >> >>>>> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> >> >>>>> > >>>> >> >>>>> > >>>> >> >>>>> >>>> >> >>>>> _______________________________________________ >>>> >> >>>>> Carbon-dev mailing list >>>> >> >>>>> [email protected] >>>> >> >>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> >> >>>> >>>> >> >>>> >>>> >> >>>> _______________________________________________ >>>> >> >>>> Carbon-dev mailing list >>>> >> >>>> [email protected] >>>> >> >>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> >> >>>> >>>> >> >>> Thanks, >>>> >> >>> Samisa... >>>> >> >>> >>>> >> >>> Samisa Abeysinghe >>>> >> >>> VP Engineering >>>> >> >>> WSO2 Inc. >>>> >> >>> http://wso2.com >>>> >> >>> http://wso2.org >>>> >> >>> >>>> >> >>> >>>> >> >>> >>>> >> >>> _______________________________________________ >>>> >> >>> Carbon-dev mailing list >>>> >> >>> [email protected] >>>> >> >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> >> >>> >>>> >> >> >>>> >> >> >>>> >> >> _______________________________________________ >>>> >> >> Carbon-dev mailing list >>>> >> >> [email protected] >>>> >> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> >> >> >>>> >> > >>>> >> > >>>> >> > _______________________________________________ >>>> >> > Carbon-dev mailing list >>>> >> > [email protected] >>>> >> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> >> > >>>> >> > >>>> >> >>>> >> >>>> >> >>>> >> -- >>>> >> Suminda Chamara Silva >>>> >> Senior Software Engineer - QA >>>> >> WSO2 Inc. >>>> >> Mobile: +94 718 302858 >>>> >> blog: http://chamaras.blogspot.com >>>> >> >>>> >> _______________________________________________ >>>> >> Carbon-dev mailing list >>>> >> [email protected] >>>> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> > >>>> > Thanks, >>>> > Samisa... >>>> > >>>> > Samisa Abeysinghe >>>> > VP Engineering >>>> > WSO2 Inc. >>>> > http://wso2.com >>>> > http://wso2.org >>>> > >>>> > >>>> > >>>> > _______________________________________________ >>>> > Carbon-dev mailing list >>>> > [email protected] >>>> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> > >>>> > >>>> >>>> >>>> >>>> -- >>>> Suminda Chamara Silva >>>> Senior Software Engineer - QA >>>> WSO2 Inc. >>>> Mobile: +94 718 302858 >>>> blog: http://chamaras.blogspot.com >>>> >>>> _______________________________________________ >>>> Carbon-dev mailing list >>>> [email protected] >>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>>> >>> >>> >>> _______________________________________________ >>> Carbon-dev mailing list >>> [email protected] >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >>> Thanks, >> Samisa... >> >> Samisa Abeysinghe >> VP Engineering >> WSO2 Inc. >> http://wso2.com >> http://wso2.org >> >> >> >> >> _______________________________________________ >> Carbon-dev mailing list >> [email protected] >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >> > > _______________________________________________ > Carbon-dev mailing list > [email protected] > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > Thanks, Samisa... Samisa Abeysinghe VP Engineering WSO2 Inc. http://wso2.com http://wso2.org
_______________________________________________ Carbon-dev mailing list [email protected] https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
