Dear Saros Community, in our university course about software processes at Freie Universität Berlin we are now working on Goal Question Metrics (GQM).
As part of our exercise course we have to elaborate a study on GQM in an open source project which we would like to conduct at the Saros project. Therefore we have written down some ideas. GQM is a software metric model and therefore aims to measure metrics of software processes and products to allow comparison and evaluation of such. As a result either changes can be suggested or current procedure can be confirmed. Our first idea regards the continuous integration service. As far as we know GUI Tests with STF are only run nightly on the master branch. All other JUnit Tests are run on any patch set submitted to code review. This might result in Gerrit patch sets passing regular JUnit tests and therefore get marked as verified by Jenkins CI although they break STF test cases. Hence the first goal is to analyze the schedule and results of automated test runs. Goal: Analyze schedule and results of automated test runs Object of study: Unit- and STF-Test-Results of all (accepted) patch sets Focus: Number of broken test cases in all (accepted) patch sets Stakeholder: Saros developers Questions to answer for this goal: - Is the current schedule of automated test runs adequate? - For which patch sets or branches and at which time are test runs useful? Our second goal targets Saros code quality and is a very general one. Goal: Improve code quality Object of study: Saros source code Focus: Code complexity Stakeholder: Saros developers Questions to answer for this goal: - Is it possible to improve code quality and reduce code complexity? - Is it possible to improve the maintainability of the source code? As this is still a draft we would like to ask if you have comments on the proposed goals and questions. We are not familiar with Saros for a long time yet so it might happen that some of our goals or questions are not very useful to be asked. Please tell us! Are there any which would be more important to the project? To further investigate possible metrics to answer our questions regarding CI test workloads we have setup an instance of Jenkins. We are now at the point where we have to configure Jenkins to run JUnit and STF-Tests on specific branches of our Saros repository. What actions are needed to configure this? Can you give us the configuration you use? Would it be possible to run STF-Tests without Jenkins, i.e. from the Shell as well? Thank you very much in advance! Best regards Thomas Benndorf and Christoph Viebig ------------------------------------------------------------------------------ LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d _______________________________________________ DPP-Devel mailing list DPP-Devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dpp-devel
