Hi, I am thinking of following adjustments in Service Pack creation procedure. IMO, we need to add few additional steps (green highlighted items) into the Service Pack creation procedure to improve the quality. Main target of this exercise is to improve the testing coverage . So following is the procedure. I am repeating the entire list of actions with adjustments (highlighted)
Development State: 1. Get a patch number 2. Generate SP 3. Generate a data sheet from PMT, which should capture, patchId, availability of tests, support JIRA, **product. 4. Call for missing automation tests. 5. Revisit tests that were identified as 'CannotDO' 6. Prepare test scenarios for 'CannotDo' tests. -->Because we need data to backtrack, correct and fix. Last time we failed in this, because we simply handed over these patches for testing. Testing State: 1. Run automated tests on the product with SP 2. Generate reports 3. Validate test results 4. List all failed cases 5. Distinguish actual fails from infrastructure related matters (e.g timeouts). 6. Re-run tests by package or by class for infrastructure related matters. 7. Manually execute all other failed scenarios.-- test scenario here, will be the automated test case. 8. Ask for fixes on all real failure cases. 9. Redo SP with new fixes - (need to get a new number) 10.Repeat Testing steps 1-8 until no failure case. Release State: 1. Create a ftp location to host the patch. 2. Finalize patch data sheets, test results etc. 3. Finalize the list of production accounts that the patch should be shared with. 4. Share with prod accounts 5. Notify the development accounts and share as and when requested. We usually share SP with Prod customers only. But last time we shared with development accounts as well. There were lot of responses from latter. So I feel having 'Release State - step5' is more appropriate than 3 and 5 of the same. Please share your ideas too. Thanks, Yumani -- * Yumani Ranaweera* Technical Lead WSO2 Inc. - lean . enterprise . middleware | http://wso2.com Office: +94 0112145345 | Mob: + 94 777795242 http://yumani.blogspot.com http://yumsnotes.blogspot.com/
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
