Hi, we used an automated tester called Testpro a few years ago. You can set it up to run through your system using data in a file as input or you can load the script with the data. It works by recording what you do and capturing the screen output. It works......BUT it takes longer to maintain the scripts then do the changes. The overhead proved to much, we had about 30 developers at the time.
We produce test plans for everything we do. It is the standard of the test plan and the quality of the person doing the testing that counts. Good luck Les Sherlock Hewkin Project Manager Group Financial Systems I.T. Department Ryehill House Ryehill Close, Lodge Way Industrial Estate, Northampton. NN5 7UA T 01604 592289 M 07917 856195 -----Original Message----- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Lee Leitner Sent: 22 September 2009 23:25 To: U2 Users List Subject: Re: [U2] Software Test Bill: One strategy that improves testing results is to correctly define what a successful test is. A successful test is one that *finds* errors in the code. If no errors are found, then either there aren't any (and that's highly unlikely,) or the tests aren't good enough to trigger the problems. Ideally, you get a hold of someone who knows the application very well, and has a demonic streak. Have that person follow the strategy Ken Hall suggested in the earlier post. If they are immediately successful (i.e. finding errors,) track the rate of error discovery. When the rate falls below, say one per day, you might be at a cutoff point. Get a second opinion from another destructive expert if you can, particularly if the first fails (i.e. finds no errors.) Basically, nothing beats an application expert bent on breaking the software for finding bugs the fastest. What your boss is proposing to do is to kill several hundred bacteria by boiling the ocean. Managing test case coverage for a typical application is a huge task. And when you'll get a positive ROI is unclear: At what point will the test system have enough critical mass (test coverage) to actually demonstrably improve reliability and user satisfaction? Lee On Tue, 22 Sep 2009, Brutzman, Bill wrote: > > My boss has a new grand scheme for software testing. To test each > program revision, he wants scripts to inject sample data into user apps > and then another (big) program looks at EVERYTHING that comes out, > comparing it to a baseline. > > To me, the scope of this project is huge, perhaps bigger that our ERP > system. So far, I have been unable to talk him out of it. > > Thus, I am wondering what other people are doing in the way of software > test. Virtually all of the source code that we have is in UniBasic. > > I do not know what jargon to use to describe the test that I do now. On > a spreadsheet, I layout the various possiblities and then try each > scenario... One-by-one... Fixing bugs as I find them and then starting > the batch of tests from scratch. > > --Bill > _______________________________________________ > U2-Users mailing list > U2-Users@listserver.u2ug.org > http://listserver.u2ug.org/mailman/listinfo/u2-users > ------------------------------------------------------ Lee J. Leitner, Ph.D. leitn...@acm.org http://www.leitner.org/~leitnerl The world can only be grasped by action, not by contemplation. The hand is the cutting edge of the mind. -- Jacob Bronowski V.13.0 ------------------------------------------------------- _______________________________________________ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users <html> <head> <meta http-equiv="Content-type" content="text/html; charset=UTF-8"> </head> <body> <P style="MARGIN-TOP: 0pt; MARGIN-BOTTOM: 0pt"><SPAN style="FONT-SIZE: 8.2pt; FONT-FAMILY: 'MS Sans Serif'">This e-mail and any attachments are confidential and intended solely for the use of the addressee only. If you have received this message in error, you must not copy, distribute or disclose the contents; please notify the sender immediately and delete the message. </SPAN></P> <P style="MARGIN-TOP: 0pt; MARGIN-BOTTOM: 0pt"><SPAN style="FONT-SIZE: 8.2pt; FONT-FAMILY: 'MS Sans Serif'">This message is attributed to the sender and may not necessarily reflect the view of Travis Perkins plc or its subsidiaries (Travis Perkins). Agreements binding Travis Perkins may not be concluded by means of e-mail communication. </SPAN></P> <P style="MARGIN-TOP: 0pt; MARGIN-BOTTOM: 0pt"><SPAN style="FONT-SIZE: 8.2pt; FONT-FAMILY: 'MS Sans Serif'">E-mail transmissions are not secure and Travis Perkins accepts no responsibility for changes made to this message after it was sent. Whilst steps have been taken to ensure that this message is virus free, Travis Perkins accepts no liability for infection and recommends that you scan this e-mail and any attachments. </SPAN></P> <P style="MARGIN-TOP: 0pt; MARGIN-BOTTOM: 0pt"><SPAN style="FONT-SIZE: 8.2pt; FONT-FAMILY: 'MS Sans Serif'">Part of Travis Perkins plc. Registered Office: Lodge Way House, Lodge Way, Harlestone Road, Northampton, NN5 7UG. </SPAN></P> </BODY> </HTML> _______________________________________________ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
