[Webware-devel] Re: automated test suite, your thoughts?

[Winston Wolff]

Below is a list of all the tests that I've found in the current CVS version of Webware. UserKit, WebUtils, and TaskKit have some automated test extending unittest.TestCase. But they also have some non-automated test. MiddleKit has a bunch of automated tests, but they don't extend unittest.

The current situation makes sense--the easy compartmentalized things have some unittests, but the harder tests that use the appserver are not automated.

I will get all the tests running on my machine, then try to automate them. The goal is to have things arranged such that one can:
• download the latest version,
• do as little setup as possible, hopefully none, and then
• run some or all tests and they will "just work."

-winston
-------------

WebKit/Tests/
Jason H's automated functional base class and test suite
AppServerTest.py - Base class that runs Webware in a thread and then runs unittests.
Test.py
Basic/ - A webware environment for the purpose of these tests.
Test.py - Jason's one sample TestBasicFunctionality, using AppServerTest


WebKit/Testing/
Contains a number of tests that are not automated, i.e. the result
must be evaluated by the user to see if the test worked or not.
EmbeddedServlet.py - Tests "extra path info"-such as:
http://localhost/WebKit.cgi/Servlet/Extra/Path/Info
Where the servlet is embedded in the URL, rather than being the last component.
Forward*.py - Tests trans.application().forward()
IncludeURLTest.py - test the callMethodOfServlet and includeURL redirection.
Main.py
Servlet.py - test req.serverSidePath() and req.extraURLPath()
SetCookie.py - tests setting and retrieving cookies
TestIMS.py - Test If-Modified-Since support in Webware
stress.py - Purpose: Hit the WebKit AppServer with lots of a requests in order to:
Test for memory leaks, concurrency, Investigate performance

WebUtils/Tests/
TestFuncs.py - tests performace of utility functions in WebUtils vs. their standard Python alternatives.
TestHTMLTag.py - unittest.TestCase for WebUtils.HTMLTag.HTMLReader class


UserKit/Tests/
Test.py - unittest.TestCase which seems quite extensive.


TaskKit/Tests/
BasicTest.py - tests task scheduling.
Test.py - unittest.TestCase with some setup, but no actual outcome testing. Perhpas it tests that the scheduler at least doesn't fire internal assertions.


PSP/ - no tests.


MiddleKit/Tests/ - A hand-rolled(?) testing framework. There are 24 models, and each model has a
TestEmpty.py and/or TestSamples.py file which has self-evaluating tests inside it.


COMKit/ - Seems to be empty. Is that right?

_________________________________________
winston wolff - (646) 827-2242 - www.stratolab.com - learning by creating