Pete,
For functional tests only, on the web side, there is a pretty sweet project at sourceforge called solex. It's an eclipse plugin, and you can record a browser going through the site, and then have your ant task play that back on command. So far, it has passed the first couple days of trials with flying colors.
We also looked at TestMaker but could not use it because it doesn't support javascript, which is what does all of our submits. But the design seems a bit cleaner, at least on the recording scripts piece.
Sounds good. I had briefly looked at the pushtotest site last week after Mike mentioned TestMaker, and sounds like Solex takes a similar approach. What do you find good.bad amongst the two?
In Anteater, you specified the URL to access and then a regexp denoting the returned HTTP response and particular patterns to look for in it. Seems like the advantage of Solex/TestMaker would be to automate the regexp specification for ANteater. Am I understanding it correctly?
Preface:
I just jumped in on this last week with another guy who is very bright has been working on it for three months, only recently attempting to use TestMaker and Solex.
Our requirements are that you need to be able to record a trip through a site, maybe 20 - 100 clicks, logging in, doing stuff, going from screen to screen, etc. Then this recorded script needs to run every night, and check against returned http responses and make sure everything is peachy. It is not feasible for us to write this script by hand, for there will be hundreds of scripts. So it has to be an automated recording process that any manager type could do.
End of last week, TestMaker had all the signs of a brilliant choice. Tons of documentation, commercial support, a very active mail list, a published author, corporate success stories and a very sweet feature set. I declared it a winner and pursued with my usual gusto, but the other guy found solex friday night, and TestMaker came to a sudden halt because doesn't work with javascript submits and it has a little bit crankier setup. The developer on the TestMaker list declared it a huge fix to add the necessary javascript fix.
Then when we tried Solex, everything that we had tried to do in TestMaker started working in Solex, only with a very easy to use Eclipse front end. My partner in crime started looking at the code base and found that the reason it worked where TestMaker didn't was because it was doing things in a much simpler, and in this case more direct way. (He also found very similar problems with Cactus, by the way.)
So in conclusion, we are going full tilt with Solex and dropping TestMaker for the moment.
As regards the specifics of your question above, the answer is yes, I think that is what it does but my partner is doing most of the testing. I did run through a recorded script with an ant task ant that worked easily. But solex has a nice little GUI in eclipse to feed it the variables. But we are still just barely getting past the first few sets of tests so this is still a bit preliminary.
http://keelframework.org/documentation Keelgroup mailing list [EMAIL PROTECTED] http://lists.keelframework.com/listinfo.cgi/keelgroup-keelframework.com
