On Thu, Feb 14, 2013 at 12:01 AM, Marco Hess <[email protected]> wrote:

Last week Ian Wells send a message to the [updatesteam] list about a problem we recently had with some updates to SME8 having slipped through with insufficiently tested and users suddenly finding that something did not work any more after the update.

Quoting Les Mikesell <[email protected]>:

On Thu, Feb 14, 2013 at 12:01 AM, Marco Hess <[email protected]> wrote:

Then I came across robotframework
(http://code.google.com/p/robotframework/).
It's a generic test automation tool for acceptance testing, under active
development and
to me looks like an almost ideal tool for use with SME automated testing
(although I don't
have any personal experience with it, but like to try).

You'd probably do most of this work with selenium anyway since much of
SME involves the web interface.   Another option to drive it would be
Jenkins (http://jenkins-ci.org/) which is more generally useful for
cross-platform builds as well as testing, and it has a plugin to
manage selenium too.

We just had another bad update, this time breaking HTTP ibay access which slipped through the testing.

So time to raise this up again.

I like the look of robotframework (http://code.google.com/p/robotframework/)

Can anyone look into this more?
There appears to be support for testing web apps and also items like SSH.

Anything that would increase our current coverage would be great.

For instance I don't initially need it to customise a VM, that could be done manually. It could be presumed that there are ibays preconfigured

testibay1
HTTP open access

testibay2
HTTPS access only

testibay3
password access

testibay4
restricted access

etc

Then the test case just tries to access each ibay and compares the result.

i.e. it may not be needed to drive the server-manager

Same for SSH
can a SSH session be established (known port, password or key)

Once the basics are done it would be good to also drive the server-manager.

I think that the mentality should be not what cannot be done, but what can be done.

Ian



_______________________________________________
Discussion about project organisation and overall direction
To unsubscribe, e-mail [email protected]
Searchable archive at http://lists.contribs.org/mailman/public/discussion/

Reply via email to