[Zope3-dev] Re: Automated compatibility tests

2006-02-08 Thread Max M

Tarek Ziadé wrote:


I think buildbot fills this need very well,
like http://buildbot.zope.org/ or http://buildbot.nuxeo.org/



I was aware of http://buildbot.zope.org/ but I though it was an 
internally developed tool.


It certainly goes a long way in getting there. Though it might be a bit 
much of a setup for the single developer.



A shared system where every product in a svn/tags would be tested would 
probably be ideal.


I will check it out. It is at least suitable for my own use.


--

hilsen/regards Max M, Denmark

http://www.mxm.dk/
IT's Mad Science

___
Zope3-dev mailing list
Zope3-dev@zope.org
Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com



Re: [Zope3-dev] Re: Automated compatibility tests

2006-02-08 Thread Tarek Ziadé

Max M wrote:


Tarek Ziadé wrote:


I think buildbot fills this need very well,
like http://buildbot.zope.org/ or http://buildbot.nuxeo.org/




I was aware of http://buildbot.zope.org/ but I though it was an 
internally developed tool.


Nope, it's a python product. python-dev even use it too now, see 
http://www.python.org/dev/buildbot/




It certainly goes a long way in getting there. Though it might be a 
bit much of a setup for the single developer.



A shared system where every product in a svn/tags would be tested 
would probably be ideal.


I will check it out. It is at least suitable for my own use.


Yup, it is a bit long to set up but if you have a spare computer where 
you can set up all environnements where

you want to test your different product versions, it is very nice indeed.



___
Zope3-dev mailing list
Zope3-dev@zope.org
Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com



[Zope3-dev] Re: Automated compatibility tests

2006-02-08 Thread Max M

Chris Withers wrote:

Tarek Ziadé wrote:


Or am I the only one seing this as a problem that should be automated?


I think buildbot fills this need very well,
like http://buildbot.zope.org/ or http://buildbot.nuxeo.org/


Nah, Max is after something different, and I agree with him that it 
would be great if it could be done automatically, but I suspect it'll 
best be done by hand...


Just 'cos the tests pass doesn't mean it works ;-)



One could imagine that unittests and creative use of testbrowser would 
be a big help.


I have product where contacts can be turned into Plone members. In Plone 
2.1 a script called validate_registration was removed, and so my 
product breaks. Now I have people asking what is wrong with with my product.


A problem like that would certainly have been caught by functional tests.

If the aforementioned compatibility list was available they would at 
least be able to see the that the current product version is 
officially incompatible.



--

hilsen/regards Max M, Denmark

http://www.mxm.dk/
IT's Mad Science

___
Zope3-dev mailing list
Zope3-dev@zope.org
Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com



Re: [Zope3-dev] Re: Automated compatibility tests

2006-02-08 Thread Benji York

Tarek Ziadé wrote:
[snip buildbot]

Yup, it is a bit long to set up but if you have a spare computer
where you can set up all environnements where you want to test your
different product versions, it is very nice indeed.


And now that VMware Server is free (no charge, not open) you can run 
those environments on different OSs: 
http://www.vmware.com/news/releases/server_beta.html

--
Benji York
Senior Software Engineer
Zope Corporation
___
Zope3-dev mailing list
Zope3-dev@zope.org
Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com



[Zope3-dev] Re: Automated compatibility tests

2006-02-08 Thread Simon Michael

+1 Max M! I have this problem in a big way.

http://zopewiki.org/VersionsMatrix is a manual equivalent.

___
Zope3-dev mailing list
Zope3-dev@zope.org
Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com