Thomas Martitz wrote:
> I think we should work a lot more with RC builds to let users test
> on targets for which we don't currently have a maintainer around.

I agree, but providing RC builds alone is not very useful. We need to help the 
users with their testing. And we need to help users report the results of their 
testing.

What we need is basically to design a batch test system that is "executed" by 
humans. In plain language: We need to write test cases. Lots of them. And then 
we need to write a web based test report tool where users can report their 
results.

I'm envisioning a tool/webpage where you enter the svn revision and target you 
are testing and then go down a list of dozens and dozens of test cases, ticking 
a checkbox (works/doesn't/other, or something) for every test.

This would allow non-programming users to contribute enormously to the 
development and improvement of the code. And it would, potentially, allow for 
actual regression tracking.

We discussed this on the last devcon, but it never came to much. I still think 
this could be a really big step forward.

-- 
Björn

Reply via email to