Hi,
Bertrand Delacretaz schrieb:
On Fri, Jun 27, 2008 at 12:22 PM, Felix Meschberger <[EMAIL PROTECTED]> wrote:
Bertrand Delacretaz schrieb:
...Having a list of testable bundles under /system/self-test, with a user
interface to run the tests, would make it much easier to test various
combinations of bundles....
...While I fully agree with the need for tests and more tests and integration
tests etc, I do not have the best of all gut feelings including tests into
released binaries....
Allow me to insist ;-)
Sure ;-)
Of course this can be dangerous and this is new territory. But the way
we're working with OSGi is new territory as well, so we need to adjust
our ways of working.
...Tests belong to development/QA and the source and should not be distributed
with the actual binary. At the end of the day, this might create more pain
than relieve....
Why would having tests create more pain than not having tests?
Because of non-production dependencies you include (e.g. JUnit etc).
...What we _must_ really care for is to ensure each bundle release is backwards
compatible - at least for the minor and micro release numbers....
Yes, but how are you going to do that except by testing the various
combinations of bundles?
As OSGi allows people to mix and match bundles as they like, I don't
see another way than allowing people to test their own mix themselves.
Point is, that we programm to the API ! This is key. If we can test our
own bundles such that we can confidently say, they implement the API
correctly we are more than halfway done.
Integration testing is important, yes. But if we have good unit tests
proving the isolated API implementation is correct, integration testing
is not that important anymore (it used to be in times when there were
_no_ unit tests).
But how about this approach: We keep the testing and production support
separate. We distribute special testing support (bundles). People may
wish to install and use the to integration test our and their bundles.
If the are satisfied, they remove the testing bundles again, and we are
done.
WDYT ?
Regards
Felix
-Bertrand
