On Jan 15, 2007, at 2:51 PM, sheila miguez wrote:
>> Before committing to the trunk. This is a vital area that
>> affects
>> everyone.
>
> Of course it is. I'm not denying that.
>
> I asked if you have different testing criteria before accepting
> changes because I'm doubting that you actually have 100% test case
> coverage of all possible combinations of a feature that you want to
> test.
Whoa. Nobody ever claimed to have 100% anything.
> Not to mention that I doubt you have time to do 100% coverage of
> the test cases that you have come up with (scriptable or otherwise,
> unit or otherwise) before making a commit to the trunk. I'd expect
> that your coverage percentage is different based on what type of
> change you're committing, and I'd expect that you have different
> percentages for when you are preparing an official release.
Be realistic. Just because there isn't 100% coverage and 100%
thoroughness and 100% exactness, etc., doesn't mean that things don't
get tested sufficiently to determine if they work. There are
certainly edge cases that slip by, and these are fixed as soon as
they are noted.
In this case, at the very least I would have run queries, inserts,
updates, and deletes against all backends, using both AppWizard apps
and some of my own. There is no way that the changes that were
committed would have even gotten close to being committed had that
been done.
>> I test such changes against the demo data on the site, as
>> well as my
>> local stuff. I have VMs with each server type, so at a minimum I test
>> the demo data on each.
>
> People without access to your local data cannot run tests based on it.
I certainly hope not. I'm no security expert, but I hope I
understand enough to make sure that this is the case.
If you're going to changing the guts of the data access layer, you
should either have the ability to test those changes on all backends,
or, lacking that, work with others who do.
-- Ed Leafe
-- http://leafe.com
-- http://dabodev.com
_______________________________________________
Post Messages to: [email protected]
Subscription Maintenance: http://leafe.com/mailman/listinfo/dabo-users
