2010/11/30 Pertti Kellomäki <[email protected]>:
> On 11/30/2010 04:51 PM, ext Andrew Flegg wrote:
>>
>> I'm somewhat hoping the developer doesn't hack on
>> meegotouch-applauncherd for a while until WhizBang stops crashing,
>> then ships the fix without any further form of regression or automated
>> testing...
>
> The scenario is that WhizBang developer notices that WhizBang crashes when
> it is launched with applauncherd ,and files a bug against us (applauncherd
> developers that is). The bug report then contains stack traces of
> WhizBang, along with other potentially proprietary/secret information.
Yup.
> In order to file a meaningful bug in the public bugzilla, the WhizBang
> developer would need to develop a test application that crashes in an
> identical way to WhizBang.
I'm happy for the WhizBang tester to file a bug against WhizBang - but
once it's identified it's applauncherd (either by a WhizBang developer
*or* an applauncherd developer), a minimal test case SHOULD be created
anyway to add to the automated unit test suite.
This ensures:
* The bug fixer can fix it quickly by running the automated
test, rather than repeatedly rebuilding WhizBang (which they
might not have access to, nor a stable version of) and
getting it to some particular state.
* applauncherd has a further test to ensure the problem is
not reintroduced.
* applauncherd has a further test which "documents" the usage
of its API.
* applauncherd's test coverage increases.
* the minimal test case can be shared, publicly, without
fear of exposing internal or proprietary information.
As I said, though, this presupposes that applauncherd has automated
tests already, although as you said a minimal application could be
used to recreate the issue. To paraphrase Neal Ford, "the lack of
rigourous automated testing should be considered, for software
engineers, professional negligence."
Cheers,
Andrew
--
Andrew Flegg -- mailto:[email protected] | http://www.bleb.org/
Maemo Community Council member
_______________________________________________
MeeGo-packaging mailing list
[email protected]
http://lists.meego.com/listinfo/meego-packaging