Hi Joep, hi all,

> What you basicly want is a test matrix for each library  x each pic
> (and maybe some variations in xtal freq, osc type etc). In practice,
> there will be some libraries (like serial_hardware and print) that are
> used in lots of tests. I am not sure why you expect the number of
> tests to be significantly larger then the number of (non-device) libs,
> so please explain.


Back again on this... I was first thinking to put tests as columns, so the
more tests we have the more columns too. Finally, this could finish with
100's columns... Then you said "no, don't put the tests as columns, put the
library", which makes sense, I agree 100%.

My question is the following:

 * one test can use mutliple library
 * a test can pass or not (pass or fail)
 * if a test passes, all libraries it uses can be mark as "successfully
tested"
 * if a test fails,... what do I put ?

Does all libraries it uses will be mark as "failed" ?

I could do the following:

 * imagine testA uses lib1 and lib2.
 * testB uses lib1 and lib3

testA fails. testB passes. I have:

 * lib1 : one fail, one pass
 * lib2 : one fail
 * lib3 : one pass

which can give:

 * lib1 : successfully tested
 * lib2 : failed
 * lib3 : successfully tested

that is, when a lib a least passes in one test, then it's a considered as a
success.

What do you think ?

Thanks for your help on this infinite topic, and sorry for my bullet list
abuse :) (maybe I've been eaten by a black hole, and now lost in the matrix,
yeah, the testing matrix...)


Cheers,
Seb
-- 
Sébastien Lelong
http://www.sirloon.net
http://sirbot.org

--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups 
"jallib" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/jallib?hl=en
-~----------~----~----~----~------~----~------~--~---

Reply via email to