Hi, Zhongyi Hu! On Mar 17, Zhongyi Hu wrote: > Hi, Sergei Golubchik! > > I am afraid I don't understand the following items very well, could you > explain them for me? > > - average over different combinations or builders > - or don't average and treat triplets (test,combination,builder) as > individual "tests"
Individual test files (say, select.test) run on different builders (say, on win64, and on fedora20-i686, etc). Test files fail with different probabilities. These probabilities may be different for different builders. One can calculate a "test failure probability" as a function of probabilities for this test file to fail on different builders. Alternatively, one cat treat the "select.test run on win64" and "select.test run on fedora20-i686" as two different tests. Regards, Sergei _______________________________________________ Mailing list: https://launchpad.net/~maria-developers Post to : [email protected] Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
