Re: Regression testing in OpenBSD

2014-03-14 Thread Sergey Bronnikov
Hi, Ingo On 22:19 Thu 13 Mar , Ingo Schwarze wrote: Hi Sergey, Sergey Bronnikov wrote on Thu, Mar 13, 2014 at 10:08:40PM +0400: We need more and more tests to cover OpenBSD code as much as possible. Sure, so improve or write some tests. amount of OpenBSD developers is about 70, and it

Regression testing in OpenBSD

2014-03-13 Thread Sergey Bronnikov
Hi, all I read OpenBSD mail lists several years and always stuck with reports like I have tested your patch and it works fine. Such reports are useless. We don't know details about _how_ it was tested and we can't retest on the same way. We need more and more tests to cover OpenBSD code as much

Re: Regression testing in OpenBSD

2014-03-13 Thread Ingo Schwarze
Hi Sergey, Sergey Bronnikov wrote on Thu, Mar 13, 2014 at 10:08:40PM +0400: We need more and more tests to cover OpenBSD code as much as possible. Sure, so improve or write some tests. OpenBSD developers has unit and regression tests in source tree (src/regress) but you cannot use them

Re: Regression testing in OpenBSD

2014-03-13 Thread Theo de Raadt
To summarize, if you are interested in improving OpenBSD regression tests, i'd suggest working on *actual tests*, not bloated frameworks. One could look at the existing tests, clean them up such that they actually run through, do not generate bogus errors, improve the style in some places