Hi Egor, the point is the following: we put only those requirements for which there are volunteers. If for example Oleg's favorite debugger works on Windows he don't commit to any requirements on other platfroms.
If you like to be responsible for meeting pass rates on some specific platform I think nobody will object to put this into requirements. So, do you? Thanks, Mikhail 06 Jun 2007 16:41:10 +0400, Egor Pasko <[EMAIL PROTECTED]>:
On the 0x2ED day of Apache Harmony Oleg Oleinik wrote: > > I suppose, we would not be targeting this only platform. How about > > others? Is the picture equally beautiful? > > Unfortunately, I have no information for other platforms. I would prefer if _stability_ targets for Linux/x86 were same-or-better-than WindowsAny/x86. Does everybody feel the same? > On 06 Jun 2007 14:07:59 +0400, Egor Pasko <[EMAIL PROTECTED]> wrote: > > On the 0x2ED day of Apache Harmony Oleg Oleinik wrote: > > > Clarification: DRL VM was used, Windows 2003. > > > > Oleg, BIG thank you! > > > > I suppose, we would not be targeting this only platform. How about > > others? Is the picture equally beautiful? > > > > PS: 65% on stress tests make me worry a little :( > > > > > On 6/6/07, Oleg Oleinik <[EMAIL PROTECTED]> wrote: > > > > > > Thanks for capturing the requirements. IMO the requirements still lack > > > > > > good tests to ensure stability and reliability. I propose to include > > > > > > the following recently accepted tests: > > > > > > > > > > > > 1. VM validation test suite - http://issues.apache.org/jira/browse/HARMONY-3206 > > > > > > 2. Functional test suite - http://issues.apache.org/jira/browse/HARMONY-3528 > > > > > > 3. Stress tests - http://issues.apache.org/jira/browse/HARMONY-3536 > > > > > > 4. Reliability test - https://issues.apache.org/jira/browse/HARMONY-2918 > > > > > > > > > > > > Olegs seems proposed a reasonable target for the tests- 98% pass rate > > > > > > of all valid tests from these test suites. > > > > > > > > > > what is the % today? where can I find these numbers to make sure 98% is real? > > > > > > > > Here are some approximate numbers I have (without details with some > > > > probability of mistake) to estimate how far we are from 98% pass > > > > rates: > > > > > > > > Reliability test suite: valid 83, pass 59 (0,5 hour per test), fail > > > > 24, rate: 71% > > > > Functional: valid 1328, pass 1254, fail 74, rate 94% > > > > Stress: valid 376, pass 245, fail 131, rate 65% > > > > VM validation: valid 4346, pass 4263, fail 83, rate 98% > > > > > > > > TPTP profiler tests: valid 174, pass 174, rate 100% > > > > Geronimo unit tests: valid 616, pass 603, fail 13, rate 97,8% > > > > Eclipse unit tests (wrong test suites patched): valid 36642, pass > > > > 35598, fail 1044, rate 97% > > > > > > > > Harmony class library tests: total ~24000, fail ~300, rate 98,8% > > > > > > > > > > > -- > > Egor Pasko > > > > > -- Egor Pasko
