On 12/7/06, Alexey Varlamov <[EMAIL PROTECTED]> wrote:
2006/12/6, Elena Semukhina <[EMAIL PROTECTED]>: > On 12/5/06, Rana Dasgupta <[EMAIL PROTECTED]> wrote: > > > > How much total additional time would be needed to run the tests that are > > excluded for "slowness" only? > > > There are 11 tests marked as slow. They run about 30 sec in JIT mode. Only > one of them is rather slow: gc.Mark (~15 sec). > > I compared the whole run duration on linux (JIT + interpreter). Currently 26 > tests run for about 3 min 30 sec. Adding 42 tests from exclude list > increases duration up to 11 minutes (1 min 40 sec for JIT). > > Is this time acceptable? Probably yes.Exact timings depend on hardware used; I guess the figures above are on a laptop?
No, 11 minutes are for multiprocessor machines (Windows/linux). On a single processor desktop the tests run for 24 minutes :( Most annoying is the interpreter mode. We can agree later that some slow tests should be excluded for interpreter. Anyway I need a couple of days to run the tests intensively to reveal all unstable issues. Elena Anyway let's try them over! Later if someone analyzed coverage, we can
re-balance pre-commit and CI tests. > > Thanks, > Elena > > Thanks, > > Rana > > > > > > On 12/5/06, Elena Semukhina <[EMAIL PROTECTED]> wrote: > > > > > > We currently have more than 40 smoke tests in the exclude list. > > > I tried to run all of them on linux/Windows and found out that most of > > > them > > > stably pass. > > > Those of them which have been marked with the "slow" keyword don't > > > actually > > > run slow. They are not slower than an average smoke test. Only few of > > them > > > work about 10 seconds (comparing to 1-4 seconds duration of any other > > > test). > > > > > > Only 3 tests stably fail and about 5 tests fail intermittently. I've > > added > > > the details to the > > http://wiki.apache.org/harmony/DRLVMInternalTestspage. > > > I plan to file JIRA issues about failing tests and to gather more > > > statictics > > > on intermittent failures. > > > > > > Does anybody object to removing most tests from exclude lists and bring > > > them > > > back to runs? > > > > > > -- > > > Thanks, > > > Elena > > > > > > > > > > > > > -- > Thanks, > Elena > >
-- Thanks, Elena
