2006/12/6, Elena Semukhina <[EMAIL PROTECTED]>:
On 12/5/06, Rana Dasgupta <[EMAIL PROTECTED]> wrote:
>
> How much total additional time would be needed to run the tests that are
> excluded for "slowness" only?
There are 11 tests marked as slow. They run about 30 sec in JIT mode. Only
one of them is rather slow: gc.Mark (~15 sec).
I compared the whole run duration on linux (JIT + interpreter). Currently 26
tests run for about 3 min 30 sec. Adding 42 tests from exclude list
increases duration up to 11 minutes (1 min 40 sec for JIT).
Is this time acceptable?
Probably yes.Exact timings depend on hardware used; I guess the
figures above are on a laptop?
Anyway let's try them over! Later if someone analyzed coverage, we can
re-balance pre-commit and CI tests.
Thanks,
Elena
Thanks,
> Rana
>
>
> On 12/5/06, Elena Semukhina <[EMAIL PROTECTED]> wrote:
> >
> > We currently have more than 40 smoke tests in the exclude list.
> > I tried to run all of them on linux/Windows and found out that most of
> > them
> > stably pass.
> > Those of them which have been marked with the "slow" keyword don't
> > actually
> > run slow. They are not slower than an average smoke test. Only few of
> them
> > work about 10 seconds (comparing to 1-4 seconds duration of any other
> > test).
> >
> > Only 3 tests stably fail and about 5 tests fail intermittently. I've
> added
> > the details to the
> http://wiki.apache.org/harmony/DRLVMInternalTestspage.
> > I plan to file JIRA issues about failing tests and to gather more
> > statictics
> > on intermittent failures.
> >
> > Does anybody object to removing most tests from exclude lists and bring
> > them
> > back to runs?
> >
> > --
> > Thanks,
> > Elena
> >
> >
>
>
--
Thanks,
Elena
