Hi,
I might have chosen the wrong thread for this message, but this is
about another well-known unit tests suite - Eclipse Unit Tests. I've
recently filed new JIRA issue
(https://issues.apache.org/jira/browse/HARMONY-2038) with the ant
script to run EUT on Harmony. Does it make sense to integrate it to
the buildtest module?
For a moment EUT pass rate on Harmony is ~77%. EUT runs results (on
Linux/ia32 and windows/ia32) are being updated on wiki:
http://wiki.apache.org/harmony/Eclipse_Unit_Tests_Pass_on_DRLVM
A number of EUT test cases fail on Harmony because EUT uses some
hard-coded Sun/Jrockit classlibs names. In particular,
org.eclipse.jdt.core.tests.util.Util class uses specific paths to
class libraries jar files (<JRE_HOME>/lib/rt.jar, for example).
org.eclipse.jdt.core.tests.runtime.*VMLauncher classes use "javaw" as
vm executable name that is missing in Harmony bundle. So what I would
like to do now is to patch EUT to invoke Harmony correctly if it is ok
with everyone here.
Best regards,
Nina
On 10/25/06, Vladimir Ivanov <[EMAIL PROTECTED]> wrote:
Excellent!
I have one more idea: we already have buildtest module. Some time ago we
agreed to extends it by coverage and japi scripts (I hope it happens soon:)
). May be we extend it one more time and store here some scripts for
automatic run of other-projects unit tests? Seems, in this case we can
easily reproduce tests run and enable new platforms.
Of cause, we can not cover all application but we can define some list of
'most important application'.
Is it OK?
Leo, could you share your script for Derby?
Tony, could you share your scripts for ant and log4j?
thanks, Vladimir
PS. The directory structure may be something like that:
builtest
- trunk
- cc
- coverage
- japi
- application_test
- derby
- ant
- etc
- misc (some other scripts)
On 10/25/06, Geir Magnusson Jr. <[EMAIL PROTECTED]> wrote:
>
> Nice work!
>
> More inline..
>
> Leo Li wrote:
> > 467 Tests Run
> > 94% Pass (443 tests passed)
> > 6% Fail (24 tests failed)
> > 5 Suites skipped
> >
> > The main progress focuses here:
> > 1. Harmony classlib fails to load class when user-defined security
> policy
> > exists. It is due to the sequence of library loading of VM, which has
> been
> > resolved now.
> > 2. A new workround for derby tests which allow useprocess to run test or
> > else several testcases might fail due to derby lack these tests when
> > useprocess = false.
> > 3. Derby source code uses the version and the name of java vm to decide
> > what
> > to do, while current IBM VM has the version of "1.4.2" and the name of
> > "j9",
> > which has different output on the screen from that of standard RI 1.5.
> At
> > the same time Derby test compares the output of the iteractive test
> scripts
> > to that of expected. I have made some slight modification in its source
> > code, but I have not throughly change this odd behavior, ...,too much:(
>
> Have you approached the derby community with the changes?
>
> >
> > Besides, some testcase fails even on RI. I exclude
> > a "derbynetclientmats" test suit since it will hang both RI and Harmony.
> > Currently all the failure is irrelevant to Harmony. Hope I can find
> > something in the left.
> >
> > I have updated the wiki of derby on Hamony:
> > http://wiki.apache.org/harmony/Apache_Derby.
> >
>
