hi, colleagues:
I uploaded the testing results of the reliabilities testing suite also:
(12) Reliability testing
In our batch-mode running of the 73 reliability test cases, 2 of them
failed in Linux X86 and 5 of them failed in Windows X86_64.
Linux_x86:
api.kernel.thread.ThreadSuspendResume.ThreadSuspendResume
(ireproducible)
api.kernel.threadgroup.EnumerateTest(irreproducible)
Windows x86_64:
api.kernel.hooks.ShtdwnHooksCornerCaseTest (irreproducible)
api.kernel.string.InternThreadingTest(irreproducible)
api.net.DatagramTest(irreproducible, HARMONY-5531)
api.text.DecimalFormat_Locales(ireproducible, HARMONY-5810)
api.zip.ZipEntryIterateThreadingTest(irreproducible)
As marked, I can not reproduce any of the failure in standalone
running.
I talked with Yakushev and got guessed-cause as instable/stress OS
state that we can often eliminate the errors by rebooting machine.
On Fri, Nov 7, 2008 at 11:05 PM, chunrong lai <[EMAIL PROTECTED]> wrote:
>
> Here is the M8 candidate (r710036) testing status (
> http://people.apache.org/~chunrong/snapshots/r710036/index.html):
>
> The passed test suites are: Ant Scenario (self-hosting), Axis, DRLVM
> regression, DRLVM tests, Eclipse TPTP, scimark, Tomcat Scenario, VTS VM test
> suites.
>
> (1) ClasslibTest:
> (1.1) All passed in windows x86_64.
> (1.2) org.apache.harmony.xnet.provider.jsse.SSLSocketImplTest fails
> in Linux_x86, since r691267 (removed the hy.no.sig option)
> (1.3) More concurrent test errors in Linux_x86, these failures only
> happens with release binary so not observed in integrity testing (debug
> build),
> on the other hand RI passes those test so far,
> AtomicLongArrayTest
> testCompareAndSet
> testCompareAndSetInMultipleThreads
> testCountingInMultipleThreads
> AtomicLongFieldUpdaterTest
> testCompareAndSet
> testCompareAndSetInMultipleThreads
> AtomicLongTest
> testCompareAndSet
> testCompareAndSetInMultipleThreads
> (2) Dacapo:
> (2.1) It is reported PASSED in the snapshot testing, while running
> with default VM options.
> (2.2) Buqi reported that antlr will get failed with option -Xem:opt or
> -Xem:server, in HARMONY-5993.
> I have not checked previous Dacapo running with such options
> so I do not know when the error started from.
> (2.3) Running more VM options seperatedly, I also see that xalan will
> failed with -Xem:server, in 32bits platforms (OK in 64bits platforms).
>
> (3) EUTs:
> In Linux x86 platform, the pass rate is 99.38%, slightly higher than
> the 99.36% in M7.
>
> (4) Eclipse HelloWorld:
> A freshed running reports error since r641928, as filed in
> HARMONY-5954.
> The test will pass, if it is setup/configured successfully before, as
> in integrity testing, or the introduced workaround for an old SUN
> JDK/Eclipse bundle (https://bugs.eclipse.org/bugs/show_bug.cgi?id=103263).
>
> (5) Functional tests:
> The pass rate is 99.2%, the status is almost same as in M7 and we
> have 1 less total failures in the two platforms.
> There is only 1 new regression in Window x86_64 platform.
> (5.1) Old regressions in two platforms:
> api/java/text/MessageFormat/MessageFormatTest (HARMONY-5430)
> api/java/util/jar/Manifest/ManifestTest (HARMONY-5473)
> java/beans/beancontext/BeanContextTest
> api/java/beans/persistence/EncoderDecoderTest
> api/java/beans/persistence/EncoderTest
> reg/vm/btest5625/Btest5625
> (5.2) Old regression in 1 platform
> api/java/rmi/basicexception/BasicException (HARMONY-5823)
> api/java/rmi/basicregistry/RemoteServerTest(HARMONY-5823)
>
> api/java/math/F_BigIntegerMatrixMultiplyTest_01/F_BigIntegerMatrixMultiplyTest_01
> (Timeout)
> org/apache/harmony/test/func/reg/jit/btest5710/Btest5710
> org/apache/harmony/test/func/reg/jit/btest8029/Btest8029
> org/apache/harmony/test/func/jpda/jdwp/scenario/ST07/ST07Test
> org/apache/harmony/test/func/reg/vm/btest5717/Btest5717
> (Timeout, test too heavy)
> jit/HLO/devirt/Runtime/RuntimeExtend1/RuntimeExtend1 (not a
> regression?)
> jit/HLO/inline/ControlFlow/IfElse/IfElse1/IfElseTest1 (looks
> like issue in test)
> org/apache/harmony/test/func/reg/vm/btest6353/Btest6353 (might
> be issue with the test)
> (5.3) New regression in 1 platform
> api/java/io/DataInputStream/DataInputStreamTest
>
> 6: Geronimo Unit Tests:
> The pass rate is 99.6%. There are 3 error tests with similar
> java.lang.NoClassDefFoundError for CORBA some related classes,
> after we updated the YOKO dependencies, as filed in HARMONY-5983.
>
> 7: JDK tools Test.
> We have same timeout issues as M7.
>
> 8: Jetty Scanerio.
> We have same Linux failure due to the unresolved HARMONY-5219.
>
> 9: SpecJVM 2008.
> The test suite pass in Windows X86_64.
> It also pass in Linux32 system with default options.
> However one of the benchmark: compress, will hang in Linux 32 bits
> platform if with -Xem:server option.
>
> 10: Stress Test:
> Besides similar failures as M7 I observed two looks-new regressions
> from jpda tests:
> jpda/jdwp/scenario/MIXED002/MixedTest002
> jpda/jdwp/scenario/EVENT001/EventTest001
> The pass rate is 97.2% in Linux x86 and 98.3% in Windows X86_64
> platform, 0.5% lower than M7.
>
> 11: Struts.
> Same status as M7.
>
>
> 11:
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> On Fri, Nov 7, 2008 at 9:20 PM, Sian January <[EMAIL PROTECTED]>wrote:
>
>> Great - thanks Chunrong. In that case I think we should leave the
>> vote until next week as there is testing still ongoing.
>>
>> 2008/11/7 chunrong lai <[EMAIL PROTECTED]>:
>> > I will upload the snapshot testing result page soon.
>> > The reliability testing has not been finished.
>> >
>> >
>> > On Fri, Nov 7, 2008 at 7:12 PM, Sian January <
>> [EMAIL PROTECTED]>wrote:
>> >
>> >> Are there any objections to starting a vote for M8 later today?
>> >>
>> >> --
>> >> Unless stated otherwise above:
>> >> IBM United Kingdom Limited - Registered in England and Wales with
>> number
>> >> 741598.
>> >> Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6
>> 3AU
>> >>
>> >
>>
>>
>>
>> --
>> Unless stated otherwise above:
>> IBM United Kingdom Limited - Registered in England and Wales with number
>> 741598.
>> Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
>>
>
>
