They've passed more consistently in the past, they're either concurrency
bugs or network timing related, it would be nice to at least determine
if it's the former or latter.
Cheers,
Peter.
Tom Hobbs wrote:
Are these all new failures, i.e. were they working before? Or are they
"new" failures in that the test categories have only recently been
reactivated and the failures discovered?
Are they a big enough blocker to stop a release?
On Sun, Mar 31, 2013 at 11:31 PM, Peter Firmstone <[email protected]> wrote:
The following test fails 30 times in a run of 130 tests:
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 0
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 0
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
[java] # of tests passed = 0
[java] # of tests passed = 1
100
Buildfile: build.xml
qa.run-tests:
james-brown:
[delete] Deleting directory /opt/src/River_Fixed/**
peterConcurrentPolicy/qa/soul
[mkdir] Created dir: /opt/src/River_Fixed/**
peterConcurrentPolicy/qa/soul
[touch] Creating /opt/src/River_Fixed/**peterConcurrentPolicy/qa/soul/*
*soul.201303312239034808
run-tests:
[java]
[java] ------------------------------**-----------
[java] CONFIGURATION FILE:
[java]
[java] /opt/src/River_Fixed/**peterConcurrentPolicy/qa/src/**
com/sun/jini/test/resources/**qaHarness.prop
[java]
[java] ------------------------------**-----------
[java] SETTING UP THE TEST LIST:
[java]
[java] Adding test: com/sun/jini/test/spec/**javaspace/conformance/
**snapshot/**SnapshotExpirationNotifyTest.**td
[java]
[java] ------------------------------**-----------
[java] GENERAL HARNESS CONFIGURATION INFORMATION:
[java]
[java] Date started:
[java] Sun Mar 31 22:39:37 EST 2013
[java] Installation directory of the JSK:
[java] com.sun.jini.jsk.home=/opt/**src/River_Fixed/**
peterConcurrentPolicy
[java] Installation directory of the harness:
[java] com.sun.jini.qa.home=/opt/src/**River_Fixed/**
peterConcurrentPolicy/qa
[java] Categories being tested:
[java] categories=No Categories
[java] ------------------------------**-----------
[java] ENVIRONMENT PROPERTIES:
[java]
[java] JVM information:
[java] Java HotSpot(TM) Server VM, 20.5-b03, 32 bit VM mode
[java] Sun Microsystems Inc.
[java] OS information:
[java] SunOS, 5.10, sparc
[java]
[java] ------------------------------**-----------
[java] STARTING TO RUN THE TESTS
[java]
[java]
[java] Running com/sun/jini/test/spec/**javaspace/conformance/**
snapshot/**SnapshotExpirationNotifyTest.**td
[java] Time is Sun Mar 31 22:39:38 EST 2013
[java] Starting test in separate process with command:
[java] /usr/jdk/jdk1.6.0_30/jre/bin/**java
-Djava.security.manager=org.**apache.river.api.security.**CombinerSecurityManager
-Djava.security.policy=file:/**opt/src/River_Fixed/**
peterConcurrentPolicy/qa/**harness/policy/defaulttest.**policy
-Djava.rmi.server.codebase=htt**p://bluto:9082/qa1-javaspace-**dl.jar<http://bluto:9082/qa1-javaspace-dl.jar>-cp
/opt/src/River_Fixed/
**peterConcurrentPolicy/qa/lib/**jiniharness.jar:/opt/src/**River_Fixed/**
peterConcurrentPolicy/qa/lib/**jinitests.jar:/opt/src/River_**
Fixed/peterConcurrentPolicy/**lib/jsk-platform.jar:/opt/src/**River_Fixed/
**peterConcurrentPolicy/lib/jsk-**lib.jar:/opt/src/River_Fixed/**
peterConcurrentPolicy/lib/**high-scale-lib.jar:/opt/src/**River_Fixed/**
peterConcurrentPolicy/lib/**custard-apple-1.0.2.jar -ea -esa -client
-Djava.ext.dirs=/usr/jdk/jdk1.**6.0_30/jre/lib/ext:/usr/jdk/**
packages/lib/ext:/opt/src/**River_Fixed/**peterConcurrentPolicy/qa/lib-**
ext:/opt/src/River_Fixed/**peterConcurrentPolicy/lib-ext
-Dcom.sun.jini.jsk.port=9080 -Dcom.sun.jini.qa.port=9081
-Dcom.sun.jini.jsk.home=/opt/**src/River_Fixed/**peterConcurrentPolicy
-Dcom.sun.jini.qa.home=/opt/**src/River_Fixed/**peterConcurrentPolicy/qa
-Dcom.sun.jini.qa.harness.**harnessJar=/opt/src/River_**
Fixed/peterConcurrentPolicy/**qa/lib/jiniharness.jar
-Dcom.sun.jini.qa.harness.**testJar=/opt/src/River_Fixed/**
peterConcurrentPolicy/qa/lib/**jinitests.jar
-Dcom.sun.jini.qa.harness.**runjiniserver=true
-Dcom.sun.jini.qa.harness.**runkitserver=true -Djava.security.properties=*
*file:/opt/src/River_Fixed/**peterConcurrentPolicy/qa/**
harness/trust/dynamic-policy.**properties -Dcom.sun.jini.qa.harness.**testhosts=
-Djava.util.logging.config.**file=/home/peter/logging.**properties
-Dcom.sun.jini.test.home=/opt/**src/River_Fixed/**peterConcurrentPolicy/qa
-Dcom.sun.jini.test.port=9082 -Dcom.sun.jini.qa.harness.**
policies=file:/opt/src/River_**Fixed/peterConcurrentPolicy/**
qa/src/com/sun/jini/test/**resources/jinitest.policy
-Djava.ext.dirs=/usr/jdk/jdk1.**6.0_30/jre/lib/ext:/usr/jdk/**
packages/lib/ext:/opt/src/**River_Fixed/**peterConcurrentPolicy/qa/lib-**
ext:/opt/src/River_Fixed/**peterConcurrentPolicy/lib-ext
com.sun.jini.qa.harness.**MasterTest com/sun/jini/test/spec/**
javaspace/conformance/**snapshot/**SnapshotExpirationNotifyTest.**td
[java] com.sun.jini.qa.harness.**TestException: Not all listeners've
got expected number of events.
[java] at com.sun.jini.test.spec.**javaspace.conformance.**
snapshot.**SnapshotExpirationNotifyTest.**run(**
SnapshotExpirationNotifyTest.**java:370)
[java] at com.sun.jini.qa.harness.**MasterTest.doTest(MasterTest.*
*java:256)
[java] at com.sun.jini.qa.harness.**MasterTest.main(MasterTest.**
java:144)
[java]
[java] TIME: 10:42:54 PM
[java]
[java] Test process was destroyed and returned code 1
[java] com/sun/jini/test/spec/**javaspace/conformance/**snapshot/**
SnapshotExpirationNotifyTest.**td
[java] Test Failed: Test Failed: com.sun.jini.qa.harness.**TestException:
Not all listeners've got expected number of events.
[java]
[java]
[java] ------------------------------**-----------
[java]
[java] SUMMARY ==============================**===
[java]
[java] com/sun/jini/test/spec/**javaspace/conformance/**snapshot/**
SnapshotExpirationNotifyTest.**td
[java] Test Failed: Test Failed: com.sun.jini.qa.harness.**TestException:
Not all listeners've got expected number of events.
[java]
[java] ------------------------------**-----------
[java]
[java] # of tests started = 1
[java] # of tests completed = 1
[java] # of tests passed = 0
[java] # of tests failed = 1
[java]
[java] ------------------------------**-----------
[java]
[java] Date finished:
[java] Sun Mar 31 22:42:59 EST 2013
[java] Time elapsed:
[java] 201 seconds
[java]
[java] Java Result: 1
collect-result:
BUILD FAILED
/opt/src/River_Fixed/**peterConcurrentPolicy/build.**xml:2105: The
following error occurred while executing this line:
/opt/src/River_Fixed/**peterConcurrentPolicy/qa/**build.xml:357:
condition satisfied
Total time: 3 minutes 30 seconds
