kalashnikov:hbase.git.commit stack$ python ./dev-support/findHangingTests.py https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/466/consoleText Fetching https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/466/consoleText Building remotely on H4 (Mapreduce zookeeper Hadoop Pig falcon Hdfs) in workspace /home/jenkins/jenkins-slave/workspace/HBase-1.3/jdk/latest1.7/label/Hadoop Printing hanging tests Hanging test : org.apache.hadoop.hbase.procedure2.TestProcedureRecovery Printing Failing tests
Something change in TestProcedureRecovery to make it hang? St.Ack On Wed, Dec 23, 2015 at 8:45 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/466/changes > > > > Changes: > > [anoopsamjohn] HBASE-14940 Make our unsafe based ops more safe. > > ------------------------------------------ > [...truncated 28934 lines...] > Running org.apache.hadoop.hbase.util.TestBytes > Tests run: 31, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.524 sec > - in org.apache.hadoop.hbase.util.TestBytes > Running org.apache.hadoop.hbase.util.TestKeyLocker > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.374 sec > - in org.apache.hadoop.hbase.util.TestKeyLocker > Running org.apache.hadoop.hbase.util.TestCounter > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.018 sec > - in org.apache.hadoop.hbase.util.TestCounter > Running org.apache.hadoop.hbase.util.TestDrainBarrier > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.353 sec > - in org.apache.hadoop.hbase.util.TestDrainBarrier > Running org.apache.hadoop.hbase.util.TestByteRangeWithKVSerialization > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.393 sec > - in org.apache.hadoop.hbase.util.TestByteRangeWithKVSerialization > Running org.apache.hadoop.hbase.util.TestOrder > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.121 sec > - in org.apache.hadoop.hbase.util.TestOrder > Running org.apache.hadoop.hbase.TestClassFinder > Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.48 sec > - in org.apache.hadoop.hbase.TestClassFinder > Running org.apache.hadoop.hbase.TestCellUtil > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.52 sec - > in org.apache.hadoop.hbase.TestCellUtil > Running org.apache.hadoop.hbase.zookeeper.TestZKConfig > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.283 sec > - in org.apache.hadoop.hbase.zookeeper.TestZKConfig > Running org.apache.hadoop.hbase.TestChoreService > Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.313 > sec - in org.apache.hadoop.hbase.TestChoreService > Running org.apache.hadoop.hbase.TestCellComparator > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.13 sec - > in org.apache.hadoop.hbase.TestCellComparator > Running org.apache.hadoop.hbase.TestTimeout > Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.24 sec - > in org.apache.hadoop.hbase.TestTimeout > Running org.apache.hadoop.hbase.codec.TestCellCodec > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.302 sec > - in org.apache.hadoop.hbase.codec.TestCellCodec > Running org.apache.hadoop.hbase.codec.TestCellCodecWithTags > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.183 sec > - in org.apache.hadoop.hbase.codec.TestCellCodecWithTags > Running org.apache.hadoop.hbase.codec.TestKeyValueCodec > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.316 sec > - in org.apache.hadoop.hbase.codec.TestKeyValueCodec > Running org.apache.hadoop.hbase.codec.TestKeyValueCodecWithTags > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.193 sec > - in org.apache.hadoop.hbase.codec.TestKeyValueCodecWithTags > Running org.apache.hadoop.hbase.TestCompoundConfiguration > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.892 sec > - in org.apache.hadoop.hbase.TestCompoundConfiguration > Running org.apache.hadoop.hbase.types.TestFixedLengthWrapper > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.231 sec > - in org.apache.hadoop.hbase.types.TestFixedLengthWrapper > Running org.apache.hadoop.hbase.types.TestCopyOnWriteMaps > Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.452 > sec - in org.apache.hadoop.hbase.types.TestCopyOnWriteMaps > Running org.apache.hadoop.hbase.types.TestStruct > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.138 sec > - in org.apache.hadoop.hbase.types.TestStruct > Running org.apache.hadoop.hbase.types.TestOrderedBlob > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.099 sec > - in org.apache.hadoop.hbase.types.TestOrderedBlob > Running org.apache.hadoop.hbase.types.TestRawString > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.189 sec > - in org.apache.hadoop.hbase.types.TestRawString > Running org.apache.hadoop.hbase.types.TestUnion2 > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.341 sec > - in org.apache.hadoop.hbase.types.TestUnion2 > Running org.apache.hadoop.hbase.types.TestOrderedBlobVar > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.088 sec > - in org.apache.hadoop.hbase.types.TestOrderedBlobVar > Running org.apache.hadoop.hbase.types.TestStructNullExtension > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.227 sec > - in org.apache.hadoop.hbase.types.TestStructNullExtension > Running org.apache.hadoop.hbase.types.TestTerminatedWrapper > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.383 sec > - in org.apache.hadoop.hbase.types.TestTerminatedWrapper > Running org.apache.hadoop.hbase.types.TestOrderedString > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.133 sec > - in org.apache.hadoop.hbase.types.TestOrderedString > > Results : > > Tests run: 235, Failures: 0, Errors: 0, Skipped: 1 > > [INFO] > [INFO] --- maven-surefire-plugin:2.18.1:test (secondPartTestsExecution) @ > hbase-common --- > [INFO] Tests are skipped. > [INFO] > [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources) @ > hbase-common --- > [INFO] Building jar: < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/hbase-common/target/hbase-common-1.3.0-SNAPSHOT-sources.jar > > > [INFO] > [INFO] --- maven-jar-plugin:2.4:test-jar (default) @ hbase-common --- > [INFO] Building jar: < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/hbase-common/target/hbase-common-1.3.0-SNAPSHOT-tests.jar > > > [INFO] > [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ hbase-common --- > [INFO] Building jar: < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/hbase-common/target/hbase-common-1.3.0-SNAPSHOT.jar > > > [INFO] > [INFO] --- maven-install-plugin:2.3.1:install (default-install) @ > hbase-common --- > [INFO] Installing < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/hbase-common/target/hbase-common-1.3.0-SNAPSHOT.jar> > to < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/.repository/org/apache/hbase/hbase-common/1.3.0-SNAPSHOT/hbase-common-1.3.0-SNAPSHOT.jar > > > [INFO] Installing < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/466/artifact/hbase-common/pom.xml> > to < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/.repository/org/apache/hbase/hbase-common/1.3.0-SNAPSHOT/hbase-common-1.3.0-SNAPSHOT.pom > > > [INFO] Installing < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/hbase-common/target/hbase-common-1.3.0-SNAPSHOT-sources.jar> > to < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/.repository/org/apache/hbase/hbase-common/1.3.0-SNAPSHOT/hbase-common-1.3.0-SNAPSHOT-sources.jar > > > [INFO] Installing < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/hbase-common/target/hbase-common-1.3.0-SNAPSHOT-tests.jar> > to < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/.repository/org/apache/hbase/hbase-common/1.3.0-SNAPSHOT/hbase-common-1.3.0-SNAPSHOT-tests.jar > > > [INFO] > [INFO] > ------------------------------------------------------------------------ > [INFO] Building Apache HBase - Procedure 1.3.0-SNAPSHOT > [INFO] > ------------------------------------------------------------------------ > [INFO] > [INFO] --- maven-enforcer-plugin:1.0.1:enforce (enforce) @ hbase-procedure > --- > [INFO] > [INFO] --- buildnumber-maven-plugin:1.3:create-timestamp (default) @ > hbase-procedure --- > [INFO] > [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ > hbase-procedure --- > [INFO] > [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ > hbase-procedure --- > [INFO] Using 'UTF-8' encoding to copy filtered resources. > [INFO] skip non existing resourceDirectory < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/hbase-procedure/src/main/resources > > > [INFO] Copying 3 resources > [INFO] > [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ > hbase-procedure --- > [INFO] Compiling 26 source files to < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/hbase-procedure/target/classes > > > [INFO] > [INFO] --- maven-resources-plugin:2.6:testResources > (default-testResources) @ hbase-procedure --- > [INFO] Using 'UTF-8' encoding to copy filtered resources. > [INFO] Copying 2 resources > [INFO] Copying 3 resources > [INFO] > [INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ > hbase-procedure --- > [INFO] Compiling 10 source files to < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/hbase-procedure/target/test-classes > > > [INFO] > [INFO] --- maven-surefire-plugin:2.18.1:test (default-test) @ > hbase-procedure --- > [INFO] Surefire report directory: < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/hbase-procedure/target/surefire-reports > > > [INFO] Using configured provider > org.apache.maven.surefire.junitcore.JUnitCoreProvider > [INFO] parallel='none', perCoreThreadCount=true, threadCount=0, > useUnlimitedThreads=false, threadCountSuites=0, threadCountClasses=0, > threadCountMethods=0, parallelOptimized=true > > ------------------------------------------------------- > T E S T S > ------------------------------------------------------- > Running org.apache.hadoop.hbase.procedure2.TestProcedureToString > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec > - in org.apache.hadoop.hbase.procedure2.TestProcedureToString > Running org.apache.hadoop.hbase.procedure2.util.TestTimeoutBlockingQueue > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.851 sec > - in org.apache.hadoop.hbase.procedure2.util.TestTimeoutBlockingQueue > Running org.apache.hadoop.hbase.procedure2.TestProcedureExecution > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.549 sec > - in org.apache.hadoop.hbase.procedure2.TestProcedureExecution > Running org.apache.hadoop.hbase.procedure2.TestProcedureRecovery > Running org.apache.hadoop.hbase.procedure2.TestProcedureFairRunQueues > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec > - in org.apache.hadoop.hbase.procedure2.TestProcedureFairRunQueues > Running org.apache.hadoop.hbase.procedure2.store.TestProcedureStoreTracker > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 80.984 sec > - in org.apache.hadoop.hbase.procedure2.store.TestProcedureStoreTracker > Running org.apache.hadoop.hbase.procedure2.store.wal.TestWALProcedureStore > Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.25 sec > - in org.apache.hadoop.hbase.procedure2.store.wal.TestWALProcedureStore > Running org.apache.hadoop.hbase.procedure2.TestYieldProcedures > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.469 sec > - in org.apache.hadoop.hbase.procedure2.TestYieldProcedures > Running org.apache.hadoop.hbase.procedure2.TestProcedureReplayOrder > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.087 sec > - in org.apache.hadoop.hbase.procedure2.TestProcedureReplayOrder > > Results : > > Tests run: 35, Failures: 0, Errors: 0, Skipped: 0 > > [INFO] > ------------------------------------------------------------------------ > [INFO] Reactor Summary: > [INFO] > [INFO] Apache HBase ...................................... SUCCESS > [1:05.828s] > [INFO] Apache HBase - Checkstyle ......................... SUCCESS [6.844s] > [INFO] Apache HBase - Resource Bundle .................... SUCCESS [0.279s] > [INFO] Apache HBase - Annotations ........................ SUCCESS [1.531s] > [INFO] Apache HBase - Protocol ........................... SUCCESS > [20.297s] > [INFO] Apache HBase - Common ............................. SUCCESS > [2:39.162s] > [INFO] Apache HBase - Procedure .......................... FAILURE > [18:33.555s] > [INFO] Apache HBase - Client ............................. SKIPPED > [INFO] Apache HBase - Hadoop Compatibility ............... SKIPPED > [INFO] Apache HBase - Hadoop Two Compatibility ........... SKIPPED > [INFO] Apache HBase - Prefix Tree ........................ SKIPPED > [INFO] Apache HBase - Server ............................. SKIPPED > [INFO] Apache HBase - Testing Util ....................... SKIPPED > [INFO] Apache HBase - Thrift ............................. SKIPPED > [INFO] Apache HBase - Rest ............................... SKIPPED > [INFO] Apache HBase - Shell .............................. SKIPPED > [INFO] Apache HBase - Integration Tests .................. SKIPPED > [INFO] Apache HBase - Examples ........................... SKIPPED > [INFO] Apache HBase - External Block Cache ............... SKIPPED > [INFO] Apache HBase - Assembly ........................... SKIPPED > [INFO] Apache HBase - Shaded ............................. SKIPPED > [INFO] Apache HBase - Shaded - Client .................... SKIPPED > [INFO] Apache HBase - Shaded - Server .................... SKIPPED > [INFO] > ------------------------------------------------------------------------ > [INFO] BUILD FAILURE > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 23:09.459s > [INFO] Finished at: Thu Dec 24 04:44:58 UTC 2015 > [INFO] Final Memory: 59M/1332M > [INFO] > ------------------------------------------------------------------------ > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (default-test) > on project hbase-procedure: There was a timeout or other error in the fork > -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, > please read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn <goals> -rf :hbase-procedure > Build step 'Invoke top-level Maven targets' marked build as failure > Performing Post build task... > Match found for :.* : True > Logical operation result is TRUE > Running script : # Post-build task script. TODO: Check this in and have > all builds reference check-in. > pwd && ls > # NOTE!!!! The below code has been copied and pasted from > ./dev-tools/run-test.sh > # Do not change here without syncing there and vice-versa. > ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test' > | wc -l` > if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then > echo "Suspicious java process found - waiting 30s to see if there are > just slow to stop" > sleep 30 > ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test' > | wc -l` > if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then > echo " {color:red}There appear to be $ZOMBIE_TESTS_COUNT zombie > tests{color}, they should have been killed by surefire but survived" > jps -v | grep surefirebooter | grep -e '-Dhbase.test' > jps -v | grep surefirebooter | grep -e '-Dhbase.test' | cut -d ' ' -f 1 > | xargs -n 1 jstack > # Exit with error > exit 1 > else > echo "We're ok: there is no zombie test, but some tests took some time > to stop" > fi > else > echo "We're ok: there is no zombie test" > fi > [Hadoop] $ /bin/bash -xe /tmp/hudson7566515136721162421.sh > + pwd > <https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/> > + ls > bin > CHANGES.txt > conf > dev-support > hbase-annotations > hbase-assembly > hbase-checkstyle > hbase-client > hbase-common > hbase-examples > hbase-external-blockcache > hbase-hadoop2-compat > hbase-hadoop-compat > hbase-it > hbase-native-client > hbase-prefix-tree > hbase-procedure > hbase-protocol > hbase-resource-bundle > hbase-rest > hbase-server > hbase-shaded > hbase-shell > hbase-testing-util > hbase-thrift > LICENSE.txt > NOTICE.txt > pom.xml > README.txt > src > target > ++ jps -v > ++ grep surefirebooter > ++ grep -e -Dhbase.test > ++ wc -l > + ZOMBIE_TESTS_COUNT=0 > + [[ 0 != 0 ]] > + echo 'We'\''re ok: there is no zombie test' > We're ok: there is no zombie test > POST BUILD TASK : SUCCESS > END OF POST BUILD TASK : 0 > Archiving artifacts > Recording test results >
