See <https://builds.apache.org/job/hbase-0.96-hadoop2/183/changes>
Changes: [jdcryans] HBASE-10249 TestReplicationSyncUpTool fails because failover takes too long ------------------------------------------ [...truncated 4508 lines...] Running org.apache.hadoop.hbase.client.replication.TestReplicationAdmin Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.475 sec Running org.apache.hadoop.hbase.client.TestTimestampsFilter Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.416 sec Running org.apache.hadoop.hbase.client.TestSnapshotCloneIndependence Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.739 sec Running org.apache.hadoop.hbase.client.TestMultipleTimestamps Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.047 sec Running org.apache.hadoop.hbase.client.TestFromClientSideNoCodec Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.967 sec Running org.apache.hadoop.hbase.client.TestFromClientSideWithCoprocessor Tests run: 67, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 133.971 sec Running org.apache.hadoop.hbase.client.TestHTableMultiplexer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.707 sec Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableReusablePool Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.423 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 438.617 sec Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.714 sec Running org.apache.hadoop.hbase.client.TestHCM Tests run: 15, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 72.18 sec Running org.apache.hadoop.hbase.client.TestHTableUtil Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.928 sec Running org.apache.hadoop.hbase.client.TestSnapshotFromClient Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.481 sec Running org.apache.hadoop.hbase.client.TestFromClientSide Tests run: 67, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 160.314 sec Running org.apache.hadoop.hbase.client.TestFromClientSide3 Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 92.023 sec Running org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClient Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 262.394 sec Running org.apache.hadoop.hbase.client.TestMetaScanner Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.433 sec Running org.apache.hadoop.hbase.client.TestScannerTimeout Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.34 sec Running org.apache.hadoop.hbase.client.TestScannersFromClientSide Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.51 sec Running org.apache.hadoop.hbase.TestMultiVersions Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.134 sec Running org.apache.hadoop.hbase.master.TestRollingRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.412 sec Running org.apache.hadoop.hbase.master.TestActiveMasterManager Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.46 sec Running org.apache.hadoop.hbase.master.TestDeadServer Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.407 sec Running org.apache.hadoop.hbase.master.TestRegionPlacement Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.855 sec Running org.apache.hadoop.hbase.client.TestMultiParallel Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 71.427 sec Running org.apache.hadoop.hbase.master.TestMasterNoCluster Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.734 sec Running org.apache.hadoop.hbase.master.balancer.TestDefaultLoadBalancer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.467 sec Running org.apache.hadoop.hbase.master.balancer.TestBaseLoadBalancer Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.743 sec Running org.apache.hadoop.hbase.master.TestMasterMetrics Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.466 sec Running org.apache.hadoop.hbase.master.TestZKBasedOpenCloseRegion Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.643 sec Running org.apache.hadoop.hbase.master.TestMasterFileSystem Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.301 sec Running org.apache.hadoop.hbase.master.handler.TestTableDeleteFamilyHandler Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.267 sec Running org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 147.572 sec Running org.apache.hadoop.hbase.master.handler.TestTableDescriptorModification Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.431 sec Running org.apache.hadoop.hbase.master.TestMaster Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.416 sec Running org.apache.hadoop.hbase.master.handler.TestCreateTableHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.373 sec Running org.apache.hadoop.hbase.master.TestMasterTransitions Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 17.301 sec Running org.apache.hadoop.hbase.master.snapshot.TestSnapshotFileCache Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.944 sec Running org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancer Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 78.69 sec Running org.apache.hadoop.hbase.master.TestOpenedRegionHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.389 sec Running org.apache.hadoop.hbase.master.TestMasterMetricsWrapper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.008 sec Running org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.784 sec Running org.apache.hadoop.hbase.master.TestAssignmentManager Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.408 sec Running org.apache.hadoop.hbase.master.TestAssignmentManagerOnCluster Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.859 sec Running org.apache.hadoop.hbase.master.TestMasterStatusServlet Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.639 sec Running org.apache.hadoop.hbase.master.TestHMasterRPCException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.385 sec Running org.apache.hadoop.hbase.master.TestSplitLogManager Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 90.215 sec Running org.apache.hadoop.hbase.master.TestMasterShutdown Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.828 sec Running org.apache.hadoop.hbase.master.TestMasterFailover Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 67.872 sec Running org.apache.hadoop.hbase.master.cleaner.TestHFileCleaner Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.694 sec Running org.apache.hadoop.hbase.master.TestTableLockManager Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 109.675 sec Running org.apache.hadoop.hbase.master.TestClusterStatusPublisher Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.399 sec Running org.apache.hadoop.hbase.master.cleaner.TestLogsCleaner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.84 sec Running org.apache.hadoop.hbase.master.TestMasterFailoverBalancerPersistence Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.701 sec Running org.apache.hadoop.hbase.master.cleaner.TestSnapshotFromMaster Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.559 sec Running org.apache.hadoop.hbase.master.TestRestartCluster Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.846 sec Running org.apache.hadoop.hbase.client.TestAdmin Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 423.791 sec Running org.apache.hadoop.hbase.migration.TestUpgradeTo96 Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.063 sec Running org.apache.hadoop.hbase.migration.TestNamespaceUpgrade Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.766 sec Running org.apache.hadoop.hbase.ipc.TestProtoBufRpc Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.697 sec Running org.apache.hadoop.hbase.ipc.TestDelayedRpc Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.62 sec Running org.apache.hadoop.hbase.ipc.TestHBaseClient Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.358 sec Running org.apache.hadoop.hbase.TestInfoServers Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.464 sec Running org.apache.hadoop.hbase.TestRegionRebalancing Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.631 sec Running org.apache.hadoop.hbase.procedure.TestZKProcedureControllers Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.082 sec Running org.apache.hadoop.hbase.procedure.TestZKProcedure Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.923 sec Running org.apache.hadoop.hbase.TestAcidGuarantees Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.823 sec Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 238.178 sec Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.537 sec Running org.apache.hadoop.hbase.TestIOFencing Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.492 sec Results : Tests in error: testRSTermnationAfterRegisteringToMasterBeforeCreatingEphemeralNod(org.apache.hadoop.hbase.regionserver.TestRSKilledWhenInitializing): test timed out after 180000 milliseconds Tests run: 1522, Failures: 0, Errors: 1, Skipped: 21 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping HBase [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] HBase ............................................. SUCCESS [13.138s] [INFO] HBase - Common .................................... SUCCESS [34.834s] [INFO] HBase - Protocol .................................. SUCCESS [9.021s] [INFO] HBase - Client .................................... SUCCESS [39.912s] [INFO] HBase - Hadoop Compatibility ...................... SUCCESS [5.473s] [INFO] HBase - Hadoop Two Compatibility .................. SUCCESS [2.632s] [INFO] HBase - Prefix Tree ............................... SUCCESS [4.729s] [INFO] HBase - Server .................................... FAILURE [50:20.423s] [INFO] HBase - Testing Util .............................. SKIPPED [INFO] HBase - Thrift .................................... SKIPPED [INFO] HBase - Shell ..................................... SKIPPED [INFO] HBase - Integration Tests ......................... SKIPPED [INFO] HBase - Examples .................................. SKIPPED [INFO] HBase - Assembly .................................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 52:17.472s [INFO] Finished at: Wed Jan 22 00:37:43 UTC 2014 [INFO] Final Memory: 45M/747M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (secondPartTestsExecution) on project hbase-server: There are test failures. [ERROR] [ERROR] Please refer to /home/hudson/jenkins-slave/workspace/hbase-0.96-hadoop2/0.96-on-hadoop2/hbase-server/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hbase-server Build step 'Invoke top-level Maven targets' marked build as failure Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l` if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then #It seems sometimes the tests are not dying immediately. Let's give them 10s echo "Suspicious java process found - waiting 10s to see if there are just slow to stop" sleep 10 ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l` if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then echo "There are $ZOMBIE_TESTS_COUNT zombie tests, they should have been killed by surefire but survived" echo "************ BEGIN zombies jstack extract" ZB_STACK=`jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 jstack | grep ".test" | grep "\.java"` jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 jstack echo "************ END zombies jstack extract" JIRA_COMMENT="$JIRA_COMMENT {color:red}-1 core zombie tests{color}. There are ${ZOMBIE_TESTS_COUNT} zombie test(s): ${ZB_STACK}" BAD=1 jps | grep surefirebooter | cut -d ' ' -f 1 | xargs kill -9 else echo "We're ok: there is no zombie test, but some tests took some time to stop" fi else echo "We're ok: there is no zombie test" fi [hbase-0.96-hadoop2] $ /bin/bash -xe /tmp/hudson2769393880606341142.sh ++ jps ++ grep surefirebooter ++ wc -l + ZOMBIE_TESTS_COUNT=1 + [[ 1 != 0 ]] + echo 'Suspicious java process found - waiting 10s to see if there are just slow to stop' Suspicious java process found - waiting 10s to see if there are just slow to stop + sleep 10 ++ jps ++ grep surefirebooter ++ wc -l + ZOMBIE_TESTS_COUNT=1 + [[ 1 != 0 ]] + echo 'There are 1 zombie tests, they should have been killed by surefire but survived' There are 1 zombie tests, they should have been killed by surefire but survived + echo '************ BEGIN zombies jstack extract' ************ BEGIN zombies jstack extract ++ jps ++ grep surefirebooter ++ cut -d ' ' -f 1 ++ xargs -n 1 jstack ++ grep .test ++ grep '\.java' 1906: Unable to open socket file: target process not responding or HotSpot VM not loaded The -F option can be used when the target process is not responding + ZB_STACK= POST BUILD TASK : FAILURE END OF POST BUILD TASK : 0 Archiving artifacts Recording test results Updating HBASE-10249
