See <https://builds.apache.org/job/HBase-TRUNK/4546/changes>
Changes: [stack] HBASE-9610 TestThriftServer.testAll failing; DEBUGGING ------------------------------------------ [...truncated 4177 lines...] Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2 Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 404.395 sec Running org.apache.hadoop.hbase.mapreduce.TestImportExport Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 381.045 sec Running org.apache.hadoop.hbase.trace.TestHTraceHooks Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.001 sec Running org.apache.hadoop.hbase.TestAcidGuarantees Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 143.162 sec Running org.apache.hadoop.hbase.snapshot.TestSnapshotDescriptionUtils Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.685 sec Running org.apache.hadoop.hbase.snapshot.TestExportSnapshot Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.144 sec Running org.apache.hadoop.hbase.snapshot.TestRestoreFlushSnapshotFromClient Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 267.123 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditorNoCluster Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.756 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.493 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.704 sec Running org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 259.068 sec Running org.apache.hadoop.hbase.catalog.TestMetaMigrationConvertingToPB Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.891 sec Running org.apache.hadoop.hbase.client.TestTimestampsFilter Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.846 sec Running org.apache.hadoop.hbase.client.TestFromClientSide3 Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 88.864 sec Running org.apache.hadoop.hbase.client.TestShell Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 167.645 sec Running org.apache.hadoop.hbase.client.TestClientTimeouts Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.639 sec Running org.apache.hadoop.hbase.client.TestScannersFromClientSide Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.033 sec Running org.apache.hadoop.hbase.client.TestFromClientSide Tests run: 66, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 263.699 sec Running org.apache.hadoop.hbase.client.TestHCM Tests run: 15, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 108.152 sec Running org.apache.hadoop.hbase.client.TestScannerTimeout Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.414 sec Running org.apache.hadoop.hbase.client.TestHTableMultiplexer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.175 sec Running org.apache.hadoop.hbase.client.TestMetaScanner Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 67.302 sec Running org.apache.hadoop.hbase.client.TestHTableUtil Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.205 sec Running org.apache.hadoop.hbase.client.TestFromClientSideWithCoprocessor Tests run: 66, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 231.898 sec Running org.apache.hadoop.hbase.client.TestSnapshotFromClient Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.801 sec Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableReusablePool Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.771 sec Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.307 sec Running org.apache.hadoop.hbase.client.TestSnapshotMetadata Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.529 sec Running org.apache.hadoop.hbase.client.TestMultipleTimestamps Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.918 sec Running org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClient Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 412.862 sec Running org.apache.hadoop.hbase.client.TestSnapshotCloneIndependence Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 113.733 sec Running org.apache.hadoop.hbase.client.replication.TestReplicationAdmin Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.099 sec Running org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.816 sec Running org.apache.hadoop.hbase.client.TestMultiParallel Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 99.714 sec Running org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 372.154 sec Running org.apache.hadoop.hbase.client.TestFromClientSideNoCodec Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.935 sec Running org.apache.hadoop.hbase.constraint.TestConstraint Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.81 sec Running org.apache.hadoop.hbase.rest.TestGzipFilter Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.962 sec Running org.apache.hadoop.hbase.rest.TestMultiRowResource Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.627 sec Running org.apache.hadoop.hbase.rest.TestScannersWithFilters Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.064 sec Running org.apache.hadoop.hbase.client.TestAdmin Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 591.735 sec Running org.apache.hadoop.hbase.rest.client.TestRemoteTable Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.138 sec Running org.apache.hadoop.hbase.rest.TestVersionResource Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.749 sec Running org.apache.hadoop.hbase.rest.TestRowResource Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 88.465 sec Running org.apache.hadoop.hbase.rest.TestScannerResource Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.532 sec Running org.apache.hadoop.hbase.rest.TestStatusResource Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.192 sec Running org.apache.hadoop.hbase.rest.TestTableResource Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.033 sec Running org.apache.hadoop.hbase.rest.TestSchemaResource Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.524 sec Running org.apache.hadoop.hbase.io.encoding.TestLoadAndSwitchEncodeOnDisk Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.389 sec Running org.apache.hadoop.hbase.TestIOFencing Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 128.337 sec Running org.apache.hadoop.hbase.io.encoding.TestEncodedSeekers Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 75.637 sec Running org.apache.hadoop.hbase.io.encoding.TestBufferedDataBlockEncoder Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.745 sec Running org.apache.hadoop.hbase.io.encoding.TestChangingEncoding Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 182.362 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileSeek Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.316 sec Running org.apache.hadoop.hbase.io.hfile.slab.TestSlabCache Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.857 sec Running org.apache.hadoop.hbase.io.hfile.slab.TestSingleSizeCache Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.557 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileBlockIndex Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.714 sec Running org.apache.hadoop.hbase.io.hfile.TestHFilePerformance Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.78 sec Running org.apache.hadoop.hbase.io.encoding.TestDataBlockEncoders Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 236.556 sec Running org.apache.hadoop.hbase.io.hfile.TestForceCacheImportantBlocks Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.802 sec Running org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.273 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileBlock Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 100.865 sec Running org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite Tests run: 36, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 99.561 sec Running org.apache.hadoop.hbase.io.TestFileLink Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.423 sec Running org.apache.hadoop.hbase.TestClusterBootOrder Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.33 sec Running org.apache.hadoop.hbase.migration.TestUpgradeTo96 Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.343 sec Running org.apache.hadoop.hbase.migration.TestNamespaceUpgrade Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 104.732 sec Running org.apache.hadoop.hbase.replication.TestReplicationKillMasterRSCompressed Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 103.64 sec Running org.apache.hadoop.hbase.replication.TestReplicationChangingPeerRegionservers Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 70.238 sec Running org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 86.113 sec Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.201 sec Running org.apache.hadoop.hbase.replication.TestReplicationKillMasterRS Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 86.846 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.415 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.206 sec Running org.apache.hadoop.hbase.replication.TestReplicationTrackerZKImpl Tests run: 4, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 1.437 sec Running org.apache.hadoop.hbase.replication.TestReplicationStateZKImpl Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.685 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationHLogReaderManager Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 183.894 sec Running org.apache.hadoop.hbase.replication.TestReplicationSource Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.79 sec Running org.apache.hadoop.hbase.replication.TestMasterReplication Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 183.064 sec Running org.apache.hadoop.hbase.replication.TestReplicationSmallTests Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 127.404 sec Running org.apache.hadoop.hbase.ipc.TestDelayedRpc Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.147 sec Running org.apache.hadoop.hbase.ipc.TestProtoBufRpc Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.839 sec Running org.apache.hadoop.hbase.ipc.TestHBaseClient Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.249 sec Running org.apache.hadoop.hbase.replication.TestReplicationKillSlaveRS Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 96.217 sec Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 88.797 sec Running org.apache.hadoop.hbase.TestHBaseTestingUtility Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 113.825 sec Results : Tests run: 1593, Failures: 0, Errors: 0, Skipped: 21 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] HBase ............................................. SUCCESS [11.218s] [INFO] HBase - Common .................................... SUCCESS [23.836s] [INFO] HBase - Protocol .................................. SUCCESS [18.613s] [INFO] HBase - Client .................................... SUCCESS [21.315s] [INFO] HBase - Hadoop Compatibility ...................... SUCCESS [5.456s] [INFO] HBase - Hadoop One Compatibility .................. SUCCESS [1.687s] [INFO] HBase - Prefix Tree ............................... SUCCESS [4.070s] [INFO] HBase - Server .................................... FAILURE [2:35:42.685s] [INFO] HBase - Thrift .................................... SKIPPED [INFO] HBase - Integration Tests ......................... SKIPPED [INFO] HBase - Examples .................................. SKIPPED [INFO] HBase - Assembly .................................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 2:37:09.620s [INFO] Finished at: Sun Sep 22 04:48:32 UTC 2013 [INFO] Final Memory: 31M/542M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (secondPartTestsExecution) on project hbase-server: Failure or timeout -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hbase-server Build step 'Invoke top-level Maven targets' marked build as failure Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l` if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then #It seems sometimes the tests are not dying immediately. Let's give them 10s echo "Suspicious java process found - waiting 10s to see if there are just slow to stop" sleep 10 ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l` if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then echo "There are $ZOMBIE_TESTS_COUNT zombie tests, they should have been killed by surefire but survived" echo "************ BEGIN zombies jstack extract" ZB_STACK=`jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 jstack | grep ".test" | grep "\.java"` jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 jstack echo "************ END zombies jstack extract" JIRA_COMMENT="$JIRA_COMMENT {color:red}-1 core zombie tests{color}. There are ${ZOMBIE_TESTS_COUNT} zombie test(s): ${ZB_STACK}" BAD=1 jps | grep surefirebooter | cut -d ' ' -f 1 | xargs kill -9 else echo "We're ok: there is no zombie test, but some tests took some time to stop" fi else echo "We're ok: there is no zombie test" fi [HBase-TRUNK] $ /bin/bash -xe /tmp/hudson3915520814114751595.sh ++ jps ++ wc -l ++ grep surefirebooter + ZOMBIE_TESTS_COUNT=0 + [[ 0 != 0 ]] + echo 'We'\''re ok: there is no zombie test' We're ok: there is no zombie test POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 0 Archiving artifacts Recording test results Updating HBASE-9610
