Failed here: TestZooKeeper.testRegionAssignmentAfterMasterRecoveryDueToZKExpiry:518 expected:<16> but was:<17>
Odd. On Tue, Sep 16, 2014 at 11:16 AM, Apache Jenkins Server < [email protected]> wrote: > See <https://builds.apache.org/job/HBase-TRUNK/5512/changes> > > Changes: > > [jxiang] HBASE-11961 Document region state transitions (Jimmy Xiang and > Misty Stanley-Jones) > > [jxiang] HBASE-11976 Server startcode is not checked for bulk region > assignment > > ------------------------------------------ > [...truncated 1785 lines...] > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.845 sec > - in org.apache.hadoop.hbase.rest.TestVersionResource > Running org.apache.hadoop.hbase.rest.TestStatusResource > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.247 sec > - in org.apache.hadoop.hbase.rest.TestStatusResource > Running org.apache.hadoop.hbase.rest.TestTableScan > Running org.apache.hadoop.hbase.rest.TestScannerResource > Running org.apache.hadoop.hbase.rest.TestScannersWithLabels > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.583 sec > - in org.apache.hadoop.hbase.rest.TestScannerResource > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.962 sec > - in org.apache.hadoop.hbase.rest.TestScannersWithLabels > Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.128 > sec - in org.apache.hadoop.hbase.rest.TestTableScan > Running org.apache.hadoop.hbase.rest.TestScannersWithFilters > Running org.apache.hadoop.hbase.io.hfile.TestHFileBlockIndex > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.707 sec > - in org.apache.hadoop.hbase.io.hfile.TestHFileBlockIndex > Tests run: 46, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 114.2 sec > - in org.apache.hadoop.hbase.security.access.TestAccessController > Running org.apache.hadoop.hbase.io.hfile.TestHFileSeek > Running org.apache.hadoop.hbase.io.hfile.TestCacheConfig > Running org.apache.hadoop.hbase.io.hfile.TestForceCacheImportantBlocks > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.421 sec > - in org.apache.hadoop.hbase.io.hfile.TestCacheConfig > Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.764 sec > - in org.apache.hadoop.hbase.rest.TestScannersWithFilters > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.927 sec > - in org.apache.hadoop.hbase.io.hfile.TestHFileSeek > Running org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite > Running org.apache.hadoop.hbase.trace.TestHTraceHooks > Running org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL > Running org.apache.hadoop.hbase.io.hfile.TestHFileBlock > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.89 sec - > in org.apache.hadoop.hbase.trace.TestHTraceHooks > Running org.apache.hadoop.hbase.io.TestFileLink > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.981 sec > - in org.apache.hadoop.hbase.io.TestFileLink > Running org.apache.hadoop.hbase.io.encoding.TestEncodedSeekers > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.484 sec > - in org.apache.hadoop.hbase.io.hfile.TestForceCacheImportantBlocks > Running org.apache.hadoop.hbase.io.encoding.TestChangingEncoding > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.665 sec > - in org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL > Running org.apache.hadoop.hbase.io.encoding.TestDataBlockEncoders > Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 96.485 > sec - in org.apache.hadoop.hbase.io.hfile.TestHFileBlock > Running org.apache.hadoop.hbase.io.encoding.TestPrefixTree > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.719 sec > - in org.apache.hadoop.hbase.io.encoding.TestChangingEncoding > Running org.apache.hadoop.hbase.io.encoding.TestBufferedDataBlockEncoder > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.781 sec > - in org.apache.hadoop.hbase.io.encoding.TestPrefixTree > Running org.apache.hadoop.hbase.io.encoding.TestLoadAndSwitchEncodeOnDisk > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.284 sec > - in org.apache.hadoop.hbase.io.encoding.TestBufferedDataBlockEncoder > Running org.apache.hadoop.hbase.TestRegionRebalancing > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.847 sec > - in org.apache.hadoop.hbase.io.encoding.TestLoadAndSwitchEncodeOnDisk > Tests run: 72, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 135.936 > sec - in org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite > Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 111.045 > sec - in org.apache.hadoop.hbase.io.encoding.TestEncodedSeekers > Running org.apache.hadoop.hbase.TestHColumnDescriptorDefaultVersions > Running org.apache.hadoop.hbase.mapred.TestTableInputFormat > Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.646 sec > - in org.apache.hadoop.hbase.mapred.TestTableInputFormat > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.803 sec > - in org.apache.hadoop.hbase.TestHColumnDescriptorDefaultVersions > Running org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat > Running org.apache.hadoop.hbase.mapred.TestTableMapReduceUtil > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.861 sec > - in org.apache.hadoop.hbase.TestRegionRebalancing > Running org.apache.hadoop.hbase.replication.TestReplicationTrackerZKImpl > Tests run: 4, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.794 sec > - in org.apache.hadoop.hbase.replication.TestReplicationTrackerZKImpl > Running org.apache.hadoop.hbase.mapred.TestTableMapReduce > Running org.apache.hadoop.hbase.replication.TestReplicationEndpoint > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.876 sec > - in org.apache.hadoop.hbase.replication.TestReplicationEndpoint > Running > org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.409 sec > - in org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer > Running > org.apache.hadoop.hbase.replication.TestReplicationKillMasterRSCompressed > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 82.788 sec > - in org.apache.hadoop.hbase.mapred.TestTableMapReduceUtil > Running org.apache.hadoop.hbase.replication.TestPerTableCFReplication > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.757 sec > - in > org.apache.hadoop.hbase.replication.TestReplicationKillMasterRSCompressed > Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 204.023 > sec - in org.apache.hadoop.hbase.io.encoding.TestDataBlockEncoders > Running > org.apache.hadoop.hbase.replication.regionserver.TestReplicationHLogReaderManager > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 91.823 sec > - in org.apache.hadoop.hbase.mapred.TestTableMapReduce > Running > org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager > Running > org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.859 sec > - in org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.54 sec - > in > org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager > Running > org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.25 sec > - in org.apache.hadoop.hbase.replication.TestPerTableCFReplication > Running > org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpointNoMaster > Running org.apache.hadoop.hbase.replication.TestReplicationSource > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.427 sec > - in org.apache.hadoop.hbase.replication.TestReplicationSource > Running > org.apache.hadoop.hbase.replication.TestReplicationChangingPeerRegionservers > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.391 sec > - in > org.apache.hadoop.hbase.replication.TestReplicationChangingPeerRegionservers > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.672 sec > - in > org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpointNoMaster > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.947 sec > - in > org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint > Running org.apache.hadoop.hbase.replication.TestReplicationSyncUpTool > Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication > Running org.apache.hadoop.hbase.replication.TestReplicationKillMasterRS > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.549 sec > - in org.apache.hadoop.hbase.replication.TestReplicationKillMasterRS > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.508 sec > - in org.apache.hadoop.hbase.replication.TestMultiSlaveReplication > Running org.apache.hadoop.hbase.replication.TestReplicationWithTags > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.329 sec > - in org.apache.hadoop.hbase.replication.TestReplicationWithTags > Running org.apache.hadoop.hbase.replication.TestReplicationKillSlaveRS > Running org.apache.hadoop.hbase.replication.TestReplicationStateZKImpl > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.289 sec > - in org.apache.hadoop.hbase.replication.TestReplicationStateZKImpl > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.71 sec > - in org.apache.hadoop.hbase.replication.TestReplicationSyncUpTool > Running org.apache.hadoop.hbase.replication.TestMasterReplication > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.303 sec > - in org.apache.hadoop.hbase.replication.TestReplicationKillSlaveRS > Running org.apache.hadoop.hbase.util.TestMergeTool > Running org.apache.hadoop.hbase.replication.TestReplicationSmallTests > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 271.026 > sec - in org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat > Running org.apache.hadoop.hbase.util.TestFSTableDescriptors > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.679 sec > - in org.apache.hadoop.hbase.util.TestMergeTool > Running org.apache.hadoop.hbase.util.TestHBaseFsckEncryption > Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.463 sec > - in org.apache.hadoop.hbase.util.TestFSTableDescriptors > Running org.apache.hadoop.hbase.util.TestIdLock > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.303 sec > - in org.apache.hadoop.hbase.util.TestIdLock > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.28 sec > - in org.apache.hadoop.hbase.util.TestHBaseFsckEncryption > Running org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential > Running org.apache.hadoop.hbase.util.TestMergeTable > Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.005 sec > - in org.apache.hadoop.hbase.replication.TestReplicationSmallTests > Running org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.79 sec > - in org.apache.hadoop.hbase.util.TestMergeTable > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 75.964 sec > - in org.apache.hadoop.hbase.replication.TestMasterReplication > Running org.apache.hadoop.hbase.util.TestFSUtils > Running org.apache.hadoop.hbase.util.TestHBaseFsck > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 226.767 > sec - in > org.apache.hadoop.hbase.replication.regionserver.TestReplicationHLogReaderManager > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.613 sec > - in org.apache.hadoop.hbase.util.TestFSUtils > Running org.apache.hadoop.hbase.util.TestProcessBasedCluster > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.074 sec > - in org.apache.hadoop.hbase.util.TestProcessBasedCluster > Running org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.82 sec > - in org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential > Running org.apache.hadoop.hbase.util.TestRegionSplitter > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.295 sec > - in org.apache.hadoop.hbase.util.TestRegionSplitter > Running org.apache.hadoop.hbase.util.TestFSVisitor > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.631 sec > - in org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel > Running org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildBase > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.951 sec > - in org.apache.hadoop.hbase.util.TestFSVisitor > Running org.apache.hadoop.hbase.util.TestCoprocessorScanPolicy > Running org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildOverlap > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.678 sec > - in org.apache.hadoop.hbase.util.TestCoprocessorScanPolicy > Running org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildHole > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.267 sec > - in org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildBase > Running org.apache.hadoop.hbase.util.TestDefaultEnvironmentEdge > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.405 sec > - in org.apache.hadoop.hbase.util.TestDefaultEnvironmentEdge > Running org.apache.hadoop.hbase.util.TestFSHDFSUtils > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.42 sec > - in org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildOverlap > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.816 sec > - in org.apache.hadoop.hbase.util.TestFSHDFSUtils > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.541 sec > - in org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildHole > Running org.apache.hadoop.hbase.TestMetaTableAccessorNoCluster > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.407 sec > - in org.apache.hadoop.hbase.TestMetaTableAccessorNoCluster > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.804 sec > - in org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded > Running org.apache.hadoop.hbase.TestInfoServers > Running org.apache.hadoop.hbase.TestNamespace > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.236 sec > - in org.apache.hadoop.hbase.TestInfoServers > Running org.apache.hadoop.hbase.TestMetaTableAccessor > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.943 sec > - in org.apache.hadoop.hbase.TestMetaTableAccessor > Tests run: 9, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 9.648 sec > - in org.apache.hadoop.hbase.TestNamespace > Tests run: 46, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 277.106 > sec - in org.apache.hadoop.hbase.util.TestHBaseFsck > > Results : > > Failed tests: > TestZooKeeper.testRegionAssignmentAfterMasterRecoveryDueToZKExpiry:518 > expected:<16> but was:<17> > > Tests run: 2007, Failures: 1, Errors: 0, Skipped: 19 > > [INFO] > ------------------------------------------------------------------------ > [INFO] Reactor Summary: > [INFO] > [INFO] HBase ............................................. SUCCESS [5.887s] > [INFO] HBase - Common .................................... SUCCESS > [1:09.826s] > [INFO] HBase - Protocol .................................. SUCCESS [8.335s] > [INFO] HBase - Client .................................... SUCCESS > [1:03.982s] > [INFO] HBase - Hadoop Compatibility ...................... SUCCESS [7.076s] > [INFO] HBase - Hadoop Two Compatibility .................. SUCCESS [5.680s] > [INFO] HBase - Prefix Tree ............................... SUCCESS [7.938s] > [INFO] HBase - Server .................................... FAILURE > [1:03:56.285s] > [INFO] HBase - Testing Util .............................. SKIPPED > [INFO] HBase - Thrift .................................... SKIPPED > [INFO] HBase - Shell ..................................... SKIPPED > [INFO] HBase - Integration Tests ......................... SKIPPED > [INFO] HBase - Examples .................................. SKIPPED > [INFO] HBase - Assembly .................................. SKIPPED > [INFO] > ------------------------------------------------------------------------ > [INFO] BUILD FAILURE > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 1:06:45.904s > [INFO] Finished at: Tue Sep 16 18:13:00 UTC 2014 > [INFO] Final Memory: 40M/335M > [INFO] > ------------------------------------------------------------------------ > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.17:test > (secondPartTestsExecution) on project hbase-server: There are test failures. > [ERROR] > [ERROR] Please refer to > /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/hbase-server/target/surefire-reports > for the individual test results. > [ERROR] -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, > please read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn <goals> -rf :hbase-server > Build step 'Invoke top-level Maven targets' marked build as failure > Performing Post build task... > Match found for :.* : True > Logical operation result is TRUE > Running script : ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l` > if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then > #It seems sometimes the tests are not dying immediately. Let's give > them 10s > echo "Suspicious java process found - waiting 10s to see if there are > just slow to stop" > sleep 10 > ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l` > if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then > echo "There are $ZOMBIE_TESTS_COUNT zombie tests, they should have > been killed by surefire but survived" > echo "************ BEGIN zombies jstack extract" > ZB_STACK=`jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 > jstack | grep ".test" | grep "\.java"` > jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 jstack > echo "************ END zombies jstack extract" > JIRA_COMMENT="$JIRA_COMMENT > > {color:red}-1 core zombie tests{color}. There are > ${ZOMBIE_TESTS_COUNT} zombie test(s): ${ZB_STACK}" > BAD=1 > jps | grep surefirebooter | cut -d ' ' -f 1 | xargs kill -9 > else > echo "We're ok: there is no zombie test, but some tests took some > time to stop" > fi > else > echo "We're ok: there is no zombie test" > fi > [HBase-TRUNK] $ /bin/bash -xe /tmp/hudson8722023937237859819.sh > ++ jps > ++ grep surefirebooter > ++ wc -l > + ZOMBIE_TESTS_COUNT=1 > + [[ 1 != 0 ]] > + echo 'Suspicious java process found - waiting 10s to see if there are > just slow to stop' > Suspicious java process found - waiting 10s to see if there are just slow > to stop > + sleep 10 > ++ jps > ++ grep surefirebooter > ++ wc -l > + ZOMBIE_TESTS_COUNT=1 > + [[ 1 != 0 ]] > + echo 'There are 1 zombie tests, they should have been killed by surefire > but survived' > There are 1 zombie tests, they should have been killed by surefire but > survived > + echo '************ BEGIN zombies jstack extract' > ************ BEGIN zombies jstack extract > ++ jps > ++ cut -d ' ' -f 1 > ++ grep surefirebooter > ++ xargs -n 1 jstack > ++ grep .test > ++ grep '\.java' > + ZB_STACK= > POST BUILD TASK : FAILURE > END OF POST BUILD TASK : 0 > Archiving artifacts > Sending artifact delta relative to HBase-TRUNK #5500 > Archived 1790 artifacts > Archive block size is 32768 > Received 73 blocks and 556396048 bytes > Compression is 0.4% > Took 2 min 33 sec > Recording test results > Updating HBASE-11961 > Updating HBASE-11976 >
