See <https://builds.apache.org/job/HBase-TRUNK/4565/changes>
Changes: [stack] HBASE-9610 TestThriftServer.testAll failing; ADDENDUM ------------------------------------------ [...truncated 4200 lines...] Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.577 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.683 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 67.513 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.608 sec Running org.apache.hadoop.hbase.coprocessor.TestWALObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.125 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.388 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.588 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.204 sec Running org.apache.hadoop.hbase.trace.TestHTraceHooks Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.661 sec Running org.apache.hadoop.hbase.procedure.TestZKProcedure Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.43 sec Running org.apache.hadoop.hbase.procedure.TestZKProcedureControllers Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.702 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionOnCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.177 sec Running org.apache.hadoop.hbase.regionserver.TestTags Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.731 sec Running org.apache.hadoop.hbase.regionserver.TestRegionServerNoMaster Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.278 sec Running org.apache.hadoop.hbase.TestIOFencing Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 121.108 sec Running org.apache.hadoop.hbase.regionserver.TestMemStore Tests run: 23, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.069 sec Running org.apache.hadoop.hbase.regionserver.TestMasterAddressManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.298 sec Running org.apache.hadoop.hbase.regionserver.TestRegionServerMetrics Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.387 sec Running org.apache.hadoop.hbase.regionserver.TestHRegion Tests run: 64, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 83.512 sec Running org.apache.hadoop.hbase.regionserver.TestCompoundBloomFilter Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.784 sec Running org.apache.hadoop.hbase.regionserver.TestCompactionWithCoprocessor Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.377 sec Running org.apache.hadoop.hbase.regionserver.TestSplitLogWorker Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.775 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionBusyWait Tests run: 65, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 84.738 sec Running org.apache.hadoop.hbase.regionserver.TestServerCustomProtocol Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 88.799 sec Running org.apache.hadoop.hbase.regionserver.TestStore Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.212 sec Running org.apache.hadoop.hbase.regionserver.TestStoreFileBlockCacheSummary Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.188 sec Running org.apache.hadoop.hbase.regionserver.TestAtomicOperation Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.159 sec Running org.apache.hadoop.hbase.regionserver.TestClusterId Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 70.312 sec Running org.apache.hadoop.hbase.regionserver.TestRegionMergeTransactionOnCluster Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 86.183 sec Running org.apache.hadoop.hbase.regionserver.TestBlocksRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.569 sec Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.626 sec Running org.apache.hadoop.hbase.regionserver.TestCompactionState Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 196.572 sec Running org.apache.hadoop.hbase.regionserver.TestSeekOptimizations Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.221 sec Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.084 sec Running org.apache.hadoop.hbase.regionserver.handler.TestOpenRegionHandler Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.157 sec Running org.apache.hadoop.hbase.regionserver.TestJoinedScanners Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.661 sec Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster Tests run: 11, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 114.712 sec <<< FAILURE! Running org.apache.hadoop.hbase.regionserver.TestGetClosestAtOrBefore Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.424 sec Running org.apache.hadoop.hbase.regionserver.TestParallelPut Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.978 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.499 sec Running org.apache.hadoop.hbase.regionserver.TestCacheOnWriteInSchema Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.023 sec Running org.apache.hadoop.hbase.regionserver.TestPriorityRpc Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.374 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 191.357 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLog Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 78.872 sec Running org.apache.hadoop.hbase.regionserver.wal.TestReadOldRootAndMetaEdits Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.763 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Tests run: 33, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 234.606 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 661.666 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplitCompressed Tests run: 33, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 225.666 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 76.914 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 83.355 sec Running org.apache.hadoop.hbase.regionserver.wal.TestDurability Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.465 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogFiltering Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.441 sec Running org.apache.hadoop.hbase.regionserver.TestStoreScanner Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.659 sec Running org.apache.hadoop.hbase.regionserver.TestRegionFavoredNodes Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.4 sec Running org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.311 sec Running org.apache.hadoop.hbase.regionserver.TestCompaction Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.432 sec Running org.apache.hadoop.hbase.regionserver.TestMultiColumnScanner Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.671 sec Running org.apache.hadoop.hbase.mapred.TestTableInputFormat Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.447 sec Running org.apache.hadoop.hbase.fs.TestBlockReorder Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.334 sec Running org.apache.hadoop.hbase.mapred.TestTableMapReduce Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 194.208 sec Running org.apache.hadoop.hbase.backup.example.TestZooKeeperTableArchiveClient Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.495 sec Running org.apache.hadoop.hbase.TestClusterBootOrder Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.303 sec Running org.apache.hadoop.hbase.TestDrainingServer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.041 sec Running org.apache.hadoop.hbase.backup.TestHFileArchiving Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 203.837 sec Running org.apache.hadoop.hbase.mapreduce.TestTimeRangeMapRed Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.087 sec Running org.apache.hadoop.hbase.mapreduce.TestRowCounter Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 136.178 sec Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduceUtil Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.832 sec Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat Tests run: 10, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 347.226 sec Running org.apache.hadoop.hbase.mapreduce.TestCopyTable Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 219.218 sec Running org.apache.hadoop.hbase.mapreduce.TestSecureLoadIncrementalHFiles Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.176 sec Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 275.611 sec Running org.apache.hadoop.hbase.mapreduce.TestImportTsv Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 303.14 sec Running org.apache.hadoop.hbase.mapreduce.TestImportExport Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 424.065 sec Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2 Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 378.584 sec Running org.apache.hadoop.hbase.mapreduce.TestWALPlayer Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 104.768 sec Running org.apache.hadoop.hbase.mapreduce.TestMultithreadedTableMapper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 163.848 sec Running org.apache.hadoop.hbase.mapreduce.TestSecureLoadIncrementalHFilesSplitRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.374 sec Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduce Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 209.335 sec Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 382.287 sec Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.891 sec Running org.apache.hadoop.hbase.mapreduce.TestHLogRecordReader Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.109 sec Running org.apache.hadoop.hbase.mapreduce.TestHRegionPartitioner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 82.054 sec Running org.apache.hadoop.hbase.mapreduce.TestCellCounter Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 112.072 sec Results : Failed tests: testShutdownFixupWhenDaughterHasSplit(org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster): Region not moved off hbase:meta server Tests run: 1630, Failures: 1, Errors: 0, Skipped: 22 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] HBase ............................................. SUCCESS [6.201s] [INFO] HBase - Common .................................... SUCCESS [20.186s] [INFO] HBase - Protocol .................................. SUCCESS [17.996s] [INFO] HBase - Client .................................... SUCCESS [20.901s] [INFO] HBase - Hadoop Compatibility ...................... SUCCESS [5.434s] [INFO] HBase - Hadoop One Compatibility .................. SUCCESS [1.346s] [INFO] HBase - Prefix Tree ............................... SUCCESS [3.721s] [INFO] HBase - Server .................................... FAILURE [2:19:51.767s] [INFO] HBase - Thrift .................................... SKIPPED [INFO] HBase - Shell ..................................... SKIPPED [INFO] HBase - Integration Tests ......................... SKIPPED [INFO] HBase - Examples .................................. SKIPPED [INFO] HBase - Assembly .................................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 2:21:08.293s [INFO] Finished at: Thu Sep 26 22:51:30 UTC 2013 [INFO] Final Memory: 34M/352M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (secondPartTestsExecution) on project hbase-server: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/HBase-TRUNK/ws/trunk/hbase-server/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hbase-server Build step 'Invoke top-level Maven targets' marked build as failure Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l` if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then #It seems sometimes the tests are not dying immediately. Let's give them 10s echo "Suspicious java process found - waiting 10s to see if there are just slow to stop" sleep 10 ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l` if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then echo "There are $ZOMBIE_TESTS_COUNT zombie tests, they should have been killed by surefire but survived" echo "************ BEGIN zombies jstack extract" ZB_STACK=`jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 jstack | grep ".test" | grep "\.java"` jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 jstack echo "************ END zombies jstack extract" JIRA_COMMENT="$JIRA_COMMENT {color:red}-1 core zombie tests{color}. There are ${ZOMBIE_TESTS_COUNT} zombie test(s): ${ZB_STACK}" BAD=1 jps | grep surefirebooter | cut -d ' ' -f 1 | xargs kill -9 else echo "We're ok: there is no zombie test, but some tests took some time to stop" fi else echo "We're ok: there is no zombie test" fi [HBase-TRUNK] $ /bin/bash -xe /tmp/hudson1723968589400734116.sh ++ jps ++ grep surefirebooter ++ wc -l + ZOMBIE_TESTS_COUNT=0 + [[ 0 != 0 ]] + echo 'We'\''re ok: there is no zombie test' We're ok: there is no zombie test POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 0 Archiving artifacts Recording test results Updating HBASE-9610
