See <https://builds.apache.org/job/HBase-TRUNK/2427/changes>
Changes: [nspiegelberg] HBASE-4769 Abort RegionServer Immediately on OOME [stack] HBASE-4741 Online schema change doesn't return errors [stack] HBASE-4288 "Server not running" exception during meta verification causes RS abort [nspiegelberg] HBASE-3690 Option to Exclude Bulk Import Files from Minor Compaction Summary: We ran an incremental scrape with HFileOutputFormat and encountered major compaction storms. This is caused by the bug in HBASE-3404. The permanent fix is a little tricky without HBASE-2856. We realized that a quicker solution for avoiding these compaction storms is to simply exclude bulk import files from minor compactions and let them only be handled by time-based major compactions. Add with functionality along with a config option to enable it. Rewrote this feature to be done on a per-bulkload basis. Test Plan: - mvn test -Dtest=TestHFileOutputFormat DiffCamp Revision: Reviewers: stack, Kannan, JIRA, dhruba Reviewed By: stack CC: dhruba, lhofhansl, nspiegelberg, stack Differential Revision: 357 [nspiegelberg] HBASE-4765 Enhance HLog Metrics ------------------------------------------ [...truncated 1773 lines...] Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.931 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.132 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.307 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverStacking Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.664 sec Running org.apache.hadoop.hbase.coprocessor.TestClassLoading Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.083 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.659 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.475 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.81 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.197 sec Running org.apache.hadoop.hbase.coprocessor.TestWALObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.635 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorInterface Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.477 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.252 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.062 sec Running org.apache.hadoop.hbase.thrift2.TestThriftHBaseServiceHandler Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.388 sec Running org.apache.hadoop.hbase.TestCompare Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.241 sec Running org.apache.hadoop.hbase.avro.TestAvroServer Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.514 sec Running org.apache.hadoop.hbase.avro.TestAvroUtil Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.633 sec Running org.apache.hadoop.hbase.thrift.TestThriftServer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.411 sec Running org.apache.hadoop.hbase.monitoring.TestTaskMonitor Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.226 sec Running org.apache.hadoop.hbase.monitoring.TestMemoryBoundedLogMessageBuffer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.101 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionInfo Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.662 sec Running org.apache.hadoop.hbase.regionserver.TestMemStore Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.765 sec Running org.apache.hadoop.hbase.regionserver.TestHRegion Tests run: 57, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.184 sec Running org.apache.hadoop.hbase.regionserver.TestMasterAddressManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.531 sec Running org.apache.hadoop.hbase.regionserver.TestCompoundBloomFilter Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.815 sec Running org.apache.hadoop.hbase.regionserver.TestSplitLogWorker Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.035 sec Running org.apache.hadoop.hbase.regionserver.TestServerCustomProtocol Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.63 sec Running org.apache.hadoop.hbase.regionserver.TestScanWithBloomError Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.043 sec Running org.apache.hadoop.hbase.regionserver.TestStoreFileBlockCacheSummary Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.455 sec Running org.apache.hadoop.hbase.regionserver.TestStore Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.766 sec Running org.apache.hadoop.hbase.regionserver.TestAtomicOperation Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.545 sec Running org.apache.hadoop.hbase.regionserver.TestBlocksRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.423 sec Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.328 sec Running org.apache.hadoop.hbase.regionserver.TestSeekOptimizations Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.042 sec Running org.apache.hadoop.hbase.regionserver.TestKeepDeletes Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.548 sec Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.826 sec Running org.apache.hadoop.hbase.regionserver.handler.TestOpenRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.938 sec Running org.apache.hadoop.hbase.regionserver.TestScanDeleteTracker Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.599 sec Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.233 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.671 sec Running org.apache.hadoop.hbase.regionserver.TestSplitTransaction Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.864 sec Running org.apache.hadoop.hbase.regionserver.TestReadWriteConsistencyControl Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.115 sec Running org.apache.hadoop.hbase.regionserver.TestKeyValueHeap Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.5 sec Running org.apache.hadoop.hbase.regionserver.TestCompactSelection Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.652 sec Running org.apache.hadoop.hbase.regionserver.TestMinVersions Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.216 sec Running org.apache.hadoop.hbase.regionserver.TestWideScanner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.899 sec Running org.apache.hadoop.hbase.regionserver.TestColumnSeeking Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.713 sec Running org.apache.hadoop.hbase.regionserver.TestGetClosestAtOrBefore Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.178 sec Running org.apache.hadoop.hbase.regionserver.TestExplicitColumnTracker Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.904 sec Running org.apache.hadoop.hbase.regionserver.TestMemStoreLAB Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.352 sec Running org.apache.hadoop.hbase.regionserver.TestParallelPut Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.941 sec Running org.apache.hadoop.hbase.regionserver.TestKeyValueScanFixture Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.127 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogBench Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.206 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 157.592 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALActionsListener Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.636 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 320.196 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLog Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 59.034 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Tests run: 29, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 229.944 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.348 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogMethods Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.81 sec Running org.apache.hadoop.hbase.regionserver.TestRSStatusServlet Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.69 sec Running org.apache.hadoop.hbase.regionserver.TestStoreScanner Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.153 sec Running org.apache.hadoop.hbase.regionserver.TestResettingCounters Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.728 sec Running org.apache.hadoop.hbase.regionserver.TestStoreFile Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.783 sec Running org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.683 sec Running org.apache.hadoop.hbase.regionserver.TestScanWildcardColumnTracker Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.466 sec Running org.apache.hadoop.hbase.regionserver.TestCompaction Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.236 sec Running org.apache.hadoop.hbase.regionserver.TestQueryMatcher Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.537 sec Running org.apache.hadoop.hbase.regionserver.TestRpcMetrics Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.029 sec Running org.apache.hadoop.hbase.regionserver.TestScanner Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.421 sec Running org.apache.hadoop.hbase.regionserver.TestMultiColumnScanner Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.691 sec Running org.apache.hadoop.hbase.regionserver.TestRegionSplitPolicy Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.699 sec Running org.apache.hadoop.hbase.regionserver.TestKeyValueSkipListSet Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.129 sec Running org.apache.hadoop.hbase.mapred.TestTableMapReduce Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.984 sec Running org.apache.hadoop.hbase.mapred.TestTableInputFormat Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.245 sec Running org.apache.hadoop.hbase.TestDrainingServer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.847 sec Running org.apache.hadoop.hbase.TestFSTableDescriptorForceCreation Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.524 sec Running org.apache.hadoop.hbase.executor.TestExecutorService Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.442 sec Running org.apache.hadoop.hbase.mapreduce.TestTimeRangeMapRed Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.951 sec Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 199.463 sec Running org.apache.hadoop.hbase.mapreduce.TestImportTsv Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.093 sec Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 450.888 sec Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.143 sec Running org.apache.hadoop.hbase.mapreduce.TestTableSplit Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.139 sec Running org.apache.hadoop.hbase.mapreduce.TestSimpleTotalOrderPartitioner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.423 sec Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduce Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 94.65 sec Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.287 sec Running org.apache.hadoop.hbase.TestHRegionLocation Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.144 sec Results : Failed tests: queueFailover(org.apache.hadoop.hbase.replication.TestReplication): Waited too much time for queueFailover replication Tests run: 1100, Failures: 1, Errors: 0, Skipped: 10 [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1:38:51.883s [INFO] Finished at: Fri Nov 11 02:55:38 UTC 2011 [INFO] Final Memory: 22M/738M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project hbase: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/HBase-TRUNK/ws/trunk/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project hbase: There are test failures. Please refer to <https://builds.apache.org/job/HBase-TRUNK/ws/trunk/target/surefire-reports> for the individual test results. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:213) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.MojoExecutor.executeForkedExecutions(MojoExecutor.java:365) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:199) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196) at org.apache.maven.cli.MavenCli.main(MavenCli.java:141) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352) Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures. Please refer to <https://builds.apache.org/job/HBase-TRUNK/ws/trunk/target/surefire-reports> for the individual test results. at org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:87) at org.apache.maven.plugin.surefire.SurefirePlugin.writeSummary(SurefirePlugin.java:641) at org.apache.maven.plugin.surefire.SurefirePlugin.handleSummary(SurefirePlugin.java:615) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:137) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:98) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209) ... 23 more [ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException Build step 'Invoke top-level Maven targets' marked build as failure [locks-and-latches] Releasing all the locks [locks-and-latches] All the locks released Archiving artifacts Recording test results Updating HBASE-3690 Updating HBASE-4288 Updating HBASE-4765 Updating HBASE-2856 Updating HBASE-4769 Updating HBASE-4741 Updating HBASE-3404
