See <https://builds.apache.org/job/HBase-TRUNK/2439/changes>
Changes: [nspiegelberg] HBASE-4768 Per-(table, columnFamily) metrics with configurable table name inclusion Summary: This is an initial version of an HBase trunk diff for per-table/CF metrics (see JIRA for details). Unit tests mostly pass -- need to look into TestDistributedLogSplitting. Also still doing cluster testing. Test Plan: Unit tests, single-node cluster, dev cluster. Need to try bulk-load map-reduce jobs as well. Observe metrics through JMX. Reviewers: jgray, nspiegelberg, stack, tedyu, todd, JIRA Reviewed By: nspiegelberg CC: nspiegelberg, Liyin, mbautin, tedyu Differential Revision: 363 [dmeil] HBASE-4786 book.xml,performance.xml adding and reorg of schema info ------------------------------------------ [...truncated 1766 lines...] Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.542 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.964 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.034 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverStacking Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.663 sec Running org.apache.hadoop.hbase.coprocessor.TestClassLoading Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.581 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.426 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.316 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.124 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.756 sec Running org.apache.hadoop.hbase.coprocessor.TestWALObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.259 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorInterface Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.456 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.536 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.398 sec Running org.apache.hadoop.hbase.thrift2.TestThriftHBaseServiceHandler Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.209 sec Running org.apache.hadoop.hbase.TestCompare Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.241 sec Running org.apache.hadoop.hbase.avro.TestAvroServer Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.773 sec Running org.apache.hadoop.hbase.avro.TestAvroUtil Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.629 sec Running org.apache.hadoop.hbase.thrift.TestThriftServer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.992 sec Running org.apache.hadoop.hbase.monitoring.TestTaskMonitor Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.222 sec Running org.apache.hadoop.hbase.monitoring.TestMemoryBoundedLogMessageBuffer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.101 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionInfo Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.599 sec Running org.apache.hadoop.hbase.regionserver.TestMemStore Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.583 sec Running org.apache.hadoop.hbase.regionserver.TestHRegion Tests run: 57, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.815 sec Running org.apache.hadoop.hbase.regionserver.TestMasterAddressManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.53 sec Running org.apache.hadoop.hbase.regionserver.TestRegionServerMetrics Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.024 sec Running org.apache.hadoop.hbase.regionserver.TestCompoundBloomFilter Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.669 sec Running org.apache.hadoop.hbase.regionserver.TestSplitLogWorker Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.06 sec Running org.apache.hadoop.hbase.regionserver.TestServerCustomProtocol Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.332 sec Running org.apache.hadoop.hbase.regionserver.TestScanWithBloomError Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.036 sec Running org.apache.hadoop.hbase.regionserver.TestStoreFileBlockCacheSummary Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.092 sec Running org.apache.hadoop.hbase.regionserver.TestStore Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.857 sec Running org.apache.hadoop.hbase.regionserver.TestAtomicOperation Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.132 sec Running org.apache.hadoop.hbase.regionserver.TestBlocksRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.446 sec Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.181 sec Running org.apache.hadoop.hbase.regionserver.TestSeekOptimizations Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.072 sec Running org.apache.hadoop.hbase.regionserver.TestKeepDeletes Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.559 sec Running org.apache.hadoop.hbase.regionserver.metrics.TestSchemaConfigured Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.25 sec Running org.apache.hadoop.hbase.regionserver.metrics.TestSchemaMetrics Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.009 sec Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.824 sec Running org.apache.hadoop.hbase.regionserver.handler.TestOpenRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.912 sec Running org.apache.hadoop.hbase.regionserver.TestScanDeleteTracker Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.598 sec Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.022 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.962 sec Running org.apache.hadoop.hbase.regionserver.TestSplitTransaction Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.783 sec Running org.apache.hadoop.hbase.regionserver.TestReadWriteConsistencyControl Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.115 sec Running org.apache.hadoop.hbase.regionserver.TestKeyValueHeap Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.502 sec Running org.apache.hadoop.hbase.regionserver.TestCompactSelection Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.652 sec Running org.apache.hadoop.hbase.regionserver.TestMinVersions Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.227 sec Running org.apache.hadoop.hbase.regionserver.TestWideScanner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.909 sec Running org.apache.hadoop.hbase.regionserver.TestColumnSeeking Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.994 sec Running org.apache.hadoop.hbase.regionserver.TestGetClosestAtOrBefore Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.179 sec Running org.apache.hadoop.hbase.regionserver.TestExplicitColumnTracker Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.898 sec Running org.apache.hadoop.hbase.regionserver.TestMemStoreLAB Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.281 sec Running org.apache.hadoop.hbase.regionserver.TestParallelPut Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.137 sec Running org.apache.hadoop.hbase.regionserver.TestKeyValueScanFixture Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.126 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogBench Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.251 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 166.659 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALActionsListener Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.614 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 310.418 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLog Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 72.228 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Tests run: 29, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 235.979 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.247 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogMethods Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.813 sec Running org.apache.hadoop.hbase.regionserver.TestRSStatusServlet Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.679 sec Running org.apache.hadoop.hbase.regionserver.TestStoreScanner Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.152 sec Running org.apache.hadoop.hbase.regionserver.TestResettingCounters Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.732 sec Running org.apache.hadoop.hbase.regionserver.TestStoreFile Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.91 sec Running org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.718 sec Running org.apache.hadoop.hbase.regionserver.TestScanWildcardColumnTracker Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.466 sec Running org.apache.hadoop.hbase.regionserver.TestCompaction Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.428 sec Running org.apache.hadoop.hbase.regionserver.TestQueryMatcher Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.543 sec Running org.apache.hadoop.hbase.regionserver.TestRpcMetrics Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.027 sec Running org.apache.hadoop.hbase.regionserver.TestScanner Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.463 sec Running org.apache.hadoop.hbase.regionserver.TestMultiColumnScanner Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.8 sec Running org.apache.hadoop.hbase.regionserver.TestRegionSplitPolicy Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.703 sec Running org.apache.hadoop.hbase.regionserver.TestKeyValueSkipListSet Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.129 sec Running org.apache.hadoop.hbase.mapred.TestTableMapReduce Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.059 sec Running org.apache.hadoop.hbase.mapred.TestTableInputFormat Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.464 sec Running org.apache.hadoop.hbase.TestDrainingServer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.437 sec Running org.apache.hadoop.hbase.TestFSTableDescriptorForceCreation Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.523 sec Running org.apache.hadoop.hbase.executor.TestExecutorService Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.443 sec Running org.apache.hadoop.hbase.mapreduce.TestTimeRangeMapRed Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.004 sec Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 210.763 sec Running org.apache.hadoop.hbase.mapreduce.TestImportTsv Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.557 sec Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 456.072 sec Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.638 sec Running org.apache.hadoop.hbase.mapreduce.TestTableSplit Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.138 sec Running org.apache.hadoop.hbase.mapreduce.TestSimpleTotalOrderPartitioner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.424 sec Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduce Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 89.776 sec Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.965 sec Running org.apache.hadoop.hbase.TestHRegionLocation Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.144 sec Results : Failed tests: testBlockHeapSize(org.apache.hadoop.hbase.io.hfile.TestHFileBlock): expected:<80> but was:<64> Tests run: 1123, Failures: 1, Errors: 0, Skipped: 10 [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1:38:14.526s [INFO] Finished at: Tue Nov 15 05:14:25 UTC 2011 [INFO] Final Memory: 43M/704M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project hbase: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/HBase-TRUNK/ws/trunk/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project hbase: There are test failures. Please refer to <https://builds.apache.org/job/HBase-TRUNK/ws/trunk/target/surefire-reports> for the individual test results. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:213) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.MojoExecutor.executeForkedExecutions(MojoExecutor.java:365) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:199) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196) at org.apache.maven.cli.MavenCli.main(MavenCli.java:141) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352) Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures. Please refer to <https://builds.apache.org/job/HBase-TRUNK/ws/trunk/target/surefire-reports> for the individual test results. at org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:87) at org.apache.maven.plugin.surefire.SurefirePlugin.writeSummary(SurefirePlugin.java:641) at org.apache.maven.plugin.surefire.SurefirePlugin.handleSummary(SurefirePlugin.java:615) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:137) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:98) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209) ... 23 more [ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException Build step 'Invoke top-level Maven targets' marked build as failure [locks-and-latches] Releasing all the locks [locks-and-latches] All the locks released Archiving artifacts Recording test results Updating HBASE-4786 Updating HBASE-4768
