See <http://54.241.6.143/job/HBase-0.94-Hadoop-2/166/changes>
Changes: [tedyu] HBASE-8639 very poor performance of htable#getscanner in multithreaded environment (Ted Yu) ------------------------------------------ [...truncated 3769 lines...] Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.096 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.689 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.446 sec Running org.apache.hadoop.hbase.coprocessor.TestWALObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.684 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.328 sec Running org.apache.hadoop.hbase.coprocessor.TestBigDecimalColumnInterpreter Tests run: 38, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.704 sec Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.111 sec Running org.apache.hadoop.hbase.coprocessor.example.TestZooKeeperScanPolicyObserver Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.709 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.214 sec Running org.apache.hadoop.hbase.coprocessor.example.TestBulkDeleteProtocol Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.027 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.125 sec Running org.apache.hadoop.hbase.filter.TestColumnRangeFilter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.614 sec Running org.apache.hadoop.hbase.coprocessor.TestClassLoading Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.98 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 31.54 sec Running org.apache.hadoop.hbase.mapreduce.TestHLogRecordReader Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.853 sec Running org.apache.hadoop.hbase.TestHBaseFileSystem Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.928 sec Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.38 sec Running org.apache.hadoop.hbase.mapreduce.TestTimeRangeMapRed Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.891 sec Running org.apache.hadoop.hbase.mapreduce.TestImportExport Tests run: 4, Failures: 0, Errors: 4, Skipped: 0, Time elapsed: 73.397 sec <<< FAILURE! Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduce Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 60.425 sec <<< FAILURE! Running org.apache.hadoop.hbase.mapreduce.TestMultithreadedTableMapper Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 48.4 sec <<< FAILURE! Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 70.936 sec Running org.apache.hadoop.hbase.mapreduce.TestCopyTable Tests run: 2, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 61.07 sec <<< FAILURE! Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat Tests run: 10, Failures: 4, Errors: 0, Skipped: 0, Time elapsed: 124.924 sec <<< FAILURE! Running org.apache.hadoop.hbase.mapreduce.TestWALPlayer Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 54.297 sec <<< FAILURE! Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 Tests run: 5, Failures: 5, Errors: 0, Skipped: 0, Time elapsed: 121.315 sec <<< FAILURE! Running org.apache.hadoop.hbase.mapreduce.TestImportTsv Tests run: 13, Failures: 3, Errors: 1, Skipped: 0, Time elapsed: 187.384 sec <<< FAILURE! Running org.apache.hadoop.hbase.TestLocalHBaseCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.294 sec Running org.apache.hadoop.hbase.TestRegionRebalancing Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.156 sec Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2 Tests run: 7, Failures: 6, Errors: 1, Skipped: 0, Time elapsed: 155.256 sec <<< FAILURE! Running org.apache.hadoop.hbase.procedure.TestZKProcedureControllers Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.156 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Running org.apache.hadoop.hbase.procedure.TestZKProcedure Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.707 sec Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.435 sec Running org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat Tests run: 5, Failures: 5, Errors: 0, Skipped: 0, Time elapsed: 127.74 sec <<< FAILURE! Running org.apache.hadoop.hbase.mapred.TestTableInputFormat Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.026 sec Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.354 sec Running org.apache.hadoop.hbase.TestAcidGuarantees Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 89.219 sec Running org.apache.hadoop.hbase.mapred.TestTableMapReduce Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 87.687 sec <<< FAILURE! Running org.apache.hadoop.hbase.io.encoding.TestLoadAndSwitchEncodeOnDisk Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.495 sec Running org.apache.hadoop.hbase.io.hfile.TestChecksum Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.58 sec Running org.apache.hadoop.hbase.io.hfile.TestFixedFileTrailer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.304 sec Running org.apache.hadoop.hbase.io.encoding.TestUpgradeFromHFileV1ToEncoding Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 107.461 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileBlockIndex Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.629 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileSeek Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.494 sec Running org.apache.hadoop.hbase.io.hfile.TestHFilePerformance Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.263 sec Running org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite Tests run: 36, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.488 sec Running org.apache.hadoop.hbase.io.hfile.slab.TestSlabCache Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.549 sec Running org.apache.hadoop.hbase.io.encoding.TestDataBlockEncoders Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 181.782 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileBlock Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.395 sec Running org.apache.hadoop.hbase.io.hfile.slab.TestSingleSizeCache Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 67.424 sec Running org.apache.hadoop.hbase.io.hfile.TestLruBlockCache Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.947 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileBlockCompatibility Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.194 sec Running org.apache.hadoop.hbase.io.encoding.TestChangingEncoding Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 271.531 sec Running org.apache.hadoop.hbase.io.TestFileLink Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.474 sec Running org.apache.hadoop.hbase.replication.TestReplicationZookeeper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.458 sec Running org.apache.hadoop.hbase.replication.TestReplicationSource Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.786 sec Running org.apache.hadoop.hbase.avro.TestAvroServer Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.698 sec Running org.apache.hadoop.hbase.io.hfile.TestForceCacheImportantBlocks Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 101.212 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.858 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.447 sec Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.209 sec Running org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 80.181 sec Running org.apache.hadoop.hbase.replication.TestReplicationQueueFailover Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.638 sec Running org.apache.hadoop.hbase.replication.TestReplicationQueueFailoverCompressed Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.995 sec Running org.apache.hadoop.hbase.replication.TestReplicationSmallTests Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 121.996 sec Running org.apache.hadoop.hbase.thrift.TestThriftServer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.708 sec Running org.apache.hadoop.hbase.replication.TestMasterReplication Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.539 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditorNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.967 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 10, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 9.827 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.849 sec Running org.apache.hadoop.hbase.backup.TestHFileArchiving Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 79.271 sec Running org.apache.hadoop.hbase.thrift.TestThriftServerCmdLine Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 347.949 sec Results : Failed tests: testMultiRegionTable(org.apache.hadoop.hbase.mapreduce.TestTableMapReduce) testMultithreadedTableMapper(org.apache.hadoop.hbase.mapreduce.TestMultithreadedTableMapper) testCopyTable(org.apache.hadoop.hbase.mapreduce.TestCopyTable): expected:<0> but was:<1> testStartStopRow(org.apache.hadoop.hbase.mapreduce.TestCopyTable): expected:<0> but was:<1> testMRIncrementalLoad(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat) testMRIncrementalLoadWithSplit(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat) testExcludeAllFromMinorCompaction(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat) testExcludeMinorCompaction(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat) testWALPlayer(org.apache.hadoop.hbase.mapreduce.TestWALPlayer): expected:<0> but was:<1> testScanEmptyToEmpty(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) testScanEmptyToBBA(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) testScanEmptyToBBB(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) testScanEmptyToOPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) testMROnTableWithTimestamp(org.apache.hadoop.hbase.mapreduce.TestImportTsv) testMROnTableWithCustomMapper(org.apache.hadoop.hbase.mapreduce.TestImportTsv) testBulkOutputWithoutAnExistingTable(org.apache.hadoop.hbase.mapreduce.TestImportTsv) testScanOBBToOPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2) testScanOPPToEmpty(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2) testScanYYXToEmpty(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2) testScanYYYToEmpty(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2) testScanYZYToEmpty(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2) testScanFromConfiguration(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2) testScanEmptyToEmpty(org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat) testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat) testScanOBBToOPP(org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat) testScanOPPToEmpty(org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat) testScanYZYToEmpty(org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat) Tests in error: testAppendClose(org.apache.hadoop.hbase.regionserver.wal.TestHLog): Failed to open hdfs://localhost:45279/user/ec2-user/hbase/TestHLog/hlogdirtrue/hlog.1369859002711 for append testSimpleCase(org.apache.hadoop.hbase.mapreduce.TestImportExport) testMetaExport(org.apache.hadoop.hbase.mapreduce.TestImportExport) testWithDeletes(org.apache.hadoop.hbase.mapreduce.TestImportExport) testWithFilter(org.apache.hadoop.hbase.mapreduce.TestImportExport) testMROnTable(org.apache.hadoop.hbase.mapreduce.TestImportTsv) testScanOBBToQPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2) testMultiRegionTable(org.apache.hadoop.hbase.mapred.TestTableMapReduce) Tests run: 1358, Failures: 28, Errors: 8, Skipped: 13 [JENKINS] Recording test results [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 48:50.202s [INFO] Finished at: Wed May 29 20:50:53 UTC 2013 [INFO] Final Memory: 87M/390M [INFO] ------------------------------------------------------------------------ [JENKINS] Archiving <http://54.241.6.143/job/HBase-0.94-Hadoop-2/ws/pom.xml> to /var/lib/jenkins/jobs/HBase-0.94-Hadoop-2/modules/org.apache.hbase$hbase/builds/2013-05-29_20-01-57/archive/org.apache.hbase/hbase/0.94.8/hbase-0.94.8.pom Waiting for Jenkins to finish collecting data mavenExecutionResult exceptions not empty message : Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (secondPartTestsExecution) on project hbase: There are test failures. Please refer to <http://54.241.6.143/job/HBase-0.94-Hadoop-2/ws/target/surefire-reports> for the individual test results. cause : There are test failures. Please refer to <http://54.241.6.143/job/HBase-0.94-Hadoop-2/ws/target/surefire-reports> for the individual test results. Stack trace : org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (secondPartTestsExecution) on project hbase: There are test failures. Please refer to <http://54.241.6.143/job/HBase-0.94-Hadoop-2/ws/target/surefire-reports> for the individual test results. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:213) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) at org.jvnet.hudson.maven3.launcher.Maven3Launcher.main(Maven3Launcher.java:79) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:329) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:239) at org.jvnet.hudson.maven3.agent.Maven3Main.launch(Maven3Main.java:158) at hudson.maven.Maven3Builder.call(Maven3Builder.java:100) at hudson.maven.Maven3Builder.call(Maven3Builder.java:66) at hudson.remoting.UserRequest.perform(UserRequest.java:118) at hudson.remoting.UserRequest.perform(UserRequest.java:48) at hudson.remoting.Request$2.run(Request.java:326) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang.Thread.run(Thread.java:662) Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures. Please refer to <http://54.241.6.143/job/HBase-0.94-Hadoop-2/ws/target/surefire-reports> for the individual test results. at org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:87) at org.apache.maven.plugin.surefire.SurefirePlugin.writeSummary(SurefirePlugin.java:651) at org.apache.maven.plugin.surefire.SurefirePlugin.handleSummary(SurefirePlugin.java:625) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:137) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:98) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209) ... 27 more channel stopped
