See <http://54.241.6.143/job/HBase-0.94-Security-Hadoop-2/166/changes>
Changes: [tedyu] HBASE-8639 very poor performance of htable#getscanner in multithreaded environment (Ted Yu) ------------------------------------------ [...truncated 5290 lines...] Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 31.024 sec Running org.apache.hadoop.hbase.TestDrainingServer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.462 sec Running org.apache.hadoop.hbase.procedure.TestZKProcedureControllers Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.808 sec Running org.apache.hadoop.hbase.procedure.TestZKProcedure Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.74 sec Running org.apache.hadoop.hbase.TestMultiVersions Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.932 sec Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.269 sec Running org.apache.hadoop.hbase.avro.TestAvroServer Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.939 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditorNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.775 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 10, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 10.116 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.807 sec Running org.apache.hadoop.hbase.TestLocalHBaseCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.032 sec Running org.apache.hadoop.hbase.regionserver.TestSeekOptimizations Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.648 sec Running org.apache.hadoop.hbase.regionserver.metrics.TestSchemaMetrics Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.116 sec Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.78 sec Running org.apache.hadoop.hbase.regionserver.TestCompactionState Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.328 sec Running org.apache.hadoop.hbase.regionserver.TestStore Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.143 sec Running org.apache.hadoop.hbase.regionserver.TestBlocksRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.297 sec Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.279 sec Running org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.127 sec Running org.apache.hadoop.hbase.regionserver.TestStoreScanner Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.108 sec Running org.apache.hadoop.hbase.regionserver.handler.TestOpenRegionHandler Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.658 sec Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.471 sec Running org.apache.hadoop.hbase.regionserver.TestCompactionWithCoprocessor Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 74.978 sec Running org.apache.hadoop.hbase.regionserver.TestMasterAddressManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.576 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionBusyWait Tests run: 74, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.054 sec Running org.apache.hadoop.hbase.regionserver.TestRegionServerMetrics Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 66.373 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLog Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Tests run: 30, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 78.032 sec Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 31.69 sec <<< FAILURE! Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 69.309 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 66.429 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogBench Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.291 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollingNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.28 sec Running org.apache.hadoop.hbase.regionserver.wal.TestDurability Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.318 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.502 sec Running org.apache.hadoop.hbase.regionserver.TestRpcMetrics Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.9 sec Running org.apache.hadoop.hbase.regionserver.TestStoreFileBlockCacheSummary Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.39 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplitCompressed Tests run: 30, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 95.865 sec Running org.apache.hadoop.hbase.regionserver.TestAtomicOperation Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.33 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionOnCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.252 sec Running org.apache.hadoop.hbase.regionserver.TestMXBean Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.778 sec Running org.apache.hadoop.hbase.regionserver.TestSplitLogWorker Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.361 sec Running org.apache.hadoop.hbase.regionserver.TestCacheOnWriteInSchema Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.479 sec Running org.apache.hadoop.hbase.regionserver.TestMultiColumnScanner Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 74.546 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 147.584 sec Running org.apache.hadoop.hbase.regionserver.TestServerCustomProtocol Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.378 sec Running org.apache.hadoop.hbase.regionserver.TestParallelPut Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.492 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.332 sec Running org.apache.hadoop.hbase.regionserver.TestHRegion Tests run: 73, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 104.256 sec Running org.apache.hadoop.hbase.regionserver.TestRSKilledWhenMasterInitializing Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 93.976 sec Running org.apache.hadoop.hbase.snapshot.TestSnapshotDescriptionUtils Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.704 sec Running org.apache.hadoop.hbase.TestFullLogReconstruction Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 73.075 sec Running org.apache.hadoop.hbase.monitoring.TestMemoryBoundedLogMessageBuffer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.894 sec Running org.apache.hadoop.hbase.monitoring.TestTaskMonitor Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.681 sec Running org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.994 sec Running org.apache.hadoop.hbase.TestInfoServers Running org.apache.hadoop.hbase.snapshot.TestExportSnapshot Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.616 sec Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.307 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.909 sec Running org.apache.hadoop.hbase.constraint.TestConstraint Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.951 sec Running org.apache.hadoop.hbase.io.encoding.TestLoadAndSwitchEncodeOnDisk Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.878 sec Running org.apache.hadoop.hbase.snapshot.TestRestoreFlushSnapshotFromClient Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 172.588 sec Running org.apache.hadoop.hbase.io.hfile.TestFixedFileTrailer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.952 sec Running org.apache.hadoop.hbase.io.hfile.TestChecksum Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.306 sec Running org.apache.hadoop.hbase.io.encoding.TestUpgradeFromHFileV1ToEncoding Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 133.471 sec Running org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite Tests run: 36, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 72.554 sec Running org.apache.hadoop.hbase.io.hfile.slab.TestSlabCache Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.932 sec Running org.apache.hadoop.hbase.io.hfile.TestHFilePerformance Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.214 sec Running org.apache.hadoop.hbase.io.hfile.TestLruBlockCache Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.767 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileSeek Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.993 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileBlockCompatibility Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.763 sec Running org.apache.hadoop.hbase.io.hfile.slab.TestSingleSizeCache Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 76.395 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileBlockIndex Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.369 sec Running org.apache.hadoop.hbase.io.encoding.TestDataBlockEncoders Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 309.891 sec Running org.apache.hadoop.hbase.io.encoding.TestChangingEncoding Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 306.118 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileBlock Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 67.393 sec Running org.apache.hadoop.hbase.io.TestFileLink Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.304 sec Running org.apache.hadoop.hbase.io.hfile.TestForceCacheImportantBlocks Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.981 sec Results : Failed tests: testCreateBadTables(org.apache.hadoop.hbase.client.TestAdmin): expected:<1> but was:<2> testMultithreadedTableMapper(org.apache.hadoop.hbase.mapreduce.TestMultithreadedTableMapper) testCopyTable(org.apache.hadoop.hbase.mapreduce.TestCopyTable): expected:<0> but was:<1> testStartStopRow(org.apache.hadoop.hbase.mapreduce.TestCopyTable): expected:<0> but was:<1> testMRIncrementalLoad(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat) testMRIncrementalLoadWithSplit(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat) testExcludeAllFromMinorCompaction(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat) testExcludeMinorCompaction(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat) testMROnTable(org.apache.hadoop.hbase.mapreduce.TestImportTsv) testMROnTableWithTimestamp(org.apache.hadoop.hbase.mapreduce.TestImportTsv) testMROnTableWithCustomMapper(org.apache.hadoop.hbase.mapreduce.TestImportTsv) testBulkOutputWithoutAnExistingTable(org.apache.hadoop.hbase.mapreduce.TestImportTsv) testScanEmptyToEmpty(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) testScanEmptyToBBA(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) testScanEmptyToBBB(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) testScanEmptyToOPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) testScanEmptyToEmpty(org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat) testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat) testScanOBBToOPP(org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat) testScanOPPToEmpty(org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat) testScanYZYToEmpty(org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat) testWALPlayer(org.apache.hadoop.hbase.mapreduce.TestWALPlayer): expected:<0> but was:<1> testScanOBBToOPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2) testScanOBBToQPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2) testScanOPPToEmpty(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2) testScanYYXToEmpty(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2) testScanYYYToEmpty(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2) testScanYZYToEmpty(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2) testScanFromConfiguration(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2) Tests in error: testMultiRegionTable(org.apache.hadoop.hbase.mapred.TestTableMapReduce): Job failed! testMultiRegionTable(org.apache.hadoop.hbase.mapreduce.TestTableMapReduce) testSimpleCase(org.apache.hadoop.hbase.mapreduce.TestImportExport) testMetaExport(org.apache.hadoop.hbase.mapreduce.TestImportExport) testWithDeletes(org.apache.hadoop.hbase.mapreduce.TestImportExport) testWithFilter(org.apache.hadoop.hbase.mapreduce.TestImportExport) testAppendClose(org.apache.hadoop.hbase.regionserver.wal.TestHLog): Failed to open hdfs://localhost:60232/user/ec2-user/hbase/TestHLog/hlogdirtrue/hlog.1369863383158 for append Tests run: 1404, Failures: 30, Errors: 7, Skipped: 13 [JENKINS] Recording test results [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 58:58.691s [INFO] Finished at: Wed May 29 21:50:08 UTC 2013 [INFO] Final Memory: 157M/432M [INFO] ------------------------------------------------------------------------ [JENKINS] Archiving <http://54.241.6.143/job/HBase-0.94-Security-Hadoop-2/ws/pom.xml> to /var/lib/jenkins/jobs/HBase-0.94-Security-Hadoop-2/modules/org.apache.hbase$hbase/builds/2013-05-29_20-51-03/archive/org.apache.hbase/hbase/0.94.8/hbase-0.94.8.pom Waiting for Jenkins to finish collecting data mavenExecutionResult exceptions not empty message : Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (secondPartTestsExecution) on project hbase: Failure or timeout cause : Failure or timeout Stack trace : org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (secondPartTestsExecution) on project hbase: Failure or timeout at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) at org.jvnet.hudson.maven3.launcher.Maven3Launcher.main(Maven3Launcher.java:79) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:329) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:239) at org.jvnet.hudson.maven3.agent.Maven3Main.launch(Maven3Main.java:158) at hudson.maven.Maven3Builder.call(Maven3Builder.java:100) at hudson.maven.Maven3Builder.call(Maven3Builder.java:66) at hudson.remoting.UserRequest.perform(UserRequest.java:118) at hudson.remoting.UserRequest.perform(UserRequest.java:48) at hudson.remoting.Request$2.run(Request.java:326) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang.Thread.run(Thread.java:662) Caused by: org.apache.maven.plugin.MojoExecutionException: Failure or timeout at org.apache.maven.plugin.surefire.SurefirePlugin.assertNoFailureOrTimeout(SurefirePlugin.java:643) at org.apache.maven.plugin.surefire.SurefirePlugin.handleSummary(SurefirePlugin.java:624) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:137) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:98) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209) ... 27 more channel stopped
