HBASE-8365 might be related to the test failure. Cheers
On May 9, 2013, at 1:23 AM, Andrew Purtell <apurt...@apache.org> wrote: > I can get TestMetaReaderEditor to periodically fail (1 in 5 runs or so), > bisecting now. > > > On Thu, May 9, 2013 at 3:35 PM, Andrew Purtell <apurt...@apache.org> wrote: > >> Looking into the state of the 0.94 branch. >> >> >> On Thu, May 9, 2013 at 3:25 PM, <apurt...@apache.org> wrote: >> >>> See <http://54.241.6.143/job/HBase-0.94/151/> >>> >>> ------------------------------------------ >>> [...truncated 31888 lines...] >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.635 sec >>> Running org.apache.hadoop.hbase.client.TestFromClientSide3 >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.479 sec >>> Running org.apache.hadoop.hbase.client.TestSnapshotFromClient >>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.749 sec >>> Running org.apache.hadoop.hbase.client.TestMetaScanner >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.219 sec >>> Running org.apache.hadoop.hbase.client.TestMultiParallel >>> Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.787 >>> sec >>> Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor >>> Tests run: 5, Failures: 1, Errors: 3, Skipped: 0, Time elapsed: 257.635 >>> sec <<< FAILURE! >>> Running org.apache.hadoop.hbase.client.TestAdmin >>> Tests run: 41, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 122.143 >>> sec >>> Running org.apache.hadoop.hbase.client.TestScannerTimeout >>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.391 sec >>> Running org.apache.hadoop.hbase.client.TestHCM >>> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.307 sec >>> Running org.apache.hadoop.hbase.client.TestMetaMigrationRemovingHTD >>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.625 sec >>> Running org.apache.hadoop.hbase.client.TestMultipleTimestamps >>> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.292 sec >>> Running org.apache.hadoop.hbase.client.TestTimestampsFilter >>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.202 sec >>> Running org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClient >>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 141.11 sec >>> Running org.apache.hadoop.hbase.client.TestShell >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 90.229 sec >>> Running org.apache.hadoop.hbase.client.TestHTableUtil >>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.749 sec >>> Running org.apache.hadoop.hbase.master.TestMXBean >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.502 sec >>> Running org.apache.hadoop.hbase.master.TestActiveMasterManager >>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.376 sec >>> Running org.apache.hadoop.hbase.master.TestClockSkewDetection >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.461 sec >>> Running org.apache.hadoop.hbase.master.snapshot.TestSnapshotFileCache >>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.426 sec >>> Running org.apache.hadoop.hbase.TestClusterBootOrder >>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.397 sec >>> Running >>> org.apache.hadoop.hbase.master.handler.TestTableDescriptorModification >>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.281 sec >>> Running org.apache.hadoop.hbase.master.handler.TestCreateTableHandler >>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.171 sec >>> Running >>> org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.488 sec >>> Running org.apache.hadoop.hbase.client.TestFromClientSideWithCoprocessor >>> Tests run: 59, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 192.84 >>> sec >>> Running org.apache.hadoop.hbase.master.TestMaster >>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.44 sec >>> Running >>> org.apache.hadoop.hbase.master.handler.TestTableDeleteFamilyHandler >>> Running org.apache.hadoop.hbase.master.TestDefaultLoadBalancer >>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.345 sec >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.602 sec >>> Running org.apache.hadoop.hbase.master.TestDeadServer >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.39 sec >>> Running org.apache.hadoop.hbase.master.TestHMasterRPCException >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.073 sec >>> Running org.apache.hadoop.hbase.master.TestMasterTransitions >>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 21.095 sec >>> Running org.apache.hadoop.hbase.client.TestFromClientSide >>> Tests run: 59, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 188.263 >>> sec >>> Running org.apache.hadoop.hbase.master.cleaner.TestLogsCleaner >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.29 sec >>> Running org.apache.hadoop.hbase.master.cleaner.TestHFileCleaner >>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.634 sec >>> Running org.apache.hadoop.hbase.master.TestZKBasedOpenCloseRegion >>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.363 sec >>> Running org.apache.hadoop.hbase.master.TestMasterZKSessionRecovery >>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.567 sec >>> Running org.apache.hadoop.hbase.master.TestRestartCluster >>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.005 sec >>> Running org.apache.hadoop.hbase.master.cleaner.TestSnapshotFromMaster >>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.457 sec >>> Running org.apache.hadoop.hbase.master.TestMasterFileSystem >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.471 sec >>> Running org.apache.hadoop.hbase.master.TestSplitLogManager >>> Running org.apache.hadoop.hbase.master.TestRollingRestart >>> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 83.977 >>> sec >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.002 sec >>> Running org.apache.hadoop.hbase.master.TestAssignmentManager >>> Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.481 sec >>> Running org.apache.hadoop.hbase.master.TestMasterFailover >>> Running org.apache.hadoop.hbase.master.TestMasterStatusServlet >>> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.541 sec >>> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 80.283 sec >>> Running org.apache.hadoop.hbase.master.TestOpenedRegionHandler >>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.376 sec >>> Running org.apache.hadoop.hbase.master.TestMasterShutdown >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.917 sec >>> Running org.apache.hadoop.hbase.io.hfile.TestChecksum >>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.416 sec >>> Running org.apache.hadoop.hbase.io.hfile.TestHFileBlockIndex >>> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.405 >>> sec >>> Running org.apache.hadoop.hbase.io.hfile.TestFixedFileTrailer >>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.022 sec >>> Running org.apache.hadoop.hbase.io.hfile.TestHFileSeek >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.5 sec >>> Running org.apache.hadoop.hbase.io.hfile.TestHFileBlock >>> Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.409 >>> sec >>> Running org.apache.hadoop.hbase.io.hfile.TestHFileBlockCompatibility >>> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.921 sec >>> Running org.apache.hadoop.hbase.io.hfile.TestLruBlockCache >>> Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.074 sec >>> Running org.apache.hadoop.hbase.io.hfile.TestHFilePerformance >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.77 sec >>> Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting >>> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 156.566 >>> sec >>> Running org.apache.hadoop.hbase.io.hfile.slab.TestSlabCache >>> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.731 sec >>> Running org.apache.hadoop.hbase.io.hfile.slab.TestSingleSizeCache >>> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.9 sec >>> Running org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite >>> Tests run: 36, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.462 >>> sec >>> Running org.apache.hadoop.hbase.io.encoding.TestLoadAndSwitchEncodeOnDisk >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.275 sec >>> Running org.apache.hadoop.hbase.io.hfile.TestForceCacheImportantBlocks >>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 73.349 sec >>> Running org.apache.hadoop.hbase.io.TestFileLink >>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.588 sec >>> Running >>> org.apache.hadoop.hbase.io.encoding.TestUpgradeFromHFileV1ToEncoding >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 114.357 >>> sec >>> Running org.apache.hadoop.hbase.io.encoding.TestDataBlockEncoders >>> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 167.193 >>> sec >>> Running org.apache.hadoop.hbase.TestInfoServers >>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.594 sec >>> Running org.apache.hadoop.hbase.thrift.TestThriftServer >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.404 sec >>> Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles >>> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.7 sec >>> Running org.apache.hadoop.hbase.TestFullLogReconstruction >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.539 sec >>> Running org.apache.hadoop.hbase.io.encoding.TestChangingEncoding >>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 296.209 >>> sec >>> Running org.apache.hadoop.hbase.thrift.TestThriftServerCmdLine >>> Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 376.209 >>> sec >>> Running org.apache.hadoop.hbase.mapreduce.TestMultithreadedTableMapper >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 182.42 sec >>> Running org.apache.hadoop.hbase.mapreduce.TestWALPlayer >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 85.369 sec >>> Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduce >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 166.412 >>> sec >>> Running org.apache.hadoop.hbase.mapreduce.TestTimeRangeMapRed >>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.119 sec >>> Running org.apache.hadoop.hbase.mapreduce.TestHLogRecordReader >>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.066 sec >>> Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2 >>> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 461.92 sec >>> Running org.apache.hadoop.hbase.mapreduce.TestImportTsv >>> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 452.382 >>> sec >>> Running >>> org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery >>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 93.041 sec >>> Running org.apache.hadoop.hbase.mapreduce.TestImportExport >>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 121.374 >>> sec >>> Running org.apache.hadoop.hbase.TestMultiVersions >>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.135 sec >>> Running org.apache.hadoop.hbase.constraint.TestConstraint >>> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.243 sec >>> Running org.apache.hadoop.hbase.TestAcidGuarantees >>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 107.309 >>> sec >>> Running org.apache.hadoop.hbase.procedure.TestZKProcedureControllers >>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.27 sec >>> Running org.apache.hadoop.hbase.procedure.TestZKProcedure >>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.774 sec >>> Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat >>> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 526.822 >>> sec >>> Running org.apache.hadoop.hbase.TestZooKeeper >>> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.744 sec >>> Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase >>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.456 sec >>> Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 >>> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 490.142 >>> sec >>> Running org.apache.hadoop.hbase.backup.TestHFileArchiving >>> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 178.892 >>> sec >>> Running org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat >>> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 603.965 >>> sec >>> >>> Results : >>> >>> Failed tests: >>> testRetrying(org.apache.hadoop.hbase.catalog.TestMetaReaderEditor): reader: >>> count=1, t=null >>> >>> Tests in error: >>> testTableExists(org.apache.hadoop.hbase.catalog.TestMetaReaderEditor): >>> Failed after attempts=10, exceptions:(..) >>> testGetRegion(org.apache.hadoop.hbase.catalog.TestMetaReaderEditor): >>> Failed after attempts=10, exceptions:(..) >>> >>> testScanMetaForTable(org.apache.hadoop.hbase.catalog.TestMetaReaderEditor) >>> >>> Tests run: 1348, Failures: 1, Errors: 3, Skipped: 13 >>> >>> [JENKINS] Recording test results >>> [INFO] >>> ------------------------------------------------------------------------ >>> [INFO] BUILD FAILURE >>> [INFO] >>> ------------------------------------------------------------------------ >>> [INFO] Total time: 1:06:05.589s >>> [INFO] Finished at: Thu May 09 07:25:26 UTC 2013 >>> [INFO] Final Memory: 53M/254M >>> [INFO] >>> ------------------------------------------------------------------------ >>> [JENKINS] Archiving <http://54.241.6.143/job/HBase-0.94/ws/pom.xml> to >>> /var/lib/jenkins/jobs/HBase-0.94/modules/org.apache.hbase$hbase/builds/2013-05-09_06-19-13/archive/org.apache.hbase/hbase/0.94.8-SNAPSHOT/hbase-0.94.8-SNAPSHOT.pom >>> Waiting for Jenkins to finish collecting data >>> mavenExecutionResult exceptions not empty >>> message : Failed to execute goal >>> org.apache.maven.plugins:maven-surefire-plugin:2.12-TRUNK-HBASE-2:test >>> (secondPartTestsExecution) on project hbase: There are test failures. >>> >>> Please refer to < >>> http://54.241.6.143/job/HBase-0.94/ws/target/surefire-reports> for the >>> individual test results. >>> cause : There are test failures. >>> >>> Please refer to < >>> http://54.241.6.143/job/HBase-0.94/ws/target/surefire-reports> for the >>> individual test results. >>> Stack trace : >>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute >>> goal org.apache.maven.plugins:maven-surefire-plugin:2.12-TRUNK-HBASE-2:test >>> (secondPartTestsExecution) on project hbase: There are test failures. >>> >>> Please refer to < >>> http://54.241.6.143/job/HBase-0.94/ws/target/surefire-reports> for the >>> individual test results. >>> at >>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:213) >>> at >>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) >>> at >>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) >>> at >>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) >>> at >>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) >>> at >>> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) >>> at >>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) >>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) >>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) >>> at >>> org.jvnet.hudson.maven3.launcher.Maven3Launcher.main(Maven3Launcher.java:79) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:597) >>> at >>> org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:329) >>> at >>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:239) >>> at >>> org.jvnet.hudson.maven3.agent.Maven3Main.launch(Maven3Main.java:158) >>> at hudson.maven.Maven3Builder.call(Maven3Builder.java:100) >>> at hudson.maven.Maven3Builder.call(Maven3Builder.java:66) >>> at hudson.remoting.UserRequest.perform(UserRequest.java:118) >>> at hudson.remoting.UserRequest.perform(UserRequest.java:48) >>> at hudson.remoting.Request$2.run(Request.java:326) >>> at >>> hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) >>> at >>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) >>> at java.util.concurrent.FutureTask.run(FutureTask.java:138) >>> at >>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) >>> at >>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) >>> at java.lang.Thread.run(Thread.java:662) >>> Caused by: org.apache.maven.plugin.MojoFailureException: There are test >>> failures. >>> >>> Please refer to < >>> http://54.241.6.143/job/HBase-0.94/ws/target/surefire-reports> for the >>> individual test results. >>> at >>> org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:87) >>> at >>> org.apache.maven.plugin.surefire.SurefirePlugin.writeSummary(SurefirePlugin.java:651) >>> at >>> org.apache.maven.plugin.surefire.SurefirePlugin.handleSummary(SurefirePlugin.java:625) >>> at >>> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:137) >>> at >>> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:98) >>> at >>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101) >>> at >>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209) >>> ... 27 more >>> channel stopped >>> Archiving artifacts >> >> >> >> -- >> Best regards, >> >> - Andy >> >> Problems worthy of attack prove their worth by hitting back. - Piet Hein >> (via Tom White) > > > > -- > Best regards, > > - Andy > > Problems worthy of attack prove their worth by hitting back. - Piet Hein > (via Tom White)
