[ https://issues.apache.org/jira/browse/HBASE-23000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926798#comment-16926798 ]
Rushabh S Shah commented on HBASE-23000: ---------------------------------------- I did some analysis yesterday. Found the commit that caused these tests to fail. This is the jira: https://issues.apache.org/jira/browse/HBASE-22627 I reverted just 1 commit from branch-1.3 head and ran all the failing tests and it succeeded. See the results below. {noformat} [INFO] --- maven-surefire-plugin:2.22.2:test (default-test) @ hbase-server --- [INFO] [INFO] ------------------------------------------------------- [INFO] T E S T S [INFO] ------------------------------------------------------- [INFO] Running org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 112.481 s - in org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad [INFO] Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.036 s - in org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort [INFO] Running org.apache.hadoop.hbase.master.TestMasterFileSystemWithWALDir [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.381 s - in org.apache.hadoop.hbase.master.TestMasterFileSystemWithWALDir [INFO] Running org.apache.hadoop.hbase.fs.TestBlockReorder [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.484 s - in org.apache.hadoop.hbase.fs.TestBlockReorder [INFO] [INFO] Results: [INFO] [INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] [INFO] --- maven-surefire-plugin:2.22.2:test (secondPartTestsExecution) @ hbase-server --- [INFO] Tests are skipped. [INFO] ------------------------------------------------------------------------ {noformat} git log output: {noformat} commit e55a9054dacfacdef1dcb2d8d18e41dfd107f78e (HEAD -> HBASE-23000) Author: Rushabh <rushabh.s...@salesforce.com> Date: Tue Sep 10 09:42:26 2019 -0700 Revert "HBASE-22627 Port HBASE-22617 (Recovered WAL directories not getting cleaned up) to branch-1 (#339)" This reverts commit 13d1c231ba010854e3a3d2d5b9e028b40c28e3e0. commit 64c0ac5dd4e2dac664c58cbe309a9d8b4a69c4c9 (origin/branch-1.3, branch-1.3) Author: ravowlga123 <ravow...@gmail.com> Date: Thu Aug 29 17:29:24 2019 +0200 HBASE-22900 Multiple httpcore and httpclient versions included in binary package (branch-1.3 and branch-1.4) closes #563 Signed-off-by: Jan Hentschel <jan.hentsc...@ultratendency.com> Signed-off-by: Sean Busbey <bus...@apache.org> {noformat} I will post how the test fails in next post. > Fix all consistently failing tests in branch-1.3 > ------------------------------------------------ > > Key: HBASE-23000 > URL: https://issues.apache.org/jira/browse/HBASE-23000 > Project: HBase > Issue Type: Bug > Components: test > Affects Versions: 1.3.6 > Reporter: Rushabh S Shah > Assignee: Rushabh S Shah > Priority: Major > > Flaky test report: > https://builds.apache.org/view/H-L/view/HBase/job/HBase-Find-Flaky-Tests/job/branch-1.3/Flaky_20Test_20Report/dashboard.html#job_2 > In last 30 builds this test failed all 30 times. > Here is the stack trace: > {noformat} > Stacktrace > java.io.IOException: Shutting down > at > org.apache.hadoop.hbase.fs.TestBlockReorder.testBlockLocation(TestBlockReorder.java:428) > Caused by: java.lang.RuntimeException: Master not initialized after 200000ms > seconds > at > org.apache.hadoop.hbase.fs.TestBlockReorder.testBlockLocation(TestBlockReorder.java:428) > {noformat} > Link to latest jenkins build: > https://builds.apache.org/job/HBase-Flaky-Tests/job/branch-1.3/9351/testReport/org.apache.hadoop.hbase.fs/TestBlockReorder/testBlockLocation/ -- This message was sent by Atlassian Jira (v8.3.2#803003)