[
https://issues.apache.org/jira/browse/HBASE-24131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17077269#comment-17077269
]
Michael Stack commented on HBASE-24131:
---------------------------------------
6 tests all timed out in this run actually. They all ran concurrently. All but
one were permutations on TestExportSnapshot. All failed w/ TEST TIMED OUT
running for longer than our 13 minute max:
{code}
[INFO]
[ERROR] Errors:
[ERROR] org.apache.hadoop.hbase.replication.TestVerifyReplication.null
[ERROR] Run 1:
TestVerifyReplication.testVerifyReplicationWithSnapshotSupport:449 »
TestTimedOut
[ERROR] Run 2: TestVerifyReplication » Appears to be stuck in thread Socket
Reader #1 for po...
[INFO]
[ERROR] org.apache.hadoop.hbase.snapshot.TestExportSnapshot.null
[ERROR] Run 1:
TestExportSnapshot.testExportRetry:267->testExportFileSystemState:227 »
TestTimedOut
[ERROR] Run 2: TestExportSnapshot » Appears to be stuck in thread
RS-EventLoopGroup-5-3
[INFO]
[ERROR]
org.apache.hadoop.hbase.snapshot.TestExportSnapshotWithTemporaryDirectory.null
[ERROR] Run 1:
TestExportSnapshotWithTemporaryDirectory>TestExportSnapshot.testExportRetry:267->TestExportSnapshot.testExportFileSystemState:227
» TestTimedOut
[ERROR] Run 2: TestExportSnapshotWithTemporaryDirectory » Appears to be
stuck in thread RS-E...
[INFO]
[ERROR] org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot.null
[ERROR] Run 1:
TestMobExportSnapshot>TestExportSnapshot.testExportRetry:267->TestExportSnapshot.testExportFileSystemState:227
» TestTimedOut
[ERROR] Run 2: TestMobExportSnapshot » Appears to be stuck in thread
RS-EventLoopGroup-5-3
[INFO]
[ERROR] org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot.null
[ERROR] Run 1:
TestMobSecureExportSnapshot>TestExportSnapshot.testExportRetry:267->TestExportSnapshot.testExportFileSystemState:227
» TestTimedOut
[ERROR] Run 2: TestMobSecureExportSnapshot » Appears to be stuck in thread
RS-EventLoopGroup...
[INFO]
[ERROR] org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot.null
[ERROR] Run 1:
TestSecureExportSnapshot>TestExportSnapshot.testExportRetry:267->TestExportSnapshot.testExportFileSystemState:227
» TestTimedOut
[ERROR] Run 2: TestSecureExportSnapshot » Appears to be stuck in thread
RS-EventLoopGroup-5-...
[INFO]
[INFO]
[ERROR] Tests run: 275, Failures: 0, Errors: 6, Skipped: 29
{code}
Let me break up these tests into smaller pieces.
> [Flakey Tests] TestExportSnapshot takes too long; up against 13min max
> ----------------------------------------------------------------------
>
> Key: HBASE-24131
> URL: https://issues.apache.org/jira/browse/HBASE-24131
> Project: HBase
> Issue Type: Bug
> Reporter: Michael Stack
> Priority: Major
>
> TestExportSnapshot fails fairly regularly locally. Looking, its test timeout.
> Looking at how long it ran, its 13minutes plus. Looking at recent successful
> branch-2 run, it passed but it took about 7-8minutes. Let me break up the
> test into to pieces.
> org.junit.runners.model.TestTimedOutException: test timed out after 780
> seconds
> at
> org.apache.hadoop.hbase.snapshot.TestExportSnapshot.testExportFileSystemState(TestExportSnapshot.java:227)
> at
> org.apache.hadoop.hbase.snapshot.TestExportSnapshot.testExportRetry(TestExportSnapshot.java:267)
> ... I see this in the log:
> ====> TEST TIMED OUT. PRINTING THREAD DUMP. <====
> Test started at:
> 2020-04-06 17:19:21,739 INFO
> ... and the timestamp just above the TIMED OUT was
> 2020-04-06 17:31:01,758
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
