[
https://issues.apache.org/jira/browse/IGNITE-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ilya Shishkov updated IGNITE-18549:
-----------------------------------
Description:
Currently, there are flaky timeouts in an {{#afterTest}} method of
{{CdcKafkaReplicationTest}}, {{CdcKafkaReplicationAppsTest}}.
Sometimes, tests stuck on waiting of topics deletion and thread dump is printed
into log:
{quote}
[2023-01-13T08:13:22,320][INFO
][after-test-timeout-org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest][]
org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest.{color:red}afterTest{color}()
timed out, dumping threads (afterTest() still keeps running)
{quote}
As we can see in thread dump, method awaits topic deletion at line #92 of
{{CdcKafkaReplicationTest.java}} [1]:
{quote}
[08:13:22] : [Step 3/3] Thread [name="main", id=1, state=TIMED_WAITING,
blockCnt=460, waitCnt=3547]
[08:13:22] : [Step 3/3] at java.lang.Thread.sleep(Native Method)
[08:13:22] : [Step 3/3] at
o.a.i.i.util.IgniteUtils.sleep(IgniteUtils.java:8266)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2055)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2023)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2004)
[08:13:22] : [Step 3/3] {color:red}at
o.a.i.cdc.kafka.CdcKafkaReplicationTest.afterTest(CdcKafkaReplicationTest.java:92){color}
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.GridAbstractTest.runAfterTest(GridAbstractTest.java:762)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.GridAbstractTest.cleanUpTestEnviroment(GridAbstractTest.java:739)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.GridAbstractTest.runTest(GridAbstractTest.java:2555)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.GridAbstractTest.access$600(GridAbstractTest.java:194)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.GridAbstractTest$1.evaluate(GridAbstractTest.java:237)
[08:13:22] : [Step 3/3] at
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.SystemPropertiesRule.lambda$methodStatement$1(SystemPropertiesRule.java:110)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.SystemPropertiesRule$$Lambda$56/739582925.evaluate(Unknown
Source)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.DelegatingJUnitStatement.evaluate(DelegatingJUnitStatement.java:49)
{quote}
These timeouts leads to test execution over 5 minutes [2-4].
Reason should be investigated and fixed.
Links:
#
https://github.com/apache/ignite-extensions/blob/master/modules/cdc-ext/src/test/java/org/apache/ignite/cdc/kafka/CdcKafkaReplicationTest.java#L92
# [TC1 Build #412 at 13 Jan
08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/7003974?buildTab=tests&orderBy=duration&order=desc],
build log: [^_TESTS_CDC_412.log.zip]
# [TC1 Build #411 at 12 Jan
08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/7002590?buildTab=tests&orderBy=duration&order=desc],
build log: [^_TESTS_CDC_411.log.zip]
# [TC1 Build #411 at 12 Jan
08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/6998391?buildTab=tests&orderBy=duration&order=desc],
build log:
was:
Currently, there are flaky timeouts in an {{#afterTest}} method of
{{CdcKafkaReplicationTest}}, {{CdcKafkaReplicationAppsTest}}.
Sometimes, tests stuck on waiting of topics deletion and thread dump is printed
into log:
{quote}
[2023-01-13T08:13:22,320][INFO
][after-test-timeout-org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest][]
org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest.{color:red}afterTest{color}()
timed out, dumping threads (afterTest() still keeps running)
{quote}
As we can see in thread dump, method awaits topic deletion at line #92 of
{{CdcKafkaReplicationTest.java}} [1]:
{quote}
[08:13:22] : [Step 3/3] Thread [name="main", id=1, state=TIMED_WAITING,
blockCnt=460, waitCnt=3547]
[08:13:22] : [Step 3/3] at java.lang.Thread.sleep(Native Method)
[08:13:22] : [Step 3/3] at
o.a.i.i.util.IgniteUtils.sleep(IgniteUtils.java:8266)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2055)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2023)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2004)
[08:13:22] : [Step 3/3] {color:red}at
o.a.i.cdc.kafka.CdcKafkaReplicationTest.afterTest(CdcKafkaReplicationTest.java:92){color}
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.GridAbstractTest.runAfterTest(GridAbstractTest.java:762)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.GridAbstractTest.cleanUpTestEnviroment(GridAbstractTest.java:739)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.GridAbstractTest.runTest(GridAbstractTest.java:2555)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.GridAbstractTest.access$600(GridAbstractTest.java:194)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.GridAbstractTest$1.evaluate(GridAbstractTest.java:237)
[08:13:22] : [Step 3/3] at
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.SystemPropertiesRule.lambda$methodStatement$1(SystemPropertiesRule.java:110)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.SystemPropertiesRule$$Lambda$56/739582925.evaluate(Unknown
Source)
[08:13:22] : [Step 3/3] at
o.a.i.testframework.junits.DelegatingJUnitStatement.evaluate(DelegatingJUnitStatement.java:49)
{quote}
These timeouts leads to test execution over 5 minutes [2-4].
Reason should be investigated and fixed.
Links:
#
https://github.com/apache/ignite-extensions/blob/master/modules/cdc-ext/src/test/java/org/apache/ignite/cdc/kafka/CdcKafkaReplicationTest.java#L92
# [TC1 Build #412 at 13 Jan
08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/7003974?buildTab=tests&orderBy=duration&order=desc],
build log: [^_TESTS_CDC_412.log.zip]
# [TC1 Build #411 at 12 Jan
08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/7002590?buildTab=tests&orderBy=duration&order=desc],
build log:
# [TC1 Build #411 at 12 Jan
08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/6998391?buildTab=tests&orderBy=duration&order=desc],
build log:
> Fix timeouts of CdcKafkaReplicationTest#afterTest
> -------------------------------------------------
>
> Key: IGNITE-18549
> URL: https://issues.apache.org/jira/browse/IGNITE-18549
> Project: Ignite
> Issue Type: Test
> Components: extensions
> Reporter: Ilya Shishkov
> Priority: Minor
> Labels: IEP-59, ise
> Attachments: _TESTS_CDC_407.log.zip, _TESTS_CDC_411.log.zip,
> _TESTS_CDC_412.log.zip
>
>
> Currently, there are flaky timeouts in an {{#afterTest}} method of
> {{CdcKafkaReplicationTest}}, {{CdcKafkaReplicationAppsTest}}.
> Sometimes, tests stuck on waiting of topics deletion and thread dump is
> printed into log:
> {quote}
> [2023-01-13T08:13:22,320][INFO
> ][after-test-timeout-org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest][]
> org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest.{color:red}afterTest{color}()
> timed out, dumping threads (afterTest() still keeps running)
> {quote}
> As we can see in thread dump, method awaits topic deletion at line #92 of
> {{CdcKafkaReplicationTest.java}} [1]:
> {quote}
> [08:13:22] : [Step 3/3] Thread [name="main", id=1, state=TIMED_WAITING,
> blockCnt=460, waitCnt=3547]
> [08:13:22] : [Step 3/3] at java.lang.Thread.sleep(Native Method)
> [08:13:22] : [Step 3/3] at
> o.a.i.i.util.IgniteUtils.sleep(IgniteUtils.java:8266)
> [08:13:22] : [Step 3/3] at
> o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2055)
> [08:13:22] : [Step 3/3] at
> o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2023)
> [08:13:22] : [Step 3/3] at
> o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2004)
> [08:13:22] : [Step 3/3] {color:red}at
> o.a.i.cdc.kafka.CdcKafkaReplicationTest.afterTest(CdcKafkaReplicationTest.java:92){color}
> [08:13:22] : [Step 3/3] at
> o.a.i.testframework.junits.GridAbstractTest.runAfterTest(GridAbstractTest.java:762)
> [08:13:22] : [Step 3/3] at
> o.a.i.testframework.junits.GridAbstractTest.cleanUpTestEnviroment(GridAbstractTest.java:739)
> [08:13:22] : [Step 3/3] at
> o.a.i.testframework.junits.GridAbstractTest.runTest(GridAbstractTest.java:2555)
> [08:13:22] : [Step 3/3] at
> o.a.i.testframework.junits.GridAbstractTest.access$600(GridAbstractTest.java:194)
> [08:13:22] : [Step 3/3] at
> o.a.i.testframework.junits.GridAbstractTest$1.evaluate(GridAbstractTest.java:237)
> [08:13:22] : [Step 3/3] at
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> [08:13:22] : [Step 3/3] at
> o.a.i.testframework.junits.SystemPropertiesRule.lambda$methodStatement$1(SystemPropertiesRule.java:110)
> [08:13:22] : [Step 3/3] at
> o.a.i.testframework.junits.SystemPropertiesRule$$Lambda$56/739582925.evaluate(Unknown
> Source)
> [08:13:22] : [Step 3/3] at
> o.a.i.testframework.junits.DelegatingJUnitStatement.evaluate(DelegatingJUnitStatement.java:49)
> {quote}
> These timeouts leads to test execution over 5 minutes [2-4].
> Reason should be investigated and fixed.
> Links:
> #
> https://github.com/apache/ignite-extensions/blob/master/modules/cdc-ext/src/test/java/org/apache/ignite/cdc/kafka/CdcKafkaReplicationTest.java#L92
> # [TC1 Build #412 at 13 Jan
> 08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/7003974?buildTab=tests&orderBy=duration&order=desc],
> build log: [^_TESTS_CDC_412.log.zip]
> # [TC1 Build #411 at 12 Jan
> 08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/7002590?buildTab=tests&orderBy=duration&order=desc],
> build log: [^_TESTS_CDC_411.log.zip]
> # [TC1 Build #411 at 12 Jan
> 08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/6998391?buildTab=tests&orderBy=duration&order=desc],
> build log:
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
