[ 
https://issues.apache.org/jira/browse/IGNITE-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ilya Shishkov updated IGNITE-18549:
-----------------------------------
    Description: 
Currently, there are flaky timeouts in an {{#afterTest}} method of 
{{CdcKafkaReplicationTest}}, {{CdcKafkaReplicationAppsTest}}.

Sometimes, tests stuck on waiting of topics deletion and thread dump is printed 
into log:
{quote}
[2023-01-13T08:13:22,320][INFO 
][after-test-timeout-org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest][] 
org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest.{color:red}afterTest{color}()
 timed out, dumping threads (afterTest() still keeps running)
{quote}

As we can see in thread dump, method awaits topic deletion at line #92 of 
{{CdcKafkaReplicationTest.java}} [1]:
{quote}
[08:13:22] :     [Step 3/3] Thread [name="main", id=1, state=TIMED_WAITING, 
blockCnt=460, waitCnt=3547]
[08:13:22] :     [Step 3/3]         at java.lang.Thread.sleep(Native Method)
[08:13:22] :     [Step 3/3]         at 
o.a.i.i.util.IgniteUtils.sleep(IgniteUtils.java:8266)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2055)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2023)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2004)
[08:13:22] :     [Step 3/3]         {color:red}at 
o.a.i.cdc.kafka.CdcKafkaReplicationTest.afterTest(CdcKafkaReplicationTest.java:92){color}
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.GridAbstractTest.runAfterTest(GridAbstractTest.java:762)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.GridAbstractTest.cleanUpTestEnviroment(GridAbstractTest.java:739)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.GridAbstractTest.runTest(GridAbstractTest.java:2555)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.GridAbstractTest.access$600(GridAbstractTest.java:194)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.GridAbstractTest$1.evaluate(GridAbstractTest.java:237)
[08:13:22] :     [Step 3/3]         at 
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.SystemPropertiesRule.lambda$methodStatement$1(SystemPropertiesRule.java:110)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.SystemPropertiesRule$$Lambda$56/739582925.evaluate(Unknown
 Source)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.DelegatingJUnitStatement.evaluate(DelegatingJUnitStatement.java:49)
{quote}

These timeouts leads to test execution over 5 minutes [2-4].
Reason should be investigated and fixed. 

Links:
# 
https://github.com/apache/ignite-extensions/blob/master/modules/cdc-ext/src/test/java/org/apache/ignite/cdc/kafka/CdcKafkaReplicationTest.java#L92
# [TC1 Build #412 at 13 Jan 
08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/7003974?buildTab=tests&orderBy=duration&order=desc],
 build log:  [^_TESTS_CDC_412.log.zip] 
# [TC1 Build #411 at 12 Jan 
08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/7002590?buildTab=tests&orderBy=duration&order=desc],
 build log:  [^_TESTS_CDC_411.log.zip] 
# [TC1 Build #407 at 10 Jan 
08:00|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/6998391?buildTab=tests&orderBy=duration&order=desc],
 build log:  [^_TESTS_CDC_407.log.zip] 



  was:
Currently, there are flaky timeouts in an {{#afterTest}} method of 
{{CdcKafkaReplicationTest}}, {{CdcKafkaReplicationAppsTest}}.

Sometimes, tests stuck on waiting of topics deletion and thread dump is printed 
into log:
{quote}
[2023-01-13T08:13:22,320][INFO 
][after-test-timeout-org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest][] 
org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest.{color:red}afterTest{color}()
 timed out, dumping threads (afterTest() still keeps running)
{quote}

As we can see in thread dump, method awaits topic deletion at line #92 of 
{{CdcKafkaReplicationTest.java}} [1]:
{quote}
[08:13:22] :     [Step 3/3] Thread [name="main", id=1, state=TIMED_WAITING, 
blockCnt=460, waitCnt=3547]
[08:13:22] :     [Step 3/3]         at java.lang.Thread.sleep(Native Method)
[08:13:22] :     [Step 3/3]         at 
o.a.i.i.util.IgniteUtils.sleep(IgniteUtils.java:8266)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2055)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2023)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2004)
[08:13:22] :     [Step 3/3]         {color:red}at 
o.a.i.cdc.kafka.CdcKafkaReplicationTest.afterTest(CdcKafkaReplicationTest.java:92){color}
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.GridAbstractTest.runAfterTest(GridAbstractTest.java:762)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.GridAbstractTest.cleanUpTestEnviroment(GridAbstractTest.java:739)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.GridAbstractTest.runTest(GridAbstractTest.java:2555)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.GridAbstractTest.access$600(GridAbstractTest.java:194)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.GridAbstractTest$1.evaluate(GridAbstractTest.java:237)
[08:13:22] :     [Step 3/3]         at 
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.SystemPropertiesRule.lambda$methodStatement$1(SystemPropertiesRule.java:110)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.SystemPropertiesRule$$Lambda$56/739582925.evaluate(Unknown
 Source)
[08:13:22] :     [Step 3/3]         at 
o.a.i.testframework.junits.DelegatingJUnitStatement.evaluate(DelegatingJUnitStatement.java:49)
{quote}

These timeouts leads to test execution over 5 minutes [2-4].
Reason should be investigated and fixed. 

Links:
# 
https://github.com/apache/ignite-extensions/blob/master/modules/cdc-ext/src/test/java/org/apache/ignite/cdc/kafka/CdcKafkaReplicationTest.java#L92
# [TC1 Build #412 at 13 Jan 
08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/7003974?buildTab=tests&orderBy=duration&order=desc],
 build log:  [^_TESTS_CDC_412.log.zip] 
# [TC1 Build #411 at 12 Jan 
08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/7002590?buildTab=tests&orderBy=duration&order=desc],
 build log:  [^_TESTS_CDC_411.log.zip] 
# [TC1 Build #411 at 12 Jan 
08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/6998391?buildTab=tests&orderBy=duration&order=desc],
 build log:  [^_TESTS_CDC_407.log.zip] 




> Fix timeouts of CdcKafkaReplicationTest#afterTest
> -------------------------------------------------
>
>                 Key: IGNITE-18549
>                 URL: https://issues.apache.org/jira/browse/IGNITE-18549
>             Project: Ignite
>          Issue Type: Test
>          Components: extensions
>            Reporter: Ilya Shishkov
>            Priority: Minor
>              Labels: IEP-59, ise
>         Attachments: _TESTS_CDC_407.log.zip, _TESTS_CDC_411.log.zip, 
> _TESTS_CDC_412.log.zip
>
>
> Currently, there are flaky timeouts in an {{#afterTest}} method of 
> {{CdcKafkaReplicationTest}}, {{CdcKafkaReplicationAppsTest}}.
> Sometimes, tests stuck on waiting of topics deletion and thread dump is 
> printed into log:
> {quote}
> [2023-01-13T08:13:22,320][INFO 
> ][after-test-timeout-org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest][] 
> org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest.{color:red}afterTest{color}()
>  timed out, dumping threads (afterTest() still keeps running)
> {quote}
> As we can see in thread dump, method awaits topic deletion at line #92 of 
> {{CdcKafkaReplicationTest.java}} [1]:
> {quote}
> [08:13:22] :   [Step 3/3] Thread [name="main", id=1, state=TIMED_WAITING, 
> blockCnt=460, waitCnt=3547]
> [08:13:22] :   [Step 3/3]         at java.lang.Thread.sleep(Native Method)
> [08:13:22] :   [Step 3/3]         at 
> o.a.i.i.util.IgniteUtils.sleep(IgniteUtils.java:8266)
> [08:13:22] :   [Step 3/3]         at 
> o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2055)
> [08:13:22] :   [Step 3/3]         at 
> o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2023)
> [08:13:22] :   [Step 3/3]         at 
> o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2004)
> [08:13:22] :   [Step 3/3]         {color:red}at 
> o.a.i.cdc.kafka.CdcKafkaReplicationTest.afterTest(CdcKafkaReplicationTest.java:92){color}
> [08:13:22] :   [Step 3/3]         at 
> o.a.i.testframework.junits.GridAbstractTest.runAfterTest(GridAbstractTest.java:762)
> [08:13:22] :   [Step 3/3]         at 
> o.a.i.testframework.junits.GridAbstractTest.cleanUpTestEnviroment(GridAbstractTest.java:739)
> [08:13:22] :   [Step 3/3]         at 
> o.a.i.testframework.junits.GridAbstractTest.runTest(GridAbstractTest.java:2555)
> [08:13:22] :   [Step 3/3]         at 
> o.a.i.testframework.junits.GridAbstractTest.access$600(GridAbstractTest.java:194)
> [08:13:22] :   [Step 3/3]         at 
> o.a.i.testframework.junits.GridAbstractTest$1.evaluate(GridAbstractTest.java:237)
> [08:13:22] :   [Step 3/3]         at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> [08:13:22] :   [Step 3/3]         at 
> o.a.i.testframework.junits.SystemPropertiesRule.lambda$methodStatement$1(SystemPropertiesRule.java:110)
> [08:13:22] :   [Step 3/3]         at 
> o.a.i.testframework.junits.SystemPropertiesRule$$Lambda$56/739582925.evaluate(Unknown
>  Source)
> [08:13:22] :   [Step 3/3]         at 
> o.a.i.testframework.junits.DelegatingJUnitStatement.evaluate(DelegatingJUnitStatement.java:49)
> {quote}
> These timeouts leads to test execution over 5 minutes [2-4].
> Reason should be investigated and fixed. 
> Links:
> # 
> https://github.com/apache/ignite-extensions/blob/master/modules/cdc-ext/src/test/java/org/apache/ignite/cdc/kafka/CdcKafkaReplicationTest.java#L92
> # [TC1 Build #412 at 13 Jan 
> 08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/7003974?buildTab=tests&orderBy=duration&order=desc],
>  build log:  [^_TESTS_CDC_412.log.zip] 
> # [TC1 Build #411 at 12 Jan 
> 08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/7002590?buildTab=tests&orderBy=duration&order=desc],
>  build log:  [^_TESTS_CDC_411.log.zip] 
> # [TC1 Build #407 at 10 Jan 
> 08:00|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/6998391?buildTab=tests&orderBy=duration&order=desc],
>  build log:  [^_TESTS_CDC_407.log.zip] 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to