[
https://issues.apache.org/jira/browse/IGNITE-21792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17909400#comment-17909400
]
Matthias Klenz commented on IGNITE-21792:
-----------------------------------------
h2. *Test Reports (with JUnit Annotation)*
Manual: tests are executed manually from an IDE (Intelij)
Automated: tests are executed from another program for parallaization, stressing
Stressor: CPU/RAM almost fully utilised during test execution
h3.
Test Setup 1
Specs:
CPU: 13th Gen Intel© Core™ i7-13700KF × 16
RAM: 32gb
||Type||Timeout setting||Result||
|Manual, 5 runs|2s|timeout|
|Manual, 5 runs|3s|success|
|Manual, 5 runs |2.5s|flaky|
|Automated, 50 runs (stressor)|5s|success|
|Automated, 50 runs (stressor)|10s|success|
Note: At 5 seconds, other tests in the test suite begin to flake.
h3. Test Setup 2
Specs:
CPU:Intel© Core™ i7-5000U × 4
RAM: 16gb
||Type||Timeout setting||Result||
|Automated, 10 runs (stressor)|5s|success|
|Automated, 10 runs (stressor)|10s|success|
h3. Test Setup 3
Github Action
||Type||Timeout setting||Result||
|20 runs |5s|success|
|10 runs|10s|success|
> ItNodeTest#testFollowerStartStopFollowing is flaky
> --------------------------------------------------
>
> Key: IGNITE-21792
> URL: https://issues.apache.org/jira/browse/IGNITE-21792
> Project: Ignite
> Issue Type: Bug
> Reporter: Alexander Lapin
> Assignee: Matthias Klenz
> Priority: Major
> Labels: ignite-3
> Time Spent: 20m
> Remaining Estimate: 0h
>
> ItNodeTest#testFollowerStartStopFollowing is flaky with
> {code:java}
> org.opentest4j.AssertionFailedError: expected: <true> but was: <false> at
> app//org.junit.jupiter.api.AssertionFailureBuilder.build(AssertionFailureBuilder.java:151)
> at
> app//org.junit.jupiter.api.AssertionFailureBuilder.buildAndThrow(AssertionFailureBuilder.java:132)
> at app//org.junit.jupiter.api.AssertTrue.failNotTrue(AssertTrue.java:63)
> at app//org.junit.jupiter.api.AssertTrue.assertTrue(AssertTrue.java:36) at
> app//org.junit.jupiter.api.AssertTrue.assertTrue(AssertTrue.java:31) at
> app//org.junit.jupiter.api.Assertions.assertTrue(Assertions.java:183) at
> app//org.apache.ignite.raft.jraft.core.ItNodeTest.testFollowerStartStopFollowing(ItNodeTest.java:2636)
> at [email protected]/java.lang.reflect.Method.invoke(Method.java:566) at
> [email protected]/java.util.ArrayList.forEach(ArrayList.java:1541) at
> [email protected]/java.util.ArrayList.forEach(ArrayList.java:1541) {code}
> [TC failure
> link|https://ci.ignite.apache.org/buildConfiguration/ApacheIgnite3xGradle_Test_RunAllTests/7944770?expandBuildDeploymentsSection=false&hideTestsFromDependencies=false&expandBuildTestsSection=true&hideProblemsFromDependencies=false&expandCode+Inspection=true&expandBuildProblemsSection=true&expandBuildChangesSection=true]
> *Definition of done*
> The test should have a timeout long enough to pass at least 95% of the time.
> If the test reaches the timeout, the test report will state that the test
> timed out and did not fail.
> *Implementation notes*
> Removed all statements that throw an exception when a timeout is reached, and
> used the JUnit timeout annotation instead.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
