Re: [Development] results of July flaky tests fixing

2022-09-01 Thread Thiago Macieira
On Thursday, 1 September 2022 06:28:55 -03 Volker Hilsheimer wrote: > * stress tests for data races: if your test doesn’t expose any race > conditions if you run with QThread::idealThreadCount threads, then it’s > unlikely that it will expose races if you run with more threads. But with > time

Re: [Development] results of July flaky tests fixing

2022-09-01 Thread Edward Welbourne
Volker Hilsheimer (1 September 2022 11:28) wrote (inter alia): > * hardcoded waiting times is an anti-pattern. A good way to avoid them is to use the QTRY_*() family of macros, as long as you can find something that shall become true by the time the waiting is no longer needed. Eddy.

Re: [Development] results of July flaky tests fixing

2022-09-01 Thread Volker Hilsheimer
Thanks for sharing that overview, Anna! When I chased after failures of my integrations caused by flaky tests during summer, I’ve seen a couple of patterns I think are worth keeping in mind when investigating flaky tests, or when writing new tests: * QTest::qWaitForWindowActive - very often,

[Development] results of July flaky tests fixing

2022-08-30 Thread Anna Wojciechowska
Hello, I would like to present the results of the July fixing of flaky tests. short version: 19 - number of platform-specific flakiness to start with: (14 different tests) as a result: 11 platform-specific flakiness was fixed (caused by 8 different tests) 4 platform specific flakiness was