I’ve been running that one failing test in a loop and most of the failures exhibit an unexpected value of 101, but occasionally some fail with a greater value (observed values of 102, 103, and even 113 and 124).
In all those cases, it appears the value of serverSpy->count() is always 100, and the value of errorSpy->count() is ≥ 0. I suspect a behaviour change in Qt. We now have to support three different versions: - 5.4.1 in vivid+overlay - 5.5.1 in xenial+overlay - 5.6.1 in yakkety Given these constraints, it looks like the test expectations will need to be made laxer. -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to webbrowser-app in Ubuntu. https://bugs.launchpad.net/bugs/1611403 Title: Intermittent unit test failure with Qt 5.6 in yakkety Status in webbrowser-app package in Ubuntu: In Progress Bug description: I’m seeing tst_FaviconFetcherTests intermittently fail in CI runs on yakkety. Those test runs are carried out in sbuild environments with -proposed enabled, where Qt 5.6.1 recently appeared. I’m able to reproduce the failure locally in a yakkety chroot: FAIL! : FaviconFetcherTests::shouldCancelRequests() Compared values are not the same Actual (serverSpy->count() + errorSpy->count()): 101 Expected (requests) : 100 Loc: [/tmp/webbrowser-app/tests/unittests/favicon-fetcher/tst_FaviconFetcherTests.cpp(297)] I’m unable to reproduce in the same chroot with Qt 5.5.1. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/webbrowser-app/+bug/1611403/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : [email protected] Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
