Autotests `tst_qnmeapositioninfosource_simulation', `tst_qpacketprotocol
(qtquick1)', `tst_qsslsocket_onDemandCertificates_member', and
`tst_qsslsocket_onDemandCertificates_static' failed :(
Some (not all) of the tests were determined to be flaky, meaning results were
not consistent across multiple runs. This might make the problem difficult to
reproduce. Also, flaky failures might or might not be related to any recent
changes in the source code.
Testing tst_QNmeaPositionInfoSource_Simulation
FAIL! :
tst_QNmeaPositionInfoSource_Simulation::startUpdates_waitForValidDateTime(Feed
GGA,RMC,GGA; expect RMC, second GGA only) Compared values are not the same
Actual (spy.count()) : 0
Expected (dateTimes.count()): 2
..\tst_qnmeapositioninfosource.cpp(360) : failure location
FAIL! :
tst_QNmeaPositionInfoSource_Simulation::requestUpdate_waitForValidDateTime(Feed
GGA,RMC,GGA; expect RMC, second GGA only) Compared values are not the same
Actual (spy.count()): 0
Expected (1) : 1
..\tst_qnmeapositioninfosource.cpp(415) : failure location
Totals: 24 passed, 2 failed, 0 skipped
QtQA::App::TestRunner: test failed, running again to see if it is flaky...
********* Start testing of tst_QNmeaPositionInfoSource_Simulation *********
Config: Using QtTest library 5.2.0, Qt 5.2.0
PASS : tst_QNmeaPositionInfoSource_Simulation::initTestCase()
PASS : tst_QNmeaPositionInfoSource_Simulation::constructor()
PASS : tst_QNmeaPositionInfoSource_Simulation::supportedPositioningMethods()
PASS : tst_QNmeaPositionInfoSource_Simulation::minimumUpdateInterval()
PASS :
tst_QNmeaPositionInfoSource_Simulation::setUpdateInterval_delayedUpdate()
PASS : tst_QNmeaPositionInfoSource_Simulation::lastKnownPosition()
PASS :
tst_QNmeaPositionInfoSource_Simulation::beginWithBufferedData(startUpdates(), 1
update in buffer)
PASS :
tst_QNmeaPositionInfoSource_Simulation::beginWithBufferedData(requestUpdate(),
1 update in buffer)
PASS :
tst_QNmeaPositionInfoSource_Simulation::beginWithBufferedData(startUpdates(),
multiple updates in buffer)
PASS :
tst_QNmeaPositionInfoSource_Simulation::beginWithBufferedData(requestUpdate(),
multiple updates in buffer)
PASS : tst_QNmeaPositionInfoSource_Simulation::startUpdates(1 update)
PASS : tst_QNmeaPositionInfoSource_Simulation::startUpdates(2 updates)
PASS : tst_QNmeaPositionInfoSource_Simulation::startUpdates(10 updates)
PASS : tst_QNmeaPositionInfoSource_Simulation::startUpdates_withTimeout()
PASS :
tst_QNmeaPositionInfoSource_Simulation::startUpdates_expectLatestUpdateOnly()
PASS :
tst_QNmeaPositionInfoSource_Simulation::startUpdates_waitForValidDateTime(Feed
GGA,RMC,GGA; expect RMC, second GGA only)
PASS :
tst_QNmeaPositionInfoSource_Simulation::startUpdates_waitForValidDateTime(Feed
GGA,ZDA,GGA; expect second GGA only)
PASS :
tst_QNmeaPositionInfoSource_Simulation::startUpdates_waitForValidDateTime(Feed
good RMC, RMC with bad date/time, good RMC; expect first and third RMC only)
PASS :
tst_QNmeaPositionInfoSource_Simulation::requestUpdate_waitForValidDateTime(Feed
GGA,RMC,GGA; expect RMC, second GGA only)
PASS :
tst_QNmeaPositionInfoSource_Simulation::requestUpdate_waitForValidDateTime(Feed
GGA,ZDA,GGA; expect second GGA only)
PASS :
tst_QNmeaPositionInfoSource_Simulation::requestUpdate_waitForValidDateTime(Feed
good RMC, RMC with bad date/time, good RMC; expect first and third RMC only)
PASS : tst_QNmeaPositionInfoSource_Simulation::requestUpdate()
QWARN : tst_QNmeaPositionInfoSource_Simulation::requestUpdate_after_start()
QNmeaPositionInfoSource: no QIODevice data source, call setDevice() first
QWARN : tst_QNmeaPositionInfoSource_Simulation::requestUpdate_after_start()
QNmeaPositionInfoSource: no QIODevice data source, call setDevice() first
FAIL! : tst_QNmeaPositionInfoSource_Simulation::requestUpdate_after_start()
Compared values are not the same
Actual (spyUpdate.count()): 0
Expected (1) : 1
..\tst_qnmeapositioninfosource.cpp(485) : failure location
PASS :
tst_QNmeaPositionInfoSource_Simulation::testWithBadNmea(requestUpdate(), bad
second sentence)
PASS :
tst_QNmeaPositionInfoSource_Simulation::testWithBadNmea(startUpdates(), bad
second sentence)
PASS : tst_QNmeaPositionInfoSource_Simulation::cleanupTestCase()
Totals: 25 passed, 1 failed, 0 skipped
********* Finished testing of tst_QNmeaPositionInfoSource_Simulation *********
QtQA::App::TestRunner: test failed on first and second attempts, but with
different behavior each time:
QtQA::App::TestRunner: first attempt: exited with exit code 2
QtQA::App::TestRunner: second attempt: exited with exit code 1
QtQA::App::TestRunner: the test seems to be flaky, please fix this
QtQA::App::TestRunner: this flaky test is being treated as a FAIL
QtQA::App::TestRunner: end tst_qnmeapositioninfosource_simulation: 92
seconds, exit code 1
Testing tst_QSslSocket_onDemandCertificates_static
FAIL! :
tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithoutProxy)
'socket2->waitForEncrypted()' returned FALSE. (Network operation timed out)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithSocks5Proxy)
'socket2->waitForEncrypted()' returned FALSE. (TTL expired)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithSocks5ProxyAuth)
'socket2->waitForEncrypted()' returned FALSE. (TTL expired)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithHttpProxy)
'socket2->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithHttpProxyBasicAuth)
'socket2->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
Totals: 2 passed, 5 failed, 0 skipped
QtQA::App::TestRunner: test failed, running again to see if it is flaky...
********* Start testing of tst_QSslSocket_onDemandCertificates_static
*********
Config: Using QtTest library 5.2.0, Qt 5.2.0
PASS : tst_QSslSocket_onDemandCertificates_static::initTestCase()
FAIL! :
tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithoutProxy)
'socket2->waitForEncrypted()' returned FALSE. (Network operation timed out)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithSocks5Proxy)
'socket2->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithSocks5ProxyAuth)
'socket2->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithHttpProxy)
'socket2->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithHttpProxyBasicAuth)
'socket2->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
PASS : tst_QSslSocket_onDemandCertificates_static::cleanupTestCase()
Totals: 2 passed, 5 failed, 0 skipped
********* Finished testing of tst_QSslSocket_onDemandCertificates_static
*********
QtQA::App::TestRunner: test failure could be reproduced twice consecutively
QtQA::App::TestRunner: end tst_qsslsocket_onDemandCertificates_static: 270
seconds, exit code 5
Testing tst_QSslSocket_onDemandCertificates_member
FAIL! :
tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithoutProxy)
'socket->waitForEncrypted()' returned FALSE. (Network operation timed out)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithSocks5Proxy)
'socket->waitForEncrypted()' returned FALSE. (Host not found)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithSocks5ProxyAuth)
'socket->waitForEncrypted()' returned FALSE. (Host not found)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithHttpProxy)
'socket->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithHttpProxyBasicAuth)
'socket->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
Totals: 2 passed, 5 failed, 0 skipped
QtQA::App::TestRunner: test failed, running again to see if it is flaky...
********* Start testing of tst_QSslSocket_onDemandCertificates_member
*********
Config: Using QtTest library 5.2.0, Qt 5.2.0
PASS : tst_QSslSocket_onDemandCertificates_member::initTestCase()
FAIL! :
tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithoutProxy)
'socket->waitForEncrypted()' returned FALSE. (Network operation timed out)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithSocks5Proxy)
'socket->waitForEncrypted()' returned FALSE. (TTL expired)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithSocks5ProxyAuth)
'socket->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithHttpProxy)
'socket->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! :
tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithHttpProxyBasicAuth)
'socket->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
PASS : tst_QSslSocket_onDemandCertificates_member::cleanupTestCase()
Totals: 2 passed, 5 failed, 0 skipped
********* Finished testing of tst_QSslSocket_onDemandCertificates_member
*********
QtQA::App::TestRunner: test failure could be reproduced twice consecutively
QtQA::App::TestRunner: end tst_qsslsocket_onDemandCertificates_member: 271
seconds, exit code 5
Testing tst_QPacketProtocol
FAIL! : tst_QPacketProtocol::setMaximumPacketSize(invalid)
'm_server->waitForNewConnection()' returned FALSE. ()
tst_qpacketprotocol.cpp(90) : failure location
Totals: 14 passed, 1 failed, 0 skipped
QtQA::App::TestRunner: test failed, running again to see if it is flaky...
********* Start testing of tst_QPacketProtocol *********
Config: Using QtTest library 5.2.0, Qt 5.2.0
PASS : tst_QPacketProtocol::initTestCase()
PASS : tst_QPacketProtocol::maximumPacketSize()
PASS : tst_QPacketProtocol::setMaximumPacketSize(invalid)
FAIL! : tst_QPacketProtocol::setMaximumPacketSize(still invalid)
'm_server->waitForNewConnection()' returned FALSE. ()
tst_qpacketprotocol.cpp(90) : failure location
PASS : tst_QPacketProtocol::setMaximumPacketSize(valid)
PASS : tst_QPacketProtocol::send(auto send)
PASS : tst_QPacketProtocol::send(no auto send)
PASS : tst_QPacketProtocol::packetsAvailable(1)
PASS : tst_QPacketProtocol::packetsAvailable(2)
PASS : tst_QPacketProtocol::packetsAvailable(10)
PASS : tst_QPacketProtocol::clear()
PASS : tst_QPacketProtocol::read()
FAIL! : tst_QPacketProtocol::device() 'm_server->waitForNewConnection()'
returned FALSE. ()
tst_qpacketprotocol.cpp(90) : failure location
PASS : tst_QPacketProtocol::tst_QPacket_clear()
PASS : tst_QPacketProtocol::cleanupTestCase()
Totals: 13 passed, 2 failed, 0 skipped
********* Finished testing of tst_QPacketProtocol *********
QtQA::App::TestRunner: test failed on first and second attempts, but with
different behavior each time:
QtQA::App::TestRunner: first attempt: exited with exit code 1
QtQA::App::TestRunner: second attempt: exited with exit code 2
QtQA::App::TestRunner: the test seems to be flaky, please fix this
QtQA::App::TestRunner: this flaky test is being treated as a FAIL
QtQA::App::TestRunner: end tst_qpacketprotocol (qtquick1): 1 seconds, exit
code 2
Build log:
http://testresults.qt-project.org/ci/Qt5_stable_Integration/build_00540/win32-msvc2010_developer-build_qtnamespace_Windows_7/log.txt.gz
Tested changes (refs/builds/stable_1383718810):
http://codereview.qt-project.org/70454 [PS3] - Updated submodules.
_______________________________________________
Ci-reports mailing list
[email protected]
http://lists.qt-project.org/mailman/listinfo/ci-reports
