Autotest `scripts' failed :(
The test was determined to be flaky, meaning results were not consistent across
multiple runs. This might make the problem difficult to reproduce. Also,
flaky failures might or might not be related to any recent changes in the
source code.
+ perl /work/build/qt/qtqa/scripts/setup.pl --install
Checking perl modules ...
Capture::Tiny - OK
YAML - OK
HTTP::Headers - OK
List::Compare - OK
List::MoreUtils - OK
File::HomeDir - OK
Proc::Reliable - OK
Const::Fast - OK
Text::ParseWords - OK
Data::Compare - OK
LWP::UserAgent::Determined - OK
Timer::Simple - OK
QMake::Project - OK
File::Which - OK
Sub::Override - OK
Test::Perl::Critic - OK
Text::Wrap - OK
Lingua::EN::Inflect - OK
File::Find::Rule - OK
Tie::Sysctl - OK
Readonly - OK
Test::Warn - OK
Params::Validate - OK
AnyEvent::Watchdog - OK
Log::Dispatch - OK
IO::Prompt - OK
IO::CaptureOutput - OK
Win32::Status - OK
Inline::C - OK
Time::Piece - OK
Coro::AnyEvent - OK
Lingua::EN::Numbers - OK
Test::NoWarnings - OK
Class::Factory::Util - OK
IO::Uncompress::AnyInflate - OK
AnyEvent::Util - OK
autodie - OK
Mail::Sender - OK
IO::Interactive - OK
AnyEvent - OK
Test::Exception - OK
parent - OK
Test::Exit - OK
Env::Path - OK
AnyEvent::HTTP - OK
BSD::Resource - OK
File::Fetch - OK
Test::More - OK
Text::Diff - OK
Perl::Critic - OK
File::Copy::Recursive - OK
Tie::IxHash - OK
Data::Alias - OK
XML::Simple - OK
File::chdir - OK
Encode::Locale - OK
Text::Trim - OK
Class::Data::Inheritable - OK
File::Slurp - OK
IO::Compress::Gzip - OK
App::cpanminus - OK
ReleaseAction - OK
Template - OK
AnyEvent::HTTPD - OK
Tie::Persistent - OK
YAML::Node - OK
JSON - OK
Config::Tiny - OK
It looks like your CPAN setup is complete :)
+ prove -I /work/build/qt/qtqa/scripts/lib/perl5 --merge --state=save -I
/work/build/qt/qtqa/scripts/lib/perl5 --recurse /work/build/qt/qtqa/scripts
/work/build/qt/qtqa/scripts/generic/t/01-coveragerunner_testcocoon.t
...................... ok
/work/build/qt/qtqa/scripts/generic/t/01-testrunner-testcocoon.t
.......................... ok
/work/build/qt/qtqa/scripts/generic/t/01-xml2html_testcocoon.t
............................ ok
/work/build/qt/qtqa/scripts/generic/t/10-testrunner.t
..................................... ok
/work/build/qt/qtqa/scripts/generic/t/15-testrunner-capture-logs.t
........................ ok
/work/build/qt/qtqa/scripts/generic/t/16-testrunner-capture-logs-race.t
................... ok
/work/build/qt/qtqa/scripts/generic/t/20-testrunner-core.t
................................ ok
/work/build/qt/qtqa/scripts/generic/t/21-testrunner-flaky.t
............................... ok
/work/build/qt/qtqa/scripts/generic/t/22-testrunner-sync-output.t
......................... ok
/work/build/qt/qtqa/scripts/generic/t/23-testrunner-crashreporter.t
....................... ok
/work/build/qt/qtqa/scripts/generic/t/30-parse_build_log.t
................................ ok
/work/build/qt/qtqa/scripts/generic/t/40-testplanner.t
.................................... ok
/work/build/qt/qtqa/scripts/generic/t/41-print_calling_makefile.t
......................... skipped: This test is relevant only on Win32 and nmake
/work/build/qt/qtqa/scripts/generic/t/50-testscheduler.t
.................................. ok
/work/build/qt/qtqa/scripts/git/t/10-git-qtqa-combine.t
................................... ok
/work/build/qt/qtqa/scripts/jenkins/t/05-qt-jenkins-integrator.t
.......................... ok
/work/build/qt/qtqa/scripts/jenkins/t/10-summarize-jenkins-build.t
........................ ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/Reliable/t/01-QtQA-Proc-Reliable-Win32.t
.. ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/t/10-reliable.t
........................... ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/t/20-reliable-strategies.t
................ ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Test/t/10-test-more-create_mock_command.t
...... ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/10-Gerrit.t
.................................. ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/10-TestScript.t
.............................. ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/20-TestScript-autodocs.t
..................... ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/30-TestScript-reliable-exe.t
................. ok
/work/build/qt/qtqa/scripts/t/10-perl-syntax-check.t
...................................... ok
/work/build/qt/qtqa/scripts/t/20-perl-critic-check.t
...................................... ok
/work/build/qt/qtqa/scripts/t/90-licenses.t
...............................................
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/3 subtests
Test Summary Report
-------------------
/work/build/qt/qtqa/scripts/generic/t/23-testrunner-crashreporter.t
(Wstat: 0 Tests: 22 Failed: 0)
TODO passed: 1-8, 10-13, 15-16, 18, 20-22
/work/build/qt/qtqa/scripts/t/90-licenses.t
(Wstat: 256 Tests: 3 Failed: 1)
Failed test: 3
Non-zero exit status: 1
Files=28, Tests=1400, 243 wallclock secs ( 0.27 usr 0.06 sys + 164.03 cusr
20.90 csys = 185.26 CPU)
Result: FAIL
I'm going to run only the failed tests again:
+ prove -I /work/build/qt/qtqa/scripts/lib/perl5 --state=failed,save --verbose
# testing tst_licenses.pl under
/work/build/qt/qtqa/scripts/test_pl_tmp/90-licenses.t-m0IQUD
# Failed test 'tst_licenses.pl output matches expected'
# at /work/build/qt/qtqa/scripts/t/90-licenses.t line 112.
# --- expected output of tst_licenses.pl
# +++ actual output of tst_licenses.pl
# @@ -1,3 +1,4 @@
# +Possible attempt to put comments in qw() list at
/work/build/qt/qtqa/tests/prebuild/license/tst_licenses.pl line 79.
# 1..12
# not ok x - QT_BEGIN_LICENSE does not follow Copyright block in
bad/missing-license-info.qdoc, line 8
# not ok x - Mismatch in license text in bad/multiple-header-one-wrong.s
# Looks like you failed 1 test of 3.
/work/build/qt/qtqa/scripts/t/90-licenses.t ..
ok 1 - tst_licenses.pl exists
ok 2 - license-testdata exists
not ok 3 - tst_licenses.pl output matches expected
1..3
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/3 subtests
Test Summary Report
-------------------
/work/build/qt/qtqa/scripts/t/90-licenses.t (Wstat: 256 Tests: 3 Failed: 1)
Failed test: 3
Non-zero exit status: 1
Files=1, Tests=3, 0 wallclock secs ( 0.02 usr 0.00 sys + 0.13 cusr 0.01
csys = 0.16 CPU)
Result: FAIL
prove -I /work/build/qt/qtqa/scripts/lib/perl5 --state=failed,save --verbose
exited with value 1
QtQA::App::TestRunner: test failed, running again to see if it is flaky...
+ perl /work/build/qt/qtqa/scripts/setup.pl --install
Checking perl modules ...
Capture::Tiny - OK
YAML - OK
HTTP::Headers - OK
List::Compare - OK
List::MoreUtils - OK
File::HomeDir - OK
Proc::Reliable - OK
Const::Fast - OK
Text::ParseWords - OK
Data::Compare - OK
LWP::UserAgent::Determined - OK
Timer::Simple - OK
QMake::Project - OK
File::Which - OK
Sub::Override - OK
Test::Perl::Critic - OK
Text::Wrap - OK
Lingua::EN::Inflect - OK
File::Find::Rule - OK
Tie::Sysctl - OK
Readonly - OK
Test::Warn - OK
Params::Validate - OK
AnyEvent::Watchdog - OK
Log::Dispatch - OK
IO::Prompt - OK
IO::CaptureOutput - OK
Win32::Status - OK
Inline::C - OK
Time::Piece - OK
Coro::AnyEvent - OK
Lingua::EN::Numbers - OK
Test::NoWarnings - OK
Class::Factory::Util - OK
IO::Uncompress::AnyInflate - OK
AnyEvent::Util - OK
autodie - OK
Mail::Sender - OK
IO::Interactive - OK
AnyEvent - OK
Test::Exception - OK
parent - OK
Test::Exit - OK
Env::Path - OK
AnyEvent::HTTP - OK
BSD::Resource - OK
File::Fetch - OK
Test::More - OK
Text::Diff - OK
Perl::Critic - OK
File::Copy::Recursive - OK
Tie::IxHash - OK
Data::Alias - OK
XML::Simple - OK
File::chdir - OK
Encode::Locale - OK
Text::Trim - OK
Class::Data::Inheritable - OK
File::Slurp - OK
IO::Compress::Gzip - OK
App::cpanminus - OK
ReleaseAction - OK
Template - OK
AnyEvent::HTTPD - OK
Tie::Persistent - OK
YAML::Node - OK
JSON - OK
Config::Tiny - OK
It looks like your CPAN setup is complete :)
+ prove -I /work/build/qt/qtqa/scripts/lib/perl5 --merge --state=save -I
/work/build/qt/qtqa/scripts/lib/perl5 --recurse /work/build/qt/qtqa/scripts
/work/build/qt/qtqa/scripts/generic/t/01-coveragerunner_testcocoon.t
...................... ok
/work/build/qt/qtqa/scripts/generic/t/01-testrunner-testcocoon.t
.......................... ok
/work/build/qt/qtqa/scripts/generic/t/01-xml2html_testcocoon.t
............................ ok
/work/build/qt/qtqa/scripts/generic/t/10-testrunner.t
..................................... ok
/work/build/qt/qtqa/scripts/generic/t/15-testrunner-capture-logs.t
........................ ok
/work/build/qt/qtqa/scripts/generic/t/16-testrunner-capture-logs-race.t
................... ok
/work/build/qt/qtqa/scripts/generic/t/20-testrunner-core.t
................................ ok
/work/build/qt/qtqa/scripts/generic/t/21-testrunner-flaky.t
............................... ok
/work/build/qt/qtqa/scripts/generic/t/22-testrunner-sync-output.t
......................... ok
/work/build/qt/qtqa/scripts/generic/t/23-testrunner-crashreporter.t
....................... ok
/work/build/qt/qtqa/scripts/generic/t/30-parse_build_log.t
................................ ok
/work/build/qt/qtqa/scripts/generic/t/40-testplanner.t
.................................... ok
/work/build/qt/qtqa/scripts/generic/t/41-print_calling_makefile.t
......................... skipped: This test is relevant only on Win32 and nmake
/work/build/qt/qtqa/scripts/generic/t/50-testscheduler.t
.................................. ok
/work/build/qt/qtqa/scripts/git/t/10-git-qtqa-combine.t
................................... ok
/work/build/qt/qtqa/scripts/jenkins/t/05-qt-jenkins-integrator.t
.......................... ok
/work/build/qt/qtqa/scripts/jenkins/t/10-summarize-jenkins-build.t
........................ ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/Reliable/t/01-QtQA-Proc-Reliable-Win32.t
.. ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/t/10-reliable.t
........................... ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/t/20-reliable-strategies.t
................ ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Test/t/10-test-more-create_mock_command.t
...... ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/10-Gerrit.t
.................................. ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/10-TestScript.t
.............................. ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/20-TestScript-autodocs.t
..................... ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/30-TestScript-reliable-exe.t
................. ok
/work/build/qt/qtqa/scripts/t/10-perl-syntax-check.t
...................................... ok
/work/build/qt/qtqa/scripts/t/20-perl-critic-check.t
...................................... ok
/work/build/qt/qtqa/scripts/t/90-licenses.t
...............................................
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/3 subtests
Test Summary Report
-------------------
/work/build/qt/qtqa/scripts/generic/t/23-testrunner-crashreporter.t
(Wstat: 0 Tests: 22 Failed: 0)
TODO passed: 1-8, 10-13, 15-16, 18, 20-22
/work/build/qt/qtqa/scripts/t/90-licenses.t
(Wstat: 256 Tests: 3 Failed: 1)
Failed test: 3
Non-zero exit status: 1
Files=28, Tests=1400, 237 wallclock secs ( 0.26 usr 0.06 sys + 154.96 cusr
18.22 csys = 173.50 CPU)
Result: FAIL
I'm going to run only the failed tests again:
+ prove -I /work/build/qt/qtqa/scripts/lib/perl5 --state=failed,save --verbose
# testing tst_licenses.pl under
/work/build/qt/qtqa/scripts/test_pl_tmp/90-licenses.t-5bgEwI
# Failed test 'tst_licenses.pl output matches expected'
# at /work/build/qt/qtqa/scripts/t/90-licenses.t line 112.
# --- expected output of tst_licenses.pl
# +++ actual output of tst_licenses.pl
# @@ -1,3 +1,4 @@
# +Possible attempt to put comments in qw() list at
/work/build/qt/qtqa/tests/prebuild/license/tst_licenses.pl line 79.
# 1..12
# not ok x - QT_BEGIN_LICENSE does not follow Copyright block in
bad/missing-license-info.qdoc, line 8
# not ok x - Mismatch in license text in bad/multiple-header-one-wrong.s
# Looks like you failed 1 test of 3.
/work/build/qt/qtqa/scripts/t/90-licenses.t ..
ok 1 - tst_licenses.pl exists
ok 2 - license-testdata exists
not ok 3 - tst_licenses.pl output matches expected
1..3
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/3 subtests
Test Summary Report
-------------------
/work/build/qt/qtqa/scripts/t/90-licenses.t (Wstat: 256 Tests: 3 Failed: 1)
Failed test: 3
Non-zero exit status: 1
Files=1, Tests=3, 0 wallclock secs ( 0.02 usr 0.00 sys + 0.12 cusr 0.01
csys = 0.15 CPU)
Result: FAIL
prove -I /work/build/qt/qtqa/scripts/lib/perl5 --state=failed,save --verbose
exited with value 1
QtQA::App::TestRunner: test failed on first and second attempts, but with
different behavior each time:
QtQA::App::TestRunner: first attempt: exited with exit code 2
QtQA::App::TestRunner: second attempt: exited with exit code 1
QtQA::App::TestRunner: the test seems to be flaky, please fix this
QtQA::App::TestRunner: this flaky test is being treated as a FAIL
QtQA::App::TestRunner: end scripts: 485 seconds, exit code 1
Build log:
http://testresults.qt-project.org/ci/QtQA_master_Integration/build_00548/macx-clang_developer-build_OSX_10.8/log.txt.gz
Tested changes (refs/builds/master_1378284693):
http://codereview.qt-project.org/64576 [PS2] - qtqa: skip QtWebEngine's
license check
_______________________________________________
Ci-reports mailing list
[email protected]
http://lists.qt-project.org/mailman/listinfo/ci-reports
