#428: Test failures and TODO passes summary for Linux AMD64 (Kubuntu Intrepid)
at
r37267
--------------------+-------------------------------------------------------
Reporter: mikehh | Type: bug
Status: new | Priority: normal
Milestone: 1.0 | Component: none
Version: trunk | Severity: medium
Keywords: | Lang:
Patch: | Platform:
--------------------+-------------------------------------------------------
Following up on TT#420 for Linux i386 (Kubuntu Intrepid)
I have included test failures and test summaries with TODO passes.
The smolder report for the build is:
http://smolder.plusthree.com/app/public_projects/report_details/18823
this included a TODO pass:
{{{
All tests successful.
Test Summary Report
-------------------
t/pmc/exception.t (Wstat: 0 Tests: 31 Failed: 0)
TODO passed: 30
Files=396, Tests=11740, 366 wallclock secs ( 4.59 usr 1.57 sys + 125.47
cusr 55.31 csys = 186.94 CPU)
Result: PASS
}}}
My build was as follows:
{{{
mh...@mhk64-desktop:~/parrot$ make realclean
mh...@mhk64-desktop:~/parrot$ date
Tue Mar 10 10:17:04 GMT 2009
mh...@mhk64-desktop:~/parrot$ svn up
At revision 37267.
mh...@mhk64-desktop:~/parrot$ date
Tue Mar 10 10:17:27 GMT 2009
mh...@mhk64-desktop:~/parrot$ perl Configure.pl --optimize --test
--configure_trace
pre config tests:
All tests successful.
Files=124, Tests=2887, 31 wallclock secs ( 1.14 usr 0.38 sys + 21.00 cusr
5.79 csys = 28.31 CPU)
Result: PASS
post config tests:
All tests successful.
Files=38, Tests=1042, 35 wallclock secs ( 0.42 usr 0.18 sys + 29.55 cusr
1.90 csys = 32.05 CPU)
Result: PASS
mh...@mhk64-desktop:~/parrot$ date
Tue Mar 10 10:19:46 GMT 2009
mh...@mhk64-desktop:~/parrot$ make world
mh...@mhk64-desktop:~/parrot$ date
Tue Mar 10 10:25:06 GMT 2009
mh...@mhk64-desktop:~/parrot$ make html
make -C docs html
make[1]: Entering directory `/home/mhk64/parrot/docs'
/usr/bin/perl -I../lib ../tools/docs/write_docs.pl --silent
--version=0.9.1-devel
make[1]: Leaving directory `/home/mhk64/parrot/docs'
mh...@mhk64-desktop:~/parrot$ date
Tue Mar 10 10:25:40 GMT 2009
mh...@mhk64-desktop:~/parrot$ make smoke
All tests successful.
Test Summary Report
-------------------
t/pmc/exception.t (Wstat: 0 Tests: 31 Failed: 0)
TODO passed: 30
Files=396, Tests=11740, 366 wallclock secs ( 4.59 usr 1.57 sys + 125.47
cusr 55.31 csys = 186.94 CPU)
Result: PASS
TAP Archive created at /home/mhk64/parrot/parrot_test_run.tar.gz
Test report successfully sent to Smolder at
http://smolder.plusthree.com/app/public_projects/report_details/18823
You can see other recent reports at
http://smolder.plusthree.com/app/public_projects/smoke_reports/8 .
}}}
As make fulltest exits before completion I ran the tests manually.
The -b, -C, -g, -f and -S give the same result as -b:
{{{
mh...@mhk64-desktop:~/parrot$ date
Tue Mar 10 10:43:27 GMT 2009
mh...@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-
test -b --runcore-tests
All tests successful.
Test Summary Report
-------------------
t/compilers/imcc/syn/hll.t (Wstat: 0 Tests: 2 Failed: 0)
TODO passed: 2
t/op/exceptions.t (Wstat: 0 Tests: 31 Failed: 0)
TODO passed: 23
t/pmc/exception.t (Wstat: 0 Tests: 31 Failed: 0)
TODO passed: 26, 30
Files=252, Tests=8393, 306 wallclock secs ( 3.68 usr 0.76 sys + 86.83
cusr 42.38 csys = 133.65 CPU)
Result: PASS
}}}
There was a failure with -r:
{{{
mh...@mhk64-desktop:~/parrot$ date
Tue Mar 10 11:11:45 GMT 2009
mh...@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-
test -r --runcore-tests
t/op/pushaction.t ...................... 4/7
# Failed test 'pushaction as closure'
# at t/op/pushaction.t line 100.
# Exited with error code: 1
# Received:
# main
# at popmark, flag = 0
# a = Null PMC in say
# current instr.: 'exit_handler' pc 32
(/home/mhk64/parrot/t/op/pushaction_6.pir:22)
# called from Sub 'main' pc 15
(/home/mhk64/parrot/t/op/pushaction_6.pir:11)
#
# Expected:
# main
# at popmark, flag = 0
# a = 42
#
not ok 7 - pushaction: error while handling error # TODO runloop
shenanigans
# Looks like you failed 1 test of 7.
t/op/pushaction.t ...................... Dubious, test returned 1 (wstat
256, 0x100)
Failed 1/7 subtests
t/pmc/packfile.t ....................... 4/6
# Failed test 'set_integer_keyed_str'
# at t/pmc/packfile.t line 142.
# Exited with error code: 134
# Received:
# Aborted
#
# Expected:
# not equal
#
# Looks like you failed 1 test of 6.
t/pmc/packfile.t ....................... Dubious, test returned 1 (wstat
256, 0x100)
Failed 1/6 subtests
t/pmc/sub.t ............................ 60/64
# Failed test ':outer with identical sub names'
# at t/pmc/sub.t line 1457.
# Exited with error code: 1
# Received:
# ABC::outer
# ABC::inner
# Null PMC in say
# current instr.: 'parrot;ABC;inner' pc 47
(/home/mhk64/parrot/t/pmc/sub_63.pir:20)
# called from Sub 'parrot;ABC;outer' pc 37
(/home/mhk64/parrot/t/pmc/sub_63.pir:14)
# called from Sub 'main' pc 9 (/home/mhk64/parrot/t/pmc/sub_63.pir:3)
#
# Expected:
# ABC::outer
# ABC::inner
# ABC lex
# DEF::outer
# DEF::inner
# DEF lex
#
# Looks like you failed 1 test of 64.
t/pmc/sub.t ............................ Dubious, test returned 1 (wstat
256, 0x100)
Failed 1/64 subtests
Test Summary Report
-------------------
t/op/pushaction.t (Wstat: 256 Tests: 7 Failed: 1)
Failed test: 6
Non-zero exit status: 1
t/pmc/packfile.t (Wstat: 256 Tests: 6 Failed: 1)
Failed test: 6
Non-zero exit status: 1
t/pmc/sub.t (Wstat: 256 Tests: 64 Failed: 1)
Failed test: 63
Non-zero exit status: 1
Files=252, Tests=8393, 358 wallclock secs ( 4.25 usr 0.85 sys + 115.25
cusr 68.72 csys = 189.07 CPU)
Result: FAIL
}}}
I don't know if anyone else is getting the t/pmc/packfile.t failure.
I have had problems with this before.
see TT#412
make src_tests, make run_tests and make perl_tests were all successful.
The code_tests failed with the following result:
{{{
mh...@mhk64-desktop:~/parrot$ date
Tue Mar 10 11:28:23 GMT 2009
mh...@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-
test --code-tests
t/distro/file_metadata.t ....... # Collecting svn:mime-type attributes...
t/distro/file_metadata.t ....... 1/5 # Collecting svn:keywords
attributes...
t/distro/file_metadata.t ....... 3/5
# Failed test 'svn:keywords'
# at t/distro/file_metadata.t line 131.
# got: 'Set svn:keywords with:
# svn ps svn:keywords "Author Date Id Revision"
examples/pir/befunge/Makefile
# '
# expected: ''
# Collecting svn:eol-style attributes...
t/distro/file_metadata.t ....... 4/5 # Collecting svn:eol-style
attributes...
# Looks like you failed 1 test of 5.
t/distro/file_metadata.t ....... Dubious, test returned 1 (wstat 256,
0x100)
Failed 1/5 subtests
t/codingstd/perlcritic.t ....... 269/307
# Failed test 'Test::Perl::Critic for
"/home/mhk64/parrot/tools/dev/install_files.pl"'
# at t/codingstd/perlcritic.t line 88.
#
# Perl::Critic found these violations in
"/home/mhk64/parrot/tools/dev/install_files.pl":
# Flag comment 'TODO' found at
/home/mhk64/parrot/tools/dev/install_files.pl line 198
t/codingstd/perlcritic.t ....... 307/307 # Looks like you failed 1 test of
307.
t/codingstd/perlcritic.t ....... Dubious, test returned 1 (wstat 256,
0x100)
Failed 1/307 subtests
t/codingstd/pir_code_coda.t .... ok
t/codingstd/pod_syntax.t ....... 1/2
Finding files with POD, this may take a minute.
t/codingstd/pod_syntax.t ....... 2/2
# Failed test 'Pod syntax correct'
# at t/codingstd/pod_syntax.t line 45.
# got: 'xconf/samples/yourfoobar
# t/configure/testlib/verbosefoobar
# t/configure/testlib/ddefectivefoobar
# t/configure/testlib/adefectivefoobar
# t/configure/testlib/cdefectivefoobar
# t/configure/testlib/bdefectivefoobar
# xconf/samples/testfoobar'
# expected: ''
# You should use podchecker to check the failed files.
# Looks like you failed 1 test of 2.
t/codingstd/pod_syntax.t ....... Dubious, test returned 1 (wstat 256,
0x100)
Failed 1/2 subtests
Test Summary Report
-------------------
t/distro/file_metadata.t (Wstat: 256 Tests: 5 Failed: 1)
Failed test: 3
Non-zero exit status: 1
t/codingstd/perlcritic.t (Wstat: 256 Tests: 307 Failed: 1)
Failed test: 270
Non-zero exit status: 1
t/codingstd/pod_syntax.t (Wstat: 256 Tests: 2 Failed: 1)
Failed test: 2
Non-zero exit status: 1
Files=28, Tests=354, 220 wallclock secs ( 0.31 usr 0.09 sys + 205.54 cusr
4.68 csys = 210.62 CPU)
Result: FAIL
}}}
The benchmark_tests gave the following:
{{{
mh...@mhk64-desktop:~/parrot$ date
Tue Mar 10 11:33:53 GMT 2009
mh...@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-
test t/benchmark/*.t
t/benchmark/benchmarks.t .. 19/37
# Failed test 'examples/benchmarks/oo1.pasm'
# at t/benchmark/benchmarks.t line 218.
# Exited with error code: 139
# Received:
# Segmentation fault
#
# Expected:
# 10
#
# Failed test 'examples/benchmarks/oo2.pasm'
# at t/benchmark/benchmarks.t line 218.
# Exited with error code: 139
# Received:
# Segmentation fault
#
# Expected:
# 10
#
# Failed test 'examples/benchmarks/oo3.pasm'
# at t/benchmark/benchmarks.t line 218.
# Exited with error code: 139
# Received:
# Segmentation fault
#
# Expected:
# 10
#
# Failed test 'examples/benchmarks/oo4.pasm'
# at t/benchmark/benchmarks.t line 218.
# Exited with error code: 139
# Received:
# Segmentation fault
#
# Expected:
# 500000
#
t/benchmark/benchmarks.t .. 37/37 # Looks like you failed 4 tests of 37.
t/benchmark/benchmarks.t .. Dubious, test returned 4 (wstat 1024, 0x400)
Failed 4/37 subtests
Test Summary Report
-------------------
t/benchmark/benchmarks.t (Wstat: 1024 Tests: 37 Failed: 4)
Failed tests: 20-23
Non-zero exit status: 4
Files=1, Tests=37, 513 wallclock secs ( 0.05 usr 0.00 sys + 482.09 cusr
27.20 csys = 509.34 CPU)
Result: FAIL
}}}
The manifest_tests were successful.
There were NO doc_tests:
{{{
mh...@mhk64-desktop:~/parrot$ date
Tue Mar 10 11:45:21 GMT 2009
mh...@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-
test t/doc/*.t
Files=0, Tests=0, 0 wallclock secs ( 0.01 usr + 0.00 sys = 0.01 CPU)
Result: NOTESTS
}}}
For the example_tests I have included the summary here - see the attached
report for the test failures (but not all).
{{{
mh...@mhk64-desktop:~/parrot$ date
Tue Mar 10 11:49:54 GMT 2009
mh...@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-
test t/examples/*.t
Test Summary Report
-------------------
t/examples/catchall.t (Wstat: 3584 Tests: 166 Failed: 14)
Failed tests: 40-42, 44, 63, 65, 72-73, 78, 109, 113
116-117, 119
Non-zero exit status: 14
t/examples/shootout.t (Wstat: 2816 Tests: 20 Failed: 11)
Failed tests: 1, 3, 6-11, 17-19
Non-zero exit status: 11
t/examples/streams.t (Wstat: 512 Tests: 12 Failed: 2)
Failed tests: 1-2
Non-zero exit status: 2
Files=11, Tests=272, 220 wallclock secs ( 0.22 usr 0.04 sys + 11.61 cusr
4.80 csys = 16.67 CPU)
Result: FAIL
}}}
and finally the distro_tests:
{{{
mh...@mhk64-desktop:~/parrot$ date
Tue Mar 10 12:08:28 GMT 2009
mh...@mhk64-desktop:~/parrot$ perl t/harness --gc-debug --running-make-
test t/distro/*.t
t/distro/file_metadata.t ....... # Collecting svn:mime-type attributes...
t/distro/file_metadata.t ....... 1/5 # Collecting svn:keywords
attributes...
t/distro/file_metadata.t ....... 3/5
# Failed test 'svn:keywords'
# at t/distro/file_metadata.t line 131.
# got: 'Set svn:keywords with:
# svn ps svn:keywords "Author Date Id Revision"
examples/pir/befunge/Makefile
# '
# expected: ''
# Collecting svn:eol-style attributes...
t/distro/file_metadata.t ....... 4/5 # Collecting svn:eol-style
attributes...
# Looks like you failed 1 test of 5.
t/distro/file_metadata.t ....... Dubious, test returned 1 (wstat 256,
0x100)
Failed 1/5 subtests
t/distro/test_file_coverage.t .. 1/3
# Failed test 'there are PMC files for all test files in t/pmc'
# at t/distro/test_file_coverage.t line 57.
# files in src/pmc but not in test dir:
# packfileannotation
# packfileannotationkeys
# packfileannotations
# Looks like you failed 1 test of 3.
t/distro/test_file_coverage.t .. Dubious, test returned 1 (wstat 256,
0x100)
Failed 1/3 subtests
Test Summary Report
-------------------
t/distro/file_metadata.t (Wstat: 256 Tests: 5 Failed: 1)
Failed test: 3
Non-zero exit status: 1
t/distro/test_file_coverage.t (Wstat: 256 Tests: 3 Failed: 1)
Failed test: 1
Non-zero exit status: 1
Files=4, Tests=13, 5 wallclock secs ( 0.05 usr 0.02 sys + 3.49 cusr
1.59 csys = 5.15 CPU)
Result: FAIL
}}}
After the tests I built rakudo using this build of parrot.
make test passed and make spectest had some failures.
They all passed on build r37250:
{{{
mh...@mhk64-desktop:~/rakudo$ date
Tue Mar 10 12:11:40 GMT 2009
mh...@mhk64-desktop:~/rakudo$ cat ../parrot/.parrot_current_rev
37267
mh...@mhk64-desktop:~/rakudo$ git pull
remote: Counting objects: 19, done.
remote: Compressing objects: 100% (13/13), done.
remote: Total 13 (delta 10), reused 0 (delta 0)
Unpacking objects: 100% (13/13), done.
From git://github.com/rakudo/rakudo
d16d3c3..95ce390 master -> origin/master
Updating d16d3c3..95ce390
Fast forward
docs/guide_to_setting.pod | 30 +++++++++++++++++++++---------
src/setting/Any-list.pm | 6 +++---
2 files changed, 24 insertions(+), 12 deletions(-)
mh...@mhk64-desktop:~/rakudo$ make realclean
mh...@mhk64-desktop:~/rakudo$ perl Configure.pl --parrot-
config=../parrot/parrot_config
mh...@mhk64-desktop:~/rakudo$ make
mh...@mhk64-desktop:~/rakudo$ date
Tue Mar 10 12:15:54 GMT 2009
mh...@mhk64-desktop:~/rakudo$ make test
All tests successful.
Files=29, Tests=236, 56 wallclock secs ( 0.24 usr 0.08 sys + 45.68 cusr
9.20 csys = 55.20 CPU)
Result: PASS
mh...@mhk64-desktop:~/rakudo$ make spectest
t/spec/S04-statements/given.rakudo ............................. Failed
16/48 subtests
(less 2 skipped subtests: 30 okay)
t/spec/S32-num/complex.rakudo .................................. Method
're' not found for invocant of class 'Complex'
current instr.: 'parrot;P6metaclass;dispatch' pc 320
(src/classes/ClassHOW.pir:161)
called from Sub '_block21' pc 336 (EVAL_20:121)
called from Sub '_block14' pc 101 (EVAL_20:53)
called from Sub '!UNIT_START' pc 17435 (src/builtins/guts.pir:325)
called from Sub 'parrot;PCT;HLLCompiler;eval' pc 950
(src/PCT/HLLCompiler.pir:527)
called from Sub 'parrot;PCT;HLLCompiler;evalfiles' pc 1275
(src/PCT/HLLCompiler.pir:688)
called from Sub 'parrot;PCT;HLLCompiler;command_line' pc 1456
(src/PCT/HLLCompiler.pir:778)
called from Sub 'parrot;Perl6;Compiler;main' pc 21732 (perl6.pir:163)
t/spec/S32-num/complex.rakudo .................................. Dubious,
test returned 1 (wstat 256, 0x100)
Failed 140/140 subtests
Test Summary Report
-------------------
t/spec/S04-statements/given.rakudo (Wstat: 11
Tests: 32 Failed: 0)
Non-zero wait status: 11
Parse errors: Bad plan. You planned 48 tests but ran 32.
t/spec/S32-list/reduce.rakudo (Wstat: 0
Tests: 14 Failed: 0)
TODO passed: 14
t/spec/S32-num/complex.rakudo (Wstat: 256
Tests: 0 Failed: 0)
Non-zero exit status: 1
Parse errors: Bad plan. You planned 140 tests but ran 0.
Files=317, Tests=9242, 2410 wallclock secs ( 8.52 usr 3.33 sys + 2162.31
cusr 208.41 csys = 2382.57 CPU)
Result: FAIL
Failed 2/317 test programs. 0/9242 subtests failed.
make: *** [spectest] Error 255
}}}
--
Ticket URL: <https://trac.parrot.org/parrot/ticket/428>
Parrot <https://trac.parrot.org/parrot/>
Parrot Development
_______________________________________________
parrot-tickets mailing list
[email protected]
http://lists.parrot.org/mailman/listinfo/parrot-tickets
