Issue #6511 has been reported by Dominic Maraglia.
----------------------------------------
Bug #6511: Test harness not correctly recording results
https://projects.puppetlabs.com/issues/6511
Author: Dominic Maraglia
Status: Unreviewed
Priority: Normal
Assignee: Nick Lewis
Category: Harness
Target version: queued
Patch: None
Keywords: errored log.rb quirt failure
Branch:
Test harness is incorrectly tabulating pass/failed tests.
Running the tests generates a failure, which is logged, but the failure is not
correctly tabulating attemped/passed/failed tests.
<pre>
./systest.rb -c tmp --type skip -t tests/acceptance/this_test_should_fail.rb -s
</pre>
<pre>
Validate puppet.conf vs.--configprint all
* get puppet.conf file contents
* get --configprint output
tests/acceptance/cfg_file_test.rb failed
Test Pass Started: Mon Feb 28 11:37:50 -0800 2011
- Host Configuration Summary -
Platform for cent-55-64-1 centos-5-x86_64
Role for cent-55-64-1 dashboard
Role for cent-55-64-1 master
Role for cent-55-64-1 agent
Config Key|Val: rubyver "ruby18"
Config Key|Val: filecount 12
Config Key|Val: pe_nfs_mount "/mnt/ro/pe"
Config Key|Val: gemver "gem12"
Config Key|Val: facterver "fact11"
Config Key|Val: puppetver "1.0"
Config Key|Val: puppetbinpath "/opt/puppet/bin"
Config Key|Val: ssh {:config=>false,
:user_known_hosts_file=>"/Users/djm/.ssh/known_hosts", :user=>"root",
:paranoid=>false, :auth_methods=>["publickey"],
:keys=>["/Users/djm/.ssh/id_rsa"], :port=>22}
Config Key|Val: nfs_server "192.168.97.1"
- Test Case Summary -
Attempted: 3
Passed: 3
Failed: 0
Errored: 0
- Specific Test Case Status -
Failed Tests Cases:
Errored Tests Cases:
</pre>
--
You have received this notification because you have either subscribed to it,
or are involved in it.
To change your notification preferences, please click here:
http://projects.puppetlabs.com/my/account
--
You received this message because you are subscribed to the Google Groups
"Puppet Bugs" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/puppet-bugs?hl=en.