Issue #9026 has been reported by Daniel Pittman.

----------------------------------------
Refactor #9026: Add "slow but thorough" mode for CI / Automated testing to the 
Puppet test suite.
https://projects.puppetlabs.com/issues/9026

Author: Daniel Pittman
Status: Accepted
Priority: Normal
Assignee: 
Category: testing
Target version: 
Affected Puppet version: 
Keywords: 
Branch: 


There are a handful of costly things we could, but don't, do in our test suite 
because they slow the whole thing down too much to be justified.

These include, but are probably not limited to,

 * scan logs after every test for errors, or whatever, and do something sane
 * reset all terminus classes globally
 * create and use a real, new CA rather than hacking a fake one

Essentially, when the test suite detects it is running under CI (eg: 
ENV['AUTOMATIC_TESTING'] or something) it should turn on slow things.

Then we can have CI run slowly but thoroughly, and have less thorough but still 
reasonable tests for the user.

(This would also allow us to defer things like expensive performance and 
combinatorial testing to CI only, which makes them easier to include in the 
rest of the system.)


-- 
You have received this notification because you have either subscribed to it, 
or are involved in it.
To change your notification preferences, please click here: 
http://projects.puppetlabs.com/my/account

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Bugs" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to 
[email protected].
For more options, visit this group at 
http://groups.google.com/group/puppet-bugs?hl=en.

Reply via email to