Hi Everyone
We want to unit test our servers with something like serverspec, but we do
not have the coding skills in the team to write ruby/rspec, and we want a
low barrier to entry for writing tests
Our site isn't small with 3.5K servers, 200 modules, 400 manifests covering
3K resources. Each server averages about 650 resources
I was wondering what others do for server acceptance testing given a
similar set of requirements. Based on my quick reviews on what is out
there, Jenkins with perl's Test::Harness looks a good fit, which is a
little scary
Am I missing something?
Thanks
John
Requirements:
- Use industry standard test harness
- Use industry standard formatter / dashboard (Jenkins?)
- Lightweight, not monolithic. One test = one file
- Command line based
- Independent of central server for initiating checks
- Roll up checks into arbitrary domains such as role, profile, location,
environment
- Can be run on production servers
- Check actual state, not puppet results (we already do that)
- Run not just at build, but all the time and alert on deviations
through monitoring system
- Some checks run on servers, but some run elsewhere that check other
systems (accurate data centre inventory records, console access, DNS
reverse address exists, etc)
- Do not want to be restricted by language to write tests in. We have a
wide range of programming abilities in team (averaging little or none), and
expect most checks to be written in shell, and if they have to be -
perl/python. Very rarely ruby
Reviewed:
- Serverspec
- Ruby / rspec. No chance of widespread adoption
- Beaker
- Ruby / rspec. No chance of widespread adoption
- Does allow shell outs...
- Bigger than a test harness - whole test environment creation. Probably
more than what we'd need
- Focus seems to test puppet modules - cannot run in production and test
arbitrary states
- xUnit
- Language specific? Difficult to have tests in different languages
- Need to deploy each language specific test runner
- Jenkins can eat xUnit test results
- Perl
- Test::Harness <http://search.cpan.org/dist/Test-Harness/> by
default exists on every server
- Different languages supported if in different directories
- Jenkins eats TAP test results
--
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/puppet-users/CAAJLFxW42sjKQ6PyLM9bUzwCPcmQ_0RcLZShdsM-BXA6mv3bfw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
