Hi Everyone
We want to unit test our servers with something like serverspec, but we do
not have the coding skills in the team to write ruby/rspec, and we want a
low barrier to entry for writing tests
Our site isn't small with 3.5K servers, 200 modules, 400 manifests covering
3K resources. Each server averages about 650 resources
I was wondering what others do for server acceptance testing given a
similar set of requirements. Based on my quick reviews on what is out
there, Jenkins with perl's Test::Harness looks a good fit, which is a
little scary
Am I missing something?
Thanks
John
Requirements:
- Use industry standard test harness
- Use industry standard formatter / dashboard (Jenkins?)
- Lightweight, not monolithic. One test = one file
- Command line based
- Independent of central server for initiating checks
- Roll up checks into arbitrary domains such as role, profile, location,
environment
- Can be run on production servers
- Check actual state, not puppet results (we already do that)
- Run not just at build, but all the time and alert on deviations
through monitoring system
- Some checks run on servers, but some run elsewhere that check other
systems (accurate data centre inventory records, console access, DNS
reverse address exists, etc)
- Do not want to be restricted by language to write tests in. We have a
wide range of programming abilities in team (averaging little or none), and
expect most checks to be written in shell, and if they have to be -
perl/python. Very rarely ruby
Reviewed:
- Serverspec
- Ruby / rspec. No chance of widespread adoption
- Beaker
- Ruby / rspec. No chance of widespread adoption
- Does allow shell outs...
- Bigger than a test harness - whole test environment creation. Probably
more than what we'd need
- Focus seems to test puppet modules - cannot run in production and test
arbitrary states
- xUnit
- Language specific? Difficult to have tests in different languages
- Need to deploy each language specific test runner
- Jenkins can eat xUnit test results
- Perl
- Test::Harness <http://search.cpan.org/dist/Test-Harness/> by
default exists on every server
- Different languages supported if in different directories
- Jenkins eats TAP test results
--
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to puppet-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/puppet-users/CAAJLFxW42sjKQ6PyLM9bUzwCPcmQ_0RcLZShdsM-BXA6mv3bfw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.