Paul Nasrat wrote:
> It'd be nice to have a post 0.25.x push to try make the tests less
> brittle. I know there are some oddities in ordering but I've tracked

I think we could possibly do a couple of pre-0.25.x pushes to tests
alone - I am seeing that Markus is a far way down the path of tracking
down some of the issues - Markus?

> those down by bisection before, it may be possible. Also getting the
> hudson builds to run on each push would be great to spot integration
> issues early. I guess this means moving it off James' credit card :)

That's mostly been my and Luke's business with other stuff.  I don't
mind the cost too much - it's not huge for test runs - although correct
it might wear on me after a while.

The other issue is how long they currently take - to run up the test
hosts and execute the tests can take up to an hour because we're using
small/medium AMIs and they need to be built up a lot. Building our own
AMIs with an existing build/test configuration will significantly reduce
this obviously - again something I don't have time for but RL might?
Perhaps Larry or Teyo - though I know they are both busy too. Luke?

Barring this I also still need to make the scripts more resilient - hell
they are awfully crude now - and I am sure that Larry or someone who
does a lot more unattended builds with EC2 than me could do a much
better job of them.  They provide the basic make-up though and could
easily be adapted into Rake or Rubigen to make them more "standard" and
Puppet-like.

The irony obviously is that installing and building the test hosts with
Puppet seems to have bleed-through to the tests in the check-out and
stuff on the local host gets in the way.  I am not savvy enough to work
out why the local /usr/lib contents are getting pulled in either. :)

Regards

James Turnbull

-- 
Author of:
* Pro Linux Systems Administration (http://tinyurl.com/linuxadmin)
* Pulling Strings with Puppet (http://tinyurl.com/pupbook)
* Pro Nagios 2.0 (http://tinyurl.com/pronagios)
* Hardening Linux (http://tinyurl.com/hardeninglinux)

Attachment: signature.asc
Description: OpenPGP digital signature

Reply via email to