On Tue, May 20, 2008 at 09:54:23PM -0500, Luke Kanies wrote:
> 
> On May 20, 2008, at 3:27 PM, Marcin Owsiany wrote:
> 
> >
> > Hi all,
> >
> > After I managed to invoke the rspec test runner (see #1237), I  
> > realized
> > with sadness that they are far from usable. I got:
> >   3053 examples, 219 failures, 30 pending - when running as root
> > and
> >   3053 examples, 145 failures, 31 pending - when running as non-root
> > This is on master branch.
> 
> I get zero failures on master or 0.24.x, although I haven't run either  
> of them as root.

Hm, even on Debian? I'm wondering what's the reason of #1244

> no tests should fail for anyone ever.

Good to hear that, it's encouraging. In that case I will work on them
for a while, maybe most of them do have a common cause that will be easy
to fix.

> If we have a continuous integration service, then I would definitely  
> never release a product that had non-green tests on any supported  
> platform.  Is anyone in a position to set such a thing up and maintain  
> it?

This would be a fun project, however I know little of that EC2 thing.
Let me see if I can get the tests to pass first. Then I'll try to create
a basic set of puppet manifests which would turn a bare base Debian
install into a basic continuous integration service, in a VM.  If that
works, I'll have a look at EC2.

> they're only running during the actual test process (e.g., once a day  
> for an hour or so, rather than 24hrs a day).

The tests seem to take only a couple of minutes on my oldish laptop, so
I guess 5 minute runs every, say, 6 hours would be better.

Marcin
-- 
Marcin Owsiany <[EMAIL PROTECTED]>              http://marcin.owsiany.pl/
GnuPG: 1024D/60F41216  FE67 DA2D 0ACA FC5E 3F75  D6F6 3A0D 8AA0 60F4 1216
 
"Every program in development at MIT expands until it can read mail."
                                                              -- Unknown

--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups 
"Puppet Developers" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/puppet-dev?hl=en
-~----------~----~----~----~------~----~------~--~---

Reply via email to