[Puppet Users] template compilation performance

2012-05-16 Thread Matt
I'm running into an issue where I have hundreds of configuration files generated from templates, which they are apache vhosts for various sites. I'm running into a problem where it can take up to 10 minutes to build them and sometimes clients get server execution expired. I'm also on 2.6

Re: [Puppet Users] template compilation performance

2012-05-16 Thread Gary Larizza
There's a bit of information you'll need to provide for help: How many masters? Specs on master? Running your master under Webrick or something else (nginx, unicorn, apache/passenger)? Agents running puppet daemonized? How long does it take to run `puppet master --compile agent certname` on

Re: [Puppet Users] template compilation performance

2012-05-16 Thread Matt
Yeah my bad, lots of things going on right now, here is the information. I currently have 3 puppet masters with 4 vCPU, 8GB ram, running apache with passenger. Puppet agents are run from mcollective with a concurrency of 20. Output from the puppet master compile command notice: Compiled

Re: [Puppet Users] template compilation performance

2012-05-16 Thread Trevor Vaughan
Can you check your logs and see if you're getting a bell curve on compile time, or are they always that long? Trevor On Wed, May 16, 2012 at 12:30 PM, Matt mjbl...@gmail.com wrote: Yeah my bad, lots of things going on right now, here is the information. I currently have 3 puppet masters with

Re: [Puppet Users] template compilation performance

2012-05-16 Thread Matt
I would say that it that is close to the average. Not all nodes have the same amount of templates, these are just the web servers that are having the long compile time. On Wednesday, May 16, 2012 12:55:59 PM UTC-4, Trevor Vaughan wrote: Can you check your logs and see if you're getting a bell