Running in webrick, for the exact same node, we saw 458 seconds to compile using directory environments vs 4.5 seconds using the old file-based environments.
On Thursday, April 17, 2014 5:23:24 AM UTC-4, Antoine Cotten wrote: > > Dear Puppet Users community, I would like to report an issue I experience > since the first release of Puppet 3.5, and possibly get some input from > people who face the same problem (if any). > > > I run a Puppet environment in which all 48 nodes run CentOS 6.5. I have > been using config file-based environments so far without any trouble. When > Puppet 3.5.0 was officially released I decided to give give it a try, along > with the new Directory Environments feature. I disabled my old-style > environment config while making sure my directory tree was correctly set, > as described in the "Directory Environments" documentation > page<http://docs.puppetlabs.com/puppet/latest/reference/environments.html> > . > > The problem shows up immediately after I restart httpd: Passenger starts > spawning more and more processes which all consume 25% of my machine CPU, > reaching a load average of 10+ in less than a minute as soon as the first > node requests a catalog. This makes the master unusable, it takes between > 200 and 300sec to compile any catalog. > > > What I have tried: > > 1. Switching back from Passenger to WEBrick: same performance issue > 2. Disabling the puppet service on all nodes, and triggering *one*single > manual Puppet run on a random node: same > performance issue > 3. Disabling my external node classifier (Foreman): same performance > issue > 4. Upgrading to Puppet 3.5.1: same performance issue > 5. Switching back to config-based environments and re-enabling all > nodes: no issue, my master behaves normally and the load-average > remains under 0.25 constantly > > As you might have noticed, this is definitely not a sizing issue. My > master has 2GB of RAM and 2 allocated vCPU, but the Puppet master rack > process starts consuming all resources as soon as I re-enable Directory > Environments. > > When I want to use Directory Environments, the only thing I do is > commenting the [development] and [production] sections in my puppet.conf > file, and adding this to the [main] section: environmentpath = > $confdir/environments > > Let me describe my configuration: > > *-----------------puppet.conf--------------* > [main] > logdir = /var/log/puppet. > rundir = /var/run/puppet > ssldir = $vardir/ssl > privatekeydir = $ssldir/private_keys { group = service } > hostprivkey = $privatekeydir/$certname.pem { mode = 640 } > autosign = $confdir/autosign.conf { mode = 664 } > > [master] > autosign = $confdir/autosign.conf { mode = 664 } > reports = foreman > external_nodes = /etc/puppet/node.rb > node_terminus = exec > ca = true > ssldir = /var/lib/puppet/ssl > storeconfigs = true > storeconfigs_backend = puppetdb > > [development] > modulepath = > /etc/puppet/environments/development/modules:/usr/share/puppet/modules > manifest = /etc/puppet/environments/development/manifests/site.pp > config_version = > [production] > modulepath = > /etc/puppet/environments/production/modules:/usr/share/puppet/modules > manifest = /etc/puppet/environments/production/manifests/site.pp > config_version = > > *--------------------------------------------------* > > *--------------directory tree--------------*/etc/puppet/environments/ > |-- development > | |-- manifests > | | `-- site.pp > | `-- modules > | |-- activemq > | |-- apache > | |-- apt > | |-- concat > | |-- datacat > | |-- environment > | |-- epel > | |-- erlang > | |-- firewall > | |-- java > | |-- java_ks > | |-- mcollective > | |-- postfix > | |-- profiles > | |-- rabbitmq > | |-- repos > | |-- stdlib > | `-- tomcat > `-- production > |-- manifests > | `-- site.pp > `-- modules > |-- activemq > |-- apache > |-- apt > |-- concat > |-- datacat > |-- environment > |-- epel > |-- erlang > |-- firewall > |-- inifile > |-- java > |-- java_ks > |-- mcollective > |-- mysql > |-- ntp > |-- postfix > |-- postgresql > |-- profiles > |-- puppetdb > |-- rabbitmq > |-- repos > |-- stdlib > |-- tomcat > `-- vsftpd > *--------------------------------------------------* > > > > Can anybody reproduce this it on any platform? Thank you in advance for > your help! > > Toni > -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-users/f8dde57e-7eaf-46c1-b2cd-f530f7847bf1%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
