Re: [Puppet Users] Puppet managing thousands of resources

2017-01-11 Thread Christopher Wood
nuary, 2017 22:33:22 > > Subject: Re: [Puppet Users] Puppet managing thousands of resources > > > Out of gruesome interest, 5000 resources of what? > > > > Assuming I'm remembering the path correctly, something like this would > > count it > > up, mod

Re: [Puppet Users] Puppet managing thousands of resources

2017-01-11 Thread Ramin K
On 1/11/17 9:58 AM, Zachary Vida wrote: Hello, I was wonder if there are any significant impovements in later version of puppet >= 2.6 to catolog compilation and/or application runtimes. In an environment I manage we populate many local files (/etc/passwd,/etc/group,/etc/hosts) via ENC. This

Re: [Puppet Users] Puppet managing thousands of resources

2017-01-11 Thread R.I.Pienaar
- Original Message - > From: "Christopher Wood" <christopher_w...@pobox.com> > To: "puppet-users" <puppet-users@googlegroups.com> > Sent: Wednesday, 11 January, 2017 22:33:22 > Subject: Re: [Puppet Users] Puppet managing thousands of resources

Re: [Puppet Users] Puppet managing thousands of resources

2017-01-11 Thread Christopher Wood
Out of gruesome interest, 5000 resources of what? Assuming I'm remembering the path correctly, something like this would count it up, modify for your local case (assuming no puppetdb at your place) to search for resource types: python -m json.tool /var/lib/puppet/client_data/catalog/`hostname

Re: [Puppet Users] Puppet managing thousands of resources

2017-01-11 Thread Trevor Vaughan
By my calculations...really. I'm around 3k normally right now with no issue but, as you move toward 10k, your agents start to have a bad time. CC'ing Henrik and Eric since this is an "in the wild" case outside of my theoretical ranting. It's pretty easy to test using 'puppet apply' and files

Re: [Puppet Users] Puppet managing thousands of resources

2017-01-11 Thread Zachary Vida
Exponential? Really or just an expression, but rough estimate is probably about 5k On Wed, Jan 11, 2017, 2:50 PM Trevor Vaughan wrote: > How many resources are in your catalog? > > Puppet starts to hit exponential catalog sizes and run times as you > approach 10k

Re: [Puppet Users] Puppet managing thousands of resources

2017-01-11 Thread Trevor Vaughan
How many resources are in your catalog? Puppet starts to hit exponential catalog sizes and run times as you approach 10k resources. Thanks, Trevor On Wed, Jan 11, 2017 at 12:58 PM, Zachary Vida wrote: > Hello, I was wonder if there are any significant impovements in

Re: [Puppet Users] Puppet managing thousands of resources

2017-01-11 Thread R.I.Pienaar
Lots of improvements. Http connections are reused and new static catalogs will help. It's different for everyone just how much it helps though. --- R.I.Pienaar > On 11 Jan 2017, at 18:58, Zachary Vida wrote: > > Hello, I was wonder if there are any significant

Re: [Puppet Users] Puppet managing thousands of resources

2017-01-11 Thread Zachary Vida
Lowe, I am well aware it is very old. We have a single puppet master and a couple of hundred servers. I hope that answers your question? On Wednesday, January 11, 2017 at 1:44:26 PM UTC-5, Lowe Schmidt wrote: > > How do you run the puppetmaster? (Also, 2.6 is wy EOL) > > -- > Lowe Schmidt

Re: [Puppet Users] Puppet managing thousands of resources

2017-01-11 Thread Lowe Schmidt
How do you run the puppetmaster? (Also, 2.6 is wy EOL) -- Lowe Schmidt | +46 723 867 157 On 11 January 2017 at 18:58, Zachary Vida wrote: > Hello, I was wonder if there are any significant impovements in later > version of puppet >= 2.6 to catolog compilation and/or

[Puppet Users] Puppet managing thousands of resources

2017-01-11 Thread Zachary Vida
Hello, I was wonder if there are any significant impovements in later version of puppet >= 2.6 to catolog compilation and/or application runtimes. In an environment I manage we populate many local files (/etc/passwd,/etc/group,/etc/hosts) via ENC. This results in a steady state catalog