Issue #1973 has been updated by harisekhon.

What version of Puppet are you running?

Mainly 0.24.6, a couple are 0.24.4


What is the system setup? OS version? 64 bit? CPUs? RAM?

CentOS 5 combination of x86 and x86_64 systems.
Dual Xeons 2 - 2.8GHz, dual or quad cores.
Gentoo x86 and x86_64
Dual Opeterons 2GHz

What is ridiculous amounts of CPU?

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND           
23061 root      25   0  815m 812m 2536 R  100 20.1 403:16.41 puppetd            
13108 userX     25   0 98596  94m  496 R  100  2.3 118:46.72 ProgramX           
   

ProgramX is a proprietary company program that does computation and runs nearly 
continuously throughout the day at 100% CPU usage.

So as you can see from cpu time, puppetd is consuming huge amounts of cpu 
relatively. Perhaps ProgramX hasn't been living as long as puppet to rack up 
the cpu time but when puppet runs it is chewing up 100% CPU and contending with 
ProgramX, which is doing serious work.

400+ hours of cpu time to copy over a few configuration files and restart one 
or two services!! Not to mention the 800MB of Ram it is consuming...


Here is a bad case on another server from yesterday that I got a chewing out 
for:

Cpu1  : 99.7% us,  0.1% sy,  0.0% ni,  0.2% id,  0.0% wa,  0.0% hi,  0.0% si
Cpu2  :  0.8% us,  6.3% sy,  0.0% ni, 92.7% id,  0.0% wa,  0.0% hi,  0.3% si
Cpu3  :  0.2% us,  1.3% sy,  0.0% ni, 98.4% id,  0.0% wa,  0.0% hi,  0.1% si
Mem:   4147412k total,  4006216k used,   141196k free,     4792k buffers
Swap:        0k total,        0k used,        0k free,  2140744k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
26281 root      25   0 1761m 1.7g  488 R 99.8 43.4  70:43.48 puppetd

So puppetd is comsuming approaching 2GB of Ram and chewing up 100% cpu!!! It's 
single threaded, not using the other cpus/cores by the look of it.

Yesterday puppet also caused a database machine to die twice from Out-of-memory 
killer (not surprising since it took an extra 2GB out of the system!). This box 
is running a 1.5TB oracle database with 8GB of ram.

So puppet causing havoc on these quite powerful machines that were previously 
very solid is a seriously achievement!!



What is the cpu when the agent is applying a catalog?

100%


What is the cpu when the agent is idle?

0% when idle as you can see above
----------------------------------------
Bug #1973: Performance problems
http://projects.reductivelabs.com:80/issues/1973

Author: harisekhon
Status: Needs more information
Priority: High
Assigned to: 
Category: 
Target version: 
Complexity: Unknown
Affected version: 0.24.7
Keywords: 


Puppetd is chewing up a ridiculous amount of CPU and the boss at work has 
unfortunately noticed and described it as "unacceptable".

I would really like to see puppet run more efficiently. We are running fast 
multi-cpu servers with multi-cores have servers running oracle databases and 
computational services so when someone says that puppet is making a noticeable 
dent in cpu time, I don't have much of a come back for that, other than "that's 
life!". I understand that the multi-cpus and core probably makes no difference 
as I believe this is pretty much single threaded but the point is they are new 
and fast servers.

My fear is that my boss will turn around and say "Get rid of that bloatware, I 
want my servers to go fast..."

Unfortunately my boss is not the only person who has called puppet a resource 
hog... help!


----------------------------------------
You have received this notification because you have either subscribed to it, 
or are involved in it.
To change your notification preferences, please click here: 
http://reductivelabs.com/redmine/my/account

--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups 
"Puppet Bugs" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to 
[email protected]
For more options, visit this group at 
http://groups.google.com/group/puppet-bugs?hl=en
-~----------~----~----~----~------~----~------~--~---

Reply via email to