Issue #1395 has been updated by Sergio Ballestrero.
Running on Scientific Linux CERN 5.7, 64bit, puppet-2.6.12-2.el5, augeas-0.9.0-1.el5, ruby-1.8.5-22.el5_7.1.x86_64, we see the long running puppetd having a virtual memory footprint of ~130MB when it starts, in ~1 week growing to 300MB and continuing more slowly. <pre> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 3349 root 15 0 345m 252m 3280 S 0.0 8.4 193:21.19 puppetd </pre> On a `puppet agent --onetime` I see the same memory consumption of a freshly started long-running puppetd: <pre> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 22657 root 15 0 224m 131m 3176 S 30.6 4.4 0:15.72 puppet </pre> `/var/lib/puppet/state/state.yaml` is 125832 bytes. This is happening practically on all our clients, so it's very reproducible for me. I will now try a completely empty node definition, on a test VM, to see the effect on memory. For later reference, this VM now has been up 30 days, and I see <pre> 2655 root 15 0 550m 438m 4464 S 0.0 43.7 1285:42 puppetd </pre> and a 58328 bytes `state.yaml`. Did not decrease after changing the config, with `puppetd` still running. After a restart, it's <pre> 3151 root 15 0 158m 63m 3120 S 0.0 6.4 0:02.93 puppetd </pre> and still 58328 bytes `state.yaml`. ---------------------------------------- Bug #1395: puppet memory usage https://projects.puppetlabs.com/issues/1395 Author: Peter Meier Status: Accepted Priority: Normal Assignee: Category: plumbing Target version: Affected Puppet version: 0.25.1 Keywords: memory leaks Branch: In a recent discussion about using puppetd with xinetd ("main thread":http://groups.google.com/group/puppet-users/browse_thread/thread/50c94008469fc395/11687cd0a633f8f4 ) it came out that there is some investigation needed on puppetd's memory usage. Different people noticed that running puppetd is using a lot of footprint (links follow), while other noticed that it uses nearly none (links follow) Notices about high memory usage: <pre> VIRT/RES "141m/61m":http://groups.google.com/group/puppet-users/msg/75a8bb3b6652bae6 "127m/82m":http://groups.google.com/group/puppet-users/msg/a4a43d3edd585c03 64 bit "166m/83m":http://groups.google.com/group/puppet-users/msg/1825ed57ff84287f "183m/96m":http://groups.google.com/group/puppet-users/msg/ecf2cd36b6e1e3a6 version 0.24.4, 64 bit </pre> Notices about low memory usage: <pre> "nothing specific":http://groups.google.com/group/puppet-users/msg/aac9fade1b906bd9 version 0.24.4 "57m/46m":http://groups.google.com/group/puppet-users/msg/680b2b2760aa8890 version 0.23.1 </pre> Personally I can add another memory usage on a 32bit machine, which is rather low: 85m virt and 69m res, running 0.24.4 Luke then "noticed":http://groups.google.com/group/puppet-users/msg/573a76e32fba3eb0 that we should investigate on memory usage in the near future. Besides the memory consumption of puppetd, also the memory consumption of puppetmaster was discussed. There Duncan Hill noticed that splitting the fileserver off the the main puppetmaster "improved the situation heavily":http://groups.google.com/group/puppet-users/msg/a7083b931b5c4cda , however he "noticed":http://groups.google.com/group/puppet-users/msg/f68347fdb69b8496 that the manifest puppetmaster still consumes a lot of memory. There have been also "other reports about memory usage trashing the master and the client":http://groups.google.com/group/puppet-users/browse_thread/thread/26aa8025de704cc4/1c9608f58360cdbb, however this might not be related. Quick Summary: We have seen different environments reporting a lot of memory usage. Most of them seem to be 64bit machines using 0.24.4. One report about low memory usage was a 0.23.1 version. Personal additional assumption: And for a first glance it looks like that 64bit machines double the memory consumption. (Take care of this assumption) -- You have received this notification because you have either subscribed to it, or are involved in it. To change your notification preferences, please click here: http://projects.puppetlabs.com/my/account -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/puppet-bugs?hl=en.
