Issue #1395 has been updated by Khushil Dep.
Target version set to 2.7.x
So I see the same on puppet on client machines which have been alive for a long
time - memory just seems to grow...
[SERVER] Executing task 'pmap'
[SERVER] sudo: pmap -x $(ps fax | grep puppetd | grep -v grep | awk '{print
$1}')
[SERVER] out: /etc/profile: line 64: HISTTIMEFORMAT: readonly variable
[SERVER] out: 3985: /usr/bin/ruby /usr/sbin/puppetd
[SERVER] out: Address Kbytes RSS Dirty Mode Mapping
[SERVER] out: 0000000000400000 4 4 0 r-x-- ruby
[SERVER] out: 0000000000600000 8 8 4 rw--- ruby
[SERVER] out: 0000000014594000 479936 479320 479320 rw--- [ anon ]
[SERVER] out: 0000000041f06000 4 0 0 ----- [ anon ]
[SERVER] out: 0000000041f07000 10240 4 4 rw--- [ anon ]
[SERVER] out: 0000003251800000 112 80 0 r-x-- ld-2.5.so
[SERVER] out: 0000003251a1c000 4 4 4 r---- ld-2.5.so
[SERVER] out: 0000003251a1d000 4 4 4 rw--- ld-2.5.so
[SERVER] out: 0000003251c00000 1336 560 0 r-x-- libc-2.5.so
[SERVER] out: 0000003251d4e000 2048 0 0 ----- libc-2.5.so
[SERVER] out: 0000003251f4e000 16 16 4 r---- libc-2.5.so
[SERVER] out: 0000003251f52000 4 4 4 rw--- libc-2.5.so
[SERVER] out: 0000003251f53000 20 20 20 rw--- [ anon ]
[SERVER] out: 0000003252000000 8 8 0 r-x-- libdl-2.5.so
[SERVER] out: 0000003252002000 2048 0 0 ----- libdl-2.5.so
[SERVER] out: 0000003252202000 4 4 4 r---- libdl-2.5.so
[SERVER] out: 0000003252203000 4 4 4 rw--- libdl-2.5.so
[SERVER] out: 0000003252400000 236 8 0 r-x-- libsepol.so.1
[SERVER] out: 000000325243b000 2048 0 0 ----- libsepol.so.1
[SERVER] out: 000000325263b000 4 4 4 rw--- libsepol.so.1
[SERVER] out: 000000325263c000 40 0 0 rw--- [ anon ]
[SERVER] out: 0000003252800000 84 8 0 r-x-- libselinux.so.1
[SERVER] out: 0000003252815000 2048 0 0 ----- libselinux.so.1
[SERVER] out: 0000003252a15000 8 8 8 rw--- libselinux.so.1
[SERVER] out: 0000003252a17000 4 4 4 rw--- [ anon ]
[SERVER] out: 0000003252c00000 88 64 0 r-x-- libpthread-2.5.so
[SERVER] out: 0000003252c16000 2044 0 0 ----- libpthread-2.5.so
[SERVER] out: 0000003252e15000 4 4 4 r---- libpthread-2.5.so
[SERVER] out: 0000003252e16000 4 4 4 rw--- libpthread-2.5.so
[SERVER] out: 0000003252e17000 16 4 4 rw--- [ anon ]
[SERVER] out: 0000003253000000 520 16 0 r-x-- libm-2.5.so
[SERVER] out: 0000003253082000 2044 0 0 ----- libm-2.5.so
[SERVER] out: 0000003253281000 4 4 0 r---- libm-2.5.so
[SERVER] out: 0000003253282000 4 4 4 rw--- libm-2.5.so
[SERVER] out: 0000003253400000 80 40 0 r-x-- libz.so.1.2.3
[SERVER] out: 0000003253414000 2044 0 0 ----- libz.so.1.2.3
[SERVER] out: 0000003253613000 4 4 4 rw--- libz.so.1.2.3
[SERVER] out: 0000003253c00000 36 4 0 r-x-- libcrypt-2.5.so
[SERVER] out: 0000003253c09000 2044 0 0 ----- libcrypt-2.5.so
[SERVER] out: 0000003253e08000 4 4 4 r---- libcrypt-2.5.so
[SERVER] out: 0000003253e09000 4 4 4 rw--- libcrypt-2.5.so
[SERVER] out: 0000003253e0a000 184 0 0 rw--- [ anon ]
[SERVER] out: 0000003254000000 176 8 0 r-x--
libgssapi_krb5.so.2.2
[SERVER] out: 000000325402c000 2048 0 0 -----
libgssapi_krb5.so.2.2
[SERVER] out: 000000325422c000 8 8 8 rw---
libgssapi_krb5.so.2.2
[SERVER] out: 0000003254400000 1204 576 0 r-x--
libcrypto.so.0.9.8e
[SERVER] out: 000000325452d000 2044 0 0 -----
libcrypto.so.0.9.8e
[SERVER] out: 000000325472c000 132 124 16 rw---
libcrypto.so.0.9.8e
[SERVER] out: 000000325474d000 16 16 16 rw--- [ anon ]
[SERVER] out: 0000003254800000 280 156 0 r-x-- libssl.so.0.9.8e
[SERVER] out: 0000003254846000 2048 0 0 ----- libssl.so.0.9.8e
[SERVER] out: 0000003254a46000 24 24 16 rw--- libssl.so.0.9.8e
[SERVER] out: 0000003255400000 68 8 0 r-x-- libresolv-2.5.so
[SERVER] out: 0000003255411000 2048 0 0 ----- libresolv-2.5.so
[SERVER] out: 0000003255611000 4 4 4 r---- libresolv-2.5.so
[SERVER] out: 0000003255612000 4 4 4 rw--- libresolv-2.5.so
[SERVER] out: 0000003255613000 8 0 0 rw--- [ anon ]
[SERVER] out: 0000003255800000 8 4 0 r-x-- libcom_err.so.2.1
[SERVER] out: 0000003255802000 2044 0 0 ----- libcom_err.so.2.1
[SERVER] out: 0000003255a01000 4 4 4 rw--- libcom_err.so.2.1
[SERVER] out: 0000003255c00000 584 12 0 r-x-- libkrb5.so.3.3
[SERVER] out: 0000003255c92000 2044 0 0 ----- libkrb5.so.3.3
[SERVER] out: 0000003255e91000 16 16 12 rw--- libkrb5.so.3.3
[SERVER] out: 0000003256000000 32 8 0 r-x--
libkrb5support.so.0.1
[SERVER] out: 0000003256008000 2044 0 0 -----
libkrb5support.so.0.1
[SERVER] out: 0000003256207000 4 4 4 rw---
libkrb5support.so.0.1
[SERVER] out: 0000003256400000 8 4 0 r-x-- libkeyutils-1.2.so
[SERVER] out: 0000003256402000 2044 0 0 ----- libkeyutils-1.2.so
[SERVER] out: 0000003256601000 4 4 4 rw--- libkeyutils-1.2.so
[SERVER] out: 0000003256800000 144 8 0 r-x-- libk5crypto.so.3.1
[SERVER] out: 0000003256824000 2044 0 0 ----- libk5crypto.so.3.1
[SERVER] out: 0000003256a23000 8 8 8 rw--- libk5crypto.so.3.1
[SERVER] out: 00000033a8600000 868 716 0 r-x-- libruby.so.1.8.5
[SERVER] out: 00000033a86d9000 2044 0 0 ----- libruby.so.1.8.5
[SERVER] out: 00000033a88d8000 20 20 12 rw--- libruby.so.1.8.5
[SERVER] out: 00000033a88dd000 120 116 116 rw--- [ anon ]
[SERVER] out: 00002aaaaaaab000 516 516 516 rw--- [ anon ]
[SERVER] out: 00002aaaaab39000 212 4 0 r--s- hosts
[SERVER] out: 00002aaaaab6e000 212 4 0 r--s- dbMxl8qI (deleted)
[SERVER] out: 00002aaaaac71000 13288 13288 13288 rw--- [ anon ]
[SERVER] out: 00002aaaab96b000 40 24 0 r-x--
libnss_files-2.5.so
[SERVER] out: 00002aaaab975000 2044 0 0 -----
libnss_files-2.5.so
[SERVER] out: 00002aaaabb74000 4 4 4 r----
libnss_files-2.5.so
[SERVER] out: 00002aaaabb75000 4 4 4 rw---
libnss_files-2.5.so
[SERVER] out: 00002acf7e3f6000 12 8 8 rw--- [ anon ]
[SERVER] out: 00002acf7e400000 404 404 404 rw--- [ anon ]
[SERVER] out: 00002acf7e466000 704 704 704 rw--- [ anon ]
[SERVER] out: 00002acf7e516000 16 4 0 r-x-- stringio.so
[SERVER] out: 00002acf7e51a000 2048 0 0 ----- stringio.so
[SERVER] out: 00002acf7e71a000 4 4 4 rw--- stringio.so
[SERVER] out: 00002acf7e71b000 112 100 0 r-x-- syck.so
[SERVER] out: 00002acf7e737000 2044 0 0 ----- syck.so
[SERVER] out: 00002acf7e936000 8 8 8 rw--- syck.so
[SERVER] out: 00002acf7e939000 1268 1268 1268 rw--- [ anon ]
[SERVER] out: 00002acf7ea76000 8 8 0 r-x-- etc.so
[SERVER] out: 00002acf7ea78000 2048 0 0 ----- etc.so
[SERVER] out: 00002acf7ec78000 4 4 4 rw--- etc.so
[SERVER] out: 00002acf7ec7a000 2280 2280 2280 rw--- [ anon ]
[SERVER] out: 00002acf7eeb4000 212 4 0 r--s- dbZqNUDa (deleted)
[SERVER] out: 00002acf7eee9000 12 12 0 r-x-- syslog.so
[SERVER] out: 00002acf7eeec000 2044 0 0 ----- syslog.so
[SERVER] out: 00002acf7f0eb000 4 4 4 rw--- syslog.so
[SERVER] out: 00002acf7f0ed000 4104 4104 4104 rw--- [ anon ]
[SERVER] out: 00002acf7f4ef000 236 8 0 r-x-- nkf.so
[SERVER] out: 00002acf7f52a000 2048 0 0 ----- nkf.so
[SERVER] out: 00002acf7f72a000 16 16 16 rw--- nkf.so
[SERVER] out: 00002acf7f72e000 4 0 0 rw--- [ anon ]
[SERVER] out: 00002acf7f72f000 16 16 0 r-x-- strscan.so
[SERVER] out: 00002acf7f733000 2044 0 0 ----- strscan.so
[SERVER] out: 00002acf7f932000 4 4 4 rw--- strscan.so
[SERVER] out: 00002acf7f933000 16 4 0 r-x-- iconv.so
[SERVER] out: 00002acf7f937000 2044 0 0 ----- iconv.so
[SERVER] out: 00002acf7fb36000 4 4 4 rw--- iconv.so
[SERVER] out: 00002acf7fb37000 28 0 0 r--s-
gconv-modules.cache
[SERVER] out: 00002acf7fb3e000 8 0 0 r-x-- UTF-16.so
[SERVER] out: 00002acf7fb40000 2044 0 0 ----- UTF-16.so
[SERVER] out: 00002acf7fd3f000 8 8 8 rw--- UTF-16.so
[SERVER] out: 00002acf7fd41000 12 12 0 r-x-- sha1.so
[SERVER] out: 00002acf7fd44000 2044 0 0 ----- sha1.so
[SERVER] out: 00002acf7ff43000 4 4 4 rw--- sha1.so
[SERVER] out: 00002acf7ff44000 8 8 0 r-x-- digest.so
[SERVER] out: 00002acf7ff46000 2044 0 0 ----- digest.so
[SERVER] out: 00002acf80145000 4 4 4 rw--- digest.so
[SERVER] out: 00002acf80146000 12 12 0 r-x-- cparse.so
[SERVER] out: 00002acf80149000 2048 0 0 ----- cparse.so
[SERVER] out: 00002acf80349000 4 4 4 rw--- cparse.so
[SERVER] out: 00002acf8034a000 8 8 0 r-x-- md5.so
[SERVER] out: 00002acf8034c000 2044 0 0 ----- md5.so
[SERVER] out: 00002acf8054b000 4 4 4 rw--- md5.so
[SERVER] out: 00002acf8054d000 7384 7384 7384 rw--- [ anon ]
[SERVER] out: 00002acf80c83000 44 36 0 r-x-- socket.so
[SERVER] out: 00002acf80c8e000 2044 0 0 ----- socket.so
[SERVER] out: 00002acf80e8d000 4 4 4 rw--- socket.so
[SERVER] out: 00002acf80e8e000 232 152 0 r-x-- openssl.so
[SERVER] out: 00002acf80ec8000 2044 0 0 ----- openssl.so
[SERVER] out: 00002acf810c7000 12 12 12 rw--- openssl.so
[SERVER] out: 00002acf810ca000 4 4 0 r-x-- fcntl.so
[SERVER] out: 00002acf810cb000 2044 0 0 ----- fcntl.so
[SERVER] out: 00002acf812ca000 4 4 4 rw--- fcntl.so
[SERVER] out: 00002acf812cb000 8 8 0 r-x-- enumerator.so
[SERVER] out: 00002acf812cd000 2044 0 0 ----- enumerator.so
[SERVER] out: 00002acf814cc000 4 4 4 rw--- enumerator.so
[SERVER] out: 00002acf814cd000 36 24 0 r-x-- zlib.so
[SERVER] out: 00002acf814d6000 2044 0 0 ----- zlib.so
[SERVER] out: 00002acf816d5000 4 4 4 rw--- zlib.so
[SERVER] out: 00002acf816d6000 8 8 0 r-x-- shadow.so
[SERVER] out: 00002acf816d8000 2044 0 0 ----- shadow.so
[SERVER] out: 00002acf818d7000 4 4 4 rw--- shadow.so
[SERVER] out: 00002acf818d8000 12 12 0 r-x-- _augeas.so
[SERVER] out: 00002acf818db000 2044 0 0 ----- _augeas.so
[SERVER] out: 00002acf81ada000 4 4 4 rw--- _augeas.so
[SERVER] out: 00002acf81ae3000 260 120 0 r-x--
libaugeas.so.0.15.0
[SERVER] out: 00002acf81b24000 2044 0 0 -----
libaugeas.so.0.15.0
[SERVER] out: 00002acf81d23000 12 12 12 rw---
libaugeas.so.0.15.0
[SERVER] out: 00002acf81d26000 72 12 0 r-x-- libfa.so.1.3.5
[SERVER] out: 00002acf81d38000 2048 0 0 ----- libfa.so.1.3.5
[SERVER] out: 00002acf81f38000 4 4 4 rw--- libfa.so.1.3.5
[SERVER] out: 00002acf81f39000 1228 168 0 r-x-- libxml2.so.2.6.26
[SERVER] out: 00002acf8206c000 2048 0 0 ----- libxml2.so.2.6.26
[SERVER] out: 00002acf8226c000 36 36 36 rw--- libxml2.so.2.6.26
[SERVER] out: 00002acf82275000 4 0 0 rw--- [ anon ]
[SERVER] out: 00007fffc303e000 584 584 584 rw--- [ stack ]
[SERVER] out: 00007fffc31fd000 12 4 0 r-x-- [ anon ]
[SERVER] out: ffffffffff600000 8192 0 0 ----- [ anon ]
[SERVER] out: ---------------- ------ ------ ------
[SERVER] out: total kB 622624 513560 510344
----------------------------------------
Bug #1395: puppet memory usage
https://projects.puppetlabs.com/issues/1395#change-71272
Author: Peter Meier
Status: Needs More Information
Priority: Normal
Assignee: Daniel Pittman
Category: plumbing
Target version: 2.7.x
Affected Puppet version: 0.25.1
Keywords: memory leaks
Branch:
In a recent discussion about using puppetd with xinetd ("main
thread":http://groups.google.com/group/puppet-users/browse_thread/thread/50c94008469fc395/11687cd0a633f8f4
) it came out that there is some investigation needed on puppetd's memory
usage.
Different people noticed that running puppetd is using a lot of footprint
(links follow), while other noticed that it uses nearly none (links follow)
Notices about high memory usage:
<pre>
VIRT/RES
"141m/61m":http://groups.google.com/group/puppet-users/msg/75a8bb3b6652bae6
"127m/82m":http://groups.google.com/group/puppet-users/msg/a4a43d3edd585c03 64
bit
"166m/83m":http://groups.google.com/group/puppet-users/msg/1825ed57ff84287f
"183m/96m":http://groups.google.com/group/puppet-users/msg/ecf2cd36b6e1e3a6
version 0.24.4, 64 bit
</pre>
Notices about low memory usage:
<pre>
"nothing
specific":http://groups.google.com/group/puppet-users/msg/aac9fade1b906bd9
version 0.24.4
"57m/46m":http://groups.google.com/group/puppet-users/msg/680b2b2760aa8890
version 0.23.1
</pre>
Personally I can add another memory usage on a 32bit machine, which is rather
low: 85m virt and 69m res, running 0.24.4
Luke then
"noticed":http://groups.google.com/group/puppet-users/msg/573a76e32fba3eb0 that
we should investigate on memory usage in the near future.
Besides the memory consumption of puppetd, also the memory consumption of
puppetmaster was discussed. There Duncan Hill noticed that splitting the
fileserver off the the main puppetmaster "improved the situation
heavily":http://groups.google.com/group/puppet-users/msg/a7083b931b5c4cda ,
however he
"noticed":http://groups.google.com/group/puppet-users/msg/f68347fdb69b8496 that
the manifest puppetmaster still consumes a lot of memory.
There have been also "other reports about memory usage trashing the master and
the
client":http://groups.google.com/group/puppet-users/browse_thread/thread/26aa8025de704cc4/1c9608f58360cdbb,
however this might not be related.
Quick Summary:
We have seen different environments reporting a lot of memory usage. Most of
them seem to be 64bit machines using 0.24.4. One report about low memory usage
was a 0.23.1 version.
Personal additional assumption: And for a first glance it looks like that 64bit
machines double the memory consumption. (Take care of this assumption)
--
You have received this notification because you have either subscribed to it,
or are involved in it.
To change your notification preferences, please click here:
http://projects.puppetlabs.com/my/account
--
You received this message because you are subscribed to the Google Groups
"Puppet Bugs" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/puppet-bugs?hl=en.
