Issue #1395 has been updated by konrad rzentarzewski.

good news... it seems not to be related to storeconfigs. i have small function 
on puppetmaster called :template_search and it seems to be locking itself and 
eating all memory.

<pre>
# /var/lib/puppet/lib/puppet/parser/functions/template_search.rb
 
Puppet::Parser::Functions::newfunction(:template_search, :type => :rvalue, :doc 
=>
    "Find first existing file and run puppet template function on it. If you 
want
    to concatenate multiple templates try var = template_search(file1,file2) +
    template_search(file3,file4) and then use var in your resources.") do |vals|
            ret = nil
            errors = Array.new
            vals.each do |file|
                debug "in :template_search find %s" % file
                ret = nil
                begin
                    ret = function_template(file)
                rescue Exception=>e
                    if /could.not.find.template/i =~ e
                        debug "in :template_search not found %s" % file
                    else
                        raise Puppet::ParseError, "in :template_search 
exception in %s: %s" % [file,e]
                        errors.push(e)
                    end
                end
                if ret
                    debug "in :template_search found %s" % file
                    break
                end
            end
            if ret
                ret
            else
                if errors.length > 0
                    raise Puppet::ParseError, "Errors from :template function: 
%s" %
                        errors.join(", ")
                else
                    raise Puppet::ParseError, "Could not find any files from 
%s" %
                        vals.join(", ")
                end
            end
end
</pre>

in logs it hangs on:

<pre>
Dec 14 19:10:40 punch puppetmasterd[16865]: (Scope(Class[exim::backend])) in 
:template_search find exim/mailser01/exim-backend.erb
</pre>

any idea why this is happening?
----------------------------------------
Bug #1395: puppet memory usage
http://projects.reductivelabs.com/issues/1395

Author: Peter Meier
Status: Accepted
Priority: Normal
Assigned to: Markus Roberts
Category: plumbing
Target version: 0.25.2
Patch: None
Affected version: 0.25.1
Keywords: memory leaks
Branch: 


In a recent discussion about using puppetd with xinetd ("main 
thread":http://groups.google.com/group/puppet-users/browse_thread/thread/50c94008469fc395/11687cd0a633f8f4
 ) it came out that there is some investigation needed on puppetd's memory 
usage.

Different people noticed that running puppetd is using a lot of footprint 
(links follow), while other noticed that it uses nearly none (links follow)

Notices about high memory usage:

VIRT/RES
"141m/61m":http://groups.google.com/group/puppet-users/msg/75a8bb3b6652bae6
"127m/82m":http://groups.google.com/group/puppet-users/msg/a4a43d3edd585c03 64 
bit
"166m/83m":http://groups.google.com/group/puppet-users/msg/1825ed57ff84287f
"183m/96m":http://groups.google.com/group/puppet-users/msg/ecf2cd36b6e1e3a6 
version 0.24.4, 64 bit

Notices about low memory usage:

"nothing 
specific":http://groups.google.com/group/puppet-users/msg/aac9fade1b906bd9 
version 0.24.4
"57m/46m":http://groups.google.com/group/puppet-users/msg/680b2b2760aa8890 
version 0.23.1

Personally I can add another memory usage on a 32bit machine, which is rather 
low: 85m virt and 69m res, running 0.24.4

Luke then 
"noticed":http://groups.google.com/group/puppet-users/msg/573a76e32fba3eb0 that 
we should investigate on memory usage in the near future.

Besides the memory consumption of puppetd, also the memory consumption of 
puppetmaster was discussed. There Duncan Hill noticed that splitting the 
fileserver off the the main puppetmaster "improved the situation 
heavily":http://groups.google.com/group/puppet-users/msg/a7083b931b5c4cda , 
however he 
"noticed":http://groups.google.com/group/puppet-users/msg/f68347fdb69b8496 that 
the manifest puppetmaster still consumes a lot of memory.

There have been also "other reports about memory usage trashing the master and 
the 
client":http://groups.google.com/group/puppet-users/browse_thread/thread/26aa8025de704cc4/1c9608f58360cdbb,
 however this might not be related.

Quick Summary:

We have seen different environments reporting a lot of memory usage. Most of 
them seem to be 64bit machines using 0.24.4. One report about low memory usage 
was a 0.23.1 version. 

Personal additional assumption: And for a first glance it looks like that 64bit 
machines double the memory consumption. (Take care of this assumption)


-- 
You have received this notification because you have either subscribed to it, 
or are involved in it.
To change your notification preferences, please click here: 
http://reductivelabs.com/redmine/my/account

--

You received this message because you are subscribed to the Google Groups 
"Puppet Bugs" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to 
[email protected].
For more options, visit this group at 
http://groups.google.com/group/puppet-bugs?hl=en.


Reply via email to