Issue #18114 has been updated by Erik Dalén.

Josh Cooper wrote:
> There are several places where we do things like `File.read` and 
> `File.binread` instead of streaming the file. In particular, 
> Puppet::FileBucket::File keeps file contents in memory

That still doesn't explain it fully though as the size of the files was total 
400MB, so it shouldn't need to allocate several GB of memory to hold that.
----------------------------------------
Bug #18114: Recursive filebucket backup consumes way too much memory
https://projects.puppetlabs.com/issues/18114#change-78801

Author: Erik Dalén
Status: Accepted
Priority: Normal
Assignee: 
Category: filebucket
Target version: 
Affected Puppet version: 3.0.1
Keywords: 
Branch: 


On a host where puppet decided to do a recursive filebucket backup of ~12000 
files of total 400MB this caused the puppetmaster to consistently allocate more 
than 30GB and then get killed by the OOM killer.


-- 
You have received this notification because you have either subscribed to it, 
or are involved in it.
To change your notification preferences, please click here: 
http://projects.puppetlabs.com/my/account

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Bugs" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to 
[email protected].
For more options, visit this group at 
http://groups.google.com/group/puppet-bugs?hl=en.

Reply via email to