On Mar 19, 2009, at 7:19 PM, Mark Plaksin wrote:

>
> Brice Figureau <brice-pup...@daysofwonder.com> writes:
>
>> On 19/03/09 22:50, Luke Kanies wrote:
>>
>>> Hi all,
>>>
>>> I've been thinking a lot about file recursion and why it's so darn
>>> complicated, and I think one reason is the recursion happening in  
>>> the
>>> same resource type doing the managing.  As a result, I've been
>>> thinking of moving the file recursion into a Fileset resource type.
>>>
>>> Currently, the file type generates new file resources during
>>> recursion; this basic model would be the same, except that the  
>>> fileset
>>> resource type would be generating files.
>>
>> I've also been thinking a lot about local file recursion lately,  
>> but for
>> performance reasons.
>>
>> I understand your idea and what are the benefits of your proposals in
>> term of clarity, code concision and such.
>>
>> Right now, the main performance issue with local recursive file
>> resources is creating one newchild file resource per managed sub  
>> file,
>> which in turn will be managed by the system.
>> Ruby seems particularly slow at creating tons of objects, and it uses
>> memory for something that is at really transient.
>
> I'm outta my league as far as the code goes but this *sounds* like  
> what
> caused the support case about tidy that I submitted today.  We tried  
> to
> tidy our puppet reports directory which had 350k files using 1.5G.
> Puppet used more and more RAM until it segfaulted when it hit 2G (I
> assume it was exactly 2G--I wasn't watching that closely but our stats
> say used RAM went up about 2G while puppet was running).


Indeed, that was likely the problem.  I was just about to close your  
support ticket. :)

-- 
It is dangerous to be right when the government is wrong.
     -- Voltaire
---------------------------------------------------------------------
Luke Kanies | http://reductivelabs.com | http://madstop.com


--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups 
"Puppet Developers" group.
To post to this group, send email to puppet-dev@googlegroups.com
To unsubscribe from this group, send email to 
puppet-dev+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/puppet-dev?hl=en
-~----------~----~----~----~------~----~------~--~---

Reply via email to