On Friday, May 11, 2012 6:40:19 PM UTC-7, Jeff McCune wrote: > > And to jump on this... > > We absolutely have to make sure synchronizing plugins is fast and > efficient. If something like stdlib is a performance issue by its nature of > containing lots of additional functionality then we consider that a bug and > we'll fix it. > > For me, hundreds of file resources aren't really a concern in puppet > today. even thousands should be fine. > > It's large files that are a concern. if you have a hundred files of about > a meg each then that's where we have concerns. > >
It's interesting... that you are concerned about one aspect, but not at all about another. To give an extreme example of why I care: We used to have a large rsync job, to transfer files between one host and another that ran every night.It was on a relatively large filesystem. A full resync, where the other side was wiped, took something like 1 hour. However, a run where everything was already in sync... took *half an hour*. Half the time of the sync, was just checking the file dates and sizes. file comparisons are a small resource cost, but they are non-zero; and that's when you're only doing stat(). Actually reading the things and chksumming them, is signifcantly worse. Have a lot of them, and they add up. If modules get more popular, then you will potentially find it commonplace to have hundreds of files that need syncing. *per client*. puppet already has a reputation of having difficulty scaling with a single master server. It would be a shame to have deliberate design choices make that worse. 1,000 system farms are becoming commonplace. For some admins, if a product cannot reliably scale to handle that number of nodes from a single master, then they view the product as not designed for their standards of scaling, and they seek elsewhere. Are you giving up that area as a design target? -- You received this message because you are subscribed to the Google Groups "Puppet Developers" group. To view this discussion on the web visit https://groups.google.com/d/msg/puppet-dev/-/GThkaIhY6RYJ. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/puppet-dev?hl=en.
