On 04/04/10 22:55, Luke Kanies wrote: > On Apr 3, 2010, at 9:22 AM, Brice Figureau wrote: > >> Hi, >> >> I'm proud to post here two patches forming the Puppet Streaming patch. >> It's rather different and more leightweight than my previous attempt at >> solving this issue. But it doesn't cover streaming the catalog, it only >> involves streaming file content, either server side or client side. >> >> It doesn't also yet contain the code for #3408 (http compression), which >> I expect to add in the following couple of weeks. >> >> Please review, as usual :-) >> >> Note to Markus: if you apply this in testing, as it is based on >> lak:/tickets/master/3398, make sure to apply it to the tip of testing (or >> after 3398). >> >> Note: I'd welcome any testing the server-side on mongrel and/or rack. >> I also welcome any testing of both patches. > > > Very nice - I'm really excited you got this done. I'd love to see some > test results for memory and performance differences.
I'll post some as soon as I can get them. The first tests I did regarding memory were good. > This refactor actually perfectly prepares the code for the next thing I > want to experiment with: Retrieving the content from a filebucket > rather than from a remote file server (well, it might be a remote > filebucket). This would make catalogs more immutable - the remote files > could change but the catalog would still be coherent. > > The step after that is to replace filebuckets with git. :) Which is a nice goal. > So thanks a ton Brice, this will help people doing file trading today, > and our cool dev in the future. I also plan to add http compression to the mix (actually client decompression only); this would greatly help on WANs. It looks like it is relatively easy to add in puppet, so stay tuned. -- Brice Figureau My Blog: http://www.masterzen.fr/ -- You received this message because you are subscribed to the Google Groups "Puppet Developers" group. To post to this group, send email to puppet-...@googlegroups.com. To unsubscribe from this group, send email to puppet-dev+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-dev?hl=en.
