On Tue, 30 Mar 2010, David Landgren wrote:
I believe cvsup (FreeBSD's source distribution mechanism) knows how to avoid
this cost by serialising context between runs.
That may be an avenue worth exploring, since it should be a less risky
proposition for a mirror operator to download a tried and true technology
rather than some pie-in-the-sky new system that may run out of steam in a
year's time.
You had me excited at first, but then the home page said:
To update non-RCS files, CVSup uses the highly efficient rsync algorithm,
developed by Andrew Tridgell and Paul Mackerras.
Looks like its speed benefits are due to knowledge of specific file types
(RCS and log files) so it can grab just the new content for transfer. For
all other types it falls back onto rsync, which they say is built into
CVSup.
If there isn't an existing (and portable solution) out there, I've got a few
ideas I may have to mock up and try out myself.
--Arthur Corliss
Live Free or Die
