Re: reducing file list bytes transferred

2007-10-03 Thread Peter Salameh
Thanks for that. Doesn't the delta-transfer algorithm compare the files on sender and receiver? For the file list, we would only need compare the new file list with the last one on the sender (it would be a simple matter to check that the receiver's file list is still valid with a checksum). If

Re: reducing file list bytes transferred

2007-10-03 Thread Peter Salameh
I agree that rsync being stateless is a good thing. I have found it very reliable and predictable for years. I certainly wouldn't change to unison (which apparently is currently not maintained) just to speed up the file list transfer. Delta-transfer of the file list seems to make good sense for

Re: reducing file list bytes transferred

2007-10-02 Thread Wayne Davison
On Mon, Oct 01, 2007 at 08:21:25PM -0500, Stephen Zemlicka wrote: I thought it was supposed to do it more effeciently Yes, protocol 30 has several improvements that reduce the number of bytes sent over the wire in addition to its incremental recursion mode. The latter is slightly less

reducing file list bytes transferred

2007-10-01 Thread Peter Salameh
Hello, This is my first posting to the rsync list. I mirror a database containing directories which contain a very large number of files (say 30,000), and sending the file list can often take longer than transferring the new files.(Rsync ends up sending nearly the same file list on every

Re: reducing file list bytes transferred

2007-10-01 Thread Matt McCutchen
On 10/1/07, Peter Salameh [EMAIL PROTECTED] wrote: Has the rsync team considered an rsync option which would remember the last file list on both ends, and only send changes to the list? Perhaps a more natural approach is to use the delta-transfer algorithm to send the file list. Jamie Lokier

RE: reducing file list bytes transferred

2007-10-01 Thread Stephen Zemlicka
, October 01, 2007 5:42 PM To: rsync@lists.samba.org Subject: reducing file list bytes transferred Hello, This is my first posting to the rsync list. I mirror a database containing directories which contain a very large number of files (say 30,000), and sending the file list can often take longer

Re: reducing file list bytes transferred

2007-10-01 Thread Matt McCutchen
On 10/1/07, Stephen Zemlicka [EMAIL PROTECTED] wrote: I think the next release is supposed to speed this up. Are you thinking of incremental recursion? It interleaves file list and file data transmission but does not decrease the total amount of file-list data sent. Matt -- To unsubscribe or

RE: reducing file list bytes transferred

2007-10-01 Thread Stephen Zemlicka
, October 01, 2007 8:10 PM To: Stephen Zemlicka Cc: Peter Salameh; rsync@lists.samba.org Subject: Re: reducing file list bytes transferred On 10/1/07, Stephen Zemlicka [EMAIL PROTECTED] wrote: I think the next release is supposed to speed this up. Are you thinking of incremental recursion

Re: reducing file list bytes transferred

2007-10-01 Thread Matt McCutchen
On 10/1/07, Stephen Zemlicka [EMAIL PROTECTED] wrote: I thought it was supposed to do it more effeciently Not that I know of. (Wayne, please correct me if necessary.) Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read:

Re: reducing file list bytes transferred

2007-10-01 Thread Matt McCutchen
On 10/2/07, Peter Salameh [EMAIL PROTECTED] wrote: Thanks for that. Doesn't the delta-transfer algorithm compare the files on sender and receiver? Correct. For the file list, we would only need compare the new file list with the last one on the sender Unison (