Re: rsync rewrites all blocks of large files although it uses delta transfer

2019-02-13 Thread Delian Krustev via rsync
On Wednesday, February 13, 2019 6:25:59 PM EET Remi Gauvin wrote: > If the --inplace delta is as large as the filesize, then the > structure/location of the data has changed enough that the whole file > would have to be written out in any case. This is not the case. If you see my original post

Re: rsync rewrites all blocks of large files although it uses delta transfer

2019-02-13 Thread Delian Krustev via rsync
On Wednesday, February 13, 2019 6:20:13 PM EET Remi Gauvin via rsync wrote: > Have you run the nifs-clean before checking this free space comparison? > Maybe there is just large amplification created by Rsyn's many small > writes when using --inplace. nilfs-clean is being suspended for the

Re: rsync rewrites all blocks of large files although it uses delta transfer

2019-02-13 Thread Remi Gauvin via rsync
On 2019-02-13 10:47 a.m., Delian Krustev via rsync wrote: > > > Free space at the beginning and end of the backup: > Filesystem 1M-blocks Used Available Use% Mounted on > /dev/mapper/bkp 102392 76872 20400 80% /mnt/bkp > /dev/mapper/bkp 102392 78768

Re: rsync rewrites all blocks of large files although it uses delta transfer

2019-02-13 Thread Remi Gauvin via rsync
On 2019-02-13 5:26 p.m., Delian Krustev via rsync wrote: > > The copy is needed for the comparison of the blocks as "--inplace" overwrites > the destination file. I've tried without "--backup" but then the delta > transfers too much data - close to the size of the backed-up files. > It's

Re: rsync rewrites all blocks of large files although it uses delta transfer

2019-02-13 Thread Kevin Korb via rsync
It can't do what you want. The closest thing would be --compare-dest. On 2/13/19 5:26 PM, Delian Krustev wrote: > On Wednesday, February 13, 2019 11:29:44 AM EET Kevin Korb via rsync > wrote: >> With --backup in order to end up with 2 files it has to write out a >> whole new file. >> Sure, it

Re: rsync rewrites all blocks of large files although it uses delta transfer

2019-02-13 Thread Delian Krustev via rsync
On Wednesday, February 13, 2019 11:29:44 AM EET Kevin Korb via rsync wrote: > With --backup in order to end up with 2 files it has to write out a > whole new file. > Sure, it only sent the differences (normally that means > over the network but there is no network here) but the writing end was >

Re: rsync rewrites all blocks of large files although it uses delta transfer

2019-02-13 Thread Kevin Korb via rsync
With --backup in order to end up with 2 files it has to write out a whole new file. Sure, it only sent the differences (normally that means over the network but there is no network here) but the writing end was told to duplicate the file being updated before updating it. On 2/13/19 10:47 AM,

rsync rewrites all blocks of large files although it uses delta transfer

2019-02-13 Thread Delian Krustev via rsync
Hi All, For a backup purpose I'm trying to transfer only the changed blocks of large files. Thus I've run "rsync" with the appropriate options: RSYNC_BKPDIR=`mktemp -d` rsync \ --archive \ --no-whole-file \ --inplace \