backu...@kosowsky.org wrote at about 13:04:21 -0500 on Sunday, January 23, 2022:
 > backu...@kosowsky.org wrote at about 00:29:11 -0500 on Sunday, January 23, 
 > 2022:
 >  > backu...@kosowsky.org wrote at about 21:53:48 -0500 on Saturday, January 
 > 22, 2022:
 >  >  > Kenneth Porter wrote at about 18:27:52 -0800 on Saturday, January 22, 
 > 2022:
 >  >  >  > --On Saturday, January 22, 2022 8:55 PM -0500 backu...@kosowsky.org 
 > wrote:
 >  >  >  > 
 >  >  >  > > It gets "stuck" at varying places... as IO slows to a complete 
 > halt
 >  >  >  > > (based on iftop) until rsync timesout.
 >  >  >  > > Similarly, 'strace' stalls.
 >  >  >  > >
 >  >  >  > > This happens even if I run rsync_bpc from the command line 
 > directly,
 >  >  >  > > but it does *not* happen when I use native rsync with the 
 > comparable
 >  >  >  > > options.
 >  >  >  > >
 >  >  >  > > Any ideas on how to debug this further?
 >  >  >  > 
 >  >  >  > Once it stalls but before the timeout, run ps and lsof to see what 
 > files 
 >  >  >  > are open by the rsync_bpc. Maybe run from gdb and force a break at 
 > that 
 >  >  >  > point to get a stack dump.
 >  >  >  > 
 >  >  > 
 >  >  > lsof doesn't show any open backup files on the BackupPC server.
 >  >  > 
 >  >  > The Android host shows that
 >  >  > '/data/app-lib/com.adobe.reader-10/libAdobeReader.so' is open.
 >  >  > Not sure why this would cause a problem as it is only 6.6MB. On the
 >  >  > other hand, it is the largest file that is transferred as the first 25
 >  >  > or so files are all < 0.5MB.
 >  >  > 
 >  >  > I can try to exclude it and see if/where it gets stuck when that file
 >  >  > is excluded.
 >  >  > 
 >  > 
 >  > Indeed, whenever I exclude a file larger than ~0.5MB, it gets stuck on
 >  > the next file larger than ~0.5MB
 >  > 
 >  > Doesn't quite make sense since native rsync works so it would seem to
 >  > be something with rsync-bpc...
 > 
 > It's actually not the size of any individual file as I am able to
 > backup large files individually or in small groups.
 > 
 > Rather the problem only occurs when there are "many" files with a
 > "large" total size -- though I have not been able to pin down the
 > issue yet.
 > 

Interestingly, until now I have been running  rsync_bpc against an existing 
TopDir/cpool
that contains several old backups of the Android device.
As such it hangs (on the local client side) after backing up ~30
files.

I just tried running the same rsync_bpc command line against a new
TopDir with a clean cpool and it proceeded much further, hanging after
about 15000 (!) files.

Again this seems to confirm that there is some issue with rsync_bpc
rather than with the native rsync code itself or the connection
between the rsync client and server.

I am wondering whether this is just another example of the often
submitted issue where BackupPC hangs... which the mailing list experts
often suggest is due to a too large or corrupted file...

Perhaps there is some type of caching or communication bug within
rsync_bpc that may be causing not just my problem but others noted in
the past...


_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Reply via email to