I suggest trying to recreate this by running 'rsync' manually using as
similar options to backuppc as possible. You can see the options by
running 'ps' while backuppc is running. Also try to use the same rsync
version as backuppc is using.
This way you should be able to (mostly) rule out a problem with your
client/host machine, network, and rsync itself.
David Raison wrote at about 10:04:31 +0200 on Thursday, July 20, 2023:
> Hi again,
>
> On 19/07/2023 13:25, David Raison wrote:
> > I guess I'll try to pipe the process' output to files so that I may > be
> > able to spot when and/or where exactly the switch from listing to
> > dumping happens, but any ideas from your side are more than welcome.
>
> When it's dumping contents to the screen, it's not stderr, but stdout. I
> collected 224Gb of logs tonight before the backup aborted. (Good thing
> this is a backup host with storage capacity…)
>
> The point where it started dumping content during that first run was here:
>
> create 600 5000/5000 92
> var/vmail/domain.tld/frank/Maildir/dovecot-keywords
> create 600 5000/5000 2363352
> var/vmail/domain.tld/frank/Maildir/dovecot-uidlist
> create 600 5000/5000 8
> var/vmail/domain.tld/frank/Maildir/dovecot-uidvalidity
> create 444 5000/5000 0
> var/vmail/domain.tld/frank/Maildir/dovecot-uidvalidity.555ef901
> create 600 5000/5000 838408
> var/vmail/domain.tld/frank/Maildir/dovecot.index
> create 600 5000/5000 61418840
> var/vmail/domain.tld/frank/Maildir/dovecot.index.cache
> create 600 5000/5000 19364
> var/vmail/domain.tld/frank/Maildir/dovecot.index.log
> Remote[9]:
> ^@(^@0^@^P^@^P^@,^@T^@^P^@^P^@,^@a^@^P^@^P^@"^@^B^F^A^A^@^P^@^@^@^@^@V<97>aVöä½^YpQ7"]Væ'O<87>^C^@^@^@^@^@^@^H^@^@^B^@^@^@^@^@^@^@^@<80>^@^@^D<80>^@^GReturn-Path:
>
> <ret...@news.engelvoelkers.com>\nDelivered-To:
> u...@domain.tld\nReceived: from localhost (localhost [127.0.0.1])\n
> by host.domain.tld (Postfix) with ESMTP id 52F0942D757\n for
> <u...@domain.tld>; Thu, 8 Apr 2021 16:01:11 +0200
> (CEST)\nX-Virus-Scanned: Debian amavisd-new at
> host.domain.tld\nX-Spam-Flag: NO\nX-Spam-Score: -1.
>
> If we look at the directory and which other files it contains, we have:
>
> drwx------ 2 vmail vmail 3178496 Jul 19 15:06 cur
> -rw------- 1 vmail vmail 838408 Jul 19 12:18 dovecot.index
> -rw------- 1 vmail vmail 61427528 Jul 19 15:06 dovecot.index.cache
> -rw------- 1 vmail vmail 25260 Jul 19 15:10 dovecot.index.log
> -rw------- 1 vmail vmail 32768 Jul 18 23:10 dovecot.index.log.2
> -rw------- 1 vmail vmail 92 Mar 24 2020 dovecot-keywords
> -rw------- 1 vmail vmail 1016 Jul 19 13:18 dovecot.list.index
> -rw------- 1 vmail vmail 500 Jul 19 13:40 dovecot.list.index.log
> -rw------- 1 vmail vmail 72 Sep 4 2017 dovecot.mailbox.log
> -rw------- 1 vmail vmail 2363623 Jul 19 15:06 dovecot-uidlist
> -rw------- 1 vmail vmail 8 Sep 4 2017 dovecot-uidvalidity
> -r--r--r-- 1 vmail vmail 0 May 22 2015 dovecot-uidvalidity.555ef901
> drwx------ 2 vmail vmail 4096 Jul 19 15:06 new
> -rw------- 1 vmail vmail 62 Dec 27 2020 subscriptions
> drwx------ 2 vmail vmail 4096 Jul 19 15:06 tmp
>
> I tried excluding the entire directory to see if the problem still
> occurred, this time on a different location perhaps, and it did… so it's
> not any specific file in that directory.
>
> The second time, it started acting up here:
>
> Can't open /var/lib/backuppc/pc/host.hypervisor.srv.1024.lu/858/f%2f for
> MD4 check (err=-3, .)
> .: md4 doesn't match: will retry in phase 1; file removed
> Must redo 0 (.)\n
> Remote[-6]: 18541^A1689778695.774
> ^A27602^@^@^@^@^A©+/^Kù<8d>áy^W^Híò>qVùE^B^@^@^@^@^@^@^H^@^@^B^@^@^@^@^@^@^@^@0^@^@Dä^@^G^@^@^@^@^A^@^@^@^@^@^@^@a^U^F^@
>
> ^@^@^@^@^P^@^@^@^H^@^@^@^@^@^@^B^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@¨#B^@^Aþ^@^@s{`à<94>y^@^@^@^@^@^@^A^@^@^@^A^@^@^@^@^@^@^@^@^@^@^@[^@^@^@Ñ<8d>h^^A^@^@^@^A^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^
> […]
> Remote[69]:
> c93\njH/3ZGveb4VPZTRFLd/h91i1tX32j3tH1QbhlPMJ9vW4LWw0i/1UNXKS+az+\natfzrWMuD7fh0qk9F+LwfGaMU2ofif1Zv58k8vxUfJtqvSEW71Stxbd4Xe7J\nwXKjYYG2W5a4N0XaMv/UiINfLeMMfKcKUULKnlunpEXVNetiq1q6R9fD69+P\nc49g7Dv3rK7nvEPFuCHvC1EbzwuVvYSz4NGH+ALt+eRuPbK9ippi7nvEj3Yj\nmrTIa2JeIXvO0dTKsLxOUt+6TLFbEsJXjOAy7uOW/XFmwrXNJWf20tPrh73T\nl8P+RimIHFo6B5gT+9sxYs8ng8jQkFPHDTkTWS0C3EHMudBadYd+gVoPXn03\nt4FEjWt5mpG3wDUKL5N7Iss2N5lPBy/lYy0LbjT17oDDZNOVK/q0nk5ud8gO\naCP0LVQAX1tYQQ4Lp2v4Pd+rS…
>
>
> So I don't know where to head on from here.
>
> Regards,
> David
>
> --
>
> *TenTwentyFour S.à r.l.*
> www.tentwentyfour.lu <https://www.tentwentyfour.lu>
> *T*: +352 20 211 1024
> *F*: +352 20 211 1023
> 1 place de l'Hôtel de Ville
> 4138 Esch-sur-Alzette
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki: https://github.com/backuppc/backuppc/wiki
> Project: https://backuppc.github.io/backuppc/
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
