Re: [BackupPC-users] File Size Summary shows too large value for host
On Tue, Dec 13, 2022 at 3:29 AM Stefan Helfer wrote: > > Hello Iosif, > > Just to be sure, what do you mean by "Can you check sizes in parallel"? > I have already looked at the two backups, from v3 and v4, and compared them. > There are NO differences in the exports. Same size, same content, everything > identical. > If I start with a smaller list of files for the backup, I still see a > difference. However, the difference becomes smaller. > I thought v4 knew enough not to transfer files already in the pool found on another host, where v3 transfers them before finding they are duplicates and converting to hardlinks and only skips matches from a previous backup of the same host. Maybe it is calculating sizes from the transfers. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] File Size Summary shows too large value for host
Hello Stefan, Just to be sure, what do you mean by "Can you check sizes in parallel"? Doing the very same set of backups, at the same time, using different servers. I have already looked at the two backups, from v3 and v4, and compared them. There are NO differences in the exports. Same size, same content, everything identical. Definitely _eveything_ identical? In the logs you used as example previously, there were _different_ files skipped as incomplete showing up. If I start with a smaller list of files for the backup, I still see a difference. However, the difference becomes smaller. What if you start with a single file to be backed up? And/or keep the amount of files sufficiently small to be able to sum up the sizes manually to see if the total fits? Are the two servers running the same OSes? Might be far fetched, but maybe the filesystems are using different block sizes on disk? Best regards, Iosif Fettich ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] File Size Summary shows too large value for host
Hello Iosif, Just to be sure, what do you mean by "Can you check sizes in parallel"? I have already looked at the two backups, from v3 and v4, and compared them. There are NO differences in the exports. Same size, same content, everything identical. If I start with a smaller list of files for the backup, I still see a difference. However, the difference becomes smaller. Regarding my setup: BackupPC v3 and v4 are installed on different servers. Greetings Stefan Gesendet: Dienstag, 13. Dezember 2022 um 09:24 Uhr Von: "Iosif Fettich" An: "General list for user discussion, questions and support" Betreff: Re: [BackupPC-users] File Size Summary shows too large value for host Hello Stefan, > I understand that v3 and v4 work differently. However, I can also > reproduce this behavior when the two hosts have no history of backups at > all. > Starting with the first full backup, the size difference is shown. I > have other hosts where this problem does not occur, however I cannot > find the difference. That's interesting. Can you check sizes in parallel? Going from top to bottom, comparing the biggest directories first, entering the one that shows the biggest size diff, etc.? If there is a big difference, I do not really understand how you cannot find at least one particular file or dir co-responsible for that difference. It takes some time, of course, but since this happens only on some of your hosts, I suspect you can solve the mistery only by hunting this down on these affected hosts. > The affected hosts do not have particularly large sparse files, they do > not have bind mounts, no excessive number of hard links. What if you start back-ups repeatedly from scratch (and at the same time...), but increasing steadily the dirs you do backup? I'd probably start only with /home, excluding /tmp, /mnt/, /var/, ... Would you still see size differences...? Btw: what's your set-up, do you have different servers for BacupPC v3 and Backup PC v4? Thanks, Iosif Fettich ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] File Size Summary shows too large value for host
Hello Stefan, I understand that v3 and v4 work differently. However, I can also reproduce this behavior when the two hosts have no history of backups at all. Starting with the first full backup, the size difference is shown. I have other hosts where this problem does not occur, however I cannot find the difference. That's interesting. Can you check sizes in parallel? Going from top to bottom, comparing the biggest directories first, entering the one that shows the biggest size diff, etc.? If there is a big difference, I do not really understand how you cannot find at least one particular file or dir co-responsible for that difference. It takes some time, of course, but since this happens only on some of your hosts, I suspect you can solve the mistery only by hunting this down on these affected hosts. The affected hosts do not have particularly large sparse files, they do not have bind mounts, no excessive number of hard links. What if you start back-ups repeatedly from scratch (and at the same time...), but increasing steadily the dirs you do backup? I'd probably start only with /home, excluding /tmp, /mnt/, /var/, ... Would you still see size differences...? Btw: what's your set-up, do you have different servers for BacupPC v3 and Backup PC v4? Thanks, Iosif Fettich ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
