Craig - agree with your perspective... and would welcome any user who is willing to contribute code that extends your fantastic backup software...
Craig Barratt via BackupPC-users wrote at about 12:20:13 -0700 on Monday, August 31, 2020: > I've tried to suggest a couple of reasons that could explain what you are > seeing, based on very incomplete information. > > Without you confirming what the issue actually is, your conclusion is > already that it's "absolutely buggy" and "useless". To pick another > example, rsync -aHv will also report a total file size that is the sum of > the hardlink file sizes, and it also reports the actual bytes transferred > and the speedup. So by your logic, does that mean rsync is also > "absolutely buggy" and "useless"? > > I'd recommend you actually understand the issue, and then decide what the > best options are. > > If your question is "is there a reasonable way to potion pool usage among > backup clients?" you are asking a question that doesn't have a simple > answer, because of hardlinks on the clients and pooling among all the > clients. > > That said, it wouldn't be too hard to write a script that reads the > reference counts for a client (which includes all the backups for that > client), and apportioning the pool file sizes to that client based on the > ratio of its own reference count to the total pool reference count for each > pool file. But that's just one way of doing it. And commercial > auditing/billing tools are well out of scope for BackupPC, but you are most > welcome to contribute anything you develop. > > Craig > > On Mon, Aug 31, 2020 at 9:38 AM Ján ONDREJ (SAL) <ondr...@salstar.sk> wrote: > > > Hello, > > > > thanks for explanation, but how I can check in backuppc, which user > > uses how much disk space of my backuppc storage? This way File Size counter > > is absolutelly buggy. > > > > I need to check, which backup uses most of my space and need to find, > > where I should exclude more files. But there is no information, which > > I can use. New files are only new files, doesn't count how much files > > there are. In Total files hardlinked files are counter multiple times, > > which ends in 10x more space usage in this counter like it's real. > > > > This way total files counter is useless, only useful for windows users, > > which don't use hardlinks. > > > > SAL > > > > On Mon, Aug 31, 2020 at 09:09:02AM -0700, Craig Barratt via BackupPC-users > > wrote: > > > That file is a hardlink, not a symlink. In the backup stats, each > > instance > > > of a hardlink is counted towards the total file size. > > > > > > If your file system has a lot of hardlinks, perhaps that's why the > > reported > > > number is higher than you expect? > > > > > > Craig > > > > > > On Mon, Aug 31, 2020 at 12:40 AM Ján ONDREJ (SAL) <ondr...@salstar.sk> > > > wrote: > > > > > > > Hello, > > > > > > > > On Mon, Aug 31, 2020 at 12:08:50AM -0700, Craig Barratt via > > BackupPC-users > > > > wrote: > > > > > Does your backup include sparse files? > > > > > > > > I think no. > > > > > > > > > Look in the XferLOG file to see the sizes of individual files - it > > > > > shouldn't be too hard to spot one that is large. > > > > > > > > There is no one large file. As I wrote, restored backup is not so large > > > > too. > > > > But you pointed me to right plate. I see this line in XferLOG: > > > > > > > > new recv hf..tpog... rw-r--r-- 1000, 1000 25089367 > > > > var/www/public/media/598522/catalogue.pdf => > > > > var/www/private/import/docs/catalogue.pdf > > > > > > > > This is a symlink and it's size is counted as 25089367. > > > > According to "=>" symbol, this symlink is properly identified as > > symlink, > > > > but it's size is stored as symlinks target file. This is why backup > > > > size is larger than my filesystem. Can this be fixed? > > > > > > > > SAL > > > > > > > > > On Sun, Aug 30, 2020 at 11:51 PM Ján ONDREJ (SAL) < > > ondr...@salstar.sk> > > > > > wrote: > > > > > > > > > > > Hello, > > > > > > > > > > > > I am using BackupPC for years, but after update to v4 (4.4.0), > > some > > > > > > backups have inconsistent size dislayed in "File Size/Count Reuse > > > > Summary" > > > > > > table. > > > > > > > > > > > > This is my servers directory, which should be in backup: > > > > > > > > > > > > Filesystem Size Used Avail Use% Mounted on > > > > > > /dev/md0 4.0G 3.0G 1.1G 75% / > > > > > > /dev/mapper/vg_server-www 200G 119G 82G 60% /var/www > > > > > > > > > > > > There is no other filesystem mounted, binded to this directory. > > > > > > > > > > > > It's complete size is 200 GB, used only 118 GB. Some files are > > excluded > > > > > > from > > > > > > backup, so an full backup should be about 120 GB uncompressed, > > after > > > > > > compression less. But our File Size table looks like: > > > > > > > > > > > > Totals Existing Files New > > Files > > > > > > Backup# Type #Files Size/MiB MiB/sec #Files Size/MiB #Files > > > > Size/MiB > > > > > > 0 full 3220584 943488.6 26.86 2625461 872577.7 1232 > > 537.4 > > > > > > > > > > > > As you see, this backup total size is 921 GiB. How it's possible, > > that > > > > > > an 200 GB partition is stored as 900 GB? > > > > > > Also according to i-nodes in linux, my server has: > > > > > > > > > > > > Filesystem Inodes IUsed IFree IUse% > > Mounted on > > > > > > /dev/md0 4194240 51082 4143158 2% / > > > > > > /dev/mapper/vg_fusion-www 209715200 2470434 207244766 2% > > /var/www > > > > > > > > > > > > So there is 2.5 millions of files, some excluded, but results as > > 3.2 > > > > > > millions > > > > > > on backup. > > > > > > > > > > > > Trying to restore files. Restore downloaded a 68GB tar package. > > > > > > This looks to be real, but if there are only 70 GB of data, why on > > > > backuppc > > > > > > status it's displayed as 900 GB? > > > > > > > > > > > > I need to find, which server is using most of my backup space. > > > > > > I know, that it's hard to find, because files are shared between > > > > servers > > > > > > (deduplicated), but at least I can estimate it. But if there are > > > > multiples > > > > > > of usage displayed in statistics, then it's impossible to > > aproximate. > > > > > > > > > > > > I deleted all backups of this server, in hope, that it helps, but > > > > don't. > > > > > > :-( > > > > > > > > > > > > Thank for help. > > > > > > > > > > > > SAL > > > > > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > > > BackupPC-users mailing list > > > > > > BackupPC-users@lists.sourceforge.net > > > > > > List: > > https://lists.sourceforge.net/lists/listinfo/backuppc-users > > > > > > Wiki: https://github.com/backuppc/backuppc/wiki > > > > > > Project: https://backuppc.github.io/backuppc/ > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > > BackupPC-users mailing list > > > > > BackupPC-users@lists.sourceforge.net > > > > > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > > > > > Wiki: https://github.com/backuppc/backuppc/wiki > > > > > Project: https://backuppc.github.io/backuppc/ > > > > > > > > > > > > > > > > _______________________________________________ > > > > BackupPC-users mailing list > > > > BackupPC-users@lists.sourceforge.net > > > > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > > > > Wiki: https://github.com/backuppc/backuppc/wiki > > > > Project: https://backuppc.github.io/backuppc/ > > > > > > > > > > > _______________________________________________ > > > BackupPC-users mailing list > > > BackupPC-users@lists.sourceforge.net > > > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > > > Wiki: https://github.com/backuppc/backuppc/wiki > > > Project: https://backuppc.github.io/backuppc/ > > > > > _______________________________________________ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ _______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
