On 6/5/19 21:40, Stefan Schumacher wrote:
Hello, I have a new backup-server - this time using a classic RAID setup without ZFS and with much, much more storage (22TB Netto). I added the hosts to backup last week on Thursday and just now checked the logs. It seems that the Nightly Clean does not remove any duplicate files. These are the relevant lines: 2019-05-06 01:02:57 Pool nightly clean removed 0 files of size 0.00GB 2019-05-06 01:02:57 Pool is 0.00GB, 0 files (0 repeated, 0 max chain, 0 max links), 0 directories 2019-05-06 01:02:57 Cpool nightly clean removed 0 files of size 0.00GB 2019-05-06 01:02:57 Cpool is 0.00GB, 0 files (0 repeated, 0 max chain, 0 max links), 0 directories 2019-05-06 01:02:57 Pool4 nightly clean removed 0 files of size 0.00GB 2019-05-06 01:02:57 Pool4 is 0.00GB, 0 files (0 repeated, 0 max chain, 0 max links), 0 directories 2019-05-06 01:02:57 Cpool4 nightly clean removed 0 files of size 0.00GB 2019-05-06 01:02:57 Cpool4 is 1948.57GB, 8107866 files (0 repeated, 0 max chain, 1842328 max links), 16512 directories I have checked the older logs and there is no instance in which nightly clean removed any files at all. The only thing shown in the logs is cpool4 growing to a size of nearly 2TB in less than a week. Am I correct in assuming that nightly deduplication is not working as it should? How can I fix this? At this speed even the new server will fill up in an inaceptably short amount of time.
The nightly clean will only remove files that no longer exist in any backup that needs to be saved. If the server has only just started backing up the hosts, then I would assume your retention period is longer than a week, therefore there are no old backups to expire, and even if there were, possibly no files have been deleted from the clients in that time and hence, there is nothing to remove.
It would be expected that initial backups would use significantly more data (per day) as the first backup of each server is completed. Later, once the number of saved backups is at the maximum (ie, each daily backup results in an old backup being removed) you should see disk space required is relatively stable, with slow growth (because users always use more and more disk over time).
What is the total size of all your clients used disk space? If that is around 2TB then there is clearly nothing to worry about.
Regards, Adam _______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/