Hello, In one of my last posts I described our new backup system. It has 22TB netto storage capacity and it is storing backups for 64 hosts of which only six have a size of slightly over 100GB. Nearly all hosts are Debian Webservers (Jessie and Stretch), so there should be a lot of shared files in the pool. The average host has a size of around 30GB. I checked the system after the weekend and was shocked to see that 16 of the 22TB had been filled in the last couple of days! I still believe that there must be something that is not running as it should. Our old BackupPC 3 server ran for 1600 days with a 2TB drive and stored about 2/3 of the hosts now on the new server. A lot of the data was long- term-backups, which have not yet been saved on the new host. I can't believe that there has been such a huge loss of efficiency between the version. How do you interpret the data which now follows?
Im going to show you the output of the graphs and backuppc itself and then will show the example of one anonymized host. As I said before, df shows 16 of 22TB in use. Status: Pool is 1921.51GiB comprising 7898759 files and 16512 directories (as of 2019-05-12 01:03), Pool file system was recently at 78% (2019-05-13 17:20), today's max is 78% (2019-05-13 16:47) and yesterday's max was 52%. BackPC Pool Size according to the Graphs. CPool V4 in bytes: Maximum 2,49T Prior to pooling and compression: Maximum 10,69T Host Summary: 86 full backups of total size 1783.47GiB (prior to pooling and compression), 382 incr backups of total size 9098.42GiB (prior to pooling and compression). What follows is the sanitized output of one of the larger hosts Backup# Type Filled Level Start Date Duration/mins Age/day s Server Backup Path 1 incr no 1 2019-05-01 22:05 23.4 11.8 /var/lib/backuppc/pc/XXX.netfed.de/1 2 incr no 1 2019-05-02 22:00 5.3 10.8 /var/lib/backuppc/pc/XXX.netfed.de/2 3 incr no 1 2019-05-03 22:00 7.5 9.8 /var/lib/backuppc/pc/XXX.netfed.de/3 4 incr no 1 2019-05-04 22:00 7.0 8.8 /var/lib/backuppc/pc/XXX.netfed.de/4 5 incr no 1 2019-05-05 22:00 10.8 7.8 /var/lib/backuppc/pc/XXX.netfed.de/5 6 incr no 1 2019-05-06 22:00 6.8 6.8 /var/lib/backuppc/pc/XXX.netfed.de/6 7 full yes 0 2019-05-08 00:30 778.8 5.7 /var/lib/backuppc/pc/XXX.netfed.de/7 8 incr yes 1 2019-05-09 02:53 23.9 4.6 /var/lib/backuppc/pc/XXX.netfed.de/8 Totals Existing Files New Files Backup# Type #Files Size/MiB MiB/sec #Files Size/MiB #Files Size/MiB 1 incr 2339383 80193.3 57.04 16 16.4 25 3074.3 2 incr 2339355 80232.3 253.10 30 5.5 162 4091.2 3 incr 2339395 80299.5 178.05 39 21.5 169 4239.5 4 incr 2339398 80331.2 190.36 35 18.7 91 4132.5 5 incr 2339394 80362.6 123.44 25 1.2 90 4175.8 6 incr 2339381 80395.0 195.61 32 11.3 155 4217.8 7 full 2339423 80582.6 1.72 13 10.6 231 4403.7 8 incr 2339467 80603.5 56.17 16 0.0 90 3273.1 Existing Files New Files Backup# Type Comp Level Size/MiB Comp/MiB Comp Size/MiB Comp/MiB Comp 1 incr 3 16.4 5.4 67.1% 3074.3 280.1 90.9% 2 incr 3 5.5 2.2 60.1% 4091.2 437.2 89.3% 3 incr 3 21.5 7.3 66.0% 4239.5 509.1 88.0% 4 incr 3 18.7 6.6 64.7% 4132.5 428.8 89.6% 5 incr 3 1.2 1.2 5.3% 4175.8 435.8 89.6% 6 incr 3 11.3 4.3 61.8% 4217.8 447.4 89.4% 7 full 3 10.6 3.8 64.2% 4403.7 535.0 87.9% 8 incr 3 0.0 0.0 51.5% 3273.1 273.8 91.6% Yours sincerely Stefan Schumacher Stefan Schumacher Systemadministrator NetFederation GmbH Sürther Hauptstraße 180 B - Fon: +49 (0)2236/3936-701 E-Mail: stefan.schumac...@net-federation.de Internet: http://www.net-federation.de Besuchen Sie uns doch auch auf facebook, twitter, Google+, flickr, Slideshare, XING oder unserem Blog. Wir freuen uns! ******************************************************************* Unser MR Benchmark 2019 ist erschienen! ******************************************************************* Wer hat das beste Media Center und wie sieht die digitale Pressearbeit bei großen Unternehmen insgesamt aus? Die Ergebnisse und das Ranking finden Sie in unserem neuen MR Benchmark unter: https://www.mr-benchmark.de/media-relations-benchmark-2019/benchmark ***************************************************** NetFederation GmbH Geschäftsführung: Christian Berens, Thorsten Greiten Amtsgericht Köln, HRB Nr. 32660 ***************************************************** The information in this e-mail is confidential and may be legally privileged. It is intended solely for the addressee and access to the e-mail by anyone else is unauthorised. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. If you have received this e-mail in error please forward to: post...@net-federation.de Die in dieser E-Mail enthaltenen Informationen sind vertraulich und können von rechtlicher Bedeutung sein. Diese Mail ist ausschließlich für den Adressaten bestimmt und jeglicher Zugriff durch andere Personen ist nicht zulässig. Falls Sie nicht der beabsichtigte Empfänger sind, ist jegliche Veröffentlichung, Vervielfältigung, Verteilung oder sonstige in diesem Zusammenhang stehende Handlung untersagt und unter Umständen ungesetzlich. Falls Sie diese E-Mail irrtümlich erhalten haben, leiten Sie sie bitte weiter an: post...@net-federation.de _______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
