[BackupPC-users] Whats wrong - missing files and folders
Hi, i have BBC 4.4.0 under Debian running. I noticed that some files and folders on one debian machine wasnt backuped. I checked the config, but i cant find the error. Perhaps someone can help. I want to backup all files and folders under /etc/pve/ but the directory /etc/pve is empty in the backup. Thats the content which are note backuped: 0 drwxr-xr-x 2 root www-data0 Jan 1 1970 . 4,0K drwxr-xr-x 99 root root 4,0K Jun 11 16:03 .. 512 -rw-r- 1 root www-data 451 Jun 11 21:06 authkey.pub 512 -rw-r- 1 root www-data 451 Jun 11 21:06 authkey.pub.old 0 -r--r- 1 root www-data 9,7K Jan 1 1970 .clusterlog 512 -rw-r- 1 root www-data 561 Apr 24 2020 corosync.conf 512 -rw-r- 1 root www-data 13 Feb 21 2019 datacenter.cfg 0 -rw-r- 1 root www-data2 Jan 1 1970 .debug 0 drwxr-xr-x 2 root www-data0 Sep 11 2020 ha 0 lrwxr-xr-x 1 root www-data0 Jan 1 1970 local -> nodes/proxsrv05 0 lrwxr-xr-x 1 root www-data0 Jan 1 1970 lxc -> nodes/proxsrv05/lxc 0 -r--r- 1 root www-data 325 Jan 1 1970 .members 0 drwxr-xr-x 2 root www-data0 Feb 21 2019 nodes 0 lrwxr-xr-x 1 root www-data0 Jan 1 1970 openvz -> nodes/proxsrv05/openvz 0 drwx-- 2 root www-data0 Feb 21 2019 priv 512 -rw-r- 1 root www-data 2,1K Feb 21 2019 pve-root-ca.pem 512 -rw-r- 1 root www-data 1,7K Feb 21 2019 pve-www.key 0 lrwxr-xr-x 1 root www-data0 Jan 1 1970 qemu-server -> nodes/proxsrv05/qemu-server 0 -rw-r- 1 root www-data0 Apr 21 11:20 replication.cfg 0 -r--r- 1 root www-data 2,7K Jan 1 1970 .rrd 0 drwxr-xr-x 2 root www-data0 Sep 11 2020 sdn 512 -rw-r- 1 root www-data 446 Apr 21 14:23 storage.cfg 512 -rw-r- 1 root www-data 40 Feb 21 2019 user.cfg 0 -r--r- 1 root www-data 899 Jan 1 1970 .version 0 drwxr-xr-x 2 root www-data0 Mai 31 2020 virtual-guest 0 -r--r- 1 root www-data 838 Jan 1 1970 .vmlist 512 -rw-r- 1 root www-data 120 Apr 21 11:20 vzdump.cron This is the exclusion list: /app* /boot* /bin* /dev* /lib* /lib32* /lib64* /lost+found* /mnt* /proc* /run* /sbin* /srv* /sys* /tmp* /usr/bin* /usr/games* /usr/include* /usr/lib* /usr/lib32/ /usr/sbin* /usr/share* /usr/src* /var/backup* /var/backups* /var/cache* /var/lib/docker* /var/lib/mysql* /var/log/lastlog /var/run* /var/tmp* /var/www/**/cache /var/www/**/tmp I use rsync as root user. Do you have any idea why files and folders are missing under /etc/pve? thx Taste ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] BackupPC 4.4.0: Incremental smb backup is skipping not backed-up files under certain conditions
On Fri, Jun 11, 2021 at 8:38 AM Michael Stowe wrote: > It is worth poking at the contention that "an incremental backup with rsyncd > unfortunately takes as long as the full backup." This probably isn't true, > but I can understand how one can believe this after running a single > incremental backup with rsyncd. How does rsyncd know what to copy > incrementally? It skips files that are already copied ... of which, there > are none for your first incremental backup. If the files are mostly tiny, you can see how rsync's action of exchanging the directory information needed to determine existing/changed status would be almost as much work as updating the files. > If your *second* incremental backup takes almost as long as the full backup, > we'll need more details, as your configuration is deviating significantly > from expectations. I think I recall something about the third rsync backup getting a speedup too, where the block checkums are saved on the 2nd run after a file has been copied. Not sure if that still applies to v4. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] BackupPC 4.4.0: Incremental smb backup is skipping not backed-up files under certain conditions
On 2021-05-26 07:01, Jens Potthast wrote: Hi, My Problem: When doing an incremental backup with smb, only files with mtime newer than the date and time of the last backup are being backed up. To reproduce: If I copy a file with an old ctime, the file is not included in the backup even if it is not contained in the previous complete backup. Only the timestamp of the mtime seems to be relevant - even if the file is not present in any backup so far. I am not sure, if this behavior is intended or if I have misconfigured smb backup settings. The problem would be solved with the next complete backup. However, due to my circumstances, I can rarely do a full backup. And only with rsyncd, because smbclient aborts after a while, because I have to backup lots of files (> 1.000.000), which takes usually more than a day. (However, not due to configurable time limits, which I extended generously.) An incremental backup with rsyncd unfortunately takes almost as long as the full backup, so I need to do the incremental backups with smbclient. This takes only minutes (with only a few changed files), but misses new files with an old date. Any help is greatly appreciated! Regards, Jens You're describing a limitation of using SMB. Considering it for a moment, one can ask SMB to retrieve files modified beyond a certain time, but SMB does not have a command that says, "send along any files that weren't there at a certain point in the past." How would SMB know the files weren't there? How would one implement such a command using SMB? By retrieving all files, and comparing to a previous backup... which is also known as a full backup. It is worth poking at the contention that "an incremental backup with rsyncd unfortunately takes as long as the full backup." This probably isn't true, but I can understand how one can believe this after running a single incremental backup with rsyncd. How does rsyncd know what to copy incrementally? It skips files that are already copied ... of which, there are none for your first incremental backup. If your *second* incremental backup takes almost as long as the full backup, we'll need more details, as your configuration is deviating significantly from expectations.___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
[BackupPC-users] Difference between BackupPC 4.4.0 data usage and disk space.
Hi, I lost half my disk capacity? Or is there something else? I'm running BackupPC 4.4.0 now with around 100 clients to be backupped via rsync. At the moment only pool v4 is active. Status page says for several months, this kind of figures: Pool is 4152.10GiB comprising 20752385 files and 12384 directories (as of 2021-06-11 03:09), But disk is: Filesystem Size Used Avail Use% Mounted on /dev/mapper/loods4--vg-home 9.7T 9.4T 352G 97% /var/lib/backuppc And: --- /var/lib/backuppc 9.1TiB [##] /cpool I did a ncdu scan and the storage seems to be distributed over the folders in cpool and not 1 folder is an obvious problem. I really would like to recover the 4TB of lost space (or be sure the correct usage is 9.4T then I know to add disks. Met vriendelijke groet, Micha Kersloot [ https://www.kovoks.nl/ ] [ https://www.kovoks.nl/e-mail ] [ https://www.kovoks.nl/ | www.kovoks.nl ] | [ https://www.zimbra-nederland.nl/ | www.zimbra-nederland.nl ] | Volg [ http://twitter.com/kovoks | @kovoks ] op Twitter E [ mailto:mi...@kovoks.nl"; | mi...@kovoks.nl ] T [ tel:+31 (0)345 - 53 29 27 | +31 (0)345 - 53 29 27 ] / 0345 - 53 29 27 A [ https://goo.gl/maps/MrqmTv442tH2 | Belle van Zuylenlaan 1-5 ] | [ https://goo.gl/maps/MrqmTv442tH2 | 4105 JX Culemborg ] KvK 1104 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
