Gandalf-
Sounds like you need a bigger backup server.
BackupPC keeps the tranfer logs compressed, even the most recent one.
Typical log sizes for my largest host (768GB, 6.7 Million files) which
also has a significant amount of churn. You can see that the Full, (backup
65) even compressed, the log was huge. There are monthly logs kept for
activity, and a per backup log for transfers. This server also is limited
to running tar as the Xfer method, which are Extremely chatty compared to
the Rsync based transfer logs.
This server is my worst case scenario.
-rw-r-----. 1 backuppc backuppc 26K May 31 01:45 LOG.052017.z
-rw-r-----. 1 backuppc backuppc 1.5K Jun 30 22:27 LOG.062017.z
-rw-r-----. 1 backuppc backuppc 39M Jul 31 03:38 LOG.072017.z
-rw-r-----. 1 backuppc backuppc 18M Sep 1 00:02 LOG.082017.z
-rw-r-----. 1 backuppc backuppc 0 Sep 1 01:14 LOG.092017
drwxr-x---. 2 backuppc backuppc 16K Sep 1 00:03 refCnt
-rw-r-----. 1 backuppc backuppc 2.3M Jul 3 22:33 XferLOG.35.z
-rw-r-----. 1 backuppc backuppc 2.2M Jul 17 23:39 XferLOG.49.z
-rw-r-----. 1 backuppc backuppc 2.2M Jul 31 03:40 XferLOG.62.z
-rw-r-----. 1 backuppc backuppc 2.3M Aug 1 04:07 XferLOG.63.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 2 04:23 XferLOG.64.z
-rw-r-----. 1 backuppc backuppc 41M Aug 3 12:22 XferLOG.65.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 4 20:29 XferLOG.66.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 5 20:31 XferLOG.67.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 6 20:46 XferLOG.68.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 7 21:00 XferLOG.69.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 8 20:57 XferLOG.70.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 9 20:57 XferLOG.71.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 10 21:04 XferLOG.72.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 11 23:27 XferLOG.73.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 12 22:23 XferLOG.74.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 13 22:21 XferLOG.75.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 14 22:23 XferLOG.76.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 15 22:22 XferLOG.77.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 16 22:23 XferLOG.78.z
-rw-r-----. 1 backuppc backuppc 2.3M Aug 17 22:25 XferLOG.79.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 18 23:02 XferLOG.80.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 19 22:20 XferLOG.81.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 20 22:21 XferLOG.82.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 21 22:23 XferLOG.83.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 22 22:22 XferLOG.84.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 23 22:22 XferLOG.85.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 24 22:24 XferLOG.86.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 25 23:07 XferLOG.87.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 26 23:23 XferLOG.88.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 27 23:44 XferLOG.89.z
-rw-r-----. 1 backuppc backuppc 2.3M Aug 28 23:48 XferLOG.90.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 29 23:46 XferLOG.91.z
-rw-r-----. 1 backuppc backuppc 2.2M Aug 30 23:45 XferLOG.92.z
-rw-r-----. 1 backuppc backuppc 2.2M Sep 1 00:03 XferLOG.93.z
A more typical server (220GB, 3 Million files, less churn.): This server
uses RSYNC transfers, note that the full backup (#72) log is not noticeably
larger than the incremental logs.
-rw-r-----. 1 backuppc backuppc 1.2K May 31 01:06 LOG.052017.z
-rw-r-----. 1 backuppc backuppc 1.5K Jun 30 22:13 LOG.062017.z
-rw-r-----. 1 backuppc backuppc 40M Jul 31 02:29 LOG.072017.z
-rw-r-----. 1 backuppc backuppc 41M Aug 31 21:23 LOG.082017.z
-rw-r-----. 1 backuppc backuppc 0 Sep 1 01:13 LOG.092017
drwxr-x---. 2 backuppc backuppc 16K Aug 31 21:23 refCnt
-rw-r-----. 1 backuppc backuppc 15K Jul 4 22:13 XferLOG.42.z
-rw-r-----. 1 backuppc backuppc 26K Jul 18 23:37 XferLOG.56.z
-rw-r-----. 1 backuppc backuppc 9.3K Jul 31 02:30 XferLOG.68.z
-rw-r-----. 1 backuppc backuppc 9.1K Aug 1 02:42 XferLOG.69.z
-rw-r-----. 1 backuppc backuppc 52K Aug 2 02:54 XferLOG.70.z
-rw-r-----. 1 backuppc backuppc 9.8K Aug 3 04:34 XferLOG.71.z
-rw-r-----. 1 backuppc backuppc 35K Aug 4 20:54 XferLOG.72.z
-rw-r-----. 1 backuppc backuppc 9.0K Aug 5 20:04 XferLOG.73.z
-rw-r-----. 1 backuppc backuppc 9.3K Aug 6 19:32 XferLOG.74.z
-rw-r-----. 1 backuppc backuppc 9.3K Aug 7 19:32 XferLOG.75.z
-rw-r-----. 1 backuppc backuppc 12K Aug 8 19:34 XferLOG.76.z
-rw-r-----. 1 backuppc backuppc 9.9K Aug 9 19:30 XferLOG.77.z
-rw-r-----. 1 backuppc backuppc 9.3K Aug 10 19:31 XferLOG.78.z
-rw-r-----. 1 backuppc backuppc 9.7K Aug 11 20:25 XferLOG.79.z
-rw-r-----. 1 backuppc backuppc 9.1K Aug 12 20:01 XferLOG.80.z
-rw-r-----. 1 backuppc backuppc 9.2K Aug 13 19:33 XferLOG.81.z
-rw-r-----. 1 backuppc backuppc 9.7K Aug 14 19:32 XferLOG.82.z
-rw-r-----. 1 backuppc backuppc 63K Aug 15 19:32 XferLOG.83.z
-rw-r-----. 1 backuppc backuppc 16K Aug 16 19:32 XferLOG.84.z
-rw-r-----. 1 backuppc backuppc 14K Aug 17 19:43 XferLOG.85.z
-rw-r-----. 1 backuppc backuppc 13K Aug 18 20:24 XferLOG.86.z
-rw-r-----. 1 backuppc backuppc 7.4K Aug 19 20:26 XferLOG.87.z
-rw-r-----. 1 backuppc backuppc 7.3K Aug 20 20:02 XferLOG.88.z
-rw-r-----. 1 backuppc backuppc 7.6K Aug 21 20:05 XferLOG.89.z
-rw-r-----. 1 backuppc backuppc 54K Aug 22 20:03 XferLOG.90.z
-rw-r-----. 1 backuppc backuppc 8.4K Aug 23 20:03 XferLOG.91.z
-rw-r-----. 1 backuppc backuppc 16K Aug 24 20:09 XferLOG.92.z
-rw-r-----. 1 backuppc backuppc 1.4M Aug 25 21:26 XferLOG.93.z
-rw-r-----. 1 backuppc backuppc 7.4K Aug 26 21:53 XferLOG.94.z
-rw-r-----. 1 backuppc backuppc 7.1K Aug 27 21:21 XferLOG.95.z
-rw-r-----. 1 backuppc backuppc 7.5K Aug 28 21:24 XferLOG.96.z
-rw-r-----. 1 backuppc backuppc 7.5K Aug 29 21:23 XferLOG.97.z
-rw-r-----. 1 backuppc backuppc 7.7K Aug 30 21:23 XferLOG.98.z
-rw-r-----. 1 backuppc backuppc 12K Aug 31 21:23 XferLOG.99.z
On Fri, Sep 1, 2017 at 10:53 AM, Gandalf Corvotempesta <
gandalf.corvotempe...@gmail.com> wrote:
> 2017-09-01 18:50 GMT+02:00 Les Mikesell <lesmikes...@gmail.com>:
> > Large, changing files can be a problem, but log files tend to be
> > highly compressible.
>
> rotated log files are already compressed by the client.
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki: http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
--
Time flies like an arrow, but fruit flies like a banana.
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
