In addition to the helpful suggestions, are you sure you are not backing up any sparse or virtual files (eg, /var/log/lastlog, /proc etc)?
Craig On Tue, Jul 9, 2019 at 5:43 AM G.W. Haywood via BackupPC-users < backuppc-users@lists.sourceforge.net> wrote: > Hi there, > > On Mon, 8 Jul 2019, David Koski wrote: > > > I am trying to back up about 24TB of data that has millions of files.? > > It takes a day or to before it starts backing up and then stops ... > > Your post is a little light on detail. > > BackupPC installations routinely back up that kind of data volume. > > My own systems are relatively smaller. At my place of business I have > for example a dozen Linux hosts and about 14TB backed up nightly using > BackupPC V4. An incremental backup takes between a couple of minutes > and 20 or 25 minutes, depending on machine. Anything between a couple > of hundred thousand to a million files. For the machine with the most > data to be backed up, a full can take 6 - 7 hours. Most of these are > fairly capable machines with 6GB/s SATA disc (no RAID), 1Gb/s network. > > In a case like yours I'd try to use the Razor technique, which means > try to split the job into smaller pieces. There are many ways to do > it but without more information from you I hesitate. The performance > of a filesystem can leave something to be desired when an individual > directory can contain hundreds of thousands or millions of files, but > it very much depends on the filesystem. > > HTH > > -- > > 73, > Ged. > > > _______________________________________________ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ >
_______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
