Re: [BackupPC-users] Backup fails after three days, possibly millions of files

2019-07-21 Thread Adam Goryachev
On 20/7/19 07:08, David Koski wrote: On 7/16/19 4:27 PM, Adam Goryachev wrote: On 17/7/19 4:22 am, David Koski wrote: Regards, David Koski dko...@sutinen.com On 7/8/19 6:16 PM, Adam Goryachev wrote: On 9/7/19 10:23 am, David Koski wrote: I am trying to back up about 24TB of data that has

Re: [BackupPC-users] Backup fails after three days, possibly millions of files

2019-07-19 Thread David Koski
On 7/16/19 4:27 PM, Adam Goryachev wrote: On 17/7/19 4:22 am, David Koski wrote: Regards, David Koski dko...@sutinen.com On 7/8/19 6:16 PM, Adam Goryachev wrote: On 9/7/19 10:23 am, David Koski wrote: I am trying to back up about 24TB of data that has millions of files.  It takes a day or

Re: [BackupPC-users] Backup fails after three days, possibly millions of files

2019-07-17 Thread G.W. Haywood via BackupPC-users
Hello again, On Wed, 17 Jul 2019, David Koski wrote: I suspect there are over ten million files but I don't have a good way of telling now. This indicates to me an issue more fundamental than not being able to back up a few files using BackupPC. You need to have *some* kind of a handle on

Re: [BackupPC-users] Backup fails after three days, possibly millions of files

2019-07-16 Thread Adam Goryachev
On 17/7/19 4:22 am, David Koski wrote: Regards, David Koski dko...@sutinen.com On 7/8/19 6:16 PM, Adam Goryachev wrote: On 9/7/19 10:23 am, David Koski wrote: I am trying to back up about 24TB of data that has millions of files.  It takes a day or to before it starts backing up and then

Re: [BackupPC-users] Backup fails after three days, possibly millions of files

2019-07-16 Thread David Koski
Thank you all for your input.  More information: rsync version on client: 3.0.8 (Windows) rsync version on server: 3.1.2 (Debian) BackupPC version: 3.3.1 $(Config{ClientTimeout} = 604800 I just compared the output of two verbose BackupPC_dump runs and it looks like the files are reported to be

Re: [BackupPC-users] Backup fails after three days, possibly millions of files

2019-07-10 Thread Craig Barratt via BackupPC-users
In addition to the helpful suggestions, are you sure you are not backing up any sparse or virtual files (eg, /var/log/lastlog, /proc etc)? Craig On Tue, Jul 9, 2019 at 5:43 AM G.W. Haywood via BackupPC-users < backuppc-users@lists.sourceforge.net> wrote: > Hi there, > > On Mon, 8 Jul 2019,

Re: [BackupPC-users] Backup fails after three days, possibly millions of files

2019-07-09 Thread G.W. Haywood via BackupPC-users
Hi there, On Mon, 8 Jul 2019, David Koski wrote: I am trying to back up about 24TB of data that has millions of files.? It takes a day or to before it starts backing up and then stops ... Your post is a little light on detail. BackupPC installations routinely back up that kind of data

Re: [BackupPC-users] Backup fails after three days, possibly millions of files

2019-07-08 Thread Adam Goryachev
On 9/7/19 10:23 am, David Koski wrote: I am trying to back up about 24TB of data that has millions of files.  It takes a day or to before it starts backing up and then stops with an error.  I did a CLI dump and trapped the output and can see the error message: Can't write 32780 bytes to

[BackupPC-users] Backup fails after three days, possibly millions of files

2019-07-08 Thread David Koski
I am trying to back up about 24TB of data that has millions of files.  It takes a day or to before it starts backing up and then stops with an error.  I did a CLI dump and trapped the output and can see the error message: Can't write 32780 bytes to socket Read EOF: Connection reset by peer