[BackupPC-users] md4 doesn't match: will retry in phase 1;
Hello, I'm running BackupPC-3.3.1-1.el6, and I'm seeing an issue with large files on a host. daily_app_beta.sql.gz: md4 doesn't match: will retry in phase 1; file removed daily_zabbix.sql.gz: md4 doesn't match: will retry in phase 1; file removed These files are generated daily, with the first being 20G and the second being 1G. I've ensured that the cron job that creates them is run (and completed) hours before BackupPC is run, so I know the files aren't changing. The files do succeed on the retry, but transferring 21G twice means that my backup takes twice as long as needed. I've done a bunch of googling, and found many people with the same issue, and one in particular caught my eye. They said the problem only occurred when the files in question were in a second share, which is also my case. Suggestions appreciated. Robert -- Senior Software Engineer @ Parsons pgpiJbU77cwHH.pgp Description: OpenPGP digital signature -- Attend Shape: An AT Tech Expo July 15-16. Meet us at AT Park in San Francisco, CA to explore cutting-edge tech and listen to tech luminaries present their vision of the future. This family event has something for everyone, including kids. Get more information and register today. http://sdm.link/attshape___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Full period
Hi, Adam Goryachev wrote on 2016-06-21 20:17:43 +1000 [Re: [BackupPC-users] Full period]: > On 21/06/2016 17:28, absolutely_f...@libero.it wrote: > > [...] > > I noticed that I am unable to complete backups for each server in one > > day; probably it takes 3 days to finish. > > [...] > > > > Is there a way to configure BackupPC to run Full backup every X > > backups (and NOT every X days)? have you understood the concept of full and incremental backups? Is your requirement really "I need every Xth backup to be exact, no matter how far in time they are appart, and need to trade exactness for speed in between"? > > I think that probably I'll save some bandwidth, am I wrong? Yes, quite the opposite, if you are using rsync(d) (and if not, you probably should be). > Why does the backup take so long? Is it bandwidth between the two > machines or something else? You have a good point here. From the data given - none - we can't even begin to guess whether the long backup times are a flaw in design or in implementation. Very, very likely, backups *shouldn't* be taking 3 days to finish. I don't know what you are backing up, but apparently it is not exactly close to static. A three day duration backup won't give you anything even close to a consistent snapshot of your backup set (unless you are using file system snapshots, obviously). Are the backup times plausible for the amount of data? Should you be splitting your backups between multiple BackupPC servers? I'd suggest fixing the issue rather than trying to awkwardly work around it. > [...] > Other than that, I don't think there is any way to automatically do more > incrementals, short of increasing the FullPeriod to a higher value I should hope there isn't ;-). Increasing the FullPeriod makes sense, because it corresponds to a *common* requirement: I need a precise reference point every N days (e.g. once a month). Of course, *in BackupPC*, a full backup is also a backup I can keep for a long time. I can't do that with a BackupPC incremental. Hope that helps. Regards, Holger -- Attend Shape: An AT Tech Expo July 15-16. Meet us at AT Park in San Francisco, CA to explore cutting-edge tech and listen to tech luminaries present their vision of the future. This family event has something for everyone, including kids. Get more information and register today. http://sdm.link/attshape ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Full period
On 21/06/2016 17:28, absolutely_f...@libero.it wrote:
> Hi,
>
> currently I have default value for:
>
> $Conf{FullPeriod} = '6.97';
> $Conf{IncrPeriod} = '0.97';
>
> I noticed that I am unable to complete backups for each server in one
> day; probably it takes 3 days to finish.
> So, I have this situation (let's say this is backup list for ONE server)
>
> day1: full backup
> day2: nothing
> day3: nothing
> day4: nothing
> day5: incremental
> day6: nothing
> day7: another full backup
>
> Is there a way to configure BackupPC to run Full backup every X
> backups (and NOT every X days)?
> I think that probably I'll save some bandwidth, am I wrong?
>
What method are you using to do the backup?
Why does the backup take so long? Is it bandwidth between the two
machines or something else?
Potentially, using rsync or rsyncd will reduce the time to complete a
backup, produce more accurate backups, and also reduce bandwidth
consumption. Result is more backups, so better ability to restore
if/when needed.
Other than that, I don't think there is any way to automatically do more
incrementals, short of increasing the FullPeriod to a higher value
PS, I assume day6 is nothing because even the incremental took 2 days to
complete
Regards,
Adam
Regards,
Adam
--
Attend Shape: An AT Tech Expo July 15-16. Meet us at AT Park in San
Francisco, CA to explore cutting-edge tech and listen to tech luminaries
present their vision of the future. This family event has something for
everyone, including kids. Get more information and register today.
http://sdm.link/attshape
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
[BackupPC-users] Full period
Hi,
currently I have default value for:
$Conf{FullPeriod} = '6.97';
$Conf{IncrPeriod} = '0.97';
Other parameters:
$Conf{FullKeepCnt} = [ '2' ];$Conf{FullKeepCntMin} = '2';
$Conf{FullAgeMax} = '15';
$Conf{IncrKeepCnt} = '6';
$Conf{IncrAgeMax} = '15';
I noticed that I am unable to complete backups for each server in one day;
probably it takes 3 days to finish.So, I have this situation (let's say this is
backup list for ONE server)
day1: full backupday2: nothingday3: nothingday4: nothingday5: incrementalday6:
nothingday7: another full backup
Is there a way to configure BackupPC to run Full backup every X backups (and
NOT every X days)?I think that probably I'll save some bandwidth, am I
wrong?Thank you very much!
--
Attend Shape: An AT Tech Expo July 15-16. Meet us at AT Park in San
Francisco, CA to explore cutting-edge tech and listen to tech luminaries
present their vision of the future. This family event has something for
everyone, including kids. Get more information and register today.
http://sdm.link/attshape___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
