Re: [BackupPC-users] BPC 4 very slow

[Gandalf Corvotempesta]

2016-01-27 22:50 GMT+01:00 Les Mikesell :
> And yet, other people who haven't made your changes don't see that
> issue.  I don't know why it would happen but I wonder if your
> FullPeriod is somehow getting parsed as 2.

I had this:

$Conf{FullPeriod} = 27.97;

now changed to

$Conf{FullPeriod} = 7.97;

just in case bpc was parsing only the first digit.

--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] BPC 4 very slow

[Gandalf Corvotempesta]

2016-01-26 22:58 GMT+01:00 Gandalf Corvotempesta
:
> Let's see what happens this night.

Still another full is running. (obviously, there are no full in the
pool, as BPC is removing previous backups on every run)

It makes a full, then the day after it makes an incremental and
removed the previous full. After that, the next backup would
be another full (as there are no more full available). And so on

--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] BPC 4 very slow

[Holger Parplies]

Gandalf Corvotempesta wrote on 2016-01-27 11:28:24 +0100 [Re: [BackupPC-users] 
BPC 4 very slow]:
> [basically the same thing over and over again]

In case it's not obvious, adjust the settings so they specify to do what you
want. Before that, preferably, understand the settings. Use the suitable tool
for your purpose. You keep repeating that you get no advantage from pooling,
because all your files constantly change, and thus you must keep only minimal
history. But you want to restore things you are not keeping. Strange.

Hope that helps.

Regards,
Holger

--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] BPC 4 very slow

[Gandalf Corvotempesta]

2016-01-27 20:19 GMT+01:00 Kris Lou :
> Your $Conf{FullKeepCnt} = 1, which means to keep 1 filled backup. (Not
> necessarily 1 Full backup)

That's ok for me. Probably i'll increase that to 2, but even 1 would be ok

> After a successful backup (full or incr), the most recent is your 1 filled
> backup, and so it removes the oldest filled which happens to be your
> previous Full.  Then it'll try to take a new Full on the next run.

That's wrong.
Ok to remove the "fill" from older backups (according to my
FullKeepCount setting)
but AFAIK, this should remove common files between the filled backup
and the previous one.

A sort of reverse incremental, where the last backup is always a full
copy and the previous
backup is a differential backup storing only different files

Actually is removing the WHOLE backup, making some days unavailable to restore.

> You might have stumbled upon an edge case where FullKeepCnt <
> FullKeepCntMin.  And I also wonder about the integrity of the incr backups
> where the filled source of reverse deltas has been removed (i.e. #1, based
> upon #2, but then #2 was removed after successful completion of #3).

Exaclty what i'm trying to understand. If the filled backup is missing, probably
al subsequent unfilled backup would be inconsistent.

> But yeah, experiment with FullKeepCnt?  If you want to take 1 full every 30
> days, then FullKeepCnt = 2 ... I would think.

Already tried with no luck. BPC is still deleting the whole backup.

> At the very least, thanks for bringing some more v4 attention to the list.

v4 is a great software, but actually, is impossible to use.
Probably there is something wrong in my configuration, but i've posted
all customized parameters (mostly the retention levels) to the list
and noone told me about possible issues.

--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] BPC 4 very slow

[Kris Lou]

I've spent entirely too much time reading the v4 docs, but here's how I
interpret it (and take with a grain of salt as I don't run v4):

Your $Conf{FullKeepCnt} = 1, which means to keep 1 filled backup. (Not
necessarily 1 Full backup)

After a successful backup (full or incr), the most recent is your 1 filled
backup, and so it removes the oldest filled which happens to be your
previous Full.  Then it'll try to take a new Full on the next run.

You might have stumbled upon an edge case where FullKeepCnt <
FullKeepCntMin.  And I also wonder about the integrity of the incr backups
where the filled source of reverse deltas has been removed (i.e. #1, based
upon #2, but then #2 was removed after successful completion of #3).

But yeah, experiment with FullKeepCnt?  If you want to take 1 full every 30
days, then FullKeepCnt = 2 ... I would think.

At the very least, thanks for bringing some more v4 attention to the list.

-Kris




Kris Lou
k...@themusiclink.net

On Wed, Jan 27, 2016 at 9:04 AM, Holger Parplies  wrote:

> Gandalf Corvotempesta wrote on 2016-01-27 11:28:24 +0100 [Re:
> [BackupPC-users] BPC 4 very slow]:
> > [basically the same thing over and over again]
>
> In case it's not obvious, adjust the settings so they specify to do what
> you
> want. Before that, preferably, understand the settings. Use the suitable
> tool
> for your purpose. You keep repeating that you get no advantage from
> pooling,
> because all your files constantly change, and thus you must keep only
> minimal
> history. But you want to restore things you are not keeping. Strange.
>
> Hope that helps.
>
> Regards,
> Holger
>
>
> --
> Site24x7 APM Insight: Get Deep Visibility into Application Performance
> APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
> Monitor end-to-end web transactions and take corrective actions now
> Troubleshoot faster and improve end-user experience. Signup Now!
> http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] BPC 4 very slow

[Gandalf Corvotempesta]

2016-01-27 21:32 GMT+01:00 Norm Legare :
> I think he meant use v4 as its configured "out-of-the-box".

I'm using it "out-of-the-box" except for incremental keep count and
mail notification (and exclude dirs for rsync)
I've not customized anything that could lead to issue to backup removal.

--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] BPC 4 very slow

[Les Mikesell]

On Wed, Jan 27, 2016 at 3:25 PM, Gandalf Corvotempesta
 wrote:
> 2016-01-27 21:32 GMT+01:00 Norm Legare :
>> I think he meant use v4 as its configured "out-of-the-box".
>
> I've not customized anything that could lead to issue to backup removal.
>

And yet, other people who haven't made your changes don't see that
issue.  I don't know why it would happen but I wonder if your
FullPeriod is somehow getting parsed as 2.

-- 
  Les Mikesell
lesmikes...@gmail.com

--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] BPC 4 very slow

[Gandalf Corvotempesta]

2016-01-27 9:19 GMT+01:00 Gandalf Corvotempesta
:
> It makes a full, then the day after it makes an incremental and
> removed the previous full. After that, the next backup would
> be another full (as there are no more full available). And so on

This is what I mean, look at the screenshot.

Our log is as follow:

2016-01-23 09:38:07 full backup 0 complete, 2912565 files, 2912565
bytes, 1 xferErrs (0 bad files, 0 bad shares, 1 other)
2016-01-24 01:59:46 incr backup 1 complete, 2905889 files, 2905889
bytes, 0 xferErrs (0 bad files, 0 bad shares, 0 other)
2016-01-25 06:28:16 full backup 2 complete, 2915983 files, 2915983
bytes, 13 xferErrs (0 bad files, 0 bad shares, 13 other)
2016-01-26 16:12:06 incr backup 3 complete, 2927190 files, 2927190
bytes, 0 xferErrs (0 bad files, 0 bad shares, 0 other)
2016-01-27 09:25:01 full backup 4 complete, 2912699 files, 2912699
bytes, 9 xferErrs (0 bad files, 0 bad shares, 9 other)

BPC did a full on 2016-01-22 (#0), 2016-01-25 (#2), 2016-01-27 (#4)

After each backup, it removes the older "filled" backup. In my case,
after each incremental (#1, #3) filled backups #0 and #2 was remved.
2 hours ago, a new full was made. This night probably it will do an
incremental, and as think, it will remove the today full.

This is absolutely wrong because i'm missing restore points. I'm
unable to restore from 2016-01-23, 2016-01-25 and tomorrow i will
unable to restore from 2016-01-27

AFAIK, the previous backup must not be totally removed, but just
converted from "filled" to "unfilled" by removing just *common* files
between last and previous one.
--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] Identifying new files

[martin f krafft]

Hello,

is there an easy way to identify which files were added to a backup?
The File Size/Count Reuse Summary table tells me about a number of
files and their size, but I wonder if there's an easy way to get
a file list, other than increasing the verbosity and parsing the
XferLog?

Thanks,

-- 
@martinkrafft | http://madduck.net/ | http://two.sentenc.es/
 
"men who say it cannot be done should not interrupt men doing it."
  -- old chinese proverb
 
spamtraps: madduck.bo...@madduck.net


digital_signature_gpg.asc
Description: Digital signature (see	http://martin-krafft.net/gpg/sig-policy/999bbcc4/current)
--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/