Re: [BackupPC-users] Discrepancy in *actual* vs. *reported* missing pool files

2020-06-09 Thread Craig Barratt via BackupPC-users
Jeff,

We've discussed at least one issue off-list - making sure you consider
inodes too.

It looks like BackupPC_fsck -f only rebuilds the last two backup refcounts
for each host.  It should use the -F option instead of -f when it calls
BackupPC_refcountUpdate (see line 630).  So you should try changing that
and re-running.

Craig

On Tue, Jun 9, 2020 at 8:44 AM  wrote:

> For the longest of time my log files have warned about 37 missing pool
> files.
> E.g.
> admin : BackupPC_refCountUpdate: missing pool file
> 718fc4796633702979bb5edbd20e27a6
>
> So, I decided to find them to see what is going on...
>
> I did the following:
>
> 1. Stopped the running of further backups
> Ran: BackupPC_fsck -f' to do a full checkup
> Ran: BackupPC_nightly to prune the pool fully
>
> 2. Created a sorted, uniq list of all the cpool files, using 'find'
>and 'sort -u' on TopDir/cpool
>
> 3. Created a program to iterate through all the attrib files in all my
>backups and print out the digest and name of each file (plus also
>size and type). I also included the md5sum encoded in the name of
>each attrib file itself.
> Ran the program on all my hosts and backups
> Sorted and uniquified the list of md5sum
>
> 4. Used 'comm -1 -3' and 'comm -2 -3' to find missing ones from each
>listing
>
> Result:
> 1. Relative to the attrib listing, the pool was missing *105* files
>including the 37 that were found in the LOG
>
>INTERESTINGLY, all 105 were from previously migrated v3 backups.
>Actually, from the last 3 backups on that machine (full, incr, incr)
>
> 2. Relative to the pool listing, there were *1154* files in the pool
>that were not mentioned in the attrib file digests (including the
>digest of the attrib itself)
>
> So,
> - Why is BackupPC_fsck not detecting all the missing pool files?
> - Why is BackupPC_nightly not pruning files not mentioned in the
>   attrib listing?
> - Any suggestions on how to further troubleshoot?
>
>
>
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


[BackupPC-users] Discrepancy in *actual* vs. *reported* missing pool files

2020-06-09 Thread
For the longest of time my log files have warned about 37 missing pool files. 
E.g.
admin : BackupPC_refCountUpdate: missing pool file 
718fc4796633702979bb5edbd20e27a6

So, I decided to find them to see what is going on...

I did the following:

1. Stopped the running of further backups
Ran: BackupPC_fsck -f' to do a full checkup
Ran: BackupPC_nightly to prune the pool fully

2. Created a sorted, uniq list of all the cpool files, using 'find'
   and 'sort -u' on TopDir/cpool

3. Created a program to iterate through all the attrib files in all my
   backups and print out the digest and name of each file (plus also
   size and type). I also included the md5sum encoded in the name of
   each attrib file itself.
Ran the program on all my hosts and backups
Sorted and uniquified the list of md5sum

4. Used 'comm -1 -3' and 'comm -2 -3' to find missing ones from each
   listing 

Result:
1. Relative to the attrib listing, the pool was missing *105* files
   including the 37 that were found in the LOG

   INTERESTINGLY, all 105 were from previously migrated v3 backups.
   Actually, from the last 3 backups on that machine (full, incr, incr)

2. Relative to the pool listing, there were *1154* files in the pool
   that were not mentioned in the attrib file digests (including the
   digest of the attrib itself)

So,
- Why is BackupPC_fsck not detecting all the missing pool files?
- Why is BackupPC_nightly not pruning files not mentioned in the
  attrib listing?
- Any suggestions on how to further troubleshoot?



___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/