Re: [BackupPC-users] Nightly does not find some pool files, but they exist

[Craig Barratt]

Dieter,

You are right about the pool files being in the correct location.  Bit 0 of
the first two bytes is ignored since the directory fanout is 128 at the
first two levels.

This does look like a minor or benign bug (perhaps it's just the error
message that is wrong).  Does it happen again the next time
BackupPC_nightly runs?

Craig

On Thursday, May 4, 2017, Dieter Fauth  wrote:

> Hi Holger,
> The directories for the pools do not use the last bit (128 instead of 256
> values).
> It is documented somewhere.
> So there is top level 10 and 12, but no 11.
> Same with next level. D9 and D8 go into D8 since there is no D9 directory.
>
> > I believe a file '11d9...' should be in 11/d9/, not in 10/d8/
> > (off-by-one in
> > both path components).
>
> I would be interested in knowing why this design decision has been made.
> (in case the devs reads this - not to complain, but to learn)
>
>
> Leaves me back on my original issue. For me it smells like a bug.
> Unfortunately perl is none of my languages.
> If I am the only one seeing this, it could be my hard drive as well, the
> migration caused quite some stress to it. A fresh one is already waiting...
>
> PS: Sorry for the DOT, was a copy error I guess
>
> --
> Many regards, Dieter Fauth :-)
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net 
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Nightly does not find some pool files, but they exist

[Dieter Fauth]

Hi Holger,
The directories for the pools do not use the last bit (128 instead of 256  
values).
It is documented somewhere.
So there is top level 10 and 12, but no 11.
Same with next level. D9 and D8 go into D8 since there is no D9 directory.

> I believe a file '11d9...' should be in 11/d9/, not in 10/d8/  
> (off-by-one in
> both path components).

I would be interested in knowing why this design decision has been made.  
(in case the devs reads this - not to complain, but to learn)


Leaves me back on my original issue. For me it smells like a bug.  
Unfortunately perl is none of my languages.
If I am the only one seeing this, it could be my hard drive as well, the  
migration caused quite some stress to it. A fresh one is already waiting...

PS: Sorry for the DOT, was a copy error I guess

-- 
Many regards, Dieter Fauth :-)

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Nightly does not find some pool files, but they exist

[Holger Parplies]

Hi,

Dieter Fauth wrote on 2017-05-04 10:20:10 +0200 [[BackupPC-users] Nightly does 
not find some pool files, but they exist]:
> in the log I see many lines like these:
> [...]
> 2017-05-04 09:04:01  admin : BackupPC_refCountUpdate: missing pool file 
> 11d9a30eb21b173a1e073e7a86b83f2e count 16
> [...]
> The files itself exist though. This is what ls shows:
> ls /var/lib/backuppc/cpool/10/d8/11d9a30*
>   10/d8/11d9a30eb21b173a1e073e7a86b83f2e

I believe a file '11d9...' should be in 11/d9/, not in 10/d8/ (off-by-one in
both path components).

> Version: 4.1.1git
> Repo has been migrated to V4 (I hope all now, just checking right now).

A brief look at the code doesn't suggest the migration might be at fault. I
wonder how the pool files ended up in the wrong place, particularly since it
only seems to apply to some of the files ...

Is it ok for migration and refCountUpdate to run in parallel?

Regards,
Holger

P.S.: While "lists.sourceforge.net." (with trailing dot) is a perfectly
  valid DNS name, at least my MTA doesn't like e-mail addresses ending
  on a dot. Could you please use the canonical form we all use?

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] Nightly does not find some pool files, but they exist

[Dieter Fauth]

Hi,
in the log I see many lines like these:
2017-05-04 09:03:55 BackupPC_nightly now running BackupPC_refCountUpdate  
-m -s -c -P 5 -r 16-31
2017-05-04 09:03:55  admin : __bpc_pidStart__ 725
2017-05-04 09:04:01  admin : BackupPC_refCountUpdate: missing pool file  
11d9a30eb21b173a1e073e7a86b83f2e count 16
2017-05-04 09:04:01  admin : BackupPC_refCountUpdate: missing pool file  
109ea560445eaeaff3b90f2d0810ca95 count 6
2017-05-04 09:04:01  admin : BackupPC_refCountUpdate: missing pool file  
1196c64c5ca46448928d9c57189349e5 count 16
...

The files itself exist though. This is what ls shows:
ls /var/lib/backuppc/cpool/10/d8/11d9a30*
10/d8/11d9a30eb21b173a1e073e7a86b83f2e

Version: 4.1.1git
Repo has been migrated to V4 (I hope all now, just checking right now).

-- 
Many regards, Dieter Fauth :-)

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/