Re: [BackupPC-users] Can't access older backups after upgrade

2021-11-02 Thread backuppc
Anthony Chavez wrote at about 02:08:39 -0700 on Tuesday, November 2, 2021:
 > On 10/19/21 7:06 PM, Anthony Chavez wrote:
 > > 
 > > On 10/9/21 3:02 PM, Anthony Chavez wrote:
 > >> Hi all,
 > >>
 > >> So I have had to make a slight change to my BackupPC setup and while I 
 > >> am able to access new backups in the web interface, I am now unable to 
 > >> access my older backups.
 > >>
 > >> My old setup was under a FreeNAS Jail, using the FreeBSD pkg of 
 > >> BackupPC with a nullfs mount from the jail to a ZFS dataset housing 
 > >> the backups themselves. It worked great for months.
 > >>
 > >> When upgrading from FreeNAS 11 to TrueNAS 12, my jail refused to 
 > >> upgrade so the option was to either create a new jail or install Linux 
 > >> in a VM and mount the backups directory over NFSv3. I chose the latter 
 > >> (ArchLinux) and because Docker is becoming a thing in my LAN, 
 > >> adferrand/backuppc.
 > >>
 > >> The error message for older backups I am seeing in the web interface 
 > >> is "Error: Directory /data/backuppc/pc/$host/$baknum is empty".
 > >> When trying to access an older backup, BackupPC_ls comes back with, 
 > >> for example: "bpc_attrib_dirRead: can't open 
 > >> /data/backuppc/cpool/72/ca/72ca0cc1bf7a179f8c3cdabc187e3887".

Have you tried BackupPC_zcat on the above pool file?

 > >>
 > >> Permissions check out (uid 126/backuppc, gid 126/backuppc, umask 027) 
 > >> so the only thing I can think of is that I need to re-index or 
 > >> re-build the pool somehow, but I am not familiar enough with BackupPC 
 > >> command line utilities to know what to do at this point.
 > >>
 > >> Any help would be much appreciated.
 > > 
 > > Could anyone help with this please? It's making no sense to me:
 > > 
 > > $ ls -ahln /data/backuppc/pc/$host/$baknum
 > > total 65K
 > > drwxr-x---    8 126  126   10 Aug 29 16:22 .
 > > drwxr-x---  110 126  126  233 Oct 19 15:12 ..
 > > -rwxr-x---    1 126  126    0 Aug 29 16:22 
 > > attrib_5e6a2266a222d07587f687f9df5ac097
 > > -rwxr-x---    1 126  126  695 Aug 29 16:00 backupInfo
 > > drwxr-x---    3 126  126    4 Aug 29 16:01 f%2fetc
 > > drwxr-x---    3 126  126    4 Aug 29 16:14 f%2fhome
 > > drwxr-x---    3 126  126    3 Aug 29 16:18 f%2fsrv
 > > drwxr-x---    4 126  126    4 Aug 29 16:20 f%2fvar
 > > drwxr-x---    2 126  126    3 Aug 29 16:22 f%2fvar%2flib
 > > drwxr-x---    2 126  126   95 Oct  7 14:13 refCnt

What is in the refCnt directory (and subdirectory)?
What is in the f-mangled directories?

What is in the log files under:
- TopDir/log
- TopDir/pc/$host

Are there errors? And if so what are they?

> > $ /usr/local/BackupPC/bin/BackupPC_ls -h $host -n $baknum -s /etc /
 > > /:
 > > bpc_attrib_dirRead: can't open 
 > > /data/backuppc/cpool/72/ca/72ca0cc1bf7a179f8c3cdabc187e3887
 > > bpc_attrib_dirRead: can't open 
 > > /data/backuppc/cpool/68/40/6940aeccff660743da3041191216d260
 >
Again try BackupPC_zcat..
You may also want to try backuppcfs.pl which mounts your backups as a fuse
file system and allows you to browse files to see what if any files
are actually backed up.

 > Is there nobody that can help me with this? Are my backups lost?
 > 
You really need to give us some more troubleshooting info if we are to
have any chance of helping you!

 > I am open to paying for one-on-one assistance with this. I would very 
 > much like to salvage this situation, if at all possible.
 > 
 > 
 > ___
 > BackupPC-users mailing list
 > BackupPC-users@lists.sourceforge.net
 > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
 > Wiki:https://github.com/backuppc/backuppc/wiki
 > Project: https://backuppc.github.io/backuppc/



___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/


Re: [BackupPC-users] Is all in order?

2021-11-02 Thread Norman J. Goldstein
I suppose it depends what "idle" signifies.  From your response (thank 
you), I understand that "idle" is the correct state for the system to be 
in i.e. it does not signify a process that is waiting to complete 
something it is currently unable to complete.



On 2021-11-02 00:53, Dave Sherohman via BackupPC-users wrote:


What seems suspicious to you about it?  It's not currently in the 
process of backing up files or doing anything with the host right this 
minute; it is idle.


On 11/2/21 7:47 AM, Norman Goldstein wrote:

My question is in the last line of this email.

I was having errors backing up, so I decided to start with a fresh, 
empty /var/lib/BackupPC , and started a manual full backup.  
Afterwards, I was able to access various backup files, as a sanity 
check.  Also ...


The server log file looks good:
2021-11-01 22:24:50 User backuppc requested backup ofmelodic  
  (melodic  
)
2021-11-01 22:24:51 Started full backup onmelodic  
  (pid=14098, share=/)
2021-11-01 22:24:52 Started full backup onmelodic  
  (pid=14098, share=/home)
2021-11-01 22:55:52 Finished full backup onmelodic  


The host log file looks good:

2021-11-01 22:24:51 full backup started for directory /
2021-11-01 22:24:52 full backup started for directory /home
2021-11-01 22:55:35 full backup 0 complete, 20167 files, 5521522076 bytes, 0 
xferErrs (0 bad files, 0 bad shares, 0 other)

The server Status page looks good (no running jobs).

The server Host Summary page has an idle entry:
 
Host 
User 
Comment 
#Full 	Full Age 
(days) 	Full Size 
(GiB) 	Speed 
(MiB/s) 
#Incr 	Incr Age 
(days) 	Last Backup 
(days) 
State 	#Xfer 
errs 	Last 
attempt

melodic   backuppc
1   0.1 5.142.860   0.1 idle0   
idle

This idle entry looks suspicious to me. Is this something I can ignore?


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project:https://backuppc.github.io/backuppc/



___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project:https://backuppc.github.io/backuppc/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/


Re: [BackupPC-users] Can't access older backups after upgrade

2021-11-02 Thread G.W. Haywood via BackupPC-users

Hi there,

On Tue, 2 Nov 2021, Anthony Chavez wrote:

On 10/19/21 7:06 PM, Anthony Chavez wrote:

On 10/9/21 3:02 PM, Anthony Chavez wrote:


So I have had to make a slight change to my BackupPC setup and while I
am able to access new backups in the web interface, I am now unable to
access my older backups.

My old setup was under a FreeNAS Jail, using the FreeBSD pkg of
BackupPC with a nullfs mount from the jail to a ZFS dataset housing
the backups themselves. It worked great for months.

When upgrading from FreeNAS 11 to TrueNAS 12, my jail refused to
upgrade so the option was to either create a new jail or install Linux
in a VM and mount the backups directory over NFSv3. I chose the latter
(ArchLinux) and because Docker is becoming a thing in my LAN,
adferrand/backuppc.


FWIW I wouldn't use NFS for anything that even vaguely bears a passing
resemblance to a backup system.  In my experience NFS is always flaky.
Even if you do get it more or less under control, there always seem to
be gotchas lurking in there.


The error message for older backups I am seeing in the web interface
is "Error: Directory /data/backuppc/pc/$host/$baknum is empty".

When trying to access an older backup, BackupPC_ls comes back with,
for example: "bpc_attrib_dirRead: can't open
/data/backuppc/cpool/72/ca/72ca0cc1bf7a179f8c3cdabc187e3887".

Permissions check out (uid 126/backuppc, gid 126/backuppc, umask 027)
so the only thing I can think of is that I need to re-index or
re-build the pool somehow, but I am not familiar enough with BackupPC
command line utilities to know what to do at this point.

Any help would be much appreciated.


Could anyone help with this please? It's making no sense to me:


Sometimes some of the things that go on with BackupPC make no sense to
me either.  I've yet to see BackupPC_ls produce any output at all that
makes sense to me but I haven't tried too hard.  That said, things can
often work out all right in the end anyway. :)

One of the things to watch out for is indirection, where processes are
using some configured value.  This is particularly true when the value
is a filesystem path.  That might be helpful and it might not, in this
case, I throw it in because at this stage I can't immediately think of
anything else _concrete_ that might be relevant to your issue.  You've
done enough already, however, to give anybody, er, pause for thought.


$ ls -ahln /data/backuppc/pc/$host/$baknum
total 65K
drwxr-x---??? 8 126? 126?? 10 Aug 29 16:22 .
drwxr-x---? 110 126? 126? 233 Oct 19 15:12 ..
-rwxr-x---??? 1 126? 126??? 0 Aug 29 16:22
attrib_5e6a2266a222d07587f687f9df5ac097
-rwxr-x---??? 1 126? 126? 695 Aug 29 16:00 backupInfo
drwxr-x---??? 3 126? 126??? 4 Aug 29 16:01 f%2fetc
drwxr-x---??? 3 126? 126??? 4 Aug 29 16:14 f%2fhome
drwxr-x---??? 3 126? 126??? 3 Aug 29 16:18 f%2fsrv
drwxr-x---??? 4 126? 126??? 4 Aug 29 16:20 f%2fvar
drwxr-x---??? 2 126? 126??? 3 Aug 29 16:22 f%2fvar%2flib
drwxr-x---??? 2 126? 126?? 95 Oct? 7 14:13 refCnt
$ /usr/local/BackupPC/bin/BackupPC_ls -h $host -n $baknum -s /etc /
/:
bpc_attrib_dirRead: can't open
/data/backuppc/cpool/72/ca/72ca0cc1bf7a179f8c3cdabc187e3887
bpc_attrib_dirRead: can't open
/data/backuppc/cpool/68/40/6940aeccff660743da3041191216d260


Is there nobody that can help me with this? Are my backups lost?


My gut feeling is no, your backups will not be lost - unless you do
something rash.  But given that

(1) you seem to think that your backups are important to you and
(2) you've been messing about wantonly with the architecture and
(3) it appears that this is your only backup then

what you have done so far seems to me a bit on the rash side.


I am open to paying for one-on-one assistance with this. I would very
much like to salvage this situation, if at all possible.


Well I probably should't pass up an offer like that, but first things
first: what version(s) of BackupPC are we talking about?

--

73,
Ged.


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/


Re: [BackupPC-users] Can't access older backups after upgrade

2021-11-02 Thread Anthony Chavez

On 10/19/21 7:06 PM, Anthony Chavez wrote:


On 10/9/21 3:02 PM, Anthony Chavez wrote:

Hi all,

So I have had to make a slight change to my BackupPC setup and while I 
am able to access new backups in the web interface, I am now unable to 
access my older backups.


My old setup was under a FreeNAS Jail, using the FreeBSD pkg of 
BackupPC with a nullfs mount from the jail to a ZFS dataset housing 
the backups themselves. It worked great for months.


When upgrading from FreeNAS 11 to TrueNAS 12, my jail refused to 
upgrade so the option was to either create a new jail or install Linux 
in a VM and mount the backups directory over NFSv3. I chose the latter 
(ArchLinux) and because Docker is becoming a thing in my LAN, 
adferrand/backuppc.


The error message for older backups I am seeing in the web interface 
is "Error: Directory /data/backuppc/pc/$host/$baknum is empty".


When trying to access an older backup, BackupPC_ls comes back with, 
for example: "bpc_attrib_dirRead: can't open 
/data/backuppc/cpool/72/ca/72ca0cc1bf7a179f8c3cdabc187e3887".


Permissions check out (uid 126/backuppc, gid 126/backuppc, umask 027) 
so the only thing I can think of is that I need to re-index or 
re-build the pool somehow, but I am not familiar enough with BackupPC 
command line utilities to know what to do at this point.


Any help would be much appreciated.


Could anyone help with this please? It's making no sense to me:

$ ls -ahln /data/backuppc/pc/$host/$baknum
total 65K
drwxr-x---    8 126  126   10 Aug 29 16:22 .
drwxr-x---  110 126  126  233 Oct 19 15:12 ..
-rwxr-x---    1 126  126    0 Aug 29 16:22 
attrib_5e6a2266a222d07587f687f9df5ac097

-rwxr-x---    1 126  126  695 Aug 29 16:00 backupInfo
drwxr-x---    3 126  126    4 Aug 29 16:01 f%2fetc
drwxr-x---    3 126  126    4 Aug 29 16:14 f%2fhome
drwxr-x---    3 126  126    3 Aug 29 16:18 f%2fsrv
drwxr-x---    4 126  126    4 Aug 29 16:20 f%2fvar
drwxr-x---    2 126  126    3 Aug 29 16:22 f%2fvar%2flib
drwxr-x---    2 126  126   95 Oct  7 14:13 refCnt
$ /usr/local/BackupPC/bin/BackupPC_ls -h $host -n $baknum -s /etc /
/:
bpc_attrib_dirRead: can't open 
/data/backuppc/cpool/72/ca/72ca0cc1bf7a179f8c3cdabc187e3887
bpc_attrib_dirRead: can't open 
/data/backuppc/cpool/68/40/6940aeccff660743da3041191216d260


Is there nobody that can help me with this? Are my backups lost?

I am open to paying for one-on-one assistance with this. I would very 
much like to salvage this situation, if at all possible.



___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/


Re: [BackupPC-users] Is all in order?

2021-11-02 Thread Dave Sherohman via BackupPC-users
What seems suspicious to you about it?  It's not currently in the 
process of backing up files or doing anything with the host right this 
minute; it is idle.


On 11/2/21 7:47 AM, Norman Goldstein wrote:

My question is in the last line of this email.

I was having errors backing up, so I decided to start with a fresh, 
empty /var/lib/BackupPC , and started a manual full backup.  
Afterwards, I was able to access various backup files, as a sanity 
check.  Also ...


The server log file looks good:
2021-11-01 22:24:50 User backuppc requested backup ofmelodic  
  (melodic  
)
2021-11-01 22:24:51 Started full backup onmelodic  
  (pid=14098, share=/)
2021-11-01 22:24:52 Started full backup onmelodic  
  (pid=14098, share=/home)
2021-11-01 22:55:52 Finished full backup onmelodic  


The host log file looks good:

2021-11-01 22:24:51 full backup started for directory /
2021-11-01 22:24:52 full backup started for directory /home
2021-11-01 22:55:35 full backup 0 complete, 20167 files, 5521522076 bytes, 0 
xferErrs (0 bad files, 0 bad shares, 0 other)

The server Status page looks good (no running jobs).

The server Host Summary page has an idle entry:
 
Host 
User 
Comment 
#Full 	Full Age 
(days) 	Full Size 
(GiB) 	Speed 
(MiB/s) 
#Incr 	Incr Age 
(days) 	Last Backup 
(days) 
State 	#Xfer 
errs 	Last 
attempt

melodic   backuppc
1   0.1 5.142.860   0.1 idle0   
idle

This idle entry looks suspicious to me. Is this something I can ignore?


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/


[BackupPC-users] Is all in order?

2021-11-02 Thread Norman Goldstein

My question is in the last line of this email.

I was having errors backing up, so I decided to start with a fresh, 
empty /var/lib/BackupPC , and started a manual full backup. Afterwards, 
I was able to access various backup files, as a sanity check.  Also ...


The server log file looks good:

2021-11-01 22:24:50 User backuppc requested backup ofmelodic  
  (melodic  
)
2021-11-01 22:24:51 Started full backup onmelodic  
  (pid=14098, share=/)
2021-11-01 22:24:52 Started full backup onmelodic  
  (pid=14098, share=/home)
2021-11-01 22:55:52 Finished full backup onmelodic  


The host log file looks good:

2021-11-01 22:24:51 full backup started for directory /
2021-11-01 22:24:52 full backup started for directory /home
2021-11-01 22:55:35 full backup 0 complete, 20167 files, 5521522076 bytes, 0 
xferErrs (0 bad files, 0 bad shares, 0 other)

The server Status page looks good (no running jobs).

The server Host Summary page has an idle entry:


Host 
User 
Comment 
#Full 	Full Age 
(days) 	Full Size 
(GiB) 	Speed 
(MiB/s) 
#Incr 	Incr Age 
(days) 	Last Backup 
(days) 
State 	#Xfer 
errs 	Last 
attempt

melodic   backuppc
1   0.1 5.142.860   0.1 idle0   
idle

This idle entry looks suspicious to me. Is this something I can ignore?
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/