Re: [BackupPC-users] Rsync Memory Issue

Could you try the bpc-rsync master code from github? Just clone the repository and build it. I did some commits in July 2021 that were after the latest release. Craig On Thu, Nov 17, 2022 at 6:55 AM wrote: > Missing pool files should not generally have anything to do with rysnc > memory

Re: [BackupPC-users] Recent version of BackupPC_deleteFile

V4 has a script BackupPC_backupDelete which can delete a particular directory in a specific backup and share. However, it doesn't have granularity down to the file level. Craig On Fri, Aug 19, 2022 at 1:36 PM Libor Klepáč wrote: > Hi, thanks for answer. > > I will have to be patient then :)

Re: [BackupPC-users] Needed patch for BackupPC::Storage::Text.pm

losif, Thanks for discovering and debugging this issue. Yes, it's a long-time latent bug because the 2nd argument is missing a qw() wrapper. Your solution is the right one. I created an issue and have pushed a fix

Re: [BackupPC-users] Some directories stay empty (The directory ... is empty).

I definitely agree with Guillermo that passwordless root access is very risky. There are several ways to make it more secure, including the approach he describes. The same approach can be used to run as root locally should you wish to do so: you should ssh as a non-privileged user, then use sudo

Re: [BackupPC-users] rsync open-noatime option

The rysnc open-noatime option isn't supported by rsync-bpc. Like Jeff, I use the noatime mount option on my BackupPC filesystem. Craig On Fri, Feb 11, 2022 at 8:46 AM wrote: > Kenneth Porter wrote at about 18:44:40 -0800 on Thursday, February 10, > 2022: > > Is anyone using the rsync/rsyncd

Re: [BackupPC-users] Where is BackupPC_rsyncBackup and BackupPC_rsyncRestore?

The 2nd sentence is completely wrong. There have never been standalone programs BackupPC_rsyncBackup and BackupPC_rsyncRestore. Looks like it's been there since the very early days of 4.0.0. I just committed a change to git to remove it. Craig On Tue, Jan 25, 2022 at 6:04 PM wrote: > The

Re: [BackupPC-users] Backups not backing up everything

The default rsync arguments in v4 include --one-file-system, which could be why it's not descending into those directories (ie, are the missing directories different file systems?). If so, you can either remove --one-file-system (in which case you'll need to explicitly exclude things like /proc),

Re: [BackupPC-users] Weird fd leaks (possibly trigged by 0 sized file?)

What version of BackupPC and rsync are you running? If BackupPC is 3.x, rsync is 3.2.3 and your File::RsyncP is older than version 0.76 then this could be your issue: https://github.com/backuppc/backuppc/issues/369 The solution is to upgrade File::RsyncP to the latest version 0.76. Craig On

Re: [BackupPC-users] Perl error on FreeBSD

P module doesn't exist) > > > it works fine if I commented out that line. > > > Il 08/02/2021 07:49 Craig Barratt ha > scritto: > > > Can you try replacing that line 554: > > close($rs->{fh_stderr}); > > > with: > > close($rs->{fh_stderr}) if

Re: [BackupPC-users] Bug/annoyance with continued incrementing of interrupted backups

The intention was to make sure the backup number always represents the same backup. So in the successful case, the new backup is N+1 and the prior deltas stored at N correctly represent that prior backup. In the failure case and the prior backup deltas are empty, it removes the empty delta. I

Re: [BackupPC-users] Perl error on FreeBSD

-RsyncP-0.76 > > > thank you! > > Il 06/02/2021 00:12 Craig Barratt ha > scritto: > > > What version of File::RsyncP is this? > > Craig > > On Sat, Feb 6, 2021 at 4:01 AM absolutely_free--- via BackupPC-users < > backuppc-users@lists.sourceforge.net&

Re: [BackupPC-users] Perl error on FreeBSD

What version of File::RsyncP is this? Craig On Sat, Feb 6, 2021 at 4:01 AM absolutely_free--- via BackupPC-users < backuppc-users@lists.sourceforge.net> wrote: > Hi, > > I am using BackupPC 3 on two FreeBSD 12.1 servers. > > On both servers, I am unable to run backups, I get error: > > Can't

Re: [BackupPC-users] XferLog file entries out of order???

This is benign and relates to how those log messages are buffered. There are multiple processes involved across the server and client. The one-line-per-file summary requires information from both server-side processes, so they get buffered until both sides are done with the file. To reduce log

Re: [BackupPC-users] Change in format of /usr/bin/rsync --server --sender command

This is rsync related, not specific to rsync-bpc.c. From options.c in 3.1.2 and 3.1.3: /* We make use of the -e option to let the server know about * any pre-release protocol version && some behavior flags. */ eFlags[x++] = 'e'; #if

Re: [BackupPC-users] Vanished file

It should only affect rsync-bpc 3.1.3+. 3.1.2 and 3.0.9 use the original style of handling long path and filename strings (just a large fixed size is used). Craig On Tue, Jan 12, 2021 at 5:28 PM wrote: > Craig Barratt via BackupPC-users wrote at about 15:32:27 +1100 on Tuesday, > Janu

Re: [BackupPC-users] Vanished file

rnatives/alt-java -> > /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.275.b01-0.el7_9.x86_64/jre/bin/alt-java > lrwxrwxrwx 1 root root 81 Dec 18 08:08 /etc/alternatives/alt-java.1.gz -> > /usr/share/man/man1/alt-java-java-1.8.0-openjdk-1.8.0.275.b01-0.el7_9.x86_64.1.gz > > Pete > >

Re: [BackupPC-users] Vanished file

Pete, Thanks for that. Yes, this is exactly the same issue that Alexander reported: https://github.com/backuppc/rsync-bpc/issues/18 One more step: what's the output from: BackupPC_zcat 9dea1ea7cd900fa4fcd3e24f86ad0be8 Thanks, Craig On Mon, Jan 11, 2021 at 10:32 PM Pete Geenhuizen wrote: >

Re: [BackupPC-users] Vanished file

Excellent point - yes it does look like it's the same issue. The error does mention a mangled file path, which it shouldn't know about. Pete - please look in the attrib file of the parent directory (as in that issue) to see if the signature is the same. Craig On Sun, Jan 10, 2021 at 5:22 PM

Re: [BackupPC-users] Vanished file

you run these commands: BackupPC_zcat DIGEST | wc BackupPC_attribPrint path_to_attrib_file Craig On Sun, Jan 10, 2021 at 2:38 PM Craig Barratt < cbarr...@users.sourceforge.net> wrote: > Peter, > > Ok, those are all the latest versions. The next step is to increase the &g

Re: [BackupPC-users] Vanished file

On Sat, Jan 9, 2021 at 11:10 PM Pete Geenhuizen wrote: > Craig, > Thanks for the response, these are the versions that I'm running > BackupPC4-4.4.0-2.el7.fws.x86_64 > BackupPC-XS-0.62-2.el7.fws.x86_64 > rsync-bpc-3.1.3.0-2.el7.fws.x86_64 > > Pete > > >

Re: [BackupPC-users] Vanished file

This should be fixed in the latest version of rsync-bpc. What versions are you using (BackupPC, rsync-bpc and backuppc-xs)? Craig On Sat, Jan 9, 2021 at 8:08 AM Pete Geenhuizen wrote: > After a recent kernel update for Centos 7 I started seeing the following > error on 2 hosts. I didn't give

Re: [BackupPC-users] tar exit status.

The reported exit status is shifted left by 8 bits, so that means tar exited with status 2, which means failure. You should look at the XferLOG to see what error(s) it reported. It could be something benign, but you should be sure before you start disabling error checking. Craig On Sat, Nov

Re: [BackupPC-users] backup failed (received signal=ALRM)

Ok, that confirms this is the same issue. Rsync 3.2.3 made a change that unfortunately exposed a long-standing bug in File::RsyncP. The new version of File::RsyncP fixes that issue. Craig On Tue, Nov 17, 2020 at 10:41 AM Marcus Hardt wrote: > To add the rsync versions: > > backkupc side:

Re: [BackupPC-users] backup failed (received signal=ALRM)

Are you using BackupPC 3.x with rsync? Was your client rsync version recently upgraded to 3.2.3? If so, see this issue . The solution is to upgrade File::RsyncP to version 0.76. Craig On Tue, Nov 17, 2020

Re: [BackupPC-users] Possible memory leak in rsync-bpc-3.1.3.0

Yes, it's perfectly fine to downgrade to rsync-bpc-3.1.2.0-2.el7. It's fully compatible with BackupPC 4.4.0. It would be good to know whether it behaves differently. What are your settings for $Conf{RsyncArgs} and $Conf{RsyncArgsExtra}? Craig On Mon, Nov 9, 2020 at 1:33 AM Pim Rupert

Re: [BackupPC-users] Important question concerning offsite backups

Thanks for corrections! Craig On Thu, Nov 5, 2020 at 9:03 PM wrote: > Craig Barratt via BackupPC-users wrote at about 18:17:54 -0800 on > Thursday, November 5, 2020: > > There's also a community-developed Fuse file system for BackupPC, which > > provides read-only acc

Re: [BackupPC-users] Important question concerning offsite backups

le was? > > Thank you, should answer all > > -- > *From: *"backuppc-users" > *To: *"backuppc-users" > *Cc: *"Craig Barratt" > *Sent: *Thursday, October 29, 2020 12:45:05 PM > *Subject: *Re: [BackupPC-users]

Re: [BackupPC-users] BSD (FreeNAS) rsync init

Does the error happen at the start of the transfer, or part way through. It would be helpful to know which version you are running, and the relevant lines from the XferLOG file. Craig On Sun, Nov 1, 2020 at 1:56 PM Steve Zemlicka wrote: > Update: I was able to use visudo to add the

Re: [BackupPC-users] Important question concerning offsite backups

David, For doing offsite backups weekly we have 2 synology drive arrays that we > rotate between 2 buildings. If i did some kinda of rsync of > /backup/astrobackup to offsite1:/backup/astrobackup would that make our > data be recoverable in case of disaster? Yes - you should rsync that entire

Re: [BackupPC-users] Wrong info in bpc->BackupInfoRead ?

Ghislain, This looks like a bug. It seems that $Conf{DumpPostUserCmd} is run before the backups file is re-written with the new backup information. Before that there is just a placeholder for the new backup. You could see if you can fix it by moving the $Conf{UserCmdCheckStatus} run in

Re: [BackupPC-users] Incomplete backups?

This is normal. In 4.x just an attrib file captures all the information about which files are in that directory, with all their metadata (size, modes, links, xattrs etc). As you note, the file is actually empty and all that matters is the md5 digest in its name. That refers to the actual

Re: [BackupPC-users] Problems doing full backup resulting in out of memory errors

> > What else can i provide?? > > -- > *From: *"backuppc-users" > *To: *"backuppc-users" > *Cc: *"Craig Barratt" > *Sent: *Tuesday, October 20, 2020 1:51:23 PM > *Subject: *Re: [BackupPC-users] Problems doing full backup resu

Re: [BackupPC-users] Problems doing full backup resulting in out of memory errors

rent path. Just want to be sure i don't break anything > $Conf{RsyncBackupPCPath} = '/usr/bin/rsync_bpc'; > > I will add more logging to the rsyncargsextra > > -- > *From: *"backuppc-users" > *To: *"backuppc-users" > *Cc: *"Crai

Re: [BackupPC-users] Problems doing full backup resulting in out of memory errors

> *From: *"backuppc-users" > *To: *"backuppc-users" > *Cc: *"Craig Barratt" > *Sent: *Tuesday, October 20, 2020 1:17:58 PM > *Subject: *Re: [BackupPC-users] Problems doing full backup resulting in > out of memory errors > > CA

Re: [BackupPC-users] Problems doing full backup resulting in out of memory errors

What versions are you running? Specifically, BackupPC, rsync-bpc and BackupPC::XS. Craig On Tue, Oct 20, 2020 at 10:16 AM David Hoskinson < david.hoskin...@astroshapes.com> wrote: > I am having issues with a backup of a nethserver with a 2 TB directory > being backed up. The system being

Re: [BackupPC-users] Problems migrating backups from CentOS 6 to CentOS 7

The BackupPC 3.x store has large numbers of hardlinks. What commands are you using to migrate the data? You need to copy the file system in a manner that is aware of, and reconstructs, the hardlinks (eg, rsync -aH, or a raw file system copy provided they are compatible). Copying all the

Re: [BackupPC-users] Excludes Parameter $Conf{BackupFilesExclude} Not Excluding

Try removing the leading "/" from each of the exclude paths. Also, you should just exclude, eg, "OneDrive", not "OneDrive/*", and same for AppData. Craig On Tue, Oct 13, 2020 at 5:09 PM Akibu Flash wrote: > All, > > I have an arch linux server backing up two Windows 10 clients via rsync. > In

Re: [BackupPC-users] Can BackupPC_tarCreate restore large files?

David, Can you find or compile a perl with 64 bit IVs? You'll also need to rebuild BackupPC::XS using that perl. That should solve the problem. Craig On Tue, Oct 13, 2020 at 12:50 PM David Walton wrote: > Comparing with omv rather than the Alpine Linux in the docker container > gives the

Re: [BackupPC-users] Can BackupPC_tarCreate restore large files?

linux ' > ivtype='long' > ivsize=4 > > os is Alpine Linux v3.10.1 > > On Tue, 13 Oct 2020 at 10:07, Craig Barratt via BackupPC-users < > backuppc-users@lists.sourceforge.net> wrote: > >> This might be because BackupPC::XS (which is used by BackupPC_attribPri

Re: [BackupPC-users] set/shift preferred backup execution time?

Yes, blackouts are per-host. The backup on a host can happen on any server wakeup outside its blackout window. So it's not quite one explicit time, but captures the idea of preferred times of day with flexibility in specific windows. Craig On Tue, Oct 13, 2020 at 2:49 AM Guillermo Rozas

Re: [BackupPC-users] BPC not keeping IncrKeepCnt # of incr bkups?

Yes, that should keep ~6 incrementals. Is there anything in the LOG files that show when those were deleted? Was there any point where you set $Conf{IncrKeepCnt} to less than 6? I guess you could wait and see if it keeps #4 for the next 3 days. Craig On Mon, Oct 12, 2020 at 9:49 AM PGNet Dev

Re: [BackupPC-users] Can BackupPC_tarCreate restore large files?

> small, even for the full backups. > > The RestoreLOG for a restore initiated by the web interface contains the > following line: > send basemap.vg > > > On Tue, 13 Oct 2020 at 02:13, Craig Barratt via BackupPC-users < > backuppc-users@lists.sourceforge.net> wrote:

Re: [BackupPC-users] set/shift preferred backup execution time?

he client is sometime not available at the 3am. > Best regards, > Guillermo > > On Mon, Oct 12, 2020, 13:39 PGNet Dev wrote: > >> On 10/12/20 9:34 AM, Craig Barratt wrote: >> > * in the web interface, assuming no backup is running, select >> stop/dequeue backup and

Re: [BackupPC-users] set/shift preferred backup execution time?

Here are two ways: - manually start a backup at the preferred time, then subsequent backups will occur after that; however, 3am doesn't make this a convenient option - in the web interface, assuming no backup is running, select stop/dequeue backup and enter the number of hours until a

Re: [BackupPC-users] Can BackupPC_tarCreate restore large files?

BackupPC_tarCreate can restore large files. The error you are seeing happens when the metadata file size (stored in the directory's attrib file) doesn't match the uncompressed file size. It appears in this case, for some reason, the attribute file in that directory says the file size for

Re: [BackupPC-users] Backup doesn't copy all files/directories from my linux share

I'd strongly recommend using rsync instead of smb. >From the log you sent, it's possible that BackupPC isn't recognizing the smbclient output due to the LOCALE setting (eg, there are 20056 skipping lines, but all the file and directory counters are 0). What do some of those lines contain? Craig

Re: [BackupPC-users] backuppc v4 hanging when starting backup

> Is there anything I need to do / keep on top of, to prevent this from > occurring again ? Like periodically removing the rsyncTmp files ? Or is > this a hang over from the upgrade ? > > Thanks again! > > Peter > <https://bit.ly/tt_cr> > > --

Re: [BackupPC-users] Understanding Schedule Config

incremental. So is that correct: > > fullperiod = 29.97 > fullkeepcnt = 12 > fullkeepcntmin = 12 > fullagemax = 365 > > Incremental should be ok for that, right? > > -- > Taste > > > Am 04.10.2020 18:56:39, schrieb Craig Barratt via BackupPC-users:

Re: [BackupPC-users] is queued on the user queue (will be backed up soon)

We can't really help without more information. Is any backup running already when you manually start a new one? Does the backup end successfully? Specifically, what messages are near the end of the XferLOG file? Please tell us what's in the host LOG file and the BackupPC server LOG file around

Re: [BackupPC-users] v4.4.0 'config-dir', set @ new install + configure.pl, ignored; looks for config in /etc/BackupPC, and fails to launch ?

ted with the correct --config-dir: ConfDir=> $confDir eq "" ? '/usr/local/etc/backuppc' : $confDir,# updated by configure.pl Craig On Mon, Oct 5, 2020 at 10:18 AM PGNet Dev wrote: > On 10/5/20 9:57 AM, Craig Barratt wrote: > > Yes, the --config-dir option to c

Re: [BackupPC-users] v4.4.0 'config-dir', set @ new install + configure.pl, ignored; looks for config in /etc/BackupPC, and fails to launch ?

Yes, the --config-dir option to configure.pl should override the fhs default of /etc/BackupPC. Assuming configure.pl runs successfully, it modifies lib/BackupPC/Lib.pm and replaces __CONFDIR__ (and also __TOPDIR__, __INSTALLDIR__ etc) with whatever was configured. So look near the top of that

Re: [BackupPC-users] backuppc v4 hanging when starting backup

ith v4. > > -Peter > > ---------- > *From:* Craig Barratt > *Sent:* Sunday, October 4, 2020 10:57 pm > *To:* General list for user discussion, questions and support > *Cc:* McDonald, Peter George > *Subject:* Re: [BackupPC-users] backuppc v4 hanging when starti

Re: [BackupPC-users] backuppc v4 hanging when starting backup

> **Corporate > Responsibility Report <https://bit.ly/tt_cr>* > <https://bit.ly/tt_cr> > > -- > *From:* Craig Barratt > *Sent:* 04 October 2020 22:32 > *To:* McDonald, Peter George > *Cc:* General list for user discussion, questions and support &

Re: [BackupPC-users] backuppc v4 hanging when starting backup

948.0.4, e,d,f = 1,0,1 > > Is It safe to delete /tt-archive/backuppc/pc/localhost/96/ - and the > other ones that have started to duplicate and hung ? > > Cheers, > > Peter G. McDonald > -- > *From:* Craig Barratt > *Sent:* 03 October 2020 1

Re: [BackupPC-users] backup Windows10 clients

The recommended approach for Windows clients is installing cygwin-rsyncd . Craig On Sun, Oct 4, 2020 at 1:57 AM Sebastian Schieke wrote: > Dear Backuppc Users, > > we have been trying to backup all our Windows 10 notebooks with > backuppc.

Re: [BackupPC-users] Understanding Schedule Config

Your interpretations are almost completely correct. For the Full settings, there's no need to have such a large number for FullKeepCnt, since that would be roughly 900 days (30 * 29.97). Only one would be kept after 180 days. The exponential settings (where FullKeepCnt is an array) give more

Re: [BackupPC-users] backuppc v4 hanging when starting backup

Not sure why this should happen. It's just copying a tree of directories that contain one empty file, so that shouldn't be a problem. I'd recommend manually running BackupPC_backupDuplicate as the BackupPC user with $Conf{XferLogLevel} set to 5. First make sure a backup isn't running on

Re: [BackupPC-users] rsync + lvm snapshot in BackupPC v4+? integrated, or DIY via 'DumpPreUserCmd' ?

Sure, there are a lot of ways to do it. The various Dump{Pre|Post}ShareCmds can take arguments that are passed to whatever the first argument specifies as the command. While it doesn't execute it with a shell (to avoid various security issues), it does allow arguments (simple breaking at white

Re: [BackupPC-users] rsync + lvm snapshot in BackupPC v4+? integrated, or DIY via 'DumpPreUserCmd' ?

Sure, setting aside windoze, LVMs are widespread and consistent today, but BackupPC has been around for quite a while. So my comment was probably more historical. Craig On Fri, Oct 2, 2020 at 4:27 PM PGNet Dev wrote: > On 10/2/20 3:35 PM, Craig Barratt wrote: > > Snapshotting is a g

Re: [BackupPC-users] rsync + lvm snapshot in BackupPC v4+? integrated, or DIY via 'DumpPreUserCmd' ?

Snapshotting is a great idea but it's not built in, since the underlying commands and approaches vary so much between different OSes and filesystems. Several users have developed scripts that do snapshots, which are especially beneficial on windoze given the prevalence of enforced file locking.

Re: [BackupPC-users] 'hard-link' usage for BackupPC4 vs rsync ... independent?

Yes, you are correct. The '--hard-links' argument tells rsync to transfer hardlinks from the client. On the server side, hardlinks are not used to store the hardlink information that rsync sends from the client. On restore, the opposite happens - the server side reconstructs the hardlink

Re: [BackupPC-users] Inconsistent backup size

upPC_tarCreate or something > similar, or using backuppcfs, but this is very slow for large backups. > > SAL > > On Mon, Aug 31, 2020 at 12:20:13PM -0700, Craig Barratt wrote: > > I've tried to suggest a couple of reasons that could explain what you are >

Re: [BackupPC-users] Windows backups failing with special characters

Mariano, I believe the unix charset should always be utf-8. It's the dos charset that you should be changing. Craig On Wed, Sep 2, 2020 at 10:51 AM Mariano Aliaga wrote: > On Wed, Sep 2, 2020 at 2:20 PM Craig Barratt < > cbarr...@users.sourceforge.net> wrote: > >&g

Re: [BackupPC-users] Exclude and keep Folderstructure

I don't know the answer, but googling led me to: https://stackoverflow.com/questions/3546001/rsync-how-to-include-directories-but-not-files . So you could try including those -f options in $Conf{RsyncArgsExtra}. Craig On Fri, Aug 28, 2020 at 3:50 PM Taste-Of-IT wrote: > Hello, > > i use

Re: [BackupPC-users] Windows backups failing with special characters

<https://en.wikipedia.org/wiki/Windows-1252>? Craig On Wed, Sep 2, 2020 at 10:05 AM Mariano Aliaga wrote: > Hi Craig, >Thanks for your reply > > On Wed, Sep 2, 2020 at 1:49 PM Craig Barratt via BackupPC-users < > backuppc-users@lists.sourceforge.net> wrote: >

Re: [BackupPC-users] Windows backups failing with special characters

The "tar" errors are from smbclient. Unfortunately the output format of smb messages have changed many times over the years. I'm happy to accept PRs for detecting additional errors it reports if someone wants to submit something. As Jeff points out, rsync is a far better option. It has built

Re: [BackupPC-users] Inconsistent backup size

e hardlinks. > > SAL > > On Mon, Aug 31, 2020 at 09:09:02AM -0700, Craig Barratt via BackupPC-users > wrote: > > That file is a hardlink, not a symlink. In the backup stats, each > instance > > of a hardlink is

Re: [BackupPC-users] BackupPC 4.3.0 Backups not complete

You need to tell us more information. What is the XferMethod? If it's rsync, perhaps you have the --one-file-system option, which causes it to only backup one of the file systems? Are you excluding certain files or directories? If you browse the backup, it is obvious what is missing? Craig

Re: [BackupPC-users] Inconsistent backup size

) wrote: > Hello, > > On Mon, Aug 31, 2020 at 12:08:50AM -0700, Craig Barratt via BackupPC-users > wrote: > > Does your backup include sparse files? > > I think no. > > > Look in the XferLOG file to see the sizes of individual files - it > > shouldn'

Re: [BackupPC-users] Inconsistent backup size

Does your backup include sparse files? Look in the XferLOG file to see the sizes of individual files - it shouldn't be too hard to spot one that is large. Craig On Sun, Aug 30, 2020 at 11:51 PM Ján ONDREJ (SAL) wrote: > Hello, > > I am using BackupPC for years, but after update to v4

Re: [BackupPC-users] Missing variables

Tom, Those names should all be replaced with the actual names or paths specific to your installation. When you ran configure.pl, the values you chose (eg, the name of the BackupPC user, and the TopDir) are used to replace those values. Craig On Sun, Aug 30, 2020 at 4:28 PM Tim Evans wrote: >

Re: [BackupPC-users] Missing variables

What process did you use to install BackupPC (eg, from the tarball source with configure.pl, or a package)? Craig On Sun, Aug 30, 2020 at 2:56 PM Tom Cada wrote: > This is an installation of version 4.4.0 on an Ubuntu Server running 20-04. > > All of the various BackupPC environment variables

Re: [BackupPC-users] Verify full integrity of pool and backups

$Conf{PoolNightlyDigestCheckPercent} is in percent, so you should set it to 100 to check all the pool file's MD5 digest against their file names. As Guillermo mentions, to check the pool MD5 digests, you can set temporarily set $Conf{PoolNightlyDigestCheckPercent} to 100 and

Re: [BackupPC-users] DumpPreUserCmd didnt run anything

For security reasons, BackupPC doesn't use a shell to run any of the external commands, including DumpPreUserCmd. It uses fork() and exec(). It does split the string you provide at spaces (but doesn't understand quoting). Or you can set those commands to an array - the first entry is the full

Re: [BackupPC-users] Backups vanished from UI but present in file system

Raoul, Thanks for maintaining the Debian packages! I'm not sure how the backups files got corrupted. First, do you really have a host called $host, or are you just obfuscating the real host name? The reason I ask if there is this line in the LOG file: Added host $host to backup list When

Re: [BackupPC-users] backuppc won't start after host migration

Dagg, The error should be self-explanatory - either /mnt/backup is a file system that doesn't support hardlinks, or /mnt/backup/pc and /mnt/backup/cpool are two different file systems (and therefore hardlinks between them fail). Are they two different file systems? Craig On Wed, Aug 12, 2020 at

Re: [BackupPC-users] Sign out

I appreciate the feedback. Please use the "List " link in the footer of any email to unsubscribe. Mailing to the list mails everyone on the list. It doesn't help you unsubscribe. Craig On Tue, Jul 21, 2020 at 2:22 PM Ants Mark

Re: [BackupPC-users] Backup installation of BackupPC

>From the web interface, can you see the old hosts information? What happens when you select one of the hosts? The most likely issue is that $Conf{TopDir} in the config file isn't pointing to the top-level store directory on the old disk. If you need the file urgently, rather than just testing

Re: [BackupPC-users] backuppc process will not stop

Mark, Perhaps systemd is being used to run BackupPC? What output do you get from: systemctl status backuppc If it shows as active/running, then the correct command to stop BackupPC is: systemctl stop backuppc Craig On Mon, Jun 29, 2020 at 11:05 AM Mark Maciolek wrote: > hi, > > Running

Re: [BackupPC-users] Unable to connect on port -1

The CGI script is trying to connect to the BackupPC server using the unix-domain socket, which is at $Conf{LogDir}/BackupPC.sock. From your email, on your system that appears to be /var/lib/log/BackupPC.sock. Are you running nfs v3 or v4? I have had experience with v3 not working reliably with

Re: [BackupPC-users] [BackupPC-devel] BackupPC 4.4.0 released

You can install the perl module Module::Path to find the path for a module. After installing, do this: perl -e 'use Module::Path "module_path"; print(module_path("BackupPC::XS")."\n");' Example output: /usr/local/lib/x86_64-linux-gnu/perl/5.26.1/BackupPC/XS.pm Now try as root and the BackupPC

Re: [BackupPC-users] Is there a reason that DumpPreUserCmd (and its analogs) are executed without a shell?

Jeff, The reason BackupPC avoids running shells for sub-commands is security, and the extra layer of argument escaping or quoting. It's easy to inadvertently have some security weakness from misconfiguration or misuse. Can you get what you need by starting the command with "/bin/bash -c"? You

Re: [BackupPC-users] [BackupPC-devel] BackupPC 4.4.0 released

Mike, It's possible you have two different versions of perl installed, or for some reason the BackupPC user is seeing an old version of BackupPC::XS. Try some of the suggestions here: https://github.com/backuppc/backuppc/issues/351. Craig On Wed, Jun 24, 2020 at 10:12 AM Richard Shaw wrote:

[BackupPC-users] BackupPC 4.4.0 released

BackupPC 4.4.0 has been released on Github. This release contains several new features and some bug fixes. New features include: - any full/filled backup can be marked for keeping, which prevents any expiry or deletion - any

Re: [BackupPC-users] Keep only one Full Backup as Archive

Stefan, BackupPC_backupDelete is only available in 4.x. Craig On Thu, Jun 18, 2020 at 2:33 AM Stefan Schumacher < stefan.schumac...@net-federation.de> wrote: > > > If you want to remove a backup, best to use a script built to do it > > right -- BackupPC_backupDelete. Not sure if it is bundled

Re: [BackupPC-users] how to disable full backups and keep just incremental

Dagg, What version of BackupPC are you using? Craig On Wed, Jun 10, 2020 at 7:24 AM daggs wrote: > Greetings, > > I have two large (several hundreds gigabytes) backups that keep failing > due to abort or child end unexpectedly. I ran it three times already. > I want to disable the full backup

Re: [BackupPC-users] What is the best way to add back MISSING pool files?

Jeff, The first method seems simpler. Don't you just have to mv the file based on BackupPC_zcat file | md5sum? BackupPC_nightly shouldn't need to run (other than to check you no longer get the missing error). Btw, where did you find the missing pool files? For the benefit of people on the

Re: [BackupPC-users] attrib_0 files?

Jeff, I don't think there's much different whether a directory has an empty attrib file or not. The reason they exist is when a directory ends up being empty after updating the directory. The reason a directory might exist without one is when reverse deltas require a change deeper in the

Re: [BackupPC-users] Discrepancy in *actual* vs. *reported* missing pool files

Jeff, We've discussed at least one issue off-list - making sure you consider inodes too. It looks like BackupPC_fsck -f only rebuilds the last two backup refcounts for each host. It should use the -F option instead of -f when it calls BackupPC_refcountUpdate (see line 630). So you should try

Re: [BackupPC-users] How does --checksum work in v4?

untley wrote: > I’m fine with both action items. > > I back up millions of emails and so far the restores I’ve performed have > never been an issue. > > mph > > > > On Jun 8, 2020, at 3:01 PM, Craig Barratt via BackupPC-users < > backuppc-users@lists.source

Re: [BackupPC-users] How does --checksum work in v4?

Jeff & Guillermo, Agreed - it's better to scan small subsets of the pool. I'll add that to BackupPC_refCountUpdate (which does the nightly pool scanning to delete unused files and update stats). Craig On Mon, Jun 8, 2020 at 2:35 PM wrote: > Guillermo Rozas wrote at about 16:41:03 -0300 on

Re: [BackupPC-users] How does --checksum work in v4?

Guillermo, Yes, that's an excellent point. Actually v3 suffers from this too since, with cached block and full-file checksums, it doesn't recheck the file contents either. However, v3 had a parameter $Conf{RsyncCsumCacheVerifyProb} (default 0.01 == 1%) that caused rsync to verify that random

Re: [BackupPC-users] How does --checksum work in v4?

Jeff, Yes, that's correct. In v4 a full backup using --checksum will compare all the metadata and full-file checksum. Any file that matches all those will be presumed unchanged. In v4 the server load for a full is very low, since all that meta data (including the full-file checksum) is stored

Re: [BackupPC-users] Regarding Transport mechanism limitations

Ok, I'll remove that. There isn't an 18GB limit. Kris was simply saying that 18GB files work fine. Craig On Tue, Jun 2, 2020 at 12:41 PM wrote: > The url in "Some Limitations" section of updated docs are pointing to old > docs > > Thanks. Is there a way to work around 18 GB limit ? > > On

Re: [BackupPC-users] Thank you far an easier installation

Thanks to folks who have developed packages for several linux flavors, and also for updating the wiki . It would be great to get additional volunteers to develop and maintain packages for remaining linux distros, and submitting them upstream. If you are

Re: [BackupPC-users] Regarding Transport mechanism limitations

Kris is correct - the limits in 4.x (and 3.x) are much higher than suggested by that very old FAQ, certainly for rsync. Craig On Tue, Jun 2, 2020 at 11:44 AM Kris Lou via BackupPC-users < backuppc-users@lists.sourceforge.net> wrote: > Updated Docs (4.x) are here:

Re: [BackupPC-users] how to install SCGI , exactly??

Step-9:-CGI-interface ) > > The amount of time spent analyzing all this stuff might be better spent just > building something from scratch :( > > > -- Original Message -- > From: "Craig Barratt via BackupPC-users" < > backuppc-users@lists.sourceforge

Re: [BackupPC-users] Spurious "file doesn't exist" messages... BUG?

ges... > > The only remaining issue I see now is with SELinux extended attributes > :) > > Plus, the challenges with hangs on bpc-rsyn 3.1.2 and 3.1.3-beta0 > > Craig Barratt via BackupPC-users wrote at about 13:08:31 -0700 on Monday, > May 25, 2020: > > Jeff, >

Re: [BackupPC-users] Spurious "file doesn't exist" messages... BUG?

Jeff, Thanks for figuring that out. I pushed a fix so the warning doesn't get printed on zero-length files. Craig On Mon, May 25, 2020 at 8:08 AM wrote: > Presumably the problem is in rsync-bpc:

Re: [BackupPC-users] Problems with latest rsync-bpc 3.1.3 - zlib??

Thanks for the updates. Yes, rsync's included zlib isn't compatible with system zlib. However, since you are not using the -z option, I don't think that's the issue. Can you try rsync-bpc 3.1.2.1? It has more testing than 3.1.3.beta0. Craig On Sun, May 24, 2020 at 7:43 PM wrote: >

  1   2   3   4   5   6   7   8   9   10   >