Re: [BackupPC-users] backuppc 4: rsync error: unexplained error (code 255) at io.c(629) [Receiver=3.0.9.8])

2017-07-29 Thread Craig Barratt via BackupPC-users
First, you should only need to add the $Conf{RsyncBackupPCPath} setting to the main config file. It's likely that that $Conf{RsyncClientPath} is not set correctly based on the old $Conf{RsyncClientCmd} setting. What are those settings? You should look in one of the failed backup XferLOG.bad

Re: [BackupPC-users] backuppc 4: rsync error: unexplained error (code 255) at io.c(629) [Receiver=3.0.9.8])

2017-08-13 Thread Craig Barratt via BackupPC-users
> > $Conf{RsyncClientCmd} = '$sshPath -q -x -l root $host $rsyncPath > $argList+'; That setting is not used in 4.x. You now say: and all seems to be fine but every backup tries to login on a host with the > backuppc account so it appears backups are now working correctly. If ssh is using

Re: [BackupPC-users] FTP backup of website

2017-08-13 Thread Craig Barratt via BackupPC-users
> > Can't use string ("0") as an ARRAY ref while “strict refs” in use at > /usr/local/BackupPC/lib/BackupPC/Xfer/Ftp.pm line 998 A few weeks ago I pushed this fix to correct this error. Craig On Wed, Jul 12,

Re: [BackupPC-users] Dealing with large directories.

2017-08-14 Thread Craig Barratt via BackupPC-users
te.edu> wrote: > > Craig- > > Thanks for taking a look at this. > > > > On Sun, Aug 13, 2017 at 8:06 PM, Craig Barratt via BackupPC-users < > backuppc-users@lists.sourceforge.net> wrote: > >> Ray, >> >> What is the XferMethod and backup schedule (ie,

Re: [BackupPC-users] Dealing with large directories.

2017-08-13 Thread Craig Barratt via BackupPC-users
Ray, What is the XferMethod and backup schedule (ie, how often do you do incrementals and fulls)? Which backup are you viewing (ie, how many incrementals need to be merged to view it)? Are you running v3 or v4? Two options are to: - use BackupPC_ls so you can see the backup tree using the

Re: [BackupPC-users] mistake during server migration - how to prevent trash cleanup from file removal?

2017-08-13 Thread Craig Barratt via BackupPC-users
I would like to understand the steps you took. First, by "server A" and "server B" you mean clients that BackupPC backs up? When you said "on my BackupPC I deleted "A:data"" did you mean you simply removed that share from the config.pl for server A, or did you actually delete files below the

Re: [BackupPC-users] BackupPC_serverMesg has no effect?

2017-08-13 Thread Craig Barratt via BackupPC-users
Sorry about the poor documentation for BackupPC_serverMesg, but in most cases you should use the same argument for host and hostIP. So try this instead: /usr/share/backuppc/bin/BackupPC_serverMesg backup humppa humppa backuppc 1 Craig On Sat, Jul 22, 2017 at 8:42 AM, Les Mikesell

Re: [BackupPC-users] V4, Set port for SSH

2017-08-10 Thread Craig Barratt via BackupPC-users
Pelle, In 4.x you should use $Conf{RsyncSshArgs}. Craig On Thu, Aug 10, 2017 at 11:51 AM, Pelle Hanses wrote: > Hi, > I have upgraded to V4 (4.1.2) and everything seems to work except from > setting SSH port. How can I set the port SSH will connect to? > In version 3 I

Re: [BackupPC-users] Error in rsync protocol data stream

2017-07-09 Thread Craig Barratt via BackupPC-users
Wade, How far does it get when you get the error? If it doesn't get very far, you could manually run: BackupPC_dump -f -v client and email the output. If instead it happens a long way into the backup, please send the exact rsync_bpc command that is being run (from the XferLOG file)? One

Re: [BackupPC-users] BackupPC 4.1.x vs. MacOS rsyncd

2017-07-09 Thread Craig Barratt via BackupPC-users
Josh, As Bob points out, I'd also recommend using native rsync 3.x (from homebrew), not the one that ships with OSX. Dan has accurately described one change in 4.x that might not be backward compatible with your rsyncd configuration: 4.x uses the rsync iconv option, which requires rsyncd.conf on

Re: [BackupPC-users] Ran out of inodes

2017-07-15 Thread Craig Barratt via BackupPC-users
It's important to realize that a mixed V3/V4 installation will use more inodes than just V3 or V4 alone. If you migrate an existing V3 installation to V4 (using BackupPC_migrateV3toV4), the inode usage to store the backup trees will double, while the inode usage to store the pool files will be

Re: [BackupPC-users] BackupPC_tarExtract exited with fail status 256

2017-07-16 Thread Craig Barratt via BackupPC-users
I'd like to get to the bottom of this. First, please summarize your relevant $Conf Xfer settings for this host. Can you email the first several lines of the XferLOG file, in particular the lines that print which external commands it is running. When the tar backup appears to be stalled, please

Re: [BackupPC-users] status graph

2017-07-30 Thread Craig Barratt via BackupPC-users
; > [root@backuppc cpool]# ls -li f/f/f/fff33b3ff92969f322863a4363a15f7a > > 71819 -rw-r-. 3 nobody nobody 199706 Jun 16 2016 > > f/f/f/fff33b3ff92969f322863a4363a15f7a > > [root@backuppc cpool]# cd - > > /mnt/backuppc/pc > > [root@backuppc pc]# find . -type f -

Re: [BackupPC-users] restore .tar / .zip files empty #128

2017-07-30 Thread Craig Barratt via BackupPC-users
Doug, Since you copied the exact source from git, you should make sure these two lines (the first, and a few lines down): #!/usr/bin/perl use lib "/usr/local/BackupPC/lib"; in BackupPC_tarCreate and BackupPC_zipCreate point to the correct perl and BackupPC lib directory on your

Re: [BackupPC-users] backuppc 4: rsync error: unexplained error (code 255) at io.c(629) [Receiver=3.0.9.8])

2017-07-30 Thread Craig Barratt via BackupPC-users
Moving that setting to the main config file wasn't intended to be a fix - it was simply an observation that it is simpler to put global settings in the main config file. The XferLOG.bad file can be accessed from the client's status page via the web interface, or from the command line. If HOST is

Re: [BackupPC-users] I'd like to make a suggestion to the BPC devsm

2017-07-30 Thread Craig Barratt via BackupPC-users
Back to the original request - you could set up a second BackupPC host (using ClientNameAlias to point to the real host) to do incrementals-only (with rsync) every hour. However, as others have noted, it's a lot less efficient to do that versus snapshots: rsync has to traverse the whole client

Re: [BackupPC-users] Using many storage pools

2017-07-30 Thread Craig Barratt via BackupPC-users
> > So, I think to run two instance of BackupPC on the server with different > storage directory. Is there a proper way to do this? It is possible to run two separate BackupPC instances. However, you have to be careful to make sure all the key installation directories (and configuration paths

Re: [BackupPC-users] restore .tar / .zip files empty #128

2017-07-30 Thread Craig Barratt via BackupPC-users
Doug, Here's a simplified combined patch. After you gunzip it, it should work cleanly on 4.1.2, 4.1.3 etc. Craig On Sun, Jul 30, 2017 at 3:10 PM, Doug Lytle via BackupPC-users < backuppc-users@lists.sourceforge.net> wrote: > On 07/30/2017 05:42 PM, Doug Lytle via BackupPC-users wrote: > >>

Re: [BackupPC-users] BackupPC_tarExtract exited with fail status 256

2017-07-30 Thread Craig Barratt via BackupPC-users
I just pushed a change to git to make the SMB pipe non-blocking, which is the same change I made to Tar.pm in 4.1.3 to fix a stall issue with tar reported by Matt Bedynek. Here's a diff that you could apply

Re: [BackupPC-users] restore .tar / .zip files empty #128

2017-07-30 Thread Craig Barratt via BackupPC-users
Doug, I pushed a fix that should fix the problem. Craig On Sun, Jul 30, 2017 at 4:54 AM, Doug Lytle via BackupPC-users < backuppc-users@lists.sourceforge.net> wrote: > I'm looking for a patch for the GitHub

Re: [BackupPC-users] restore .tar / .zip files empty #128

2017-07-30 Thread Craig Barratt via BackupPC-users
Doug, I just pushed a minor fix to the last commit. Please tell me if these two patches work in your setup. Craig On Sun, Jul 30, 2017 at 10:43 AM, Craig Barratt < cbarr...@users.sourceforge.net> wrote: >

Re: [BackupPC-users] Question about v4

2017-08-07 Thread Craig Barratt via BackupPC-users
Sorry that it isn't very clearly stated - yes, v4 does store inode-like information in the backup tree (and can therefore accurately represent hardlinks etc), but it uses regular files to do it - it doesn't use real hardlinks, and it doesn't depend on the real client's inode (and inode numbers) on

Re: [BackupPC-users] Using SMBv2/Disabled SMBv1 on Windows Hosts, Not Backing Up

2017-06-12 Thread Craig Barratt via BackupPC-users
James, Sven Bunge submitted a pull request to add the -m option to $Conf{SmbClientFullCmd}. His patch uses "-mSMB3". I haven't applied the PR since I don't know about backward compatibility with old versions of smbclient. Can you test his change?

Re: [BackupPC-users] BackupPC Excludes - How To

2017-06-20 Thread Craig Barratt via BackupPC-users
Akibu, The convention is to not use the trailing "/" on rsync share names. Unlike most linux utilities, in certain cases rsync will behave differently whether or not there is a trailing "/" on a directory name. So you probably want do this: $Conf{RsyncShareName} = "/cygdrive/j";

Re: [BackupPC-users] Trying to limit my backups

2017-06-21 Thread Craig Barratt via BackupPC-users
Try this. Craig $Conf{SmbShareName} = [ 'C$' ]; $Conf{BackupFilesOnly} = { 'C$' => [ '/Users', '/ProgramData' ] }; On Wed, Jun 21, 2017 at 2:30 PM, Jeffrey West via BackupPC-users < backuppc-users@lists.sourceforge.net> wrote: > All, > > > > I am having a heck of a time trying to

Re: [BackupPC-users] Feature request: Restore Search across all shares/backups

2017-06-14 Thread Craig Barratt via BackupPC-users
Les is right for 3.x. For 4.x the files are not stored in the backup tree. So you'll need to use BackupPC_ls -R, or you could also grep the XferLOG.nnn.z files (although the format and what appears or not depends on the XferMethod). Examples: BackupPC_ls -R -h HOST -n NUM -s SHARE / | egrep

Re: [BackupPC-users] Fuse filesystem to explore backups

2017-06-17 Thread Craig Barratt via BackupPC-users
Daniel, I updated backuppcfs.pl for 4.x. I've attached the gzip'ed new version. Unfortunately fuse creates its own inode numbers, so hardlinks won't be correctly rendered via fuse (ie: the inode numbers of two hardlinked files won't be the same when viewed via fuse). Craig On Thu, Jun 15,

Re: [BackupPC-users] acls and xattrs attributes

2017-06-11 Thread Craig Barratt via BackupPC-users
evel you could add > that the range is 1 through 10. (I was uncomfortable, guessing that 10 was > the limit.) > > I have said it before and many others have also, GREAT JOB!! Backuppc is > very good!!! > > On Sat, Jun 10, 2017 at 9:17 PM, Craig Barratt via BackupPC-users < >

Re: [BackupPC-users] Unexplained Error Code 255 - BackupPC

2017-06-11 Thread Craig Barratt via BackupPC-users
3665 > BackupPC_refCountUpdate: computing totals for host akibu-desktop > bpc_lib_conf_init: topDir = /mnt/backup_disks/backuppc, logLevel = 9 > bpc_attrib_backwardCompat: WriteOldStyleAttribFile = 0, KeepOldAttribFiles > = 0 > BackupPC_refCountUpdate: host akibu-desktop go

Re: [BackupPC-users] Unexplained Error Code 255 - BackupPC

2017-06-11 Thread Craig Barratt via BackupPC-users
> > debug1: connect to address 10.10.10.10 port 22: Connection timed out > ssh: connect to host akibu-desktop port 22: Connection timed out Ok, this confirms that ssh to your client does not work. You need to figure out whether sshd is running on your client, or whether the windoze firewall is

Re: [BackupPC-users] Unexplained Error Code 255 - BackupPC

2017-06-11 Thread Craig Barratt via BackupPC-users
got 0 errors > Xfer PIDs are now > Finished BackupPC_backupDelete, status = 0 (running time: 0 sec) > Xfer PIDs are now > Running BackupPC_refCountUpdate -h akibu-desktop -f on akibu-desktop > Xfer PIDs are now 3665 > BackupPC_refCountUpdate: computing totals for host akibu-des

Re: [BackupPC-users] Unexplained Error Code 255 - BackupPC

2017-06-11 Thread Craig Barratt via BackupPC-users
> > Failed to add the host to the list of known hosts > (/home/backuppc/.ssh/known_hosts). > In addition to password-less login, this error is also a problem. It probably means your permissions on ~backuppc/.ssh/known_hosts are wrong. Without the client being in known_hosts, ssh will prompt

Re: [BackupPC-users] acls and xattrs attributes

2017-06-10 Thread Craig Barratt via BackupPC-users
Bob, There doesn't seem to be anything untoward in the log information you sent. To figure out why /home is empty, you should post the specific rsync_bpc commands (that are in the XferLOG file). Note that for 4.1.2, I added --one-file-system to the default $Conf{RsyncArgs}, and it also adds

Re: [BackupPC-users] Unexplained Error Code 255 - BackupPC

2017-06-10 Thread Craig Barratt via BackupPC-users
The strace is showing the dynamic linking during startup of ssh, which isn't particularly relevant. It's not showing the files being backed up. What we are missing is the log output from XferLOG. That has the more detailed information (eg, exact rsync / ssh args). Can you send that please?

Re: [BackupPC-users] log level setting limits

2017-06-10 Thread Craig Barratt via BackupPC-users
Any value is allowed, but the meaningful values are between 0 and 10. Increasing the value generates more log output. At XferLogLevel == 1 you should get one line of output per file, and it goes up from there. If I'm trying to track down a problem, I usually start at 7. You can also get

Re: [BackupPC-users] A cleanup question for orphaned backup directories.

2017-06-10 Thread Craig Barratt via BackupPC-users
Ray, Sorry about the delay in replying. I'm not sure why those two directories are still around; BackupPC_backupDelete didn't report any errors. It also didn't delete the XferLOG.[56].z files. It looks like #3 was correctly deleted, and XferLOG.3.z too. What's in those directories? Are they

Re: [BackupPC-users] Proper syntax to delete a particular directory within a share

2017-06-13 Thread Craig Barratt via BackupPC-users
Bob, Try this (add a space after the share name, and add quotes around the path since it contains a space): ./BackupPC_backupDelete -h n6850.local -n 4 -s Backup-Data-Folder "/Time Machine" Craig On Tue, Jun 13, 2017 at 7:54 PM, Bob Katz wrote: > I'm trying to delete an

Re: [BackupPC-users] Valid SshPath

2017-06-15 Thread Craig Barratt via BackupPC-users
Lano, That setting needs to point to an executable without any arguments. If you can't inject the right arguments elsewhere (eg, ssh config, other Xfer commands), then I'd recommend making a short shell script, eg, /usr/local/bin/backuppc_sshpass that executes the command with the arguments you

Re: [BackupPC-users] BackupPC v4 and rsync for localhost

2017-06-15 Thread Craig Barratt via BackupPC-users
You can set $Conf{RsyncSshArgs} to a command that simply executes its arguments (like ssh does). However, rsync adds the host name to whatever you specify in $Conf{RsyncSshArgs}, so unfortunately this doesn't work since the first argument is the host name, and env will give an error:

Re: [BackupPC-users] BackupPC_migrateV3toV4 failing

2017-06-15 Thread Craig Barratt via BackupPC-users
Daniel, It looks like it is reading a V3 file, and the file size from the attributes is bigger than how much data it read from the file. This is probably due to some sort of disk data corruption. At line 722 of /usr/share/BackupPC/lib/BackupPC/Lib.pm there is this code:

Re: [BackupPC-users] BackupPC v4 and rsync for localhost

2017-06-15 Thread Craig Barratt via BackupPC-users
> > Doesn't BPC v4 have the "rsyncd" transfer method? That uses pure rsync > with no encryption overhead. Yes v4 supports rsyncd. Craig -- Check out the vibrant tech community on one of the world's most engaging tech

Re: [BackupPC-users] Feature request: Restore Search across all shares/backups

2017-06-15 Thread Craig Barratt via BackupPC-users
> > [backuppc@localhost bin]$ ./BackupPC_zcat /Bobby/pc/*/XferLOG.*.z | egrep > *headphone* > > The output of this command is instantaneous! So the search from the CLI > is very powerful and VERY fast. The problem is that the results do not > tell which backup has the resulting file, the backup

Re: [BackupPC-users] status graph

2017-06-18 Thread Craig Barratt via BackupPC-users
better to find solution and delete unused > data? > > On 11 June 2017 at 13:00, Craig Barratt via BackupPC-users > <backuppc-users@lists.sourceforge.net> wrote: > > Alex, > > > > First you should check to see what's left in the v3 cpool, eg: > > > >

Re: [BackupPC-users] status graph

2017-06-10 Thread Craig Barratt via BackupPC-users
Alex, First you should check to see what's left in the v3 cpool, eg: cd /data/BackupPC/cpool ls -lR [0-9a-f] du -s ?/?/? Next you could pick a file and find its inode number and number of links: ls -li 0/1/2/1234567890abcdef Are there any files with >1 links? If so, you could

Re: [BackupPC-users] Manual backup not done, kno warning, no error, no logs

2017-09-16 Thread Craig Barratt via BackupPC-users
Adam, There are three places to look for an error: - in the main server LOG - in that backup client's LOG - in that backup's XferLOG.bad.z file Each are available via the GUI, or you can look at that from the command-line. Craig On Sat, Sep 16, 2017 at 7:18 AM, Adam Hardy

Re: [BackupPC-users] RefCntFsck

2017-09-19 Thread Craig Barratt via BackupPC-users
If a backup fails or is aborted, BackupPC_refCntUpdate is run on the last two backups, independent of the $Conf{RefCntFsck} setting. Craig On Tuesday, September 19, 2017, Gandalf Corvotempesta < gandalf.corvotempe...@gmail.com> wrote: > refCnt is also run on backup #1 (that in my case is the

Re: [BackupPC-users] BackuPC 4 hang during transfer

2017-09-21 Thread Craig Barratt via BackupPC-users
Yes, Les is right - if you change compression (on to off, or off to on) then the next backup will be like a first-time backup - it will be forced to a full and will not take advantage of any prior backup. Back to OP - from the rsync_bpc args you sent, it looks like you have XferLogLevel set to 0.

Re: [BackupPC-users] BPC4: shared files from pool and compression

2017-09-21 Thread Craig Barratt via BackupPC-users
You can look in the XferLOG file to see whether a file is transferred or not, and whether it matches the pool. You can also use BackupPC_ls to list the contents of an existing client backup. It prints the digest of each file. If you run it on two different backups, and /bin/ls has the same

Re: [BackupPC-users] BackuPC 4 hang during transfer

2017-09-19 Thread Craig Barratt via BackupPC-users
(please ignore this reply - I queued it up a few hours ago on a plane ride, and it just sent now after several more useful replies to the thread) On Tuesday, September 19, 2017, Craig Barratt < cbarr...@users.sourceforge.net> wrote: > Gandalf, > > What XferMethod are you using? > > Yes, it would

Re: [BackupPC-users] cygwin-rsyncd-3.1.2.1: service cygrunsrv

2017-09-19 Thread Craig Barratt via BackupPC-users
Yes, the latest cygwin-rsyncd-3.1.2.1 is only 64 bit. In addition to trying deltacopy, you could try removing the --protect-args option from $Conf{RsyncArgs}. Craig On Monday, September 18, 2017, Pascal Mosimann wrote: > Le 18. 09. 17 à 15:32, Carl Soderstrom a écrit

Re: [BackupPC-users] BackuPC 4 hang during transfer

2017-09-19 Thread Craig Barratt via BackupPC-users
Gandalf, What XferMethod are you using? Yes, it would be interesting to see the strace output for each BackupPC_dump process when it hangs. Craig On Tuesday, September 19, 2017, Gandalf Corvotempesta < gandalf.corvotempe...@gmail.com> wrote: > Still getting the same issue. > Backup for a

Re: [BackupPC-users] BackuPC 4 hang during transfer

2017-09-20 Thread Craig Barratt via BackupPC-users
> > An order of magnitude is totally unacceptable and can only mean some bugs > in the code. Only BPC is slow as hell. Since you have concluded what the problem is, I don't have anything constructive to add. Craig On Tue, Sep 19, 2017 at 11:41 PM, Gandalf Corvotempesta <

Re: [BackupPC-users] Automatic backups not working

2017-10-07 Thread Craig Barratt via BackupPC-users
Have you looked in both the main server log, and the per-host log? An alternative is to manually run BackupPC_dump with the -v option. It should say what it's doing or not doing: su backuppcUser /usr/local/BackupPC/bin/BackupPC_dump -v HOST Also, please confirm that your HOST's (and/or main)

Re: [BackupPC-users] scgi : BackupPC_Admin_SCGI: can't load perl SCGI module - install via CPAN; exiting in 60 seconds

2017-10-01 Thread Craig Barratt via BackupPC-users
You are missing the CPAN scgi module, so you should install it (eg, via CPAN). Since BackupPC_Admin_SCGI fails, apache complains that it can't connect to the SCGI server. Craig On Sun, Oct 1, 2017 at 2:38 PM, Li, Guoqing Gary (gl4n) wrote: > Please help. I am trying to set

Re: [BackupPC-users] netbios name not retrieved

2017-10-01 Thread Craig Barratt via BackupPC-users
That's not the expected output from nmblookup for a valid netbios host name. If the host has a fixed IP address, it's much better to use that. You can use whatever host name you want, and set $Conf{ClientNameAlias} to its IP address. Craig On Fri, Sep 29, 2017 at 6:11 AM, François Dagorn

Re: [BackupPC-users] backup blackout question

2017-08-27 Thread Craig Barratt via BackupPC-users
Alexey, Yes, that should work. Craig On Sun, Aug 20, 2017 at 9:48 PM, Alexey Safonov wrote: > I want some of my servers to be backed up during weekends only. is it > correct synatax to dibasble weekdays backups ? > > $Conf{BlackoutPeriods} = [ > { >

Re: [BackupPC-users] rsync-bpc 3.0.9.8 with rrsync on the client

2017-08-27 Thread Craig Barratt via BackupPC-users
Sebastian, I haven't used rrsync. The --protect-args option causes file names to be sent over the socket, not the command-line. So try removing that option. (One caveat: without that option, spaces or special characters in the share name won't work since the shell will try to interpret them,

Re: [BackupPC-users] archive / extract to usb drive

2017-08-27 Thread Craig Barratt via BackupPC-users
Ulrich, As Kris suggested, you could use a script to create a copy of the latest backup tree. For example, you could use a command like this (replace HOST, SHARENAME and /PATH/TO/USB/DRIVE) to extract the most recent backup of share SHARE on host HOST: BackupPC_tarCreate -h HOST -n -1 -s

Re: [BackupPC-users] Xfer errors for 31 files

2017-08-27 Thread Craig Barratt via BackupPC-users
Daniel, Can you check if there is an attrib file in that directory (/var/lib/BackupPC//pc/robert/242/f%2f/fusr/fbin)? (You might need to update the 242 to be the number of the latest filled backup.) It should have a file name of the form "attrib_" where is 32 hex digits. Next, run this

Re: [BackupPC-users] mistake during server migration - how to prevent trash cleanup from file removal?

2017-08-27 Thread Craig Barratt via BackupPC-users
; Dear Craig, > > On Sun, Aug 13, 2017 at 07:30:00PM -0700, Craig Barratt via BackupPC-users > wrote: > > I would like to understand the steps you took. > > > > First, by "server A" and "server B" you mean clients that BackupPC backs > up? > >

Re: [BackupPC-users] Best way to install BackupPC to easily be able to update

2017-08-27 Thread Craig Barratt via BackupPC-users
Pelle, If there isn't a package available, it's quite easy to install BackupPC from the tar distribution. See the releases on Github: download BackupPC-4.1.3.tar.gz and follow the instructions on the main BackupPC Github page

Re: [BackupPC-users] File not present in backup

2017-08-27 Thread Craig Barratt via BackupPC-users
Wade, What XferMethod are you using? Does the backup run as root, or as a non-privileged user? Did the 11:00 backup finish before 15:00? If you look in the XferLOG file, do you see that the file was backed up? Similarly for the directory? Craig On Fri, Aug 25, 2017 at 10:57 AM, Jenkins, Wade

Re: [BackupPC-users] Watching restore status

2017-11-24 Thread Craig Barratt via BackupPC-users
What BackupPC version and Xfer method are you using? Version 4.x with rsync does periodically report number of files transferred. You could look at the restore log file, but it isn't flushed to disk that often and it's compressed. Something like this should work: tail -c +0

Re: [BackupPC-users] rsync error buffer overflow

2017-11-24 Thread Craig Barratt via BackupPC-users
BackupPC 3.x uses older versions of the rsync protocol, which requires the entire file list to be stored in memory. BackupPC 4.x uses pretty up-to-date versions of rsync, which no longer requires the full file list to be stored. So it's likely that BackupPC 4.x will have a better chance of

Re: [BackupPC-users] Problem BackupPC 4 report double files count and size

2017-11-24 Thread Craig Barratt via BackupPC-users
This was fixed in this commit on July 30. Will be included in 4.1.4, to be released soon (hopefully). Craig On Fri, Nov 24, 2017 at 11:38 AM, Stéphane Bourque < stephane.bour...@croesus.com> wrote: > Hello,

Re: [BackupPC-users] problem with samba

2017-11-24 Thread Craig Barratt via BackupPC-users
> > [root@barak ~]# smbclient //hayun-34/gis -U micha -E -d 3 -c tarmode full I believe you need to pass a single argument to -c, so either quote it, or add a backslash: [root@barak ~]# smbclient //hayun-34/gis -U micha -E -d 3 -c 'tarmode full' What is $Conf{SmbClientFullCmd} set to on this

Re: [BackupPC-users] Documentation version discrepancies

2017-11-24 Thread Craig Barratt via BackupPC-users
That snippet of text is from the 3.x documentation, where filling was indeed a legacy feature. It's not present in the 4.x documentation, where filling has another meaning and purpose. Craig On Wed, Nov 22, 2017 at 9:18 AM, Jamie Burchell wrote: > "Filling backups takes a

Re: [BackupPC-users] Execute bash script after each share on backup server

2017-11-24 Thread Craig Barratt via BackupPC-users
> > But why Error 256 when it's 1? And the last Line the scripts outputs is: Perl shifts the exit status left by 8 bits, so the reported exit status is 256 times your program's exit status. 2017-11-23 16:18:08 Output from DumpPreShareCmd: ERROR: Index * on *** > corrupted or locked! I'm

Re: [BackupPC-users] Don't expand first backed up directory by default?

2017-11-24 Thread Craig Barratt via BackupPC-users
Jamie, Unfortunately it's not easy to have none open, since the browse code assumes you have selected a particular share. How about this: by default it opens the last one, rather than the first? That way all the other shares will appear first. It's a very simple change if you want to try it.

Re: [BackupPC-users] Bug in rsync_bpc --sparse?

2017-12-14 Thread Craig Barratt via BackupPC-users
Unfortunately sparse files are not supported by rsync_bpc, and there are no plans to do so. I should make it a fatal error if that option is specified. I believe a full backup (without --sparse of course) should update the files to their correct state. Craig On Thu, Dec 14, 2017 at 4:59 AM,

Re: [BackupPC-users] BackupPC 4.1.5 released (plus new versions of backuppc-xs and rsync-bpc)

2017-12-13 Thread Craig Barratt via BackupPC-users
There were a couple of bugs in rsync-bpc-3.0.9.9 that are fixed in a newly released rsync-bpc-3.0.9.11 . If you have installed rsync-bpc-3.0.9.9 or rsync-bpc-3.0.9.10, please upgrade to rsync-bpc-3.0.9.11. Craig On Sun, Dec 3, 2017 at

Re: [BackupPC-users] problem with samba

2017-11-19 Thread Craig Barratt via BackupPC-users
Micha, I've tested Samba 4.7.0 and it works; I don't think the tar options have changed. The NT_STATUS_LOGON_FAILURE error shouldn't be bogus. But I can't explain why incrementals work. Can you experiment with running smbclient manually to see what options do and don't work? Craig On Thu,

Re: [BackupPC-users] Documentation version discrepancies

2017-11-19 Thread Craig Barratt via BackupPC-users
To be clear, the documentation link in the BackupPC CGI interface (and all links for things like config parameters) point to the (locally stored) documentation for the version you are running. That way it's consistent with whatever version you are running. Craig On Sat, Nov 18, 2017 at 11:15

Re: [BackupPC-users] PC Backup Genie message

2017-11-19 Thread Craig Barratt via BackupPC-users
> > Is there any easy way to make PC Backup Genie ignore this file during its > checks ? No, unfortunately it's not configurable. You could comment the code out in BackupPC_sendEmail if you want, specifically this line: push(@oldDirs, "$TopDir/pc/$host"); Craig On Thu, Nov 16, 2017 at

Re: [BackupPC-users] Backup hung well past timeout value

2017-11-05 Thread Craig Barratt via BackupPC-users
What's your BackupPC version and XferMethod? Craig On Wed, Oct 25, 2017 at 6:28 AM, Jenkins, Wade William wrote: > I’ve got the timeout for my backups set at 36000 seconds (10hrs). I’ve > currently got two backups that appear to have been hung/inactive for almost > 5 days. >

Re: [BackupPC-users] Backups missing from webpage

2017-11-05 Thread Craig Barratt via BackupPC-users
Gerald, 3.1 is a pretty old version. But it includes a script bin/BackupPC_fixupBackupSummary which tries to re-create the backups file. I'd recommend making a backup copy of the backups file: su backuppc cd /var/lib/backuppc/pc/wpg-sbs.erlphase.com cp backups backups.save

Re: [BackupPC-users] Backup via FTP not using overrides

2017-11-05 Thread Craig Barratt via BackupPC-users
I'm not sure why those lines got commented out - clearly a mistake. Thanks for figuring it out. I just made a commit with them uncommented. Craig On Sun, Nov 5, 2017 at 12:13 PM, Adam W wrote: > After looking through the code, I noticed that the line to read in the >

Re: [BackupPC-users] BPC4: checksum

2017-11-05 Thread Craig Barratt via BackupPC-users
Removing --checksum will make an rsync full behave just like an incremental. An equivalent, and clearer, way to do that is to only do incrementals. BackupPC 4.x allows you to do that. That can be accomplished by setting $Conf{FullPeriod} to a large value. You should also set $Conf{FillCycle}

Re: [BackupPC-users] BPC4: checksum

2017-11-05 Thread Craig Barratt via BackupPC-users
at's the difference between a filled backup and a full one? > > Currently I have set FullPeriod to 120 as we would like to only do > incrementals, but what's the fillcycle? > Doc's are unclear about this, at least for non native English readers > > > > > > Il 6 no

Re: [BackupPC-users] Archive to tape library

2017-11-05 Thread Craig Barratt via BackupPC-users
No, this isn't supported. There are tools (like BackupPC_tarCreate) in BackupPC that could be used with external tools or scripts to write/manage tapes. Or you could run something like Bacula in parallel with BackupPC if you really want tapes. Craig On Thu, Oct 12, 2017 at 11:08 AM, Gandalf

Re: [BackupPC-users] Upgrade v3 to v4.1.3: v3 pool is still very large

2017-11-05 Thread Craig Barratt via BackupPC-users
Chrisich, Do you have any hosts that didn't get backed up (or have backups disabled) during that period? Craig On Wed, Oct 4, 2017 at 8:27 AM, oetschi.ex...@bluewin.ch < oetschi.ex...@bluewin.ch> wrote: > Hello all of you, > > For years I am using backuppc and I like it very much. There is

[BackupPC-users] BackupPC 4.1.5 released (plus new versions of backuppc-xs and rsync-bpc)

2017-12-03 Thread Craig Barratt via BackupPC-users
BackupPC 4.1.5 has been released on Github. New versions of BackupPC-XS 0.57 and rsync-bpc 3.0.9.9 have also been

[BackupPC-users] BackupPC 4.2.1 released

2018-05-12 Thread Craig Barratt via BackupPC-users
BackupPC 4.2.1 has been released on Github. The changes since 4.2.0 are listed below. This release allows the new backup delete CGI feature to be disabled for users and/or admins,

Re: [BackupPC-users] BackupPC 4.2.0 released

2018-05-05 Thread Craig Barratt via BackupPC-users
in the foot" button in the web interface, nothing more. > > There will always be people who use BackupPC somewhere in between those > scenarios, so yes, why not give them the option of deleting backups through > the web interface? > > > It is a great feature to have, espec

Re: [BackupPC-users] Incremental backups succeed, full backups fail.

2018-05-17 Thread Craig Barratt via BackupPC-users
Please email me the entire XferLOG file (or the first ~100 lines if it's too big). Please also tell me your settings for $Conf{XferMethod}, $Conf{RsyncArgs}, $Conf{RsyncFullArgsExtra}, $Conf{RsyncClientPath}, $Conf{RsyncSshArgs}, and $Conf{RsyncArgsExtra}. What is your client's rsync version?

Re: [BackupPC-users] since upgrading to 4.0 I can no longer do full backups

2018-05-15 Thread Craig Barratt via BackupPC-users
Please send the first part of the log file with the full rsync command (feel free to redact confidential arguments, but maintain any special characters etc). Also send this client's settings for $Conf{RsyncSshArgs}, $Conf{RsyncClientPath}, $Conf{RsyncBackupPCPath}, $Conf{RsyncFullArgsExtra} and

Re: [BackupPC-users] since upgrading to 4.0 I can no longer do full backups

2018-05-15 Thread Craig Barratt via BackupPC-users
ribFiles = 0 > rsync: on remote machine: -slHogDtprc: unknown option > > > > On May 15, 2018 at 3:28:04 PM, Craig Barratt via BackupPC-users ( > backuppc-users@lists.sourceforge.net) wrote: > > Ok, you are using rsyncd, so $Conf{RsyncSshArgs} doesn't matter. > > It seems

Re: [BackupPC-users] since upgrading to 4.0 I can no longer do full backups

2018-05-15 Thread Craig Barratt via BackupPC-users
roup', > > '-D', > > '--links', > > '--hard-links', > > '--times', > > '--block-size=2048', > > '--recursive' > > ]; > > > Appreciate your help - thanks > > Paul > > On May 15, 2018 at 1:04:19 PM, Craig Barratt via B

Re: [BackupPC-users] getaddrinfo is not a valid Socket macro after Update to version 4.0.0

2018-05-23 Thread Craig Barratt via BackupPC-users
Diane, That problem is related to the old version of perl and Socket you are running. This was fixed in BackupPC version 4.1.1 last year (it detects which version of Socket you are using, and defaults to old interface if necessary). I strongly recommend upgrading to the most recent version of

Re: [BackupPC-users] since upgrading to 4.0 I can no longer do full backups

2018-05-15 Thread Craig Barratt via BackupPC-users
it. > > Thanks again, I really appreciate your help and backup pc is the best, > have used it for ever. > > Paul > > > On May 15, 2018 at 4:45:46 PM, Craig Barratt via BackupPC-users ( > backuppc-users@lists.sourceforge.net) wrote: > > On your client the rsyncd.c

Re: [BackupPC-users] how can I identify in which backup a certain file is?

2018-05-16 Thread Craig Barratt via BackupPC-users
BackupPC_zcat. Craig On Wed, May 16, 2018 at 10:30 PM, Michael Schumacher < michael.schumac...@pamas.de> wrote: > Thanks Robert, > > this is not very comfortable, but it works. > > I assume that there is no interest to have such a function integrated > into BackupPC. > > Btw., what program

Re: [BackupPC-users] backuppc 4.2.1 perl issue

2018-06-12 Thread Craig Barratt via BackupPC-users
Some random questions: What's the very first line of BackupPC_Admin? Could this be some sort of selinux issue? What happens when you manually run BackupPC_Admin (as the backuppc user)? What user is apache running as? Craig On Tue, Jun 12, 2018 at 7:17 PM, mlm wrote: > > > On 6/12/2018 8:10

Re: [BackupPC-users] backuppc 4.2.1 perl issue

2018-06-13 Thread Craig Barratt via BackupPC-users
b.io/backuppc;>Homepage > > > > > > > > Â Â Â BackupPC Server Status > > > > > > > > Â Â Â Currently Running Jobs > > > > > > > > Host > > Â Â Â Type > > Â Â Â User > > Â Â Â Start Time >

Re: [BackupPC-users] Backuppc hangs on certain files.

2018-05-30 Thread Craig Barratt via BackupPC-users
Brent, First you should tell us which versions of rsync, BackupPC and rsync-bpc you are using. If they are old, you should upgrade and try again. Assuming you are using relatively recent versions (ie, at least 4.1.x), you should run the restore with a high level of debug logging. Specifically:

Re: [BackupPC-users] about installation of backuppc 4.2.0 on CentOS 7

2018-05-02 Thread Craig Barratt via BackupPC-users
Luigi, It looks like the CGI script is running correctly, but the static web data (CSS, images etc) are not being loaded. Inspect the page source. The first few lines should include things like this: On the BackupPC side, the path to those files in the html is specified by

Re: [BackupPC-users] tarExtract: Can't use an undefined value as a HASH

2018-04-26 Thread Craig Barratt via BackupPC-users
Can you increase the log level (XferLogLevel) to, eg, 5 and send me either the whole log file, or at a minimum the last few hundred lines up to and including the error? Just send it directly to me, and not to the list, or we could use Google drive or dropbox etc. Thanks, Craig On Thu, Apr 26,

Re: [BackupPC-users] tarExtract: Can't use an undefined value as a HASH

2018-04-28 Thread Craig Barratt via BackupPC-users
Tarak (SSC/SPC) < tarak.pa...@canada.ca> wrote: > Hi Craig, > > > > I will collect logs with XferLogLevel set to 5 of a failure and keep you > posted. > > > > Thanks, > > > Tarak > > > > *From:* Craig Barratt via BackupPC-users [mailto:backu

Re: [BackupPC-users] Trouble with restore

2017-12-24 Thread Craig Barratt via BackupPC-users
It looks like this issue was opened on github a couple of days ago. I responded there with some suggestions. Craig On Wed, Dec 13, 2017 at 10:50 AM, Holger Parplies wrote: > Hi, > > let's start over. > > Jens Potthast wrote

Re: [BackupPC-users] File System containing backup was too full

2017-12-24 Thread Craig Barratt via BackupPC-users
This log message: 2017-12-19 01:00:00 24hr disk usage: 68% max, 68% recent, 0 skipped hosts correctly shows the disk usage, and also says that no hosts were skipped. Is there any chance you are running two different BackupPCs, and the 2nd one is on a different system that is in fact 96% full?

Re: [BackupPC-users] Problems with BackupPC - RSync

2017-12-24 Thread Craig Barratt via BackupPC-users
There could be a lot of reasons for this. Start by looking for errors in the server log file, and the XferLOG.bad.z file in the client's backup directory. Craig On Thu, Dec 14, 2017 at 8:10 AM, Jeffrey West via BackupPC-users < backuppc-users@lists.sourceforge.net> wrote: > All, > > > > I have

  1   2   3   4   >