Re: [BackupPC-users] rsync via ssh/rrsync

2024-05-23 Thread Mike Hughes
al list for user discussion, questions and support Subject: Re: [BackupPC-users] rsync via ssh/rrsync This is the command in authorized_keys: command="/usr/bin/rrsync /",restrict,from= So it should allow rsync to access to the full server, as expected, but BPC doesn't sh

Re: [BackupPC-users] rsync via ssh/rrsync

2024-05-23 Thread Gandalf Corvotempesta
This is the command in authorized_keys: command="/usr/bin/rrsync /",restrict,from= So it should allow rsync to access to the full server, as expected, but BPC doesn't show any files in the backup Il giorno gio 23 mag 2024 alle ore 10:24 Gandalf Corvotempesta ha scritto: > >

Re: [BackupPC-users] rsync via ssh/rrsync

2024-05-23 Thread Gandalf Corvotempesta
Il giorno gio 23 mag 2024 alle ore 09:16 Christian Völker via BackupPC-users ha scritto: > > Well, I guess you'll need to make sure ssh works fine. > To do so, go to your backuppc server an switch into the user context of > backuppc by "su - backuppc". From there issue "ssh user@hostname" and >

Re: [BackupPC-users] rsync via ssh/rrsync

2024-05-23 Thread Christian Völker via BackupPC-users
Well, I guess you'll need to make sure ssh works fine. To do so, go to your backuppc server an switch into the user context of backuppc by "su - backuppc". From there issue "ssh user@hostname" and accept the public key of the target client. Once done, it should run without any problems. As long

[BackupPC-users] rsync via ssh/rrsync

2024-05-23 Thread Gandalf Corvotempesta
hi guys im using with great success backuppc backing up clients with rsyncd for one host i have to move from rsyncd to rsync through ssh (and rrsync on ssh command) but im hitting tons of different errors can someone stare a working config for rsync? other that changing the share name to the

Re: [BackupPC-users] Rsync Memory Issue

2022-11-17 Thread Richard Shaw
On Thu, Nov 17, 2022 at 11:10 AM Craig Barratt via BackupPC-users < backuppc-users@lists.sourceforge.net> wrote: > Could you try the bpc-rsync master code from github? Just clone the > repository and build it. I did some commits in July 2021 that were after > the latest release. > Are you

Re: [BackupPC-users] Rsync Memory Issue

2022-11-17 Thread Craig Barratt via BackupPC-users
Could you try the bpc-rsync master code from github? Just clone the repository and build it. I did some commits in July 2021 that were after the latest release. Craig On Thu, Nov 17, 2022 at 6:55 AM wrote: > Missing pool files should not generally have anything to do with rysnc > memory

Re: [BackupPC-users] Rsync Memory Issue

2022-11-17 Thread backuppc
Missing pool files should not generally have anything to do with rysnc memory issues. - Are you using a very old version of rsync (e.g., < 3.x)? Memory handling was worse in older versions? - How much memory do you have? - How many files are you trying to back up and how large are the

Re: [BackupPC-users] Rsync Memory Issue

2022-11-17 Thread Richard Shaw
On Wed, Nov 16, 2022 at 10:02 PM wrote: > I have an issue on my server, causing it to crash with out-of-memory > errors. It eventually just causes the virtual server to abort. I can’t find > a log with relevant information for this. Does anyone know where I can look > at a log file or what might

[BackupPC-users] Rsync Memory Issue

2022-11-16 Thread mtuckness
I have an issue on my server, causing it to crash with out-of-memory errors. It eventually just causes the virtual server to abort. I can't find a log with relevant information for this. Does anyone know where I can look at a log file or what might be the cause? These keep showing up,

Re: [BackupPC-users] rsync backups: full xferlogs missing

2022-11-04 Thread Ludovic Drolez
On Thu, Nov 03, 2022 at 02:56:11PM -0300, Guillermo Rozas wrote: >As a result, on V4 only the files that have really changed are logged >(before every file was logged, even if it didn't change). Maybe it's that? >Best regards, >Guillermo I don't see file lists for new files, and

Re: [BackupPC-users] rsync backups: full xferlogs missing

2022-11-03 Thread Guillermo Rozas
There was a change in the rsync flags that are used between V4 and V3, due to the new way of calculating the digests (can't check which flags now). As a result, on V4 only the files that have really changed are logged (before every file was logged, even if it didn't change). Maybe it's that? Best

[BackupPC-users] rsync backups: full xferlogs missing

2022-11-03 Thread Ludovic Drolez
Hi! I've noticed, maybe after a migration to v4, that I don't see the full list of transfered files for rsync based backups. Here is what I see: Running: /usr/libexec/backuppc-rsync/rsync_bpc --bpc-top-dir /var/lib/backuppc --bpc-host-name myhost.com --bpc-share-name /var/log/apache2

[BackupPC-users] rsync FROM backuppc

2022-10-29 Thread gregrwm
i have an old copy of a VM (from before it was migrated to a different server), and backuppc captured more recent changes, before a problem occurred on the server the VM has been running on recently. what's missing is backuppc is capturing the content of the VM, but that's not quite enough to

[BackupPC-users] Rsync ignores username all of a sudden

2022-06-30 Thread Brian Joiner
I recently upgraded to the 22.04 LTS of Ubuntu, and I'm guessing I now have the v4 of backuppc.  Prior to this, both my local and remote (same lan) backups were working fine via rsync. On the remote host, I connect via the backuppc user and root ssh key (backuppc can ssh as root on the remote

Re: [BackupPC-users] rsync/File::RsyncP conflict

2022-04-13 Thread G.W. Haywood via BackupPC-users
Hi there, On Wed, 13 Apr 2022, Dave Sherohman wrote: On 4/11/22 18:22, G.W. Haywood via BackupPC-users wrote: Looking at https://metacpan.org/dist/File-RsyncP/changes it seems that there is only one later version (0.76) so your options seem to be somewhat limited. :) Is it even still

Re: [BackupPC-users] rsync/File::RsyncP conflict

2022-04-12 Thread Dave Sherohman via BackupPC-users
On 4/11/22 18:22, G.W. Haywood via BackupPC-users wrote: Looking at https://metacpan.org/dist/File-RsyncP/changes it seems that there is only one later version (0.76) so your options seem to be somewhat limited. :) Is it even still being used?  My BPC server is running 4.4.0, installed from

Re: [BackupPC-users] rsync/File::RsyncP conflict

2022-04-11 Thread G.W. Haywood via BackupPC-users
Hi there, On Mon, 11 Apr 2022, Matthew Pounsett wrote: I seem to have encountered the same problem described in this thread which ends here: To summarize what I understand from that thread, there's a bug in

Re: [BackupPC-users] rsync/File::RsyncP conflict

2022-04-11 Thread Matthew Pounsett
On Mon, Apr 11, 2022 at 9:08 AM Jon Daley via BackupPC-users wrote: > > I'm using > > 3.1.3.0-3 of backuppc-rsync > 3.2.3-4+deb of rsync > 4.4.0-3 of backuppc > 0.62-1+b1 of libbackuppc-xs-perl > successfully. > > libfile-rsync-perl is not installed Yeah, it appears libfile-rsync-perl was

Re: [BackupPC-users] rsync/File::RsyncP conflict

2022-04-11 Thread Jon Daley via BackupPC-users
I'm using 3.1.3.0-3 of backuppc-rsync 3.2.3-4+deb of rsync 4.4.0-3 of backuppc 0.62-1+b1 of libbackuppc-xs-perl successfully. libfile-rsync-perl is not installed Hope that helps. On April 11, 2022 6:35:40 AM EDT, Matthew Pounsett wrote: >I seem to have encountered the same problem described

[BackupPC-users] rsync/File::RsyncP conflict

2022-04-11 Thread Matthew Pounsett
I seem to have encountered the same problem described in this thread which ends here: To summarize what I understand from that thread, there's a bug in File::RsyncP prior to some unidentified version that is exposed

Re: [BackupPC-users] rsync-bcp problem

2022-04-07 Thread Jon Daley via BackupPC-users
On Thu, 7 Apr 2022, backu...@kosowsky.org wrote: So, I think that proves that it is rsync-bpc that is causing trouble, as `rsync -a Downloads d` works perfectly fine. Nope. Just proves you don't know how rsync_bpc works... True. :) It was described as a "drop-in replacement" for rsync on the

Re: [BackupPC-users] rsync-bcp problem

2022-04-07 Thread backuppc
Jon Daley via BackupPC-users wrote at about 03:57:19 -0400 on Thursday, April 7, 2022: > I recently upgraded backuppc to V4 and the bcp version of rsync, and I > can't get anything to work. The migration to V4 seems to have gone well - > it took 2-3 days to run through all of the hosts (15

Re: [BackupPC-users] rsync-bcp problem

2022-04-07 Thread Jon Daley via BackupPC-users
I just built my own rsync-bpc and this version (Both report the same output from --version: rsync_bpc version 3.1.3.0 protocol version 31) gives some more useful output when running my simple test: sync_bpc: BackupPC options are compulsory for running rsync_bpc Which explains why my test

[BackupPC-users] rsync-bcp problem

2022-04-07 Thread Jon Daley via BackupPC-users
I recently upgraded backuppc to V4 and the bcp version of rsync, and I can't get anything to work. The migration to V4 seems to have gone well - it took 2-3 days to run through all of the hosts (15 hosts with 105 backups) All backups get an error like this: 2022-04-07 03:02:37 incr backup

Re: [BackupPC-users] rsync ACL Support

2022-03-04 Thread ralph strebbing
On Thu, Mar 3, 2022 at 11:03 AM ralph strebbing wrote: > I'm attempting an upgrade to 4 now. So the upgrade to 4 works. Is there any reason that the Ubuntu/Debian repos aren't using the latest? ___ BackupPC-users mailing list

Re: [BackupPC-users] rsync ACL Support

2022-03-03 Thread ralph strebbing
On Thu, Mar 3, 2022 at 11:02 AM wrote: > > ACLs are not supported in 3.x but are supported in 4.x > Not sure --fake-super is supported but --super is supported. Yeah, I've just noticed that I'm not on v4, it didn't click until now. I'm attempting an upgrade to 4 now.

Re: [BackupPC-users] rsync ACL Support

2022-03-03 Thread backuppc
ACLs are not supported in 3.x but are supported in 4.x Not sure --fake-super is supported but --super is supported. ralph strebbing wrote at about 10:35:24 -0500 on Thursday, March 3, 2022: > Hi All, > > I'm attempting to set-up BackupPC for use with our linux server > infrastructure, using

[BackupPC-users] rsync ACL Support

2022-03-03 Thread ralph strebbing
Hi All, I'm attempting to set-up BackupPC for use with our linux server infrastructure, using either rsync or rsyncd. I'm currently running the Ubuntu package of BackupPC (Version 3.3.2-3), with rsync_bpc version 3.1.3.0 protocol version 31. So far things work great! However, I'm running into

Re: [BackupPC-users] rsync open-noatime option

2022-02-11 Thread backuppc
Seems like open-noatime is a new option as it doesn't appear in the documentation of my rsync 3.1.2 version. Is the suggestion that by having TopDir mounted in a noatime filesystem, then open-noatime will assure that atimes are not read/written on the remote BackupPc-client, thereby saving time

Re: [BackupPC-users] rsync open-noatime option

2022-02-11 Thread Craig Barratt via BackupPC-users
The rysnc open-noatime option isn't supported by rsync-bpc. Like Jeff, I use the noatime mount option on my BackupPC filesystem. Craig On Fri, Feb 11, 2022 at 8:46 AM wrote: > Kenneth Porter wrote at about 18:44:40 -0800 on Thursday, February 10, > 2022: > > Is anyone using the rsync/rsyncd

Re: [BackupPC-users] rsync open-noatime option

2022-02-11 Thread backuppc
Kenneth Porter wrote at about 18:44:40 -0800 on Thursday, February 10, 2022: > Is anyone using the rsync/rsyncd method with the open-noatime option to > avoid unnecessary metadata writes when comparing files? > Not sure what open-noatime means... but I have been running backuppc using rsync

[BackupPC-users] rsync open-noatime option

2022-02-10 Thread Kenneth Porter
Is anyone using the rsync/rsyncd method with the open-noatime option to avoid unnecessary metadata writes when comparing files? I'm disabling atime on all my Linux partitions and wondering if that option has any effect on Cygwin rsyncd running on my Windows 10 clients. It does look like NTFS

Re: [BackupPC-users] rsync error

2021-09-24 Thread Gary L. Roach
Sorry about the missing attachment. There was an error on my end. I'll try again. Gary R On 9/22/21 11:48 PM, Dave Sherohman wrote: Also, FYI, I didn't receive an attachment with your mail; I suspect the list manager software may be set up to remove them. On 9/22/21 11:14 PM, Gary L.

Re: [BackupPC-users] rsync error

2021-09-23 Thread Dave Sherohman
According to a quick web search, it looks like rsync error code 5 indicates authorization problems.  Here are a couple links which may provide solutions: https://unix.stackexchange.com/questions/71719/rsync-error-starting-client-server-protocol

Re: [BackupPC-users] rsync error

2021-09-22 Thread Gary L. Roach
Sorry I forgot the following: Operating System: Debian GNU/Linux 11 KDE Plasma Version: 5.20.5 KDE Frameworks Version: 5.78.0 Qt Version: 5.15.2 Kernel Version: 5.10.0-8-amd64 OS Type: 64-bit Processors: 4 × AMD FX(tm)-4350 Quad-Core Processor Memory: 15.6 GiB of RAM Graphics Processor: AMD

Re: [BackupPC-users] rsync error

2021-09-22 Thread Rob Morin
Hey Gary, to start with, are you able to simply ssh as the backuppc user to those 2 servers? Let us know. On Wed., Sep. 22, 2021, 17:15 Gary L. Roach, wrote: > Hi All, > > After setting up SSH, Rsyncd and Backuppc, I tried to run a backup on two > different computers and got the following log

[BackupPC-users] rsync error

2021-09-22 Thread Gary L. Roach
Hi All, After setting up SSH, Rsyncd and Backuppc, I tried to run a backup on two different computers and got the following log file error: 2021-09-22 13:22:08 Created directory /var/lib/backuppc/pc/supercrunch /refCnt 2021-09-22

Re: [BackupPC-users] Rsync and swapping the hard drive mounted at /var/lib/BackupPC - backups vanish

2021-07-25 Thread Gavin Henry
> > > > Hopefully, you have backuppc v4, which does not have the hard link > limitation issue so that you can just do a regular rsync. > Yeah, v4 at home in Fedora 32, but v3 in two datacentres (Edinburgh and London) backing up 102~ nodes at SureVoIP (my business). Each sites big BackupPC box

Re: [BackupPC-users] Rsync and swapping the hard drive mounted at /var/lib/BackupPC - backups vanish

2021-07-24 Thread Kenneth Porter
On 7/24/2021 6:36 PM, backu...@kosowsky.org wrote: I do the same with soft links rather than bind mounts so that I don't have to mess with my fstab. I think I initially tried that and rpm/yum did something wierd at the next upgrade, like converting the links to the directory in the package.

Re: [BackupPC-users] Rsync and swapping the hard drive mounted at /var/lib/BackupPC - backups vanish

2021-07-24 Thread backuppc
Kenneth Porter wrote at about 13:51:30 -0700 on Saturday, July 24, 2021: > Tip: > > Mount the drive's root to /mnt/BackupPC, create subfolders /backuppc/etc > and /backuppc/BackupPC, then do a bind mount of those folders to > /etc/BackupPC and /var/lib/BackupPC. That way you'll keep the

Re: [BackupPC-users] Rsync and swapping the hard drive mounted at /var/lib/BackupPC - backups vanish

2021-07-24 Thread backuppc
Gavin Henry wrote at about 19:43:56 +0100 on Saturday, July 24, 2021: > Hi all, > > On my home desktop my backups are going to a 2TB usb drive. All good. It's > filling up, so I bought a 4TB usb one and have rsynced all data on the same > type of filesystem too (rsync -av --delete) but when

Re: [BackupPC-users] Rsync and swapping the hard drive mounted at /var/lib/BackupPC - backups vanish

2021-07-24 Thread Gavin Henry
On Sat, 24 Jul 2021, 21:52 Kenneth Porter, wrote: > On 7/24/2021 1:34 PM, Gavin Henry wrote: > > Remind me, where is it inheriting the perms from? The folders under > > the mount are all correct. > > ext4 stores owner and group id numbers, so you need to do a "chown -R > backuppc.backuppc

Re: [BackupPC-users] Rsync and swapping the hard drive mounted at /var/lib/BackupPC - backups vanish

2021-07-24 Thread Kenneth Porter
On 7/24/2021 1:34 PM, Gavin Henry wrote: Remind me, where is it inheriting the perms from? The folders under the mount are all correct. ext4 stores owner and group id numbers, so you need to do a "chown -R backuppc.backuppc /var/lib/BackupPC" when it's mounted to set the uid and gid. Alas,

Re: [BackupPC-users] Rsync and swapping the hard drive mounted at /var/lib/BackupPC - backups vanish

2021-07-24 Thread Gavin Henry
That's fixed it and all matches up now: sudo ls -lhd /var/lib/BackupPC/ drwxr-x---. 7 backuppc root 4.0K Jan 25 22:23 /var/lib/BackupPC/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:

Re: [BackupPC-users] Rsync and swapping the hard drive mounted at /var/lib/BackupPC - backups vanish

2021-07-24 Thread Gavin Henry
Sorted. Permissions as always. Thanks for your second pair of eyes Kenneth! I'm re-running the rsync like so for selinux too (due to the dot at the end of the directory perms): rsync -av -X --delete --dry-run backuppc/ /var/lib/BackupPC/ ls -lhd /var/lib/BackupPC drwxr-x---. 7 backuppc root

Re: [BackupPC-users] Rsync and swapping the hard drive mounted at /var/lib/BackupPC - backups vanish

2021-07-24 Thread Gavin Henry
> How are you mounting it? Unit file? /etc/fstab? /etc/fstab (just the usb devices have changed) /dev/sdd1 /var/lib/BackupPC ext4defaults0 0 #/dev/sde1 /var/lib/BackupPC ext4defaults0 0 > Permissions look ok on the drive and

Re: [BackupPC-users] Rsync and swapping the hard drive mounted at /var/lib/BackupPC - backups vanish

2021-07-24 Thread Kenneth Porter
On 7/24/2021 11:43 AM, Gavin Henry wrote: On my home desktop my backups are going to a 2TB usb drive. All good. It's filling up, so I bought a 4TB usb one and have rsynced all data on the same type of filesystem too (rsync -av --delete) but when I mount it and restart BackupPC, nothing shows.

[BackupPC-users] Rsync and swapping the hard drive mounted at /var/lib/BackupPC - backups vanish

2021-07-24 Thread Gavin Henry
Hi all, On my home desktop my backups are going to a 2TB usb drive. All good. It's filling up, so I bought a 4TB usb one and have rsynced all data on the same type of filesystem too (rsync -av --delete) but when I mount it and restart BackupPC, nothing shows. Put the old drive back and

[BackupPC-users] rsync errors in baclkups

2021-01-11 Thread backuppc
As promised in the other thread, I did find a couple of repeated file errors out of my dozen hosts and tens of millions of backup files. There are exactly 2 such errors (each repeated twice due to an rsync 'retry') that appear on every full backup on one of my Windoze hosts. The errors occur

Re: [BackupPC-users] rsync + lvm snapshot in BackupPC v4+? integrated, or DIY via 'DumpPreUserCmd' ?

2020-10-04 Thread PGNet Dev
On 10/4/20 4:41 PM, backu...@kosowsky.org wrote: > better to use the hooks that Craig has provided sure. here's my initial take -- seems to be working well enough. so far. still testing ... for a localhost test with 2 'live data' source types that I want to 'snapshot' appropriately before

Re: [BackupPC-users] rsync + lvm snapshot in BackupPC v4+? integrated, or DIY via 'DumpPreUserCmd' ?

2020-10-04 Thread
Craig Barratt via BackupPC-users wrote at about 15:35:38 -0700 on Friday, October 2, 2020: > One recent addition which should be helpful is $Conf{ClientShareName2Path} > which allows you to map the share name to the real path (in this case, the > snapshot path). There is, however, an open

Re: [BackupPC-users] rsync + lvm snapshot in BackupPC v4+? integrated, or DIY via 'DumpPreUserCmd' ?

2020-10-04 Thread
I have done a fair bit of this both on Linux using btrfs snapshots and Windoze using VSS (volume snapshot service). As Craig mentions, the challenge is that there are many different OS's and filesystems, each with their own method of creating snapshots. Beyond that there are several

Re: [BackupPC-users] rsync + lvm snapshot in BackupPC v4+? integrated, or DIY via 'DumpPreUserCmd' ?

2020-10-02 Thread Craig Barratt via BackupPC-users
Sure, there are a lot of ways to do it. The various Dump{Pre|Post}ShareCmds can take arguments that are passed to whatever the first argument specifies as the command. While it doesn't execute it with a shell (to avoid various security issues), it does allow arguments (simple breaking at white

Re: [BackupPC-users] rsync + lvm snapshot in BackupPC v4+? integrated, or DIY via 'DumpPreUserCmd' ?

2020-10-02 Thread Craig Barratt via BackupPC-users
Sure, setting aside windoze, LVMs are widespread and consistent today, but BackupPC has been around for quite a while. So my comment was probably more historical. Craig On Fri, Oct 2, 2020 at 4:27 PM PGNet Dev wrote: > On 10/2/20 3:35 PM, Craig Barratt wrote: > > Snapshotting is a great idea

Re: [BackupPC-users] rsync + lvm snapshot in BackupPC v4+? integrated, or DIY via 'DumpPreUserCmd' ?

2020-10-02 Thread PGNet Dev
Craig, digging around a bit, it appears, $Conf{DumpPreUserCmd} $Conf{DumpPostUserCmd} $Conf{DumpPreShareCmd} $Conf{DumpPostShareCmd} are declared as single value string types, ./lib/BackupPC/Config/Meta.pm DumpPreUserCmd => {type =>

Re: [BackupPC-users] rsync + lvm snapshot in BackupPC v4+? integrated, or DIY via 'DumpPreUserCmd' ?

2020-10-02 Thread PGNet Dev
On 10/2/20 4:26 PM, PGNet Dev wrote: > I don't see that in the release docs; I assume it's in recent/master. (Will > take a peek here in a bit ...) well, if I'd look at the *current* release docs, THAT might help ... ___ BackupPC-users mailing list

Re: [BackupPC-users] rsync + lvm snapshot in BackupPC v4+? integrated, or DIY via 'DumpPreUserCmd' ?

2020-10-02 Thread PGNet Dev
On 10/2/20 3:35 PM, Craig Barratt wrote: > Snapshotting is a great idea but it's not built in, since the underlying > commands and approaches vary so much between different OSes and filesystems. noted. though, LVMs _are_ fairly widespread. support's available on linux*, of course; and, netbsd

Re: [BackupPC-users] rsync + lvm snapshot in BackupPC v4+? integrated, or DIY via 'DumpPreUserCmd' ?

2020-10-02 Thread Craig Barratt via BackupPC-users
Snapshotting is a great idea but it's not built in, since the underlying commands and approaches vary so much between different OSes and filesystems. Several users have developed scripts that do snapshots, which are especially beneficial on windoze given the prevalence of enforced file locking.

[BackupPC-users] rsync + lvm snapshot in BackupPC v4+? integrated, or DIY via 'DumpPreUserCmd' ?

2020-10-02 Thread PGNet Dev
Within the scope of a single backup I've a mix of live data sources. For a live data source, e.g. /src/data1, that resides on a dedicated LV, mount | grep vmail /dev/mapper/VG0-LV_DATA1 on /src/data1 type ext4 (rw,relatime,dax=never) I'd like to snapshot the volume

[BackupPC-users] rsync error backing up Windows 10 computer

2020-07-01 Thread backuppc
The log file shows multiple instances of the following error when rsync_bpc is run: unpack_smb_acl: warning: entry with unrecognized tag type ignored Any idea what may be going on here? ___ BackupPC-users mailing list

Re: [BackupPC-users] Rsync restore from the command line

2020-05-21 Thread Craig Barratt via BackupPC-users
Jeff, Sure, that's possible. But given that it was necessary to use a file to pass along the list of files to restore, it seemed easier to just use that one mechanism. It would be pretty easy to write a wrapper script that takes command-line arguments and writes the request file and passes it

Re: [BackupPC-users] Rsync restore from the command line

2020-05-20 Thread backuppc
Couldn't their be an option to read the to-be-restored files from a file (similar to what tar and rsync allow) but allowing basic restores to be done form the command line. Other parameters could either be via command line or added config.pl settings if more permanent. Craig Barratt via

Re: [BackupPC-users] Rsync restore from the command line

2020-05-20 Thread Craig Barratt via BackupPC-users
Jeff, For restores, there could be a long list of specific files or directories to restore, which might not fit on the command line, so that's what triggered putting everything in a request file and just passing its name. There are also several other settings specific to the restore (eg, the path

Re: [BackupPC-users] Rsync restore from the command line

2020-05-20 Thread backuppc
Thanks Craig, Why is restore inherently that much more complicated than dump? It seems like config.pl already has a number of parameters built-in for both including rsync args and pre/post restore commands. Conceptually, I would think that what one needs to specify each time is: 1. Host 2.

Re: [BackupPC-users] Rsync restore from the command line

2020-05-20 Thread Craig Barratt via BackupPC-users
Jeff, BackupPC_restore takes quite a few parameters, so many years ago I decided to pass those parameters via a file rather than command-line arguments. Probably a bad choice... There are two alternatives: - write a script that creates the restore request parameter file (see

[BackupPC-users] Rsync restore from the command line

2020-05-20 Thread
Is it possible to do an rsync restore from the command line using BackupPC_restore? If so, it's not clear from the (limited) documentation how to use it. For example, how do you specify the desired backup number, share, paths, etc. Alternatively, is there an rsync analog of BackupPC_tarCreate?

Re: [BackupPC-users] rsync vs rsyncd speed for huge number of small files

2020-04-21 Thread Richard Shaw
On Tue, Apr 21, 2020 at 11:15 AM ED Fochler wrote: > I would expect no difference for small file performance between rsync and > ssh-rsync. The ssh overhead on a modern system limits data rate to > something like 75MB/s, nearly saturating a gigabit link. It seems you have > basic filesystem

Re: [BackupPC-users] rsync vs rsyncd speed for huge number of small files

2020-04-21 Thread R.C.
Il 21/04/2020 17:48, ED Fochler ha scritto: I would expect no difference for small file performance between rsync and ssh-rsync. The ssh overhead on a modern system limits data rate to something like 75MB/s, nearly saturating a gigabit link. It seems you have basic filesystem performance

Re: [BackupPC-users] rsync vs rsyncd speed for huge number of small files

2020-04-21 Thread R.C.
Il 21/04/2020 18:05, Craig Barratt via BackupPC-users ha scritto: What version of BackupPC are you running?  4.x will likely be a good deal faster than 3.x for both rsync+ssh and rsyncd. I have 3.2.1 backing up this imap folder. I'm evaluating whether to upgrade to V4 but I am mirroring

Re: [BackupPC-users] rsync vs rsyncd speed for huge number of small files

2020-04-21 Thread ED Fochler
I would expect no difference for small file performance between rsync and ssh-rsync. The ssh overhead on a modern system limits data rate to something like 75MB/s, nearly saturating a gigabit link. It seems you have basic filesystem performance issues. More RAM, larger caches, SSD?

Re: [BackupPC-users] rsync vs rsyncd speed for huge number of small files

2020-04-21 Thread Craig Barratt via BackupPC-users
What version of BackupPC are you running? 4.x will likely be a good deal faster than 3.x for both rsync+ssh and rsyncd. The penalty of rsync+ssh vs rsyncd is likely modest, although it depends on how much data is changing between backups. Craig On Tue, Apr 21, 2020 at 1:33 AM R.C. wrote: >

[BackupPC-users] rsync vs rsyncd speed for huge number of small files

2020-04-21 Thread R.C.
Hi What is the expected difference in performance between rsync+shh and rsyncd? I would use it over a private LAN, so no concerns about security. Currently rsync+ssh is way too slow for a huge number of very small files (about 700K email files in an imap server tree), even without --checksum.

Re: [BackupPC-users] rsync backup error

2019-12-26 Thread Gandalf Corvotempesta
Latest for both Il gio 26 dic 2019, 22:19 Craig Barratt via BackupPC-users < backuppc-users@lists.sourceforge.net> ha scritto: > What versions of BackupPC and rsync-bpc are you using? > > Craig > > On Thu, Dec 26, 2019 at 8:58 AM Gandalf Corvotempesta < > gandalf.corvotempe...@gmail.com> wrote:

Re: [BackupPC-users] rsync backup error

2019-12-26 Thread Craig Barratt via BackupPC-users
What versions of BackupPC and rsync-bpc are you using? Craig On Thu, Dec 26, 2019 at 8:58 AM Gandalf Corvotempesta < gandalf.corvotempe...@gmail.com> wrote: > I've got this, and the backup is restarted. Any idea ? > Both client and server are on a private gigabit lan, no firewall between > > R

[BackupPC-users] rsync backup error

2019-12-26 Thread Gandalf Corvotempesta
I've got this, and the backup is restarted. Any idea ? Both client and server are on a private gigabit lan, no firewall between R bpc_sysCall_checkFileMatch(var/www/clients/y/x/web/_vendor/jenky/laravel-plupload/tests/.gitkeep): file doesn't exist R

Re: [BackupPC-users] rsync without checksum

2019-11-30 Thread Gandalf Corvotempesta
please ignore the previous email, checksumming is done only on full backups, not on incrementals. I've saw that nightly job (i'm using 1/128 cycle) is veery slow, it takes about 5 days to do 1/128. when the nightly is running , everything else will slow down. Il giorno sab 30 nov

[BackupPC-users] rsync without checksum

2019-11-30 Thread Gandalf Corvotempesta
Hi to all. I'm fighting against very very very slow backuppc backups. I've found that --checksum args to rsync will slow down A LOT everything. Is it safe to remove it ? I'm not worried about transferring more data over the network (i'm on a local net) and even if incremental backups would be

Re: [BackupPC-users] rsync-bpc claims that "file has vanished", but tries to download it over and over again

2019-07-30 Thread Alexander Kobel
Thanks Pierre-Yves for the hint, and Craig for confirming. Just this minute, I was about to write that the maintainer of the Arch Linux package (Sébastien Luttringer, amazingly swift!) already updated the package with the new rsync-bpc and BackupPC::XS, and the issue is gone with the new version.

Re: [BackupPC-users] rsync-bpc claims that "file has vanished", but tries to download it over and over again

2019-07-29 Thread Craig Barratt via BackupPC-users
Yes, that bug is fixed in the latest versions of BackupPC (4.3.1) and rsync_bpc (3.1.2.1). It sounds like you have the latest BackupPC, but you will need to upgrade to the latest rsync_bpc. Craig On Mon, Jul 29, 2019 at 12:29 PM Alexander Kobel wrote: > Hi, > > On 29.07.19 18:30, Pierre-Yves

Re: [BackupPC-users] rsync-bpc claims that "file has vanished", but tries to download it over and over again

2019-07-29 Thread Alexander Kobel
Hi, On 29.07.19 18:30, Pierre-Yves Bonnetain-Nesterenko wrote: > On 29/07/2019 17:49, Alexander Kobel wrote: >> Any ideas about what could be the culprit? > > Looks like the « zombie files » bug which was corrected by last update > of BPC. huh. My google-fu fails me here... Would that be

[BackupPC-users] rsync-bpc claims that "file has vanished", but tries to download it over and over again

2019-07-29 Thread Alexander Kobel
Dear all, I just noticed that one of two virtually identical BackupPC instances, both backing up the same host (my email server), reports for a couple weeks that some files vanished - and they are. So why does it insist on trying to download it over and over again? In the error log of server 1

Re: [BackupPC-users] rsync backup permissions

2019-07-06 Thread Craig Barratt via BackupPC-users
Is rsync running as root on the client side? If not, it won't have permission to chown files to root. An example setting would be: $Conf{RsyncClientPath} = 'sudo /usr/bin/rsync'; This requires the backuppc user to have sudo privileges. You should exercise some caution in doing this, since a

[BackupPC-users] rsync backup permissions

2019-07-06 Thread David Metcalf
Hi, New Backup PC user here.  I just ran a backup/restore test of a Linux client using the rsync backup method.  The restore worked but the file was not owned by root but rather the backuppc user.  Is there a way to change this behavior so that restored files retain the original ownership?

Re: [BackupPC-users] Rsync backup does not start

2019-05-06 Thread Michael Stowe
On 2019-05-06 00:26, THÉBAULT Arnaud wrote: HI, I am new to backuppc.. again ( I was used to work with it nearly 15 years ago…) I have an issue when trying to backup a Windows 10 computer with rsyncd. When initiating the backup from the backupPC GUI, it never starts. There is no error

[BackupPC-users] Rsync backup does not start

2019-05-06 Thread THÉBAULT Arnaud
HI, I am new to backuppc.. again ( I was used to work with it nearly 15 years ago...) I have an issue when trying to backup a Windows 10 computer with rsyncd. When initiating the backup from the backupPC GUI, it never starts. There is no error message in the log file. I have tried to

[BackupPC-users] Rsync-Error on new Backuppc 4

2019-02-14 Thread Stefan Schumacher
Hello, we have been using Backuppc 3 for some years to create daily backups of about a hundred VMs. Our old server hit it's storage capacity limit a few month ago so we decided to set up a new server with a zfs filesystem and a recent version of Backuppc, 4. All of our hosts are backed up

Re: [BackupPC-users] rsync optimisation

2018-12-19 Thread Kris Lou via BackupPC-users
I've found that the version of rsync that Apple bundles is pretty squirrelly -- there are some posts in the archive about this. But generally speaking, there were some BackupPC-default rsync arguments that didn't play nicely with Apple's rsync. I don't recall having issues with BPCv3, but with

[BackupPC-users] rsync optimisation

2018-12-19 Thread Patrick Bégou
Hello rsync performances is a regular question with Backuppc... and is a regular problem where I do not find a good solution. I'm using BackuPC 3 and time to run a full backup for a mac book reach so long time that full backup fails regularly now. The folder is arround 50GB but with many small

Re: [BackupPC-users] rsync file restore ownership

2018-12-14 Thread Tony Schreiner
While an rsync transfer is in progress, parent directories are owned by root, and changed when all subdirectories are completed. Could there have been an interruption? On Fri, Dec 14, 2018 at 11:41 AM Pete Geenhuizen wrote: > It's been a while since I had to restore a file which has always gone

Re: [BackupPC-users] rsync file restore ownership

2018-12-14 Thread Pete Geenhuizen
Not that I'm aware of, but I will say that I was restoring 2 subdirectories at the same time into my home, and perhaps the restores collided with the result that neither restore were able to set the ownership correctly when they were done. I'll have to test that out. Thanks for the reply.

[BackupPC-users] rsync file restore ownership

2018-12-14 Thread Pete Geenhuizen
It's been a while since I had to restore a file which has always gone as expected. Today I restored 2 directories along with all the files to my home using the same method that I've always used, i.e. logged into the web interface as root and selecting the appropriate files and the world was

Re: [BackupPC-users] Rsync issue

2018-10-09 Thread Craig Barratt via BackupPC-users
Matt, I'm happy to take a look at the logs. The "io timeout after 72035 seconds" suggests something has stalled, and we'd like to find out what is going on just before that. Yes, the first step will be to increase the XferLogLevel to see what is happening before things stall. Maybe try 5?

[BackupPC-users] Rsync issue

2018-10-04 Thread Bedynek, Matthew J.
All, Am using BackupPC 4.2.1 on a Redhat 7.5 host to backup a rather large repository of data. I believe things worked OK with tar but after we changed the file system we switched back to Rsync. I think we have plenty of others which roughly equal in size but backup fine. Not sure if

[BackupPC-users] rsync-vshadow-winexe client

2018-09-05 Thread tbuchanan
There used to be a rsync-vshadow-winexe client for backupc on the www.michaelstowe.com web site but I can not seem to access this any longer. Is this no longer a recommended setup? I'm looking to use vshadow and thought this was a good way to implement it. Suggestions for good documentation

Re: [BackupPC-users] rsync error buffer overflow

2017-11-27 Thread Jose Barriga
Thanks a lot, increasing RAM memory fix the problem (4 GB to 10 GB) ill try backupPC 4.x later regards [image: http://www.finkok.com/team/signature/finkok/jbarriga.png] La calidad del servicio que usted recibe es muy importante para FINKOK, por lo que si usted considera que la atención que

Re: [BackupPC-users] rsync error buffer overflow

2017-11-24 Thread Craig Barratt via BackupPC-users
BackupPC 3.x uses older versions of the rsync protocol, which requires the entire file list to be stored in memory. BackupPC 4.x uses pretty up-to-date versions of rsync, which no longer requires the full file list to be stored. So it's likely that BackupPC 4.x will have a better chance of

Re: [BackupPC-users] rsync error buffer overflow

2017-11-24 Thread G.W. Haywood via BackupPC-users
Hi there, On Fri, 24 Nov 2017, Jose Barriga wrote: Im trying to backup a very large number of files and trees and trees of directories. How can i solved??? You either need to add memory to the machine or modify the way that you use rsync/rsyncd so that it uses less memory to do the

[BackupPC-users] rsync error buffer overflow

2017-11-23 Thread Jose Barriga
backuppc version: BackupPC-3.3.1-5.el7.x86_64 rsync version: rsync-3.0.9-18.el7.x86_64 xfer method: rsyncd S.O: Centos 7 everything works fine, but one of my clients show the next error log when starts rsyncd backup full/incremental (both case the same error). Im trying to backup a very large

[BackupPC-users] rsync: writefd_unbuffered failed to write 4 bytes to socket [sender]: Connection reset by peer (104)

2017-09-25 Thread Gandalf Corvotempesta
Setting a $Conf{ClientTimeout} lower than "timeout" value wrote on rsyncd server, will result in rsync: writefd_unbuffered failed to write 4 bytes to socket [sender]: Connection reset by peer (104) after a couple of seconds. I've set "43700" on rsyncd.conf but tried to use a lower timeout value

  1   2   3   4   5   6   7   >