Re: [BackupPC-users] Backup problems with /home directory
On Tue, Apr 16, 2024 at 2:12 AM John Cusick wrote: > > I would have thought that the "sudo /usr/bin/rsync" would give the rsync > executable root level access but I guess not. Something has appeared to have > changed from 6 years ago and I'm not sure what it is. > > (again, the sudoers file reads: "backuppc ALL= NOPASSWD:/usr/bin/rsync" ) When you are running rsync as a daemon, the permissions are entirely controlled by the startup options and config file and the authorized user setup has nothing to do with local users or sudoers. The daemon needs to run as root to access most files and even then Selinux can prevent access. Try disabling Selinux to see if that allows access. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup problems with /home directory
On Mon, Apr 15, 2024 at 9:10 PM John Cusick wrote: > > I've searched multiple sites and everything I've tried just isn't working. > > I'm using rsyncd > > The systems I'm testing are both Fedora 39, one server and one laptop. > > I'm using the BackupPC on the server: > BackupPC-XS-0.62-13.fc39.x86_64 > BackupPC-4.4.0-10.fc39.x86_64 > > I named the backup user "backuppc" which has passwordless ssh login on both > the server and laptop client. > > the sudoers file has the following entry: ... Are you sure you understand the difference between the rsync and rsyncd methods?Rsyncd expects a standalone rsync daemon listening on the client and backs up 'shares' in the rsyncd.conf setup. The rsync method connects over ssh to the client and either needs to connect as root on the client or have a more convoluted sudo configuration to have permission to read everything. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] PingCmd no longer having effect
On Fri, Apr 5, 2024 at 3:56 PM Ian via BackupPC-users
wrote:
>
> I guess this is my fault due to my setup. I have several systems at a single
> dynamic ip. I have backupPC set up like so:
You can use $Conf{ClientNameAlias} to point multiple hosts to the same
IP (or a resolvable name).
--
Les Mikesell
lesmikes...@gmail.com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] How to run a manual backup.
On Wed, Mar 6, 2024 at 9:18 AM Tony Molloy wrote: > > Thanks, yes the real problem is with the configuration of sshd on CS-9. It > seems to be slightly different than on CS-8. So I don't have ssh working on > the CS-9 box yet. I get the following error when I try to ssh between > accounts even on the laptop box itself. > > sshd[2608]: refusing RSA key: Invalid key length [preauth] > sshd[2608]: Accepted password for root from 192.168.1.8 port 35958 ssh2 > > So I was hoping for the test of BackupPC that running a manual backup when > the ssh login failed that it would fall back and ask for a password. This is > just a test laptop and I wanted to make sure all the services I regularly use > were working on it before I upgraded my home network. > > So it's back to sorting out sshd. It looks like they have changed the acceptable key pairs for sshd in CS-9. I found this article saying you either have to configure the crypto policy to accept SHA1 or generate new key pairs with an acceptable format. https://serverfault.com/questions/1095898/how-can-i-use-a-legacy-ssh-rsa-key-on-centos-9-stream -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
On Fri, Feb 16, 2024 at 2:31 AM daggs wrote: > > managed to get it to work, the the -s was / and the rest was all the folders > one after another as * didn't worked > If you aren't familiar with the unix/linux shell, * would have to be enclosed in single quotes like '*'. Otherwise it expands to the list of files in your current directory before the command sees it. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
On Tue, Feb 13, 2024 at 1:15 PM daggs wrote: > > I want to restore it to a mount I've attached to the backup server > so Backuppc_tarCreate -h host -n -1 | tar xf -C /mnt > will do the trick? > Backuppc_tarCreate needs a '-s sharename' option which would be the share you used for the backup (maybe '/') and you can specify a list of files or directories to restore. You can also use '-l' to just list the files. I'd try that first - and maybe restore a small directory like /etc or a single file first to see if you are on the right track. I'm retired and a little fuzzy on this myself.Also, is the drive mounted as /mnt or something under /mnt? I'd cd into the top of that mount point to run the command instead of using -C. Also tar needs a '-' after the f option to tell it to read stdin. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
On Sun, Feb 11, 2024 at 12:08 AM daggs wrote: > > > > > what is the expected behavior if I restore to remote and not localhost? > > > > > > > That's going to depend on ssh being set up correctly on the remote. > > And it will use the method configured for that host for the restore. > > If you want the large tar image file instead you could use the web > > interface to download it on some other computer with space. > > > > both machines are headless... > also, I'm not sure I can place a >2 TB file anywhere on my systems. > > I assume I can use BackupPC_zcat on each file and restore it to the proper > location, thing is, I have the files which are part of either full backup and > incremental backup > and the last save is a incremental one, so is there a way to work with only > the incremental one and have BackupPC_zcat know when to take it from the full > backup? Did you want to restore to the original remote host or to a mounted local filesystem? If the latter, and the problem is not having space for the intermediate tar image file, then pipe the tarCreate command output to an appropriate tar restore command. Note that the extract will happen in your current directory unless you include a -C path option, and ownership is going to be set according to the numeric user id on the original file which may not match when on a different machine. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
On Sat, Feb 10, 2024 at 1:15 PM daggs wrote: > > what is the expected behavior if I restore to remote and not localhost? > That's going to depend on ssh being set up correctly on the remote. And it will use the method configured for that host for the restore. If you want the large tar image file instead you could use the web interface to download it on some other computer with space. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
On Sat, Feb 10, 2024 at 10:53 AM daggs via BackupPC-users wrote: > > the log doesn't specify the command but I think I have a clue, I saw that the > cmd is something in the line of this: > https://unix.stackexchange.com/questions/291402/backuppc-restore-using-command-line-tools > > so it restores it to local path, in my case the tar file should be almost 3 > TB of size and the local path as at most 16 GB. > the target path has enough space. > so I assume the issue is lack of space tarCreate writes to stdout, which in that example is redirected to a local file. Send it where you have space - or test again restoring only a small directory. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
On Thu, Feb 8, 2024 at 2:46 PM daggs via BackupPC-users wrote: > > any ideas? maybe to use the cli interface? > If normal permissions and mount status are OK, the next thing that could be preventing writing is selinux. Is it enabled/enforcing? -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
> > > Error: Can't open/create /var/lib/backuppc/pc/localhost/restoreReq.22495.0 > is there any other info required? Specifically, you need to know why the backuppc user can't write in that location. Maybe 'ls -l /var/lib/backuppc/pc' or 'ls -ld /var/lib/backuppc/pc/localhost' will tell you. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Setup for Windows backup with rsync
On Sat, Jan 20, 2024 at 9:18 AM Stephen Blackwell wrote: > > Ah, that was it. Well, that and a couple of other parameters needed setting. > Thank you. Also, it is possible to do a better job on windows if you use the VSS shadow copy system in combination with rsyncd. I'm not an expert on that myself but you can probably find what has previously been posted to this list if you search. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Setup for Windows backup with rsync
On Fri, Jan 19, 2024 at 4:06 PM Stephen Blackwell wrote: > > My external backup drive died recently so I bought a NAS and installed a > docker with Backuppc in it and set it up to backup my Linux box. Works like a > charm. > > Now I want to add my Windows laptop to the list of clients. I was following > this guide but I get this error in the XferLOG.bad.z file: > You are supposed to use the rsyncd backup method in backuppc with that setup, not rsync. The difference is that rsyncd expects to connect directly with a listening rsync daemon, not start one with ssh. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Migrating User Data to New PC via BackupPC or Other?
On Fri, Dec 1, 2023 at 8:58 AM Tim Evans wrote: > I found a software package called "ToDo PCTrans" from EaseUS. > > https://www.easeus.com/pc-transfer-software/pctrans-pro.html > > It moves accounts (including user files, permissions, docs, photos, web > browser profiles, bookmarks--and cache--e-mail profiles, mailboxes, and > save messages. In addition, it moves applications over (free version > will move 5 apps; pro version ($49) will move all apps over). Just for the record, this is something Apple got right decades ago. With a Mac you can use the built in Time Machine program to do backups to an external drive and it will keep hourly snapshots fairly efficiently. Then you plug that into your replacement machine and it will offer to put everything back or you can do it selectively, More recently, even if you didn't have a backup, if the old machine is still running, when you put a new one on the same network it will offer to copy everything over (phones and ipads do this too). The migration even includes whatever had to happen when they've switched CPUs from powerpc to intel and then arm. With Windows, I've usually cluttered them up so much with extra utilities etc. that I take the opportunity to start from scratch and just move the documents I know I need. Having a backup of the old machine helps with that since I know I can retrieve anything I missed later. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Best Practice to Speedup RSYNC
On Fri, Sep 29, 2023 at 1:46 AM David While via BackupPC-users wrote: > > Hi > > Yes I believe that could be the cause. I did some tests with the storage > mounted as NFS and then mounted as an ISCSI disk. > > The ISCSI disk was considerably faster. Can you run the backup against the host of the NFS drive instead of another host mounting it over the network? The way rsync works is that the host where it runs has to read the whole contents of each file in order to use the block checksum algorithm to decide what differences to send. If the drive is mounted over NFS, that complete read will be over a network before it can decide how to reduce network use sending to the rsync partner. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Why not use Backuppc to backup server systems?
On Thu, Aug 10, 2023 at 9:52 AM G.W. Haywood via BackupPC-users wrote: > >> > ... bootable image ... integrate that into backuppc ... > > My head hurts. :) > Saving headaches would be the point... If you've ever had to re-create a one-off custom filesystem layout and get enough stuff installed to start restoring from backuppc you'll know that it can be fairly complicated and time consuming. For older systems it may even be hard to find a matching install image with the right filestem tools. What ReaR does is use your current running distribution's installed tools to create a bootable image (as a file) containing the programs and script needed to reproduce that filesystem layout, chroot into it, and start a restore using one of several methods. It gives several opportunities to make layout changes or drop to a shell if you don't want an exact copy, but reproducing the original on new hardware (real or virtual) is mostly the point. I'm retired now and it has been a while since I used it, but I found it very handy for things like moving old/custom systems from real to virtual hardware or raid sets to normal drives, and in the process noticed that it did pretty much everything that backuppc does not do in the restore process, and that all it would take to make the perfect system would be for backuppc to manage those boot image files along with the rest of a backup and for Rear's restore script to be compatible with backuppc, either doing a tar restore from backuppc's archive output or starting sshd to wait for backuppc to initiate the restore.But, as you can imagine, there is a lot of variation in what ReaR has to do across Linux distributions and versions for the different filesystems, LVM, and raid approaches and to make the final result bootable so I've never considered touching it myself. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Why not use Backuppc to backup server systems?
On Wed, Aug 9, 2023 at 10:41 AM Marki wrote: > > Those limitations exist with every other file-based backup solution. > Of course you should test a recovery from time to time ;) There is an interesting Linux program called ReaR (Relax and Recover) that generates a bootable image and script to reinstall to bare metal from a few different types of backups. I always thought that it would be relatively simple to integrate that into backuppc so the bootable image was a file included in the backup so you would only need to make the USB or iso after you knew you needed it, and the reinstall script would pull the backup from backuppc. But there is a little too much black magic dealing with differences in Linux versions for me to trust that it would work if I tried to change it. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Why not use Backuppc to backup server systems?
On Wed, Aug 9, 2023 at 8:42 AM Wächtler, Jan wrote: > The Overview description of backuppc states that it is a > > “ .. system for backing up Unix, Linux, WinXX, and MacOSX PCs, desktops > and laptops …” > > > > Is there any reason why this list does not include Server systems? > > I am using it for years now to backup (web/application/database)-server > data and configuration, is there any reason why I should not do so? > > > Databases can be a problem because they update all the time so you may not get a consistent snapshot unless you use the tool specific to the database to perform a consistent dump to a file, then let backuppc back that up. Similarly with active windows machines you may need to use tricks to make a shadow filesystem copy to get files that would be locked. Other than that, the only issue is that it won't do a bare metal restore, so you have to be prepared to do an OS and app install or use another approach to get to a point where backuppc can put the files back. If instead, you just want to grab an old copy of a file or directory lost or corrupted by mistake, backuppc is better than most at that. Of course in a production system you should really have a formal version control system and deployment process to fix that sort of thing. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Pool hashing gives XXX repeated files with longest chain 1
On Thu, Mar 16, 2023 at 10:53 AM Rob Sheldon wrote: > > Why are you assuming this is "randomly" happening? Any time an identical file > exists in more than one place on the client filesystem, there will be a > collision. This is common in lots of cases. Desktop environments frequently > have duplicated files scattered around. I used BackupPC for website backups; > my chain length was approximately equal to the number of WordPress sites I > was hosting. > Identical files are not collisions to backuppc - they are de-duplicated. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup strategy for rarely-connected clients
On Tue, Jan 31, 2023 at 3:36 PM Richard Shaw wrote: > >> An additional problem is that the machine might only be connected for a >> short period, so the server might miss that window and fail to back it >> in the short period it's connected, as it's busy with other backups. > > > I think the perfect world example would be if there was a client you could > run so the computer could inform the server when it's up, perhaps via a REST > interface. > Why can't the user log into the web interface and start the backup at appropriate times? And if the admin gets the email that it hasn't been backed up, he can call the guy up and remind him... -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Tar causing problems with removable drive on localhost
On Thu, Jan 19, 2023 at 4:41 AM Adam Hardy wrote: > > 50% of the time, the backup works. When I run the command above as the > backuppc user, it never fails. The removable drive is always connected. > > Following advice from this mailing list in October, I searched all my logs > and found nothing related. > > I also added this to ArchivePreUserCmd: ls -la /media/adam/Videos-2TB/Videos > > However the error has not been solved. > As a wild guess, I'd say the USB drive is going to sleep and takes more time to spin up. Your PreUserCmd is probably the right idea but also failing and continuing too quickly. 'fdisk -l' might be better but needs to run as root, or maybe just adding ";sleep 2' after your ls command would work. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] File Size Summary shows too large value for host
On Tue, Dec 13, 2022 at 3:29 AM Stefan Helfer wrote: > > Hello Iosif, > > Just to be sure, what do you mean by "Can you check sizes in parallel"? > I have already looked at the two backups, from v3 and v4, and compared them. > There are NO differences in the exports. Same size, same content, everything > identical. > If I start with a smaller list of files for the backup, I still see a > difference. However, the difference becomes smaller. > I thought v4 knew enough not to transfer files already in the pool found on another host, where v3 transfers them before finding they are duplicates and converting to hardlinks and only skips matches from a previous backup of the same host. Maybe it is calculating sizes from the transfers. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Setuid problem
On Sat, Nov 5, 2022 at 2:57 PM Dave Bachmann wrote: > > This reinforces my fear that the latest install may not have run properly and > that there are other problems lurking. I expect that index.cgi should have > been created by configure.perl, but don't understand why it wasn't. What's > involved in creating it post-hoc? > Is there some reason you don't use the packaged version for your linux distribution? -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Missing backup files
On Thu, Nov 3, 2022 at 1:39 PM wrote: > > Also, /var/log/BackupPC is a weird location unless it is a link to > something like TopDir/log in which case it should contain files of > form LOG.z and LOG.N.z -- but again these are not the relevant log > files. > > Reading the documentation would be a helpful thing to do -- it was > written for a purpose! The log location is almost certain a distribution-packaging choice, so along with recommending reading documentation you might also point out that the source documentation may not match what is actually installed and running. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] errors on network-mounted pool filesystem
On Fri, Sep 2, 2022 at 1:34 PM wrote: > > Sshfs may have other limitations as it is not a full-fledged > filesystem... > And conceptually, think about what has to happen when using rysnc with a remote filesystem. Computing the block checksums that is supposed to be a quick local disk operation now has to run the whole contents of each file over the network. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Import pool or clients
On Thu, Aug 4, 2022 at 11:36 AM backuppc--- via BackupPC-users wrote: > > > Right, I guess I should have mentioned that I don't trust that old HDD > anymore. Plus keeping backups of two old clients that only exist in BackupPC > has been a bad idea because if my backups get corrupted or deleted, I don't > have the original data to fall back to anymore. > There are straightforward solutions to that. Like using dd or ddrescue to clone the HD partition to a newer one. Or using backuppc's archive facility to make a tar image of each system. Or, given the disk space and time, use your VM with the mounted HD to restore into VM images of the old machines, perhaps one at a time and perhaps renamed to avoid conflict with the existing ones. Then let your current backuppc system back them up. If there is considerable overlap with the existing files the dedup might end up saving a lot of space. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Import pool or clients
On Thu, Aug 4, 2022 at 7:32 AM backuppc--- via BackupPC-users wrote: > > Right now I am thinking that it would probably be easiest if I set up a > Debian 10 VM, which comes with BackupPC 3.3.2, point that at the old data > directory and use it to extract the data I want. Then I store that on one of > my backed up clients so that it goes to the BackupPC installation that I > actually use. > That would work, but unless you really expect to regularly extract files from the old backups, why not just leave it at having the VM set up with a version of backuppc that works with the old drive mounted? Then on the odd chance that you need something from it, just fire up that VM again. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Real Time View of What Is Being Copied
On Fri, Mar 4, 2022 at 2:39 PM Kenneth Porter wrote: > > rsync over the network should use compression. If you're doing it inside > ssh, then use ssh's compression, which is more reliable. The run of > nulls will be compressed down to a count and one null. Their transfer > will be almost instantaneous. > Yes, but it still goes through the motions of 'reading' what could potentially be many TB of data even from a small file with the filesystem delivering all those nulls. It has been a long time since I had that problem but it did in fact cause trouble at least with the rsync back then and slower CPUs. It could be that rsync tried to write them all at the other end too. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Real Time View of What Is Being Copied
On Fri, Mar 4, 2022 at 7:16 AM G.W. Haywood via BackupPC-users wrote: > > Another possibility (and the only time I've ever seen this happen) is > that there might be a large file which is causing a timeout. It was > on a Linux box here, something went off the reservation and started > writing gigabytes of messages to a file called '.xsession-errors'. Unix/Linux has something calle 'sparse' files used by some types of databases where you can seek far into a file and write without using/allocating any space up to that point. The file as stored may not be large but most tools to copy it will act as though the empty parts were filled with nulls. Rsync might handle them these days but may still take the time to send the stream of nulls. But in any case they are rarely used on Windows. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Real Time View of What Is Being Copied
On Mon, Feb 28, 2022 at 3:34 PM Akibu Flash wrote: > > > I backup a couple of Windows machines to a linux machine via rsync. However, > the backup for one of the Windows machines never finishes and results in a > partial backup. In the CGI user interface Count column, the backup always > seems to hang at 311941 for hours and hours. Then at some point, the backup > apparently stops and afterwards another backup which by that time has queued > up starts anew. Never do I get a completed backup only a partial (at least > for the last year or so). > > > > Is there a way to start a backup from the command line and have the screen > show what in real time is actually being backed up? Not exactly what you are asking for, but since the problem target is windows you are probably hitting a file that windows has locked, and the solution might be to use windows VSS snapshots. You can search the mail list for other discussions but there is a link here to a tool to do that. https://sourceforge.net/p/backuppc/mailman/message/37189039/ -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Question about full backups
On Thu, Mar 3, 2022 at 11:29 AM Kim Scarborough wrote: > > Hello, > > I recently started using BackupPC, and I'm pretty happy with it. I don't > understand, however, the point of full backups beyond the initial one. Once > you've got everything, shouldn't incremental backups be sufficient going > forward? There's not as much difference as you might think. Because of the de-duplication you don't store additional full copies. With rsync, full backups just do a more thorough check for changes, actually checking the files not just the directory timestamps but still only transfer differences. With tar or samba, a full copy is sent but then discarded if a matching file already exists. With tar/samba, incrementals are based only on a timestamp and there are filesystem operations that can preserve or set old timestamps so you'd miss new/changed/moved files in an incremental but get them in a full. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Getting lost in installation following documentation
On Wed, Mar 2, 2022 at 10:07 AM wrote: > > - I'm sorry, I'm not able to program Perl software. > If you are not a programmer, is there some reason you don't use the version packaged for installation on your linux distribution? I found these instructions with google: https://kifarunix.com/install-backuppc-on-debian-11/ -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Can't access older backups after upgrade
On Thu, Nov 4, 2021 at 4:16 AM Anthony Chavez wrote: > > Namely? > > I use NFS for a lot of things. And apart from an abysmal security model (that > can fortunately be hardened with a lot of extra work), I've had no complaints. Think about the network activity that has to happen when you rsync a file with small changes when it is stored over an NFS mount. The whole thing has to be read over the network to find the differences - when most of the point of rsync is to avoid that network traffic. That's not your immediate problem but something to consider when putting the backuppc pool on NFS. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Recommend an external drive
On Mon, Oct 18, 2021 at 7:03 PM Kenneth Porter wrote: > > My Western Digital MyPassport 4TB external drive has filled up so it's time > to buy something bigger. I'm thinking an 8 or 10, possibly a Western > Digital, as I've had fairly good experience with them over the years. > > Any suggestions on which to look at? I want something easy to format to > ext3 or ext4. (Obviously not a "Windows-only" drive!) If you are a Costco member there is this 8Gb Seagate on sale. https://www.costco.com/seagate-backup-plus-hub-8tb-desktop-hard-drive-with-rescue-data-recovery-services.product.100458004.html I'm not even sure you have to be a member to order it online. I've generally had better luck with Seagate than WD but I think they are mostly the same these days. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] We need excellent and well-written documentation for linux backup software
On Sat, Aug 28, 2021 at 4:45 AM Turritopsis Dohrnii Teo En Ming wrote: > > > We need excellent and well-written documentation for your linux backup > software. Please provide us with links on how to setup your linux > backup software. As with most Linux software, the best approach for most people will be to install the packages built for your linux distribution so it will stay updated with the rest of the system along with its dependencies. And then the final configuration will depend somewhat on the package and distribution defaults as well as your local clients. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Lost config.pl file during full backup
On Sun, Aug 1, 2021 at 9:30 AM oetschi.ex...@bluewin.ch wrote: > > > So backuppc users please do not make (full-) backups and system updates > together. You could lose some time in investigating and not be able to use > backuppc. > This report might be more useful if you mentioned 'which' system you are talking about. I'd guess it was some linux distribution, but their packaging and updates work differently. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] BackupPC 4.4.0: Incremental smb backup is skipping not backed-up files under certain conditions
On Fri, Jun 11, 2021 at 8:38 AM Michael Stowe wrote: > It is worth poking at the contention that "an incremental backup with rsyncd > unfortunately takes as long as the full backup." This probably isn't true, > but I can understand how one can believe this after running a single > incremental backup with rsyncd. How does rsyncd know what to copy > incrementally? It skips files that are already copied ... of which, there > are none for your first incremental backup. If the files are mostly tiny, you can see how rsync's action of exchanging the directory information needed to determine existing/changed status would be almost as much work as updating the files. > If your *second* incremental backup takes almost as long as the full backup, > we'll need more details, as your configuration is deviating significantly > from expectations. I think I recall something about the third rsync backup getting a speedup too, where the block checkums are saved on the 2nd run after a file has been copied. Not sure if that still applies to v4. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Problem with WakupSchedule and Backupplan
On Tue, May 4, 2021 at 10:24 AM Ralph Sikau wrote:
>
> I have a large media library which is too big to be backed
> up on a single day. That's why I'd like to split up the real
> host in several virtual hosts each defining a special part
> of the library and being backed up at night on a special day
> of the week. The PCNightlyJobs shall run during daytime.
> Can you give me an example of a correct configuration for
> this? Thanks in advance!
>
One approach to this is to make up several hostnames for your virtual
hosts, using $Conf{ClientNameAlias} to point them to the correct real
host. Then use includes/excludes to specify the directories you want
each to contain and the blackout periods to define the times you do
not want each to be backed up - leaving the window you want for each
so normal scheduling will queue them. Just be aware that if you only
include specific directories you may miss later additions or changes
on the host.
--
Les Mikesell
lesmikes...@gmail.com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Copied config with old hostname and backing up myself by mistake
On Mon, Apr 12, 2021 at 5:07 PM Gavin Henry wrote:
>
> DNS is correct in that gavin.suretec.net is in DC1, but even after
> changing all the BackupPC server details to henry.suretec.net, it's
> still treating henry.suretec.net as the other host
> (gavin.suretec.net), i.e. it's not connecting to gavin.suretec.net to
> rsync data back. It's just rsyncing to itself.
If you have anything in $Conf{ClientNameAlias} it would override the
host name. Also an entry in the server's /etc/hosts file could
override DNS when connecting. If it is a windows target using netbios
names it would be the client's own idea of its name that matters.
--
Les Mikesell
lesmikes...@gmail.com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Renaming clients from IPs?
On Wed, Apr 14, 2021 at 9:18 AM wrote: > > Seems like this is all a network admin problem and little if anything > to do with BackupPC... > No, it is kind of the point of ClientNameAlias. It lets you use whatever name you'll recognize as the host, but still provide a resolvable name or IP address that will work on your network to reach it. It can also be used if you want to split a single large host into separate runs with subsets of directories. You can make it appear like separate hosts for scheduling while still pointing to the same actual target. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Renaming clients from IPs?
On Tue, Apr 13, 2021 at 8:29 AM Kenneth Porter wrote: > > If the hosts support mDNS (and Windows does), use hostname.local. You might > need to install the Avahi package on your BackupPC server to use mDNS. That still doesn't completely solve his problem. Whether he uses DNS/mDNS or puts the IP in ClientAliasName he still needs to rename the existing backups made with the IP as the hostname. Does that take more than just changing the host and renaming the directory under pc/ to match? -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Handling machines too large to back themselves up
On Thu, Apr 8, 2021 at 8:25 AM Dave Sherohman wrote: > rsync error: error allocating core memory buffers (code 22) at util2.c(118) > [sender=3.2.0dev] This is more about the number of files than the size of the drive. Do you happen to know if there are directories containing millions of tiny files that could feasibly be archived as a tar or zip file instead of stored separately? Also, rsync versions newer than 3.x are supposed to handle it better. Is your server side extremely old? https://rsync.samba.org/FAQ.html#4 -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup Stuff on HTTP Servers
On Tue, Mar 16, 2021 at 3:46 PM Mike Weber wrote: > > No, I think rancid and oxidized are exactly what I am looking for. I was > just looking at both of them. > > Do you know if either of them support any type of alerting or reporting? One > of the key features I was looking for was notification if a config backup > failed. > > I was just looking (from the rancid wikipedia page) it looks like OpenNMS, > and LibreNMS use it in some manner. It has been several years since I've used either but I think rancid will email you about errors. OpenNMS is very configurable and will notify you about all kinds of things. I used it very extensively, but again it was several years ago - I'm retired now. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup Stuff on HTTP Servers
On Tue, Mar 16, 2021 at 2:22 PM Mike Weber wrote: > > I have some switches, with no ssh smb or sshfs > > I want to pull a config via http... > > can backuppc support http+https server pulls? If it is not worth setting up a separate backup/management system like rancid or oxidized (https://nsrc.org/workshops/2020/apricot/nmm/netmgmt/en/rancid/config-management-rancid.pdf) you could simply have a cron job pull copies nightly into a directory somewhere to be included in your other backups. If other people edit them or there are frequent changes I recommend pushing them into subversion or cvs (perhaps editing out any timestamps inserted by the retrieval process so only 'real' changes will show as a new commit with differences) and having a viewvc wrapper to make the changes easy to spot. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Full backups taking a very long time
On Sat, Mar 13, 2021 at 9:25 AM Sorin Srbu wrote: > > > Maybe some OS defaults changed at the OS-upgrade? > Or, if we are getting down to wild guesses, check that the network interfaces are running at gigabit, full duplex all the way through. A driver update might make the system more sensitive to out-of-spec cables or something and auto-switch down. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Using BackupPC 4.x with rrsync on the client
On Wed, Feb 10, 2021 at 1:58 PM wrote: > > 4. Further, along that line, while sudoer has been well-tested, About that https://www.helpnetsecurity.com/2021/01/27/cve-2021-3156/ -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Using BackupPC 4.x with rrsync on the client
On Wed, Feb 10, 2021 at 12:47 PM Felix Wolters wrote: > > I may add, that working with a non-privieged user isn’t even necessary in > many cases, as rrsync is able to restrict access to (1.) a specific command > (if need be with specific options), (2.) a specific folder, and (3.) to read > only access – but offer full root access and allowing rsync -a to keep users, > groups and permissions. That makes it powerful. > > The problem here just seems to be that rrsync (on the client to back up) and > rsync-bpc are not compatible, and a patched rrsync will – hopefully! – be the > solution. Isn't rrsync just a perl wrapper to start rsync but ensure it is only accessing a permitted subdirectory? If so it should be a matter of tweaking the command to start it to be compatible. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Which filesystem for external backup drive?
On Sat, Feb 6, 2021 at 10:38 AM G.W. Haywood via BackupPC-users wrote: > Frankly I don't know. Like Mr. Mikesell I've had good experience with > the tools for EXT4, but my wife has managed to trash at least one EXT4 > partition by simply plugging a USB device into a powered USB hub which > at the time happened to be supporting the USB disc drive on a Pi4B. Just as another anecdote, I have run one or more USB drives connected to an imac for time machine backups and extra storage for many, many years and while I've never seen anything that I blame on 'generic USB' connections, I have had several drive hardware failures and one instance of one port on a powered USB hub going bad with intermittent failures causing disc corruption. As a side note, I've come to appreciate a feature of the mac's time machine that was added at some point and I don't think it was very well publicized. If you connect 2 drives configured as time machine backups and keep them both connected it will automatically alternate between them. Since it runs every hour, I think this is a more robust scheme than using raid for redundancy with the things that can go wrong in raid recovery. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Which filesystem for external backup drive?
On Fri, Feb 5, 2021 at 1:25 PM Robert Trevellyan wrote: > I'm pretty sure my Ubuntu systems are not using FUSE to access ZFS. If that > means I have to trust the lawyers for Canonical as to the legality of using > ZFS on Ubuntu, so be it. https://www.theregister.com/2020/01/13/zfs_linux/ Torvalds declared: "Don't use ZFS. It's that simple." So, there's always freebsd... -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Which filesystem for external backup drive?
On Fri, Feb 5, 2021 at 12:02 PM Robert Trevellyan wrote: > Problematic in what way? It's been silky smooth for me with Ubuntu. Because it is not GPL and the kernel has a restriction against linking anything that can't be distributed under the GPL. So, you either have the overhead of FUSE or questionable legality. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Which filesystem for external backup drive?
On Fri, Feb 5, 2021 at 11:45 AM Robert Trevellyan wrote: > > Is there any reason not to choose ZFS? Even without redundancy, you'll at > least know if it's corrupted. ZFS on Linux is always problematic because Linus wants it to be. Ext4 is the path of least resistance and I've always found its tools to be good at repairs (had trouble with XFS long ago, back when it's speed of creating/deleting files made it seem to be worth using). -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Which filesystem for external backup drive?
On Thu, Feb 4, 2021 at 11:05 PM wrote: > > Also, I find btrfs snapshots to be very valuable. Especially, if I am > messing/playing around with backuppc... that way I can easily revert > if I mess something up... > > Snapshots have also saved me when I have run across the occasional > backuppc gremlin of disappearing files in that I can find the cpool > file and revert it from past snapshots. Are you sure that the disappearing files aren't a quirk of btrfs in the first place? -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] OT: To top-post or not?
On Thu, Feb 4, 2021 at 6:29 PM Kenneth Porter wrote: > > The biggest pain is finding an MUA that can support both and allows the > different quoting style. In interleaved, prefix the quote with "> ". In > top-post, copy the message below a separator line with no prefix. Has > anyone found a decent MUA that can do that? I love the ancient Mulberry for > mailing lists. But it insists on prefix-quoting when I top-post. So does > Thunderbird, which I use in parallel to deal with HTML email (which is > useful for support for inline images, like when a customer is reporting a > broken product). If you are willing to use gmail, the web interface mostly hides the already-read quoted parts whether they are above or below the new text, replacing them with an elipse (...) that you can click to expand in the unlikely event that you want to see it again. So it doesn't matter much whether the new part was on the top or bottom. And when you reply, if you expand the old part it shows as >prefixed if you want to interleave your reply or trim the quoted part. -- les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] OT: To top-post or not?
On Wed, Feb 3, 2021 at 1:41 PM wrote: > > Paul Leyland wrote at about 18:59:24 + on Wednesday, February 3, 2021: > > I have, very reluctantly, been forced to accept top-posting. > > Sadly, that has become too true. My solution is that a short answer is > easier/simpler to top-post -- but any serious and in-depth dialog is > much better off being woven into the earlier posting so that one can > see context and not have to rewrite or reread. I'd guess that these days enough people use gmail's web interface that collapses 'already read' content to ellipses that you can ignore or expand that it doesn't really matter whether the new part is at the top or bottom. But yes if you need to reply to different parts it should be interwoven. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Checking rsync progress/speed/status
On Tue, Jan 12, 2021 at 4:15 PM Greg Harris wrote:
>
> Yeah, that “if you can interpret it” part gets really hard when it looks like:
>
> select(7, [6], [], [6], {tv_sec=60, tv_usec=0}) = 1 (in [6], left {tv_sec=59,
> tv_usec=99})
> read(6,
> "\0\200\0\0\4\200\0\7\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
> 32768) = 27748
>
> Scrolling at 32756 lines in around 30 seconds.
That tells you it is not hung up. You could grep some 'open's out of
the stream to see what files it is examining. Sometimes the client
side will do a whole lot of reading before it finds something that
doesn't match what the server already has.
--
Les Mikesell
lesmikes...@gmail.com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Checking rsync progress/speed/status
On Tue, Jan 12, 2021 at 2:24 PM Greg Harris wrote:
>
I’ve yet to find a solid way to peer into the arena of BackupPC and
find answers to these types of questions.
Strace'ing the rsync process - possibly at both ends - gives you a
pretty detailed view of what is happening if you can interpret it.
--
Les Mikesell
lesmikes...@gmail.com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Return to BackupPC
On Mon, Jan 11, 2021 at 10:49 AM Jan Stransky wrote: > > Sorry, I did not read full thread... But I use a Docker image, that is > very easy at home. Do you lose any efficiency between the docker image and the mounted storage? -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Return to BackupPC
On Sat, Jan 9, 2021 at 3:19 PM Richard Shaw wrote: > I don't think it's practical for upstream to manage all of this across all > distros. Some will be similar, others may be very different. Perhaps - but anything that is not practical for an expert to maintain is certainly going to be too complicated for most casual users to tackle on their own. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Return to BackupPC
On Sat, Jan 9, 2021 at 1:39 PM Raoul Bhatia wrote: > >> I understand that packages can also be done badly, but if I do not trust > pre-packaged software, there are normally easy ways to package myself. > > Anybody care to share their perspective? "Well maintained" packages are always great, but they can leave you stranded if you need some quick fix and there is some problem with the maintainer or getting the repository updated. In my opinion, the 'best of all worlds' is where the source package includes the packaging script so you don't really need to know anything to build your own package if that is ever necessary. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] BackupPC 4.x on Raspberry PI?
On Thu, Jan 7, 2021 at 1:57 PM Guillermo Rozas wrote: >> >> Interesting... how does Banana Pi Pro compare to Pi4? e.g., >> performance, interfaces/ports, price, support... > > > I would say it's inferior in every aspect, except for the direct SATA > connector (I think it's roughly equivalent to a Pi2 or Pi3 in raw > specifications). If it wasn't for the reports about the Pi4 overheating / > needing an active cooler I would switch to a Pi4. There are several fanless cases that act as a huge heat sink. I like the flirc aluminum one but there are others and you can find some YouTube demonstrations/reviews of them. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] BackupPC 4.x on Raspberry PI?
On Mon, Jan 4, 2021 at 12:08 PM wrote: > > Would be good to understand if the issues with crashing 4B are due to: I think the 8Gb pi is a slightly different design anyway, and you'll also want the 64 bit OS version, and maybe the new Ubuntu so I doubt if any earlier experiences will be that helpful. One thing to consider, though, is that the tiny CPU fans that some of the kits provide are remarkably noisy. I ended up swapping with a fanless Flirc case but you might want to check some reviews or youtube demonstrations before picking anything. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] BackupPC 4.x on Raspberry PI?
On Mon, Jan 4, 2021 at 9:32 AM G.W. Haywood via BackupPC-users wrote: > > I've tried using a 4B and gave up with it - unreliable. That was the > one reservation. I think I've posted about my experience on the list, > check the archives. Maybe you just have a bad one or it is overheating in its case or something. I've left a 4B powered up for months without crashing. Mine doesn't have a load like backuppc - just occasionally playing videos with Kodi or Plex, but it doesn't crash. The only serious quirk I've seen is that having the HDMI port active interferes with wifi - but you'd want to use ethernet for backups anyway. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] BackupPC 4.x on Raspberry PI?
On Sun, Jan 3, 2021 at 6:25 PM wrote: > > I have compiled my own debian packages for Ubuntu x86 so I believe I > will be able to similarly compile them for Raspbian... :) I haven't tried it yet, but I believe there is now a full ubuntu release for the raspberry pi. That might be the place to start. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Windows (rsyncd) Backup issues
On Sat, Jan 2, 2021 at 1:37 PM wrote: > > Well, this basically reinforced my hate for Windows. I killed the backup; > and that’s left my C drive inaccessible, even to recovery processes.So, > I’m reinstalling Windows; with the pain that entails. That doesn't make any sense for anything rsyncd would have done. My guess is that you have some underlying filesystem or hardware corruption that you didn't hit with normal access. > One question I have about VSS – once I have that set up, isn’t that “enough” > of a backup? Why would I then want to back up using BackupPC? Or am I > missing something? VSS gives you a frozen snapshot that you can copy without contention of worrying about changes. It doesn't protect against future corruption or other problems with that disk or filesystem. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backuppc in large environments
On Tue, Dec 1, 2020 at 9:50 AM Dave Sherohman wrote: > > Is this something that backuppc could reliably handle? > > If so, what kind of CPU resources would it require? I've already got a > decent handle on the network requirements from observing the current TSM > backups and can calculate likely disk storage needs, but I have no idea > what to expect the backup server to need in the way of processing power. > The price is right for the software and you'll use a lot less disk space than other methods (with the big plus of instant access to single files or directories), so consider that you could divide the backups into two or more groups handled by different servers if you run into trouble with just one. It will help if the server has a lot of ram, and if you back up the virtual machines like individual hosts instead of their image files. Likewise you'll probably need to interact with the database servers with commands backuppc can send to get dumps that won't change during the copy. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Turn-key backup solution for all-Windows network
On Wed, Nov 18, 2020 at 11:09 AM G.W. Haywood via BackupPC-users wrote: > > The Pi 4B irregularly crashes for no apparent reason, the 3B+ doesn't. > So I wouldn't recommend the 4B (not *any* 4B version) for anything as > important as backup (nor for anything in or near a machine shop where > frequent power spikes could be expected). My Pi 4B doesn't crash, although I don't work it heavily. It does have something weird going on with interference from HDMI output to high resolution screens and the built-in wifi though, so maybe there can be other related issues depending on what you have connected and your cabling. - Les Mikesell l...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] [BackupPC-devel] BackupPC 4.4.0 released
> The system got itself into this state from a standard yum update. That's why you want to stick to all packaged modules whenever possible. Over time, dependencies can change and the packaged versions will update together. You can probably update a cpan module to the correct version manually but you need to track all the version dependencies yourself. There are some different approaches to removing modules: https://www.perlmonks.org/?node_id=1134981 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Migrating Hosts
On Mon, Feb 4, 2019 at 3:38 AM Arsalan Naeem wrote: > > Recently I experimented with host migration from one backuppc to another > fresh install. I rsynced the hosts folder in /var/lib/BackupPC/pc/< Host > to > a new instance. After adding the host via the web GUI. I could see all the > incremental/full backup history. I was able to download archive and restore > it to a server. I have done this many times with 100% success rate with other > hosts. > > I wanted to know is this a safe method off migration and cold storage backup > option, also how is this process working, I wasn't able to find anything in > the wiki regarding migrations other then TarCopy. With backuppc v3, copying a host directory works as far as having a copy of the content goes but you lose the de-duplication of storage for subsequent runs. The problem with it is that you lose the hardlinks into the pool/cpool directory that next backup run needs to be able to match files and make new hardlinks. So you'll get a 2nd copy of each file in your archive until the copied backups expire and are deleted. -- Les Mikesell lesmikes...@gmail.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Large directory
On Mon, Jul 9, 2018 at 9:42 AM, Bowie Bailey wrote: > > There was still plenty of free RAM and no swap usage. I know it was > still doing something because the pool filesystem was slowly growing. I > could try an strace, but I'll have to research that. I've never used > strace before. > Be sure to check RAM/swap at both ends. You give strace a process id number and it shows every system call and its arguments that the process is making. It's usually an overwhelming stream of text but you should be able to see the open() and read()s happening as long as it is still sending files. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Large directory
On Fri, Jul 6, 2018 at 1:38 PM, Bowie Bailey wrote: > > > Right now, the only error I've seen is the error that stopped the backup: > rsync error: error in rsync protocol data stream (code 12) at io.c(1556) > [generator=3.0.9.12] > > The main annoyance is that I have no way to track progress. While the > backup is running, I can't tell if it's about to finish, or if it's > bogged down and is likely to take a few more hours (or days). Rsync probably builds a table in memory to track the inodes of files with multiple links so you may be running out of RAM or slowing down from swapping. For a brute-force approach to see what is happening you could strace the rsync process on the sending side. You could at least tell if it is still opening/reading files. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Slow local backup
On Mon, Jun 18, 2018 at 9:38 AM, Bowie Bailey wrote: > > I have another big local backup that's been running all weekend. I am > trying sudo/rsync rather than rsyncd or ssh/rsync this time. This > directory has millions of small files (and is even bigger than the first > one), so I expect it to take longer. > > This time, I'm seeing higher IO-wait numbers: Moving the disk head around is almost always the slowest operation and on the first full it has to traverse every file. And backups tend to not fit the normal OS caching mechanisms that try to hide that slowness. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] about migrate to a new server
On Fri, May 11, 2018 at 10:16 AM, Luigi Augello <luigi.auge...@unipa.it> wrote: > > Never mind the more simple solution that I adopted is make new backups, > starting with all full backups > That's probably the best approach. If you need to keep any older snapshots you can make tar images with BackupPC_tarCreate from the old server. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] about migrate to a new server
On Thu, May 10, 2018 at 2:37 PM, Luigi Augello <luigi.auge...@unipa.it> wrote: > > It is V3 and the new backuppc server have V4. > I cannot preserve the old server I will return it because it was on leasing. > which is the solution. Can I convert V3 to V4 and after can I make the > migration to new server ? Whether it is practical to rsync the whole archive directory or not will depend on the overall size and to a certain extent to the amount of RAM in the server. Expect it to take several days anyway.You can use dd to copy the entire drive or partition to a similarly-sized device. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Best way to copy backuppc data
On Sat, Feb 3, 2018 at 5:50 AM, Adam Pribyl <pri...@lowlevel.cz> wrote: > On Fri, 2 Feb 2018, Iturriaga Woelfel, Markus wrote: > > > I am running short on ideas how to copy this. If you are copying to an identical disk you can use dd on the raw devices.The system may be confused by the identical UUID's if you have both drives connected when you reboot, though. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Can not start backup when client was a long time away
On Fri, Jan 12, 2018 at 11:40 AM, Nicolas Göddel <mailingli...@freakscorner.de> wrote: > > My laptop is only online in my LAN a few hours a week. Every time I connect > it to my LAN I try to manually start an incremental backup using the > BackupPC's webinterface. Unfortunality it never works directly except I wait > for hours. The thing most likely to fix itself over time would be name resolution for a DHCP client. Do you know how the name is registered after the machine is connected? And then how it propagates to your DNS service? -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-devel] Windows share not backing up - NT_STATUS_ACCESS_DENIED listing \System Volume Information\SRM\*
On Mon, Dec 18, 2017 at 4:11 AM, Marc Gilliatt <m.gilli...@live.co.uk> wrote:
>
> This has failed yet again. And its because it's trying to backup \System
> Volume Information\
>
> I do not know how to stop backuppc from not backing up this directory? I've
> tried excluding the directory, and then only included the directories that I
> want backing up.
>
Are you using both exclude and include on the same share? Per the docs:
"For Smb, only one of $Conf{BackupFilesExclude} and
$Conf{BackupFilesOnly} can be specified per share. If both are set for
a particular share, then $Conf{BackupFilesOnly} takes precedence and
$Conf{BackupFilesExclude} is ignored."
--
Les Mikesell
lesmikes...@gmail.com
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-devel mailing list
BackupPC-devel@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-devel
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Host Priority Option
On Tue, Dec 12, 2017 at 8:19 AM, Gurvinder <gurvin...@techblue.co.uk> wrote: > > I have been using BackupPc from past few months however I could not find any > option where I can prioritize hosts for backups from the list of hosts we > add. Let say i have 10 hosts added for backup, now I want specific hosts to > start backups earlier than other backup hosts. > > Is there a way to achieve this. I tried searching for the same on mailing > list archive however there was not one old post found where answer was no, It > cannot be done. I would like to confirm if there is a way to define hosts > priority. I don't think there is a setting to force an order - they are just scheduled as the age of the previous backup hits the interval set between them. You can manage it with a manual intervention, like starting a backup on the one(s) you want to happen first just before the blackout time ends. If everything has the same schedule, these will continue to run first as long as everything completes in order. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] problem with samba
On Tue, Nov 21, 2017 at 8:54 AM, Евгений <nau...@yandex.ru> wrote: >> Kinit for micha@ARAVA to access hayun-34 failed: Cannot find KDC for >> requested realm > > This is about Kerberos. > Have you configured kerberos properly? Is it working when you request ticket > (kinit command)? > I am not sure smbclient should use kerberos authentification by tickets by > default... can not check it for now. I believe smbclient will read the values from your /etc/samba/smb.conf file at startup unless you have pointed it elsewhere with the -s option. If you are also running a samba server you may have configured options that are incompatible with the backuppc client use. But that still doesn't explain a difference between full and incremental runs. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] error in rsync protocol data stream (code 12) (Restoring)
On Thu, Nov 16, 2017 at 12:08 PM, B <lazyvi...@gmx.com> wrote: > On Thu, 16 Nov 2017 10:45:40 -0600 > Les Mikesell <lesmikes...@gmail.com> wrote: > >> Yes, but things have to be very, very screwed up to get to the point >> where the user can't fix it with a tar download through a browser >> followed by an appropriate restore command. When things have been >> broken that badly it may be time to let someone else fix it. And if >> you are restoring a whole system you have to configure that part again >> anyway. > > Well, I can concede this to you, but it is a tiny bit extreme. > (do you climb mountains free hands with pitch black glasses and a > chopper waiting for you at the top ?;) No, but when doing a restore for any reason other than accidental complete deletion of a file or directory I nearly always restore to a different location and compare things instead of overwriting the existing current versions anyway. And it is not at all difficult to download a tar image and restore it where you want. Your hypothetical educated user that knows enough not to overwrite good data should not have a problem with it. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] error in rsync protocol data stream (code 12) (Restoring)
On Thu, Nov 16, 2017 at 10:37 AM, B <lazyvi...@gmx.com> wrote: > On Thu, 16 Nov 2017 10:21:49 -0600 > Les Mikesell <lesmikes...@gmail.com> wrote: > >> damaging) direct restore. But the admin should know what to tweak if >> he does need that massive restore. > > Yup, and the problem is: in this configuration, you *need* an admin > intervention to fix a restore, Yes, but things have to be very, very screwed up to get to the point where the user can't fix it with a tar download through a browser followed by an appropriate restore command. When things have been broken that badly it may be time to let someone else fix it. And if you are restoring a whole system you have to configure that part again anyway. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] error in rsync protocol data stream (code 12) (Restoring)
On Thu, Nov 16, 2017 at 3:19 AM, Jamie Burchell <ja...@ib3.co.uk> wrote: > Running as a restricted user is actually part of the BackupPC > documentation. It just neglects to mention that doing so as described > means restores are blocked. > > Having a non root user with sudo permissions to just rsync with the > "--server" param works fine for backup and restore. Maybe that should be documented more clearly. I could see where the read-only version might be useful in typical operation where the host 'owner' could still use the web interface to download copies of old files or directories but could not do a massive (and potentially damaging) direct restore. But the admin should know what to tweak if he does need that massive restore. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Execute bash script after each share on backup server
On Fri, Nov 10, 2017 at 10:11 AM, Julian Zielke <jzie...@next-level-integration.com> wrote: > I’ve written a script which should be run after each processed share of a > host. > > So I’ve tried using: > /bin/bash /etc/BackupPC/notify.sh -c $host -s $share -t $type -r $xferOK > > The log says it is being executed but also: > > Backup failed on server01 (DumpPostUserCmd returned error status 256) > > When I run the script using sh -c “…” backuppc iot runs fine. > > So what’s my mistake here? > Your script needs to return an exit code of 0. Anything else will be considered an error status. Scripts normally return the exit value from the last command executed. If that is not following conventions you can add a line 'exit 0' at the end to make backuppc consider it successful regardless. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-devel] SMB Windows share not backing up
On Thu, Nov 9, 2017 at 6:56 AM, Marc Gilliatt <m.gilli...@live.co.uk> wrote: > > It has once again failed. > > The user I created (backuppc) has read & execute, list folder contents and > read access as suggested by Nick. Should I give it write access as well, or > just give it full control? You should be able to test your settings by using smbclient in interactive mode, logging in as the same user. If you can't list a directory or get a file in interactive mode, it's not going to work in the tar mode that backuppc uses either. You'll probably also see the same from another windows box if you map the share with the same credentials. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-devel mailing list BackupPC-devel@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-devel Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Phantom host
On Fri, Oct 27, 2017 at 12:31 PM, Ethan Tarr <eta...@gmail.com> wrote: > BackupPC is running on a dedicated Debian Jessie machine (custom built 2U). > > Our PDC and SDC are Windows Server 2012 (Dell servers). > Is the 10.1.10.3 and 10.1.10.4 DNS servers that your backuppc host is querying those PDC/SDC boxes themselves or some other systems that would have to be kept in sync? -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Phantom host
On Fri, Oct 27, 2017 at 11:23 AM, Ethan Tarr <eta...@gmail.com> wrote: > > ;; Got SERVFAIL reply from 10.1.10.3, trying next server > > Server: 10.1.10.4 > Address:10.1.10.4#53 > ** server can't find mylaptop: SERVFAIL > > > I checked DNS and DHCP on the PDC back when this first happened and the > proper entries are still in place. Here’s what any other machine on the > network looks like: > I've forgotten most of what I ever knew about windows networking, but isn't there a client-side setting as to whether a DHCP client registers itself into DNS? Also, is your backuppc DNS server your PDC or does it have to keep DNS updated to some other server for your domain? -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BPC4: checksum
On Fri, Oct 27, 2017 at 10:11 AM, Gandalf Corvotempesta <gandalf.corvotempe...@gmail.com> wrote: > I'm using ZFS, so checksumming is done by ZFS itself, is not an issue for me > to skip any data corruption check, as zfs does this automatically > > What I would like is to keep load as low as possible on clients and > checksumming every file is slowing down everything I don't currently have a system running so I can't give very specific advice, but if I were doing it I'd probably try to fix the schedule to do fulls every 4 or 8 weeks and make them happen on weekends if that is down time on the clients, skewing them so different large clients get the full on different weekends and ones that complete overnight on weekdays.Alternatively, if the target data is neatly subdivided into top level directories, I might try to split runs to a single large host giving it multiple names, each with different shares, using ClientNameAlias to point it to the same target to make it possible to split the fulls into different days so each completes in the available time. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BPC4: checksum
On Fri, Oct 27, 2017 at 9:31 AM, B <lazyvi...@gmx.com> wrote: > > Correction (as often,I read much too fast): > >> This i going against: "I don't think so, because on incrementals BPC >> doesn't use "--checksum" at all." (v.4.x doc): > > The doc doesn't speak about incrementals (only fulls), but to be sure > about this, you should look at rsync_bpc source. > The default for rsync is to quickly skip any files where the timestamp and length match the existing copy. v3 used --ignore-times on full runs to go through the motions of transferring by comparing block checksums and transferring any differences. --checksum is similar but uses a single checksum over the whole file. I thought in v4 this mechanism is also related to the ability to match copied, moved or renamed files to existing matching content in the pool, so removing it might be a bad idea aside from eliminating the check for corruption or changes in content that don't update the directory/inode. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupFilesOnly file with format date
On Mon, Oct 16, 2017 at 2:52 PM, Jose Barriga <jbarr...@finkok.com> wrote: > hi everyone, I have many backups with different dates in the same directory, > by example: file-2017-10-16.txt , file-2017-10-17.txt, etc. I want to backup > only the current day, but I do not know how to set the backupOnlyFiles > parameter. im trying with: > > BackupOnlyFiles = file-'$date +%y-%m-%d'.txt > > but backuppc does not resolve this format. > I do not want to back up the whole directory because in each full backup I'm > going to consume a lot of disk space. any suggest? thanks > I think it is possible to evaluate some perl code in the per-host config files but you'll lose the ability to use the web editor if you do. But first, do you understand that backuppc pools all copies of the files? That is, if you backed up yesterday's file yesterday and it is included in today's backup too, you aren't going to take more space, or even much more time by including it again. You'll only save space if you are expiring the backups earlier than you remove the files on the source system. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackuPC 4 hang during transfer
On Fri, Sep 22, 2017 at 9:41 AM, Gandalf Corvotempesta <gandalf.corvotempe...@gmail.com> wrote: > Running transfers with loglevel 4, i can see that most of slowdown are > caused by: > > G bpc_file_checksum() > > calls. > How does your overall CPU and RAM use look while this is happening? Remember, your situation is unusual in that you are competing with the ZFS compression activity. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackuPC 4 hang during transfer
On Wed, Sep 20, 2017 at 10:20 AM, Gandalf Corvotempesta <gandalf.corvotempe...@gmail.com> wrote: > 2017-09-20 17:15 GMT+02:00 Ray Frush <fr...@rams.colostate.edu>: >> You indicate that your ZFS store does 50-70MB/s. That's pretty slow in >> today's world. I get bothered when storage is slower than a single 10K RPM >> drive (~100-120MB/sec). I wonder how fast metadata operations are. >> bonnie++ benchmarks might indicate an issue here as BackupPC is metadata >> intensive, and has to read a lot of metadata to properly place files in the >> CPOOL. Compare those results with other storage to gauge how well your ZFS >> is performing. I'm not a ZFS expert. > > Yes, is not very fast but keep in mind that i'm using SATA disks. > But the issue is not the server performance, because all other software are > able to backup in a very short time, with the same hardware. Backuppc uses the disk much more intensively than other systems. For the reasons that you want use it. And I'd guess that zfs block-level compression activity would be fairly inefficient on partial blocks for more or less the same reasons there is a hit with raid 5. I assume that your attempt to use the --inplace option reflects problems you've noticed with your other backup systems. If it works, --whole-file might be better, given a fast LAN and slow disks. Reconstructing a file from copied bits of the old and merging in the changes is pretty expensive. Also, I'm not sure anyone has experience with changing the compression level between runs. If you've done that it might add overhead. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackuPC 4 hang during transfer
On Wed, Sep 20, 2017 at 9:34 AM, Gandalf Corvotempesta <gandalf.corvotempe...@gmail.com> wrote: > >> I'm curious about what it is about your environment that is making >> it so hard to back up. > > It's the same with ALL servers that i'm trying to backup. > BPC is about 12 times slower than any other tested solution. > Obviously, same backup server, same source servers. You mentioned using zfs with compression. What kind of disk performance does that give when working with odd sized chunks? -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backing up Windows using rsync
On Tue, Sep 19, 2017 at 2:21 PM, Jeffrey West <jeffrey.w...@riptidesoftware.com> wrote: > Les, > > Thanks! I didn't realize you could edit the individual configs from the web > interface. Yes, not only that but if you have identical or near-clone systems you can copy the setup by adding them in the web interface with the syntax newname=oldname instead of just the new name. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backing up Windows using rsync
On Tue, Sep 19, 2017 at 11:10 AM, Jeffrey West
<jeffrey.w...@riptidesoftware.com> wrote:
> I am using a pl config file just for my host which has the following in it
> now.
>
> $Conf{RsyncdClientPort} = 873;
> $Conf{ClientNameAlias} = 'l-jwest17b.corpnet.com';
> $Conf{XferMethod} = 'rsyncd';
> $conf{RsyncShareName} = 'c-drive';
> $Conf{FullAgeMax} = '8';
> $Conf{RsyncdUserName} = 'backup';
> $Conf{RsyncdPasswd} = 'backup';
>
> I created a user / pass combination to see if that would help, but it
> didn't. I also changed the RsyncShareName to see if that would help, but it
> didn't.
>
What do you see if you look at it in the web configuration interface
for that host? If it is still trying to access '/' it is not parsing
your sharename the way you expect.
--
Les Mikesell
lesmikes...@gmail.com
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackuPC 4 hang during transfer
On Tue, Sep 19, 2017 at 10:47 AM, Gandalf Corvotempesta <gandalf.corvotempe...@gmail.com> wrote: > 2017-09-19 17:41 GMT+02:00 Les Mikesell <lesmikes...@gmail.com>: >> If your client rsyncd is configured to write a log file you should be >> able to see the invocation there. Just guessing, I'd say there is >> probably something wrong in your excludes and you are wandering into >> the /sys, /proc, or /dev directories and hanging when you access the >> contents. > > rsyncd is logging, but there isn't any invocation argument. > Anyway, the same command line (except for the "bpc" custom arguments) > is used by my > with rsnapshot and plain "rsync" and i'm able to backup the whole > server without issues. > > Maybe BPC is unable to manage some kind of files that plain rsync is > able to handle ? A brute-force approach to debugging would be to start an strace on the rsyncd client soon after the backup starts and after it hangs try to figure out the failing operation and hope you have enough scroll back buffer to find where the relevant file descriptor was opened so you know what it was. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackuPC 4 hang during transfer
On Tue, Sep 19, 2017 at 9:51 AM, Gandalf Corvotempesta <gandalf.corvotempe...@gmail.com> wrote: > I can't get rsync command from the client system, as "ps aux" doesn't > show the command invocation by the server. If your client rsyncd is configured to write a log file you should be able to see the invocation there. Just guessing, I'd say there is probably something wrong in your excludes and you are wandering into the /sys, /proc, or /dev directories and hanging when you access the contents. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backing up Windows using rsync
On Tue, Sep 19, 2017 at 7:59 AM, Jeffrey West
<jeffrey.w...@riptidesoftware.com> wrote:
>
> Changing the method to rsyncd made some progress. It now connects on port
> 873. I am now getting this error
>
> Last error is "Unknown module '/'".
>
> $Conf{XferMethod} = 'rsyncd';
>
> $conf{RsyncShareName} = 'C';
Something is wrong in your config. Backuppc thinks you have
$conf{RsyncShareName} = '/'; (the default).
Are you using the web interface to make and view the config changes
for this host?
--
Les Mikesell
lesmikes...@gmail.com
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backing up Windows using rsync
On Mon, Sep 18, 2017 at 1:47 PM, Jeffrey West via BackupPC-users
<backuppc-users@lists.sourceforge.net> wrote:
> All,
>
> I have rsync up and running on Windows and can successfully transfer files
> by running the rsync command from the BackupPC command line. I do not want
> to use SSH. Is there some way I can tell BackupPC not to use SSH when
> connecting via rsync? This is my config file
>
> $Conf{RsyncdClientPort} = 873;
> $Conf{ClientNameAlias} = 'l-jwest17b.corpnet.com';
> $Conf{XferMethod} = 'rsync';
If you are running a standalone rsync daemon on the target system, use
rsyncd as the xfermethod instead of rsync.
> $conf{RsyncShareName} = 'C';
And the sharename(s) should match the 'modules' you configured in your
rsyncd.conf.
--
Les Mikesell
lesmikes...@gmail.com
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] pc files ereadable (encoding?)
On Tue, Sep 5, 2017 at 4:55 PM, Maxime Chupin <note...@gmail.com> wrote: > Hi everyone, > > I'm facing a problem. I want to get back the files of a backup of a down > server. I have mount my disk on another machine, and I want to get the > files. > The files are stored (if I understand) in the > /PATHBACKUP/server/pc/localhost/147/f%2f/fhome/... > > For example, I want my .zshrc of my home. But the file is unreadable... > > cat /raid/server/pc/localhost/147/f%2f/fhome/fmc/f.zshrc You have to let backuppc do the restore, or at least have enough of it installed where you access the disk so that you can use the command line tools BackupPC_zcat or BackupPC_tarCreate. See the 'Command Line' section of http://backuppc.sourceforge.net/faq/BackupPC.html. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Email in backup success/failure
On Sun, Sep 3, 2017 at 3:26 PM, Gandalf Corvotempesta <gandalf.corvotempe...@gmail.com> wrote: > That's fine, so I'll able to configure bpc to send email every time a backup > is failed for an host? > if yes, how? See this section of the docs: http://backuppc.sourceforge.net/BackupPC-4.1.1.html#Email-reminders-status-and-messages It doesn't notify you specifically if one backup attempt fails. It notifies you when you don't have a good backup newer than EmailNotifyMinDays. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Scheduling advice
On Fri, Sep 1, 2017 at 11:35 AM, Gandalf Corvotempesta <gandalf.corvotempe...@gmail.com> wrote: > 2017-09-01 18:29 GMT+02:00 Les Mikesell <lesmikes...@gmail.com>: >> Unless you have a huge turnover in data, keeping more backups will not >> take a lot more space on the server. There is only one copy kept of >> each unique file, no matter how many backups you keep. And, since it >> is compressed it will take less space than the original copy. >> That's kind of the point of using backuppc. > > This is the same with rsnapshot that i'm currently using and i'm > running out of space. > Yes, bpc is able to compress data, but my biggest issue is with log > files, that change every day > and every server is creating about 20-30GB of new log files per day. Large, changing files can be a problem, but log files tend to be highly compressible. -- Les Mikesell lesmikes...@gmail.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
