[BackupPC-users] Disaster Recovery Configuration (Having a Hot Spare BackupPC server)
Hello everyone, I have been looking around for a solution to backing up the BackupPC server to a hot spare BackupPC server but haven't really found anything concrete. What I'm basically trying to do is this: I am currently using dd to make an exact duplicate of the server's configuration on another machine (that is also exactly the same). Once this finishes, I plan to put the drives into the spare computer and place it offsite at another location that has a direct fiber connection from the main site where the original BackupPC server is. What I'd like to do is change the hostname, IP, and have the other server running without having the actual BackupPC process running but installed. Then, using rsync (or some other recommended method), I would like to have the data copied over from the main server to the hot spare that is sitting at the alternate location without BackupPC running. From my understanding and logic, if I do this, I should be able to easily start up BackupPC if a disaster did happen and be able to access the files just as if I was using that machine to do backups on. So, I would like to have rsync* mirror the main server to the hot spare so if files are deleted off the main server, the process would delete the files automatically during a nightly run. So, my question is: What is the best solution to do this? I am assuming rsync since I've seen quite a few posts about it (and to be sure to use -H). However, I was hoping someone would have an entire command I would need to run and the best way to go about doing this since the backup server will be assumingly still building backups overnight. I also don't want to be retransferring unchanged files, only the ones that have changed (just like BackupPC does with the clients now). I've also heard someone mention storebackup but I'm not exactly convinced it's any better than rsync. Any assistance and guidance would be greatly appreciated. ~Ryan-- Protect Your Site and Customers from Malware Attacks Learn about various malware tactics and how to avoid them. Understand malware threats, the impact they can have on your business, and how you can protect your company and customers by using code signing. http://p.sf.net/sfu/oracle-sfdevnl___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Disaster Recovery Configuration (Having a Hot Spare BackupPC server)
Ryan, You're doing exactly what I'm doing, except that you want to rsync just differences between the live and spare machines. Unfortunately, you can't do so in a reasonable period of time, due to the problem with rsync and lots of hard links. My spare machines are connected by dedicated gigabit fiber in buildings 3 km apart. Once a week, I take an LVM snapshot, then use dd+ssh to copy the entire 1-TB filesystem image to the spare. This takes 14 hours. It's still faster than using rsync. Regards, Tyler On Wed, 2011-01-12 at 15:25 -0500, Ryan Blake wrote: Hello everyone, I have been looking around for a solution to backing up the BackupPC server to a hot spare BackupPC server but haven't really found anything concrete. What I'm basically trying to do is this: I am currently using dd to make an exact duplicate of the server's configuration on another machine (that is also exactly the same). Once this finishes, I plan to put the drives into the spare computer and place it offsite at another location that has a direct fiber connection from the main site where the original BackupPC server is. What I'd like to do is change the hostname, IP, and have the other server running without having the actual BackupPC process running but installed. Then, using rsync (or some other recommended method), I would like to have the data copied over from the main server to the hot spare that is sitting at the alternate location without BackupPC running. From my understanding and logic, if I do this, I should be able to easily start up BackupPC if a disaster did happen and be able to access the files just as if I was using that machine to do backups on. So, I would like to have rsync* mirror the main server to the hot spare so if files are deleted off the main server, the process would delete the files automatically during a nightly run. So, my question is: What is the best solution to do this? I am assuming rsync since I've seen quite a few posts about it (and to be sure to use -H). However, I was hoping someone would have an entire command I would need to run and the best way to go about doing this since the backup server will be assumingly still building backups overnight. I also don't want to be retransferring unchanged files, only the ones that have changed (just like BackupPC does with the clients now). I've also heard someone mention storebackup but I'm not exactly convinced it's any better than rsync. Any assistance and guidance would be greatly appreciated. ~Ryan -- Protect Your Site and Customers from Malware Attacks Learn about various malware tactics and how to avoid them. Understand malware threats, the impact they can have on your business, and how you can protect your company and customers by using code signing. http://p.sf.net/sfu/oracle-sfdevnl ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- The extreme horribleness of hell, as portrayed by priests and nuns, is inflated to compensate for its implausibility. If hell were plausible, it would only have to be moderately unpleasant in order to deter. -- Richard Dawkins, The God Delusion -- Protect Your Site and Customers from Malware Attacks Learn about various malware tactics and how to avoid them. Understand malware threats, the impact they can have on your business, and how you can protect your company and customers by using code signing. http://p.sf.net/sfu/oracle-sfdevnl ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Disaster Recovery Configuration (Having a Hot Spare BackupPC server)
On Wed, Jan 12, 2011 at 03:25:59PM -0500, Ryan Blake wrote: Hello everyone, I have been looking around for a solution to backing up the BackupPC server to a hot spare BackupPC server but haven't really found anything concrete. What I'm basically trying to do is this: I am currently using dd to make an exact duplicate of the server's configuration on another machine (that is also exactly the same). Once this finishes, I plan to put the drives into the spare computer and place it offsite at another location that has a direct fiber connection from the main site where the original BackupPC server is. What I'd like to do is change the hostname, IP, and have the other server running without having the actual BackupPC process running but installed. Then, using rsync (or some other recommended method), I would like to have the data copied over from the main server to the hot spare that is sitting at the alternate location without BackupPC running. From my understanding and logic, if I do this, I should be able to easily start up BackupPC if a disaster did happen and be able to access the files just as if I was using that machine to do backups on. So, I would like to have rsync* mirror the main server to the hot spare so if files are deleted off the main server, the process would delete the files automatically during a nightly run. So, my question is: What is the best solution to do this? I am assuming rsync since I've seen quite a few posts about it (and to be sure to use -H). However, I was hoping someone would have an entire command I would need to run and the best way to go about doing this since the backup server will be assumingly still building backups overnight. I also don't want to be retransferring unchanged files, only the ones that have changed (just like BackupPC does with the clients now). I've also heard someone mention storebackup but I'm not exactly convinced it's any better than rsync. Did anybody ever implement a backuppcfs using fuse? This would allow us to mount the backuppc pool filesystem, locally on the spare backuppc server. Then the spare could do daily backups of those mount points. This would solve the rsync/hardlink problem. It would be a little easier on the hosts than simply running two backuppc servers that backup the hosts -- hosts would only get backed up once a day instead of twice. -Rob -- Protect Your Site and Customers from Malware Attacks Learn about various malware tactics and how to avoid them. Understand malware threats, the impact they can have on your business, and how you can protect your company and customers by using code signing. http://p.sf.net/sfu/oracle-sfdevnl ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Disaster Recovery Configuration (Having a Hot Spare BackupPC server)
Dne 12.1.2011 21:25, Ryan Blake napsal(a): Hello everyone, I have been looking around for a solution to backing up the BackupPC server to a hot spare BackupPC server but haven't really found anything concrete. What I'm basically trying to do is this: I am currently using dd to make an exact duplicate of the server's configuration on another machine (that is also exactly the same). Once this finishes, I plan to put the drives into the spare computer and place it offsite at another location that has a direct fiber connection from the main site where the original BackupPC server is. What I'd like to do is change the hostname, IP, and have the other server running without having the actual BackupPC process running but installed. Then, using rsync (or some other recommended method), I would like to have the data copied over from the main server to the hot spare that is sitting at the alternate location without BackupPC running. From my understanding and logic, if I do this, I should be able to easily start up BackupPC if a disaster did happen and be able to access the files just as if I was using that machine to do backups on. So, I would like to have rsync* mirror the main server to the hot spare so if files are deleted off the main server, the process would delete the files automatically during a nightly run. So, my question is: What is the best solution to do this? I am assuming rsync since I've seen quite a few posts about it (and to be sure to use -H). However, I was hoping someone would have an entire command I would need to run and the best way to go about doing this since the backup server will be assumingly still building backups overnight. I also don't want to be retransferring unchanged files, only the ones that have changed (just like BackupPC does with the clients now). I've also heard someone mention storebackup but I'm not exactly convinced it's any better than rsync. Any assistance and guidance would be greatly appreciated. ~Ryan We are duplicating backuppc partition to external drives by synchronizing a SW RAID1 mirror. When write-intent bitmaps of mdadm are used, only changed parts of the partition are copied over. If you want to have the drive in another machine, perhaps iSCSI or ATAoE over a gigabit line would do fine. Our backuppc installation has tens of millions hardlinks and any filesystem-level duplication is technically unfeasible. Good luck, Pavel. -- Protect Your Site and Customers from Malware Attacks Learn about various malware tactics and how to avoid them. Understand malware threats, the impact they can have on your business, and how you can protect your company and customers by using code signing. http://p.sf.net/sfu/oracle-sfdevnl ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Disaster Recovery Configuration (Having a Hot Spare BackupPC server)
My spare machines are connected by dedicated gigabit fiber in buildings 3 km apart. Once a week, I take an LVM snapshot, then use dd+ssh to copy the entire 1-TB filesystem image to the spare. This takes 14 hours. It's still faster than using rsync. I use a similar approach, but backed up to encrypted volumes on removable drives (CRU Dataport 25) that I carry off site. The LVM snapshot is key, so you get an image of the file system in a consistent state (I always create the snapshot when backuppc is idle). A refinement is to alternate among two or more backup drives, so that in case the primary host goes down during a copy, you don't end up with your only backup in an inconsistent state. -- Protect Your Site and Customers from Malware Attacks Learn about various malware tactics and how to avoid them. Understand malware threats, the impact they can have on your business, and how you can protect your company and customers by using code signing. http://p.sf.net/sfu/oracle-sfdevnl ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Disaster Recovery Configuration (Having a Hot Spare BackupPC server)
On Wed, Jan 12, 2011 at 04:04:37PM -0500, Rob Owens wrote: On Wed, Jan 12, 2011 at 03:25:59PM -0500, Ryan Blake wrote: Hello everyone, I have been looking around for a solution to backing up the BackupPC server to a hot spare BackupPC server but haven't really found anything concrete. What I'm basically trying to do is this: I am currently using dd to make an exact duplicate of the server's configuration on another machine (that is also exactly the same). Once this finishes, I plan to put the drives into the spare computer and place it offsite at another location that has a direct fiber connection from the main site where the original BackupPC server is. What I'd like to do is change the hostname, IP, and have the other server running without having the actual BackupPC process running but installed. Then, using rsync (or some other recommended method), I would like to have the data copied over from the main server to the hot spare that is sitting at the alternate location without BackupPC running. From my understanding and logic, if I do this, I should be able to easily start up BackupPC if a disaster did happen and be able to access the files just as if I was using that machine to do backups on. So, I would like to have rsync* mirror the main server to the hot spare so if files are deleted off the main server, the process would delete the files automatically during a nightly run. So, my question is: What is the best solution to do this? I am assuming rsync since I've seen quite a few posts about it (and to be sure to use -H). However, I was hoping someone would have an entire command I would need to run and the best way to go about doing this since the backup server will be assumingly still building backups overnight. I also don't want to be retransferring unchanged files, only the ones that have changed (just like BackupPC does with the clients now). I've also heard someone mention storebackup but I'm not exactly convinced it's any better than rsync. Did anybody ever implement a backuppcfs using fuse? This would allow us to mount the backuppc pool filesystem, locally on the spare backuppc server. Then the spare could do daily backups of those mount points. I should clarify that the mount points would be of the most recent daily backup. This would solve the rsync/hardlink problem. It would be a little easier on the hosts than simply running two backuppc servers that backup the hosts -- hosts would only get backed up once a day instead of twice. -Rob -- Protect Your Site and Customers from Malware Attacks Learn about various malware tactics and how to avoid them. Understand malware threats, the impact they can have on your business, and how you can protect your company and customers by using code signing. http://p.sf.net/sfu/oracle-sfdevnl ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Protect Your Site and Customers from Malware Attacks Learn about various malware tactics and how to avoid them. Understand malware threats, the impact they can have on your business, and how you can protect your company and customers by using code signing. http://p.sf.net/sfu/oracle-sfdevnl ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Disaster Recovery Configuration (Having a Hot Spare BackupPC server)
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 13/01/11 07:54, Tyler J. Wagner wrote: Ryan, You're doing exactly what I'm doing, except that you want to rsync just differences between the live and spare machines. Unfortunately, you can't do so in a reasonable period of time, due to the problem with rsync and lots of hard links. My spare machines are connected by dedicated gigabit fiber in buildings 3 km apart. Once a week, I take an LVM snapshot, then use dd+ssh to copy the entire 1-TB filesystem image to the spare. This takes 14 hours. It's still faster than using rsync. I'm sure I've seen another backuppc user take advantage of NBD or eNBD or whatever it is called these days... It essentially takes you're remote HDD and makes it look like a local drive (I suppose you could use ATAoE or iSCSI to do a similar thing perhaps, though with NBD the remote drive could be a md RAID array or whatever block device (or file) you like). Then just add the remote device as a RAID1 mirror with the live system, and you have a real-time backup of the backuppc server. I do this with a file server over gigabit ethernet, and it has worked very well for years... Regards, Adam - -- Adam Goryachev Website Managers www.websitemanagers.com.au -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk0uJGQACgkQGyoxogrTyiU1EACaA/7eATy/ZmwgY02gRyfqanWb qm0An07k6vBHv6ro0HoQaEMzdF3CiBMq =P+YB -END PGP SIGNATURE- -- Protect Your Site and Customers from Malware Attacks Learn about various malware tactics and how to avoid them. Understand malware threats, the impact they can have on your business, and how you can protect your company and customers by using code signing. http://p.sf.net/sfu/oracle-sfdevnl ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] shutdown of harddisks and log-files
Hello all together, does no one has an idea, how i can move the client-specific log-files to another path or disk? Best regards, Sven Am Montag, den 10.01.2011, 19:46 +0100 schrieb Sven Keller: Thank you very much for your proposal. I just tried it, but it doesn't solve my problem: I set the LogDir to a new directory /home/LOG. This moves the following files into the new directory: BackupPC.sock LOCK LOG status.pl status.pl.old But for every single host-machine, the LOG-files are still written into the subdirectory ../backuppc/pc/name-of-the-client, which is on the RAID-partition which should sleep... That's the file which is written at every ping-result: -rw-r- 1 backuppc backuppc 3754 2011-01-10 19:30 LOG.012011 Sven Am Sonntag, den 09.01.2011, 13:25 + schrieb Dave Parce: Sven Keller mail at svenkeller.de writes: Hello! So here's my question: is it possible to move these LOG-files to another disk (i have another disk running 24hrs with the OS and often used files on it) or to avoid logging the negative ping-results? Best regards, Sven Yes, you can move the location of the log files. Change LogDir on Edit Config Server to a path not on that disk array. Dave -- Protect Your Site and Customers from Malware Attacks Learn about various malware tactics and how to avoid them. Understand malware threats, the impact they can have on your business, and how you can protect your company and customers by using code signing. http://p.sf.net/sfu/oracle-sfdevnl ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
