[BackupPC-users] Windows client : Easy deployment
Hi all. I'm in the process of bulding a large scale backup system in my institute based on backuppc. So far, things are going according to plan. We built up a backupPC server and a mechanism for seamlessly install the client on the machines to backup with to objectives in mind : - doing as secure as possible backups - making the client as easy to deploy as possible So we came out with a nice solution where the client package use a ssh service key to connect to the backuppc server which generates an ssh keypair, sends the public part to the client and registers the client in the configuration files. You can have a look if you are interrested : https://tucuxi.univ-brest.fr/projects/iuem-backuppc-client The deployment is very quick and easy on linux and MaxOS machines but now, I have to deal with the windows machines, and this is totally different. I managed to deploy a client but the process is fastidious and there is no way for my users to do this by themselves. I deployed the windows client according to the different docs on the backupPC Wiki (VShadow, rsync+ssh, cygwin). Question : Did someone already worked on an automated deployment on windows ? Has someone experience with one of those packaging system : * wix * nsis * izpack * inosetup Or would a perl script be more appropriate ? I would appreciate any pertinent input on the matter. Thanks Jonathan 0xA8657ED2.asc Description: application/pgp-keys signature.asc Description: OpenPGP digital signature -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Windows client : Easy deployment
Hi all. I'm in the process of bulding a large scale backup system in my institute based on backuppc. So far, things are going according to plan. We built up a backupPC server and a mechanism for seamlessly install the client on the machines to backup with to objectives in mind : - doing as secure as possible backups - making the client as easy to deploy as possible So we came out with a nice solution where the client package use a ssh service key to connect to the backuppc server which generates an ssh keypair, sends the public part to the client and registers the client in the configuration files. You can have a look if you are interrested : https://tucuxi.univ-brest.fr/projects/iuem-backuppc-client The deployment is very quick and easy on linux and MaxOS machines but now, I have to deal with the windows machines, and this is totally different. I managed to deploy a client but the process is fastidious and there is no way for my users to do this by themselves. I deployed the windows client according to the different docs on the backupPC Wiki (VShadow, rsync+ssh, cygwin). Question : Did someone already worked on an automated deployment on windows ? Has someone experience with one of those packaging system : * wix * nsis * izpack * inosetup Or would a perl script be more appropriate ? I would appreciate any pertinent input on the matter. Thanks Jonathan Ease of deployment was one of the criteria for the solution here: http://www.goodjobsucking.com/?p=62 Deploying a new client can be done entirely remotely on Windows with credentials; the main complication is that different versions of vshadow are required for different versions of Windows -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] copying the pool
I recently copied the pool to a new hard disk following the Copying the pool instructions from the main documentation. The documentation says to copy the 'cpool', 'log', and 'conf' directories using any technique and the 'pc' directory using BackupPC_tarPCCopy; however, there is no mention of what to do with the 'pool' directory. I thought it might be created automatically when the nightly cleanup runs, but three days later and still no 'pool' directory. Is this an oversight in the documentation or is the 'pool' directory not needed? I am using BackupPC 3.1.0. Thanks. -- Chris Purves I've seen the look of a fat man having dinner. - Frank Sinatra -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] New plugin for the backup of LVM partitions (e.g. XEN vm)
Hi, i'd like to announce the relase of a plugin for the backup of LVM partitions. I developed this scripts to handle the backup of my virtual servers. This is an extract of the documentation: While doing backups of virtual servers, there are typically two critical requirements: 1. to have almost zero downtime for the services running on the virtual machine (suppose that the machine is a web server or a database server); 2. the backup must be done syncing the file system in a consistent status; a typical example is a database server that must be copied when the processes are idle, the cache is flushed and there is no stale data around. These two requirements are conflicting: stopping the critical processes for the time required by the backup is likely to cause a long downtime of the services. This BackupPC add-on helps you in solving this problem, by leveraging on the snapshot features of LVM. The scripting framework will quickly take a snapshot of the virtual machines in idle status and, while the services become up again, the backup system can take a backup of the frozen snapshot system safely. At the end of the process we will have a backup of any virtual machine with a service downtime of the order of few seconds. I have been used this system over the past years so i can say that it works pretty well for my xen virtual machines. I'm waiting for the authorization to publish the documentation in the backuppc wiki; for now you can find all the informations about this product here: http://www.biodec.com/tools/software/backuppc-lvm Kind regards. Alberto Eusebi -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] copying the pool
On Mon, Oct 04, 2010 at 08:56:49AM -0400, Chris Purves wrote: I recently copied the pool to a new hard disk following the Copying the pool instructions from the main documentation. The documentation says to copy the 'cpool', 'log', and 'conf' directories using any technique and the 'pc' directory using BackupPC_tarPCCopy; however, there is no mention of what to do with the 'pool' directory. I thought it might be created automatically when the nightly cleanup runs, but three days later and still no 'pool' directory. Is this an oversight in the documentation or is the 'pool' directory not needed? I am using BackupPC 3.1.0. Unless you have compression turned off, the pool directory should be totally empty. If you have compression turned off, the cpool directory should be totally empty. Whichever one is empty can be ignored. -Robin -- http://singinst.org/ : Our last, best hope for a fantastic future. Lojban (http://www.lojban.org/): The language in which this parrot is dead is ti poi spitaki cu morsi, but this sentence is false is na nei. My personal page: http://www.digitalkingdom.org/rlp/ -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] What's using all this disk space?
OK, so, BackupPC says it's using 5590.63GB. This number is rapidly growing. (it's all wrong; we're actually using 5848.6GB, but that's not what this mail is about). How do I find out which backups are using a lot of disk? We'd like to see if there's a problem with our retention policy, especially on database servers, but I've no insight at all into where all this disk is *going*. Anyone got a script for this? -Robin -- http://singinst.org/ : Our last, best hope for a fantastic future. Lojban (http://www.lojban.org/): The language in which this parrot is dead is ti poi spitaki cu morsi, but this sentence is false is na nei. My personal page: http://www.digitalkingdom.org/rlp/ -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] copying the pool
On 04/10/2010 2:20 PM, Robin Lee Powell wrote: On Mon, Oct 04, 2010 at 08:56:49AM -0400, Chris Purves wrote: I recently copied the pool to a new hard disk following the Copying the pool instructions from the main documentation. The documentation says to copy the 'cpool', 'log', and 'conf' directories using any technique and the 'pc' directory using BackupPC_tarPCCopy; however, there is no mention of what to do with the 'pool' directory. I thought it might be created automatically when the nightly cleanup runs, but three days later and still no 'pool' directory. Is this an oversight in the documentation or is the 'pool' directory not needed? I am using BackupPC 3.1.0. Unless you have compression turned off, the pool directory should be totally empty. If you have compression turned off, the cpool directory should be totally empty. Whichever one is empty can be ignored. So it is. I reconnected and mounted the old drive and the pool directory is indeed empty. Thanks for your reply. -- Chris Purves What we observe is not nature itself, but nature exposed to our method of questioning. - Werner Heisenberg -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What's using all this disk space?
On Mon, Oct 04, 2010 at 03:25:03PM -0400, Timothy J Massey wrote: Robin Lee Powell rlpow...@digitalkingdom.org wrote on 10/04/2010 03:15:29 PM: How do I find out which backups are using a lot of disk? We'd like to see if there's a problem with our retention policy, especially on database servers, but I've no insight at all into where all this disk is *going*. Anyone got a script for this? I don't have a script for this, but if you look at the host page for each server, examine the New Files section. This will tell you which backups are consuming a lot of space (i.e. aren't pooling well). We have 200+ servers getting backed up on here. :) Good to know where to look, though. Database servers have the same problem that mail servers have: large files that change each and every single day, and therefore consume their full amount of space for each backup you keep. *nod* -Robin -- http://singinst.org/ : Our last, best hope for a fantastic future. Lojban (http://www.lojban.org/): The language in which this parrot is dead is ti poi spitaki cu morsi, but this sentence is false is na nei. My personal page: http://www.digitalkingdom.org/rlp/ -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What's using all this disk space?
Robin Lee Powell rlpow...@digitalkingdom.org wrote on 10/04/2010 03:15:29 PM: How do I find out which backups are using a lot of disk? We'd like to see if there's a problem with our retention policy, especially on database servers, but I've no insight at all into where all this disk is *going*. Anyone got a script for this? I don't have a script for this, but if you look at the host page for each server, examine the New Files section. This will tell you which backups are consuming a lot of space (i.e. aren't pooling well). For example, on your mail servers, we will have New Files of tens of gigabytes for each backup. Let's say that the entire server uses 100GB of space, of which 60GB is mail data. If we keep 12 copies around, we would consume about 760GB (100GB for the server as a whole plus 60 * 11 additional copies). A different server, such as a file server, might be 500GB big, but the New Files section might be, on average, under 1GB. In that case, those same 12 copies would only take 512GB. Even though the server is 5 times larger, the *deltas* are significantly smaller, and the total space used is smaller, too. Database servers have the same problem that mail servers have: large files that change each and every single day, and therefore consume their full amount of space for each backup you keep. Tim Massey -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What's using all this disk space?
On Mon, Oct 04, 2010 at 03:32:23PM -0400, Timothy J Massey wrote: Robin Lee Powell rlpow...@digitalkingdom.org wrote on 10/04/2010 03:28:23 PM: On Mon, Oct 04, 2010 at 03:25:03PM -0400, Timothy J Massey wrote: Robin Lee Powell rlpow...@digitalkingdom.org wrote on 10/04/2010 03:15:29 PM: How do I find out which backups are using a lot of disk? We'd like to see if there's a problem with our retention policy, especially on database servers, but I've no insight at all into where all this disk is *going*. Anyone got a script for this? I don't have a script for this, but if you look at the host page for each server, examine the New Files section. This will tell you which backups are consuming a lot of space (i.e. aren't pooling well). We have 200+ servers getting backed up on here. :) Well, then, you'll want to parse the pc/hostname/backups file. The 9th (New Files Count) and 10th (New Files Size) field (AFAICT) are what you're looking for. *Ooooh*. I thought I had to write Perl to talk to the server. That's *easy*. Thank you! -Robin -- http://singinst.org/ : Our last, best hope for a fantastic future. Lojban (http://www.lojban.org/): The language in which this parrot is dead is ti poi spitaki cu morsi, but this sentence is false is na nei. My personal page: http://www.digitalkingdom.org/rlp/ -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What's using all this disk space?
Robin Lee Powell rlpow...@digitalkingdom.org wrote on 10/04/2010 03:45:11 PM: On Mon, Oct 04, 2010 at 03:32:23PM -0400, Timothy J Massey wrote: Robin Lee Powell rlpow...@digitalkingdom.org wrote on 10/04/2010 03:28:23 PM: On Mon, Oct 04, 2010 at 03:25:03PM -0400, Timothy J Massey wrote: Robin Lee Powell rlpow...@digitalkingdom.org wrote on 10/04/2010 03:15:29 PM: How do I find out which backups are using a lot of disk? We'd like to see if there's a problem with our retention policy, especially on database servers, but I've no insight at all into where all this disk is *going*. Anyone got a script for this? I don't have a script for this, but if you look at the host page for each server, examine the New Files section. This will tell you which backups are consuming a lot of space (i.e. aren't pooling well). We have 200+ servers getting backed up on here. :) Well, then, you'll want to parse the pc/hostname/backups file. The 9th (New Files Count) and 10th (New Files Size) field (AFAICT) are what you're looking for. *Ooooh*. I thought I had to write Perl to talk to the server. That's *easy*. You don't have to write any Perl to talk to the server: Craig has done an outstanding job of packaging the functions of BackupPC into powerful command line functions. Virtually anything you can do from the GUI (and more!) can be done from the command line, using *any* language you want. In addition, BackupPC stores everything you see in the GUI in nicely formatted text files that can be processed however you would like. The most important one being the backups file in each host's directory. I'm glad that pointing that out helped! Tim Massey -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Wiki version
Hi, The BackuppC Wiki still shows 3.2.0 as a beta release. Gerald -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] New release of BackupPC_deleteBackup - who can put it into the wiki?
On Sun, Dec 06, 2009 at 01:13:57AM +0100, Matthias Meyer wrote: Hi, I have a new release of the BackupPC_deleteBackup script. Unfortunately I can't put it into the wiki (http://sourceforge.net/apps/mediawiki/backuppc/index.php?title=How_to_delete_backups). Jeffrey would do that but I didn't reach him via email :-( Anybody else here would put it into the wiki? Did this ever get done? I'm guessing not, given the last-modified date. Could you send the new version to the list in the meantime? -Robin -- http://singinst.org/ : Our last, best hope for a fantastic future. Lojban (http://www.lojban.org/): The language in which this parrot is dead is ti poi spitaki cu morsi, but this sentence is false is na nei. My personal page: http://www.digitalkingdom.org/rlp/ -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
