Re: [BackupPC-users] Outsourcing backup
Hello people. For the machines being backed up over the internet, I'd recommend setting IncrLevels to 1, 2, 3, 4, 5, 6 in order to minimize your bandwidth usage. I'm popping into this thread because I'm also running outsourced backups (me calling them remote backups). I'm successfully running a backuppc server at my office, which is backing up 8 remote servers for 8 different customers. I'm doing 1 FULL and subsequential 6 INCR. Here some config details: (FullPeriod=6.97, FullKeeCnt=4, FullKeepCntMin=1, FullAgeMax=90) (IncrPeriod=0.97, IncrKeepCnt=24, IncKeepCntMin=1, IncrAgeMax=30, IncrLevels=1) I'm pretty satisfied with this setup, but still I'd like to have some suggestions for eventually optimise transfer times or other things that would help doing better. What can you people suggest? Les, do you have some specific advices? I can tell you that I'd like to lower some data transfer durations for at least two of my remote hosts (they sit on slightly slower DSL): look at http://yfrog.com/0bbackuppcpoltij Any suggestion will be appreciated. Kind regards, Flavio Boniforti PIRAMIDE INFORMATICA SAGL Via Ballerini 21 6600 Locarno Switzerland Phone: +41 91 751 68 81 Fax: +41 91 751 69 14 URL: http://www.piramide.ch E-mail: fla...@piramide.ch -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Outsourcing backup
Hello, Maybe increase Full period if you use rsync ? Message du 06/05/10 à 08h38 De : Boniforti Flavio fla...@piramide.ch A : General list for user discussion,brquestions and support backuppc-users@lists.sourceforge.net Copie à : Objet : Re: [BackupPC-users] Outsourcing backup Hello people. For the machines being backed up over the internet, I'd recommend setting IncrLevels to 1, 2, 3, 4, 5, 6 in order to minimize your bandwidth usage. I'm popping into this thread because I'm also running outsourced backups (me calling them remote backups). I'm successfully running a backuppc server at my office, which is backing up 8 remote servers for 8 different customers. I'm doing 1 FULL and subsequential 6 INCR. Here some config details: (FullPeriod=6.97, FullKeeCnt=4, FullKeepCntMin=1, FullAgeMax=90) (IncrPeriod=0.97, IncrKeepCnt=24, IncKeepCntMin=1, IncrAgeMax=30, IncrLevels=1) I'm pretty satisfied with this setup, but still I'd like to have some suggestions for eventually optimise transfer times or other things that would help doing better. What can you people suggest? Les, do you have some specific advices? I can tell you that I'd like to lower some data transfer durations for at least two of my remote hosts (they sit on slightly slower DSL): look at http://yfrog.com/0bbackuppcpoltij Any suggestion will be appreciated. Kind regards, Flavio Boniforti PIRAMIDE INFORMATICA SAGL Via Ballerini 21 6600 Locarno Switzerland Phone: +41 91 751 68 81 Fax: +41 91 751 69 14 URL: http://www.piramide.ch E-mail: fla...@piramide.ch -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ Suivez toute l'actualité de la Nouvelle Star, retrouvez les dépêches, les photos et les vidéos : http://evenementiel.voila.fr/Nouvelle-Star-2010/infos -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Outsourcing backup
And as Rob say : For the machines being backed up over the internet, I'd recommend setting IncrLevels to 1, 2, 3, 4, 5, 6 in order to minimize your bandwidth usage. De : Boniforti Flavio fla...@piramide.ch I can tell you that I'd like to lower some data transfer durations for at least two of my remote hosts (they sit on slightly slower DSL): look at http://yfrog.com/0bbackuppcpoltij Suivez toute l'actualité de la Nouvelle Star, retrouvez les dépêches, les photos et les vidéos : http://evenementiel.voila.fr/Nouvelle-Star-2010/infos -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Outsourcing backup
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Inno wrote: Hello, Maybe increase Full period if you use rsync ? Message du 06/05/10 à 08h38 De : Boniforti Flavio fla...@piramide.ch A : General list for user discussion,br questions and support backuppc-users@lists.sourceforge.net Copie à : Objet : Re: [BackupPC-users] Outsourcing backup Hello people. For the machines being backed up over the internet, I'd recommend setting IncrLevels to 1, 2, 3, 4, 5, 6 in order to minimize your bandwidth usage. I'm popping into this thread because I'm also running outsourced backups (me calling them remote backups). I'm successfully running a backuppc server at my office, which is backing up 8 remote servers for 8 different customers. I'm doing 1 FULL and subsequential 6 INCR. Here some config details: (FullPeriod=6.97, FullKeeCnt=4, FullKeepCntMin=1, FullAgeMax=90) (IncrPeriod=0.97, IncrKeepCnt=24, IncKeepCntMin=1, IncrAgeMax=30, IncrLevels=1) I'm pretty satisfied with this setup, but still I'd like to have some suggestions for eventually optimise transfer times or other things that would help doing better. What can you people suggest? Les, do you have some specific advices? I can tell you that I'd like to lower some data transfer durations for at least two of my remote hosts (they sit on slightly slower DSL): look at http://yfrog.com/0bbackuppcpoltij Any suggestion will be appreciated. Enable checksum-caching, modify IncrLevels so that you don't re-transfer more and more data during each incremental. Also, I frequently add bwlimit to rsync so it doesn't 'flood' the remote link during backups. This can allow me to do some backups during periods which would otherwise not be possible (ie, business hours). Regards, Adam - -- Adam Goryachev Website Managers www.websitemanagers.com.au -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkvicYMACgkQGyoxogrTyiX3UACgm+7r9yg707dfbBX7MUqhVVhg 6iYAoMDseZMa0TlKoOZvOEDHOBTfXdOt =pmiS -END PGP SIGNATURE- -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Outsourcing backup
And as Rob say : For the machines being backed up over the internet, I'd recommend setting IncrLevels to 1, 2, 3, 4, 5, 6 in order to minimize your bandwidth usage. OK, and what would the above change result in? What would the benefit be? Thanks, F. -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Outsourcing backup
Hy Inno, Hello, Maybe increase Full period if you use rsync ? what would that be causing, in positive terms? F. -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Outsourcing backup
Hello there. Enable checksum-caching, modify IncrLevels so that you don't re-transfer more and more data during each incremental. Could you please explain more in depth what both suggestions could benefit? Also, I frequently add bwlimit to rsync so it doesn't 'flood' the remote link during backups. This can allow me to do some backups during periods which would otherwise not be possible (ie, business hours). That's fortunately not (yet) one of my needs: backups run quietly during off-hours.. F. -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Outsourcing backup
On Wednesday 05 May 2010 23:02:14 Rob Owens wrote: For the machines being backed up over the internet, I'd recommend setting IncrLevels to 1, 2, 3, 4, 5, 6 in order to minimize your bandwidth usage. Rob's right. Running with IncrLevels = 1 means that every incremental will download every file with a modification time newer than the last Full. Using 6 incrementals with levels 1, 2, ... etc, will just mean that files must differ from the last good incremental to be downloaded. That is still as reliable as rsync. I use this setup for all servers, including locals backups. Regards, Tyler -- Every normal man must be tempted at times to spit on his hands, hoist the black flag, and begin to slit throats. -- H. L. Mencken -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Outsourcing backup
On Thursday 06 May 2010 08:36:35 Adam Goryachev wrote: Also, I frequently add bwlimit to rsync so it doesn't 'flood' the remote link during backups. This can allow me to do some backups during periods which would otherwise not be possible (ie, business hours). Me too. For any wireless laptop client, I add this to RsyncArgs: --bwlimit=256 That will set a rate limit of approximately 256 kbytes/sec, or 2 mbit. I haven't found it necessary to set a bwlimit on any wired device. Regards, Tyler -- Every normal man must be tempted at times to spit on his hands, hoist the black flag, and begin to slit throats. -- H. L. Mencken -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Outsourcing backup
Have you no problem with files used during the business hours ? De : Adam Goryachev mailingli...@websitemanagers.com.au Also, I frequently add bwlimit to rsync so it doesn't 'flood' the remote link during backups. This can allow me to do some backups during periods which would otherwise not be possible (ie, business hours). Regards, Adam Suivez toute l'actualité de la Nouvelle Star, retrouvez les dépêches, les photos et les vidéos : http://evenementiel.voila.fr/Nouvelle-Star-2010/infos -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Outsourcing backup
Hy Tyler, Rob's right. Running with IncrLevels = 1 means that every incremental will download every file with a modification time newer than the last Full. Using 6 incrementals with levels 1, 2, ... etc, will just mean that files must differ from the last good incremental to be downloaded. That is still as reliable as rsync. I use this setup for all servers, including locals backups. as you state as reliable as rsync: me, I'm using rsync (over SSH). Would it also be a good choice to use six different incr levels? Flavio Boniforti PIRAMIDE INFORMATICA SAGL Via Ballerini 21 6600 Locarno Switzerland Phone: +41 91 751 68 81 Fax: +41 91 751 69 14 URL: http://www.piramide.ch E-mail: fla...@piramide.ch -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Outsourcing backup
Boniforti Flavio wrote: Hy Inno, Hello, Maybe increase Full period if you use rsync ? what would that be causing, in positive terms? I wouldn't do that - rsync fulls take longer in wall clock time because they read all the files, but they don't take a lot more bandwidth and don't hurt you that much on remote connections which are slow anyway. You need regular fulls with rsync to rebuild the trees used for comparisons. Just make sure the days the fulls run are skewed so you have time for them to complete. You can do that by forcing a manual run to set the time. -- Les Mikesell lesmikes...@gmail.com -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Outsourcing backup
Boniforti Flavio wrote: Hello people. For the machines being backed up over the internet, I'd recommend setting IncrLevels to 1, 2, 3, 4, 5, 6 in order to minimize your bandwidth usage. I'm popping into this thread because I'm also running outsourced backups (me calling them remote backups). I'm successfully running a backuppc server at my office, which is backing up 8 remote servers for 8 different customers. I'm doing 1 FULL and subsequential 6 INCR. Here some config details: (FullPeriod=6.97, FullKeeCnt=4, FullKeepCntMin=1, FullAgeMax=90) (IncrPeriod=0.97, IncrKeepCnt=24, IncKeepCntMin=1, IncrAgeMax=30, IncrLevels=1) I'm pretty satisfied with this setup, but still I'd like to have some suggestions for eventually optimise transfer times or other things that would help doing better. What can you people suggest? Les, do you have some specific advices? On slow connections it will help to add the -C (compress) option to the ssh command. Be sure you exclude any areas or big files you don't need to back up (like the slocate db on linux boxes, etc.). If you do several remote backups, don't do too many concurrently and try to get the start times and full runs skewed. -- Les Mikesell lesmikes...@gmail.com -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Backup Office Hard Drive To Home Storage over internet
Hi I have got this scenario an office (my client) has its backup on a C drive (first hard disk) then a copy of that C on a D drive (second hard drive) by using Handy.Backup utility. Now my client asked me that he wants to have an off-site backup ,,,means to have a copy of his second hard drive (D) to another site over the internet (ADSL connection) I am aware that backup over internet is slower than LAN, size of the files are not that big. Could you please advise what should I do to achieve such task ? Thanks +-- |This was sent by saadel...@hotmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Outsourcing backup
What can you people suggest? Les, do you have some specific advices? On slow connections it will help to add the -C (compress) option to the ssh command. Be sure you exclude any areas or big files you don't need to back up (like the slocate db on linux boxes, etc.). If you do several remote backups, don't do too many concurrently and try to get the start times and full runs skewed. OK, for SSH, I'm already using -C switch... Things I don't need to back up are excluded... I'm actually doing 8 remote backups, which are starting alltogether at 21 PM... Until now, I didn't have too many troubles with bandwidth/time, but I'll re-evaluate if it will come to a bottleneck. So, in the end: is there any way to optimise my backups? Would the application of more levels of incrementals, be helpful? Kind regards, Flavio Boniforti PIRAMIDE INFORMATICA SAGL Via Ballerini 21 6600 Locarno Switzerland Phone: +41 91 751 68 81 Fax: +41 91 751 69 14 URL: http://www.piramide.ch E-mail: fla...@piramide.ch -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backup Office Hard Drive To Home Storage over internet
I would look into online backup services, such as Caabonite, Mozy, CrashPlan, etc... On Thu, May 6, 2010 at 9:08 AM, zillah backuppc-fo...@backupcentral.com wrote: Hi I have got this scenario an office (my client) has its backup on a C drive (first hard disk) then a copy of that C on a D drive (second hard drive) by using Handy.Backup utility. Now my client asked me that he wants to have an off-site backup ,,,means to have a copy of his second hard drive (D) to another site over the internet (ADSL connection) I am aware that backup over internet is slower than LAN, size of the files are not that big. Could you please advise what should I do to achieve such task ? Thanks +-- |This was sent by saadel...@hotmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Excluding Directories
In checking my logs on my new installation I see that /proc is being backed up while I have it in the Exclude portion of the config. I had it in that section as /proc and as ./proc and both of these continue to be backed up each night causing me a ton of error messages. $Conf{BackupFilesExclude} = { './proc' = [ '' ] }; $Conf{XferMethod} = 'tar'; Is this correct or is this $Conf{BackupFilesExclude} = { '/proc' = [ '' ] }; $Conf{XferMethod} = 'tar'; The TarShareName is set to / and the directory in question is /proc John J. Boris, Sr. JEN-A-SyS Administrator Archdiocese of Philadelphia Remember! That light at the end of the tunnel Just might be the headlight of an oncoming train! -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Excluding Directories
$Conf{BackupFilesExclude} = { './proc' = [ '' ] }; $Conf{XferMethod} = 'tar'; Is this correct or is this $Conf{BackupFilesExclude} = { '/proc' = [ '' ] }; $Conf{XferMethod} = 'tar'; Neither! This really confused me for ages. The share needs to be in the first section, and the exclude within the square brackets so $Conf{BackupFilesExclude} = { '/' = [ '/proc' ] }; As for the ./ or /, I always get there by trial and error if it is not clear from the help files. If you are using the web interface, the share name should be in the 'New Key' and then you 'add' the exclude arguments. HTH Ed # Attention: This e-mail and any attachment is for authorised use by the intended recipient(s) only. It may contain proprietary, confidential and/or privileged information and should not be copied, disclosed, distributed, retained or used by any other party. If you are not an intended recipient please notify the sender immediately and delete this e-mail (including attachments and copies). The statements and opinions expressed in this e-mail are those of the author and do not necessarily reflect those of the Royal Marsden NHS Foundation Trust. The Trust does not take any responsibility for the statements and opinions of the author. Website: http://www.royalmarsden.nhs.uk # -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Outsourcing backup
On 5/6/2010 8:19 AM, Boniforti Flavio wrote: On slow connections it will help to add the -C (compress) option to the ssh command. Be sure you exclude any areas or big files you don't need to back up (like the slocate db on linux boxes, etc.). If you do several remote backups, don't do too many concurrently and try to get the start times and full runs skewed. OK, for SSH, I'm already using -C switch... Things I don't need to back up are excluded... I'm actually doing 8 remote backups, which are starting alltogether at 21 PM... Until now, I didn't have too many troubles with bandwidth/time, but I'll re-evaluate if it will come to a bottleneck. If your end has plenty of bandwidth and you are going to different remote locations, running several at once is probably OK. So, in the end: is there any way to optimise my backups? Would the application of more levels of incrementals, be helpful? Incremental levels will help, but if you are completing in the available time window I wouldn't worry that much about it. -- Les Mikesell lesmikes...@gmail.com -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backup Office Hard Drive To Home Storage over internet
On 5/6/2010 8:08 AM, zillah wrote: Hi I have got this scenario an office (my client) has its backup on a C drive (first hard disk) then a copy of that C on a D drive (second hard drive) by using Handy.Backup utility. Now my client asked me that he wants to have an off-site backup ,,,means to have a copy of his second hard drive (D) to another site over the internet (ADSL connection) I am aware that backup over internet is slower than LAN, size of the files are not that big. Could you please advise what should I do to achieve such task ? You can back up remotely with backuppc as long as the server can establish a connection to the target host. You may need to set up a VPN or port-forwarding on an internet router to allow the connection. If you install cygwin or CWrsync you can use rsync over ssh to connect. I don't know what Handy.Backup does, but if it creates one big file that changes daily, you might be better off backing up the original files on the C: drive since rsync would be able to skip any that haven't changed in each run. -- Les Mikesell lesmikes...@gmail.com -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Excluding Directories
I copied these from my config file which is edited through the web interface. So the web interface has a bug John J. Boris, Sr. JEN-A-SyS Administrator Archdiocese of Philadelphia Remember! That light at the end of the tunnel Just might be the headlight of an oncoming train! Ed McDonagh ed.mcdon...@rmh.nhs.uk 5/6/2010 11:20 AM $Conf{BackupFilesExclude} = { './proc' = [ '' ] }; $Conf{XferMethod} = 'tar'; Is this correct or is this $Conf{BackupFilesExclude} = { '/proc' = [ '' ] }; $Conf{XferMethod} = 'tar'; Neither! This really confused me for ages. The share needs to be in the first section, and the exclude within the square brackets so $Conf{BackupFilesExclude} = { '/' = [ '/proc' ] }; As for the ./ or /, I always get there by trial and error if it is not clear from the help files. If you are using the web interface, the share name should be in the 'New Key' and then you 'add' the exclude arguments. HTH Ed # Attention: This e-mail and any attachment is for authorised use by the intended recipient(s) only. It may contain proprietary, confidential and/or privileged information and should not be copied, disclosed, distributed, retained or used by any other party. If you are not an intended recipient please notify the sender immediately and delete this e-mail (including attachments and copies). The statements and opinions expressed in this e-mail are those of the author and do not necessarily reflect those of the Royal Marsden NHS Foundation Trust. The Trust does not take any responsibility for the statements and opinions of the author. Website: http://www.royalmarsden.nhs.uk # -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Best way to backup Windows clients?
Hey people, I'm wondering what the preferred method is to backing up Windows clients, especially in terms of performance. Currently, I'm simply mounting windows drives via SMB/autofs, and running rsync over that. I like it because I don't have to install any additional software on the clients. But I know/read that a lot of people run Cygwin and rsync directly. What are the advantages of that? Thanks, Kris Lou k...@themusiclink.net -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Excluding Directories
In my experience, the web interface doesn't have a bug, it is just not very intuitive! Try putting / in the New Key box, and click Add. Then put /proc in the box next to the Insert Delete buttons, and click Save. Then look at the config file again, and see if it has worked. It does for me. On Thu, 2010-05-06 at 11:52 -0400, John BORIS wrote: I copied these from my config file which is edited through the web interface. So the web interface has a bug John J. Boris, Sr. JEN-A-SyS Administrator Archdiocese of Philadelphia Remember! That light at the end of the tunnel Just might be the headlight of an oncoming train! Ed McDonagh ed.mcdon...@rmh.nhs.uk 5/6/2010 11:20 AM $Conf{BackupFilesExclude} = { './proc' = [ '' ] }; $Conf{XferMethod} = 'tar'; Is this correct or is this $Conf{BackupFilesExclude} = { '/proc' = [ '' ] }; $Conf{XferMethod} = 'tar'; Neither! This really confused me for ages. The share needs to be in the first section, and the exclude within the square brackets so $Conf{BackupFilesExclude} = { '/' = [ '/proc' ] }; As for the ./ or /, I always get there by trial and error if it is not clear from the help files. If you are using the web interface, the share name should be in the 'New Key' and then you 'add' the exclude arguments. HTH Ed # Attention: This e-mail and any attachment is for authorised use by the intended recipient(s) only. It may contain proprietary, confidential and/or privileged information and should not be copied, disclosed, distributed, retained or used by any other party. If you are not an intended recipient please notify the sender immediately and delete this e-mail (including attachments and copies). The statements and opinions expressed in this e-mail are those of the author and do not necessarily reflect those of the Royal Marsden NHS Foundation Trust. The Trust does not take any responsibility for the statements and opinions of the author. Website: http://www.royalmarsden.nhs.uk # -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ # Attention: This e-mail and any attachment is for authorised use by the intended recipient(s) only. It may contain proprietary, confidential and/or privileged information and should not be copied, disclosed, distributed, retained or used by any other party. If you are not an intended recipient please notify the sender immediately and delete this e-mail (including attachments and copies). The statements and opinions expressed in this e-mail are those of the author and do not necessarily reflect those of the Royal Marsden NHS Foundation Trust. The Trust does not take any responsibility for the statements and opinions of the author. Website: http://www.royalmarsden.nhs.uk # -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Excluding Directories
Bingo That is it. I was looking at the source and was wondering why was /proc pointing to blank brackets. I added it and now it is point to the directory. It looks like it is a Variable (which is probably called a key) and then you add the value of that variable. I guess like the Windows Registry. Looking at the documentation it started to make sense. Clear as mud now. ;-) John J. Boris, Sr. JEN-A-SyS Administrator Archdiocese of Philadelphia Remember! That light at the end of the tunnel Just might be the headlight of an oncoming train! Ed McDonagh ed.mcdon...@rmh.nhs.uk 5/6/2010 12:13 PM In my experience, the web interface doesn't have a bug, it is just not very intuitive! Try putting / in the New Key box, and click Add. Then put /proc in the box next to the Insert Delete buttons, and click Save. Then look at the config file again, and see if it has worked. It does for me. On Thu, 2010-05-06 at 11:52 -0400, John BORIS wrote: I copied these from my config file which is edited through the web interface. So the web interface has a bug John J. Boris, Sr. JEN-A-SyS Administrator Archdiocese of Philadelphia Remember! That light at the end of the tunnel Just might be the headlight of an oncoming train! Ed McDonagh ed.mcdon...@rmh.nhs.uk 5/6/2010 11:20 AM $Conf{BackupFilesExclude} = { './proc' = [ '' ] }; $Conf{XferMethod} = 'tar'; Is this correct or is this $Conf{BackupFilesExclude} = { '/proc' = [ '' ] }; $Conf{XferMethod} = 'tar'; Neither! This really confused me for ages. The share needs to be in the first section, and the exclude within the square brackets so $Conf{BackupFilesExclude} = { '/' = [ '/proc' ] }; As for the ./ or /, I always get there by trial and error if it is not clear from the help files. If you are using the web interface, the share name should be in the 'New Key' and then you 'add' the exclude arguments. HTH Ed # Attention: This e-mail and any attachment is for authorised use by the intended recipient(s) only. It may contain proprietary, confidential and/or privileged information and should not be copied, disclosed, distributed, retained or used by any other party. If you are not an intended recipient please notify the sender immediately and delete this e-mail (including attachments and copies). The statements and opinions expressed in this e-mail are those of the author and do not necessarily reflect those of the Royal Marsden NHS Foundation Trust. The Trust does not take any responsibility for the statements and opinions of the author. Website: http://www.royalmarsden.nhs.uk # -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ # Attention: This e-mail and any attachment is for authorised use by the intended recipient(s) only. It may contain proprietary, confidential and/or privileged information and should not be copied, disclosed, distributed, retained or used by any other party. If you are not an intended recipient please notify the sender immediately and delete this e-mail (including attachments and copies). The statements and opinions expressed in this e-mail are those of the author and do not necessarily reflect those of the Royal Marsden NHS Foundation Trust. The Trust does not take any responsibility for the statements and opinions of the author. Website: http://www.royalmarsden.nhs.uk # -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:
Re: [BackupPC-users] Best way to backup Windows clients?
Kris, In my setup I would have loved to just use the mounts but security issues here put a stop to that so I had to go to rsync. That has worked on my Windows XP and Server 2003 machines but I am having issues with my Server 2008 machines but that may be another firewall and security issue. I am by no means a Guru with this stuff but the rsync on the Windows machines was a breeze to install and configure even for me (a windows challenged person). The only thing I do notice is that when I am on my laptop which is using rsync under XP , I do get some performance issues at the start but my laptop is not on the network all the time and I haven't tuned the backup schedule to only do this say between certain hours. John J. Boris, Sr. JEN-A-SyS Administrator Archdiocese of Philadelphia Remember! That light at the end of the tunnel Just might be the headlight of an oncoming train! Kris Lou k...@themusiclink.net 5/6/2010 11:51 AM Hey people, I'm wondering what the preferred method is to backing up Windows clients, especially in terms of performance. Currently, I'm simply mounting windows drives via SMB/autofs, and running rsync over that. I like it because I don't have to install any additional software on the clients. But I know/read that a lot of people run Cygwin and rsync directly. What are the advantages of that? Thanks, Kris Lou k...@themusiclink.net -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Best way to backup Windows clients?
On Thu, 6 May 2010 08:51:12 -0700, Kris Lou k...@themusiclink.net wrote: Hey people, I'm wondering what the preferred method is to backing up Windows clients, especially in terms of performance. Currently, I'm simply mounting windows drives via SMB/autofs, and running rsync over that. I like it because I don't have to install any additional software on the clients. But I know/read that a lot of people run Cygwin and rsync directly. What are the advantages of that? Thanks, I find it works better than smbfs as it pretty much bypasses permissions (if I run the rsyncd as a local service) and then I just have to deal with (much simpler) rsyncd access control (allowed hosts, secrets, etc.). Your mileage may vary but moving my 1 client from smb to rsyncd solved all my 'access denied' problems (after a good deal of attempting to fix the smb access). -Josh -- Joshua Malone Systems Administrator (jmal...@nrao.edu)NRAO Charlottesville 434-296-0263 www.cv.nrao.edu 434-249-5699 (mobile) BOFH excuse #360: Your parity check is overdrawn and you're out of cache. -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Migrating a BackupPC pool to LVM
It took me a while to finish, but here it is. Step by step, how to move your existing BackupPC pool to LVM (so you can archive the pool itself). http://www.tolaris.com/2010/05/06/moving-an-existing-backuppc-partition-to- lvm/ Regards, Tyler -- ... jingoism, racism, fear, religious fundamentalism: these are the ways of appealing to people if you’re trying to organize a mass base of support for policies that are really intended to crush them. -- Noam Chomsky, in Understanding Power -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Syntax for excluding .gvfs
I'm running F11 and I keep getting an error on my backups. I've tracked this down to a file, .gvfs, in users home directories. From the log file: /bin/tar: ./.gvfs: Cannot stat: Permission denied I use the web interface to edit the configuration but I cannot find the correct syntax to exclude these files. The TarShareName is / and I've tried the following for BackupFilesExclude .gvfs *.gvfs /home/*/.gvfs none of which work. How have others overcome this? And, yes, I do have the Override box checked. Thanks, Steve -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Assistance with long term snapshots and levels
On 5/6/2010 4:17 PM, Brian Mathis wrote: I'm new to BackupPC and looking to keep long term snapshots. I've been reading through the docs and I think the levels concept will do what I want it to, but I still have some outstanding questions. I'm looking to use an 84 day cycle where: - Day 0 is the full backup (level 0) - Day 7, 14, 21 are incrementals relative to D0 (level 7) - Day 28 is an incremental to D0 (level 1) - Day 35, 42, 29 are incrementalss relative to D28 (level 7) - Day 56 is an incremental to D28 (level 2) - Day 63, 70, and 77 are incrementals relative to D56 (level 7) - Day 84 is the next full backup (level 0) There are no daily incrementals I think the above example means I need the config: FullPeriod = 83.97 IncrPeriod = 6.97 IncrLevels = [7, 7, 7, 1, 7, 7, 7, 2, 7, 7, 7] Am I missing anything in that config? The next piece is incremental expiration. I would like to keep at most six level 7 backups, but keep the level 0, 1, and 2 forever. I only see IncrKeepCnt which seems to be an all-or-nothing expiration number that doesn't take levels into account. Is this possible? I expect each full backup to be large, and I'm hoping that this sort of scheme will make the best use of disk space and file redundancy, while keeping a long timeline of snapshots. Suggestions are welcome. Before you do something like this, be sure you understand how both pooling and rsync work. Backuppc will keep only copy of any file and will replace any others that have identical content with hardlinks. There will be next-to-no difference in disk space used by an incremental vs. full or a different level of incremental. Also, when you use rsync, there is not a big difference in network bandwidth use between fulls and incrementals because it only copies the differences anyway. Fulls do take much more time to complete, though, because even unchanged files are read each time for the comparison where incrementals skip any with identical timestamps and lengths. -- Les Mikesell lesmikes...@gmail.com -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Assistance with long term snapshots and levels
On Thu, May 6, 2010 at 5:53 PM, Les Mikesell lesmikes...@gmail.com wrote: On 5/6/2010 4:17 PM, Brian Mathis wrote: I'm new to BackupPC and looking to keep long term snapshots. I've been reading through the docs and I think the levels concept will do what I want it to, but I still have some outstanding questions. I'm looking to use an 84 day cycle where: - Day 0 is the full backup (level 0) - Day 7, 14, 21 are incrementals relative to D0 (level 7) - Day 28 is an incremental to D0 (level 1) - Day 35, 42, 29 are incrementalss relative to D28 (level 7) - Day 56 is an incremental to D28 (level 2) - Day 63, 70, and 77 are incrementals relative to D56 (level 7) - Day 84 is the next full backup (level 0) There are no daily incrementals I think the above example means I need the config: FullPeriod = 83.97 IncrPeriod = 6.97 IncrLevels = [7, 7, 7, 1, 7, 7, 7, 2, 7, 7, 7] Am I missing anything in that config? The next piece is incremental expiration. I would like to keep at most six level 7 backups, but keep the level 0, 1, and 2 forever. I only see IncrKeepCnt which seems to be an all-or-nothing expiration number that doesn't take levels into account. Is this possible? I expect each full backup to be large, and I'm hoping that this sort of scheme will make the best use of disk space and file redundancy, while keeping a long timeline of snapshots. Suggestions are welcome. Before you do something like this, be sure you understand how both pooling and rsync work. Backuppc will keep only copy of any file and will replace any others that have identical content with hardlinks. There will be next-to-no difference in disk space used by an incremental vs. full or a different level of incremental. Also, when you use rsync, there is not a big difference in network bandwidth use between fulls and incrementals because it only copies the differences anyway. Fulls do take much more time to complete, though, because even unchanged files are read each time for the comparison where incrementals skip any with identical timestamps and lengths. -- Les Mikesell lesmikes...@gmail.com Good point. I've used rsync many times in the past and our current custom solution uses the rsync hard link tricks to get the same kind of advantages. I'm looking to get onto a less custom solution, hence backuppc. It sounds like you're saying I can probably achieve a similar effect by doing a level 0 every 28 days and then doing weekly incrementals relative to the level 0, and avoiding the multi-tiered level system I outlined? I was probably thinking that a full will always take up a full amount of disk space, but you're right and I sort of forgot it all goes into the pool and gets deduped anyway. -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Assistance with long term snapshots and levels
On Thursday 06 May 2010 22:17:00 Brian Mathis wrote: I'm new to BackupPC and looking to keep long term snapshots. I've been reading through the docs and I think the levels concept will do what I want it to, but I still have some outstanding questions. I've just kept a slowly devolving set of fulls: $Conf{FullPeriod} = '6.97'; $Conf{IncrPeriod} = '0.97'; $Conf{FullKeepCnt} = [ '8', '4', '2', '2' ]; $Conf{IncrLevels} = [ '1', '2', '3', '4', '5', '6' ]; That will keep 8 weeklies, 4 semi-weeklies, 2 monthlies, and 2 semi-monthlies. That means my oldest archive will be 40 weeks old. With pooling, I find I really can store very long archives going back. But I rarely need to get a file exactly 38 weeks old, when 32 or 40 will do. Regards, Tyler -- One of the Fifth Amendment's basic functions is to protect the innocent men who otherwise might be ensnared by ambiguous circumstances. Truthful responses of an innocent witness, as well as those of a wrongdoer, may provide the government incriminating evidence from the speaker's own mouth. -- The Supreme Court of the United States, Ohio v. Reiner, 532 U.S. 17, 20 (2001) -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Assistance with long term snapshots and levels
Also, you can look up the tower of hanoi (spelling?) way of doing backups. This is what we use on one of our picky servers. It will basically keep fulls around for up to 3 years or something silly like that. I can provide a link once I get back to the office in the morning. On 5/6/10, Brian Mathis brian.mat...@gmail.com wrote: On Thu, May 6, 2010 at 5:53 PM, Les Mikesell lesmikes...@gmail.com wrote: On 5/6/2010 4:17 PM, Brian Mathis wrote: I'm new to BackupPC and looking to keep long term snapshots. I've been reading through the docs and I think the levels concept will do what I want it to, but I still have some outstanding questions. I'm looking to use an 84 day cycle where: - Day 0 is the full backup (level 0) - Day 7, 14, 21 are incrementals relative to D0 (level 7) - Day 28 is an incremental to D0 (level 1) - Day 35, 42, 29 are incrementalss relative to D28 (level 7) - Day 56 is an incremental to D28 (level 2) - Day 63, 70, and 77 are incrementals relative to D56 (level 7) - Day 84 is the next full backup (level 0) There are no daily incrementals I think the above example means I need the config: FullPeriod = 83.97 IncrPeriod = 6.97 IncrLevels = [7, 7, 7, 1, 7, 7, 7, 2, 7, 7, 7] Am I missing anything in that config? The next piece is incremental expiration. I would like to keep at most six level 7 backups, but keep the level 0, 1, and 2 forever. I only see IncrKeepCnt which seems to be an all-or-nothing expiration number that doesn't take levels into account. Is this possible? I expect each full backup to be large, and I'm hoping that this sort of scheme will make the best use of disk space and file redundancy, while keeping a long timeline of snapshots. Suggestions are welcome. Before you do something like this, be sure you understand how both pooling and rsync work. Backuppc will keep only copy of any file and will replace any others that have identical content with hardlinks. There will be next-to-no difference in disk space used by an incremental vs. full or a different level of incremental. Also, when you use rsync, there is not a big difference in network bandwidth use between fulls and incrementals because it only copies the differences anyway. Fulls do take much more time to complete, though, because even unchanged files are read each time for the comparison where incrementals skip any with identical timestamps and lengths. -- Les Mikesell lesmikes...@gmail.com Good point. I've used rsync many times in the past and our current custom solution uses the rsync hard link tricks to get the same kind of advantages. I'm looking to get onto a less custom solution, hence backuppc. It sounds like you're saying I can probably achieve a similar effect by doing a level 0 every 28 days and then doing weekly incrementals relative to the level 0, and avoiding the multi-tiered level system I outlined? I was probably thinking that a full will always take up a full amount of disk space, but you're right and I sort of forgot it all goes into the pool and gets deduped anyway. -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Sent from my mobile device -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Assistance with long term snapshots and levels
On 5/6/2010 5:09 PM, Brian Mathis wrote: Good point. I've used rsync many times in the past and our current custom solution uses the rsync hard link tricks to get the same kind of advantages. I'm looking to get onto a less custom solution, hence backuppc. It sounds like you're saying I can probably achieve a similar effect by doing a level 0 every 28 days and then doing weekly incrementals relative to the level 0, and avoiding the multi-tiered level system I outlined? I was probably thinking that a full will always take up a full amount of disk space, but you're right and I sort of forgot it all goes into the pool and gets deduped anyway. Or even weekly fulls unless you are trying to avoid the impact on the target hosts. And you might look at the exponential expiry to keep some number of very old runs. -- Les Mikesell lesmikes...@gmail.com -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/