RE: Remote backup hosting setup?
-Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Tim Aslat Sent: Tuesday, August 03, 2004 7:33 PM To: [EMAIL PROTECTED] Subject: Re: Remote backup hosting setup? In the immortal words of Eric Crist [EMAIL PROTECTED]... I was recently contacted by a lawfirm that needs a remote backup solution to help bring their insurance rates down. I've decided to go ahead and do this, as their needs are not that great. Sounds simple enough What I'm asking, is how best to setup this situation. I've never played with jails or anything, but I'm not sure if I really need to go that far. I'm considering building a server that has ssh and sftp access. The plan is to allow them to upload at their pace, and provide next-day DVD/CD copies of their entire directory structure. Try one of the multitude of rsync based scripts, you can even get some very good incremental backups happening, and burning DVDs/ dumping to tape/etc is simple enough top script as well. Rsync by default works over ssh so can be very secure. The had part would be, how do these people want to retrieve the data? If you are just handing them media once a day, then it's simple, but if they want to retrieve it remotely as well, then you could be in for some fun and games. Cheers Tim Thanks for the reply, Tim. I didn't specify in the OP, but this is from Windows systems to my freebsd server. The retrieval method will be a copy on CD/DVD, at a premium, of course, in the even they have a faliure. Thanks again for all your help. Found on Conan O'Brian: Children's books written by celebrities; By Mel Gibson: Jesus Christ and the Terrible, Horrible, No Good, Very Bad Day. - Keep your powder dry and your pecker hard and the world WILL turn. - Eric F Crist ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
RE: Remote backup hosting setup?
Hi Eric, we are currently developing a small program/service for our customers exactly for this purpose. To just backup the data to a remote server is very easy, even on Windows: Use cygwin. It comes together with rsync and ssh. I recommend you use rsync since it is the most effective AFAIK and the transfer is safe (not unimportant to law companies). Then you could run a nightly task to backup the data. We also found that revision the data on the backup server could also be very helpful using rsnapshot. This tool is actually intended for backups between UNIX/Linux boxes, however, you can also run it locally. It creates full daily backups with the storage need of an incremental backup while using links to unchanged files. Cheers. Dave. Thanks for the reply, Tim. I didn't specify in the OP, but this is from Windows systems to my freebsd server. The retrieval method will be a copy on CD/DVD, at a premium, of course, in the even they have a faliure. Thanks again for all your help. Found on Conan O'Brian: Children's books written by celebrities; By Mel Gibson: Jesus Christ and the Terrible, Horrible, No Good, Very Bad Day. - Keep your powder dry and your pecker hard and the world WILL turn. - Eric F Crist ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED] ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
RE: Remote backup hosting setup?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 we are currently developing a small program/service for our customers exactly for this purpose. To just backup the data to a remote server is very easy, even on Windows: Use cygwin. It comes together with rsync and ssh. I recommend you use rsync since it is the most effective AFAIK and the transfer is safe (not unimportant to law companies). Then you could run a nightly task to backup the data. what is unsafe of rsh for example if network through which is going the traffic is under your control? ssh is SLOW. -BEGIN PGP SIGNATURE- Version: GnuPG v1.2.3 (FreeBSD) iD8DBQFBEJoXVbTJCKecqu0RAgGUAJ9s3MErMYwxXwTxKWGnHdVWoBFTrACcCUgN La1/dqv8okZKCIKIGc7OTbc= =eQKl -END PGP SIGNATURE- ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Remote backup hosting setup?
Eric Crist wrote: Hello list, I was recently contacted by a lawfirm that needs a remote backup solution to help bring their insurance rates down. I've decided to go ahead and do this, as their needs are not that great. What I'm asking, is how best to setup this situation. I've never played with jails or anything, but I'm not sure if I really need to go that far. I'm considering building a server that has ssh and sftp access. The plan is to allow them to upload at their pace, and provide next-day DVD/CD copies of their entire directory structure. Any advice on how to go about this? I do this using rsync. Remote FreeBSD machines are straightforward. For Windows computers wishing to backup remotely I am starting to use: http://sync2nas.sourceforge.net/ I also find it helps to start with a copy of their data from some medium like a tape, CD(s) or DVD, or even a hard drive moved from one machine to another. Otherwise, the initial transfer can, literally, take weeks. HTH Peter. Thanks! Eric F Crist Found on Conan O'Brian: Children's books written by celebrities; By Mel Gibson: Jesus Christ and the Terrible, Horrible, No Good, Very Bad Day. - Keep your powder dry and your pecker hard and the world WILL turn. - Eric F Crist ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED] ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Remote backup hosting setup?
On Aug 4, 2004, at 4:11 AM, Wojciech Puchar wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 we are currently developing a small program/service for our customers exactly for this purpose. To just backup the data to a remote server is very easy, even on Windows: Use cygwin. It comes together with rsync and ssh. I recommend you use rsync since it is the most effective AFAIK and the transfer is safe (not unimportant to law companies). Then you could run a nightly task to backup the data. what is unsafe of rsh for example if network through which is going the traffic is under your control? ssh is SLOW. Howso? Using rsync with SSH wrapper allows you to not only alter only files that have been altered but as I understand it rsync will only copy changes within files over to the remote site. SSH can be used to compress the transfer in addition to (of course) encrypting the connection and transfer, and it can be partially automated to allow login without passwords if you save the generated public key... For the information supplied about what the customer would like done, using the SSH with Rsync may be ideal for low cost and reliable backups to a remote site. -Bart ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Remote backup hosting setup?
Tim Aslat [EMAIL PROTECTED] writes: Try one of the multitude of rsync based scripts, you can even get some very good incremental backups happening, I have been thinking about this for my own use. One problem with basic rsync is that if (say) I trash a critical file and don't notice it for a couple days, the (nightly) rsync will have overwritten the good version with the trashed version. So I've been thinking of having maybe 5 different copies at the destination and rsyncing to a different one each night so I have 5 different backups to go to -- just like in the days of tape. Something conceptually like: rsync -avR --delete / remote:/BACKUP/`expr $dayofyear % 5`/ Yeah, you need to store 5x copies of your client's data, but disk is cheap. It gives 'em 5 days to realize they've just hosed that critical file and you can be a hero for restoring it. Income potential. You might be able to achieve similar by rsyncing to a single destination directory and using FreeBSD-5.x's snapshot facility. Create a (read only) snapshot of the destination partition every night. it only costs you the amount of diskspace consumed by *changes* from the snapshot to the current data. Like a NetApp. Keep 5 snapshots around and get the same effect as the multiple rsync destinations in my example above. Haven't tried this but it seems appealing. Also, the original poster mentioned the source was windoze. If you google rsync windows you'll find help on installing ssh and rsync on a Windoze box so maybe you don't need UNIX at your client's firm. Check SAMBA for access to shares. Amanda used to have some hooks to backup 'doze shares to tapes, perhaps you could leverage their work. ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Remote backup hosting setup?
On Aug 4, 2004, at 1:44 PM, Chris Shenton wrote: Tim Aslat [EMAIL PROTECTED] writes: Try one of the multitude of rsync based scripts, you can even get some very good incremental backups happening, I have been thinking about this for my own use. One problem with basic rsync is that if (say) I trash a critical file and don't notice it for a couple days, the (nightly) rsync will have overwritten the good version with the trashed version. Yes. So I've been thinking of having maybe 5 different copies at the destination and rsyncing to a different one each night so I have 5 different backups to go to -- just like in the days of tape. Something conceptually like: cut I use a similar setup. Actually what I have for two servers is a scheme where you have system A and system B. System A has a directory tree to back up. System B pulls that directory daily from A using rsync over SSH. It will create a synced image of the tree to a local directory. Next system B decides if it is a regular workday or a friday, then if it's a workday it saves a gzip'ed tarball of the snapshot to a daily archive directory. If it is a friday, it saves the snapshot to a long term archive directory. It then runs a check for files that are greater than 7 or 8 days old in their creation time in the daily archive and deletes them, or if it's the long term archive run it'll check for files older than about three months and delete them. The filenames are composed of the dates embedded in the filenames. That way you have a week-long backup as well as a weekly backup going back several months. Also, the original poster mentioned the source was windoze. If you google rsync windows you'll find help on installing ssh and rsync on a Windoze box so maybe you don't need UNIX at your client's firm. Try cygwin, running a ssh server as a service on 2000/xp. That should be all you'd need on the windows side listening as the server process. Or a batch file could kick it off I supposed, or at job... Depends really on how the OP wants to set it up...if they map network drives already, it would just be a case of copying J:\etc..otherwise fun scripts to mount shares on remote servers. Or run the backups from a central server. And they'd also have to decide if they're going to push or pull the backup... Have fun! -Bart ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Remote backup hosting setup?
So I've been thinking of having maybe 5 different copies at the destination and rsyncing to a different one each night so I have 5 different backups to go to -- just like in the days of tape. Something conceptually like: rsync -avR --delete / remote:/BACKUP/`expr $dayofyear % 5`/ Yeah, you need to store 5x copies of your client's data, but disk is cheap. Run rsnapshot at the remote destination on the backup directory. You get full daily versions at the cost of only another incremental backup. Check out http://www.rsnapshot.org/ We use this setup to backup our servers and it works perfect. Dave. ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Remote backup hosting setup?
Check out rdiff-backup: http://rdiff-backup.stanford.edu It not only generates a mirror copy of the current system, but also generates diff files that can be applied to the mirror to do a point-in-time restore. Gary -- Gary Mulder mailto:[EMAIL PROTECTED] Info Tech, Inc. 5700 SW 34th Street, Suite 1235 Phone: (352) 381-4400 Gainesville, FL 32608 Fax: (352) 381- ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Remote backup hosting setup?
Hello list, I was recently contacted by a lawfirm that needs a remote backup solution to help bring their insurance rates down. I've decided to go ahead and do this, as their needs are not that great. What I'm asking, is how best to setup this situation. I've never played with jails or anything, but I'm not sure if I really need to go that far. I'm considering building a server that has ssh and sftp access. The plan is to allow them to upload at their pace, and provide next-day DVD/CD copies of their entire directory structure. Any advice on how to go about this? Thanks! Eric F Crist Found on Conan O'Brian: Children's books written by celebrities; By Mel Gibson: Jesus Christ and the Terrible, Horrible, No Good, Very Bad Day. - Keep your powder dry and your pecker hard and the world WILL turn. - Eric F Crist ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Remote backup hosting setup?
In the immortal words of Eric Crist [EMAIL PROTECTED]... I was recently contacted by a lawfirm that needs a remote backup solution to help bring their insurance rates down. I've decided to go ahead and do this, as their needs are not that great. Sounds simple enough What I'm asking, is how best to setup this situation. I've never played with jails or anything, but I'm not sure if I really need to go that far. I'm considering building a server that has ssh and sftp access. The plan is to allow them to upload at their pace, and provide next-day DVD/CD copies of their entire directory structure. Try one of the multitude of rsync based scripts, you can even get some very good incremental backups happening, and burning DVDs/ dumping to tape/etc is simple enough top script as well. Rsync by default works over ssh so can be very secure. The had part would be, how do these people want to retrieve the data? If you are just handing them media once a day, then it's simple, but if they want to retrieve it remotely as well, then you could be in for some fun and games. Cheers Tim -- Tim Aslat [EMAIL PROTECTED] Spyderweb Consulting http://www.spyderweb.com.au Phone: +61 0401088479 ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
RE: Remote backup hosting setup?
-Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Eric Crist Sent: Tuesday, August 03, 2004 6:56 PM To: [EMAIL PROTECTED] Subject: Remote backup hosting setup? Hello list, I was recently contacted by a lawfirm that needs a remote backup solution to help bring their insurance rates down. I've decided to go ahead and do this, as their needs are not that great. What I'm asking, is how best to setup this situation. I've never played with jails or anything, but I'm not sure if I really need to go that far. I'm considering building a server that has ssh and sftp access. The plan is to allow them to upload at their pace, and provide next-day DVD/CD copies of their entire directory structure. Any advice on how to go about this? Thanks! Eric F Crist Found on Conan O'Brian: Children's books written by celebrities; By Mel Gibson: Jesus Christ and the Terrible, Horrible, No Good, Very Bad Day. - Keep your powder dry and your pecker hard and the world WILL turn. - Eric F Crist ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED] Hello, Maybe something like this? : http://www.bsdnews.org/02/rsync_windows.php Best regards, Andras Kende http://www.kende.com ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
