Re: [U2] UV Unix File Recovery
Brian: How many servers do you handle like this. This sounds a lot like Mozy Pro (that kind of thing). Bill - Original Message - *From:* br...@brianleach.co.uk *To:* 'U2 Users List' *Date:* 6/23/2012 2:23 AM *Subject:* Re: [U2] UV Unix File Recovery If you're on windows, take a look at Syncrify. It's essentially doing an rsync for Windows: I've been using it for a few months now on the client side and it's saved me a load of time for doing offsite backup to a hosted VM for peace of mind. Getting the first backup took me several nights(!) but my ISP doesn't charge for traffic between midnight and 6am and once it had that in place it's perfect for scheduling. Now it rsyncs through about 60GB worth of backups in about half an hour over a slow (rural) connection. In-house on a lan it should be very quick. Remember that whatever route you take, you must pause the database and be on a relatively recent version of UniVerse. Going back, dbpause didn't sync the shared memory headers recording dynamic file loads/splits/pointers so on restoring they would be corrupted. Plus there's always the new replication functionality to consider. From the few reports I've heard it's a lot more solid now. Brian -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Wols Lists Sent: 23 June 2012 00:22 To: u2-users@listserver.u2ug.org Subject: Re: [U2] UV Unix File Recovery On 22/06/12 20:13, Bill Haskett wrote: George: Unfortunately, I'm on Windows. I do full backups each day, but the 15Gb backup files shut down the dbms for about 30 minutes each night. We're not a 24/7 shop by any means, but we do span a number of time zones, so our window for backups is about three hours each evening. I've always wanted to use something simple but can't find anything. One would think your backup method (mirrors, breaking them, backing up the mirror, then re-syncing) would be part of the U2 admin guide (or be on some wiki). I do this with a couple of simple Windows scripts, but it's strickly a full backup operation with no mirrors. I did have to change the scripts and the method of implementation for Windows 2008 R2 from previous windows using "ntbackup". Sounds like you want proper mirrored disks on your server. dbpause, break mirror, dbresume. Then you can back up the broken mirror at your leisure before resuming the mirror. Your database won't even be down a moment. As for minor changes to a 2Gb file, that's where btrfs would come in handy. It's a "copy on write" filesystem, so when you change a file it only updates the bits that have changed. And it cascades those changes up the hierarchy, so that if you "snapshot" the file system, it will archive the then-root of the filesystem. All new changes go to a new root. Only thing is, if you want to get back to a previous state of the filesystem (ie retrieve a backup), I understand it's a reboot. But if you had the true mirror on your server, you could run an infinite loop of dbpause, break mirror, dbresume, rsync broken mirror to linux btrfs, snapshot btrfs and restore mirror, wait for mirror to resync, rinse and repeat. It would take an awfully long time to fill up the linux backup server's disk... (rsync is the unix command that will sync two file systems, and it's very good at only updating the parts of files that have changed). Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
If you're on windows, take a look at Syncrify. It's essentially doing an rsync for Windows: I've been using it for a few months now on the client side and it's saved me a load of time for doing offsite backup to a hosted VM for peace of mind. Getting the first backup took me several nights(!) but my ISP doesn't charge for traffic between midnight and 6am and once it had that in place it's perfect for scheduling. Now it rsyncs through about 60GB worth of backups in about half an hour over a slow (rural) connection. In-house on a lan it should be very quick. Remember that whatever route you take, you must pause the database and be on a relatively recent version of UniVerse. Going back, dbpause didn't sync the shared memory headers recording dynamic file loads/splits/pointers so on restoring they would be corrupted. Plus there's always the new replication functionality to consider. From the few reports I've heard it's a lot more solid now. Brian -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Wols Lists Sent: 23 June 2012 00:22 To: u2-users@listserver.u2ug.org Subject: Re: [U2] UV Unix File Recovery On 22/06/12 20:13, Bill Haskett wrote: > George: > > Unfortunately, I'm on Windows. I do full backups each day, but the > 15Gb backup files shut down the dbms for about 30 minutes each night. > We're not a 24/7 shop by any means, but we do span a number of time > zones, so our window for backups is about three hours each evening. > > I've always wanted to use something simple but can't find anything. > One would think your backup method (mirrors, breaking them, backing up > the mirror, then re-syncing) would be part of the U2 admin guide (or > be on some wiki). I do this with a couple of simple Windows scripts, > but it's strickly a full backup operation with no mirrors. I did have > to change the scripts and the method of implementation for Windows > 2008 R2 from previous windows using "ntbackup". > Sounds like you want proper mirrored disks on your server. dbpause, break mirror, dbresume. Then you can back up the broken mirror at your leisure before resuming the mirror. Your database won't even be down a moment. As for minor changes to a 2Gb file, that's where btrfs would come in handy. It's a "copy on write" filesystem, so when you change a file it only updates the bits that have changed. And it cascades those changes up the hierarchy, so that if you "snapshot" the file system, it will archive the then-root of the filesystem. All new changes go to a new root. Only thing is, if you want to get back to a previous state of the filesystem (ie retrieve a backup), I understand it's a reboot. But if you had the true mirror on your server, you could run an infinite loop of dbpause, break mirror, dbresume, rsync broken mirror to linux btrfs, snapshot btrfs and restore mirror, wait for mirror to resync, rinse and repeat. It would take an awfully long time to fill up the linux backup server's disk... (rsync is the unix command that will sync two file systems, and it's very good at only updating the parts of files that have changed). Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
On 22/06/12 20:13, Bill Haskett wrote: > George: > > Unfortunately, I'm on Windows. I do full backups each day, but the 15Gb > backup files shut down the dbms for about 30 minutes each night. We're > not a 24/7 shop by any means, but we do span a number of time zones, so > our window for backups is about three hours each evening. > > I've always wanted to use something simple but can't find anything. One > would think your backup method (mirrors, breaking them, backing up the > mirror, then re-syncing) would be part of the U2 admin guide (or be on > some wiki). I do this with a couple of simple Windows scripts, but it's > strickly a full backup operation with no mirrors. I did have to change > the scripts and the method of implementation for Windows 2008 R2 from > previous windows using "ntbackup". > Sounds like you want proper mirrored disks on your server. dbpause, break mirror, dbresume. Then you can back up the broken mirror at your leisure before resuming the mirror. Your database won't even be down a moment. As for minor changes to a 2Gb file, that's where btrfs would come in handy. It's a "copy on write" filesystem, so when you change a file it only updates the bits that have changed. And it cascades those changes up the hierarchy, so that if you "snapshot" the file system, it will archive the then-root of the filesystem. All new changes go to a new root. Only thing is, if you want to get back to a previous state of the filesystem (ie retrieve a backup), I understand it's a reboot. But if you had the true mirror on your server, you could run an infinite loop of dbpause, break mirror, dbresume, rsync broken mirror to linux btrfs, snapshot btrfs and restore mirror, wait for mirror to resync, rinse and repeat. It would take an awfully long time to fill up the linux backup server's disk... (rsync is the unix command that will sync two file systems, and it's very good at only updating the parts of files that have changed). Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
As long as she doesn't decide to lead... -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Bill Haskett Sent: Friday, June 22, 2012 3:45 PM To: U2 Users List Subject: Re: [U2] UV Unix File Recovery That's quite a waltz! However, it I can get the girl to lean into me it'd be worth it. :-) ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
We do *EMC replication manager* for snapshots in Windows and make a backup out of it. It halts IO for 2-4 seconds only. hp On Fri, Jun 22, 2012 at 3:13 PM, Bill Haskett wrote: > George: > > Unfortunately, I'm on Windows. I do full backups each day, but the 15Gb > backup files shut down the dbms for about 30 minutes each night. We're not > a 24/7 shop by any means, but we do span a number of time zones, so our > window for backups is about three hours each evening. > > I've always wanted to use something simple but can't find anything. One > would think your backup method (mirrors, breaking them, backing up the > mirror, then re-syncing) would be part of the U2 admin guide (or be on some > wiki). I do this with a couple of simple Windows scripts, but it's > strickly a full backup operation with no mirrors. I did have to change the > scripts and the method of implementation for Windows 2008 R2 from previous > windows using "ntbackup". > > Thanks, > > Bill > > --**--** > > - Original Message - > *From:* ggal...@wyanokegroup.com > *To:* U2 Users List > *Date:* 6/22/2012 9:39 AM > *Subject:* Re: [U2] UV Unix File Recovery > >> I don't know the method it uses, but if figures out what changed in the >> file and saves just that part. >> >> I have a 300gb partition set for our backups, and it can hold apx 8 >> months of 20 minute interval diff checks >> Granted, that figure would depend on the size of your database files (I'm >> not really sure what our base gb >> Figure is). >> >> It doesn't really impact noticeably our system processing speed either >> when it runs. >> >> It either uses rsynch or a modified version of it to determine the >> differences between the mirror and the >> Active file - rsynch is pretty fast also. >> >> For unix system, it might already be loaded (Redhat has it preloaded), >> otherwise it's pretty simple to >> Install, (does require python to be loaded) >> >> Load it up, give it a try >> >> It does not replace backups - but it does make for those oops moments for >> restore a file to it's previous >> State much faster than pulling tapes, assuming you have the incrementals >> for the time period you want. >> >> But to be honest, I've never actually tracked a large file with minor >> changes to see how large the >> Change files are. >> >> To help save space, the incremental files are stored in a compressed >> format, great for UV ASCII data. >> >> George >> >> >> -Original Message- >> From: >> u2-users-bounces@listserver.**u2ug.org[mailto: >> u2-users-bounces@**listserver.u2ug.org] >> On Behalf Of Bill Haskett >> Sent: Friday, June 22, 2012 12:06 PM >> To: U2 Users List >> Subject: Re: [U2] UV Unix File Recovery >> >> George: >> >> If you update a few records in a 2Gb file, isn't the incremental backup >> going to save the entire 2Gb file? So, your entire database will most >> likely be saved each time the incremental backup is run. >> >> Or is this some kind of imaging backup (I didn't get this from their >> website). >> >> Thanks, >> >> Bill >> >> --**--** >> >> - Original Message - >> *From:* ggal...@wyanokegroup.com >> *To:* U2 Users List >> *Date:* 6/21/2012 8:20 PM >> *Subject:* Re: [U2] UV Unix File Recovery >> >>> From: >>> u2-users-bounces@listserver.**u2ug.org[ >>> u2-users-bounces@listserver.**u2ug.org] >>> On Behalf Of Wols Lists [antli...@youngman.org.uk] >>> Sent: Thursday, June 21, 2012 6:56 PM >>> To: u2-users@listserver.u2ug.org >>> Subject: Re: [U2] UV Unix File Recovery >>> >>> On 21/06/12 16:53, George Gallen wrote: >>> >>>> We use rdiff-backup for onsite backups, it creates a mirror and keeps >>>> differential for >>>> Restoring to specific backup date images (although that is a file by >>>> file). >>>> >>> How easy is it to get back to any particular date? Disk space is cheap >>> (though network bandwidth isn't, if big files get modified). Not saying >>> my way is better, but it gives the appearance of multiple full backups, >>> while only doing an incremental copy. >>> >>> >>> http://www.nongnu.org/rdiff-**backup/<http:/
Re: [U2] UV Unix File Recovery
That's quite a waltz! However, it I can get the girl to lean into me it'd be worth it. :-) I'll play with this concept and maybe I can get something like this running in my dev environment. I do have an extra server I could install linux on. Hmmm...maybe I could even find a linux person to help out. :-) Thanks, Bill - Original Message - *From:* ggal...@wyanokegroup.com *To:* U2 Users List *Date:* 6/22/2012 12:33 PM *Subject:* Re: [U2] UV Unix File Recovery Not sure if this would work for you Install a 1000mbs NIC card on your windows machine Do a direct connection to a linux machine (flavor you pick) Share your drive that contains your UV files Use samba to mount a directory on the linux machine to your windows share Then run rdiff-backup on the linux machine to mirror from the mount directory To a directory on the linux machine I have my rdiff-backup script check a lock file before running (if it exists, It won't run). If you can modify your windows backup script to create a file Prior to running, and delete it after it's done. You could use that as lock File to stop rdiff from attempting to mirror while your backup is running. We run the backup every 20 min against the live files. Occaisionally I will see A message that the file changed while it was mirroring (it uses the prechange for It's mirror), but I yet to have any file corruption because of it. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Bill Haskett Sent: Friday, June 22, 2012 3:14 PM To: U2 Users List Subject: Re: [U2] UV Unix File Recovery George: Unfortunately, I'm on Windows. I do full backups each day, but the 15Gb backup files shut down the dbms for about 30 minutes each night. We're not a 24/7 shop by any means, but we do span a number of time zones, so our window for backups is about three hours each evening. I've always wanted to use something simple but can't find anything. One would think your backup method (mirrors, breaking them, backing up the mirror, then re-syncing) would be part of the U2 admin guide (or be on some wiki). I do this with a couple of simple Windows scripts, but it's strickly a full backup operation with no mirrors. I did have to change the scripts and the method of implementation for Windows 2008 R2 from previous windows using "ntbackup". Thanks, Bill - Original Message - *From:* ggal...@wyanokegroup.com *To:* U2 Users List *Date:* 6/22/2012 9:39 AM *Subject:* Re: [U2] UV Unix File Recovery I don't know the method it uses, but if figures out what changed in the file and saves just that part. I have a 300gb partition set for our backups, and it can hold apx 8 months of 20 minute interval diff checks Granted, that figure would depend on the size of your database files (I'm not really sure what our base gb Figure is). It doesn't really impact noticeably our system processing speed either when it runs. It either uses rsynch or a modified version of it to determine the differences between the mirror and the Active file - rsynch is pretty fast also. For unix system, it might already be loaded (Redhat has it preloaded), otherwise it's pretty simple to Install, (does require python to be loaded) Load it up, give it a try It does not replace backups - but it does make for those oops moments for restore a file to it's previous State much faster than pulling tapes, assuming you have the incrementals for the time period you want. But to be honest, I've never actually tracked a large file with minor changes to see how large the Change files are. To help save space, the incremental files are stored in a compressed format, great for UV ASCII data. George -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Bill Haskett Sent: Friday, June 22, 2012 12:06 PM To: U2 Users List Subject: Re: [U2] UV Unix File Recovery George: If you update a few records in a 2Gb file, isn't the incremental backup going to save the entire 2Gb file? So, your entire database will most likely be saved each time the incremental backup is run. Or is this some kind of imaging backup (I didn't get this from their website). Thanks, Bill - Original Message ----- *From:* ggal...@wyanokegroup.com *To:* U2 Users List *Date:* 6/21/2012 8:20 PM *Subject:* Re: [U2] UV Unix File Recovery From: u2-users-boun...@listserver.u2ug.org [u2-users-boun...@listserver.u2ug.org] On Behalf Of Wols Lists [antli...@youngman.org.uk] Sent: Thursday, June 21, 2012 6:56 PM To: u2-users@listserve
Re: [U2] UV Unix File Recovery
Not sure if this would work for you Install a 1000mbs NIC card on your windows machine Do a direct connection to a linux machine (flavor you pick) Share your drive that contains your UV files Use samba to mount a directory on the linux machine to your windows share Then run rdiff-backup on the linux machine to mirror from the mount directory To a directory on the linux machine I have my rdiff-backup script check a lock file before running (if it exists, It won't run). If you can modify your windows backup script to create a file Prior to running, and delete it after it's done. You could use that as lock File to stop rdiff from attempting to mirror while your backup is running. We run the backup every 20 min against the live files. Occaisionally I will see A message that the file changed while it was mirroring (it uses the prechange for It's mirror), but I yet to have any file corruption because of it. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Bill Haskett Sent: Friday, June 22, 2012 3:14 PM To: U2 Users List Subject: Re: [U2] UV Unix File Recovery George: Unfortunately, I'm on Windows. I do full backups each day, but the 15Gb backup files shut down the dbms for about 30 minutes each night. We're not a 24/7 shop by any means, but we do span a number of time zones, so our window for backups is about three hours each evening. I've always wanted to use something simple but can't find anything. One would think your backup method (mirrors, breaking them, backing up the mirror, then re-syncing) would be part of the U2 admin guide (or be on some wiki). I do this with a couple of simple Windows scripts, but it's strickly a full backup operation with no mirrors. I did have to change the scripts and the method of implementation for Windows 2008 R2 from previous windows using "ntbackup". Thanks, Bill - Original Message - *From:* ggal...@wyanokegroup.com *To:* U2 Users List *Date:* 6/22/2012 9:39 AM *Subject:* Re: [U2] UV Unix File Recovery > I don't know the method it uses, but if figures out what changed in the file > and saves just that part. > > I have a 300gb partition set for our backups, and it can hold apx 8 months of > 20 minute interval diff checks > Granted, that figure would depend on the size of your database files (I'm not > really sure what our base gb > Figure is). > > It doesn't really impact noticeably our system processing speed either when > it runs. > > It either uses rsynch or a modified version of it to determine the > differences between the mirror and the > Active file - rsynch is pretty fast also. > > For unix system, it might already be loaded (Redhat has it preloaded), > otherwise it's pretty simple to > Install, (does require python to be loaded) > > Load it up, give it a try > > It does not replace backups - but it does make for those oops moments for > restore a file to it's previous > State much faster than pulling tapes, assuming you have the incrementals for > the time period you want. > > But to be honest, I've never actually tracked a large file with minor changes > to see how large the > Change files are. > > To help save space, the incremental files are stored in a compressed format, > great for UV ASCII data. > > George > > > -Original Message- > From: u2-users-boun...@listserver.u2ug.org > [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Bill Haskett > Sent: Friday, June 22, 2012 12:06 PM > To: U2 Users List > Subject: Re: [U2] UV Unix File Recovery > > George: > > If you update a few records in a 2Gb file, isn't the incremental backup > going to save the entire 2Gb file? So, your entire database will most > likely be saved each time the incremental backup is run. > > Or is this some kind of imaging backup (I didn't get this from their > website). > > Thanks, > > Bill > > > - Original Message - > *From:* ggal...@wyanokegroup.com > *To:* U2 Users List > *Date:* 6/21/2012 8:20 PM > *Subject:* Re: [U2] UV Unix File Recovery >> From: u2-users-boun...@listserver.u2ug.org >> [u2-users-boun...@listserver.u2ug.org] On Behalf Of Wols Lists >> [antli...@youngman.org.uk] >> Sent: Thursday, June 21, 2012 6:56 PM >> To: u2-users@listserver.u2ug.org >> Subject: Re: [U2] UV Unix File Recovery >> >> On 21/06/12 16:53, George Gallen wrote: >>> We use rdiff-backup for onsite backups, it creates a mirror and keeps >>> differential fo
Re: [U2] UV Unix File Recovery
George: Unfortunately, I'm on Windows. I do full backups each day, but the 15Gb backup files shut down the dbms for about 30 minutes each night. We're not a 24/7 shop by any means, but we do span a number of time zones, so our window for backups is about three hours each evening. I've always wanted to use something simple but can't find anything. One would think your backup method (mirrors, breaking them, backing up the mirror, then re-syncing) would be part of the U2 admin guide (or be on some wiki). I do this with a couple of simple Windows scripts, but it's strickly a full backup operation with no mirrors. I did have to change the scripts and the method of implementation for Windows 2008 R2 from previous windows using "ntbackup". Thanks, Bill - Original Message - *From:* ggal...@wyanokegroup.com *To:* U2 Users List *Date:* 6/22/2012 9:39 AM *Subject:* Re: [U2] UV Unix File Recovery I don't know the method it uses, but if figures out what changed in the file and saves just that part. I have a 300gb partition set for our backups, and it can hold apx 8 months of 20 minute interval diff checks Granted, that figure would depend on the size of your database files (I'm not really sure what our base gb Figure is). It doesn't really impact noticeably our system processing speed either when it runs. It either uses rsynch or a modified version of it to determine the differences between the mirror and the Active file - rsynch is pretty fast also. For unix system, it might already be loaded (Redhat has it preloaded), otherwise it's pretty simple to Install, (does require python to be loaded) Load it up, give it a try It does not replace backups - but it does make for those oops moments for restore a file to it's previous State much faster than pulling tapes, assuming you have the incrementals for the time period you want. But to be honest, I've never actually tracked a large file with minor changes to see how large the Change files are. To help save space, the incremental files are stored in a compressed format, great for UV ASCII data. George -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Bill Haskett Sent: Friday, June 22, 2012 12:06 PM To: U2 Users List Subject: Re: [U2] UV Unix File Recovery George: If you update a few records in a 2Gb file, isn't the incremental backup going to save the entire 2Gb file? So, your entire database will most likely be saved each time the incremental backup is run. Or is this some kind of imaging backup (I didn't get this from their website). Thanks, Bill - Original Message - *From:* ggal...@wyanokegroup.com *To:* U2 Users List *Date:* 6/21/2012 8:20 PM *Subject:* Re: [U2] UV Unix File Recovery From: u2-users-boun...@listserver.u2ug.org [u2-users-boun...@listserver.u2ug.org] On Behalf Of Wols Lists [antli...@youngman.org.uk] Sent: Thursday, June 21, 2012 6:56 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] UV Unix File Recovery On 21/06/12 16:53, George Gallen wrote: We use rdiff-backup for onsite backups, it creates a mirror and keeps differential for Restoring to specific backup date images (although that is a file by file). How easy is it to get back to any particular date? Disk space is cheap (though network bandwidth isn't, if big files get modified). Not saying my way is better, but it gives the appearance of multiple full backups, while only doing an incremental copy. http://www.nongnu.org/rdiff-backup/ Multiple full backups would only occur if you used a backup method to backup the mirror, (excepting the directory which holds the incremental files). To restore a file, you can specify an exact date/time or an estimated date (ie. 3d ago) It also has a pruning utility if you need to free up disk space, by deleteing older incrmental info It actually does a fairly good job at only saving the changes, even to big files. We run our nightly backups off the mirror And update the mirror every 20 minutes - except while the backup runs Yup - on the main server itself, I'd probably run mirrored disks, break the mirror to do the backup, and then resync the mirror. In my case, I don't "break" the mirror, as it's not a real time mirror, it's an every 20 minute mirror. When I run my tape backup on the mirror, I disable the every 20 minute run until it's done, then restart the mirroring. The mirror can be on the same system, SAN or another network Hmmm... If you can network the mirror, could you mirror it onto that self-same linux box? Mirror the live disk onto the linux box, b
Re: [U2] UV Unix File Recovery
I don't know the method it uses, but if figures out what changed in the file and saves just that part. I have a 300gb partition set for our backups, and it can hold apx 8 months of 20 minute interval diff checks Granted, that figure would depend on the size of your database files (I'm not really sure what our base gb Figure is). It doesn't really impact noticeably our system processing speed either when it runs. It either uses rsynch or a modified version of it to determine the differences between the mirror and the Active file - rsynch is pretty fast also. For unix system, it might already be loaded (Redhat has it preloaded), otherwise it's pretty simple to Install, (does require python to be loaded) Load it up, give it a try It does not replace backups - but it does make for those oops moments for restore a file to it's previous State much faster than pulling tapes, assuming you have the incrementals for the time period you want. But to be honest, I've never actually tracked a large file with minor changes to see how large the Change files are. To help save space, the incremental files are stored in a compressed format, great for UV ASCII data. George -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Bill Haskett Sent: Friday, June 22, 2012 12:06 PM To: U2 Users List Subject: Re: [U2] UV Unix File Recovery George: If you update a few records in a 2Gb file, isn't the incremental backup going to save the entire 2Gb file? So, your entire database will most likely be saved each time the incremental backup is run. Or is this some kind of imaging backup (I didn't get this from their website). Thanks, Bill - Original Message - *From:* ggal...@wyanokegroup.com *To:* U2 Users List *Date:* 6/21/2012 8:20 PM *Subject:* Re: [U2] UV Unix File Recovery > From: u2-users-boun...@listserver.u2ug.org > [u2-users-boun...@listserver.u2ug.org] On Behalf Of Wols Lists > [antli...@youngman.org.uk] > Sent: Thursday, June 21, 2012 6:56 PM > To: u2-users@listserver.u2ug.org > Subject: Re: [U2] UV Unix File Recovery > > On 21/06/12 16:53, George Gallen wrote: >> We use rdiff-backup for onsite backups, it creates a mirror and keeps >> differential for >> Restoring to specific backup date images (although that is a file by file). > How easy is it to get back to any particular date? Disk space is cheap > (though network bandwidth isn't, if big files get modified). Not saying > my way is better, but it gives the appearance of multiple full backups, > while only doing an incremental copy. > > http://www.nongnu.org/rdiff-backup/ > > Multiple full backups would only occur if you used a backup method to > backup the mirror, > (excepting the directory which holds the incremental files). > > To restore a file, you can specify an exact date/time or an estimated > date (ie. 3d ago) > It also has a pruning utility if you need to free up disk space, by > deleteing older incrmental info > > It actually does a fairly good job at only saving the changes, even to > big files. > > >> We run our nightly backups off the mirror >> >> And update the mirror every 20 minutes - except while the backup runs > Yup - on the main server itself, I'd probably run mirrored disks, break > the mirror to do the backup, and then resync the mirror. > >In my case, I don't "break" the mirror, as it's not a real time > mirror, it's an every 20 minute >mirror. When I run my tape backup on the mirror, I disable the every > 20 minute run >until it's done, then restart the mirroring. > >> The mirror can be on the same system, SAN or another network > Hmmm... If you can network the mirror, could you mirror it onto that > self-same linux box? > > Mirror the live disk onto the linux box, break the mirror to do a local > (probably cross-drive) backup, then resume the mirror. Rinse, repeat, etc. > > Yup, you can mirror onto itself. Just like tar, you can specify > directories to not mirror > like the directory that holds the mirror, and anything else you don't > want mirrored. > >> Rdiff-backup I believe will work between a linux box and windows >> > Do you really want to spend loads of money on a Windows system just to > provide a cheap back-up server? And if the main server is hp-ux, it's > easier to keep everything within the nix family. > > Personally, I'd prefer *nix to *nix, but I thought the OP was going from > Windows UV > to *nix UV. > > > Cheers, > Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
George: If you update a few records in a 2Gb file, isn't the incremental backup going to save the entire 2Gb file? So, your entire database will most likely be saved each time the incremental backup is run. Or is this some kind of imaging backup (I didn't get this from their website). Thanks, Bill - Original Message - *From:* ggal...@wyanokegroup.com *To:* U2 Users List *Date:* 6/21/2012 8:20 PM *Subject:* Re: [U2] UV Unix File Recovery From: u2-users-boun...@listserver.u2ug.org [u2-users-boun...@listserver.u2ug.org] On Behalf Of Wols Lists [antli...@youngman.org.uk] Sent: Thursday, June 21, 2012 6:56 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] UV Unix File Recovery On 21/06/12 16:53, George Gallen wrote: We use rdiff-backup for onsite backups, it creates a mirror and keeps differential for Restoring to specific backup date images (although that is a file by file). How easy is it to get back to any particular date? Disk space is cheap (though network bandwidth isn't, if big files get modified). Not saying my way is better, but it gives the appearance of multiple full backups, while only doing an incremental copy. http://www.nongnu.org/rdiff-backup/ Multiple full backups would only occur if you used a backup method to backup the mirror, (excepting the directory which holds the incremental files). To restore a file, you can specify an exact date/time or an estimated date (ie. 3d ago) It also has a pruning utility if you need to free up disk space, by deleteing older incrmental info It actually does a fairly good job at only saving the changes, even to big files. We run our nightly backups off the mirror And update the mirror every 20 minutes - except while the backup runs Yup - on the main server itself, I'd probably run mirrored disks, break the mirror to do the backup, and then resync the mirror. In my case, I don't "break" the mirror, as it's not a real time mirror, it's an every 20 minute mirror. When I run my tape backup on the mirror, I disable the every 20 minute run until it's done, then restart the mirroring. The mirror can be on the same system, SAN or another network Hmmm... If you can network the mirror, could you mirror it onto that self-same linux box? Mirror the live disk onto the linux box, break the mirror to do a local (probably cross-drive) backup, then resume the mirror. Rinse, repeat, etc. Yup, you can mirror onto itself. Just like tar, you can specify directories to not mirror like the directory that holds the mirror, and anything else you don't want mirrored. Rdiff-backup I believe will work between a linux box and windows Do you really want to spend loads of money on a Windows system just to provide a cheap back-up server? And if the main server is hp-ux, it's easier to keep everything within the nix family. Personally, I'd prefer *nix to *nix, but I thought the OP was going from Windows UV to *nix UV. Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
From: u2-users-boun...@listserver.u2ug.org [u2-users-boun...@listserver.u2ug.org] On Behalf Of Wols Lists [antli...@youngman.org.uk] Sent: Thursday, June 21, 2012 6:56 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] UV Unix File Recovery On 21/06/12 16:53, George Gallen wrote: > We use rdiff-backup for onsite backups, it creates a mirror and keeps > differential for > Restoring to specific backup date images (although that is a file by file). How easy is it to get back to any particular date? Disk space is cheap (though network bandwidth isn't, if big files get modified). Not saying my way is better, but it gives the appearance of multiple full backups, while only doing an incremental copy. http://www.nongnu.org/rdiff-backup/ Multiple full backups would only occur if you used a backup method to backup the mirror, (excepting the directory which holds the incremental files). To restore a file, you can specify an exact date/time or an estimated date (ie. 3d ago) It also has a pruning utility if you need to free up disk space, by deleteing older incrmental info It actually does a fairly good job at only saving the changes, even to big files. > > We run our nightly backups off the mirror > > And update the mirror every 20 minutes - except while the backup runs Yup - on the main server itself, I'd probably run mirrored disks, break the mirror to do the backup, and then resync the mirror. In my case, I don't "break" the mirror, as it's not a real time mirror, it's an every 20 minute mirror. When I run my tape backup on the mirror, I disable the every 20 minute run until it's done, then restart the mirroring. > > The mirror can be on the same system, SAN or another network Hmmm... If you can network the mirror, could you mirror it onto that self-same linux box? Mirror the live disk onto the linux box, break the mirror to do a local (probably cross-drive) backup, then resume the mirror. Rinse, repeat, etc. Yup, you can mirror onto itself. Just like tar, you can specify directories to not mirror like the directory that holds the mirror, and anything else you don't want mirrored. > > Rdiff-backup I believe will work between a linux box and windows > Do you really want to spend loads of money on a Windows system just to provide a cheap back-up server? And if the main server is hp-ux, it's easier to keep everything within the nix family. Personally, I'd prefer *nix to *nix, but I thought the OP was going from Windows UV to *nix UV. Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
On 21/06/12 16:53, George Gallen wrote: > We use rdiff-backup for onsite backups, it creates a mirror and keeps > differential for > Restoring to specific backup date images (although that is a file by file). How easy is it to get back to any particular date? Disk space is cheap (though network bandwidth isn't, if big files get modified). Not saying my way is better, but it gives the appearance of multiple full backups, while only doing an incremental copy. > > We run our nightly backups off the mirror > > And update the mirror every 20 minutes - except while the backup runs Yup - on the main server itself, I'd probably run mirrored disks, break the mirror to do the backup, and then resync the mirror. > > The mirror can be on the same system, SAN or another network Hmmm... If you can network the mirror, could you mirror it onto that self-same linux box? Mirror the live disk onto the linux box, break the mirror to do a local (probably cross-drive) backup, then resume the mirror. Rinse, repeat, etc. > > Rdiff-backup I believe will work between a linux box and windows > Do you really want to spend loads of money on a Windows system just to provide a cheap back-up server? And if the main server is hp-ux, it's easier to keep everything within the nix family. Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
We use rdiff-backup for onsite backups, it creates a mirror and keeps differential for Restoring to specific backup date images (although that is a file by file). We run our nightly backups off the mirror And update the mirror every 20 minutes - except while the backup runs The mirror can be on the same system, SAN or another network Rdiff-backup I believe will work between a linux box and windows George -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Wols Lists Sent: Thursday, June 21, 2012 11:29 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] UV Unix File Recovery On 21/06/12 15:59, Bill Brutzman wrote: > Wol: > > Thanks. One trouble with using FileZilla is having to remember to check that > pesky option for ASCII vs binary. > > It appears I need a new and improved backup and recovery scheme. I like the > Linux box idea. > > --Bill > I've thought a little bit more about my idea ... First, rsync to get a clean backup. Then run a script over the backup to create a dated backup, use ln so it's the same file in both the live and dated backup - saves disk space. Then your daily backup consists of rsync'ing the master backup directory - you need to tell rsync to delete and recreate rather than modify any changed files. Then rerun your ln script to create a new dated backup. Hey Presto - unchanged files don't take up space with multiple copies, you have a complete backup history going back however long you like, and if you have to you can free space by deleting old backups. The other thing on your backup system - consider using snapshots and btrfs, but that imho is a lot messier. Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
On 21/06/12 15:59, Bill Brutzman wrote: > Wol: > > Thanks. One trouble with using FileZilla is having to remember to check that > pesky option for ASCII vs binary. > > It appears I need a new and improved backup and recovery scheme. I like the > Linux box idea. > > --Bill > I've thought a little bit more about my idea ... First, rsync to get a clean backup. Then run a script over the backup to create a dated backup, use ln so it's the same file in both the live and dated backup - saves disk space. Then your daily backup consists of rsync'ing the master backup directory - you need to tell rsync to delete and recreate rather than modify any changed files. Then rerun your ln script to create a new dated backup. Hey Presto - unchanged files don't take up space with multiple copies, you have a complete backup history going back however long you like, and if you have to you can free space by deleting old backups. The other thing on your backup system - consider using snapshots and btrfs, but that imho is a lot messier. Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
Wol: Thanks. One trouble with using FileZilla is having to remember to check that pesky option for ASCII vs binary. It appears I need a new and improved backup and recovery scheme. I like the Linux box idea. --Bill -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Wols Lists Sent: Wednesday, June 20, 2012 6:48 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] UV Unix File Recovery On 20/06/12 22:28, Bill Brutzman wrote: > I am having trouble trying to restore a year-end file to a new file name. > > The file is saved to my Windows7 PC... The UniVerse host is running on hp-ux. How did you save it to the PC? > > I tried to FileZilla FTP the file back using binary enconding. This could be your problem - if you didn't binary it to the PC, it could be corrupt on the PC - in which case you're in trouble... > > I tried to create a new file and dictionary from the UV command prompt and > then copy the file and dictionary over. > > I tried creating a new file in UniVerse and sizing the file like the known > working files. > UV doesn't care about that sort of thing - it should "just work" > When I try to do a UVFIXFILE... an error indicating file truncation results. And this doesn't sound healthy at all. > > I am now trying ASCII encoding. > > I was able to get something like this to work in the past. > > Suggestions would be appreciated. > Have you got a backup from the hp box? Do you have the year-end file still sitting somewhere on the hp box? Disk is cheap nowadays. If you're worried about expensive hp disks, just get a cheap pc, stuff a couple of terabyte disks in it, and run linux on it. Back up the hp box over the network with rsync or something cleverer that'll do incremental snapshots. Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
No problem Bill! I've had similar issues -Original Message- From: Bill Brutzman To: U2 Users List Sent: Thu, Jun 21, 2012 7:17 am Subject: Re: [U2] UV Unix File Recovery Will: Thanks for writing. Just before I received this message, I did something close to this... I copied the entire account to my SandBox and then it worked. -Bill How about Create a new ACCOUNT Restore the file to this new account Q point at it, from the account in which you really want to use it I am having trouble trying to restore a year-end file to a new file name. The file is saved to my Windows7 PC... The UniVerse host is running on hp-ux. I tried to FileZilla FTP the file back using binary enconding. I tried to create a new file and dictionary from the UV command prompt and then opy the file and dictionary over. I tried creating a new file in UniVerse and sizing the file like the known orking files. When I try to do a UVFIXFILE... an error indicating file truncation results. I am now trying ASCII encoding. I was able to get something like this to work in the past. Suggestions would be appreciated. --Bill ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
Will: Thanks for writing. Just before I received this message, I did something close to this... I copied the entire account to my SandBox and then it worked. -Bill How about Create a new ACCOUNT Restore the file to this new account Q point at it, from the account in which you really want to use it I am having trouble trying to restore a year-end file to a new file name. The file is saved to my Windows7 PC... The UniVerse host is running on hp-ux. I tried to FileZilla FTP the file back using binary enconding. I tried to create a new file and dictionary from the UV command prompt and then opy the file and dictionary over. I tried creating a new file in UniVerse and sizing the file like the known orking files. When I try to do a UVFIXFILE... an error indicating file truncation results. I am now trying ASCII encoding. I was able to get something like this to work in the past. Suggestions would be appreciated. --Bill ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
What I've done is zip up the entire directory on the windows machine. Then unzip the file on my linux machine Create an F pointer in UV to the new location Delete any index files, as they are tied to the original location in windows, you Can modify the link to where to go, but I offhand forget how to do that. I also always chmod -R 777 the directory once it's unzipped to make sure There are no permissions issues. George -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Manu Fernandes Sent: Thursday, June 21, 2012 9:22 AM To: U2 Users List Subject: Re: [U2] UV Unix File Recovery Hi bill, If uv is on your win-box, try this : - On windows, use uvbackup (eventually -rev10.1 or less) - On hp-ux use uvrestore manu > -Message d'origine- > De : u2-users-boun...@listserver.u2ug.org [mailto:u2-users- > boun...@listserver.u2ug.org] De la part de Bill Brutzman > Envoyé : mercredi 20 juin 2012 23:29 > À : U2 Users List > Objet : [U2] UV Unix File Recovery > > I am having trouble trying to restore a year-end file to a new file name. > > The file is saved to my Windows7 PC... The UniVerse host is running on hp-ux. > > I tried to FileZilla FTP the file back using binary enconding. > > I tried to create a new file and dictionary from the UV command prompt and > then copy the file and dictionary over. > > I tried creating a new file in UniVerse and sizing the file like the known > working > files. > > When I try to do a UVFIXFILE... an error indicating file truncation results. > > I am now trying ASCII encoding. > > I was able to get something like this to work in the past. > > Suggestions would be appreciated. > > --Bill > ___ > U2-Users mailing list > U2-Users@listserver.u2ug.org > http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
Hi bill, If uv is on your win-box, try this : - On windows, use uvbackup (eventually -rev10.1 or less) - On hp-ux use uvrestore manu > -Message d'origine- > De : u2-users-boun...@listserver.u2ug.org [mailto:u2-users- > boun...@listserver.u2ug.org] De la part de Bill Brutzman > Envoyé : mercredi 20 juin 2012 23:29 > À : U2 Users List > Objet : [U2] UV Unix File Recovery > > I am having trouble trying to restore a year-end file to a new file name. > > The file is saved to my Windows7 PC... The UniVerse host is running on hp-ux. > > I tried to FileZilla FTP the file back using binary enconding. > > I tried to create a new file and dictionary from the UV command prompt and > then copy the file and dictionary over. > > I tried creating a new file in UniVerse and sizing the file like the known > working > files. > > When I try to do a UVFIXFILE... an error indicating file truncation results. > > I am now trying ASCII encoding. > > I was able to get something like this to work in the past. > > Suggestions would be appreciated. > > --Bill > ___ > U2-Users mailing list > U2-Users@listserver.u2ug.org > http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
Is it a dynamic file or a static hashed file? On Wed, Jun 20, 2012 at 6:08 PM, Wjhonson wrote: > > How about > Create a new ACCOUNT > Restore the file to this new account > Q point at it, from the account in which you really want to use it > > > > > > > > > -Original Message- > From: Bill Brutzman > To: U2 Users List > Sent: Wed, Jun 20, 2012 2:55 pm > Subject: [U2] UV Unix File Recovery > > > I am having trouble trying to restore a year-end file to a new file name. > The file is saved to my Windows7 PC... The UniVerse host is running on > hp-ux. > I tried to FileZilla FTP the file back using binary enconding. > I tried to create a new file and dictionary from the UV command prompt and > then > opy the file and dictionary over. > I tried creating a new file in UniVerse and sizing the file like the known > orking files. > When I try to do a UVFIXFILE... an error indicating file truncation > results. > I am now trying ASCII encoding. > I was able to get something like this to work in the past. > Suggestions would be appreciated. > --Bill > __ > 2-Users mailing list > 2-us...@listserver.u2ug.org > ttp://listserver.u2ug.org/mailman/listinfo/u2-users > > ___ > U2-Users mailing list > U2-Users@listserver.u2ug.org > http://listserver.u2ug.org/mailman/listinfo/u2-users > -- John Thompson ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
On 20/06/12 22:28, Bill Brutzman wrote: > I am having trouble trying to restore a year-end file to a new file name. > > The file is saved to my Windows7 PC... The UniVerse host is running on hp-ux. How did you save it to the PC? > > I tried to FileZilla FTP the file back using binary enconding. This could be your problem - if you didn't binary it to the PC, it could be corrupt on the PC - in which case you're in trouble... > > I tried to create a new file and dictionary from the UV command prompt and > then copy the file and dictionary over. > > I tried creating a new file in UniVerse and sizing the file like the known > working files. > UV doesn't care about that sort of thing - it should "just work" > When I try to do a UVFIXFILE... an error indicating file truncation results. And this doesn't sound healthy at all. > > I am now trying ASCII encoding. > > I was able to get something like this to work in the past. > > Suggestions would be appreciated. > Have you got a backup from the hp box? Do you have the year-end file still sitting somewhere on the hp box? Disk is cheap nowadays. If you're worried about expensive hp disks, just get a cheap pc, stuff a couple of terabyte disks in it, and run linux on it. Back up the hp box over the network with rsync or something cleverer that'll do incremental snapshots. Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV Unix File Recovery
How about Create a new ACCOUNT Restore the file to this new account Q point at it, from the account in which you really want to use it -Original Message- From: Bill Brutzman To: U2 Users List Sent: Wed, Jun 20, 2012 2:55 pm Subject: [U2] UV Unix File Recovery I am having trouble trying to restore a year-end file to a new file name. The file is saved to my Windows7 PC... The UniVerse host is running on hp-ux. I tried to FileZilla FTP the file back using binary enconding. I tried to create a new file and dictionary from the UV command prompt and then opy the file and dictionary over. I tried creating a new file in UniVerse and sizing the file like the known orking files. When I try to do a UVFIXFILE... an error indicating file truncation results. I am now trying ASCII encoding. I was able to get something like this to work in the past. Suggestions would be appreciated. --Bill __ 2-Users mailing list 2-us...@listserver.u2ug.org ttp://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
[U2] UV Unix File Recovery
I am having trouble trying to restore a year-end file to a new file name. The file is saved to my Windows7 PC... The UniVerse host is running on hp-ux. I tried to FileZilla FTP the file back using binary enconding. I tried to create a new file and dictionary from the UV command prompt and then copy the file and dictionary over. I tried creating a new file in UniVerse and sizing the file like the known working files. When I try to do a UVFIXFILE... an error indicating file truncation results. I am now trying ASCII encoding. I was able to get something like this to work in the past. Suggestions would be appreciated. --Bill ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
