Re: backup via an intermediate drive
On 12 Feb 2008, at 00:01, Matt McCutchen wrote: On Mon, 2008-02-11 at 23:58 +, Cavan Fyans wrote: Thanks for the quick help guys! The external backup server will be online, just not with a large enough connection to realistically backup via the connection, hence the transportation system! Since it will be online then presumably i can use the write-batch option as the in house server will be able to see the backup server to decide what needs transferring, and then just do the transporting of the batch on the intermediate drive? Yes, that should work well. Matt Great, thanks for all the help! One other problem now, one of the studio servers is an XServe and therefore running off an OS x machine. It has an older version of RSync installed on it (2.6.3) which does not have the 'only-write-batch' option - I presume this was just added in the newer versions and its not something that is excluded in the build for the OS x system? I tried updating to the latest RSync version (2.6.9) on this machine but after installing (./ configure, make, make install) it has clearly not replaced the previous version of Rsync. Am I missing something blindingly obvious here that i need to do to update the RSync version on the OS x machine? Thanks. Cav. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: backup via an intermediate drive
On Tue, 2008-02-12 at 17:57 +, Cavan Fyans wrote: One other problem now, one of the studio servers is an XServe and therefore running off an OS x machine. It has an older version of RSync installed on it (2.6.3) which does not have the 'only-write-batch' option - I presume this was just added in the newer versions and its not something that is excluded in the build for the OS x system? Correct. According to OLDNEWS, --only-write-batch was added in rsync 2.6.5. I tried updating to the latest RSync version (2.6.9) on this machine but after installing (./ configure, make, make install) it has clearly not replaced the previous version of Rsync. Am I missing something blindingly obvious here that i need to do to update the RSync version on the OS x machine? The source package's make install puts the executable at /usr/local/bin/rsync by default; it won't replace any rsync executables you might have elsewhere on the machine. If the wrong version of rsync is being invoked, try using the full path /usr/local/bin/rsync . Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
backup via an intermediate drive
Hi, I have a backup server running for a media company i work with that's being moved offsite to a server house. Obviously I still want to run the regular backups but the problem is that the outgoing connection from the companies studio can not handle the amount of data that needs to be transferred. Due to this the server housing company has provided a service through which they will transport the data to be backed up in person, on a mobile drive. The question is, can I run the same Rsync service but transfer the updated/changed files from the studio onto the backup server via the intermediate drive? Thanks. Cav. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: backup via an intermediate drive
On 11.02.2008 21:43, Cavan Fyans wrote: Hi, I have a backup server running for a media company i work with that's being moved offsite to a server house. Obviously I still want to run the regular backups but the problem is that the outgoing connection from the companies studio can not handle the amount of data that needs to be transferred. Due to this the server housing company has provided a service through which they will transport the data to be backed up in person, on a mobile drive. The question is, can I run the same Rsync service but transfer the updated/changed files from the studio onto the backup server via the intermediate drive? I guess the capacity of the transport drive is way lower than the whole storage needed? Then the option is: --write-batch But as far as i understand it, you need a second (in this case local) rsync-target that MUST be in sync with the remote server, before doing the batch, so you can create the batch-file against it. Then you transport the batch-file and last but not least apply it to the target server. Then comes the next day and you are back at square 1. :-) But if you can tell more about the data and how it changes, there maybe better(tm) ways to transfer them, especially when you have a disaster sync event. Bis denn -- Real Programmers consider what you see is what you get to be just as bad a concept in Text Editors as it is in women. No, the Real Programmer wants a you asked for it, you got it text editor -- complicated, cryptic, powerful, unforgiving, dangerous. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: backup via an intermediate drive
On 12.02.2008 00:03, Matthias Schniedermeyer wrote: On 11.02.2008 21:43, Cavan Fyans wrote: Hi, I have a backup server running for a media company i work with that's being moved offsite to a server house. Obviously I still want to run the regular backups but the problem is that the outgoing connection from the companies studio can not handle the amount of data that needs to be transferred. Due to this the server housing company has provided a service through which they will transport the data to be backed up in person, on a mobile drive. The question is, can I run the same Rsync service but transfer the updated/changed files from the studio onto the backup server via the intermediate drive? I guess the capacity of the transport drive is way lower than the whole storage needed? Then the option is: --write-batch But as far as i understand it, you need a second (in this case local) Strike the second, reading the next line of the man-page reveals the --only-write-batch-option. :-) Bis denn -- Real Programmers consider what you see is what you get to be just as bad a concept in Text Editors as it is in women. No, the Real Programmer wants a you asked for it, you got it text editor -- complicated, cryptic, powerful, unforgiving, dangerous. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: backup via an intermediate drive
On 11 Feb 2008, at 23:51, Matt McCutchen wrote: On Tue, 2008-02-12 at 00:14 +0100, Matthias Schniedermeyer wrote: On 12.02.2008 00:03, Matthias Schniedermeyer wrote: I guess the capacity of the transport drive is way lower than the whole storage needed? Then the option is: --write-batch But as far as i understand it, you need a second (in this case local) Strike the second, reading the next line of the man-page reveals the --only-write-batch-option. :-) Using --only-write-batch instead of --write-batch does not remove the need for a local copy of the backup server's contents that rsync can use to determine what data to include in the batch file. Thanks for the quick help guys! The external backup server will be online, just not with a large enough connection to realistically backup via the connection, hence the transportation system! Since it will be online then presumably i can use the write-batch option as the in house server will be able to see the backup server to decide what needs transferring, and then just do the transporting of the batch on the intermediate drive? Cav -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: backup via an intermediate drive
On Tue, 2008-02-12 at 00:14 +0100, Matthias Schniedermeyer wrote: On 12.02.2008 00:03, Matthias Schniedermeyer wrote: I guess the capacity of the transport drive is way lower than the whole storage needed? Then the option is: --write-batch But as far as i understand it, you need a second (in this case local) Strike the second, reading the next line of the man-page reveals the --only-write-batch-option. :-) Using --only-write-batch instead of --write-batch does not remove the need for a local copy of the backup server's contents that rsync can use to determine what data to include in the batch file. Cavan, if you don't like having the extra copy, you might be better served by GNU tar's incremental archives (--listed-incremental, see `info tar` for more information). Tar maintains a state file on the source machine to remember what changes have been put into incremental archives. Each time you ask tar to make an incremental archive, it will look at the state file to see what changes to include and then update the state file. If you transport the incremental archives to the backup server and extract them there in order, you will maintain a copy of the source directory. (I'm recommending GNU tar's state-based incremental mode because it is ready-to-use now. It would be possible to add a similar state-based incremental mode to rsync (or perhaps Unison), but AFAIK no one has done it. If you like, you could script your own incremental mode around rsync using --files-from.) Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: backup via an intermediate drive
On Mon, 2008-02-11 at 23:58 +, Cavan Fyans wrote: Thanks for the quick help guys! The external backup server will be online, just not with a large enough connection to realistically backup via the connection, hence the transportation system! Since it will be online then presumably i can use the write-batch option as the in house server will be able to see the backup server to decide what needs transferring, and then just do the transporting of the batch on the intermediate drive? Yes, that should work well. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
