Re: Recommendations for an OpenBSD-based Backup Solution
The last time I looks there was no Firewire or Firewire disk support in the Kernel. Expect that if it is done at some stage that it is done correctly, you won't get Disk support without Firewire being supported as a bus type (no quick hacks here). -Andy -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Dag Wastberg Sent: 13 June 2006 18:48 To: Donald J. Ankney; misc@openbsd.org Subject: Re: Recommendations for an OpenBSD-based Backup Solution On 3/20/06, Donald J. Ankney <[EMAIL PROTECTED]> wrote: > I threw together a Perl script that uses tar and external firewire > drives. Tar has flags that will let it backup over SMB (for the windows > boxes) and one can always do use scp (via certificates) piped through > tar for remote linux/BSD boxes. I've been using this solution across > several platforms (all servers) for a year now, and it has worked well. Does firewire work under OpenBSD? According to http://www.openbsd.org/i386.html firewire is unsupported. What is the state of firewire support (for external discs)? I have an upcoming install for which I've written off OpenBSD due to this, and I'd very much like to be able to use it. Dag
Re: Recommendations for an OpenBSD-based Backup Solution
On 3/20/06, Donald J. Ankney <[EMAIL PROTECTED]> wrote: I threw together a Perl script that uses tar and external firewire drives. Tar has flags that will let it backup over SMB (for the windows boxes) and one can always do use scp (via certificates) piped through tar for remote linux/BSD boxes. I've been using this solution across several platforms (all servers) for a year now, and it has worked well. Does firewire work under OpenBSD? According to http://www.openbsd.org/i386.html firewire is unsupported. What is the state of firewire support (for external discs)? I have an upcoming install for which I've written off OpenBSD due to this, and I'd very much like to be able to use it. Dag
Re: Recommendations for an OpenBSD-based Backup Solution
2006/3/21, Peter <[EMAIL PROTECTED]>: --- "Donald J. Ankney" <[EMAIL PROTECTED]> wrote: > I threw together a Perl script that uses tar and external firewire > drives. Tar has flags that will let it backup over SMB (for the > windows > boxes) and one can always do use scp (via certificates) piped through > > tar for remote linux/BSD boxes. I've been using this solution across > several platforms (all servers) for a year now, and it has worked > well. > > > Obi Okeke wrote: > > An appeal to the Gods of OpenBSD! Let me write up > > front that I am most grateful for all that the OpenBSD > > project has done. > > > > Some friends of mine need a backup solution that can > > easily handle regular, automated backups from some M$ > > Win 2k and Linux workstations as well as an OpenBSD > > 3.8 based Samba file server that I had set up for them > > a while ago. > > > > I've used FreeBSD 5x running Bacula at another site, > > but I am looking for an all OpenBSD solution so I > > don't have to install another box running > > FreeBSD/Bacula on their site since they already have 2 > > OBSD boxes up and running (perfectly thanks to OBSD) - > > one for firewall/router/nat/squid and one for the > > Samba fileserver. I would like to add the backup > > solution to the file server box since its not heavily > > loaded at all. Any recommendations would be greatly > > appreciated. Thanks in advance. > > Tired of spam? Yahoo! Mail has the best spam protection around > > http://mail.yahoo.com > > I am using rsync. It also works well. I wrote small scripts (windows side) for users to back up at their discretion. Since they are actually synchronizing it doesn't take long at all (akin to saving work in Word or whatever whenever you want). Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com I regularly use rsnapshot instead of "raw" rsync and it just works : http://www.rsnapshot.org/ Best regards, Bruno.
Re: Recommendations for an OpenBSD-based Backup Solution
On 5/10/06, Siju George <[EMAIL PROTECTED]> wrote: On 3/21/06, Andreas Vvgele <[EMAIL PROTECTED]> wrote: > > I'm working on a BackupPC port. Actually, the port only lacks a > README.OpenBSD to get people going. I'll polish the port at the weekand > and then I'll post it to [EMAIL PROTECTED] > Thankyou so much for the port Andreas :-) I am trying to get BackupPC installed on OpenBSD 3.9 in CGI-BINARY mode. I see this in the BackupPC documentation. - To see if your perl has setuid emulation, see if there is a program called sperl5.6.0 (or sperl5.8.2 etc, based on your perl version) in the place where perl is installed. If you can't find this program, then you have two options: rebuild and reinstall perl with the setuid emulation turned on (answer ``y'' to the question ``Do you want to do setuid/setgid emulation?'' when you run perl's configure script), or switch to the mod_perl alternative for the CGI script (which doesn't need setuid to work). - I don't find "sperl" on My OpenBSD 3.9 How do I get this functionality on OpenBSD You follow the directions given in the block of text you gave. Or you don't use BackupPC. It's a linux & windows specific thing. Intuitively, this sets off warning bells because 1) they probably have a linux-mentality 2) they don't care about making the code good enough to work on any unix. Or switch to mod_perl. -Nick
Re: Recommendations for an OpenBSD-based Backup Solution
On 3/21/06, Andreas Vvgele <[EMAIL PROTECTED]> wrote: I'm working on a BackupPC port. Actually, the port only lacks a README.OpenBSD to get people going. I'll polish the port at the weekand and then I'll post it to [EMAIL PROTECTED] Thankyou so much for the port Andreas :-) I am trying to get BackupPC installed on OpenBSD 3.9 in CGI-BINARY mode. I see this in the BackupPC documentation. - To see if your perl has setuid emulation, see if there is a program called sperl5.6.0 (or sperl5.8.2 etc, based on your perl version) in the place where perl is installed. If you can't find this program, then you have two options: rebuild and reinstall perl with the setuid emulation turned on (answer ``y'' to the question ``Do you want to do setuid/setgid emulation?'' when you run perl's configure script), or switch to the mod_perl alternative for the CGI script (which doesn't need setuid to work). - I don't find "sperl" on My OpenBSD 3.9 How do I get this functionality on OpenBSD Kind Regards Siju
Re: Recommendations for an OpenBSD-based Backup Solution
--- "L. V. Lammert" <[EMAIL PROTECTED]> wrote: > At 12:53 AM 3/21/2006 -0500, Peter wrote: > > >I am using rsync. It also works well. I wrote small scripts > (windows > >side) for users to back up at their discretion. > > Quick question - I have tried Cygwin rsync on more than one occasion > for > such an application, .. and it refuses to talk to the OBSD version. > Which > version(s) you were using? I am using cwrsync (very light) on the windows clients and the rsync port for FreeBSD 5.4 and 6.0. I don't see why it would not work with OpenBSD. Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com
Re: Recommendations for an OpenBSD-based Backup Solution
If you didn't already, try running rsync as a *server* on the Windows side (if you want SSH, forward the ports). There's a cygwin bug that bites rsync in some circumstances (when network buffers fill, iirc). rather than setting a standalone rsyn server listening to a port, you can try a minamilist approach have rsync installed w/ cygwin on windows, use ssh to run rsync on openbsd box, I know it works with openbsd 3.8 port of rsync. In your bat file on windoze you can use the -e option of rsync to call ssh, and the -i option of ssh to select the identity key NOTE the key has to be owned by the cygwin user and not group or other, for ssh security reasons, that is the typical gotcha. (its not uncommon on windows for the login name to actually be something different like default in the passwd file on windows cygwin) then you can use zip, dump or tar or other to backup the mirror or rather rsync file system. maybe doing a full backup weekly or monthly and using find to backup file changed daily... some notes here also: http://optics.ph.unimelb.edu.au/help/rsync/rsync_pc1.html
Re: Recommendations for an OpenBSD-based Backup Solution
Stuart Henderson wrote: On 2006/03/20 18:20, Chris Cappuccio wrote: Check out Box Backup, it has win2k and linux clients Failing that, "Karen's Replicator" and a Samba server seem to work for windoze clients BackupPC(.sf.net) is another option. I'm working on a BackupPC port. Actually, the port only lacks a README.OpenBSD to get people going. I'll polish the port at the weekand and then I'll post it to [EMAIL PROTECTED]
Re: Recommendations for an OpenBSD-based Backup Solution
At 05:22 PM 3/21/2006 +, Stuart Henderson wrote: If you didn't already, try running rsync as a *server* on the Windows side (if you want SSH, forward the ports). There's a cygwin bug that bites rsync in some circumstances (when network buffers fill, iirc). I thought the Cygwin DLLs were rquired to run rsync on Windows, .. Which version were you running successfully? Thanks! Lee
Re: Recommendations for an OpenBSD-based Backup Solution
On 2006/03/21 11:11, L. V. Lammert wrote: > At 12:53 AM 3/21/2006 -0500, Peter wrote: > > >I am using rsync. It also works well. I wrote small scripts (windows > >side) for users to back up at their discretion. > > Quick question - I have tried Cygwin rsync on more than one occasion for > such an application, .. and it refuses to talk to the OBSD version. Which > version(s) you were using? If you didn't already, try running rsync as a *server* on the Windows side (if you want SSH, forward the ports). There's a cygwin bug that bites rsync in some circumstances (when network buffers fill, iirc).
Re: Recommendations for an OpenBSD-based Backup Solution
At 12:53 AM 3/21/2006 -0500, Peter wrote: I am using rsync. It also works well. I wrote small scripts (windows side) for users to back up at their discretion. Quick question - I have tried Cygwin rsync on more than one occasion for such an application, .. and it refuses to talk to the OBSD version. Which version(s) you were using? Lee
Re: Recommendations for an OpenBSD-based Backup Solution
> Some friends of mine need a backup solution that can
> easily handle regular, automated backups from some M$
> Win 2k and Linux workstations as well as an OpenBSD
> 3.8 based Samba file server that I had set up for them
> a while ago.
I'm a little late to this party, and I apologise if
what I say here has been said already, or ruled out
already.
One of the biggest nuisances with backing up Windows
is that if you just naively walk the file structure
tree, you'll hit files that cause errors that are
very hard to trap. Some programs such as Karen's
Replicator actually manage to do this but they're in
the minority.
What I discovered earlier this year is that Windows
does in fact have a way of referring to the raw disk
by name (similar to "/dev/hdc1" on unix for example),
which makes it much easier to do a full-disk backup
while a system is running. Raw C parition would
be \\.\C: for example, and I think the entire drive,
partions, boot blocks and all (eg like /dev/hdc)
is something like \\.\PhysicalDrive0: (however
I haven't tried that one, only the \\.\C: variant
- see here:
http://www.utexas.edu/its/unix/reference/oracledocs/v92/B10501_01/win.920/a95491/ap_raw.htm
for confirmation)
These names are not usable by all utilities, but
anything in C that does fopen ought to be able
to access them.
Here's a simple program you can use to backup an
entire partition assuming no bad blocks. It exits
on the first data error which if your disk is good
denotes the end of the partition. Better handling
of bad blocks is possible, but I didn't need it.
(If I get any, then its time to restore from backup
to a new drive, not time to backup more disk errors!)
Hope this helps. You might be able to build on
this technique to do something like an scp directly
to a unix (though be careful with the scp protocol
that you handle >2Gb files properly)
Obviously when you restore the partition, you'll
need to do a windows-style fsck when you reboot as
it will be the equivalent of a crashed machine,
possibly quite an inconsistent one depending on
what was writing to disk during the backup. This
is why people pay big bucks for professional
backup software.
regards
Graham
#include
#include
#include
#include
int main(int argc, char **argv) {
FILE *input, *output;
long long bytes = 0LL;
int c;
if (argc != 3) {
fprintf(stderr, "syntax: cp64 .\\C: D:\\backup.img\n");
exit(1);
}
input = fopen(argv[1], "rb");
if (input == NULL) {
fprintf(stderr, "cp64: cannot open input file %s - %s\n", argv[1],
strerror(errno));
exit(2);
}
output = fopen(argv[2], "wb");
if (output == NULL) {
fprintf(stderr, "cp64: cannot open output file %s - %s\n", argv[2],
strerror(errno));
exit(3);
}
for (;;) {
c = fgetc(input);
if (c == EOF) break;
if (ferror(input)) {
fprintf(stderr, "Could not read from input (at %lld bytes) - %s\n",
bytes, strerror(errno));
exit(4);
}
fputc(c, output);
if (ferror(output)) {
fprintf(stderr, "Could not write to output (at %lld bytes) - %s\n",
bytes, strerror(errno));
exit(5);
}
bytes += 1LL;
#ifdef TEST
if (bytes == 256LL) {
fprintf(stderr, "Not implemented - only first 256 bytes saved.\n");
exit(6);
}
#endif
}
fprintf(stderr, "%lld bytes transferred\n", bytes);
exit(0);
}
Re: Recommendations for an OpenBSD-based Backup Solution
On 2006/03/20 18:20, Chris Cappuccio wrote: > Check out Box Backup, it has win2k and linux clients > > Failing that, "Karen's Replicator" and a Samba server seem to work for > windoze clients BackupPC(.sf.net) is another option.
Re: Recommendations for an OpenBSD-based Backup Solution
On Mon, Mar 20, 2006 at 07:32:22PM -0500, Tim Donahue wrote: > On Monday 20 March 2006 18:36, Joachim Schipper wrote: > > On Mon, Mar 20, 2006 at 10:37:42AM -0800, Donald J. Ankney wrote: > > > I threw together a Perl script that uses tar and external firewire > > > drives. Tar has flags that will let it backup over SMB (for the windows > > > boxes) and one can always do use scp (via certificates) piped through > > > tar for remote linux/BSD boxes. I've been using this solution across > > > several platforms (all servers) for a year now, and it has worked well. > > > > Amavisd has a very good algorithm for balancing backups. It is, sadly, > > otherwise a bit of a pain to get going. > > > > That said, it's very solid, and can even print pretty reports. > > > > Joachim > > > > Which amavisd are you refering to, do you have a link to the website for us? > The 2 amavisd's that I could find on google (amavisd and amavisd-new) are > both email filtering programs and don't have anything to do with backups for > servers (though amavisd-new does run quite happily on backup MX servers). As Rogier pointed out, I meant misc/amanda. Oopsie... better shut up when I've been active for more than, say, 15 hours. Joachim
Re: Recommendations for an OpenBSD-based Backup Solution
--- "Donald J. Ankney" <[EMAIL PROTECTED]> wrote: > I threw together a Perl script that uses tar and external firewire > drives. Tar has flags that will let it backup over SMB (for the > windows > boxes) and one can always do use scp (via certificates) piped through > > tar for remote linux/BSD boxes. I've been using this solution across > several platforms (all servers) for a year now, and it has worked > well. > > > Obi Okeke wrote: > > An appeal to the Gods of OpenBSD! Let me write up > > front that I am most grateful for all that the OpenBSD > > project has done. > > > > Some friends of mine need a backup solution that can > > easily handle regular, automated backups from some M$ > > Win 2k and Linux workstations as well as an OpenBSD > > 3.8 based Samba file server that I had set up for them > > a while ago. > > > > I've used FreeBSD 5x running Bacula at another site, > > but I am looking for an all OpenBSD solution so I > > don't have to install another box running > > FreeBSD/Bacula on their site since they already have 2 > > OBSD boxes up and running (perfectly thanks to OBSD) - > > one for firewall/router/nat/squid and one for the > > Samba fileserver. I would like to add the backup > > solution to the file server box since its not heavily > > loaded at all. Any recommendations would be greatly > > appreciated. Thanks in advance. > > Tired of spam? Yahoo! Mail has the best spam protection around > > http://mail.yahoo.com > > I am using rsync. It also works well. I wrote small scripts (windows side) for users to back up at their discretion. Since they are actually synchronizing it doesn't take long at all (akin to saving work in Word or whatever whenever you want). Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com
Re: Recommendations for an OpenBSD-based Backup Solution
Check out bacula (www.bacula.org). The list OpenBSD as a client... but I can't see why it wouldn't work as a server as well... (although I personally haven't tried). -- Curt On Mon, 2006-03-20 at 21:20, Chris Cappuccio wrote: > Check out Box Backup, it has win2k and linux clients > > Failing that, "Karen's Replicator" and a Samba server seem to work for > windoze clients > > Obi Okeke [EMAIL PROTECTED] wrote: > > An appeal to the Gods of OpenBSD! Let me write up > > front that I am most grateful for all that the OpenBSD > > project has done. > > > > Some friends of mine need a backup solution that can > > easily handle regular, automated backups from some M$ > > Win 2k and Linux workstations as well as an OpenBSD > > 3.8 based Samba file server that I had set up for them > > a while ago. > > > > I've used FreeBSD 5x running Bacula at another site, > > but I am looking for an all OpenBSD solution so I > > don't have to install another box running > > FreeBSD/Bacula on their site since they already have 2 > > OBSD boxes up and running (perfectly thanks to OBSD) - > > one for firewall/router/nat/squid and one for the > > Samba fileserver. I would like to add the backup > > solution to the file server box since its not heavily > > loaded at all. Any recommendations would be greatly > > appreciated. Thanks in advance. > > Tired of spam? Yahoo! Mail has the best spam protection around > > http://mail.yahoo.com
Re: Recommendations for an OpenBSD-based Backup Solution
Check out Box Backup, it has win2k and linux clients Failing that, "Karen's Replicator" and a Samba server seem to work for windoze clients Obi Okeke [EMAIL PROTECTED] wrote: > An appeal to the Gods of OpenBSD! Let me write up > front that I am most grateful for all that the OpenBSD > project has done. > > Some friends of mine need a backup solution that can > easily handle regular, automated backups from some M$ > Win 2k and Linux workstations as well as an OpenBSD > 3.8 based Samba file server that I had set up for them > a while ago. > > I've used FreeBSD 5x running Bacula at another site, > but I am looking for an all OpenBSD solution so I > don't have to install another box running > FreeBSD/Bacula on their site since they already have 2 > OBSD boxes up and running (perfectly thanks to OBSD) - > one for firewall/router/nat/squid and one for the > Samba fileserver. I would like to add the backup > solution to the file server box since its not heavily > loaded at all. Any recommendations would be greatly > appreciated. Thanks in advance. > Tired of spam? Yahoo! Mail has the best spam protection around > http://mail.yahoo.com -- "The map is not the territory; the word is not the thing defined."
Re: Recommendations for an OpenBSD-based Backup Solution
On 3/21/06, Joachim Schipper <[EMAIL PROTECTED]> wrote: > Amavisd has a very good algorithm for balancing backups. It is, sadly, > otherwise a bit of a pain to get going. I suspect you mean amanda (misc/amanda in ports). Cheers, Rogier -- If you don't know where you're going, any road will get you there.
Re: Recommendations for an OpenBSD-based Backup Solution
On Monday 20 March 2006 18:36, Joachim Schipper wrote: > On Mon, Mar 20, 2006 at 10:37:42AM -0800, Donald J. Ankney wrote: > > I threw together a Perl script that uses tar and external firewire > > drives. Tar has flags that will let it backup over SMB (for the windows > > boxes) and one can always do use scp (via certificates) piped through > > tar for remote linux/BSD boxes. I've been using this solution across > > several platforms (all servers) for a year now, and it has worked well. > > Amavisd has a very good algorithm for balancing backups. It is, sadly, > otherwise a bit of a pain to get going. > > That said, it's very solid, and can even print pretty reports. > > Joachim > Which amavisd are you refering to, do you have a link to the website for us? The 2 amavisd's that I could find on google (amavisd and amavisd-new) are both email filtering programs and don't have anything to do with backups for servers (though amavisd-new does run quite happily on backup MX servers). Tim Donahue
Re: Recommendations for an OpenBSD-based Backup Solution
On Mon, Mar 20, 2006 at 10:37:42AM -0800, Donald J. Ankney wrote: > I threw together a Perl script that uses tar and external firewire > drives. Tar has flags that will let it backup over SMB (for the windows > boxes) and one can always do use scp (via certificates) piped through > tar for remote linux/BSD boxes. I've been using this solution across > several platforms (all servers) for a year now, and it has worked well. Amavisd has a very good algorithm for balancing backups. It is, sadly, otherwise a bit of a pain to get going. That said, it's very solid, and can even print pretty reports. Joachim > Obi Okeke wrote: > >An appeal to the Gods of OpenBSD! Let me write up > >front that I am most grateful for all that the OpenBSD > >project has done. > > > >Some friends of mine need a backup solution that can > >easily handle regular, automated backups from some M$ > >Win 2k and Linux workstations as well as an OpenBSD > >3.8 based Samba file server that I had set up for them > >a while ago. > > > >I've used FreeBSD 5x running Bacula at another site, > >but I am looking for an all OpenBSD solution so I > >don't have to install another box running > >FreeBSD/Bacula on their site since they already have 2 > >OBSD boxes up and running (perfectly thanks to OBSD) - > >one for firewall/router/nat/squid and one for the > >Samba fileserver. I would like to add the backup > >solution to the file server box since its not heavily > >loaded at all. Any recommendations would be greatly > >appreciated. Thanks in advance. > >Tired of spam? Yahoo! Mail has the best spam protection around > >http://mail.yahoo.com
Re: Recommendations for an OpenBSD-based Backup Solution
I threw together a Perl script that uses tar and external firewire drives. Tar has flags that will let it backup over SMB (for the windows boxes) and one can always do use scp (via certificates) piped through tar for remote linux/BSD boxes. I've been using this solution across several platforms (all servers) for a year now, and it has worked well. Obi Okeke wrote: An appeal to the Gods of OpenBSD! Let me write up front that I am most grateful for all that the OpenBSD project has done. Some friends of mine need a backup solution that can easily handle regular, automated backups from some M$ Win 2k and Linux workstations as well as an OpenBSD 3.8 based Samba file server that I had set up for them a while ago. I've used FreeBSD 5x running Bacula at another site, but I am looking for an all OpenBSD solution so I don't have to install another box running FreeBSD/Bacula on their site since they already have 2 OBSD boxes up and running (perfectly thanks to OBSD) - one for firewall/router/nat/squid and one for the Samba fileserver. I would like to add the backup solution to the file server box since its not heavily loaded at all. Any recommendations would be greatly appreciated. Thanks in advance. Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com
