Re: Backup and FreeBSD/ZFS
On 4 February 2010 18:14, Svein Skogen (Listmail Account) svein-listm...@stillbilde.net wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 04.02.2010 17:57, Matthew Seaman wrote: On 04/02/2010 15:35, Svein Skogen (Listmail Account) wrote: On a monthly rotation the tapes are placed in a firetolerant safe. Since the most critical thing here is the terabyte (and growing!) of original photographs, I'm not thinking about just day-to-day diskfailure or pebcaks (proper raid and snapshotting handles that rather well). However snapshotting and raid solutions handles the house being on fire rather poorly, or should we say Data integrity and fires, get along like a house on fire? ;) fire tolerant? That doesn't sound amazingly effective to me. Would it stand up to temperatures in excess of 600degC for more than about 20 minutes? That's going to be fairly typical in a house fire... Well, this one is the kind placed within the concrete of our cellar (this is a home solution, not an industry one). But that area isn't suitable for the servers for other reasons. The cellar is within the bedrock of the area (the house foundation is directly on bedrock, and the cellar area has been blasted out from the bedrock), so discounting the plane-crash-into-building scenario, it's rather safe for our use (and the plane-crash scenario would quite likely invalidate me along with the backup, and so the need for a restore wouldn't be that critical) A safe like that is a good idea for local storage of backup media while it waits to go into the tape library or off-site. It's a bad idea for storing your entire archive. *snip* Tape libraries are horribly expensive since they're not mass market items. They are also intrinsically prone to breaking down or failing to work quite as well as the salesman implied. They're the only viable solution when your storage volumes get really huge, but what is considered huge nowadays is rather more than terabyte scale. If you can get away with just a single tape drive you'll save yourself a lot of money. Alas, a full backup of the current disk setup takes 4 tapes and ... I really don't feel like staying up one entire night per week to swap tapes (both for the backup and the verify). The autoloader I've got now (8 slot, 1 drive, LTO-3, SAS) works fairly well with the currently installed OS (Windows Storage Server 2008), giving about 60MB/Sec sustained transfer rate. LTO4 tapes are rated at 800--1600GB depending on achievable compression, so they might be big enough on their own. As image formats are already internally compressed, I'd expect them to come in at the low end of that, which might be tight. Worth trying out if you can get a drive on evaluation. A standalone LTO-4 might be a good alternative, if I didn't already have the tapeloader. ;) You might want to evaluate getting a bunch of 1TB (or larger) hard dives -- either USB or hot-swap SATA. They don't need to perform particularly well, but they'd have to be rated for a lot of spin-up/spin-down cycles (so something aimed at the mobile PC market). One other thing you should seriously consider is on-line backup. There are quite a lot of providers out there, and they should be at least competitive with running your own dedicated backup system. They also generally have the advantage of being instantly available if you need to recover anything in a hurry. Online-backup-solutions are a no-go for me, alas. Someone told me that Amanda should handle this, and I'm looking into it now (especially reading up on what I'd need to do to handle disaster recovery), but other options are welcome as well, including the option of going Solaris (if someone can point me to proper documentation on how to get Solaris to do what I want). Also checkout Bacula. I've found Bacula quite a lot easier to manage than Amanda, especially with tape libraries. The box itself is a C2D E7500 with 8GB ram, Asus P5Q Premium (the deluxe version with fewer NICs is on the BigAdmin HCL, basically an intel P45 chipset with sufficient number of pci-express slots, and four Marvell Yukon gigabit nics with Marvell Alaska PHY), backed by LSI SAS-MPT for the autoloader and SAS-MFI for the disks, and will handle SMB/CIFS, NFS, and iSCSI services (and the backups of that data). Nothing fancy here, meaning it should hardwarewise be no biggie to get it up and running in FreeBSD, Solaris (or leave it on Windows Storage server if that's the best solution, even if that means the iSCSI-target-service has ... less than stellar performance). So, I'm basically looking for pointers on what solutions to consider, not looking for a pre-cooked solution. I have sufficient external diskspace (still with redundancy) to handle the move-to-new-os-and-fs issue... Thanks again for taking the time to help me out here. ;) Hard to know what
Re: Backup and FreeBSD/ZFS
On 3 February 2010 19:21, Svein Skogen (Listmail Account) svein-listm...@stillbilde.net wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 03.02.2010 19:14, LoH wrote: If my memory serves, you're looking at something similar to taking a snapshot and then sending it to the tape device, so zfs send snapshot | (tape device access). This, IIRC, is functionally identical to dump/restore. Except for one smallish detail. Dump handles tape is full, switch to next one in a relatively painless way... Let's just say that ... there's a reason I've invested in an autoloader for my home server (it will, among other things, hold about a terabyte of Nikon .NEF files if that means anything) //Svein - -- - +---+--- /\ |Svein Skogen | sv...@d80.iso100.no \ / |Solberg Østli 9| PGP Key: 0xE5E76831 X|2020 Skedsmokorset | sv...@jernhuset.no / \ |Norway | PGP Key: 0xCE96CE13 | | sv...@stillbilde.net ascii | | PGP Key: 0x58CD33B6 ribbon |System Admin | svein-listm...@stillbilde.net Campaign|stillbilde.net | PGP Key: 0x22D494A4 +---+--- |msn messenger: | Mobile Phone: +47 907 03 575 |sv...@jernhuset.no | RIPE handle:SS16503-RIPE - +---+--- If you really are in a hurry, mail me at svein-mob...@stillbilde.net This mailbox goes directly to my cellphone and is checked even when I'm not in front of my computer. - Picture Gallery: https://gallery.stillbilde.net/v/svein/ - -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.12 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAktpzMgACgkQODUnwSLUlKRRfgCgulZAvQN61uE6HIcuvxzkU2yS HaAAmwcHY6YYqoTYlw/R/KeWuy/9ferH =zHrR -END PGP SIGNATURE- ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org If you combine snapshoting with a redundant array, and maybe a secondary pool that you zfs send your files ystems to (perhaps on a different box) its questionable whether having stuff on tape has any advantage. If you are taking the tapes off site it may be worth it. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Backup and FreeBSD/ZFS
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 04.02.2010 10:39, krad wrote: If you combine snapshoting with a redundant array, and maybe a secondary pool that you zfs send your files ystems to (perhaps on a different box) its questionable whether having stuff on tape has any advantage. If you are taking the tapes off site it may be worth it. On a monthly rotation the tapes are placed in a firetolerant safe. Since the most critical thing here is the terabyte (and growing!) of original photographs, I'm not thinking about just day-to-day diskfailure or pebcaks (proper raid and snapshotting handles that rather well). However snapshotting and raid solutions handles the house being on fire rather poorly, or should we say Data integrity and fires, get along like a house on fire? ;) And I think ... everyone on this list can agree that data not properly backed up, is a fancy way of saying data not yet lost. ;) This is why I'm willing to (and have already) cough up for such solutions as autoloaders for my home storage server, however my last wrestle with ZFS (on freebsd RELENG_7) left me rather less than enthusiastic about the backup options. Someone told me that Amanda should handle this, and I'm looking into it now (especially reading up on what I'd need to do to handle disaster recovery), but other options are welcome as well, including the option of going Solaris (if someone can point me to proper documentation on how to get Solaris to do what I want). The box itself is a C2D E7500 with 8GB ram, Asus P5Q Premium (the deluxe version with fewer NICs is on the BigAdmin HCL, basically an intel P45 chipset with sufficient number of pci-express slots, and four Marvell Yukon gigabit nics with Marvell Alaska PHY), backed by LSI SAS-MPT for the autoloader and SAS-MFI for the disks, and will handle SMB/CIFS, NFS, and iSCSI services (and the backups of that data). Nothing fancy here, meaning it should hardwarewise be no biggie to get it up and running in FreeBSD, Solaris (or leave it on Windows Storage server if that's the best solution, even if that means the iSCSI-target-service has ... less than stellar performance). So, I'm basically looking for pointers on what solutions to consider, not looking for a pre-cooked solution. I have sufficient external diskspace (still with redundancy) to handle the move-to-new-os-and-fs issue... Thanks again for taking the time to help me out here. ;) //Svein - -- - +---+--- /\ |Svein Skogen | sv...@d80.iso100.no \ / |Solberg Østli 9| PGP Key: 0xE5E76831 X|2020 Skedsmokorset | sv...@jernhuset.no / \ |Norway | PGP Key: 0xCE96CE13 | | sv...@stillbilde.net ascii | | PGP Key: 0x58CD33B6 ribbon |System Admin | svein-listm...@stillbilde.net Campaign|stillbilde.net | PGP Key: 0x22D494A4 +---+--- |msn messenger: | Mobile Phone: +47 907 03 575 |sv...@jernhuset.no | RIPE handle:SS16503-RIPE - +---+--- If you really are in a hurry, mail me at svein-mob...@stillbilde.net This mailbox goes directly to my cellphone and is checked even when I'm not in front of my computer. - Picture Gallery: https://gallery.stillbilde.net/v/svein/ - -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.12 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAktq6TwACgkQODUnwSLUlKQYzgCffVUn25D1CTJsg9SfVBCJNwvO xKkAn17MEHNQUdFTf7b19U3rTd/ASduU =2bla -END PGP SIGNATURE- ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Backup and FreeBSD/ZFS
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 04/02/2010 15:35, Svein Skogen (Listmail Account) wrote: On a monthly rotation the tapes are placed in a firetolerant safe. Since the most critical thing here is the terabyte (and growing!) of original photographs, I'm not thinking about just day-to-day diskfailure or pebcaks (proper raid and snapshotting handles that rather well). However snapshotting and raid solutions handles the house being on fire rather poorly, or should we say Data integrity and fires, get along like a house on fire? ;) fire tolerant? That doesn't sound amazingly effective to me. Would it stand up to temperatures in excess of 600degC for more than about 20 minutes? That's going to be fairly typical in a house fire... A safe like that is a good idea for local storage of backup media while it waits to go into the tape library or off-site. It's a bad idea for storing your entire archive. You really want your backups to be stored in an off-site location. Preferably by a company that has the right sort of secure archive facilities. 'Off-site' means 'sufficiently far away that any conceivable disaster can't affect them.' The gold standard for 'conceivable disasters' is a fully laden and fuelled plane crashing onto your premises. I did once have a setup where 'off site' was a storage company only a couple of streets over, but as their archive was in a former World War II Bunker some 100 feet underground, that was acceptable. Usually you'ld be looking at several miles away at minimum. And I think ... everyone on this list can agree that data not properly backed up, is a fancy way of saying data not yet lost. ;) This is why I'm willing to (and have already) cough up for such solutions as autoloaders for my home storage server, however my last wrestle with ZFS (on freebsd RELENG_7) left me rather less than enthusiastic about the backup options. Tape libraries are horribly expensive since they're not mass market items. They are also intrinsically prone to breaking down or failing to work quite as well as the salesman implied. They're the only viable solution when your storage volumes get really huge, but what is considered huge nowadays is rather more than terabyte scale. If you can get away with just a single tape drive you'll save yourself a lot of money. LTO4 tapes are rated at 800--1600GB depending on achievable compression, so they might be big enough on their own. As image formats are already internally compressed, I'd expect them to come in at the low end of that, which might be tight. Worth trying out if you can get a drive on evaluation. You might want to evaluate getting a bunch of 1TB (or larger) hard dives - -- either USB or hot-swap SATA. They don't need to perform particularly well, but they'd have to be rated for a lot of spin-up/spin-down cycles (so something aimed at the mobile PC market). One other thing you should seriously consider is on-line backup. There are quite a lot of providers out there, and they should be at least competitive with running your own dedicated backup system. They also generally have the advantage of being instantly available if you need to recover anything in a hurry. Someone told me that Amanda should handle this, and I'm looking into it now (especially reading up on what I'd need to do to handle disaster recovery), but other options are welcome as well, including the option of going Solaris (if someone can point me to proper documentation on how to get Solaris to do what I want). Also checkout Bacula. I've found Bacula quite a lot easier to manage than Amanda, especially with tape libraries. The box itself is a C2D E7500 with 8GB ram, Asus P5Q Premium (the deluxe version with fewer NICs is on the BigAdmin HCL, basically an intel P45 chipset with sufficient number of pci-express slots, and four Marvell Yukon gigabit nics with Marvell Alaska PHY), backed by LSI SAS-MPT for the autoloader and SAS-MFI for the disks, and will handle SMB/CIFS, NFS, and iSCSI services (and the backups of that data). Nothing fancy here, meaning it should hardwarewise be no biggie to get it up and running in FreeBSD, Solaris (or leave it on Windows Storage server if that's the best solution, even if that means the iSCSI-target-service has ... less than stellar performance). So, I'm basically looking for pointers on what solutions to consider, not looking for a pre-cooked solution. I have sufficient external diskspace (still with redundancy) to handle the move-to-new-os-and-fs issue... Thanks again for taking the time to help me out here. ;) Hard to know what to advise OS-wise. FreeBSD will do the job, although I'm not sure the iSCSI-target stuff is the best available. So will Solaris for that matter, although more likely to suffer from hardware incompatibilites. I really haven't got a clue about how well Windows would perform although I personally would avoid it simply because it was Windows...
Re: Backup and FreeBSD/ZFS
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 04.02.2010 17:57, Matthew Seaman wrote: On 04/02/2010 15:35, Svein Skogen (Listmail Account) wrote: On a monthly rotation the tapes are placed in a firetolerant safe. Since the most critical thing here is the terabyte (and growing!) of original photographs, I'm not thinking about just day-to-day diskfailure or pebcaks (proper raid and snapshotting handles that rather well). However snapshotting and raid solutions handles the house being on fire rather poorly, or should we say Data integrity and fires, get along like a house on fire? ;) fire tolerant? That doesn't sound amazingly effective to me. Would it stand up to temperatures in excess of 600degC for more than about 20 minutes? That's going to be fairly typical in a house fire... Well, this one is the kind placed within the concrete of our cellar (this is a home solution, not an industry one). But that area isn't suitable for the servers for other reasons. The cellar is within the bedrock of the area (the house foundation is directly on bedrock, and the cellar area has been blasted out from the bedrock), so discounting the plane-crash-into-building scenario, it's rather safe for our use (and the plane-crash scenario would quite likely invalidate me along with the backup, and so the need for a restore wouldn't be that critical) A safe like that is a good idea for local storage of backup media while it waits to go into the tape library or off-site. It's a bad idea for storing your entire archive. *snip* Tape libraries are horribly expensive since they're not mass market items. They are also intrinsically prone to breaking down or failing to work quite as well as the salesman implied. They're the only viable solution when your storage volumes get really huge, but what is considered huge nowadays is rather more than terabyte scale. If you can get away with just a single tape drive you'll save yourself a lot of money. Alas, a full backup of the current disk setup takes 4 tapes and ... I really don't feel like staying up one entire night per week to swap tapes (both for the backup and the verify). The autoloader I've got now (8 slot, 1 drive, LTO-3, SAS) works fairly well with the currently installed OS (Windows Storage Server 2008), giving about 60MB/Sec sustained transfer rate. LTO4 tapes are rated at 800--1600GB depending on achievable compression, so they might be big enough on their own. As image formats are already internally compressed, I'd expect them to come in at the low end of that, which might be tight. Worth trying out if you can get a drive on evaluation. A standalone LTO-4 might be a good alternative, if I didn't already have the tapeloader. ;) You might want to evaluate getting a bunch of 1TB (or larger) hard dives -- either USB or hot-swap SATA. They don't need to perform particularly well, but they'd have to be rated for a lot of spin-up/spin-down cycles (so something aimed at the mobile PC market). One other thing you should seriously consider is on-line backup. There are quite a lot of providers out there, and they should be at least competitive with running your own dedicated backup system. They also generally have the advantage of being instantly available if you need to recover anything in a hurry. Online-backup-solutions are a no-go for me, alas. Someone told me that Amanda should handle this, and I'm looking into it now (especially reading up on what I'd need to do to handle disaster recovery), but other options are welcome as well, including the option of going Solaris (if someone can point me to proper documentation on how to get Solaris to do what I want). Also checkout Bacula. I've found Bacula quite a lot easier to manage than Amanda, especially with tape libraries. The box itself is a C2D E7500 with 8GB ram, Asus P5Q Premium (the deluxe version with fewer NICs is on the BigAdmin HCL, basically an intel P45 chipset with sufficient number of pci-express slots, and four Marvell Yukon gigabit nics with Marvell Alaska PHY), backed by LSI SAS-MPT for the autoloader and SAS-MFI for the disks, and will handle SMB/CIFS, NFS, and iSCSI services (and the backups of that data). Nothing fancy here, meaning it should hardwarewise be no biggie to get it up and running in FreeBSD, Solaris (or leave it on Windows Storage server if that's the best solution, even if that means the iSCSI-target-service has ... less than stellar performance). So, I'm basically looking for pointers on what solutions to consider, not looking for a pre-cooked solution. I have sufficient external diskspace (still with redundancy) to handle the move-to-new-os-and-fs issue... Thanks again for taking the time to help me out here. ;) Hard to know what to advise OS-wise. FreeBSD will do the job, although I'm not sure the iSCSI-target stuff is the best available. So will Solaris for that matter, although more likely to
Re: Backup and FreeBSD/ZFS
- Original Message From: Svein Skogen (Listmail Account) svein-listm...@stillbilde.net To: freebsd-questions@freebsd.org Sent: Thu, February 4, 2010 12:14:18 PM Subject: Re: Backup and FreeBSD/ZFS On 04.02.2010 17:57, Matthew Seaman wrote: On 04/02/2010 15:35, Svein Skogen (Listmail Account) wrote: Alas, a full backup of the current disk setup takes 4 tapes and ... I really don't feel like staying up one entire night per week to swap tapes (both for the backup and the verify). The autoloader I've got now (8 slot, 1 drive, LTO-3, SAS) works fairly well with the currently installed OS (Windows Storage Server 2008), giving about 60MB/Sec sustained transfer rate. LTO4 tapes are rated at 800--1600GB depending on achievable compression, so they might be big enough on their own. As image formats are already internally compressed, I'd expect them to come in at the low end of that, which might be tight. Worth trying out if you can get a drive on evaluation. A standalone LTO-4 might be a good alternative, if I didn't already have the tapeloader. ;) Some (certainly not all) autoloaders can be upgraded/converted from LTO-3 to LTO-4 for about the same price as a standalone LTO-4. We use a windows based server for backups at work (nothing but a maintenance nightmare, let me tell you), and at home I have only a single-drive tape backup on my FreeBSD box (never a hiccup!) so I haven't been able to test the following, but would dump be able to understand the EOT and just be able to ask for a new one in the autoloader, which should be able to be set up to automatically move a new tape into the drive until it ran out? For what it's worth, I found Amanda unnecessarily complicated for my simple needs at home. I tried Bacula as well and it seemed easier, but not enough to make it worth it. I just dump the stuff I need to back up externally straight to tape on a weekly cron job. They still fit on one tape. :) ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Backup and FreeBSD/ZFS
On Wed, Feb 03, 2010 at 11:05:06AM +0100, Svein Skogen (Listmail Account) wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I'm currently considering switching my Backend (Running WSS2008 Enterprise) to FreeBSD RELENG_8+zfs, however my last melee with ZFS and backups to Autoloader (HP 1/8 G2 LTO-3 job) didn't quite turn out in my favour. Seems FreeBSD has a decent backup solution for UFS/2 (dump/restore) but such luxuries where nowhere to be found for ZFS (but the performance was quite good!). I haven't used ZFS yet, but if stuff is put there in 'file' with an inode for each, I wonder if dump/restore would actually work on ZFS. Of course, it would not preserve the formatting/filesystem building. But it doesn't do that fur UFS either. Backups created by dump and read by restore are just files with a series of files as they come from disk organized and located by inode. But, as I say, I haven't worked with ZFS yet so do not know how date is kept track of on ZFS. jerry So, my question is this: Can someone point me to the proper place to start reading on getting RELENG_8+zfs backed up to tape robotics (or more specifically: LTO-3 with a HP autoloader)? Will going the Opensolaris route be easier? (I had hoped to be able to use net/istgt/ from ports, but I guess I could find a different solution to that problem in Solaris). Any pointers would really help me here. The storage backend will be on MFI arrays (set up with redundant striping + automagic weekly consistency checks of the arrays). //Svein - -- - +---+--- /\ |Svein Skogen | sv...@d80.iso100.no \ / |Solberg Østli 9| PGP Key: 0xE5E76831 X|2020 Skedsmokorset | sv...@jernhuset.no / \ |Norway | PGP Key: 0xCE96CE13 | | sv...@stillbilde.net ascii | | PGP Key: 0x58CD33B6 ribbon |System Admin | svein-listm...@stillbilde.net Campaign|stillbilde.net | PGP Key: 0x22D494A4 +---+--- |msn messenger: | Mobile Phone: +47 907 03 575 |sv...@jernhuset.no | RIPE handle:SS16503-RIPE - +---+--- If you really are in a hurry, mail me at svein-mob...@stillbilde.net This mailbox goes directly to my cellphone and is checked even when I'm not in front of my computer. - Picture Gallery: https://gallery.stillbilde.net/v/svein/ - -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.12 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAktpSlIACgkQODUnwSLUlKRvRQCcCKgCzTSCr9PVfyQ9cveGkuUd xTIAn2IWherBzlLTu/02CBLJMo34Ky2m =ruSv -END PGP SIGNATURE- ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Backup and FreeBSD/ZFS
I have been using Amanda straight from the port, it supports both tar from snapshots if you need to be able to retrieve individual files from the backup and zfs send if recovery at filesystem level is OK. --glz --On Wednesday, February 03, 2010 11:05 AM +0100 Svein Skogen (Listmail Account) svein-listm...@stillbilde.net wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I'm currently considering switching my Backend (Running WSS2008 Enterprise) to FreeBSD RELENG_8+zfs, however my last melee with ZFS and backups to Autoloader (HP 1/8 G2 LTO-3 job) didn't quite turn out in my favour. Seems FreeBSD has a decent backup solution for UFS/2 (dump/restore) but such luxuries where nowhere to be found for ZFS (but the performance was quite good!). So, my question is this: Can someone point me to the proper place to start reading on getting RELENG_8+zfs backed up to tape robotics (or more specifically: LTO-3 with a HP autoloader)? Will going the Opensolaris route be easier? (I had hoped to be able to use net/istgt/ from ports, but I guess I could find a different solution to that problem in Solaris). Any pointers would really help me here. The storage backend will be on MFI arrays (set up with redundant striping + automagic weekly consistency checks of the arrays). //Svein - -- - +---+--- /\ |Svein Skogen | sv...@d80.iso100.no \ / |Solberg Østli 9| PGP Key: 0xE5E76831 X|2020 Skedsmokorset | sv...@jernhuset.no / \ |Norway | PGP Key: 0xCE96CE13 | | sv...@stillbilde.net ascii | | PGP Key: 0x58CD33B6 ribbon |System Admin | svein-listm...@stillbilde.net Campaign|stillbilde.net | PGP Key: 0x22D494A4 +---+--- |msn messenger: | Mobile Phone: +47 907 03 575 |sv...@jernhuset.no | RIPE handle:SS16503-RIPE - +---+--- If you really are in a hurry, mail me at svein-mob...@stillbilde.net This mailbox goes directly to my cellphone and is checked even when I'm not in front of my computer. - Picture Gallery: https://gallery.stillbilde.net/v/svein/ - -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.12 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAktpSlIACgkQODUnwSLUlKRvRQCcCKgCzTSCr9PVfyQ9cveGkuUd xTIAn2IWherBzlLTu/02CBLJMo34Ky2m =ruSv -END PGP SIGNATURE- ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org ... the future isMobile Goran Lowkrantz goran.lowkra...@ismobile.com System Architect, isMobile, Aurorum 2, S-977 75 Luleå, Sweden Phone: +46(0)920-75559 Mobile: +46(0)70-587 87 82 Fax: +46(0)70-615 87 82 http://www.ismobile.com ... ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Backup and FreeBSD/ZFS
If my memory serves, you're looking at something similar to taking a snapshot and then sending it to the tape device, so zfs send snapshot | (tape device access). This, IIRC, is functionally identical to dump/restore. The Solaris ZFS Admin guide is generally helpful (even as we live in the FreeBSD world). (http://docs.sun.com/app/docs/doc/819-5461/6n7ht6qsc?a=view) On 2/3/2010 4:05 AM, Svein Skogen (Listmail Account) wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I'm currently considering switching my Backend (Running WSS2008 Enterprise) to FreeBSD RELENG_8+zfs, however my last melee with ZFS and backups to Autoloader (HP 1/8 G2 LTO-3 job) didn't quite turn out in my favour. Seems FreeBSD has a decent backup solution for UFS/2 (dump/restore) but such luxuries where nowhere to be found for ZFS (but the performance was quite good!). So, my question is this: Can someone point me to the proper place to start reading on getting RELENG_8+zfs backed up to tape robotics (or more specifically: LTO-3 with a HP autoloader)? Will going the Opensolaris route be easier? (I had hoped to be able to use net/istgt/ from ports, but I guess I could find a different solution to that problem in Solaris). Any pointers would really help me here. The storage backend will be on MFI arrays (set up with redundant striping + automagic weekly consistency checks of the arrays). //Svein - -- - +---+--- /\ |Svein Skogen | sv...@d80.iso100.no \ / |Solberg Østli 9| PGP Key: 0xE5E76831 X|2020 Skedsmokorset | sv...@jernhuset.no / \ |Norway | PGP Key: 0xCE96CE13 | | sv...@stillbilde.net ascii | | PGP Key: 0x58CD33B6 ribbon |System Admin | svein-listm...@stillbilde.net Campaign|stillbilde.net | PGP Key: 0x22D494A4 +---+--- |msn messenger: | Mobile Phone: +47 907 03 575 |sv...@jernhuset.no | RIPE handle:SS16503-RIPE - +---+--- If you really are in a hurry, mail me at svein-mob...@stillbilde.net This mailbox goes directly to my cellphone and is checked even when I'm not in front of my computer. - Picture Gallery: https://gallery.stillbilde.net/v/svein/ - -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.12 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAktpSlIACgkQODUnwSLUlKRvRQCcCKgCzTSCr9PVfyQ9cveGkuUd xTIAn2IWherBzlLTu/02CBLJMo34Ky2m =ruSv -END PGP SIGNATURE- ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Backup and FreeBSD/ZFS
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 03.02.2010 19:14, LoH wrote: If my memory serves, you're looking at something similar to taking a snapshot and then sending it to the tape device, so zfs send snapshot | (tape device access). This, IIRC, is functionally identical to dump/restore. Except for one smallish detail. Dump handles tape is full, switch to next one in a relatively painless way... Let's just say that ... there's a reason I've invested in an autoloader for my home server (it will, among other things, hold about a terabyte of Nikon .NEF files if that means anything) //Svein - -- - +---+--- /\ |Svein Skogen | sv...@d80.iso100.no \ / |Solberg Østli 9| PGP Key: 0xE5E76831 X|2020 Skedsmokorset | sv...@jernhuset.no / \ |Norway | PGP Key: 0xCE96CE13 | | sv...@stillbilde.net ascii | | PGP Key: 0x58CD33B6 ribbon |System Admin | svein-listm...@stillbilde.net Campaign|stillbilde.net | PGP Key: 0x22D494A4 +---+--- |msn messenger: | Mobile Phone: +47 907 03 575 |sv...@jernhuset.no | RIPE handle:SS16503-RIPE - +---+--- If you really are in a hurry, mail me at svein-mob...@stillbilde.net This mailbox goes directly to my cellphone and is checked even when I'm not in front of my computer. - Picture Gallery: https://gallery.stillbilde.net/v/svein/ - -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.12 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAktpzMgACgkQODUnwSLUlKRRfgCgulZAvQN61uE6HIcuvxzkU2yS HaAAmwcHY6YYqoTYlw/R/KeWuy/9ferH =zHrR -END PGP SIGNATURE- ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Backup and FreeBSD/ZFS
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 03.02.2010 17:41, Goran Lowkrantz wrote: I have been using Amanda straight from the port, it supports both tar from snapshots if you need to be able to retrieve individual files from the backup and zfs send if recovery at filesystem level is OK. Does Amanda handle splitting a backup over several tapes (and using the autoloader under FreeBSD?) //Svein - -- - +---+--- /\ |Svein Skogen | sv...@d80.iso100.no \ / |Solberg Østli 9| PGP Key: 0xE5E76831 X|2020 Skedsmokorset | sv...@jernhuset.no / \ |Norway | PGP Key: 0xCE96CE13 | | sv...@stillbilde.net ascii | | PGP Key: 0x58CD33B6 ribbon |System Admin | svein-listm...@stillbilde.net Campaign|stillbilde.net | PGP Key: 0x22D494A4 +---+--- |msn messenger: | Mobile Phone: +47 907 03 575 |sv...@jernhuset.no | RIPE handle:SS16503-RIPE - +---+--- If you really are in a hurry, mail me at svein-mob...@stillbilde.net This mailbox goes directly to my cellphone and is checked even when I'm not in front of my computer. - Picture Gallery: https://gallery.stillbilde.net/v/svein/ - -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.12 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAktpzQoACgkQODUnwSLUlKT1KwCgqZjUakGildXBWt4WRF/k6x5b NPwAn0uMvmseUwXHCpcxAu9uzdQfMhnJ =hAB3 -END PGP SIGNATURE- ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Backup and FreeBSD/ZFS
Yes, I have three sets running that way, my home systems using a Dell 122 and a 5 rack config at work with a 7x200G Tandberg and a 48 slot 4U IBM beast. All are using the mtx changer scripts that come with Amanda. -glz --On Wednesday, February 03, 2010 8:22 PM +0100 Svein Skogen (Listmail Account) svein-listm...@stillbilde.net wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 03.02.2010 17:41, Goran Lowkrantz wrote: I have been using Amanda straight from the port, it supports both tar from snapshots if you need to be able to retrieve individual files from the backup and zfs send if recovery at filesystem level is OK. Does Amanda handle splitting a backup over several tapes (and using the autoloader under FreeBSD?) //Svein - -- - +---+--- /\ |Svein Skogen | sv...@d80.iso100.no \ / |Solberg Østli 9| PGP Key: 0xE5E76831 X|2020 Skedsmokorset | sv...@jernhuset.no / \ |Norway | PGP Key: 0xCE96CE13 | | sv...@stillbilde.net ascii | | PGP Key: 0x58CD33B6 ribbon |System Admin | svein-listm...@stillbilde.net Campaign|stillbilde.net | PGP Key: 0x22D494A4 +---+--- |msn messenger: | Mobile Phone: +47 907 03 575 |sv...@jernhuset.no | RIPE handle:SS16503-RIPE - +---+--- If you really are in a hurry, mail me at svein-mob...@stillbilde.net This mailbox goes directly to my cellphone and is checked even when I'm not in front of my computer. - Picture Gallery: https://gallery.stillbilde.net/v/svein/ - -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.12 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAktpzQoACgkQODUnwSLUlKT1KwCgqZjUakGildXBWt4WRF/k6x5b NPwAn0uMvmseUwXHCpcxAu9uzdQfMhnJ =hAB3 -END PGP SIGNATURE- ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org ... the future isMobile Goran Lowkrantz goran.lowkra...@ismobile.com System Architect, isMobile, Aurorum 2, S-977 75 Luleå, Sweden Phone: +46(0)920-75559 Mobile: +46(0)70-587 87 82 Fax: +46(0)70-615 87 82 http://www.ismobile.com ... ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org