Re: Backup and FreeBSD/ZFS

2010-02-05 Thread krad
On 4 February 2010 18:14, Svein Skogen (Listmail Account) 
svein-listm...@stillbilde.net wrote:

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1

 On 04.02.2010 17:57, Matthew Seaman wrote:
  On 04/02/2010 15:35, Svein Skogen (Listmail Account) wrote:
 
  On a monthly rotation the tapes are placed in a firetolerant safe. Since
  the most critical thing here is the terabyte (and growing!) of original
  photographs, I'm not thinking about just day-to-day diskfailure or
  pebcaks (proper raid and snapshotting handles that rather well). However
  snapshotting and raid solutions handles the house being on fire rather
  poorly, or should we say Data integrity and fires, get along like a
  house on fire? ;)
 
  fire tolerant?  That doesn't sound amazingly effective to me.  Would it
  stand up to temperatures in excess of 600degC for more than about 20
  minutes?  That's going to be fairly typical in a house fire...

 Well, this one is the kind placed within the concrete of our cellar
 (this is a home solution, not an industry one). But that area isn't
 suitable for the servers for other reasons. The cellar is within the
 bedrock of the area (the house foundation is directly on bedrock, and
 the cellar area has been blasted out from the bedrock), so discounting
 the plane-crash-into-building scenario, it's rather safe for our use
 (and the plane-crash scenario would quite likely invalidate me along
 with the backup, and so the need for a restore wouldn't be that critical)

  A safe like that is a good idea for local storage of backup media while
  it waits to go into the tape library or off-site.  It's a bad idea for
  storing your entire archive.
 

 *snip*

 
  Tape libraries are horribly expensive since they're not mass market
  items.  They are also intrinsically prone to breaking down or failing
  to work quite as well as the salesman implied.  They're the only viable
  solution when your storage volumes get really huge, but what is
  considered huge nowadays is rather more than terabyte scale.  If you can
  get away with just a single tape drive you'll save yourself a lot of
  money.

 Alas, a full backup of the current disk setup takes 4 tapes and ... I
 really don't feel like staying up one entire night per week to swap
 tapes (both for the backup and the verify). The autoloader I've got now
 (8 slot, 1 drive, LTO-3, SAS) works fairly well with the currently
 installed OS (Windows Storage Server 2008), giving about 60MB/Sec
 sustained transfer rate.

  LTO4 tapes are rated at 800--1600GB depending on achievable compression,
  so they might be big enough on their own.  As image formats are already
  internally compressed, I'd expect them to come in at the low end of
  that, which might be tight.  Worth trying out if you can get a drive on
  evaluation.

 A standalone LTO-4 might be a good alternative, if I didn't already have
 the tapeloader. ;)

  You might want to evaluate getting a bunch of 1TB (or larger) hard dives
  -- either USB or hot-swap SATA.  They don't need to perform particularly
  well, but they'd have to be rated for a lot of spin-up/spin-down cycles
  (so something aimed at the mobile PC market).
 
  One other thing you should seriously consider is on-line backup.  There
  are quite a lot of providers out there, and they should be at least
  competitive with running your own dedicated backup system.  They also
  generally have the advantage of being instantly available if you need to
  recover anything in a hurry.

 Online-backup-solutions are a no-go for me, alas.

  Someone told me that Amanda should handle this, and I'm looking into it
  now (especially reading up on what I'd need to do to handle disaster
  recovery), but other options are welcome as well, including the option
  of going Solaris (if someone can point me to proper documentation on how
  to get Solaris to do what I want).
 
  Also checkout Bacula.  I've found Bacula quite a lot easier to manage
  than Amanda, especially with tape libraries.
 
  The box itself is a C2D E7500 with 8GB ram, Asus P5Q Premium (the
  deluxe version with fewer NICs is on the BigAdmin HCL, basically an
  intel P45 chipset with sufficient number of pci-express slots, and four
  Marvell Yukon gigabit nics with Marvell Alaska PHY), backed by LSI
  SAS-MPT for the autoloader and SAS-MFI for the disks, and will handle
  SMB/CIFS, NFS, and iSCSI services (and the backups of that data).
  Nothing fancy here, meaning it should hardwarewise be no biggie to get
  it up and running in FreeBSD, Solaris (or leave it on Windows Storage
  server if that's the best solution, even if that means the
  iSCSI-target-service has ... less than stellar performance).
 
  So, I'm basically looking for pointers on what solutions to consider,
  not looking for a pre-cooked solution. I have sufficient external
  diskspace (still with redundancy) to handle the move-to-new-os-and-fs
  issue...
 
  Thanks again for taking the time to help me out here. ;)
 
  Hard to know what 

Re: Backup and FreeBSD/ZFS

2010-02-04 Thread krad
On 3 February 2010 19:21, Svein Skogen (Listmail Account) 
svein-listm...@stillbilde.net wrote:

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1

 On 03.02.2010 19:14, LoH wrote:
  If my memory serves, you're looking at something similar to taking a
  snapshot and then sending it to the tape device, so zfs send snapshot
  | (tape device access). This, IIRC, is functionally identical to
  dump/restore.

 Except for one smallish detail. Dump handles tape is full, switch to
 next one in a relatively painless way... Let's just say that ...
 there's a reason I've invested in an autoloader for my home server (it
 will, among other things, hold about a terabyte of Nikon .NEF files if
 that means anything)

 //Svein

 - --
 - +---+---
  /\   |Svein Skogen   | sv...@d80.iso100.no
  \ /   |Solberg Østli 9| PGP Key:  0xE5E76831
   X|2020 Skedsmokorset | sv...@jernhuset.no
  / \   |Norway | PGP Key:  0xCE96CE13
|   | sv...@stillbilde.net
  ascii  |   | PGP Key:  0x58CD33B6
  ribbon |System Admin   | svein-listm...@stillbilde.net
 Campaign|stillbilde.net | PGP Key:  0x22D494A4
+---+---
|msn messenger: | Mobile Phone: +47 907 03 575
|sv...@jernhuset.no | RIPE handle:SS16503-RIPE
 - +---+---
 If you really are in a hurry, mail me at
   svein-mob...@stillbilde.net
  This mailbox goes directly to my cellphone and is checked
even when I'm not in front of my computer.
 - 
 Picture Gallery:
  https://gallery.stillbilde.net/v/svein/
 - 
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v2.0.12 (MingW32)
 Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

 iEYEARECAAYFAktpzMgACgkQODUnwSLUlKRRfgCgulZAvQN61uE6HIcuvxzkU2yS
 HaAAmwcHY6YYqoTYlw/R/KeWuy/9ferH
 =zHrR
 -END PGP SIGNATURE-
 ___
 freebsd-questions@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-questions
 To unsubscribe, send any mail to 
 freebsd-questions-unsubscr...@freebsd.org


If you combine snapshoting with a redundant array, and maybe a secondary
pool that you zfs send your files ystems to (perhaps on a different box) its
questionable whether having stuff on tape has any advantage. If you are
taking the tapes off site it may be worth it.
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Backup and FreeBSD/ZFS

2010-02-04 Thread Svein Skogen (Listmail Account)
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 04.02.2010 10:39, krad wrote:
 If you combine snapshoting with a redundant array, and maybe a secondary
 pool that you zfs send your files ystems to (perhaps on a different box) its
 questionable whether having stuff on tape has any advantage. If you are
 taking the tapes off site it may be worth it.

On a monthly rotation the tapes are placed in a firetolerant safe. Since
the most critical thing here is the terabyte (and growing!) of original
photographs, I'm not thinking about just day-to-day diskfailure or
pebcaks (proper raid and snapshotting handles that rather well). However
snapshotting and raid solutions handles the house being on fire rather
poorly, or should we say Data integrity and fires, get along like a
house on fire? ;)

And I think ... everyone on this list can agree that data not properly
backed up, is a fancy way of saying data not yet lost. ;)

This is why I'm willing to (and have already) cough up for such
solutions as autoloaders for my home storage server, however my last
wrestle with ZFS (on freebsd RELENG_7) left me rather less than
enthusiastic about the backup options.

Someone told me that Amanda should handle this, and I'm looking into it
now (especially reading up on what I'd need to do to handle disaster
recovery), but other options are welcome as well, including the option
of going Solaris (if someone can point me to proper documentation on how
to get Solaris to do what I want).

The box itself is a C2D E7500 with 8GB ram, Asus P5Q Premium (the
deluxe version with fewer NICs is on the BigAdmin HCL, basically an
intel P45 chipset with sufficient number of pci-express slots, and four
Marvell Yukon gigabit nics with Marvell Alaska PHY), backed by LSI
SAS-MPT for the autoloader and SAS-MFI for the disks, and will handle
SMB/CIFS, NFS, and iSCSI services (and the backups of that data).
Nothing fancy here, meaning it should hardwarewise be no biggie to get
it up and running in FreeBSD, Solaris (or leave it on Windows Storage
server if that's the best solution, even if that means the
iSCSI-target-service has ... less than stellar performance).

So, I'm basically looking for pointers on what solutions to consider,
not looking for a pre-cooked solution. I have sufficient external
diskspace (still with redundancy) to handle the move-to-new-os-and-fs
issue...

Thanks again for taking the time to help me out here. ;)

//Svein

- -- 
- +---+---
  /\   |Svein Skogen   | sv...@d80.iso100.no
  \ /   |Solberg Østli 9| PGP Key:  0xE5E76831
   X|2020 Skedsmokorset | sv...@jernhuset.no
  / \   |Norway | PGP Key:  0xCE96CE13
|   | sv...@stillbilde.net
 ascii  |   | PGP Key:  0x58CD33B6
 ribbon |System Admin   | svein-listm...@stillbilde.net
Campaign|stillbilde.net | PGP Key:  0x22D494A4
+---+---
|msn messenger: | Mobile Phone: +47 907 03 575
|sv...@jernhuset.no | RIPE handle:SS16503-RIPE
- +---+---
 If you really are in a hurry, mail me at
   svein-mob...@stillbilde.net
 This mailbox goes directly to my cellphone and is checked
even when I'm not in front of my computer.
- 
 Picture Gallery:
  https://gallery.stillbilde.net/v/svein/
- 
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.12 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAktq6TwACgkQODUnwSLUlKQYzgCffVUn25D1CTJsg9SfVBCJNwvO
xKkAn17MEHNQUdFTf7b19U3rTd/ASduU
=2bla
-END PGP SIGNATURE-
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Backup and FreeBSD/ZFS

2010-02-04 Thread Matthew Seaman
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 04/02/2010 15:35, Svein Skogen (Listmail Account) wrote:

 On a monthly rotation the tapes are placed in a firetolerant safe. Since
 the most critical thing here is the terabyte (and growing!) of original
 photographs, I'm not thinking about just day-to-day diskfailure or
 pebcaks (proper raid and snapshotting handles that rather well). However
 snapshotting and raid solutions handles the house being on fire rather
 poorly, or should we say Data integrity and fires, get along like a
 house on fire? ;)

fire tolerant?  That doesn't sound amazingly effective to me.  Would it
stand up to temperatures in excess of 600degC for more than about 20
minutes?  That's going to be fairly typical in a house fire...

A safe like that is a good idea for local storage of backup media while
it waits to go into the tape library or off-site.  It's a bad idea for
storing your entire archive.

You really want your backups to be stored in an off-site location.
Preferably by a company that has the right sort of secure archive
facilities.  'Off-site' means 'sufficiently far away that any
conceivable disaster can't affect them.'  The gold standard for
'conceivable disasters' is a fully laden and fuelled plane crashing
onto your premises.  I did once have a setup where 'off site' was a
storage company only a couple of streets over, but as their archive was
in a former World War II Bunker some 100 feet underground, that was
acceptable.  Usually you'ld be looking at several miles away at minimum.

 And I think ... everyone on this list can agree that data not properly
 backed up, is a fancy way of saying data not yet lost. ;)
 
 This is why I'm willing to (and have already) cough up for such
 solutions as autoloaders for my home storage server, however my last
 wrestle with ZFS (on freebsd RELENG_7) left me rather less than
 enthusiastic about the backup options.

Tape libraries are horribly expensive since they're not mass market
items.  They are also intrinsically prone to breaking down or failing
to work quite as well as the salesman implied.  They're the only viable
solution when your storage volumes get really huge, but what is
considered huge nowadays is rather more than terabyte scale.  If you can
get away with just a single tape drive you'll save yourself a lot of
money.

LTO4 tapes are rated at 800--1600GB depending on achievable compression,
so they might be big enough on their own.  As image formats are already
internally compressed, I'd expect them to come in at the low end of
that, which might be tight.  Worth trying out if you can get a drive on
evaluation.

You might want to evaluate getting a bunch of 1TB (or larger) hard dives
- -- either USB or hot-swap SATA.  They don't need to perform particularly
well, but they'd have to be rated for a lot of spin-up/spin-down cycles
(so something aimed at the mobile PC market).

One other thing you should seriously consider is on-line backup.  There
are quite a lot of providers out there, and they should be at least
competitive with running your own dedicated backup system.  They also
generally have the advantage of being instantly available if you need to
recover anything in a hurry.

 Someone told me that Amanda should handle this, and I'm looking into it
 now (especially reading up on what I'd need to do to handle disaster
 recovery), but other options are welcome as well, including the option
 of going Solaris (if someone can point me to proper documentation on how
 to get Solaris to do what I want).

Also checkout Bacula.  I've found Bacula quite a lot easier to manage
than Amanda, especially with tape libraries.

 The box itself is a C2D E7500 with 8GB ram, Asus P5Q Premium (the
 deluxe version with fewer NICs is on the BigAdmin HCL, basically an
 intel P45 chipset with sufficient number of pci-express slots, and four
 Marvell Yukon gigabit nics with Marvell Alaska PHY), backed by LSI
 SAS-MPT for the autoloader and SAS-MFI for the disks, and will handle
 SMB/CIFS, NFS, and iSCSI services (and the backups of that data).
 Nothing fancy here, meaning it should hardwarewise be no biggie to get
 it up and running in FreeBSD, Solaris (or leave it on Windows Storage
 server if that's the best solution, even if that means the
 iSCSI-target-service has ... less than stellar performance).
 
 So, I'm basically looking for pointers on what solutions to consider,
 not looking for a pre-cooked solution. I have sufficient external
 diskspace (still with redundancy) to handle the move-to-new-os-and-fs
 issue...
 
 Thanks again for taking the time to help me out here. ;)

Hard to know what to advise OS-wise.  FreeBSD will do the job, although
I'm not sure the iSCSI-target stuff is the best available.  So will
Solaris for that matter, although more likely to suffer from hardware
incompatibilites.  I really haven't got a clue about how well Windows
would perform although I personally would avoid it simply because it was
Windows...


Re: Backup and FreeBSD/ZFS

2010-02-04 Thread Svein Skogen (Listmail Account)
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 04.02.2010 17:57, Matthew Seaman wrote:
 On 04/02/2010 15:35, Svein Skogen (Listmail Account) wrote:
 
 On a monthly rotation the tapes are placed in a firetolerant safe. Since
 the most critical thing here is the terabyte (and growing!) of original
 photographs, I'm not thinking about just day-to-day diskfailure or
 pebcaks (proper raid and snapshotting handles that rather well). However
 snapshotting and raid solutions handles the house being on fire rather
 poorly, or should we say Data integrity and fires, get along like a
 house on fire? ;)
 
 fire tolerant?  That doesn't sound amazingly effective to me.  Would it
 stand up to temperatures in excess of 600degC for more than about 20
 minutes?  That's going to be fairly typical in a house fire...

Well, this one is the kind placed within the concrete of our cellar
(this is a home solution, not an industry one). But that area isn't
suitable for the servers for other reasons. The cellar is within the
bedrock of the area (the house foundation is directly on bedrock, and
the cellar area has been blasted out from the bedrock), so discounting
the plane-crash-into-building scenario, it's rather safe for our use
(and the plane-crash scenario would quite likely invalidate me along
with the backup, and so the need for a restore wouldn't be that critical)

 A safe like that is a good idea for local storage of backup media while
 it waits to go into the tape library or off-site.  It's a bad idea for
 storing your entire archive.
 

*snip*

 
 Tape libraries are horribly expensive since they're not mass market
 items.  They are also intrinsically prone to breaking down or failing
 to work quite as well as the salesman implied.  They're the only viable
 solution when your storage volumes get really huge, but what is
 considered huge nowadays is rather more than terabyte scale.  If you can
 get away with just a single tape drive you'll save yourself a lot of
 money.

Alas, a full backup of the current disk setup takes 4 tapes and ... I
really don't feel like staying up one entire night per week to swap
tapes (both for the backup and the verify). The autoloader I've got now
(8 slot, 1 drive, LTO-3, SAS) works fairly well with the currently
installed OS (Windows Storage Server 2008), giving about 60MB/Sec
sustained transfer rate.

 LTO4 tapes are rated at 800--1600GB depending on achievable compression,
 so they might be big enough on their own.  As image formats are already
 internally compressed, I'd expect them to come in at the low end of
 that, which might be tight.  Worth trying out if you can get a drive on
 evaluation.

A standalone LTO-4 might be a good alternative, if I didn't already have
the tapeloader. ;)

 You might want to evaluate getting a bunch of 1TB (or larger) hard dives
 -- either USB or hot-swap SATA.  They don't need to perform particularly
 well, but they'd have to be rated for a lot of spin-up/spin-down cycles
 (so something aimed at the mobile PC market).
 
 One other thing you should seriously consider is on-line backup.  There
 are quite a lot of providers out there, and they should be at least
 competitive with running your own dedicated backup system.  They also
 generally have the advantage of being instantly available if you need to
 recover anything in a hurry.

Online-backup-solutions are a no-go for me, alas.

 Someone told me that Amanda should handle this, and I'm looking into it
 now (especially reading up on what I'd need to do to handle disaster
 recovery), but other options are welcome as well, including the option
 of going Solaris (if someone can point me to proper documentation on how
 to get Solaris to do what I want).
 
 Also checkout Bacula.  I've found Bacula quite a lot easier to manage
 than Amanda, especially with tape libraries.
 
 The box itself is a C2D E7500 with 8GB ram, Asus P5Q Premium (the
 deluxe version with fewer NICs is on the BigAdmin HCL, basically an
 intel P45 chipset with sufficient number of pci-express slots, and four
 Marvell Yukon gigabit nics with Marvell Alaska PHY), backed by LSI
 SAS-MPT for the autoloader and SAS-MFI for the disks, and will handle
 SMB/CIFS, NFS, and iSCSI services (and the backups of that data).
 Nothing fancy here, meaning it should hardwarewise be no biggie to get
 it up and running in FreeBSD, Solaris (or leave it on Windows Storage
 server if that's the best solution, even if that means the
 iSCSI-target-service has ... less than stellar performance).
 
 So, I'm basically looking for pointers on what solutions to consider,
 not looking for a pre-cooked solution. I have sufficient external
 diskspace (still with redundancy) to handle the move-to-new-os-and-fs
 issue...
 
 Thanks again for taking the time to help me out here. ;)
 
 Hard to know what to advise OS-wise.  FreeBSD will do the job, although
 I'm not sure the iSCSI-target stuff is the best available.  So will
 Solaris for that matter, although more likely to 

Re: Backup and FreeBSD/ZFS

2010-02-04 Thread Richard Mahlerwein
- Original Message 

From: Svein Skogen (Listmail Account) svein-listm...@stillbilde.net
To: freebsd-questions@freebsd.org
Sent: Thu, February 4, 2010 12:14:18 PM
Subject: Re: Backup and FreeBSD/ZFS

On 04.02.2010 17:57, Matthew Seaman wrote:
 On 04/02/2010 15:35, Svein Skogen (Listmail Account) wrote:

Alas, a full backup of the current disk setup takes 4 tapes and ... I
really don't feel like staying up one entire night per week to swap
tapes (both for the backup and the verify). The autoloader I've got now
(8 slot, 1 drive, LTO-3, SAS) works fairly well with the currently
installed OS (Windows Storage Server 2008), giving about 60MB/Sec
sustained transfer rate.

 LTO4 tapes are rated at 800--1600GB depending on achievable compression,
 so they might be big enough on their own.  As image formats are already
 internally compressed, I'd expect them to come in at the low end of
 that, which might be tight.  Worth trying out if you can get a drive on
 evaluation.

A standalone LTO-4 might be a good alternative, if I didn't already have
the tapeloader. ;)

Some (certainly not all) autoloaders can be upgraded/converted from LTO-3 to 
LTO-4 for about the same price as a standalone LTO-4.  

We use a windows based server for backups at work (nothing but a maintenance 
nightmare, let me tell you), and at home I have only a single-drive tape backup 
on my FreeBSD box (never a hiccup!) so I haven't been able to test the 
following, but would dump be able to understand the EOT and just be able to ask 
for a new one in the autoloader, which should be able to be set up to 
automatically move a new tape into the drive until it ran out?  

For what it's worth, I found Amanda unnecessarily complicated for my simple 
needs at home.  I tried Bacula as well and it seemed easier, but not enough to 
make it worth it.  I just dump the stuff I need to back up externally straight 
to tape on a weekly cron job.  They still fit on one tape.  :)



  
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Backup and FreeBSD/ZFS

2010-02-03 Thread Jerry McAllister
On Wed, Feb 03, 2010 at 11:05:06AM +0100, Svein Skogen (Listmail Account) wrote:

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1
 
 I'm currently considering switching my Backend (Running WSS2008
 Enterprise) to FreeBSD RELENG_8+zfs, however my last melee with ZFS and
 backups to Autoloader (HP 1/8 G2 LTO-3 job) didn't quite turn out in my
 favour.
 
 Seems FreeBSD has a decent backup solution for UFS/2 (dump/restore) but
 such luxuries where nowhere to be found for ZFS (but the performance was
 quite good!).

I haven't used ZFS yet, but if stuff is put there in 'file' with
an inode for each, I wonder if dump/restore would actually work
on ZFS.   Of course, it would not preserve the formatting/filesystem
building.   But it doesn't do that fur UFS either.
Backups created by dump and read by restore are just files with a 
series of files as they come from disk organized and located by inode.

But, as I say, I haven't worked with ZFS yet so do not know how
date is kept track of on ZFS.

jerry


 
 So, my question is this: Can someone point me to the proper place to
 start reading on getting RELENG_8+zfs backed up to tape robotics (or
 more specifically: LTO-3 with a HP autoloader)? Will going the
 Opensolaris route be easier? (I had hoped to be able to use net/istgt/
 from ports, but I guess I could find a different solution to that
 problem in Solaris).
 
 Any pointers would really help me here. The storage backend will be on
 MFI arrays (set up with redundant striping + automagic weekly
 consistency checks of the arrays).
 
 //Svein
 
 - -- 
 - +---+---
   /\   |Svein Skogen   | sv...@d80.iso100.no
   \ /   |Solberg Østli 9| PGP Key:  0xE5E76831
X|2020 Skedsmokorset | sv...@jernhuset.no
   / \   |Norway | PGP Key:  0xCE96CE13
 |   | sv...@stillbilde.net
  ascii  |   | PGP Key:  0x58CD33B6
  ribbon |System Admin   | svein-listm...@stillbilde.net
 Campaign|stillbilde.net | PGP Key:  0x22D494A4
 +---+---
 |msn messenger: | Mobile Phone: +47 907 03 575
 |sv...@jernhuset.no | RIPE handle:SS16503-RIPE
 - +---+---
  If you really are in a hurry, mail me at
svein-mob...@stillbilde.net
  This mailbox goes directly to my cellphone and is checked
 even when I'm not in front of my computer.
 - 
  Picture Gallery:
   https://gallery.stillbilde.net/v/svein/
 - 
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v2.0.12 (MingW32)
 Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
 
 iEYEARECAAYFAktpSlIACgkQODUnwSLUlKRvRQCcCKgCzTSCr9PVfyQ9cveGkuUd
 xTIAn2IWherBzlLTu/02CBLJMo34Ky2m
 =ruSv
 -END PGP SIGNATURE-
 ___
 freebsd-questions@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-questions
 To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
 
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Backup and FreeBSD/ZFS

2010-02-03 Thread Goran Lowkrantz
I have been using Amanda straight from the port, it supports both tar from 
snapshots if you need to be able to retrieve individual files from the 
backup and zfs send if recovery at filesystem level is OK.


--glz

--On Wednesday, February 03, 2010 11:05 AM +0100 Svein Skogen (Listmail 
Account) svein-listm...@stillbilde.net wrote:



-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

I'm currently considering switching my Backend (Running WSS2008
Enterprise) to FreeBSD RELENG_8+zfs, however my last melee with ZFS and
backups to Autoloader (HP 1/8 G2 LTO-3 job) didn't quite turn out in my
favour.

Seems FreeBSD has a decent backup solution for UFS/2 (dump/restore) but
such luxuries where nowhere to be found for ZFS (but the performance was
quite good!).

So, my question is this: Can someone point me to the proper place to
start reading on getting RELENG_8+zfs backed up to tape robotics (or
more specifically: LTO-3 with a HP autoloader)? Will going the
Opensolaris route be easier? (I had hoped to be able to use net/istgt/
from ports, but I guess I could find a different solution to that
problem in Solaris).

Any pointers would really help me here. The storage backend will be on
MFI arrays (set up with redundant striping + automagic weekly
consistency checks of the arrays).

//Svein

- --
- +---+---
  /\   |Svein Skogen   | sv...@d80.iso100.no
  \ /   |Solberg Østli 9| PGP Key:  0xE5E76831
   X|2020 Skedsmokorset | sv...@jernhuset.no
  / \   |Norway | PGP Key:  0xCE96CE13
|   | sv...@stillbilde.net
 ascii  |   | PGP Key:  0x58CD33B6
 ribbon |System Admin   | svein-listm...@stillbilde.net
Campaign|stillbilde.net | PGP Key:  0x22D494A4
+---+---
|msn messenger: | Mobile Phone: +47 907 03 575
|sv...@jernhuset.no | RIPE handle:SS16503-RIPE
- +---+---
 If you really are in a hurry, mail me at
   svein-mob...@stillbilde.net
 This mailbox goes directly to my cellphone and is checked
even when I'm not in front of my computer.
- 
 Picture Gallery:
  https://gallery.stillbilde.net/v/svein/
- 
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.12 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAktpSlIACgkQODUnwSLUlKRvRQCcCKgCzTSCr9PVfyQ9cveGkuUd
xTIAn2IWherBzlLTu/02CBLJMo34Ky2m
=ruSv
-END PGP SIGNATURE-
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to
freebsd-questions-unsubscr...@freebsd.org




... the future isMobile

 Goran Lowkrantz goran.lowkra...@ismobile.com
 System Architect, isMobile, Aurorum 2, S-977 75 Luleå, Sweden
 Phone: +46(0)920-75559
 Mobile: +46(0)70-587 87 82 Fax: +46(0)70-615 87 82

http://www.ismobile.com ...
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Backup and FreeBSD/ZFS

2010-02-03 Thread LoH
If my memory serves, you're looking at something similar to taking a 
snapshot and then sending it to the tape device, so zfs send snapshot 
| (tape device access). This, IIRC, is functionally identical to 
dump/restore.


The Solaris ZFS Admin guide is generally helpful (even as we live in the 
FreeBSD world).

(http://docs.sun.com/app/docs/doc/819-5461/6n7ht6qsc?a=view)

On 2/3/2010 4:05 AM, Svein Skogen (Listmail Account) wrote:

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

I'm currently considering switching my Backend (Running WSS2008
Enterprise) to FreeBSD RELENG_8+zfs, however my last melee with ZFS and
backups to Autoloader (HP 1/8 G2 LTO-3 job) didn't quite turn out in my
favour.

Seems FreeBSD has a decent backup solution for UFS/2 (dump/restore) but
such luxuries where nowhere to be found for ZFS (but the performance was
quite good!).

So, my question is this: Can someone point me to the proper place to
start reading on getting RELENG_8+zfs backed up to tape robotics (or
more specifically: LTO-3 with a HP autoloader)? Will going the
Opensolaris route be easier? (I had hoped to be able to use net/istgt/
from ports, but I guess I could find a different solution to that
problem in Solaris).

Any pointers would really help me here. The storage backend will be on
MFI arrays (set up with redundant striping + automagic weekly
consistency checks of the arrays).

//Svein

- -- 
- +---+---

   /\   |Svein Skogen   | sv...@d80.iso100.no
   \ /   |Solberg Østli 9| PGP Key:  0xE5E76831
X|2020 Skedsmokorset | sv...@jernhuset.no
   / \   |Norway | PGP Key:  0xCE96CE13
 |   | sv...@stillbilde.net
  ascii  |   | PGP Key:  0x58CD33B6
  ribbon |System Admin   | svein-listm...@stillbilde.net
Campaign|stillbilde.net | PGP Key:  0x22D494A4
 +---+---
 |msn messenger: | Mobile Phone: +47 907 03 575
 |sv...@jernhuset.no | RIPE handle:SS16503-RIPE
- +---+---
  If you really are in a hurry, mail me at
svein-mob...@stillbilde.net
  This mailbox goes directly to my cellphone and is checked
 even when I'm not in front of my computer.
- 
  Picture Gallery:
   https://gallery.stillbilde.net/v/svein/
- 
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.12 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAktpSlIACgkQODUnwSLUlKRvRQCcCKgCzTSCr9PVfyQ9cveGkuUd
xTIAn2IWherBzlLTu/02CBLJMo34Ky2m
=ruSv
-END PGP SIGNATURE-
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

   


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Backup and FreeBSD/ZFS

2010-02-03 Thread Svein Skogen (Listmail Account)
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 03.02.2010 19:14, LoH wrote:
 If my memory serves, you're looking at something similar to taking a
 snapshot and then sending it to the tape device, so zfs send snapshot
 | (tape device access). This, IIRC, is functionally identical to
 dump/restore.

Except for one smallish detail. Dump handles tape is full, switch to
next one in a relatively painless way... Let's just say that ...
there's a reason I've invested in an autoloader for my home server (it
will, among other things, hold about a terabyte of Nikon .NEF files if
that means anything)

//Svein

- -- 
- +---+---
  /\   |Svein Skogen   | sv...@d80.iso100.no
  \ /   |Solberg Østli 9| PGP Key:  0xE5E76831
   X|2020 Skedsmokorset | sv...@jernhuset.no
  / \   |Norway | PGP Key:  0xCE96CE13
|   | sv...@stillbilde.net
 ascii  |   | PGP Key:  0x58CD33B6
 ribbon |System Admin   | svein-listm...@stillbilde.net
Campaign|stillbilde.net | PGP Key:  0x22D494A4
+---+---
|msn messenger: | Mobile Phone: +47 907 03 575
|sv...@jernhuset.no | RIPE handle:SS16503-RIPE
- +---+---
 If you really are in a hurry, mail me at
   svein-mob...@stillbilde.net
 This mailbox goes directly to my cellphone and is checked
even when I'm not in front of my computer.
- 
 Picture Gallery:
  https://gallery.stillbilde.net/v/svein/
- 
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.12 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAktpzMgACgkQODUnwSLUlKRRfgCgulZAvQN61uE6HIcuvxzkU2yS
HaAAmwcHY6YYqoTYlw/R/KeWuy/9ferH
=zHrR
-END PGP SIGNATURE-
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Backup and FreeBSD/ZFS

2010-02-03 Thread Svein Skogen (Listmail Account)
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 03.02.2010 17:41, Goran Lowkrantz wrote:
 I have been using Amanda straight from the port, it supports both tar
 from snapshots if you need to be able to retrieve individual files from
 the backup and zfs send if recovery at filesystem level is OK.
 

Does Amanda handle splitting a backup over several tapes (and using the
autoloader under FreeBSD?)

//Svein

- -- 
- +---+---
  /\   |Svein Skogen   | sv...@d80.iso100.no
  \ /   |Solberg Østli 9| PGP Key:  0xE5E76831
   X|2020 Skedsmokorset | sv...@jernhuset.no
  / \   |Norway | PGP Key:  0xCE96CE13
|   | sv...@stillbilde.net
 ascii  |   | PGP Key:  0x58CD33B6
 ribbon |System Admin   | svein-listm...@stillbilde.net
Campaign|stillbilde.net | PGP Key:  0x22D494A4
+---+---
|msn messenger: | Mobile Phone: +47 907 03 575
|sv...@jernhuset.no | RIPE handle:SS16503-RIPE
- +---+---
 If you really are in a hurry, mail me at
   svein-mob...@stillbilde.net
 This mailbox goes directly to my cellphone and is checked
even when I'm not in front of my computer.
- 
 Picture Gallery:
  https://gallery.stillbilde.net/v/svein/
- 
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.12 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAktpzQoACgkQODUnwSLUlKT1KwCgqZjUakGildXBWt4WRF/k6x5b
NPwAn0uMvmseUwXHCpcxAu9uzdQfMhnJ
=hAB3
-END PGP SIGNATURE-
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Backup and FreeBSD/ZFS

2010-02-03 Thread Goran Lowkrantz
Yes, I have three sets running  that way, my home systems using a Dell 122 
and a 5 rack config at work with a 7x200G Tandberg  and a  48 slot 4U IBM 
beast. All are using the mtx changer scripts that come with Amanda.


-glz

--On Wednesday, February 03, 2010 8:22 PM +0100 Svein Skogen (Listmail 
Account) svein-listm...@stillbilde.net wrote:



-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 03.02.2010 17:41, Goran Lowkrantz wrote:

I have been using Amanda straight from the port, it supports both tar
from snapshots if you need to be able to retrieve individual files from
the backup and zfs send if recovery at filesystem level is OK.



Does Amanda handle splitting a backup over several tapes (and using the
autoloader under FreeBSD?)

//Svein

- --
- +---+---
  /\   |Svein Skogen   | sv...@d80.iso100.no
  \ /   |Solberg Østli 9| PGP Key:  0xE5E76831
   X|2020 Skedsmokorset | sv...@jernhuset.no
  / \   |Norway | PGP Key:  0xCE96CE13
|   | sv...@stillbilde.net
 ascii  |   | PGP Key:  0x58CD33B6
 ribbon |System Admin   | svein-listm...@stillbilde.net
Campaign|stillbilde.net | PGP Key:  0x22D494A4
+---+---
|msn messenger: | Mobile Phone: +47 907 03 575
|sv...@jernhuset.no | RIPE handle:SS16503-RIPE
- +---+---
 If you really are in a hurry, mail me at
   svein-mob...@stillbilde.net
 This mailbox goes directly to my cellphone and is checked
even when I'm not in front of my computer.
- 
 Picture Gallery:
  https://gallery.stillbilde.net/v/svein/
- 
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.12 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAktpzQoACgkQODUnwSLUlKT1KwCgqZjUakGildXBWt4WRF/k6x5b
NPwAn0uMvmseUwXHCpcxAu9uzdQfMhnJ
=hAB3
-END PGP SIGNATURE-
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to
freebsd-questions-unsubscr...@freebsd.org




... the future isMobile

 Goran Lowkrantz goran.lowkra...@ismobile.com
 System Architect, isMobile, Aurorum 2, S-977 75 Luleå, Sweden
 Phone: +46(0)920-75559
 Mobile: +46(0)70-587 87 82 Fax: +46(0)70-615 87 82

http://www.ismobile.com ...
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org