Re: [Bacula-users] backup to multiple disks
Hello John,
vchanger gets the job done as does the disk-changer script in
Bacula, from which vchanger was derived (and extended) if
I remember right. The disk-changer script works fine, but we
use it only for tape regression testing with our Virtual Tape driver.
I am a bit surprised that no one mentioned Bacula's built-in virtual
autochanger feature that has been there for years. The syntax for
enabling it is a bit of a kludge in my opinion, but it is the way
that Bacula
Systems is recommending to handle multiple disk backup.
In the bacula-dir.conf file, define the autochanger in
the normal way for a physical tape autochanger library.
In the bacula-sd.conf, one defines:
Autochanger {
Name = FileChgr1
Device = FileChgr1-Dev1, FileChgr1-Dev2
Changer Command =
Changer Device = /dev/null
}
Device {
Name = FileChgr1-Dev1
Media Type = File1
Archive Device = /tmp
LabelMedia = yes # lets Bacula label unlabeled media
Random Access = Yes
AutomaticMount = yes # when device opened, read it
RemovableMedia = no
AlwaysOpen = no
Maximum Concurrent Jobs = 5
}
Device {
Name = FileChgr1-Dev2
Media Type = File1
Archive Device = /tmp
LabelMedia = yes # lets Bacula label unlabeled media
Random Access = Yes
AutomaticMount = yes # when device opened, read it
RemovableMedia = no
AlwaysOpen = no
Maximum Concurrent Jobs = 5
}
You will have a virtual autochanger, which should do what most people
want in a very simple way. Of course, the above is an example. I definitely
do not recommend writing your Bacula Volumes to /tmp. Needless to say,
you can have multiple autochangers (but you probably want different Media
Types), and you can have a large number of drives in each one. No symlinks
are involved and any volume that is in the Archive Device can be mounted on
any Device.
Best regards,
Kern
On 05/03/2013 11:00 PM, John Drescher wrote:
On Fri, May 3, 2013 at 4:59 PM, John Drescher dresche...@gmail.com wrote:
Fair enough. So what happens when a new volume is needed and there's no
room on the current device? -- this is the point where you'd switch to
the next device in the list and try again until you run out of devices.
It returns volume full and asks the user to label the next volume.
Also its not advisable to make a single volume on a disk or array
since this basically prevents recycling.
John
--
Get 100% visibility into Java/.NET code with AppDynamics Lite
It's a free troubleshooting tool designed for production
Get down to code-level detail for bottlenecks, with 2% overhead.
Download for free and get started troubleshooting in minutes.
http://p.sf.net/sfu/appdyn_d2d_ap2
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Learn Graph Databases - Download FREE O'Reilly Book
Graph Databases is the definitive new guide to graph databases and
their applications. This 200-page book is written by three acclaimed
leaders in the field. The early access version is available now.
Download your free book today! http://p.sf.net/sfu/neotech_d2d_may
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Device clean lto4
On Thu, May 09, 2013 at 05:42:59PM +0200, Alberto Amo Garrido wrote: Hello. How and how ofren, you have to load de device clean lto4??? -- You should see a message in the lc display of your tape library when the drive requires cleaning, some devices also have an LED labelled cleaning that indicates a dirty drive. All the best, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann SE Co. KGaA -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] User unmounted?
On Thu, May 09, 2013 at 10:37:45AM -0300, Sergio Belkin wrote: Hi, I have some problems with bacula 5.x that I haven't when I used 2.x versions. Yesterday I unmount and eject a tape and change by hand by *another one differente tape* and backups didn't run, it outputs: Device LTO5 (/dev/nst0) is not open. Device is BLOCKED. User unmounted. There is no cronjob that unmounts the tape Why is not automounted? It's set AutomaticMount = yes; Can you check if any of your tapes have status=Append or Full and are available for recycling? Any other messages in var/bacula/working/log for instance? All the best, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann SE Co. KGaA -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] File deamon not following configuration
Hello,
2013/5/10 Wouter van Marle wou...@squirrel-systems.com
On Fri, 2013-05-10 at 07:45 +0200, Radosław Korzeniewski wrote:
Hello,
2013/5/10 Wouter van Marle wou...@squirrel-systems.com
On Thu, 2013-05-09 at 12:46 +0200, Radosław Korzeniewski
wrote:
Hello,
2013/5/9 Wouter van Marle wou...@squirrel-systems.com
*show pool=File
Pool: name=File PoolType=Backup
use_cat=1 use_once=1 cat_files=1
max_vols=0 auto_prune=1 VolRetention=1 year
VolUse=0 secs recycle=0
LabelFormat=Squirrel-${JobName}
CleaningPrefix=*None* LabelType=0
RecyleOldest=0 PurgeOldest=0 ActionOnPurge=0
MaxVolJobs=0 MaxVolFiles=0
MaxVolBytes=53687091200
Maxvolbytes above is your volume splitter at 50MB chunks.
That number is 50GB already. Not 50 MB. So again the
configuration the
console gives me is correct.
So, what is your problem with Bacula? I don't understand, sorry.
It uses 50 MB chunks, and totally different file name for the archives
than configured.
When Bacula reaches volume size limit then sets volume status to Used and
you should get appropriate information in Job messages. Bacula sets volume
name during volume creation and do not change it later. During new volume
creation you should get appropriate information in Job messages. Could you
show your Job messages for that?
During new volume creation volume inherit its parameters from Pool resource
and Bacula do not change it even you update a Pool resource configuration.
If you want to update already available volume parameters you have to
update it by hand with update volume command (it is possible to update all
volumes in Pool in batch, there is an option for that). You can list volume
parameters with llist volume command.
Bacula creates new volumes only when it cannot find already available
volumes with Append, Recycle or Purge status and cannot get ready volumes
after recycling (volumes with Purge status after recycling). New volume is
created as a last stand.
best regards
--
Radosław Korzeniewski
rados...@korzeniewski.net
--
Learn Graph Databases - Download FREE O'Reilly Book
Graph Databases is the definitive new guide to graph databases and
their applications. This 200-page book is written by three acclaimed
leaders in the field. The early access version is available now.
Download your free book today! http://p.sf.net/sfu/neotech_d2d_may___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
I am a bit surprised that no one mentioned Bacula's built-in virtual autochanger feature that has been there for years. The syntax for enabling it is a bit of a kludge in my opinion, but it is the way that Bacula Systems is recommending to handle multiple disk backup. It's been in there for years I know that however I get the sense that its usage is not recommended from mostly older mailing list posts from you and others on the development team. John -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
On 05/10/2013 02:31 PM, John Drescher wrote: I am a bit surprised that no one mentioned Bacula's built-in virtual autochanger feature that has been there for years. The syntax for enabling it is a bit of a kludge in my opinion, but it is the way that Bacula Systems is recommending to handle multiple disk backup. It's been in there for years I know that however I get the sense that its usage is not recommended from mostly older mailing list posts from you and others on the development team. In the beginning it was not tested much, so I hesitated at openly recommending it, but I think over time, it has proven its worth. Perhaps if a few more people use it, we would know for sure. :-) Kern -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
On Fri, 10 May 2013 09:09:39 +0200, Kern Sibbald said:
I am a bit surprised that no one mentioned Bacula's built-in virtual
autochanger feature that has been there for years. The syntax for
enabling it is a bit of a kludge in my opinion, but it is the way
that Bacula
Systems is recommending to handle multiple disk backup.
In the bacula-dir.conf file, define the autochanger in
the normal way for a physical tape autochanger library.
In the bacula-sd.conf, one defines:
Autochanger {
Name = FileChgr1
Device = FileChgr1-Dev1, FileChgr1-Dev2
Changer Command =
Changer Device = /dev/null
}
Device {
Name = FileChgr1-Dev1
Media Type = File1
Archive Device = /tmp
LabelMedia = yes # lets Bacula label unlabeled media
Random Access = Yes
AutomaticMount = yes # when device opened, read it
RemovableMedia = no
AlwaysOpen = no
Maximum Concurrent Jobs = 5
}
Device {
Name = FileChgr1-Dev2
Media Type = File1
Archive Device = /tmp
LabelMedia = yes # lets Bacula label unlabeled media
Random Access = Yes
AutomaticMount = yes # when device opened, read it
RemovableMedia = no
AlwaysOpen = no
Maximum Concurrent Jobs = 5
}
Can you indicate where the kludge is please?
Also, do the Device resources need AutoChanger = yes like in the other
examples?
__Martin
--
Learn Graph Databases - Download FREE O'Reilly Book
Graph Databases is the definitive new guide to graph databases and
their applications. This 200-page book is written by three acclaimed
leaders in the field. The early access version is available now.
Download your free book today! http://p.sf.net/sfu/neotech_d2d_may
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] re-initizialize old tapes
Dear all, I'm trying to reinitzialize my old tapes, but I think i miss some step. Plese, can someone point me in the right direction ? This is what I do: root@llo ~]# bconsole Connecting to Director porcello.cdlan.net:9101 1000 OK: bacula-dir Version: 2.4.4 (28 December 2008) Enter a period to cancel a command. *purge volume=Vol15 This command is can be DANGEROUS!!! It purges (deletes) all Files from a Job, JobId, Client or Volume; or it purges (deletes) all Jobs from a Client or Volume without regard for retention periods. Normally you should use the PRUNE command, which respects retention periods. 1 File on Volume Vol15 purged from catalog. There are no more Jobs associated with Volume Vol15. Marking it purged. *quit [root@llo ~]# [root@llo ~]# /usr/libexec/bacula/mtx-changer /dev/sg1 load 15 /dev/st0 0 [root@llo ~]# mt -f /dev/st0 rewind [root@llo ~]# mt -f /dev/st0 weof [root@llo ~]# btape -c bacula-sd.conf /dev/nst0 Tape block granularity is 1024 bytes. btape: butil.c:285 Using device: /dev/nst0 for writing. 10-mag 16:02 btape JobId 0: 3301 Issuing autochanger loaded? drive 0 command. 10-mag 16:02 btape JobId 0: 3302 Autochanger loaded? drive 0, result is Slot 15. btape: btape.c:372 open device DDS-4 (/dev/nst0): OK *quit [root@llo ~]# /usr/libexec/bacula/mtx-changer /dev/sg1 unload 15 /dev/st0 0 Unloading Data Transfer Element into Storage Element 15... [root@llo ~]# bconsole *relabel Automatically selected Storage: DDS-4 Defined Pools: 1: Scratch 2: Default Select the Pool (1-2): 2 ### bconsole show me all volumes Enter MediaId or Volume name: 19 Enter new Volume name: vol15 Enter slot (0 or Enter for none): 15 Defined Pools: 1: Scratch 2: Default Select the Pool (1-2): 2 Connecting to Storage daemon DDS-4 at porcello.cdlan.net:9103 ... Sending relabel command from Vol15 to vol15 ... 3000 OK label. VolBytes=64512 DVD=0 Volume=vol15 Device=DDS-4 (/dev/nst0) Catalog record for Volume vol15, Slot 15 successfully created. Old volume Vol15 deleted from catalog. Requesting to mount DDS-4 ... 3001 Device DDS-4 (/dev/nst0) is mounted with Volume vol15 *list volume Pool: Scratch No results to list. Pool: Default ### bconsole show me all volumes ... | 30 | vol15 | Append | 1 | 64,512 | 0 | 31,536,000 | 1 | 15 | 1 | DDS-4 | | ... now, as you can see, the fourth field is the volbytes and it show only 64,512 bytes, but the tabe is 800 giga size. What I do wrong ? Please help me BR Pedro -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
On 05/10/2013 04:12 PM, Martin Simmons wrote:
On Fri, 10 May 2013 09:09:39 +0200, Kern Sibbald said:
I am a bit surprised that no one mentioned Bacula's built-in virtual
autochanger feature that has been there for years. The syntax for
enabling it is a bit of a kludge in my opinion, but it is the way
that Bacula
Systems is recommending to handle multiple disk backup.
In the bacula-dir.conf file, define the autochanger in
the normal way for a physical tape autochanger library.
In the bacula-sd.conf, one defines:
Autochanger {
Name = FileChgr1
Device = FileChgr1-Dev1, FileChgr1-Dev2
Changer Command =
Changer Device = /dev/null
}
Device {
Name = FileChgr1-Dev1
Media Type = File1
Archive Device = /tmp
LabelMedia = yes # lets Bacula label unlabeled media
Random Access = Yes
AutomaticMount = yes # when device opened, read it
RemovableMedia = no
AlwaysOpen = no
Maximum Concurrent Jobs = 5
}
Device {
Name = FileChgr1-Dev2
Media Type = File1
Archive Device = /tmp
LabelMedia = yes # lets Bacula label unlabeled media
Random Access = Yes
AutomaticMount = yes # when device opened, read it
RemovableMedia = no
AlwaysOpen = no
Maximum Concurrent Jobs = 5
}
Can you indicate where the kludge is please?
Changer Command =
and
Changer Device = /dev/null
I probably should have called the resource VirtualChanger. I guess I can
still do so ...
Also, do the Device resources need AutoChanger = yes like in the other
examples?
No, and I you don't need the Drive Index = either, since in both cases
it is not a real autochanger. The autochanger code is called, but when it
sees it is a virtual changer, it just returns, and the Bacula SD core
code just handles it correctly. The main effect of this form of the
Autochanger resource is to group the Devices so you can access
any one of them with a single name. If you start using different
directories as Archive Device names, there might be problems, unless
you make a simultaneous change to the Media Type.
It was so simple that in the beginning I couldn't believe that it
would work correctly in all cases, but it does.
Kern
--
Learn Graph Databases - Download FREE O'Reilly Book
Graph Databases is the definitive new guide to graph databases and
their applications. This 200-page book is written by three acclaimed
leaders in the field. The early access version is available now.
Download your free book today! http://p.sf.net/sfu/neotech_d2d_may
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
On 5/10/2013 3:09 AM, Kern Sibbald wrote:
Hello John,
vchanger gets the job done as does the disk-changer script in
Bacula, from which vchanger was derived (and extended) if
I remember right. The disk-changer script works fine, but we
use it only for tape regression testing with our Virtual Tape driver.
Yes. As the developer of vchanger, I remember. :) Vchanger began as a
shell script derived from disk-changer, was subsequently developed as an
open source C/C++ program several years ago, and is now on Sourceforge
at http://sourceforge.net/projects/vchanger/. Its purpose was never to
replace the built-in disk storage handling, but rather more specifically
for use with removable disks such as USB, eSATA, etc. drives. In
particular, I wanted to use laptop-type USB drives for offsite storage.
My clients are mostly small businesses with smaller needs and tape
libraries are expensive to them, while at the time, USB drives were
falling rapidly in price while the capacity was growing.
The built-in disk storage handling works perfectly and is simple,
However, if using a number of removable drives and rotating them in and
out of a fire safe or offsite location, it doesn't provide any means to
easily identify which removable drive should be reattached when needed.
Vchanger treats each removable drive like a magazine in a magazine-based
library. Each magazine is labeled and its volumes use that magazine
label as the first part of the volume barcode (and filename). This makes
it is easy to identify which removable drive is needed.
Personally, I use vchanger for removable disk and always recommend using
the built-in disk storage handling for fixed-disk.
I am a bit surprised that no one mentioned Bacula's built-in virtual
autochanger feature that has been there for years.
This is particularly surprising to me, because it is discussed in the
first paragraph of the Introduction section in the vchanger HowTo
shipped with the vchanger source. :) Looking at it though, I can see
that I didn't explain it very well.
The syntax for
enabling it is a bit of a kludge in my opinion, but it is the way
that Bacula
Systems is recommending to handle multiple disk backup.
In the bacula-dir.conf file, define the autochanger in
the normal way for a physical tape autochanger library.
In the bacula-sd.conf, one defines:
Autochanger {
Name = FileChgr1
Device = FileChgr1-Dev1, FileChgr1-Dev2
Changer Command =
Changer Device = /dev/null
}
Device {
Name = FileChgr1-Dev1
Media Type = File1
Archive Device = /tmp
LabelMedia = yes # lets Bacula label unlabeled media
Random Access = Yes
AutomaticMount = yes # when device opened, read it
RemovableMedia = no
AlwaysOpen = no
Maximum Concurrent Jobs = 5
}
Device {
Name = FileChgr1-Dev2
Media Type = File1
Archive Device = /tmp
LabelMedia = yes # lets Bacula label unlabeled media
Random Access = Yes
AutomaticMount = yes # when device opened, read it
RemovableMedia = no
AlwaysOpen = no
Maximum Concurrent Jobs = 5
}
You will have a virtual autochanger, which should do what most people
want in a very simple way. Of course, the above is an example. I definitely
do not recommend writing your Bacula Volumes to /tmp. Needless to say,
you can have multiple autochangers (but you probably want different Media
Types), and you can have a large number of drives in each one. No symlinks
are involved and any volume that is in the Archive Device can be mounted on
any Device.
Best regards,
Kern
--
Learn Graph Databases - Download FREE O'Reilly Book
Graph Databases is the definitive new guide to graph databases and
their applications. This 200-page book is written by three acclaimed
leaders in the field. The early access version is available now.
Download your free book today! http://p.sf.net/sfu/neotech_d2d_may
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
On 5/10/2013 11:10 AM, Kern Sibbald wrote: On 05/10/2013 04:12 PM, Martin Simmons wrote: Can you indicate where the kludge is please? Changer Command = and Changer Device = /dev/null Is this documented anywhere, out of curiosity? I don't think it is general knowledge. I probably should have called the resource VirtualChanger. I guess I can still do so ... Also, do the Device resources need AutoChanger = yes like in the other examples? No, and I you don't need the Drive Index = either, since in both cases it is not a real autochanger. The autochanger code is called, but when it sees it is a virtual changer, How does it see this? Because the Changer Command is blank? it just returns, and the Bacula SD core code just handles it correctly. The main effect of this form of the Autochanger resource is to group the Devices so you can access any one of them with a single name. If you start using different directories as Archive Device names, there might be problems, unless you make a simultaneous change to the Media Type. It was so simple that in the beginning I couldn't believe that it would work correctly in all cases, but it does. Kern -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
On 05/10/2013 10:10 AM, Kern Sibbald wrote: On 05/10/2013 04:12 PM, Martin Simmons wrote: Can you indicate where the kludge is please? Changer Command = and Changer Device = /dev/null RGHH!!! maybe I should have posted this 1. Autochanger. Can I just omit the Changer Command = (or set it to /bin/true) and it'll magically work? Or do I have to have a fake autochanger script -- and if I do, how is it supposed to work... to the -devel list because clearly no-one who can answer it reads the -users. ... It was so simple that in the beginning I couldn't believe that it would work correctly in all cases, but it does. Yes, I believe I expressed my surprise that bacula doesn't seem to support something that simple, only to be told that bacula is multithreaded and therefore it's very complicated. I read the the autochanger resource section in TFM before starting this thread. There's no way anyone can possible figure out that setting Changer Command = Changer Device = /dev/null will work and not send your backups to /dev/null. So don't be surprised that no one mentioned Bacula's built-in virtual autochanger feature that has been there for years -- nobody knew about it until just now. -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] RAIT anyone?
Now that we know there is a way to use multiple disks without adding the 'moving symlink' script (thanks Kern), is there by any chance an undocumented trick to write two copies of the same job at once? (aka RAIT.) Like maybe listing two Pools in the JobDef? The goal is to have 2 copies of the volume file on 2 different disks so that if the main disk decides to shed magnetic layer off its platters, I can remount the copy disk as bacula's backup Device and keep going. The closest I can see in the docs is a Copy job, and that has a few problems: 1. Documentation is sketchy. 2. I'm not sure what to make of when a job record is purged (deleted) from the catalog, it will promote the copy: I'm looking for an exact copy I can just swap in if the original dies of media failure. No metadata tweaking required. 3. There seems to be room for media failure between the time main jobs finish and the copy job kicks in. It also seems a media failure in the middle of the main job will kill the whole run. With RAIT, you write two copies at once and if one device fails you just keep going, writing to the other one. So am I better off just rsync'ing the disks from RunScript? TIA -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] RAIT anyone?
(forgot to cc the list) On 05/10/2013 02:42 PM, Edward M. Markowski wrote: Any reason you can't set your disks up in a RAID1 configuration? Yesno: We had problems with mdadm and some sata controllers. Whether I can configure 12 disks into 6 *stable* md raids remains to be seen. Device utilization: I only need one copy disk, though I'd use 2 to be on the safe side. Other 10 can go into main autochanger. It's no big deal, we'll just have to replace the disks more often. Replacing disks is more work and has to be done more often with 6 raid devices as opposed to 10 plain disks. Obviously, the show-stopper would be #1 if mdadm turns out to be unhappy with that particular hba card. Everything else I could live with, but would rather not. Btrfs would be another option if it weren't experimental... -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] RAIT anyone?
On 05/10/2013 03:47 PM, Edward M. Markowski wrote:
... it is howeaver a much more interesting problem ...
Which is why the best way to do it is at the source: have the storage
write to multiple devices. E.g. in amanda you can specify the device as
rait: { /storage/device/one, /storage/device/two }.
--
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu
signature.asc
Description: OpenPGP digital signature
--
Learn Graph Databases - Download FREE O'Reilly Book
Graph Databases is the definitive new guide to graph databases and
their applications. This 200-page book is written by three acclaimed
leaders in the field. The early access version is available now.
Download your free book today! http://p.sf.net/sfu/neotech_d2d_may___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] RAIT anyone?
On Fri, May 10, 2013 at 15:20:37PM -0500, Dimitri Maziuk wrote: Any reason you can't set your disks up in a RAID1 configuration? We had problems with mdadm and some sata controllers. Whether I can configure 12 disks into 6 *stable* md raids remains to be seen. Linux software RAID works pretty much flawlessly. It's often advised to ditch hardware RAID, as that approach both limits flexibility as well as locking you in. That said, the component drives *must* have TLER turned *OFF* (many drives do not have that option, so be careful). Obviously, the show-stopper would be #1 if mdadm turns out to be unhappy with that particular hba card. If you're going to be using a SAN setup (e.g. fiber HBA), then you'd have to see what the SAN is capable of, although I daresay many of them would easily support something like that (invisible replication). I don't think you'd need mdadm when using a modern-ish SAN, anyway. Another possible idea to consider might be network RAID, Linux-style, using NDB/DRDB/AoE, etc. -- Henry Yen Aegis Information Systems, Inc. Senior Systems Programmer Hicksville, New York -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] RAIT anyone?
On 05/10/2013 05:30 PM, Henry Yen wrote: Linux software RAID works pretty much flawlessly. That may be, but I had a system with 11 disks raided between an on-board sata controller (5 free ports IIRC) and an off-board sata controller (8 ports) and it crashed on every access to disks connected to the off-board card. Without md the disks worked fine. So in my universe between mdadm, sata drivers, and controller hardware, it's only flawless if I ran the stress-tests myself. -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
On 05/10/2013 02:09 AM, Kern Sibbald wrote:
In the bacula-dir.conf file, define the autochanger in
the normal way for a physical tape autochanger library.
Does bacula-dir.conf side require Media Type and what should that be
if does? Or do I omit Media Type and have Autochanger = yes instead?
The example below uses the same Media Type for every device in the
autochanger -- contrary to what the fine manual seems to suggest --
should I do that and then (presumably) use Media Type = File1 in
bacula-dir.conf?
The fine manual reads like Media Type is very important and must be
present, but the autochanger device below doesn't have it. TFM also
implies Bad Thinkgs(tm) will happen if multiple device have the same
Media Type (File1 below).
In the bacula-sd.conf, one defines:
Autochanger {
Name = FileChgr1
Device = FileChgr1-Dev1, FileChgr1-Dev2
Changer Command =
Changer Device = /dev/null
}
Device {
Name = FileChgr1-Dev1
Media Type = File1
Archive Device = /tmp
LabelMedia = yes # lets Bacula label unlabeled media
Random Access = Yes
AutomaticMount = yes # when device opened, read it
RemovableMedia = no
AlwaysOpen = no
Maximum Concurrent Jobs = 5
}
Device {
Name = FileChgr1-Dev2
Media Type = File1
Archive Device = /tmp
LabelMedia = yes # lets Bacula label unlabeled media
Random Access = Yes
AutomaticMount = yes # when device opened, read it
RemovableMedia = no
AlwaysOpen = no
Maximum Concurrent Jobs = 5
}
Thanks again,
--
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu
signature.asc
Description: OpenPGP digital signature
--
Learn Graph Databases - Download FREE O'Reilly Book
Graph Databases is the definitive new guide to graph databases and
their applications. This 200-page book is written by three acclaimed
leaders in the field. The early access version is available now.
Download your free book today! http://p.sf.net/sfu/neotech_d2d_may___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] RAIT anyone?
Now that we know there is a way to use multiple disks without adding the 'moving symlink' script (thanks Kern), is there by any chance an undocumented trick to write two copies of the same job at once? (aka RAIT.) Like maybe listing two Pools in the JobDef? Unlikely. Building redundancy at this level when RAID already exists seems like a waste of effort. I see from your other posts that you have problems with RAID on your hardware... seems that fixing your hardware would be the best way to proceed. James -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
Yes, Media Type is very important. It must
be in the Storage resources on the Director
side, and notice that as I mentioned before, on
the SD side, Autochanger really just groups a
number of Devices. The Media Type must be
in each Device, because each one can be different
so it is not in the Autochanger resource.
There is no restriction for multiple devices to have
the same Media Type, but if they are disk devices
and don't have the same Archive Device, Bacula
won't be able to mount them. So, use the same
Media Type only in Devices that have the same Archive
Device.
Kern
On 05/11/2013 01:16 AM, Dimitri Maziuk wrote:
On 05/10/2013 02:09 AM, Kern Sibbald wrote:
In the bacula-dir.conf file, define the autochanger in
the normal way for a physical tape autochanger library.
Does bacula-dir.conf side require Media Type and what should that be
if does? Or do I omit Media Type and have Autochanger = yes instead?
The example below uses the same Media Type for every device in the
autochanger -- contrary to what the fine manual seems to suggest --
should I do that and then (presumably) use Media Type = File1 in
bacula-dir.conf?
The fine manual reads like Media Type is very important and must be
present, but the autochanger device below doesn't have it. TFM also
implies Bad Thinkgs(tm) will happen if multiple device have the same
Media Type (File1 below).
In the bacula-sd.conf, one defines:
Autochanger {
Name = FileChgr1
Device = FileChgr1-Dev1, FileChgr1-Dev2
Changer Command =
Changer Device = /dev/null
}
Device {
Name = FileChgr1-Dev1
Media Type = File1
Archive Device = /tmp
LabelMedia = yes # lets Bacula label unlabeled media
Random Access = Yes
AutomaticMount = yes # when device opened, read it
RemovableMedia = no
AlwaysOpen = no
Maximum Concurrent Jobs = 5
}
Device {
Name = FileChgr1-Dev2
Media Type = File1
Archive Device = /tmp
LabelMedia = yes # lets Bacula label unlabeled media
Random Access = Yes
AutomaticMount = yes # when device opened, read it
RemovableMedia = no
AlwaysOpen = no
Maximum Concurrent Jobs = 5
}
Thanks again,
--
Learn Graph Databases - Download FREE O'Reilly Book
Graph Databases is the definitive new guide to graph databases and
their applications. This 200-page book is written by three acclaimed
leaders in the field. The early access version is available now.
Download your free book today! http://p.sf.net/sfu/neotech_d2d_may
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] RAIT anyone?
Hello, As James points out a RAID 1 (mirror) is not in our plans. However, making two copies of the same backup on two different Devices is something that is very likely to happen before the end of the year. The first cut will be to write to two or more devices in the same SD. The second cut will be to write to more than 1 SD. Regards, Kern On 05/11/2013 03:56 AM, James Harper wrote: Now that we know there is a way to use multiple disks without adding the 'moving symlink' script (thanks Kern), is there by any chance an undocumented trick to write two copies of the same job at once? (aka RAIT.) Like maybe listing two Pools in the JobDef? Unlikely. Building redundancy at this level when RAID already exists seems like a waste of effort. I see from your other posts that you have problems with RAID on your hardware... seems that fixing your hardware would be the best way to proceed. James -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
