[Bacula-users] Migration job tape-to-tape with 1 drive
Version: Bacula 5.0.1
Hi
We use a disk-to-disk-to-tape backup workflow. We also defined a scratch
pool which holds some tapes.
Scenario:
If no disk/file volumes are available for writing anymore, a volume
(tape) from the scratch pool will be placed in the disk pool and the job
is written to that tape.
Afterwards the migration job wants to migrate to the next-pool tape
pool. Which is usually a disk-to-tape task. But if a tape of the scratch
pool is used, this would be a tape-to-tape task.
Currently we only have one drive available. Would this even be possible
without spooling?
The migration job looks like this:
Job {
Name = UpstageJob
Type = Migrate
Messages = Standard
Level = Full # Ignored
Client = bacula-master-fd # Ignored
FileSet = FullSet # Ignored
Maximum Concurrent Jobs = 4
Schedule = Daily 05:00
Pool = FilePool
Storage = FileStorage
Selection Type = Job
Selection Pattern = .*\.stage
Priority = 11 # run after DefaultJob job
}
I don't think it is possible nor a good idea if it would be possible. So
I am wondering if it is possible to change the selection pattern to only
match file/disk pools or if it is possible to place to tape of the
scratch pool back to another pool after writing, so the migration job
would not touch it?
Thanks for any help in advance.
Kind Regards
--
Adfinis SyGroup AG - Be smart. Think Open Source.
René Moser, Senior System Engineer
Brückfeldstrasse 21 | CH-3012 Bern
Tel.: +41 31 381 7047 | http://www.adfinis-sygroup.ch
signature.asc
Description: This is a digitally signed message part
--
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Connection Reset by Peer Error message
Hi Chris On Thu, 2012-01-26 at 13:29 -0500, Christopher Hylarides wrote: Scheduled time: 25-Jan-2012 22:00:00 Start time: 25-Jan-2012 22:00:01 End time: 26-Jan-2012 00:27:32 Elapsed time: 2 hours 27 mins 31 secs It is just a guess but it seems something is happening at 00:00. I think the default fd connect timeout is 30 minutes. Have you tried to schedule the job earlier or later than 00:00? Regards René -- Adfinis SyGroup AG - Be smart. Think Open Source. René Moser, Senior System Engineer Brückfeldstrasse 21 | CH-3012 Bern Tel.: +41 31 381 7047 | http://www.adfinis-sygroup.ch signature.asc Description: This is a digitally signed message part -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Storage Resouce address scripting?
Hi
We use dedicated backup networks.
This means, from the bacula-fds point of view, the storage daemon has
several different addresses depending on the clients network.
So, this means I need to define as much storage resources to the same
device as networks exists, which is kind of inconvenient.
I tried to script the storage resource address like
Storage {
...
Address = @|sh /etc/bacula/scripts/get-backup-network %n
...
}
or define the address on client side:
Storage {
...
Address = \\/etc/bacula/storage.conf
...
}
But this seems not to work as it expects to be a fqdn or IP only.
Any hints how to realize this without redefining the same storage
resource with different address over and over again?
Thx
--
Adfinis SyGroup AG - Be smart. Think Open Source.
René Moser, Senior System Engineer
Brückfeldstrasse 21 | CH-3012 Bern
Tel.: +41 31 381 7047 | http://www.adfinis-sygroup.ch
signature.asc
Description: This is a digitally signed message part
--
Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex
infrastructure or vast IT resources to deliver seamless, secure access to
virtual desktops. With this all-in-one solution, easily deploy virtual
desktops for less than the cost of PCs and save 60% on VDI infrastructure
costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula disk to tape config
On Fri, 2011-09-30 at 18:08 -0400, Dan Langille wrote: On Sep 27, 2011, at 12:42 PM, René Moser wrote: On Tue, 2011-09-27 at 16:51 +0100, Gavin McCullagh wrote: It sounds like what you're looking for could be implemented as: 1. A normal Full/Differential/Incremental job to a disk-based storage device to happen during the day. 2. A Migrate job to tape from disk to happen during the night. Yep, http://www.bacula.org/manuals/en/concepts/concepts/Migration_Copy.html is what I was looking for. Key point: A migrate or copy job can involved exactly one SD. Therefore, you cannot copy between SD. Thus, your single SD involved in this must store both the disk and the tape backups. I am not sure if I understand your point. SD = Storage Device, I guess. I can not migrate between a file storage device, to a tape storage device? But http://www.bacula.org/manuals/en/concepts/concepts/Migration_Copy.html#SECTION00164 does exactly show this by example right? Thanks for explaining again :) -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula disk to tape config
Hi We are currently using a proprietary backup solution, and we evaluation bacula to replace it. We have some 100 hosts to backup up. The current work flow is like: 1. backup server backups host files over working time to a disk volume on backup server. 2. During night, the disk volume is written to tape, verified, and the disk volume will be purged. The catalogue knows afterwards that the files have to be restored from tapes and no longer exists on disk volume. So during working day, the tape drive is accessible and we are able to restore files form the tapes. How can does be done with bacula? Thanks for any hints. Regards René -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula disk to tape config
On Tue, 2011-09-27 at 16:41 +0100, Alan Brown wrote: We are currently using a proprietary backup solution, Which proprietary backup system? BRU Backup Server We have some 100 hosts to backup up. The current work flow is like: Are these hosts PCs? What do they do? How much changes on them each night? Linux Servers (like Mailserver, Virtual Private Servers, Web servers, FTP Servers, etc.) We do differential backups. it really depends on the server how many files changed. The range is from a few MB to 2-3GB changes We do not backup every host during night, just a few per night on a day per week. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula disk to tape config
On Tue, 2011-09-27 at 16:51 +0100, Gavin McCullagh wrote: It sounds like what you're looking for could be implemented as: 1. A normal Full/Differential/Incremental job to a disk-based storage device to happen during the day. 2. A Migrate job to tape from disk to happen during the night. Yep, http://www.bacula.org/manuals/en/concepts/concepts/Migration_Copy.html is what I was looking for. To be honest though, the above work-flow raises a lot of questions for me: 1. You're doing backups of your live servers _during_ working hours. This is the opposite of what most people ordinarily do. Does this not create load on the already busy servers? Are the backups you get always in a consistent state? Okay, it is not _really_ during day it is more like backups over night to disk and backup to tape should be finished in the morning. But this is just a detail. We did not have (yet) really (big) problems about consistency. But as you say these systems are live systems and if a we hit a bad timing, that is always a problem. 2. It is apparently not possible to backup all 100 hosts straight to tape, so you write them to disk first. Why is that? It sounds like you're manually doing Spooling, which Bacula has transparent support for. You could, in Bacula, set up a single job which copied the backup data to disk first and then as that continues, spool them out to tape. This would need mean the two jobs happening at the same time, so you'd have to do it at night -- or else the tape drives would not be available during the day for restores. This may be a limitation of the current backup software in use. It may be faster this way (we are using a tape changer). We also have had troubles with some tape drives and this way (backup first to disk) was an advantage so the backup was already on disk and we just had to fix the tape changer and backup the disk volume to tape. I am really open do to it the bacula way if there is a better workflow. 3. Do you use Incremental backups at present or full backups each day? Actually mostly differentials. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula disk to tape config
On Tue, 2011-09-27 at 16:51 +0100, Gavin McCullagh wrote: 2. It is apparently not possible to backup all 100 hosts straight to tape, so you write them to disk first. Why is that? It sounds like you're manually doing Spooling, which Bacula has transparent support for. You could, in Bacula, set up a single job which copied the backup data to disk first and then as that continues, spool them out to tape. Do you have an example, how the spooling like you described can be implemented? -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
