Re: [Bacula-users] RE Job failed, how to recycle only volumes
True.
-Original Message-
From: Martin Simmons [mailto:mar...@lispworks.com]
Sent: Monday, April 29, 2013 1:42 PM
To: Conrad Lawes
Cc: bacula-users@lists.sourceforge.net; leon.wh...@greenpeace.org
Subject: Re: [Bacula-users] RE Job failed, how to recycle only volumes
>>>>> On Mon, 29 Apr 2013 12:14:46 -0400, Conrad Lawes said:
>
> I wrote a little bash script that demonstrates how to query to bacula tables
> in postgresql database and purge volumes for a given job. The same can be
> accomplished for mysql
> In the example below, I am searching for job ID 8431.
>
>
> ---code-
> #!/bin/bash
> volumes=`psql -U bacula bacula -c "select distinct media.volumename from
> media,jobmedia where jobmedia.mediaid = media.mediaid and jobmedia.jobid=8431
> order by media.volumename;" | grep -v volumename | grep -v '(' | grep -v
> '-'`
>
> for vol in $volumes
> do
> echo "Purging volume $vol"
> /usr/sbin/bconsole << EOF
> purge volume=$vol
> EOF
> done
This is dangerous if you have more than 1 job per volume.
__Martin
--
Try New Relic Now & We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service
that delivers powerful full stack analytics. Optimize and monitor your
browser, app, & servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] RE Job failed, how to recycle only volumes
I wrote a little bash script that demonstrates how to query to bacula tables in
postgresql database and purge volumes for a given job. The same can be
accomplished for mysql
In the example below, I am searching for job ID 8431.
---code-
#!/bin/bash
volumes=`psql -U bacula bacula -c "select distinct media.volumename from
media,jobmedia where jobmedia.mediaid = media.mediaid and jobmedia.jobid=8431
order by media.volumename;" | grep -v volumename | grep -v '(' | grep -v '-'`
for vol in $volumes
do
echo "Purging volume $vol"
/usr/sbin/bconsole << EOF
purge volume=$vol
EOF
done
--
Try New Relic Now & We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service
that delivers powerful full stack analytics. Optimize and monitor your
browser, app, & servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula deficiency
No, I don't use JobDefs. I'll do some research on JobDefs to see how useful
this option can be.
Thanks for the pointer.
-Original Message-
From: Dan Langille [mailto:d...@langille.org]
Sent: Tuesday, February 05, 2013 1:03 PM
To: Conrad Lawes
Cc: bacula-users@lists.sourceforge.net
Subject: RE: [Bacula-users] Bacula deficiency
On 2013-02-05 12:54, Conrad Lawes wrote:
> -Original Message-
> From: Dan Langille [mailto:d...@langille.org]
> Sent: Tuesday, February 05, 2013 11:29 AM
> To: Conrad Lawes
> Cc: bacula-users@lists.sourceforge.net
> Subject: Re: [Bacula-users] Bacula deficiency
>
> On 2013-02-05 10:44, Conrad Lawes wrote:
>> Overall, I'm fairly happy in with Bacula. It has saved me thousand
>> of
>> $$ migrating from Arkeia Network Backup software. However, there is
>> one shortfall that is causing me some grief and I don't see any easy
>> solution to: Bacula does not provide a "last of the month"
>> feature in its scheduling option.
>>
>> I wish to run an offsite backup to tape on the last Friday of each
>> month. Bacula provides 1st-5th day of the week option. Although,
>> most
>> months contain only 4 Fridays, some contain 5 (last January for
>> example). If I set the schedule to include the 4th and 5th Friday, I
>> will get 2 offsite backups for the months containing 5 Friday. I
>> don't
>> want this because it wastes limited disk space in my D2D2T
>> configuration. Manual intervention seems to be only solution but
>> this
>> defeats the "set it and forget it" paradigm that I'm seeking.
>>
>> I am hoping someone has solution to this dilemma.
>
> Script it. Run the job on both the 4th and the 5th Fridays.
>
> Add a run before script. In the script, check to see if there is a
> 5th
> Friday.
> If so, and we're on the 4th Friday, cancel the job.
On 2013-02-05 12:54, Conrad Lawes wrote:
> Ouch! I was afraid of this option. Since the RunBefore script is
> defined at the job level, this would mean that I will have to define
> additional backup jobs for each client (20). Presently, my main
> schedule contains multiple run times:
>
> Schedule {
> Name = WeeklyCycle
> Run = Level=Incremental Pool=DailyBackupPool mon-thu at 19:00
> Run = Level=Full Pool=WeeklyBackupPool 1st-3rd fri at 17:00
> Run = Level=Full Pool=OffsiteBackupPool 4th-5th fri at 17:00
> }
>
> .. and so my job definitions are simple:
>
> Job {
> Name = Server1-BackupJob
> Client = server1-fd
> Type = Backup
> Level = Incremental
> Schedule = WeeklyCycle
>
> }
>
> The scripting approach is going to require new schedule and job
> definitions for EACH client resulting in a larger and more complex
> configuration file.
> A simple, "Run = Level=Full Pool=OffsiteBackupPool last fri at 17:00"
> would be much more efficient...
Each job? Can't you add a Run directive to your JobDefs? Are you
using JobDef?
Or am I misunderstanding the issue?
--
Dan Langille - http://langille.org/
--
Free Next-Gen Firewall Hardware Offer
Buy your Sophos next-gen firewall before the end March 2013
and get the hardware for free! Learn more.
http://p.sf.net/sfu/sophos-d2d-feb
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula deficiency
Ouch! I was afraid of this option. Since the RunBefore script is defined at
the job level, this would mean that I will have to define additional backup
jobs for each client (20). Presently, my main schedule contains multiple run
times:
Schedule {
Name = WeeklyCycle
Run = Level=Incremental Pool=DailyBackupPool mon-thu at 19:00
Run = Level=Full Pool=WeeklyBackupPool 1st-3rd fri at 17:00
Run = Level=Full Pool=OffsiteBackupPool 4th-5th fri at 17:00
}
.. and so my job definitions are simple:
Job {
Name = Server1-BackupJob
Client = server1-fd
Type = Backup
Level = Incremental
Schedule = WeeklyCycle
}
The scripting approach is going to require new schedule and job definitions
for EACH client resulting in a larger and more complex configuration file.
A simple, "Run = Level=Full Pool=OffsiteBackupPool last fri at 17:00" would be
much more efficient...
-Original Message-
From: Dan Langille [mailto:d...@langille.org]
Sent: Tuesday, February 05, 2013 11:29 AM
To: Conrad Lawes
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Bacula deficiency
On 2013-02-05 10:44, Conrad Lawes wrote:
> Overall, I'm fairly happy in with Bacula. It has saved me thousand of
> $$ migrating from Arkeia Network Backup software. However, there is
> one shortfall that is causing me some grief and I don't see any easy
> solution to: Bacula does not provide a "last of the month"
> feature in its scheduling option.
>
> I wish to run an offsite backup to tape on the last Friday of each
> month. Bacula provides 1st-5th day of the week option. Although, most
> months contain only 4 Fridays, some contain 5 (last January for
> example). If I set the schedule to include the 4th and 5th Friday, I
> will get 2 offsite backups for the months containing 5 Friday. I
> don't
> want this because it wastes limited disk space in my D2D2T
> configuration. Manual intervention seems to be only solution but this
> defeats the "set it and forget it" paradigm that I'm seeking.
>
> I am hoping someone has solution to this dilemma.
Script it. Run the job on both the 4th and the 5th Fridays.
Add a run before script. In the script, check to see if there is a 5th
Friday.
If so, and we're on the 4th Friday, cancel the job.
--
Dan Langille - http://langille.org/
--
Free Next-Gen Firewall Hardware Offer
Buy your Sophos next-gen firewall before the end March 2013
and get the hardware for free! Learn more.
http://p.sf.net/sfu/sophos-d2d-feb
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula deficiency
Overall, I'm fairly happy in with Bacula. It has saved me thousand of $$ migrating from Arkeia Network Backup software. However, there is one shortfall that is causing me some grief and I don't see any easy solution to: Bacula does not provide a "last of the month" feature in its scheduling option. I wish to run an offsite backup to tape on the last Friday of each month. Bacula provides 1st-5th day of the week option. Although, most months contain only 4 Fridays, some contain 5 (last January for example). If I set the schedule to include the 4th and 5th Friday, I will get 2 offsite backups for the months containing 5 Friday. I don't want this because it wastes limited disk space in my D2D2T configuration. Manual intervention seems to be only solution but this defeats the "set it and forget it" paradigm that I'm seeking. I am hoping someone has solution to this dilemma. Thanks. [cid:image001.jpg@01CE038B.AD727520]Conrad Lawes| Systems Administrator | visit us at www.navtech.aero<http://www.navtech.aero/> <>-- Free Next-Gen Firewall Hardware Offer Buy your Sophos next-gen firewall before the end March 2013 and get the hardware for free! Learn more. http://p.sf.net/sfu/sophos-d2d-feb___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] The next tapes that Bacula will need
At my company, we store our backup tapes offsite with a storage provider. We have 28-day retention policy for weekly backups. May times I not sure which tapes Bacula will need for the coming weekly schedule. As a result, I oftentime have to manually change the volume status in the autochanger so that Bacula completes the weekly backup jobs. Is there a way to query the bacula catalog to determine the tapes that Bacula will need for the next weekly backup? Thanks. Conrad Lawes | Systems Administrator | cla...@navtech.aero | Phone: 519-747-1170 ext 254 | Skype: conrad.lawes | Website: http://www.navtech.aero -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Scheduling jobs for the last Saturday of each month
Bacula doesn't appear to have a "last of the month" option. Is there a way to schedule jobs to occur on say the last Saturday of each month? TIA Conrad Lawes | Systems Administrator | cla...@navtech.aero | -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Table containing filesets
I've been searching the bacula database but can 't find any table where the fileset and the list of included folders/files are defined. Any suggestion? -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Removing tape from library
Radosław, you have my attention. Could you elaborate more on "you can use Admin job which will change volume status when it is not available in tape library" What is an admin job? How does one create a job to change volume status when a tape is not available? I assume this involves some sql query? From: Radosław Korzeniewski [rados...@korzeniewski.net] Sent: Friday, March 30, 2012 3:11 AM To: Conrad Lawes; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Removing tape from library Hello, 2012/3/29 Conrad Lawes mailto:cla...@navtech.aero>> I want Bacula to automatically use another tape after a given amount of time if the preferred "Append" tape is not available . First of all, there is a "Used" status which is more appropriate then "Full". "Full" means no more data could be physically written to archive media. Then you can use "Volume usage duration" if you want to automatically change a volume status after a specified amount of time or you can use Admin job which will change volume status when it is not available in tape library. -- Radosław Korzeniewski rados...@korzeniewski.net<mailto:rados...@korzeniewski.net> -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Removing tape from library
What I'm after is a more hands-off approach. A simple set-it and forget-it feature. I need Bacula to "make these decisions" without any human intervention. If the last tape with Append status is not available bacula should do the following: 1. Notify the backup admin 2. Then wait 2 hours for remedy 3. If the tape in question is still not available after 2 hours, use the next available tape. This way my backup still continues even if I neglect/forget to change volume status to Full. From: John Drescher [dresche...@gmail.com] Sent: Thursday, March 29, 2012 12:46 PM To: Conrad Lawes Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Removing tape from library > What is process for removing tapes that are not yet full from that tape > library? > When I remove a not-yet-full tape from tape library and neglect to change > its status to "Full", Bacula does not alert me that it's waiting for that > tape to be mounted. Furthermore, it does not attempt to use another tape. It > just patiently waits indefinitely. > > Is there a way to correct this behaviour? > > I want Bacula to automatically use another tape after a given amount of time > if the preferred "Append" tape is not available . > When I do this I mark the tape Full or used using bconsole. And then it does not give me problems as long as its retention period is not over. John -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Removing tape from library
What is process for removing tapes that are not yet full from that tape library? When I remove a not-yet-full tape from tape library and neglect to change its status to "Full", Bacula does not alert me that it's waiting for that tape to be mounted. Furthermore, it does not attempt to use another tape. It just patiently waits indefinitely. Is there a way to correct this behaviour? I want Bacula to automatically use another tape after a given amount of time if the preferred "Append" tape is not available . Conrad Lawes | Systems Administrator | cla...@navtech.aero | Phone: 519-747-1170 ext 254 | Skype: conrad.lawes | Website: http://www.navtech.aero -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Exchange 2007 backup
I am presently running Bacula 5.26 in production for a weeks now. I recently noticed that the bacula agent (v5.1) running on the Exchange server does not truncate the Exchange transaction log after a full backup is completed. As a result, the partition containing the transaction log is filling up. The Exchange server is running on Windows 2008 SP2 64-bit. Is there a way to configure Bacula to truncate the exchange transaction log are a successful full backup? Thanks. Conrad -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Exchange 2007 backup
I am presently running Bacula 5.26 in production for a weeks now. I recently noticed that the bacula agent (v5.1) running on the Exchange server does not truncate the Exchange transaction log after a full backup is completed. As a result, the partition containing the transaction log is filling up. Is there a way to configure Bacula to truncate the exchange transaction log are a successful full backup? Thanks. Conrad -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Flexible Scheduling
Jeremy, Thanks for the pointer. I did some reading on Bacula Job Priority settings and discovered the following tidbit: Bacula will not run jobs with differing priority levels simultaneously, even if the SD is configured to run more than one job concurrently. For instance, if you have 2 jobs scheduled to run at the same time but one Job has Priority=10 and the other has Priority=20, the SD will not run them at the same time even if the Maximum Concurrent Job set is for 2 or higher. The SD will run the Job with priority 10 first. It will start the 2nd Job ONLY AFTER the 1st Job has terminated. So in the end, the solution to my problem is quite simple: Just make sure that the weekly full Backup Job and the Copy Job have different priority settings. Now I can enjoy my Sunday evenings again. Thanks to all for your responses. Cheers!!. From: Jeremy Maes [j...@schaubroeck.be] Sent: Thursday, March 01, 2012 2:42 AM To: Conrad Lawes Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Flexible Scheduling Op 1/03/2012 3:19, Conrad Lawes schreef: > I have a unique requirement and I'm not sure if Bacula can do this. Here > goes: > > I presently have 12 servers ( mixture of Windows and Linux) in my backup > rotation. I plan to add a couple more clients soon. From Monday to > Thursday, I do incremental backups to disk. On Friday a full weekly backup > is started. This full backup is also written to disk. The full backup > normally completes some time on Sunday evening. The end time varies > depending on the amount data that is being backed up. On Sunday, I also > have scheduled Copy job that archives the resent full backup to tape for > offsite storage. The Copy Job takes 48-68 hours to complete. Our offsite > storage provider picks up the tapes on Wednesday mornings. > > My problem is that sometimes the Copy-to-Tape job (D2T) starts BEFORE the > Full backup (D2D) has completed. When this happens, I have to intervene and > change the Copy Job schedule to later time to ensure that all the jobs in the > full backup are captured. Instead of fiddling with the schedule settings to > find the ideal time, I would like a flexible ( or scriptable??) scheduling > option would start the Copy Job ONLY after the weekly full backup has > completed. In so doing, I don't have to spend my Sunday evenings > monitoring backup jobs. > > > Any suggestion? Maybe use different priorities for your weekly full and your copy jobs, and disallow the running of mixed priority jobs? Regards, Jeremy DISCLAIMER http://www.schaubroeck.be/maildisclaimer.htm -- Virtualization & Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Flexible Scheduling
I have a unique requirement and I'm not sure if Bacula can do this. Here goes: I presently have 12 servers ( mixture of Windows and Linux) in my backup rotation. I plan to add a couple more clients soon. From Monday to Thursday, I do incremental backups to disk. On Friday a full weekly backup is started. This full backup is also written to disk. The full backup normally completes some time on Sunday evening. The end time varies depending on the amount data that is being backed up. On Sunday, I also have scheduled Copy job that archives the resent full backup to tape for offsite storage. The Copy Job takes 48-68 hours to complete. Our offsite storage provider picks up the tapes on Wednesday mornings. My problem is that sometimes the Copy-to-Tape job (D2T) starts BEFORE the Full backup (D2D) has completed. When this happens, I have to intervene and change the Copy Job schedule to later time to ensure that all the jobs in the full backup are captured. Instead of fiddling with the schedule settings to find the ideal time, I would like a flexible ( or scriptable??) scheduling option would start the Copy Job ONLY after the weekly full backup has completed. In so doing, I don't have to spend my Sunday evenings monitoring backup jobs. Any suggestion? Thanks. -- Virtualization & Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Automounting tape volumes for restoration
Hello Bacula Users, I having a little problem. I have an Exabyte LTO3 Tape Library with AutoChanger attached. Whenever I create a restoration job the Director reports that it is waiting for the Storage device to become available. At this point, I have to manually mount the tape volume that I need to restore from. Is there any way to force Bacula to auto mount the appropriate tape from the auto loader during a restore job? For backup jobs, tapes are mounted automatically as needed. I wish to do the same for restoration jobs. Thanks. -- Virtualization & Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
