Re: [Bacula-users] Volume Retention / Use Duration

2011-03-31 Thread Uwe Schuerkamp
Hello Jeremy  all, thanks much for your reply. 

On Wed, Mar 30, 2011 at 04:27:07PM +0200, Jeremy Maes wrote:


 Pool Type = Backup
 Recycle = yes
 AutoPrune = yes
 Volume Retention = 14 days
 Volume Use Duration = 6 days
 Recycle  Oldest Volume = yes
 Maximum Volumes = 3
 Label Format =Full-
  }
 
 Here you specify 3 volumes max, probably to make sure your incrementals 
 are still useful? (something you forgot to do for the incrementals 
 themselves I think)
 
 Why the 6 day use duration though? You say you want to do all full 
 backups on the same day. Do the backups take multiple days to complete?
  But I'm unsure about the use duration. Is there a better way to
  implement the above requirements?
 

I was hoping that when the 7th day in the cycle comes around with a
new full backup being due, bacula would note the max use duration and
create a new volume automatically (if max volumes isn't yet reached)
or recycle the oldest one, keeping two older full backups on the other
volumes. 

the backups themselves are rather smallish (the biggest is around
160G) and complete within a couple of hours after being started. 

Is there a more elegant way to keep two older volumes in the pool
without making use of max use duration? 

All the best, 

Uwe 

-- 
NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Volume Retention / Use Duration

2011-03-31 Thread Jeremy Maes
Op 31/03/2011 9:08, Uwe Schuerkamp schreef:
 Hello Jeremy  all, thanks much for your reply.

 On Wed, Mar 30, 2011 at 04:27:07PM +0200, Jeremy Maes wrote:

 Pool Type = Backup
 Recycle = yes
 AutoPrune = yes
 Volume Retention = 14 days
 Volume Use Duration = 6 days
 Recycle  Oldest Volume = yes
 Maximum Volumes = 3
 Label Format =Full-
 }
 Here you specify 3 volumes max, probably to make sure your incrementals
 are still useful? (something you forgot to do for the incrementals
 themselves I think)

 Why the 6 day use duration though? You say you want to do all full
 backups on the same day. Do the backups take multiple days to complete?
 I was hoping that when the 7th day in the cycle comes around with a
 new full backup being due, bacula would note the max use duration and
 create a new volume automatically (if max volumes isn't yet reached)
 or recycle the oldest one, keeping two older full backups on the other
 volumes.

It will indeed make the Volume get marked as Used after those 6 days 
when the next job starts (or you run a status dir from bconsole), 
making bacula search for another Volume that it can recycle (or create a 
new one).
Unless your backups run really long you can safely shorten this time to 
1 or 2 days, as long as you're sure no job will be running when the use 
duration (counted from the first write to the volume) expires.

 the backups themselves are rather smallish (the biggest is around
 160G) and complete within a couple of hours after being started.

 Is there a more elegant way to keep two older volumes in the pool
 without making use of max use duration?
If the amount of jobs writing to a full pool volume is a set number and 
isn't subject to frequent change, you could alternatively make use of 
the Maximum Volume Jobs parameter.
This will set the volume status to Used after the specified amount of 
jobs have been written, giving the same result.

Take care using this if you're doing all the backups concurrently 
though, in that case the Volume Use Duration is probably the best way to go.


Kind regards,
Jeremy

  DISCLAIMER 
http://www.schaubroeck.be/maildisclaimer.htm

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-users Digest, Vol 59, Issue 27

2011-03-31 Thread Dermot Beirne
Thanks for the reply John,
Re your response to my question about the MySQL version, the Bacula manual here:

http://www.bacula.org/5.0.x-manuals/en/main/main/Installing_Configuring_MySQ.html#SECTION00426

has a statement about upgrading MySql (at the very end of the article)
which says:

Upgrading MySQL

If you upgrade MySQL, you must reconfigure, rebuild, and re-install
Bacula otherwise you are likely to get bizarre failures. If you
install from rpms and you upgrade MySQL, you must also rebuild Bacula.
You can do so by rebuilding from the source rpm. To do so, you may
need to modify the bacula.spec file to account for the new MySQL
version.

Do you think this is now obsolete, and perhaps only relevant to older
versions of Bacula?

Dermot.


 Message: 20
 Date: Wed, 30 Mar 2011 16:41:48 -0400
 From: Josh Fisher jfis...@pvct.com
 Subject: Re: [Bacula-users] Moving a catalog due to performance issues
 To: bacula-users@lists.sourceforge.net
 Message-ID: 4d93958c.8030...@pvct.com
 Content-Type: text/plain; charset=ISO-8859-1; format=flowed

 On 3/30/2011 12:27 PM, Dermot Beirne wrote:
 Hello,
 I am using Bacula 5.0.3 on ubuntu 9.04

 I am have serious performance problems with migration speeds to tape.
 I have used the btape speed command to test the throughput of the disk
 to tape and it is achieving speeds of up to 6 times what my migration
 speed is getting, so I don't think it's the hardware.

 Someone asked if my catalog is on the same disks as the data being
 migrated, and it is.  I am not sure if this would be making such a
 huge difference, but I'm looking into moving it off the Bacula server
 to a remote server.

 I have some questions on doing this:

 1. Does it make sense.  Could it be having such a serious impact on
 the migration speeds, or should I look elsewhere first.  In case it's
 relevant, my Bacula server has a single Raid 5 array configured with
 LVM into two logical volumes. The catalog is on one, and the data on
 the other.

 It could possibly impact performance. If spooling, or at least spooling
 of attributes, is not being used, then this will cause disk thrashing,
 where the r/w heads of drives are constantly having to be moved back and
 forth to write to the catalog, then the data, then the catalog, then the
 data, etc.

 The simple solution is to turn on spooling and see if that makes a big
 improvement. Otherwise, to move the catalog to another server is
 possibly a solution, but it would then be limited by, and taking up,
 network bandwidth. It would be better to have another disk in the same
 server that was dedicated to the catalog.

 2. Does Bacula need to be on the box hosting the catalog, or is just
 having MySQL installed enough.

 Just MySQL.

 3. Can I dump and reload the catalog db from the Bacula server to the
 new remote server, change the catalog resource record, and continue
 using that.

 Yes, it is just a normal database.

 4. I am currently using mysql version:

 Server version: 5.0.75-0ubuntu10.5 (Ubuntu)

 I understand that unless I install this exact version on the remote
 server, I'll have to recompile Bacula.  Is this correct?

 No, that is not correct. Otherwise, a simple update of MySQL would
 render Bacula unusable.




 --

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] What happen if I change the client of a job ? Multi node virtualization cluster

2011-03-31 Thread Hugo Letemplier
2011/3/30 John Drescher dresche...@gmail.com:
 My first question is : How can I tell bacula to choose dynamically the
 client according to the result of a script ?


 You can script that by echoing commands to bconsole. Then execute your
 script as a cron job.

 My second question is : Can I safely/often change the client of a job
 without having bacula going bad ? Does a client change will create a
 rupture in my backups ? ( eg: Upgrading an incremental to full )


 I believe you will be fine to do this. Although it is not something I
 have done often.

 John


Hi

I just tried, the same job on two clients but using the same fileset,

= Run 1 time on 1 client.
Changed the client in the conf
= Run 1 time on the second client


Bacula upgraded my incremental job to a full. That would be nice to
limit the client rôle to a way of accessing the content.
Is there a way to force this like if you do it with ignore fileset changes ?

I don't install the file daemon on the VM to backup because I need
to use LVM snapshots. LVM management is done directly on the physical
host and not on the client.
Then I use the strippath option of the fileset in order to backup the
snapshot without the full path to its mount point.

***
For the moment, I will just run a before job script that fails the job
to run on a bad client ( eg: the machine is migrated on another node
).
In my virtual environnent virtual machines are just migrated if there
is a problem so most of the time they stays on there original node and
so it isn't mandatory to attribute dynamically the client. To foresee
futures evolutions of my cluster's architecture that would be a good
solution to backup my VMs even if they aren't on the original node.
***

The ideal thing would be to use a variable for the client name ; to
set this variable at the good value ( Node name ) with a before job
script ; and then to mount snapshot and execute the job on the good
node (client or fd) of the virtualization cluster.

I use Proxmox with DRBD for my cluster management.

Does anyone have a solution ?

thanks

Hugo

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] What happen if I change the client of a job ? Multi node virtualization cluster

2011-03-31 Thread John Drescher
 Using a cron is not a good solution, I prefer to keep job management
 and scheduling inside bacula .

You could also schedule an admin job inside bacula runs the admin job
you can run your script.

John

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Disaster Recovery

2011-03-31 Thread Mike Hendrie
Question: In the event of my entire bacula system going down. What is the
best method for recovery? I looked in the online manual, but it still was
not very clear to me.

If I have my backup of catalog files, all incremental and full backups, and
I reinstall bacula on a new server. How do I recover the data?

Can I restore the catalog to the new server?

Should I just virtualize my bacula server and keep a copy offsite for a
quick restore of the catalog?

Is there a way to recover the data without the catalog? Can bacula reindex
the files?

Do I also have to export the mysql database nightly so I can recover the
content along with my bacula catalog, system files, and backups?

Thanks
--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Disaster Recovery

2011-03-31 Thread John Drescher
 Question: In the event of my entire bacula system going down. What is the
 best method for recovery? I looked in the online manual, but it still was
 not very clear to me.

 If I have my backup of catalog files, all incremental and full backups, and
 I reinstall bacula on a new server. How do I recover the data?

 Can I restore the catalog to the new server?


Yes.


 Should I just virtualize my bacula server and keep a copy offsite for a
 quick restore of the catalog?

That is an option.


 Is there a way to recover the data without the catalog? Can bacula reindex
 the files?

Yes. bscan


 Do I also have to export the mysql database nightly so I can recover the
 content along with my bacula catalog, system files, and backups?


I do a catalog backup nightly to a disk volume (which is not on the
same server as the database) containing only catalogs. I also write a
bootstrap file for this so that I can manually recover the catalog I
want. You could do this outside of bacula with a nightly myswldump as
well. Remember to always keep a few catalogs. At one point over the 7+
years I have used bacula at work I corrupted my database and did not
know for 2 weeks..


John

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Disaster Recovery

2011-03-31 Thread John Drescher
On Thu, Mar 31, 2011 at 9:06 AM, Mike Hendrie m...@hendrienet.com wrote:
 Thank you John.

 Can you please explain to me the boot strap file? I am new to linux.


The bootstrap file is part of bacula. In the case of the catalog I
found it very important to manually extract the catalog I needed from
a disk volume with several copies of the catalog.

http://www.bacula.org/5.0.x-manuals/en/main/main/Bootstrap_File.html

John

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Volume Retention / Use Duration

2011-03-31 Thread Uwe Schuerkamp
On Thu, Mar 31, 2011 at 09:58:29AM +0200, Jeremy Maes wrote:

 Take care using this if you're doing all the backups concurrently 
 though, in that case the Volume Use Duration is probably the best way to go.

Hello Jeremy,

thanks again for your thoughts  support. I'll try the max use
duration then. 

All the best, Uwe 


-- 
NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [Bacula-devel] Feature request

2011-03-31 Thread Josh Fisher

On 3/30/2011 5:05 PM, Kern Sibbald wrote:
 Hello,

 Thank you for your feature request.  Unfortunately, I have no idea how to
 implement it, so unless you can provide some new insight, it will not help
 adding it to the projects file.

This can be done with a software transactional memory (STM) approach, 
and has been described for red-black tree traversal. If interested, see 
the Herlihy and Koskenin paper at 
ftp://ftp.cs.brown.edu/pub/techreports/07/cs07-08.pdf

 Best regards,

 Kern

 On Wednesday 30 March 2011 15:23:31 peterfl...@users.sourceforge.net wrote:
 Item n:   Add multi-threading to batch console
Origin: Peter Flasspeter_fl...@yahoo.com
Date:   30 Mar 2011
Status:

What:   When doing a restore building the directory tree
 takes an inordinate amount of time.  Multi core systems are
 common and could benefit from this.  On my dual-core 2.93GHz
 system looking at a full backup takes more than an hour
 (haven't actually timed it).  System monitor shows one CPU
 100% loaded and the other less than 5%.

Why:This would speed up restores at lot, especially
 important for critical files.

Notes:

 --
 Create and publish websites with WebMatrix
 Use the most popular FREE web apps or write code yourself;
 WebMatrix provides all the features you need to develop and
 publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
 ___
 Bacula-devel mailing list
 bacula-de...@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-devel

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Scheduling Question

2011-03-31 Thread Randy Katz
On 3/31/2011 4:43 AM, Alan Brown wrote:
 Randy Katz wrote:
 Hi,

 Now that I have used Bacula a full cycle (60 days) I have a question:

 If backups are done Full (which expires after 60 days).
 Then Diff each week and Incre each day where there is no Diff
 Then restoring from any given date going back 60 days is not a problem
 UNTIL the initial Full is replaced/overwritten. At that point all the 
 Diffs and Incre
 up to the next Full cannot be restored (as far as I can see anyways)

 Only if you overwrite the existing Full - which is a VERY BAD IDEA

 What happens if the backup in progress is interrupted, as a staring 
 point?

 You should _always_ have _at least_ 1 full backup of a fileset in the 
 system, preferably 2. Overwriting your only copy is a recipe for 
 disaster.

 Expire your Fulls at 60 days but expire the media they're on at 190 
 days (3*60 + a safety margin) - and keep the database entries at least 
 that long or you'll have to do any restores of older files the long way.





Alan, thank you for that answer and please excuse my questions:

1. Do you have a different expire time (60d) for your Full then your 
Incrementals or does it matter?
2. Which parameter are you referring to?
 a. Full Expiration - Is it File Retention or Job Retention or both?
 b. Expire Media - What parameter are you referring to?

Thank you in advance,
Randy

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-users Digest, Vol 59, Issue 27

2011-03-31 Thread Bob Hetzel
It still applies because bacula (and most everything else too nowadays from 
the look of things) uses shared libraries.  If you upgrade the libraries 
you may need to re-compile anything that was built with the old versions if 
you want rock solid reliability.  In my environment I kept getting crashes 
from bacula that would randomly start happening some time after installing 
updated OS and other programs, even though they were through normal OS 
update routines.  Since I took it upon myself to re-compile bacula every 
time I do a big swath of OS updates this has largely gone away.

Note that if you take that approach and don't load your patches frequently 
you'd be advised to get your firewall and other security settings as 
tightly restricted as possible.

Tiny little programs that don't stress the hardware may be a lot less 
susceptible but that's exactly what happens if you've got a big bacula 
installation doing a lot of parallel backups.  YMMV.


 From: Dermot Beirne dermot.bei...@dpd.ie
 Subject: Re: [Bacula-users] Bacula-users Digest, Vol 59, Issue 27
 To: bacula-users@lists.sourceforge.net
 Message-ID:
   AANLkTi=ghqrf4bnfr-sh-5vc+atmbh_ptnuxs9xqa...@mail.gmail.com
 Content-Type: text/plain; charset=ISO-8859-1

 Thanks for the reply John,
 Re your response to my question about the MySQL version, the Bacula manual 
 here:

 http://www.bacula.org/5.0.x-manuals/en/main/main/Installing_Configuring_MySQ.html#SECTION00426

 has a statement about upgrading MySql (at the very end of the article)
 which says:

 Upgrading MySQL

 If you upgrade MySQL, you must reconfigure, rebuild, and re-install
 Bacula otherwise you are likely to get bizarre failures. If you
 install from rpms and you upgrade MySQL, you must also rebuild Bacula.
 You can do so by rebuilding from the source rpm. To do so, you may
 need to modify the bacula.spec file to account for the new MySQL
 version.

 Do you think this is now obsolete, and perhaps only relevant to older
 versions of Bacula?

 Dermot.

 


--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Finding largest file(s) backed up for a specific job

2011-03-31 Thread John Stoffel

Guys,
I've been happily running bacula at home, and usualy it's pretty
predictable about the size of data backed up each night, but last
night I had an incremental run for a specfic client which used 8Gb of
data, when I normally expect around 500mb or so.  

Is there an easy mysql query I can use to:

a) find the largest file(s) backed up for a particular jobid?

b) report on the size of a directory and all the files backed up under
   it?  The idea being if that somehow I touched a million small files
   by accident, I can still find out what went on because I can sum up
   the change(s) on a per-directory basis.

You can see what I'm driving at by looking at these job results:

  Terminated Jobs:
   JobId  LevelFiles  Bytes   Status   FinishedName 
  ==
7157  Diff 53,34612.46 G  OK   27-Mar-11 02:00 jfsnew-fd
7158  Full  1158.0 M  OK   27-Mar-11 02:44
   BackupCatalog
7160  Incr  2,7751.244 G  OK   28-Mar-11 01:10 jfsnew-fd
7161  Full  1158.4 M  OK   28-Mar-11 01:14
   BackupCatalog
7163  Incr664457.0 M  OK   29-Mar-11 01:10 jfsnew-fd
7164  Full  1158.5 M  OK   29-Mar-11 01:11
   BackupCatalog
7166  Incr727423.0 M  OK   30-Mar-11 01:10 jfsnew-fd
7167  Full  1158.6 M  OK   30-Mar-11 01:11
   BackupCatalog
7169  Incr 64,4048.092 G  OK   31-Mar-11 01:21 jfsnew-fd
7170  Full  1167.8 M  OK   31-Mar-11 01:46
   BackupCatalog

Notice how the differential done last weekend backed up 53,000+ files,
and 12gb.  But last night it was 64,000+ files and 8gb.  I'm wondering
what happened  I have my suspicions, but now I'm trying to find
the culprits, if only so I can understand what's happening.

Thanks,
John


--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Scheduling Question

2011-03-31 Thread Alan Brown
Randy Katz wrote:

 Alan, thank you for that answer and please excuse my questions:
 
 1. Do you have a different expire time (60d) for your Full then your 
 Incrementals or does it matter?

I set the database file/job expire time to 100 years and simply roll the 
media, but we do full/diff/incremental in the same pool.

I did look at putting fulls in one pool and the rest in another but 
decided this is more trouble than it's worth.

 2. Which parameter are you referring to?
 a. Full Expiration - Is it File Retention or Job Retention or both?

Both

 b. Expire Media - What parameter are you referring to?

Volume expiry.

When a volume is purged its file/job data is automatically erased from 
the database anyway, with the effect being that we can restore any 
version of any file from the backup tapes, up to the oldest Full backup 
(and occasionally beyond).

If your database size is too big to handle then job/file retention could 
be shortened but I wouldn't do that if it can possibly be avoided 
(memory is cheap, the added time to bscan or be forced to do a full 
restore is not)






--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Scheduling Question

2011-03-31 Thread Randy Katz
On 3/31/2011 10:02 AM, Alan Brown wrote:
 Randy Katz wrote:

 Alan, thank you for that answer and please excuse my questions:

 1. Do you have a different expire time (60d) for your Full then your 
 Incrementals or does it matter?

 I set the database file/job expire time to 100 years and simply roll 
 the media, but we do full/diff/incremental in the same pool.

 I did look at putting fulls in one pool and the rest in another but 
 decided this is more trouble than it's worth.

 2. Which parameter are you referring to?
 a. Full Expiration - Is it File Retention or Job Retention or both?

 Both

 b. Expire Media - What parameter are you referring to?

 Volume expiry.

 When a volume is purged its file/job data is automatically erased from 
 the database anyway, with the effect being that we can restore any 
 version of any file from the backup tapes, up to the oldest Full 
 backup (and occasionally beyond).

 If your database size is too big to handle then job/file retention 
 could be shortened but I wouldn't do that if it can possibly be 
 avoided (memory is cheap, the added time to bscan or be forced to do a 
 full restore is not)

Well since I asked the question I have scripted a Pools.conf creation 
script for Full, Diff, and Incr for each Client to backup,
removed the Pools from bacula-dir.conf and added an Include 
(@/etc/bacula/conf.d/pools.conf). It didn't take very long and
if anything needs to change is trivial to reconfigure now. As for 
retaining a Full backup for so long, why is it so necessary if
I have a Full being created every month with a 3 Volume Retention and a 
Time of 60d then there should never be a time when
there is no Full before Diff/Incr's, right? If I wanted a 180 day cycle 
then would want to extend that to the incrementals and
diffs as well, right?

Regards,
Randy

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] bat crashes to much ...

2011-03-31 Thread Paulo Martinez
I just wonder if there are any accessible
devel version or nightly builds of the bat.

If so - there will be a protocol mismatch, right?

But i would like to test a current version,
if needed also with an updated dir and sd daemon.

Is anyone using/testing 5.1 as non developer?

Thx

PM


--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Device FileStorage is not open or does not exist

2011-03-31 Thread Kenney, William P. (Information Technology Services)
Hello all,

 

I have given up on RHES 6 for now and I am using Ubuntu 10.10 Server
with Bacula 5.0.2

 

I have followed the Documentation's tutorial to get the system
configured but while in the console portion (pages 98 - 101) I enter
status storage and get Device FileStorage is not open or does not
exist

 

If I continue with run I get the menu as described in the docs, select
1, and get a message indicating a termination error.

 

Any ideas as to what I haven't properly configured?

 

Bill

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Device FileStorage is not open or does not exist

2011-03-31 Thread Kleber Leal
Probably you has not created the directory defined into bacula-sd.conf file.

Kleber

2011/3/31 Kenney, William P. (Information Technology Services) 
kenn...@easternct.edu

 Hello all,



 I have given up on RHES 6 for now and I am using Ubuntu 10.10 Server with
 Bacula 5.0.2



 I have followed the Documentation's tutorial to get the system configured
 but while in the console portion (pages 98 - 101) I enter status storage and
 get Device FileStorage is not open or does not exist



 If I continue with run I get the menu as described in the docs, select 1,
 and get a message indicating a termination error.



 Any ideas as to what I haven't properly configured?



 Bill


 --
 Create and publish websites with WebMatrix
 Use the most popular FREE web apps or write code yourself;
 WebMatrix provides all the features you need to develop and
 publish your website. http://p.sf.net/sfu/ms-webmatrix-sf

 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Device FileStorage is not open or does not exist

2011-03-31 Thread Kenney, William P. (Information Technology Services)
Thanks, I'll check the SD config file closely.

 

Bill

 

 

From: Kleber Leal [mailto:kleber.l...@gmail.com] 
Sent: Thursday, March 31, 2011 8:49 PM
To: bacula-users
Subject: Re: [Bacula-users] Device FileStorage is not open or does not
exist

 

Probably you has not created the directory defined into bacula-sd.conf
file.

Kleber

2011/3/31 Kenney, William P. (Information Technology Services)
kenn...@easternct.edu

Hello all,

 

I have given up on RHES 6 for now and I am using Ubuntu 10.10 Server
with Bacula 5.0.2

 

I have followed the Documentation's tutorial to get the system
configured but while in the console portion (pages 98 - 101) I enter
status storage and get Device FileStorage is not open or does not
exist

 

If I continue with run I get the menu as described in the docs, select
1, and get a message indicating a termination error.

 

Any ideas as to what I haven't properly configured?

 

Bill



--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself;
WebMatrix provides all the features you need to develop and
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Finding largest file(s) backed up for a specific job

2011-03-31 Thread John Stoffel

John I've been happily running bacula at home, and usualy it's pretty
John predictable about the size of data backed up each night, but
John last night I had an incremental run for a specfic client which
John used 8Gb of data, when I normally expect around 500mb or so.

John Is there an easy mysql query I can use to:

John a) find the largest file(s) backed up for a particular jobid?

Ok, I've googled, read back in the archives about the File.LStat field
and how the file size is in a strange Base64 (almost) encodiing which
needs to be hacked on to get out the sizes.

Looks like I'll just need to:

1. write a perl script to read in a jobid, then pull out the files
from that job.
2. For each file, pull out the File.LStat field and decode the info.
3. And finally then I can search for the largest file(s).  

I'll post something when I'm done.  I'd prefer to do it in mysql
directly, but it looks too funky to parse the string properly without
writing really crazy (to me!) SQL procedures or cursors.  Not worth
it.

Thanks,
John

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Scheduling Question

2011-03-31 Thread Randy Katz
On 3/31/2011 10:20 AM, Randy Katz wrote:
 On 3/31/2011 10:02 AM, Alan Brown wrote:
 Randy Katz wrote:

 Alan, thank you for that answer and please excuse my questions:

 1. Do you have a different expire time (60d) for your Full then your
 Incrementals or does it matter?
 I set the database file/job expire time to 100 years and simply roll
 the media, but we do full/diff/incremental in the same pool.

 I did look at putting fulls in one pool and the rest in another but
 decided this is more trouble than it's worth.

 2. Which parameter are you referring to?
  a. Full Expiration - Is it File Retention or Job Retention or both?
 Both

  b. Expire Media - What parameter are you referring to?
 Volume expiry.

 When a volume is purged its file/job data is automatically erased from
 the database anyway, with the effect being that we can restore any
 version of any file from the backup tapes, up to the oldest Full
 backup (and occasionally beyond).

 If your database size is too big to handle then job/file retention
 could be shortened but I wouldn't do that if it can possibly be
 avoided (memory is cheap, the added time to bscan or be forced to do a
 full restore is not)
 Well since I asked the question I have scripted a Pools.conf creation
 script for Full, Diff, and Incr for each Client to backup,
 removed the Pools from bacula-dir.conf and added an Include
 (@/etc/bacula/conf.d/pools.conf). It didn't take very long and
 if anything needs to change is trivial to reconfigure now. As for
 retaining a Full backup for so long, why is it so necessary if
 I have a Full being created every month with a 3 Volume Retention and a
 Time of 60d then there should never be a time when
 there is no Full before Diff/Incr's, right? If I wanted a 180 day cycle
 then would want to extend that to the incrementals and
 diffs as well, right?


List please disregard my last questions on this, I don't know what I was 
thinking. The first full cannot
expire until all pertinent (between the date of the First Full and the 
next Full) Incrementals and/or Differentials
have expired otherwise it renders them virtually useless.

Regards,
Randy

--
Create and publish websites with WebMatrix
Use the most popular FREE web apps or write code yourself; 
WebMatrix provides all the features you need to develop and 
publish your website. http://p.sf.net/sfu/ms-webmatrix-sf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users