Re: [Bacula-users] Question about Volume Pools and Strategy

[Wesley Render]

In case this helps anyone. I ended up having problems with setting  
volume limits. For example I suddenly decided to adjust our  
incremental backups to run every 4 hours, and started reaching volume  
limits with errors.

 From what I have read in the documentation setting "Volume Use  
Duration" will effectively cause new volumes to be created, and old  
ones to be recycled based on the Volume Retention.  Since I monitor  
servers disk space and this is just disk based backup, if I get an  
alert that the storage space on the backup space is filling up I will  
then look at reducing the retention periods on the volume sets.

Here is what I have so far:

Pool {
   Name = office-p-monthly
   Pool Type = Backup
   Volume Retention = 6 months
   Recycle = yes
   AutoPrune = yes
   Action On Purge = Truncate
   LabelFormat = office-p-monthly-
   Volume Use Duration = 23h
   Maximum Volume Bytes = 100G
}
Pool {
   Name = office-p-weekly
   Pool Type = Backup
   Volume Retention = 1 months
   Recycle = yes
   AutoPrune = yes
   Action On Purge = Truncate
   LabelFormat = office-p-weekly-
   Volume Use Duration = 23h
   Maximum Volume Bytes = 100G
}
Pool {
   Name = office-p-daily
   Pool Type = Backup
   Volume Retention = 14 days
   Recycle = yes
   AutoPrune = yes
   Action On Purge = Truncate
   LabelFormat = office-p-daily-
   Volume Use Duration = 23h
   Maximum Volume Bytes = 100G
}
Pool {
   Name = datacenter-p-monthly
   Pool Type = Backup
   Volume Retention = 6 months
   Recycle = yes
   AutoPrune = yes
   Action On Purge = Truncate
   LabelFormat = datacenter-p-monthly-
   Volume Use Duration = 23h
   Maximum Volume Bytes = 100G
}
Pool {
   Name = datacenter-p-weekly
   Pool Type = Backup
   Volume Retention = 1 months
   Recycle = yes
   AutoPrune = yes
   Action On Purge = Truncate
   LabelFormat = datacenter-p-weekly-
   Volume Use Duration = 23h
   Maximum Volume Bytes = 100G
}
Pool {
   Name = datacenter-p-daily
   Pool Type = Backup
   Volume Retention = 14 days
   Recycle = yes
   AutoPrune = yes
   Action On Purge = Truncate
   LabelFormat = datacenter-p-daily-
   Volume Use Duration = 23h
   Maximum Volume Bytes = 100G
}

Here are samples of the jobs:

Job {
   Name = web221-domainname
   Type = Backup
   Level = Incremental
   Client = web221.domainname.com-fd
   FileSet = OurFileSet
   Schedule = WeeklyCycle
   Storage = horde-sd
   Pool = Default
   Full Backup Pool = datacenter-p-monthly
   Incremental Backup Pool = datacenter-p-daily
   Differential Backup Pool = datacenter-p-weekly
   Accurate = Yes
   Messages = Standard
}

Job {
   Name = web220-domainname
   Type = Backup
   Level = Incremental
   Client = web220.domainname.com-fd
   FileSet = OurFileSet
   Schedule = WeeklyCycle
   Storage = office-sd
   Pool = Default
   Full Backup Pool = office-p-monthly
   Incremental Backup Pool = office-p-daily
   Differential Backup Pool = office-p-weekly
   Accurate = Yes
   Messages = Standard
}



-- 
Wesley Render, Consultant
OtherData

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Question about Volume Pools and Strategy

[Dimitri Maziuk]

On 11/05/2015 11:02 AM, Wesley Render wrote:
> 
> In case this helps anyone. I ended up having problems with setting  
> volume limits. For example I suddenly decided to adjust our  
> incremental backups to run every 4 hours, and started reaching volume  
> limits with errors.
> 
>  From what I have read in the documentation setting "Volume Use  
> Duration" will effectively cause new volumes to be created, and old  
> ones to be recycled based on the Volume Retention.  Since I monitor  
> servers disk space and this is just disk based backup, if I get an  
> alert that the storage space on the backup space is filling up I will  
> then look at reducing the retention periods on the volume sets.

FWIW I've been using

Pool {
...
Maximum Volumes = X
Maximum Volume Bytes = Y
Recycle = yes
AutoPrune = yes
Purge Oldest Volume = yes
Recycle Oldest Volume = yes
}

(where X*Y = 90-ish% of storage disk size) for years without problems.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] KVM: backup with bacula

[Gilberto Nunes]

Hi friends

Somebody ont thisl ist make backup from KVM using bacula???
I have a bunch of file image that I've use with KVM.
Those files images are mustly raw or qcow2 format...
Is there any way to make full and incremental backup?
And how about restoration? It will work as expected?!?!

I know that is a lot of question... But I have some doubts about it...
Thanks a lot


-- 

Gilberto Ferreira
+55 (47) 9676-7530
Skype: gilberto.nunes36
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] KVM: backup with bacula

[Thing]

While I have not as yet done this to the file the kvm VM machine is a file
and you can move it and tar.gz ie its just 1s and 0s, so I cant see why
bacula would have a problem.   However I do presently backup the VM
machines with bacula-fd and the director and sd are all Vms and I have
restored files with no issues (both Vmware and kvm).

Just remember like a database the "file" will be constantly changing so the
machine will have to be turned off when you do a backup to make sure it is
consistent, hence I run a fd on each kvm which makes more sense IMHO.

If you do backup the one file you will have to restore the complete
machine, boot it and extract the file(s) you want, hard work IMHO when
having a fd on the client instead makes a restore trivial and quick.

On 6 November 2015 at 06:16, Gilberto Nunes 
wrote:

> Hi friends
>
> Somebody ont thisl ist make backup from KVM using bacula???
> I have a bunch of file image that I've use with KVM.
> Those files images are mustly raw or qcow2 format...
> Is there any way to make full and incremental backup?
> And how about restoration? It will work as expected?!?!
>
> I know that is a lot of question... But I have some doubts about it...
> Thanks a lot
>
>
> --
>
> Gilberto Ferreira
> +55 (47) 9676-7530
> Skype: gilberto.nunes36
>
>
>
> --
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] wiping test backups and starting again.

[Bryn Hughes]

It's worth considering a filesystem that supports error 
detection/correction such as ZFS... Though to really make use of that 
you need to have a machine with ECC RAM. Not sure what all you have for 
a layout, but bitflips in backup data can make for a bad time.


Generally speaking I doubt you'll see a massive difference in 
performance from one FS to the other when dealing with Bacula. Where you 
really notice a difference is things like "deleting a directory with 
10,000 files in it" which is one area where EXT* performs very poorly.  
That however isn't a use case that you'd encounter with Bacula (or 
really any other backup system apart from maybe some sort of rsync-based 
setup).  Raw sequential read/write performance won't be massively 
different one FS to another; at most you're probably talking about a few 
percentage points unless you've got something like a badly aligned RAID 
array underneath it all.  Either way it's usually network bandwidth 
that's the bottleneck rather than disk, unless you're trying to do a lot 
of simultaneous I/O.


Bryn

On 2015-11-03 12:23 PM, Thing wrote:
Hmm is there any difference in performance between file system types, 
ext4 and XFS?


hence why I pondered a re-format.



On 2 November 2015 at 14:36, Randy Katz > wrote:


Yes, however, formatting the disk is a bit extreme, you can just
go to the designated
directory and remove all the files, if it takes a while you can
background the task:

cd /baculabackupdirectory

nohup rm -f * &

or if you have subdirectories

nohup rm -rf * &



On 11/1/2015 11:01 AM, Thing wrote:

Hi,

Reading the FAQ,

cd /src/cats
./drop_mysql_tables
./make_mysql_tables

Then just format the disk to wipe the volumes?

Anything else needed to do?





--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] KVM: backup with bacula

[compdoc]

>Somebody ont thisl ist make backup from KVM using bacula???

 

If you have a VM guest, there's no reason you can't install the bacula client 
(FD) in the guest and back it up that way.

Also, baculasystems.com has plugins for KVM, XEN, and Hyper-v, but I don’t know 
the costs or how they work exactly. More info on their website...

 

 

 

 

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users