Re: [Bacula-users] Configuration reload for bacula-sd
On 11/07/2014 04:48 PM, Dmitri Maziuk wrote: On 11/7/2014 7:10 AM, Kern Sibbald wrote: Hello, I am not sure, but it sounds like you are proposing that Bacula use a raw device for storing a Volume. This is possible. There might be a trivial advantage in terms of performance, but there is no real advantage or demand to do it. The advantage is you can pull the disk out and stick a new one in, just like you do with the tape. ... It is, in general, far better to store Volumes in a filesystem rather than on a raw disk for a number of reasons. It would even be preferable to dedicate a disk to Bacula and have a filesystem on it such as XFS rather than use it as a raw device. I agree, however, in the current implementation volumes are files that must reside in a single filesystem (or you need a fake autochanger). If volumes were directories (i.e. mountpoints), we could use multiple removable disks, pull full disk out, stick new one in. Maybe you can be more precise about what you want. Was that clear enough? I think so. If I understand correctly, you want disk mount points or directories to be treated much like a tape drive, so that you can mount multiple disks. I think this feature is already implemented, with one difference from what I believe you are requesting. Bacula can already deal with a mount point where the physical device is removable such as a USB key, providing your tell Bacula that it is removable. The difference is that when the device is mounted, it assumes that it has a filesystem on it rather than treating it as a raw device. When the device is first mounted, Bacula will scan for what volumes are on that device. Much like the Virtual Autochanger feature, I am not 100% sure where this is documented, so you may have to search for it. The main requirement for it to work is to configure the SD Device (even if it is a disk device) as removable. I wrote the code to handle backup to USB keys while I was on vacation -- I just plugged in any USB key, and if there were any Volumes on the device, they would be used, which is mostly what you are requesting. By the way, in case you have not noticed, there are three white papers posted on the bacula.org web site, two of them, if I am not mistaken, document Virtual Autochangers as implemented in the community version (slightly different from the Enterprise version). www.bacula.org - Documentation - White Papers Best regards, Kern Dima -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New Bacula Gui for Management Bacula
On 11/07/2014 10:46 AM, oliveiraped wrote: Hi To All Please check the new web gui for Bacula. Reportula is a php based web program that provides you a summarized output stats of Bacula Backups jobs, clients, volumes and director that have already run. It obtains its information from your catalog database. This is a fairly high level bacula management tool. Here are a few points that one user made concerning this important tool. It is web-based so can be accessed from anywhere. It packs a phenomenal amount of information into a single web-page – that I credit as being very good design! Features Display last jobs status Display volumes usage by pool Full supported MySQL, PostgreSQL databases. Show Jobs which executed with errors last day, week, month Show a condition of your Volumes Show terminated Jobs Search Jobs on several conditions The detailed information on Pools, Volumes, Storages and Clients Search options List the files stored on job Acl Supports and Login users support Integration with Active Directory or Ldap servers www.reportula.org Hi Oliver I installed reportula to test it out and on first attempt to configure via /index.php/install per the docs I get the following PHP error: Parse error: syntax error, unexpected '[' in /var/www/Reportula-master/vendor/laravel/framework/src/Illuminate/Support/helpers.php on line 411 that line in question is: $results = []; in the class_uses_recursive() function I am using PHP v5.3.29 on that server. Also, I tried to report this on your forum instead of on this list, but there is no sign-up link. Bill -- Bill Arlofski Reverse Polarity, LLC http://www.revpol.com/ -- Not responsible for anything below this line -- -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Migration needs volstat!=append, but how to reach? [Was: Re: [7.0.5] Option to start spooling before volume mount?]
Bezüglich John Lockard's Nachricht vom 26.10.2014 15:34 (localtime): I run into this issue with several of my servers and dealt with it by creating migrate jobs. Came to the same conclusion. Spooling doesn't make sense in it's current implementation for today's capacities. But there's another behaviour I'm fighting with: Volume Use Duration, defined in the director's pool resource, only has effect if I write (a second time) to the pool. This pool is only used as buffer for a second backup, which afterwards will be migrated to tape (and pruned immediatly, to get restore using the first backup which is on another (disk) pool and has sensible retention periods). So I write to a auto-labeled volume of this pool every weekend, to prepare tape-food (which could be much more easy if spooling would start without requireing the destination volume beeing labeled+mounted!!!). migration starts on Monday morning, not blocking other disk pools, hence plenty of time getting the duplicate backup migrated. But until the next time I write into that special buffer pool (which is not used by any other job until next weekend) the migration won't happen since the volstat stays append. I haven't found a way to get it into used. *How did you accomplish that?* console command with full volume name is no option! And any form of wildcard doesn't seem to work (e. g. telling alle volumes of a specific pool should be updated to have volstat=used. Thanks, -Harry signature.asc Description: OpenPGP digital signature -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuration reload for bacula-sd
On 11/8/2014 5:36 AM, Kern Sibbald wrote: I think so. If I understand correctly, you want disk mount points or directories to be treated much like a tape drive, so that you can mount multiple disks. I think this feature is already implemented, with one difference ... that when the device is mounted, it assumes that it has a filesystem on it rather than treating it as a raw device. Either way works, filesystem makes it easy to see what's on it, but you have to mkfs on a new disk. Much like the Virtual Autochanger feature, I am not 100% sure where this is documented, so you may have to search for it. The main requirement for it to work is to configure the SD Device (even if it is a disk device) as removable. Devices that require a mount (USB) in http://www.bacula.org/7.0.x-manuals/en/main/Storage_Daemon_Configuratio.html#SECTION00173 says, among other things, write part command must be defined. Write part command is somewhat documented in Devices that require a mount (DVD) in docs for 5.0 and below, but not in 7.0. Its purpose is unclear, my guess would be it's intended for write to optical disk but not close it, no idea how or why that would apply to a usb stick. From reading that section I can't figure out the config for 12-bay hot-swap sata storage server where I can write to all disks and replace them as they get full, just like they were tapes. (But see my reading comprehension note below.) By the way, in case you have not noticed, there are three white papers posted on the bacula.org web site, two of them, if I am not mistaken, document Virtual Autochangers as implemented in the community version (slightly different from the Enterprise version). I notice now, thanks. CommunityDiskBackup.pdf has the same old problem in 2.1 Grouping Storage Devices: as usual, it talks multiple devices and shows 2 Device definitions with Archive Device = /disk in both. Personally I don't know how to mount multiple physical devices in the same /disk at the same time and keep them separate too. Same goes for 2.2 Virtual Autochanger: it doesn't let you write to multiple (disk) devices, it lets bacula treat a single Archive Device as multipe devices -- presumably for concurrent access. Same goes for section 3 (Multiple Devices) in CommunityDiskBackupDesign.pdf At least that's what I read in there. Maybe I'm not reading it right: the years have not been kind and my leet reading comprehension skillz ain't what they used to be. The rest of it is very useful but not germane to the topic of using multiple hot-swappable disks for storage. This is all great but so far the only known config I've actually seen working is a vchanger. I'd consider buying it off and rolling it into bacula proper so instead of much handwaving and allegations of maybe documented somewhere features you'd have a definitive and working answer for retentive assholes like me. Dima -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New Bacula Gui for Management Bacula
On 11/08/2014 12:56 PM, Bill Arlofski wrote: On 11/07/2014 10:46 AM, oliveiraped wrote: Hi To All Please check the new web gui for Bacula. Reportula is a php based web program that provides you a summarized output stats of Bacula Backups jobs, clients, volumes and director that have already run. It obtains its information from your catalog database. This is a fairly high level bacula management tool. Here are a few points that one user made concerning this important tool. It is web-based so can be accessed from anywhere. It packs a phenomenal amount of information into a single web-page – that I credit as being very good design! Features Display last jobs status Display volumes usage by pool Full supported MySQL, PostgreSQL databases. Show Jobs which executed with errors last day, week, month Show a condition of your Volumes Show terminated Jobs Search Jobs on several conditions The detailed information on Pools, Volumes, Storages and Clients Search options List the files stored on job Acl Supports and Login users support Integration with Active Directory or Ldap servers www.reportula.org Hi Oliver I installed reportula to test it out and on first attempt to configure via /index.php/install per the docs I get the following PHP error: Parse error: syntax error, unexpected '[' in /var/www/Reportula-master/vendor/laravel/framework/src/Illuminate/Support/helpers.php on line 411 that line in question is: $results = []; in the class_uses_recursive() function I am using PHP v5.3.29 on that server. Also, I tried to report this on your forum instead of on this list, but there is no sign-up link. Bill It was mentioned in #bacula IRC on freenode that: ... [] is a php 5.4 feature. s/[]/array()/ on older versions I suspect that the minimum requirement of 5.3.7 is a typo on the requirements page here: http://www.reportula.org/reportula/documentation-2/documentation/ Perhaps the minimum was supposed to be 5.4.7, not 5.3.7? Bill -- Bill Arlofski Reverse Polarity, LLC http://www.revpol.com/ -- Not responsible for anything below this line -- -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] [7.0.5] Incorrect NextPool evaluation from Job ressource
Hello,
testing one of the new 7.0.0 Features, mentioned in chapter 2.1.3 of the
great documentation:
»The Next Pool concept has been extended in Bacula version 7.0.0 to
allow you to specify the Next Pool directive in the Job resource as well.«
Job {
Name = CopyTest
Type = Copy
JobDefs = GenericJobSettings # see bacula-dir.conf
Client = client1-fd
Pool = quaterly-backups
Selection Type = Job
Selection Pattern = CLIENT2-periodic B2D netshare-Gruppen-HR
Next Pool = weekly-tapedup-buffer
}
*run
Automatically selected Catalog: MyCatalog
Using Catalog MyCatalog
A job name must be specified.
The defined Job resources are:
…
15: CopyTest
…
Select Job resource (1-16): 15
Run Copy job
JobName: CopyTest
Bootstrap: *None*
Client: client1-fd
FileSet: None
Pool: quaterly-backups (From Job resource)
NextPool: LTO4-Archive (From Job's NextPool resource)
^^^
Here's some inconsistency. The source is claimed to be From Job
resource, but the value actually is from Pool resource:
Pool {
Name = quaterly-backups
…
Next Pool = LTO4-Archive # needed for copy job
}
_run-directive-override works as expected:_
*run nextpool=weekly-tapedup-buffer
A job name must be specified.
The defined Job resources are:
…
15: CopyTest
…
Select Job resource (1-16): 15
Run Copy job
JobName: CopyTest
Bootstrap: *None*
Client: client1-fd
FileSet: None
Pool: quaterly-backups (From Job resource)
NextPool: weekly-tapedup-buffer (From Command input)
Thanks,
-Harry
signature.asc
Description: OpenPGP digital signature
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuration reload for bacula-sd
PS. I should probably clarify that bacula has very convenient automatic volume management features that work perfectly well with single-filesystem disk backup. It's a pity bacula's disk backup mechnism is apparently designed so you can have either automatic volume management or multiple disks, but not both. Dima -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Load slots timeout
On Nov 4, 2014, at 6:55 AM, Andrey Chebotarev a...@525.su mailto:a...@525.su wrote: Hi guys. I use bacula 5.2.13 with IBM TS3200 library. Periodically I face problem with load slot time out. In logs it looks lilke: 22-Sep 00:35 baculasrv-dir JobId 10471: Recycled volume 220AAAL6 22-Sep 00:35 baculasrv-sd JobId 10471: 3304 Issuing autochanger load slot 1, drive 1 command. 22-Sep 00:40 baculasrv-sd JobId 10471: Fatal error: 3992 Bad autochanger load slot 1, drive 1: ERR=Child died from signal 15: Termination. Results=Program killed by Bacula (timeout) 22-Sep 00:32 sqcompose-fd JobId 10471: Fatal error: backup.c:1019 Network send error to SD. As I understood, bacula tries to load slot for 5 minutes and if it's not successful stops job. I started investigation why bacula sometimes doesn't manage to load slot in 5 minutes and find out library stops responding to commands and starts cleaning drive procedure which takes more than 5 minutes(Library was configured to clean drive automatically) So how can I solve the problem? I've found place in mtx-changer script where declared 300 seconds to wait. I've increased it value to 1800 seconds. Is it only place or I have to change somthing else in sources? Hi everybody. Increasing timeout in mtx-changer script hasn't helped, I have the same issue. Where in sources I can increase timeout to 30 minutes? I don’t see why this is on devel It should be on users, which is cc’d here. — Dan Langille -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
