Re: [Bacula-users] bacula can't make use of multi drives
On 11/20/2014 11:48 AM, Süleyman Kuran wrote: On 20-11-2014 12:28, Kern Sibbald wrote: Hello, There are a number of different ways to write to several drives at the same time. They are listed with the preferred solution (for most cases) first and the worst solution last. 1. This is probably the simplest and best. Simply limit the number of simultaneous jobs by putting a Maximum Simultaneous Jobs = nn inside each Device resource in your bacula-sd.conf file. Bacula version 7.0.x comes with this directive in the Device resources as a default. For multi-drive configs, Maximum Concurrent Jobs = nn setting is recommended in Storage and Director resource in bacula-dir.conf and storage resource in bacula-sd.conf. Do you suggest to use it in only Device resource in bacula-sd.conf omitting the others? No. As I wrote in my previous response, they must all be consistent, and they all have slightly different ways of limiting concurrency (i.e. maximum jobs a director can run, maximum jobs for a Storage definition in the Director, maximum jobs a storage daemon can run, maximum jobs for a given drive, maximum jobs for a client, maximum jobs for a given job name, ...) Some you set to a big (but not too big) number; others you need to fine tune (Device), a few others you can ignore (i.e. one usually does not want more than one simultaneous job running on a given client, though there *are* cases where this is desirable). Best regards, Kern 2. As other people have pointed out, direct the output of different jobs to different Pools. This is very good for separating backups by say department, but is not an ideal way to limit concurrency. 3. Set Prefer Mounted Volumes = no. I *strongly* recommend against using this directive. It will inevitably lead to problems. Best regards, Kern On 11/18/2014 10:39 AM, Süleyman Kuran wrote: Hi, I am trying to make bacula use multi drives in a Fujitsu Tape Library with no success. Recently I added 3 more drives to bacula configuration to reduce backup time. But bacula insists on using only the first drive. Backup jobs are not sent to other suitable tape drives. Jobs are started at the same time and queued. Jobs in the queue is waiting for the previous job to finish even if there is a valid media (tape) for the pool and other drives are idle. I can mount other drives manually. Is there any other setting I'm missing to make use of multi-drives? Please advise. Regards, Suleyman == CentOS release 6.5 (Final) Bacula version 5.0.0-12.el6 Config files: bacula-sd.conf == Storage { # definition of myself Name = bacula-sd SDPort = 9103 # Director's port WorkingDirectory = "/var/spool/bacula" Pid Directory = "/var/run" Maximum Concurrent Jobs = 2 } Autochanger { Name = AYKAutochanger Device = Drive-1 Device = Drive-2 Device = Drive-3 Device = Drive-4 Changer Command = "/usr/libexec/bacula/mtx-changer %c %o %S %a %d" Changer Device = /dev/sg9 } Device { Name = Drive-1 Drive Index = 0 Media Type = LTO-5 Archive Device = /dev/nst0 AutomaticMount = yes AlwaysOpen = yes RemovableMedia = yes Random Access = no Maximum File Size = 10GB Changer Command = "/usr/libexec/bacula/mtx-changer %c %o %S %a %d" Changer Device = /dev/sg9 AutoChanger = yes } Device { Name = Drive-2 Drive Index = 1 Media Type = LTO-5 Archive Device = /dev/n
Re: [Bacula-users] Configuration reload for bacula-sd
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 11/12/2014 09:10 PM, Dimitri Maziuk wrote: On 11/12/2014 01:11 PM, Josh Fisher wrote: On 11/8/2014 1:35 PM, Dmitri Maziuk wrote: I think there is some confusion about this due to "multiple devices" being an ambiguous term. There is a difference between "multiple devices that are only attached one at a time" and "multiple devices that may be attached all at the same time". For disk storage, including virtual disk autochanger, the "device" is a directory, and in almost all cases it is in fact the mount point of a filesystem partition. The virtual autochanger described in 2.2 will work with any filesystem mounted at /disk, so multiple disk drive partitions CAN be used, but ONLY one at a time. This then works similarly to tape. If this were true you couldn't use more than one tape drive of the same kind, e.g. the jukeboxes with 2 and more drives would only use one. Perhaps that is the case and nobody knows about it because people who can shell out $15K+ on a tape library don't use bacula. ... When the disk drive partition gets full, you must unmount the current disk partition and mount the next one ... The not so obvious caveat is that in order to use hot-swappable drives with a disk Device you MUST use Requires Mount, particularly if you are using automatic volume labeling. Hmm. So I could in theory come up with Mount Command that mounts each disk in a list (and optionally checks for free space and mounts the next one if there isn't any) and it all will "Just Work(tm)". Maybe someday I'll have copious free time and a fresh supply of round tuits... ... The other issue, using multiple simultaneously mounted filesystems, is not so clear. Each Device resource associated with an autochanger can specify a different Archive Device path. To do so, it is also necessary to use a different Media Type for each filesystem. Bacula expects to be able to load any volume of a particular Media Type into any Device having that same Media Type. A volume file located in one Device's Archive Device directory cannot be "loaded" into another Device with a different Archive Device directory Again, if as Kern says it's all implemented the same way, then you also should not be able to load an LTO-6 tape in "just any" LTO-6 drive. You'd have to give them media types (e.g.) lto-6-mt0 and lto-6-mt1 and the tapes would only be loadable into /dev/mt0 and /dev/mt1 resp. You are getting confused. For Bacula, the /dev/mt0 is not at all equivalent to a directory. It is much more like a file within a directory because it is opened directly then read and written like a file. A directory is never opened by Bacula (except for more exotic reasons on Windows). Loading tapes (mounting) is something that only occurs on tape drives, so that code is distinct from the code that "loads" (opens) a volume. Not all the code for reading/writing tapes is identical to that for disks, but probably 90-95% is. That said, there is no harm in you thinking that tapes and disks are treated very different in Bacula. If that isn't the case then there are significant differences in how tape and disk backups are coded in bacula. Then the "works similarly to tape" assumption is incorrect. [vchanger] ... It is open source (GPL v2) and available on SourceForge, so no "buying it off" is needed. Figure of speech. Though I've no idea what legaleze comes with bacula enterprise and how it might play with your gpl'ed code. (Bareos folks might know more about that.) A Bacula Enterprise user can use vchanger with Bacula Enterprise -- this is permitted by Josh's GPLv2 license. In fact, any other proprietary backup program can legally use vchanger. Perhaps the best way to see this is that Bacula uses mtx (a GPLv2 program) for tapes to do something similar to what vchanger does for disks. Kern It just so happens that I have recently had some time to update vchanger. Cool. Please post a message to the list when it's out. Thanks -- Comprehensive Server Mon
Re: [Bacula-users] Concurrent Backups with a Virtual Autochanger
Unfortunately, I no longer have the time to help people debug usage problems, which I actually enjoy doing, but the other users on this Bacula email list should be able to help you resolve this. I do have a few remarks: 1. There is no reason to set the VolumePoolInterval to anything other than the default, especially for disk volumes. Doing so could cause the SD to consume a lot of unnecessary CPU time if there is an outstanding mount message. 2. Forcing Bacula to use only one concurrent job per drive is not making best use of your hardware. In general, unless you have special needs (security, tight restore SLAs,...), it is *far* better from operational and performance standpoints to let Bacula write multiple simultaneous jobs on a single drive (perhaps 5-10). This will permit the OS to reduce disk head movement. Unfortunately neither of the above points will resolve the problem you are seeing. While you have provided some important input, what is missing is the job log output including the mount message and a listing the volumes known to the catalog DB (list volumes). To reassure you, although I have not explicitly tried or tested writing to multiple disk drives using some of the techniques recently discussed on this list, I am 100% sure that the Virtual Autochanger code does work exceptionally well with a single disk drive as is your case, providing you really have labeled volumes that are available. Note, by turning on a debug level of probably 100 to 150 in the Director, and possibly also in the SD, you should be able to see more clearly why the Director/SD cannot find any volumes that are ready to use. Best regards, Kern On 11/15/2014 12:17 AM, Brady, Mike wrote: First of all thanks to Kern and Bacula Systems for making the Best Practices for Disk Based Backup and Disk Back Design documents available. I have been playing around with the best way for doing concurrent backups for a while and these documents have helped my understanding considerably. Using a Virtual Autochanger in particular seems an elegant way of doing what I would like to do. However, I am seeing some behaviour in my testing that I did not expect and I need some input. At a high level what I am trying to do is use a Virtual Autochanger to write to multiple volumes in the same pool concurrently. At the moment I have two devices limited to one concurrent job each. Which, if I have understood things correctly, means that I should have two jobs running concurrently writing to separate volumes. The schedule below kicks off eight jobs simultaneously with the number of devices limiting concurrency. This issue that I am having is that the first job gets FileChgr1-Dev1 and a volume as expected. The second job gets device FileChgr1-Dev2 as expected, but always says Cannot find any appendable volumes. and issues a mount request. There are multiple purged volumes with the recycle flag set available in the IncPoool pool. Even if there weren't, the pool has Auto Labelling configured and has not reached the MaximumVolumes limit, so there should always be a volume available. Other jobs continue to use the FileChgr1-Dev1 as it becomes available while FileChgr1-Dev2 is waiting for a volume. The second job eventually retries on FileChgr1-Dev2, gets an available volume and successfully completes without any operator intervention. After this the remaining jobs utilise both FileChgr1-Dev1 and FileChgr1-Dev2 as they become available as I expected. Is this behaviour expected (I am assuming some sort of race condition at the start of the schedule with multiple jobs trying to get a volume at the same time) or am I trying to do something fundamentally wrong here? My configuration is: Pool { Name = IncPool Pool Type = Backup Volume Use Duration = 23 hours Recycle = yes Action On Purge = Truncate Auto Prune = yes Maximum Volumes = 50 Volume Retention = 2 weeks Storage = FileStorage01 Next Pool = IncPoolCopy Label Format = IncPool- } Storage { Name = FileStorage01 Address = 192.168.42.45 SDPort = 9103 Password = *** Device = FileChgr1 Media Type = File01 Maximum Concurrent Jobs = 10 Autochanger = yes } Autochanger { Name = FileChgr1 Device = FileChgr1-Dev1, FileChgr1-Dev2 Changer Command = /dev/null # For 7.0.0 and newer releases. # Changer Command = # For 5.2 and older releases. Changer Device = /dev/null } Device { Name = FileChgr1-Dev1 Drive Index = 0 Media Type = File01 Archive Device = /bacula_storage/FileDevice LabelMedia = yes; Random Access = Yes; AutomaticMount = yes; RemovableMedia = no; AlwaysOpen = no; Maximum Concurrent Jobs = 1 VolumePollInterval = 5s Autochanger = yes } Device { Name = FileChgr1-Dev2 Drive Index = 1 MediaType = File01 ArchiveDevice = /bacula_storage
Re: [Bacula-users] [Bacula-devel] Load slots timeout
There is no need to modify the code. Just modify the bacula-sd.conf file. It is much easier. Best regards, Kern On 11/10/2014 04:14 PM, Andrey Chebotarev wrote: I've modified and recompiled, waiting for result till next drive cleaning... Probably that's it: stored/stored_conf.c: {"maximumchangerwait", store_time, ITEM(res_dev.max_changer_wait), 0, ITEM_DEFAULT, 5 * 60}, Here example what's going on. Job logs: 31-Oct 12:35 baculasrv-dir JobId 10967: Start Backup JobId 10967, Job=StorwizeBSRVData2BJob1.2014-10-31_12.35.06_34 31-Oct 12:35 baculasrv-dir JobId 10967: Recycled volume "346AAJL6" 31-Oct 12:35 baculasrv-dir JobId 10967: Using Device "IBM_TS3200_2_drive1" to write. 31-Oct 12:35 baculasrv-sd JobId 10967: 3307 Issuing autochanger "unload slot 46, drive 1" command. 31-Oct 12:36 baculasrv-sd JobId 10967: 3304 Issuing autochanger "load slot 12, drive 1" command. 31-Oct 12:36 baculasrv-sd JobId 10967: 3305 Autochanger "load slot 12, drive 1", status is OK. 31-Oct 12:36 baculasrv-sd JobId 10967: Recycled volume "346AAJL6" on device "IBM_TS3200_2_drive1" (/dev/nst0), all previous data lost. 31-Oct 12:36 baculasrv-dir JobId 10967: Max Volume jobs=1 exceeded. Marking Volume "346AAJL6" as Used. 31-Oct 23:25 baculasrv-sd JobId 10967: End of Volume "346AAJL6" at 2555:8545 on device "IBM_TS3200_2_drive1" (/dev/nst0). Write of 64512 bytes got -1. 31-Oct 23:25 baculasrv-sd JobId 10967: Re-read of last block succeeded. 31-Oct 23:25 baculasrv-sd JobId 10967: End of medium on Volume "346AAJL6" Bytes=2,555,387,735,040 Blocks=39,611,044 at 31-Oct-2014 23:25. 31-Oct 23:25 baculasrv-sd JobId 10967: 3307 Issuing autochanger "unload slot 12, drive 1" command. 31-Oct 23:28 baculasrv-dir JobId 10967: Recycled volume "349AAJL6" 31-Oct 23:28 baculasrv-sd JobId 10967: 3304 Issuing autochanger "load slot 34, drive 1" command. 31-Oct 23:28 baculasrv-sd JobId 10967: 3305 Autochanger "load slot 34, drive 1", status is OK. 31-Oct 23:28 baculasrv-sd JobId 10967: Recycled volume "349AAJL6" on device "IBM_TS3200_2_drive1" (/dev/nst0), all previous data lost. 31-Oct 23:28 baculasrv-dir JobId 10967: Max Volume jobs=1 exceeded. Marking Volume "349AAJL6" as Used. 31-Oct 23:28 baculasrv-sd JobId 10967: New volume "349AAJL6" mounted on device "IBM_TS3200_2_drive1" (/dev/nst0) at 31-Oct-2014 23:28. 01-Nov 10:25 baculasrv-sd JobId 10967: End of Volume "349AAJL6" at 2541:9287 on device "IBM_TS3200_2_drive1" (/dev/nst0). Write of 64512 bytes got -1. 01-Nov 10:25 baculasrv-sd JobId 10967: Re-read of last block succeeded. 01-Nov 10:25 baculasrv-sd JobId 10967: End of medium on Volume "349AAJL6" Bytes=2,541,436,498,944 Blocks=39,394,786 at 01-Nov-2014 10:25. 01-Nov 10:25 baculasrv-sd JobId 10967: 3307 Issuing autochanger "unload slot 34, drive 1" command. 01-Nov 10:27 baculasrv-dir JobId 10967: Recycled volume "225AAAL6" 01-Nov 10:27 baculasrv-sd JobId 10967: 3304 Issuing autochanger "load slot 3, drive 1" command. 01-Nov 10:28 baculasrv-sd JobId 10967: 3305 Autochanger "load slot 3, drive 1", status is OK. 01-Nov 10:28 baculasrv-sd JobId 10967: Recycled volume "225AAAL6" on device "IBM_TS3200_2_drive1" (/dev/nst0), all previous data lost. 01-Nov 10:28 baculasrv-dir JobId 10967: Max Volume jobs=1 exceeded. Marking Volume "225AAAL6" as Used. 01-Nov 10:28 baculasrv-sd JobId 10967: New volume "225AAAL6" mounted on device "IBM_TS3200_2_drive1" (/dev/nst0) at 01-Nov-2014 10:28. 01-Nov 23:20 baculasrv-sd JobId 10967: End of Volume "225AAAL6" at 2652:7176 on device "IBM_TS3200_2_drive1" (/dev/nst0). Write of 64512 bytes got -1. 01-Nov 23:20 baculasrv-sd JobId 10967: Re-read of last block succeeded. 01-Nov 23:20 baculasrv-sd JobId 10967: End of medium on Volume "225AAAL6" Bytes=2,652,293,210,112 Blocks=41,113,175 at 01-Nov-2014 23:20. 01-Nov 23:20 baculasrv-sd JobId 10967: 3307 Issuing autochanger "unload slot 3, drive 1" command. 01-Nov 23:22 baculasrv-dir JobId 10967: Recycled volume "345AAJL6" 01-Nov 23:22 baculasrv-sd JobId 10967: 3304 Issuing autochanger "load slot 11, drive 1" command. 01-Nov 23:23 baculasrv-sd JobId 10967: 3305 Autochanger "load slot 11, drive 1", status is OK. 01-Nov 23:23 baculasrv-sd JobId 10967: Recycled volume "345AAJL6" on device "IBM_TS3200_2_drive1" (/dev/nst0), all previous data lost. 01-Nov 23:23 baculasrv-dir JobId 10967: Max Volume
Re: [Bacula-users] Configuration reload for bacula-sd
On 11/08/2014 07:35 PM, Dmitri Maziuk wrote: On 11/8/2014 5:36 AM, Kern Sibbald wrote: I think so. If I understand correctly, you want disk mount points or directories to be treated much like a tape drive, so that you can mount multiple disks. I think this feature is already implemented, with one difference ... that when the device is mounted, it assumes that it has a filesystem on it rather than treating it as a raw device. Either way works, filesystem makes it easy to see what's on it, but you have to mkfs on a new disk. Much like the Virtual Autochanger feature, I am not 100% sure where this is documented, so you may have to search for it. The main requirement for it to work is to configure the SD Device (even if it is a disk device) as removable. Devices that require a mount (USB) in http://www.bacula.org/7.0.x-manuals/en/main/Storage_Daemon_Configuratio.html#SECTION00173 says, among other things, write part command must be defined. Write part command is somewhat documented in Devices that require a mount (DVD) in docs for 5.0 and below, but not in 7.0. Its purpose is unclear, my guess would be it's intended for write to optical disk but not close it, no idea how or why that would apply to a usb stick. It looks like the document is out of date. I am not sure we ever made a pass through the manual to remove the DVD documentation. In any case, a mount command may or may not be necessary for doing USB, but the Write Part Command is definitely not needed and indeed not used any more. From reading that section I can't figure out the config for 12-bay hot-swap sata storage server where I can write to all disks and replace them as they get full, just like they were tapes. (But see my reading comprehension note below.) I don't remember what the configuration would be, because I have not used the feature for about 5 years, but the first step would be to play with setting Removable Media to true, then looking at whether or not Requires Mount and the Mount Point and Mount Command are needed. If you have setup your USB to be automatically mounted, which seems to be the default now, but was not when I used the feature, you may not need any mount commands, though if the operator must explicitly remove and replace a disk, I imagine they will be required. By the way, in case you have not noticed, there are three white papers posted on the bacula.org web site, two of them, if I am not mistaken, document Virtual Autochangers as implemented in the community version (slightly different from the Enterprise version). I notice now, thanks. CommunityDiskBackup.pdf has the same old problem in 2.1 Grouping Storage Devices: as usual, it talks multiple devices and shows 2 Device definitions with Archive Device = /disk in both. Personally I don't know how to mount multiple physical devices in the same /disk at the same time and keep them separate too. Bacula can only mount one device in any given Device section at a time, but in an Autochanger (virtual or not) there are multiple Devices and each can have its own directory. However, if you use different directories, you must use different Media Types otherwise, Bacula will not know the right directory to look in for fixed disks. Same goes for 2.2 Virtual Autochanger: it doesn't let you write to multiple (disk) devices, it lets bacula treat a single Archive Device as multipe devices -- presumably for concurrent access. I am not sure why you believe the above. Each Device can have a different Archive Device path. The examples probably use the same directory so that it does not get too complicated (with Media Types and all). I suggest you just try using different disk devices and see what happens. Same goes for section 3 (Multiple Devices) in CommunityDiskBackupDesign.pdf At least that's what I read in there. Maybe I'm not reading it right: the years have not been kind and my leet reading comprehension skillz ain't what they used to be. I think it is just that the examples are simpler than what you want to do. The rest of it is very useful but not germane to the topic of using multiple hot-swappable disks for storage. In principle hot-swappable disks should work, but since I don't think anyone has done it before, there may be hidden problems that I am not aware of. This is all great but so far the only known config I've actually seen working is a vchanger. I'd consider buying it off and rolling it into bacula proper so instead of much handwaving and allegations of maybe documented somewhere features you'd have a definitive and working answer for retentive assholes like me. I would say that if you are already using vchanger and it works for you, you should stick with it. If someone is setting up a new configuration, the Virtual Autochanger feature may or may not be able to solve their needs. Best regards, Kern Dima
Re: [Bacula-users] Configuration reload for bacula-sd
On 11/08/2014 09:20 PM, Dmitri Maziuk wrote: PS. I should probably clarify that bacula has very convenient automatic volume management features that work perfectly well with single-filesystem disk backup. It's a pity bacula's disk backup mechnism is apparently designed so you can have either automatic volume management or multiple disks, but not both. As mentioned in a prior response, Bacula *may* actually permit both providing each disk has its own filesystem (path). I would add small nuance to what you wrote: if Bacula does *only* allow either automatic volume management or multiple disks, it is not by design, but rather because other than some elementary USB stick code I wrote and the no longer used DVD code, we never thought about dealing with the particularities of hot-swappable disks. By the way, during my vacation I noticed that you gave some very helpful advice on this list -- thanks. Kern Dima -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Load slots timeout
Hello, Assuming you are using the Bacula mtx-changer script. In case of really big problems with the mtx-changer script, the first step is to execute it by hand and see what it outputs. The second step is to set the environment variable debug_log=1 and the working directory at the file mtx.log. That should give a better idea what is going on. Best regards, Kern On 11/09/2014 05:14 PM, Dan Langille wrote: On Nov 8, 2014, at 7:28 PM, Dan Langille d...@langille.org wrote: On Nov 4, 2014, at 6:55 AM, Andrey Chebotarev a...@525.su wrote: Hi guys. I use bacula 5.2.13 with IBM TS3200 library. Periodically I face problem with load slot time out. In logs it looks lilke: 22-Sep 00:35 baculasrv-dir JobId 10471: Recycled volume "220AAAL6" 22-Sep 00:35 baculasrv-sd JobId 10471: 3304 Issuing autochanger "load slot 1, drive 1" command. 22-Sep 00:40 baculasrv-sd JobId 10471: Fatal error: 3992 Bad autochanger "load slot 1, drive 1": ERR=Child died from signal 15: Termination. Results=Program killed by Bacula (timeout) 22-Sep 00:32 sqcompose-fd JobId 10471: Fatal error: backup.c:1019 Network send error to SD. As I understood, bacula tries to load slot for 5 minutes and if it's not successful stops job. I started investigation why bacula sometimes doesn't manage to load slot in 5 minutes and find out library stops responding to commands and starts cleaning drive procedure which takes more than 5 minutes(Library was configured to clean drive automatically) So how can I solve the problem? I've found place in mtx-changer script where declared 300 seconds to wait. I've increased it value to 1800 seconds. Is it only place or I have to change somthing else in sources? Hi everybody. Increasing timeout in mtx-changer script hasn't helped, I have the same issue. Where in sources I can increase timeout to 30 minutes? I don’t see why this is on devel It should be on users, which is cc’d here. Have you ensured everything is correct with the permissions etc? Five minutes to load a tape is way too long for something which succeeds. My hypothesis: there is a problem with the process. Configuring an autochanger has many places where it can go astray. I documented some of the pitfalls here: http://www.freebsddiary.org/tape-library.php And more of the odd stuff here: http://www.freebsddiary.org/tape-library-integration.php Hope that helps. — Dan Langille -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Load slots timeout
On 11/10/2014 06:54 AM, Jesper Krogh wrote: On 09/11/2014, at 17.14, Dan Langille d...@langille.org wrote: Five minutes to load a tape is way too long for something which succeeds. My hypothesis: there is a problem with the process. Yes and no If the tape has been closed properly then Yes, if it hasnt the first thing the drive is going to do is to pass over the entire tape to get the end-marker position out of the tape which can take way more than 5 minutes and really isnt an error state. When Bacula is using mtx (the mtx-changer script) to load a tape, it does not move the tape to the end of media marker. This will happen later only if Bacula is going to write on the tape. Thus moving to the end of the media is not part of the timeout for loading a tape -- unless you have some really non-standard tape drive or OS kernel driver, which I have never heard of. Best regards, Kern And to my knowledge there is no way to detect it other than to wait Jesper -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuration reload for bacula-sd
On 11/07/2014 04:48 PM, Dmitri Maziuk wrote: On 11/7/2014 7:10 AM, Kern Sibbald wrote: Hello, I am not sure, but it sounds like you are proposing that Bacula use a raw device for storing a Volume. This is possible. There might be a trivial advantage in terms of performance, but there is no real advantage or demand to do it. The advantage is you can pull the disk out and stick a new one in, just like you do with the tape. ... It is, in general, far better to store Volumes in a filesystem rather than on a raw disk for a number of reasons. It would even be preferable to dedicate a disk to Bacula and have a filesystem on it such as XFS rather than use it as a raw device. I agree, however, in the current implementation volumes are files that must reside in a single filesystem (or you need a fake autochanger). If volumes were directories (i.e. mountpoints), we could use multiple removable disks, pull full disk out, stick new one in. Maybe you can be more precise about what you want. Was that clear enough? I think so. If I understand correctly, you want disk mount points or directories to be treated much like a tape drive, so that you can mount multiple disks. I think this feature is already implemented, with one difference from what I believe you are requesting. Bacula can already deal with a mount point where the physical device is removable such as a USB key, providing your tell Bacula that it is removable. The difference is that when the device is mounted, it assumes that it has a filesystem on it rather than treating it as a raw device. When the device is first mounted, Bacula will scan for what volumes are on that device. Much like the Virtual Autochanger feature, I am not 100% sure where this is documented, so you may have to search for it. The main requirement for it to work is to configure the SD Device (even if it is a disk device) as removable. I wrote the code to handle backup to USB keys while I was on vacation -- I just plugged in any USB key, and if there were any Volumes on the device, they would be used, which is mostly what you are requesting. By the way, in case you have not noticed, there are three white papers posted on the bacula.org web site, two of them, if I am not mistaken, document Virtual Autochangers as implemented in the community version (slightly different from the Enterprise version). www.bacula.org - Documentation - White Papers Best regards, Kern Dima -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem with installing bacula systemd unit files
Hello, Yes, you are correct, currently there is no Makefile command to install the systemd files. I like your idea of adding a new configure option. I would probably prefer with-systemd-dir= which corresponds to how the other directories work, then define a default and as you say just add a new Makefile target -- probably make install-systemd. It sounds like a nice little project that is needed and not too hard to implement. Have you done any of the work to accomplish this, or are you asking me or someone else to do it? Best regards, Kern On 11/07/2014 09:07 AM, Can Şirin wrote: Hi, I am setting up a new backup server with Bacula 7.0.5 on RHEL7. I am going to compile it from the source code. Everything is fine but just systemd integration. In the configuration options, I use --with-systemd=/usr/lib/systemd/system After make command has been ended, I run the make install but unfortunately there is no systemd unit file copied by the bacula installation under the /usr/lib/systemd/system directory. I thought it was needed to run make install-autoconf. With this way only SysV init files are copied. How could I install the systemd unit files, without copying them manually from the source (platform/systemd) dir? My configure options are; CFLAGS=-g -Wall ./configure \ --sbindir=/opt/bacula/bin \ --sysconfdir=/opt/bacula/etc \ --enable-smartalloc \ --with-postgresql=/usr/pgsql-9.3 \ --with-working-dir=/opt/bacula/working \ --with-pid-dir=/opt/bacula/working \ --with-subsys-dir=/opt/bacula/working \ --with-openssl \ --enable-conio \ --with-openssl \ --enable-acl \ --enable-lzo \ --enable-lockmgr \ --with-tcp-wrappers \ --with-dir-user=bacula \ --with-dir-group=bacula \ --with-sd-user=bacula \ --with-sd-group=bacula \ --enable-bat \ --with-systemd=/usr/lib/systemd/system Thanks, Can -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem with installing bacula systemd unit files
Simone, Would it be worth while to include your enhanced systemd files in the Bacula source release for those users who either want to build themselves or who want a more advanced template? If so, could you please send me your files? I am a bit lazy to download and extract them :-) Thanks, Kern On 11/07/2014 10:42 AM, Simone Caronni wrote: Hello, I'm the maintainer of Bacula in Fedora and I've been providing repositories for both Bacula 5.x and Bacula 7.x. These are the repositories, based on rebuilt packages that are in Fedora rawhide: https://repos.fedorapeople.org/repos/slaanesh/bacula7/ https://repos.fedorapeople.org/repos/slaanesh/bacula/ On 7 November 2014 09:07, Can Şirin sirin...@itu.edu.tr wrote: I am setting up a new backup server with Bacula 7.0.5 on RHEL7. I am going to compile it from the source code. Everything is fine but just systemd integration. Might I ask you what kind of settings you need that requires custom compilation of Bacula 7.0.5 on RHEL? I would like to know what your requirements are regarding the packages, so maybe we can integrate what you need in the official packages. It's something I've been doing during the past years with various users. You can check the changelog of the Bacula packages in the official RHEL 7 channels, there's my name in. In the configuration options, I use "--with-systemd=/usr/lib/systemd/system" After "make" command has been ended, I run the "make install" but unfortunately there is no systemd unit file copied by the bacula installation under the /usr/lib/systemd/system directory. I thought it was needed to run "make install-autoconf". With this way only SysV init files are copied. Fedora/RHEL packages carry a different systemd unit file for daemons, those in the Bacula source code are much more generic (as they need to work on more distributions), while the provided ones are much more specific. You can check the package contents here: http://pkgs.fedoraproject.org/cgit/bacula.git/tree/ Regards, --Simone -- You cannot discover new oceans unless you have the courage to lose sight of the shore (R. W. Emerson). http://xkcd.com/229/ http://negativo17.org/ -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem with installing bacula systemd unit files
Hello, OK, yes, it makes sense that the systemd directory code was probably implemented at the same time as the systemd files. Simone is going to give me some enhanced systemd files, and I will add an appropriate Makefile target for getting them installed. Thanks for bringing this up. Best regards, Kern On 11/07/2014 01:57 PM, Can Şirin wrote: Quoting Kern Sibbald k...@sibbald.com: Hello, Yes, you are correct, currently there is no Makefile command to install the systemd files. I like your idea of adding a new configure option. I would probably prefer with-systemd-dir= which corresponds to how the other directories work, then define a default and as you say just add a new Makefile target -- probably make install-systemd. Actually, this is not my idea. Systemd support has already been added to configure script. So I just wanted to use it. [root@bacula bacula-7.0.5]# ./configure --help | grep systemd --with-systemd[=UNITDIR] Include systemd support. UNITDIR is where systemd [root@bacula bacula-7.0.5]# It sounds like a nice little project that is needed and not too hard to implement. Have you done any of the work to accomplish this, or are you asking me or someone else to do it? I haven't done anything. Because there are generic systemd files under the source code directory tree whose path is exactly bacula-7.0.5/platforms/systemd/ I can copy them from this path manually. So, for now, I am going on with the SysV init scrit until you implement it. Kind regards. Can Best regards, Kern On 11/07/2014 09:07 AM, Can Şirin wrote: Hi, I am setting up a new backup server with Bacula 7.0.5 on RHEL7. I am going to compile it from the source code. Everything is fine but just systemd integration. In the configuration options, I use --with-systemd=/usr/lib/systemd/system After make command has been ended, I run the make install but unfortunately there is no systemd unit file copied by the bacula installation under the /usr/lib/systemd/system directory. I thought it was needed to run make install-autoconf. With this way only SysV init files are copied. How could I install the systemd unit files, without copying them manually from the source (platform/systemd) dir? My configure options are; CFLAGS=-g -Wall ./configure \ --sbindir=/opt/bacula/bin \ --sysconfdir=/opt/bacula/etc \ --enable-smartalloc \ --with-postgresql=/usr/pgsql-9.3 \ --with-working-dir=/opt/bacula/working \ --with-pid-dir=/opt/bacula/working \ --with-subsys-dir=/opt/bacula/working \ --with-openssl \ --enable-conio \ --with-openssl \ --enable-acl \ --enable-lzo \ --enable-lockmgr \ --with-tcp-wrappers \ --with-dir-user=bacula \ --with-dir-group=bacula \ --with-sd-user=bacula \ --with-sd-group=bacula \ --enable-bat \ --with-systemd=/usr/lib/systemd/system Thanks, Can -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuration reload for bacula-sd
Hello, I am not sure, but it sounds like you are proposing that Bacula use a raw device for storing a Volume. This is possible. There might be a trivial advantage in terms of performance, but there is no real advantage or demand to do it. It is, in general, far better to store Volumes in a filesystem rather than on a raw disk for a number of reasons. It would even be preferable to dedicate a disk to Bacula and have a filesystem on it such as XFS rather than use it as a raw device. Maybe you can be more precise about what you want. By the way, the Bacula code that writes disk and tape is virtually identical. Only the open and close and seek is different. The seeking on tape devices is far more complex than seeking on a disk, which is byte oriented (at least at the application level), rather than file/block oriented as a tape device is. Best regards, Kern On 10/28/2014 03:59 PM, Dmitri Maziuk wrote: On 10/28/2014 8:24 AM, Alan Brown wrote: ... Tape and disk are different animals and need to be approached differently. Virtual autochangers are a kludge to allow for removable disks but in most configured installations they do _not_ treat those disks in the same way as real tape drives. OT comment: I'll probably never understand that, I always thought a block device is a block device and one of the unix's strong points was to abstract away the physical differences and let the same code work with either. AFAICT the only reason they're different (in how SD treats them) is because the software is written that way... Dima -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] WinBin 7.0.5 on w2k3(x86), bat+tray-monitor - missing mingwm10.dll
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hello, Where did you get the binaries? Can you show me the full names of those binaries? Best regards, Kern On 10/27/2014 09:55 AM, Harald Schmalzbauer wrote: Hello, I just upgraded bat from 6.0.6 to 7.0.5. On W2k8(amd64), bat now runs much more stable! On Windows Server 2003 (x86), bat refuses to start with the same error like bacula-tray-monitor: Missing mingwm10.dll. Unfortunately just taking the on from Bacula 6.0.6 dosn't solve the problem. The error message vanishes, but both (bat and tray-monitor) are not starting. FD just works fine on 2k3 though. Best regards, -Harry -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -BEGIN PGP SIGNATURE- Version: GnuPG v1 Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iEYEARECAAYFAlRbr58ACgkQNgfoSvWqwEibrgCfXYMSyhOkQ26zhXW9De34VidW UPYAoOX53lnV3QzEmtp9+Q8jHs1Q3XDp =H+MQ -END PGP SIGNATURE- -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuration reload for bacula-sd
On 10/28/2014 02:24 PM, Alan Brown wrote: On 28/10/14 12:46, Ana Emília M. Arruda wrote: You have autochangers resources (fisical for tape librareis and virtual for disks) in Bacula. They are a pool of drives to be used by your jobs. I still think about having jobs and pools associated with clients instead of devices associated with clients are the better choice. Devices are not associated with any clients. They're used as-available. Tying devices to clients is an unnecessary restriction on resources and generally indicates accountants gone mad or lack of thought about what you are trying to achieve. In spite of this, If you have to work with tape drives (stand alone or tape library ones connected directly - not in a fabric topology) They are fabric connected. , maybe a second device definition for a job or pool could be more helpful than a bacula-sd.conf reload on-the-fly or the enable/disable commands. This does not work. I've tried it. If an autochanger tape drive fails, jobs pile up behind it. What's far worse than a drive failing is one getting dirty - they spend forever doing rewrites and througput drops from hundreds of Mb per second to 10-20, WITHOUT raising errors in the backup system - and running a cleaning tape doesn't work in a lot of cases (LTO drives are self cleaning, If you need a tape then you're already in trouble) This is far from ideal behaviour, especially when there are petabytes of science data involved. The only way out of either situation at the moment involves restarting the storage daemon, which kills ALL jobs running on ALL drives. Comment: Please don't presume to lecture me about what I should or should not be doing in my enterprise environment, or indeed about the way systems are setup (it's all fabric path for starters and bacula does not do d2d unless you count disk spooling I am surprised that you say that Bacula does not do d2d. With Copy and Migration jobs that is exactly what it does. What it does not do is Hierarchical backups as well as it should since it does not have the concept of cost or speed. - which we use intensively), you have no idea of the operational constraints on my site and you're making a bunch of fairly arrogant assumptions about the way things are run which impinge on the way you think Bacula should operate. It's this kind of attitude which results in inflexible software that gets sworn at, rather than sworn by. Thankfully Kern and his team are well aware that needs vary depending on setups and that multiple-tape drive setups need improvement. Yes. Tape and disk are different animals and need to be approached differently. Virtual autochangers are a kludge to allow for removable disks but in most configured installations they do _not_ treat those disks in the same way as real tape drives. Virtual autochangers were not written for removable disks. Prior to virtual autochangers, I wrote code that allows (at least for me) Bacula to deal with removable disks such as USB sticks. Virtual autochangers were written to allow much more flexibility with disks -- i.e. multiple drives on one Storage, multiple directories, ... For the most part virtual autochangers with fixed disks functions virtually identically to tape drives similarly configured. I am not sure why you consider virtual autochangers a kludge, since it does *exactly* what I intended it to do for fixed disks. I have never tried using *removable* disks with virtual autochangers, nor even thought about it, so perhaps you are trying to make it do something it was not designed for. In fact, there is a chance that removable disks will work well with virtual autochangers, *provided* you tell Bacula it is working with a removable device so it can use the removable disk code. Best regards, Kern -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuration reload for bacula-sd
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 10/28/2014 07:39 PM, Dimitri Maziuk wrote: On 10/28/2014 01:04 PM, Alan Brown wrote: Block devices may be block devices, but a tape drive is a character device. Oops. Works either way, disks are char aka "raw" devices too. People coming from a tape environment tend to see tapes (volumes) as something you use for a pool of clients or filesets, because changing volumes is NOT trivial, the tapes are only reated for a limited number of load cycles and you can only access one volume at a time. If you have more tape drives you can access more volumes simultaneously, but changing volumes is no less difficult/timeconsuming. As is changing disks. Skipping from one tarball to another on tape may take much longer, but that shouldn't make any difference to the higher-level code. There is no reason to see file volumes as dedicated to a client AFAICT; those who want it can do pool per client and volumes per pool -- works with tapes just as well. Yes, in general you can access multiple files on the same disk simultaneously. I don't expect that a backup application streaming data to or from that disk would -- or should -- actually do that, for any number of obvious reasons. The above confuses me, because Bacula can stream multiple simultaneous job data to a disk -- they will of course be streamed into separate files, but nevertheless, you can have as many Bacula steams going simultaneously to a given disk drive. Bacula can also have multiple writes to the same disk file, but of course Bacula must sequence the writes to be able to capture correct disk addresses for the restore. Which is why I'll never understand the tape/disk dichotomy. (As an aside, bacula, specifically, seems to force you to use different Media Type for each physical device so I don't get how it would work with multiple drives in the same jukebox, either -- thankfully I don't need to.) To be more precise, Bacula does not require you to use different Media Types for different devices. It only does so for different disk devices so that it can be sure where the Volume is actually stored. For a compatible tape drives in an autochanger, there is no need to have different Media Types. However, if you have multiple separate libraries the Media Type must be different so that Bacula is sure what library the Volume is in (it actually keeps a device index, but this is often insufficient). Best regards, Kern -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -BEGIN PGP SIGNATURE- Version: GnuPG v1 Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iEYEARECAAYFAlRbt38ACgkQNgfoSvWqwEjnUQCfSOAEbCisEiI5zfGS2roZ1sEL V0EAn28D4+yLzkzOcwfszYq5q3qOfy12 =mf19 -END PGP SIGNATURE- -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuration reload for bacula-sd
On 10/28/2014 07:46 PM, Alan Brown wrote: On 28/10/14 18:39, Dimitri Maziuk wrote: There is no reason to see file volumes as dedicated to a client AFAICT; Habit, I suspect. It's a bad one, given there's a database driving everything to tell you what is where. (As an aside, bacula, specifically, seems to force you to use different Media Type for each physical device so I don't get how it would work with multiple drives in the same jukebox, either -- thankfully I don't need to.) It's been more than happy to set the media type to LTO-5 on 7 drives, LTO-2 on 2 (different changer) and LTO-6 on another. What it can't handle is that you can load media types LTO4 RW in the LTO5 drives and also LTO3 RO, which would be extremely handy. This is on our list ... -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuration reload for bacula-sd
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 10/28/2014 08:23 PM, Dimitri Maziuk wrote: On 10/28/2014 01:46 PM, Alan Brown wrote: On 28/10/14 18:39, Dimitri Maziuk wrote: (As an aside, bacula, specifically, seems to force you to use different Media Type for each physical device so I don't get how it would work with multiple drives in the same jukebox, either -- thankfully I don't need to.) It's been more than happy to set the media type to LTO-5 on 7 drives, LTO-2 on 2 (different changer) and LTO-6 on another. What it can't handle is that you can load media types LTO4 RW in the LTO5 drives and also LTO3 RO, which would be extremely handy. We used ait-1 tapes in ait-3 drive with notworker and just ignored the "premature eot" (or whatever it was) barf. But I was referring to Kern's Message-ID: 518dd7f5.7080...@sibbald.com Date: Sat, 11 May 2013 07:32:37 +0200 From: Kern Sibbald k...@sibbald.com Subject: Re: [Bacula-users] backup to multiple disks ... Yes, Media Type is very important. It must be in the Storage resources on the Director side, and notice that as I mentioned before, on the SD side, Autochanger really just groups a number of Devices. The Media Type must be in each Device, because each one can be different so it is not in the Autochanger resource. There is no restriction for multiple devices to have the same Media Type, but if they are disk devices and don't have the same Archive Device, Bacula won't be able to "mount" them. So, use the same Media Type only in Devices that have the same Archive Device. I expect someone had reasons to code it that way for disk devices specifically, and they may even seemed good at the time It sounds like you are complaining about the above implementation. If it is true that you don't like how it is coded (I assume you mean designed), how would you want it designed? Kern -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -BEGIN PGP SIGNATURE- Version: GnuPG v1 Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iEYEARECAAYFAlRbuJ4ACgkQNgfoSvWqwEg2sQCg6kWWf5axcZkjm8KUHEUIoYtw o30AoNmwTmJMGZAoxd+dUfexFlcfv9+G =fZ4T -END PGP SIGNATURE- -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] is not a Bacula labeled Volume, because: ERR=block.c:1023 Re
Someone wrote an end of file on the beginning of the Volume, you probably should see if there are multiple files on that tape. If so, you may be able to recover some valid data after the tape end of file, but this is generally tricky and time consuming. btape has commands that will allow you to scan the tape to see what is on it. However, be careful. It is also easy to write on the tape with btape. Better set the read-only tab before referencing it. Best regards, Kern On 10/29/2014 10:47 AM, Che_m wrote: I can't even use bextract or bcopy on that one tape. it gives me the same errors. Warning: acquire.c:265 Read acquire: Requested Volume AOB760L4 on tape_Drive (/dev/nst0) is not a Bacula labeled Volume, because: ERR=block.c:1023 Read zero bytes at 0:0 on device tape_Drive (/dev/nst0) Regards Che +-- |This was sent by c...@belnet.be via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Bacula Status Report
On 10/29/2014 02:02 PM, Pasi Kärkkäinen wrote: On Wed, Oct 15, 2014 at 12:49:33PM +0200, Kern Sibbald wrote: Hello, On 14-10-13 09:38 PM, Pasi Kärkkäinen wrote: On Fri, Sep 05, 2014 at 11:23:31PM +0200, Kern Sibbald wrote: Hello, Hello, I have posted a Bacula Status report to the www.bacula.org site. It discusses the following items: 1. Bacula Release Status 2. Windows Binaries Hmm.. so there are no community windows binaries anymore? There have not been any for quite a number of years -- since 5.2.10. Yep. I assume those 5.2.10 windows (client) binaries should still work with the latest Bacula server? Are the windows binaries shipped by Bacula Systems proprietary or opensource ? They are proprietary but they can be obtained freely by Bacula open source users, and hopefully by everyone for personal use by the end of the year. OK. The principal reason for only one version of the Windows binaries was that for several years I was way too overloaded with work and had to reduce somewhere, and since Windows is especially painful, that is where I reduced. I am now much less overloaded, so hope to correct a number of such problems by the end of the year. I can see that.. any plans to opensource the windows agent, at least the core components for basic file backups? I have asked Bacula Systems to give the Enterprise version to individual Bacula community users. I will know by the end of the year. That would probably resolve the problem. I still do not have the time to maintain two separate code bases for Windows. However, if I cannot get permission to give the Enterprise version free to individual users (this excludes, enterprises, ...) then I will create a separate community version of Windows (one or the other will be available by 1Q15). In the mean time, if you are a Bacula contributor, you can get the Windows binaries free, and if not, the price is ridiculously low considering all the work that goes into making them. Best regards, Kern Thanks for the reply! -- Pasi Best regards, Kern Thanks, -- Pasi 3. Bacula Enterprise 4. Vacation 5. Bareos The following is a link to the report. http://blog.bacula.org/bacula-status-report-30-august-2014/ Best regards, Kern -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Bacula Status Report
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 10/29/2014 06:41 PM, Dan Langille wrote: On Oct 29, 2014, at 9:02 AM, Pasi Kärkkäinen pa...@iki.fi wrote: On Wed, Oct 15, 2014 at 12:49:33PM +0200, Kern Sibbald wrote: Hello, On 14-10-13 09:38 PM, Pasi Kärkkäinen wrote: On Fri, Sep 05, 2014 at 11:23:31PM +0200, Kern Sibbald wrote: Hello, Hello, I have posted a Bacula Status report to the www.bacula.org site. It discusses the following items: 1. Bacula Release Status 2. Windows Binaries Hmm.. so there are no community windows binaries anymore? There have not been any for quite a number of years -- since 5.2.10. Yep. I assume those 5.2.10 windows (client) binaries should still work with the latest Bacula server? Are the windows binaries shipped by Bacula Systems proprietary or opensource ? They are proprietary but they can be obtained freely by Bacula open source users, and hopefully by everyone for personal use by the end of the year. OK. The principal reason for only one version of the Windows binaries was that for several years I was way too overloaded with work and had to reduce somewhere, and since Windows is especially painful, that is where I reduced. I am now much less overloaded, so hope to correct a number of such problems by the end of the year. I can see that.. any plans to opensource the windows agent, at least the core components for basic file backups? My understanding is the windows agent source code is open source. This is true, but I stopped updating the Community Windows source as of 5.2.10, then in the 7.0.0 tree, I removed the whole Win32 directory since it is so out of date, and the old 5.2.9 (or 5.2.10? I forget which one) is still available. The binaries are no longer supplied by the community because the community stopped building them. That’s why Bacula Systems stepped up and starting providing binaries. Very true. The Bacula Enterprise Windows binaries are for sale but at a very low price. If you are a Bacula contributor (name in AUTHORS file) you get them free by asking. I am hoping to have them free by the end of the year for all individual users. Best regards, Kern — Dan Langille -BEGIN PGP SIGNATURE- Version: GnuPG v1 Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iEYEARECAAYFAlRbvQUACgkQNgfoSvWqwEgr3QCeJl/osbq48Yi+fGcuma/jQj6Q moIAniAUMICg9i6cktudoSVPHvjhWgC2 =4gxa -END PGP SIGNATURE- -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] I love Bacula. Have to confess.
Good idea. In fact, that is how we looked at the Bacula Conference. Most of the presentations are mostly community oriented, but of course, Bacula Systems has a lot to say also. The conference is open to everyone. Best regards, Kern On 10/30/2014 11:33 AM, hei...@bacula.com.br wrote: Hi there, Spreading the love: I think we need to organize a community get together in the next Bacula Conference. Regards, Heitor Medrado de Faria Need Bacula training? 10% discount coupon code at Udemy: bacula-users +55 61 2021-8260 | 8268-4220 Site: www.bacula.com.br | Facebook: heitor.faria | Gtalk: heitorfa...@gmail.com - Original Message - From: Jari Fredrisson ja...@iki.fi Cc: bacula-users bacula-users@lists.sourceforge.net Sent: Thursday, October 30, 2014 4:45:24 AM Subject: Re: [Bacula-users] I love Bacula. Have to confess. On 30.10.2014 5:03, Dan Langille wrote: On Oct 29, 2014, at 6:08 PM, Jari Fredrisson ja...@iki.fi wrote: Hands down the best software I have used Ever. This software has never laid me down. Thank You, Kern Sibbald and Bacula Systems! Which database are you using? :) — Dan Langille We use Maria DB 5.5. No problems whatsoever with Bacula, while MySQL 5.5 is sometimes picky with other apps. br. jarif -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO speed optimisation
Hello, I recommend that you use caution when applying information from a new fork with relatively young programmers. Bareos recommends setting the block size to 1M. However, myself, and confirmed by Quantum for LTO-4 tapes (may change with LTO-5, 6) is that anything greater than 512K may increase throughput but will significantly increase errors on dirty drives or old tapes. Thus you risk losing data. I currently have a project to ease the problems of changing block sizes for tapes in Bacula (hopefully by year end). I have not confirmed, but suspect that if you increase the Maximum Block Size to 512K, you will be able to read/write new volumes and you will also be able to read old volumes. I am not sure if read/write of old volumes would be a good idea though as you would then have a volume with two block sizes, which should work, but I wouldn't try it. I think (and hope) that the only problem you will get into, is that if you write a volume with 512K blocks, currently, you will not be able to read it back with a Bacula configured for 64K block sizes. If you test and confirm or infirm any of my points, please let us know. Best regards, Kern On 11/05/2014 12:48 PM, Roberts, Ben wrote: Hi all, I'd like to try and make some speed improvements to my Bacula setup (5.2.13, Solaris11). I have data (and attribute) spooling enabled using a pool of 46x 1TB directly-attached SAS disks dedicated to this purpose. Data is being despooled to 2x directly-attached SAS LTO6 drives at around 100mB/sec each. I think I should be able to get closer to the ~160mB/s maximum uncompressed thoughput the drives and tape media support (ref: http://docs.oracle.com/cd/E38452_01/en/LTO6_Vol4_E1/LTO6_Vol4_E1.pdf). I've just done a speed test and can read from the spool array at a sustained 300mB/sec even while other jobs are running, so I'm sure there's no bottleneck at the disk layer. My suspicion is that the bottleneck is at the application layer, probably due to the way I have Bacula configured. Having read through Bareos' tuning paper (http://www.bareos.org/en/Whitepapers/articles/Speed_Tuning_of_Tape_Drives.html), I've updated the max file size from 1-50GB which increased the throughput from ~75 to ~100mB/sec. I believe I need to look at tuning the block size to gain the last bit of improvement. Is it still the case in Bacula that changing the Maximum Block Size renders previously used/labelled tapes to become unreadable? I'm up to almost 1,000 tape media already written, so making these unusable for restores without restarting the SD to change configs would be less than ideal. I see Bareos is touting a feature to make changes to block size at the pool level rather than the storage level and so this problem can be avoided by moving newer backups to a different pool while still keeping older backups readable. I haven't seen any reference to this in the Bacula manual; is it something that's already supported or in the plans for a future version? For reference, this is one of the the relevant drive definitions I'm using, just in case there's something else that would help which I might have missed: Device { Name = drive-1-tapestore1 Archive Device = /dev/rmt/1mbn Device Type = Tape Media Type = LTO6 AutoChanger = yes Removable media = yes Random access = no Requires Mount = no Drive Index = 1 Maximum Concurrent Jobs = 3 Maximum Spool Size = 1024G Maximum File Size = 50G Autoselect = yes } Regards, Ben Roberts This email and any files transmitted with it contain confidential and proprietary information and is solely for the use of the intended recipient. If you are not the intended recipient please return the email to the sender and delete it from your computer and you must not use, disclose, distribute, copy, print or rely on this email or its contents. This communication is for informational purposes only. It is not intended as an offer or solicitation for the purchase or sale of any financial instrument or as an official confirmation of any transaction. Any comments or statements made herein do not necessarily reflect those of GSA Capital. GSA Capital Partners LLP is authorised and regulated by the Financial Conduct Authority and is registered in England and Wales at Stratton House, 5 Stratton Street, London W1J 8LA, number OC309261. GSA Capital Services Limited
Re: [Bacula-users] Webacula 7. Coming…
Hello, It is not particularly easy to parse Bacula configuration files, particularly the FileSet resource, and I am not sure it can be done with regex. However, Bacula does read its own conf files, and there is a program named DassModus (posted on Internet) that reads Bacula conf files in Python partially using regexes ... Concerning your conf file listed below. I am 99% sure it is not a valid conf file and could not even be scanned by Bacula. If you are worried about all the things that Bacula permits such as spaces in names, simply define a simpler Bacula syntax where names cannot have spaces. Another way is to choose your own format (such as xml, which as you know, I do not like) and use it since it is easy to parse with web tools, then convert it into Bacula syntax before giving it to Bacula. Converting xml, json, or any other representation into Bacula should be a lot easier than going the other way. Best regards, Kern On 14-10-28 04:19 AM, Yuriy Tim wrote: I kept my old letter (2011 :) I tried to parse the bacula-dir.conf. However, this is probably not possible with simple regexp's. It turned out that some applications, for example, Webmin does this with a regexp. But they're doing it wrong! For example, here is test configuration (which is written according to Bacula Main Reference: Customizing the Configuration Files) contains no errors in terms of Bacula (I checked it) but it would be wrong parsed (I have not tested it, but I'm sure of it) by 3rd parties parsers (not native) : - # comment1 # comment2 c o n s o l e { Name=name1; Password = p; \\\a s s w o rd; J o b A C L = *all\* }Con sole { N a m e = name 2; Pass word = password; JobACL = job/\1, job2, job3 } - I.e. in other words to parse with regexp any Bacula configuration will be very difficult. 2014-10-28 7:08 GMT+03:00 Victor Hugo dos Santos listas@gmail.com mailto:listas@gmail.com: On Sat, Oct 25, 2014 at 3:09 PM, Kern Sibbald k...@sibbald.com mailto:k...@sibbald.com wrote: On 14-10-05 03:36 AM, Yuriy Tim wrote: What I have in mind: 1 store all config files in the database 2 to store all the jobs in the database (for example, scheduled tasks, and not only already made) 3 to store other information in the same database 4 to have a function that preserves the tree to the the database for select the files and restore. Now it makes BVFS,but for Web-UI is useless. I once wrote in the bacula-devel but Bacula configuration files editing ? NOO! :) I am not sure why any one would object to doing configuration file editing in a Web based GUI -- we have that in Bacula Enterprise. Also who you asked to program it and when could make a big difference in the response ... Where I am not very enthusiastic is to put the configuration files in the SQL database. This would make it harder to recover Bacula during disaster recovery, and if you destroyed your database, it could make it impossible to even start Bacula. Hi I think the same with you about the posibility to store the configuration in database (is a very, very, very bad idea) !!! but, maybe the idea of this mail (If not, Yuriry can use this idea to improve webacula) is to use a database to save all the hosts, files, storages and others only to webacula interface... After the end, the user will apply the changes and so, the GUI get all the information from the database and generate a new bacula-dir.conf for example. that is the same idea that the Centreon project use to make the nagios configuration files, and IMHO, I believe that is a good idea. salu2 -- -- Victor Hugo dos Santos http://www.vhsantos.net Linux Counter #224399 -- with best regards -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuration reload for bacula-sd
Yes, your definition is clear, and it is what the Director does. However, programming it is much more difficult, especially for the SD where you are dealing with physical devices that are locked. In Apache, the Bacula Director, and elsewhere there are not physical devices that have to be locked when writing. Anyway, this is something I would like to see, but someone needs to program it ... Kern On 14-10-24 09:28 AM, Andrea Carpani wrote: On 24/10/2014 12:47, Kern Sibbald wrote: No, the SD and the FD cannot be reloaded. On the FD in principle it would be easy, but on the SD, it would be complicated if drives changed. What would you do with Jobs that are using a drive that would be removed from the reload? I'm not that deep into backup software, so maybe I'm saying something stupid, but a config reload could do the same thing that other software do, that is: - continue servicing current requests with the previous conf and - use the new conf for new requests. Something like a graceful restart apache does. Does this make sense? .a.c. -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuration reload for bacula-sd
Very well said, thanks. Kern On 14-10-24 09:55 AM, Bryn Hughes wrote: On 14-10-24 05:28 AM, Andrea Carpani wrote: On 24/10/2014 12:47, Kern Sibbald wrote: No, the SD and the FD cannot be reloaded. On the FD in principle it would be easy, but on the SD, it would be complicated if drives changed. What would you do with Jobs that are using a drive that would be removed from the reload? I'm not that deep into backup software, so maybe I'm saying something stupid, but a config reload could do the same thing that other software do, that is: - continue servicing current requests with the previous conf and - use the new conf for new requests. Something like a graceful restart apache does. Does this make sense? .a.c. Sense to humans yes, sense to program code not so much. The nature of the SD is that its configuration should almost never change - all it has for config is an inventory of hardware devices. There's a certain elegance in simplicity that would be lost trying to cover what should be a fairly narrow use case. Imagine all the debugging you have to do - is this job failing because it is trying to use the config as it appears in the config file, or some other config in memory from some time in the past? What happens if we now have different device names referring to the same physical device, we now need a whole locking mechanism that can cover the use case of multiple versions of the SD config accessing the same physical device, possibly with different parameters and names. How would you be able to tell which version of the config a given job is using? Remember it is easy to start a backup job that can last a couple of days - a full backup of a huge fileserver for instance. Things would get really messy really fast, with practically no benefit. Your SD config likely changes what, once or twice per year? If that? It is much safer to just restart the SD when you have an idle period between backups. Bryn -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuration reload for bacula-sd
I am not sure a disable drive command is *exactly* what he needs, but that feature is already planned for the not too distant future. ISP do typically want physical separation of data, which is possible with pools and pool naming conventions rather than drives (directories). The simplest approach would be to use drives, each with a different directory, but Bacula doesn' t handle that as well as pools with names that are specific to a pool. On 14-10-24 02:02 PM, Bryn Hughes wrote: On 14-10-24 09:32 AM, Alan Brown wrote: (Why would you want to disable a drive? If it's offline because it failed its cleaning cycle, as a f'instance) So what you need is a feature request to be able to disable a drive via bconsole Not to be able to dynamically reload the SD configuration. Bryn -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem installing bacula on Solaris 10
On 14-10-24 09:45 PM, Kenneth Garges wrote: I’m trying to build Bacula 7.0.4 on a Solaris 10 box (Sun T5220) but am getting this error during the configure: Doing make of dependencies ==Entering directory /home/garges/bacula-7.0.4/src ==Entering directory /home/garges/bacula-7.0.4/scripts ==Entering directory /home/garges/bacula-7.0.4/src/lib mksh: Fatal error in reader: = missing from replacement macro reference Current working directory /home/garges/bacula-7.0.4/src/lib *** Error code 1 The following command caused the error: for I in src scripts src/lib src/findlib src/filed src/console src/plugins/fd src/cats src/dird src/stored src/tools manpages; \ do (cd $I; echo ==Entering directory `pwd`; make DESTDIR= depend || exit 1); done make: Fatal error: Command failed for target `depend' chmod: WARNING: can't access storage-ctl chmod: WARNING: can't access bsg_persist Following a suggestion I read on the net I changed line 52 of Makefile.in to force configure to use gmake instead of the Solaris make: -bash-3.2$ more +52 -1 Makefile.in do (cd $$I; echo ==Entering directory `pwd`; /opt/csw/bin/gmake DESTDIR=$(DESTDIR) $@ || exit 1); done That changes the error to: Doing make of dependencies ==Entering directory /home/garges/bacula-7.0.4/src gmake[1]: Entering directory `/home/garges/bacula-7.0.4/src' gmake[1]: Nothing to be done for `depend'. gmake[1]: Leaving directory `/home/garges/bacula-7.0.4/src' ==Entering directory /home/garges/bacula-7.0.4/scripts gmake[1]: Entering directory `/home/garges/bacula-7.0.4/scripts' gmake[1]: `depend' is up to date. gmake[1]: Leaving directory `/home/garges/bacula-7.0.4/scripts' ==Entering directory /home/garges/bacula-7.0.4/src/lib gmake[1]: Entering directory `/home/garges/bacula-7.0.4/src/lib' /bin/sh: # DO NOT DELETE: nice dependency list follows: not found gmake[1]: *** [depend] Error 1 gmake[1]: Leaving directory `/home/garges/bacula-7.0.4/src/lib' *** Error code 1 The following command caused the error: for I in src scripts src/lib src/findlib src/filed src/console src/plugins/fd src/cats src/dird src/stored src/tools manpages; \ do (cd $I; echo ==Entering directory `pwd`; /opt/csw/bin/gmake DESTDIR= depend || exit 1); done make: Fatal error: Command failed for target `depend' chmod: WARNING: can't access storage-ctl chmod: WARNING: can't access bsg_persist Trying to run it manually gives the same error: -bash-3.2$ cd src/lib -bash-3.2$ /opt/csw/bin/gmake DESTDIR= depend /bin/sh: # DO NOT DELETE: nice dependency list follows: not found gmake: *** [depend] Error 1 The error seems to imply the shell is trying to execute the last line of the Makefile.in which is a comment! -bash-3.2$ tail -2 Makefile.in # DO NOT DELETE: nice dependency list follows -bash-3.2$ tail -2 Makefile # --- So I’m stumped. What should I try next? Here’s the whole dialog: *PATH*=/opt/csw/bin:/usr/bin:/usr/ccs/bin:/etc:/usr/openwin/bin:/usr/local/bin:/usr/ucb:/usr/sbin *export* PATH *LDFLAGS*=-L/opt/csw/lib -R/opt/csw/lib -L/opt/csw/lib/openssl -R/opt/csw/lib/openssl -I/opt/csw/include -I/opt/csw/include/openssl *export* LDFLAGS * * *CFLAGS*=-g -I/opt/csw/include -lcrypto -lssl -L/opt/csw/lib -R/opt/csw/lib *export* CFLAGS ./*configure* \ --sbindir=/usr/local/bin \ --sysconfdir=/etc/bacula \ --with-postgresql=/opt/csw \ --enable-smartalloc \ --with-pid-dir=/var/bacula/working \ --with-subsys-dir=/var/bacula/subsys \ --with-working-dir=/var/bacula/working \ --with-dir-user=bacula \ --with-dir-group=backup \ --with-sd-user=bacula \ --with-sd-group=backup \ --with-fd-user=root \ --with-fd-group=backup \ --with-dump-email=gar...@ucsc.edu mailto:with-dump-email=gar...@ucsc.edu \ --with-job-email=gar...@ucsc.edu mailto:with-job-email=gar...@ucsc.edu \ --with-smtp-host=smtp.ucsc.edu http://smtp.ucsc.edu \ --with-openssl=/opt/csw \ --disable-ipv6 --disable-batch-insert checking for true... /usr/bin/true checking for false... /usr/bin/false configuring for Bacula 7.0.4 (04 June 2014) checking for gcc... gcc checking whether the C compiler works... yes checking for C compiler default output file name... a.out checking for suffix of executables... checking whether we are cross compiling... no checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether gcc accepts -g... yes checking for gcc option to accept ISO C89... none needed checking for g++... g++ checking whether we are using the GNU C++ compiler... yes checking whether g++ accepts -g... yes checking whether gcc and cc understand -c and -o together... yes checking how to run the C preprocessor... gcc -E checking for grep that handles long lines and -e... /usr/xpg4/bin/grep checking for egrep... /usr/xpg4/bin/grep -E checking whether gcc needs -traditional... no checking for g++... /usr/local/bin/g++ checking for a BSD-compatible install... /opt/csw/bin/ginstall -c checking for
Re: [Bacula-users] Sparse Files
On 14-10-20 02:29 PM, Sam M wrote: Hello, I'm having issues with Sparse Files in Bacula. My data was being backed up with no issues at all. Once I moved my data onto a NetApp storage the size of the backup went up from 1.4 TB to 5 TB. I have Sparse = yes added in bacula-dir.conf which it worked before the move to NetAPP. Any help would be much appreciated. Since there is no Bacula client for NetApp, you are probably backing up over a NFS or possibly a CIFS (??) network mount. Network mounts work very well (i.e. very fast) on NetApp if you tune them correctly, but network mounts are a 3rd class product compared to a directly mounted drive. Basically they have a very primitive API, and in addition, I am not even sure that NetApp has the concept of sparse files or if their implement of sparse files (assuming they have one) corresponds to what Unix/Linux has (i.e. a file with holes in it, which has similar 4096 blocking size). Bottom line: if you have sparse files (somewhat unusual except for Linux system files) use a regular Linux mount with a filesystem such as EXT4 that supports sparse files as Bacula expects. Kern Thanks, Sam -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://p.sf.net/sfu/Zoho ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Webacula 7. Coming…
On 14-10-05 03:36 AM, Yuriy Tim wrote: 2014-10-05 2:44 GMT+03:00 Heitor Faria hei...@bacula.com.br mailto:hei...@bacula.com.br: Congratulations, Tim! We use Webacula a lot here in Brazil. Are there any other features on the roadmap? E. g.: configuration files editing? Much could be done! If Bakula would be more friendly to the Web-UI's. What I have in mind: 1 store all config files in the database 2 to store all the jobs in the database (for example, scheduled tasks, and not only already made) 3 to store other information in the same database 4 to have a function that preserves the tree to the the database for select the files and restore. Now it makes BVFS,but for Web-UI is useless. I once wrote in the bacula-devel but Bacula configuration files editing ? NOO! :) I am not sure why any one would object to doing configuration file editing in a Web based GUI -- we have that in Bacula Enterprise. Also who you asked to program it and when could make a big difference in the response ... Where I am not very enthusiastic is to put the configuration files in the SQL database. This would make it harder to recover Bacula during disaster recovery, and if you destroyed your database, it could make it impossible to even start Bacula. Best regards, Kern Regards, On Sat, Oct 4, 2014 at 8:05 PM, Yuriy Tim tim4...@gmail.com mailto:tim4...@gmail.com wrote: I'll be back :) New features: 1. Compatible with Bacula 7.x 2. The Webacula Users password hasher implements the Portable PHP password hashing framework, which is used in WordPress, Drupal and other. Now encrypted Webacula users passwords on all supported databases: MySQL, PostgreSQL, Sqlite3. 3. Therefore Webacula 7.x incompatible with prior versions! http://webacula.tim4dev.com/2014/10/webacula-7-coming/ -- with best regards -- Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer http://pubads.g.doubleclick.net/gampad/clk?id=154622311iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net mailto:Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Heitor Medrado de Faria Precisa de treinamento Bacula? 15% de desconto no curso on-line pelo site: bacula.com.br http://www.bacula.com.br/?p=2394 Need Bacula training? 10% discount coupon code at Udemy: bacula-users https://www.udemy.com/bacula-backup-software/?couponCode=bacula-users +55 61 2021-8260 +55 61 8268-4220 Site: www.bacula.com.br http://www.bacula.com.br/ Facebook: heitor.faria http://www.facebook.com/heitor.faria Gtalk: heitorfa...@gmail.com mailto:heitorfa...@gmail.com -- with best regards -- Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer http://pubads.g.doubleclick.net/gampad/clk?id=154622311iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] catalog acces ars slow since bacula upgrade
The default postgres conf files that are installed are very poorly tuned for Bacula. You might compare your old postgres conf file with the new one. Kern On 14-10-06 09:49 AM, Heitor Faria wrote: Since i upgrade bacula (5 à 7) + postgresql (8.3 à 9.3), restore and all access to the catalog are slow. Postgresql usually gets faster each version, according to benchmarks published in the Internet. Is there something (a script ?) to run when upgrade bacula ? and postgresql ? Despite of: ./configure --help | grep batch --enable-batch-insert enable the DB batch insert code [default=yes] A simple configuration: ./configure --with-postgresql Does not enable batch insert mode: Batch insert enabled:None Witch is 10 times faster mode, according to Bacula Manual. Thx *Antoine* -- Heitor Medrado de Faria Precisa de treinamento Bacula? 15% de desconto no curso on-line pelo site: bacula.com.br http://www.bacula.com.br/?p=2394 Need Bacula training? 10% discount coupon code at Udemy: bacula-users https://www.udemy.com/bacula-backup-software/?couponCode=bacula-users +55 61 2021-8260 +55 61 8268-4220 Site: www.bacula.com.br http://www.bacula.com.br/ Facebook: heitor.faria http://www.facebook.com/heitor.faria Gtalk: heitorfa...@gmail.com mailto:heitorfa...@gmail.com On Mon, Oct 6, 2014 at 9:02 AM, BOURGAULT Antoine antoine.bourga...@sib.fr mailto:antoine.bourga...@sib.fr wrote: Since i upgrade bacula (5 à7) + postgresql (8.3 à9.3), restore and all access to the catalog are slow. Is there something (a script ?) to run when upgrade bacula ? and postgresql ? Thx *Antoine * -- Slashdot TV. Videos for Nerds. Stuff that Matters. http://pubads.g.doubleclick.net/gampad/clk?id=160591471iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net mailto:Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Heitor Medrado de Faria Precisa de treinamento Bacula? 15% de desconto no curso on-line pelo site: bacula.com.br http://www.bacula.com.br/?p=2394 Need Bacula training? 10% discount coupon code at Udemy: bacula-users https://www.udemy.com/bacula-backup-software/?couponCode=bacula-users +55 61 2021-8260 +55 61 8268-4220 Site: www.bacula.com.br http://www.bacula.com.br/ Facebook: heitor.faria http://www.facebook.com/heitor.faria Gtalk: heitorfa...@gmail.com mailto:heitorfa...@gmail.com -- Slashdot TV. Videos for Nerds. Stuff that Matters. http://pubads.g.doubleclick.net/gampad/clk?id=160591471iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] is not a Bacula labeled Volume, because: ERR=block.c:1023 Re
From the little I have seen, it looks like your tape was never written (the data may be on another tape -- please check) or the tape was overwritten. Using /dev/st0 could *possibly* cause the tape to be overwritten, but Bacula attempts to avoid that. On 14-10-24 04:10 AM, Che_m wrote: I already did, found nothing useful than you should relabel it, or use /dev/nst0 instead of /dev/st0. I've always used /dev/st0 The correct tape is in the drive, the tape is labeled correct. I can mount all 28 tapes in the library, except that one. The last status of the tape was marked append so, it is not in error or anything. Neither have I archived it or taken it out to archive it. bacula version is v5.0.1 and is installed from ubuntu (10.04) repository +-- |This was sent by c...@belnet.be via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuration reload for bacula-sd
No, the SD and the FD cannot be reloaded. On the FD in principle it would be easy, but on the SD, it would be complicated if drives changed. What would you do with Jobs that are using a drive that would be removed from the reload? Kern On 14-10-24 04:48 AM, Andrea Carpani wrote: Hi all, I'm still new to the product and I was playing around with Bacula 5.2.6 (latest packages that come with CentOS 6.5). I added a new storage device to the Storage Daemon. I tried to run a job that used this device, but the backup failed apparently because bacula-sd wan't aware of this new device. I tried to use service bacula-sd reload but this didn't work, so I had to restart bacula-sd, but this broke my running backups. So my question is: is there a way to reload bacula-sd configuration on the fly? regards, Andrea .a.c. -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to Edit Bacula Volumes comment field?
There is a Description field on *every* Bacula Resource: Job, FileSet, Client, Device, Autochanger, ... The above are kept in the in-memory resources, so you simply edit the .conf files. There are several Bacula database objects that have a Comment field, but they are not connected to the resources, and I think you must use SQL commands to set them. Both of these were added in expectation of GUI commands that would allow users to easily view and edit them, but that part is only partially or not yet implemented. Kern On 14-10-22 07:45 PM, hei...@bacula.com.br wrote: Mr. Bacula Users, Just discovered there is a comment field on bacula volumes: *llist volumes ... mediaid: 4 volumename: Vol-0004 slot: 0 poolid: 2 mediatype: File1 firstwritten: ... actiononpurge: 0 *comment:* Does anyone know how to edit / insert information on this field? lol Regards, Heitor Medrado de Faria Precisa de treinamento Bacula? 15% de desconto no curso on-line pelo site: bacula.com.br http://www.bacula.com.br/?p=2394 61 2021-8260 tel:%2B55%2061%202021-8260 | 8268-4220 tel:%2B55%2061%208268-4220 Site: www.bacula.com.br http://www.bacula.com.br/ | Facebook: heitor.faria http://www.facebook.com/heitor.faria | Gtalk: heitorfa...@gmail.com mailto:heitorfa...@gmail.com = -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Inconsistent backups of windows clients
OK, if you had the German translation files installed, that would explain why the message seemed odd to me. Please disregard my comment on that subject. However, on the actual problem itself, what I wrote is the best advice I could give you. Best regards, Kern On 14-10-23 01:50 AM, Florian wrote: Hello. It could be that I did not translate the error message 100% correctly. I translated both freely from german as I thought an english version will be more helpful. The actual german message is: Fatal error: FD hat keinen Jobstatus zurückgegeben. I usually get this message when there are problems with reaching a client. Current status: No problems for 2 days in a row. Regards, Florian S. ubuntu-dir JobId XXX: Fatal error: bsock.c:118 Unable to connect to Client: Client on XXX.XXX.XXX.XXX:9102. ERR=No route to target machine ubuntu-dir JobId XXX: Fatal error: FD did not reaturn a Job status. This is very bizarre, because the second line of the message above does not exist in any Bacula that I am aware of. From the above error messages, I would say that your wakeup on WAN is not really working or you are not giving the machine enough time to come up and Bacula is timing it out. Trying to backup sleeping Clients is probably an unreliable way of running backups -- or you must find some way to fully wake up the machine before having Bacula try to contact it. Perhaps simply upping the FD Connect Timeout would solve your problem. Best regards, Kern -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to Edit Bacula Volumes comment field?
There is a Location table in the DB for the purpose that you want. Take a look at the Bacula schema. On 14-10-23 07:56 AM, hei...@bacula.com.br wrote: Hi Kern, Thanks for the reply. The user wanted to write some comments in the volumes such as the physical place description where they are keeping the tapes stored. I'll check if any GUI has this feature. Regards, Heitor Medrado de Faria Need Bacula training? 10% discount coupon code at Udemy: bacula-users https://www.udemy.com/bacula-backup-software/?couponCode=bacula-users +55 61 2021-8260 tel:%2B55%2061%202021-8260 | 8268-4220 tel:%2B55%2061%208268-4220 Site: www.bacula.com.br http://www.bacula.com.br/ | Facebook: heitor.faria http://www.facebook.com/heitor.faria | Gtalk: heitorfa...@gmail.com mailto:heitorfa...@gmail.com *De: *Kern Sibbald k...@sibbald.com *Para: *hei...@bacula.com.br, Bacula-users@lists.sourceforge.net bacula-users@lists.sourceforge.net *Enviadas: *Quinta-feira, 23 de outubro de 2014 8:59:10 *Assunto: *Re: [Bacula-users] How to Edit Bacula Volumes comment field? There is a Description field on *every* Bacula Resource: Job, FileSet, Client, Device, Autochanger, ... The above are kept in the in-memory resources, so you simply edit the .conf files. There are several Bacula database objects that have a Comment field, but they are not connected to the resources, and I think you must use SQL commands to set them. Both of these were added in expectation of GUI commands that would allow users to easily view and edit them, but that part is only partially or not yet implemented. Kern On 14-10-22 07:45 PM, hei...@bacula.com.br wrote: Mr. Bacula Users, Just discovered there is a comment field on bacula volumes: *llist volumes ... mediaid: 4 volumename: Vol-0004 slot: 0 poolid: 2 mediatype: File1 firstwritten: ... actiononpurge: 0 *comment:* Does anyone know how to edit / insert information on this field? lol Regards, Heitor Medrado de Faria Precisa de treinamento Bacula? 15% de desconto no curso on-line pelo site: bacula.com.br http://www.bacula.com.br/?p=2394 61 2021-8260 tel:%2B55%2061%202021-8260 | 8268-4220 tel:%2B55%2061%208268-4220 Site: www.bacula.com.br http://www.bacula.com.br/ | Facebook: heitor.faria http://www.facebook.com/heitor.faria | Gtalk: heitorfa...@gmail.com mailto:heitorfa...@gmail.com = -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Inconsistent backups of windows clients
On 14-10-22 01:17 AM, Florian wrote: Am 21.10.2014 um 01:31 schrieb Jean Sébastien HEDERER ASPerience: Hi, And if you make backups at 4 differents hours, do you have the problem? The thing is that there could be multiple additional clients in the future and I'd like to keep additional configuration per client at a minimum. Am 20.10.2014 um 13:25 schrieb hei...@bacula.com.br: Florian, Can you put a sleep between the Powerwake script and the backup start, just for test purposes? Mabe a ClientRunBeforeJob only with sleep. I suspect maybe the lag to the machine (and bacula-fd) start is failing the jobs. Regards, Heitor Medrado de Faria Precisa de treinamento Bacula? 15% de desconto no curso on-line pelo site: bacula.com.br http://www.bacula.com.br/?p=2394 61 2021-8260 tel:%2B55%2061%202021-8260 | 8268-4220 tel:%2B55%2061%208268-4220 Site: www.bacula.com.br http://www.bacula.com.br/ | Facebook: heitor.faria http://www.facebook.com/heitor.faria | Gtalk: heitorfa...@gmail.com mailto:heitorfa...@gmail.com = The backups ran with a 30 seconds sleep command after powerwake today. All jobs finished successfully. That's a start, but I will have to observe this a bit more. Like I said: It doesn't always happen that a job fails. *De: *Florian florian.spl...@web.de *Para: *bacula-users@lists.sourceforge.net *Enviadas: *Segunda-feira, 20 de outubro de 2014 3:57:34 *Assunto: *[Bacula-users] Inconsistent backups of windows clients Hello everyone. So, I am backing up 4 windows clients at the moment, using the 5.2.10 windows FD. over the last two weeks I noticed that jobs relatively often end with an error, meaning up to 2 clients per day. It's not even the same clients. Some days, everything works, then client 1 ends with an error, the next day maybe client 4 does, while client 1 runs completely fine. I cannot see any pattern in the occurence of these errors. I just know it is always the same problem: ubuntu-dir JobId XXX: Fatal error: bsock.c:118 Unable to connect to Client: Client on XXX.XXX.XXX.XXX:9102. ERR=No route to target machine ubuntu-dir JobId XXX: Fatal error: FD did not reaturn a Job status. This is very bizarre, because the second line of the message above does not exist in any Bacula that I am aware of. Some more information that might help: The 4 backup jobs for the clients are started at the same time. Each job starts by activating the machine using powerwake. Each client has its personal backup device in the storage daemon's config. I hope anybody can help me out here, because the backup-system is just too unreliable like this... From the above error messages, I would say that your wakeup on WAN is not really working or you are not giving the machine enough time to come up and Bacula is timing it out. Trying to backup sleeping Clients is probably an unreliable way of running backups -- or you must find some way to fully wake up the machine before having Bacula try to contact it. Perhaps simply upping the FD Connect Timeout would solve your problem. Best regards, Kern Regards, Florian S. -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://p.sf.net/sfu/Zoho ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Despooling attrs does not finish
Hello Ulrich, Perhaps Bacula 7.0.5 is incompatible with such an old Windows binary -- I cannot imagine, but it is a possibility. Since you can get a free Bacula Enterprise 7.0.5 Windows file daemon from Bacula Systems (because you are listed in the AUTHORS file), why don't you try it? Best regards, Kern On 14-10-19 01:02 PM, Ulrich Leodolter wrote: Hello Dan, On Sat, 2014-10-18 at 13:32 -0400, Dan Langille wrote: On Oct 18, 2014, at 4:03 AM, Ulrich Leodolter ulrich.leodol...@obvsg.at wrote: Hello, we have Win7 backup which does not come to an end within MaxRunTime=12h. server runs 7.0.5 (28 July 2014), the client has installed the bacula-enterprise-win64-7.0.5.exe. but the problem started about 2 months ago, at that time windows client 5.2.10 was installed on the machine. the backup itself is about 100GB compressed and seems to finish on the client after about 6 hours, below are the last messages of the job before it gets stuck. 2014-10-18 03:18:09 troll-sd JobId 635821: Committing spooled data to Volume Backup-0779. Despooling 1,692,736,419 bytes ... 2014-10-18 03:18:18 troll-sd JobId 635821: Despooling elapsed time = 00:00:09, Transfer rate = 188.0 M Bytes/second 2014-10-18 03:18:19 troll-sd JobId 635821: Elapsed time=06:11:45, Transfer rate=4.691 M Bytes/second 2014-10-18 03:18:22 troll-sd JobId 635821: Sending spooled attrs to the Director. Despooling 603,449,667 bytes . mysql status at the same time: # echo show full processlist | mysql Id UserHostdb Command TimeState Info 6854bacula localhost bacula Sleep 522 NULL 6873bacula localhost bacula Query 21143 Sending data INSERT INTO File (FileIndex, JobId, PathId, FilenameId, LStat, MD5, DeltaSeq) SELECT batch.FileIndex, batch.JobId, Path.PathId, Filename.FilenameId,batch.LStat, batch.MD5, batch.DeltaSeq FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN Filename ON (batch.Name = Filename.Name) 6899rootlocalhost NULLQuery 0 NULLshow full processlist we have a bunch of other clients (about 30), a mixture of linux, win7 and mac powerpc. all other backups run without problems for years now. there are even larger backups, in size and in number of files. does anyone have an idea why this single batch insert does not complete? do i need to analyze the attrs spool file itself ? yesterday i optimized the bacula database, but that doesn't help. there must be something special in the attrs spool file which the mysql server can't handle. the server runs on standard CentOS 6.5 x86_64. This is something which should be asked in the user mailing list, not the devel mailing list. I am replying to that list instead. Ok Is this a large number of files? about 75, not very large. I had something which took a while. I sped it up by giving PostgreSQL more memory. Perhaps MySQL can do the same. Here’s what I did: https://plus.google.com/+DanLangille/posts/AKXoRido3U1 the mysql database is already optimized and has enough memory. backups up 400 files and 700GB run without problems. below are last job messages of the last failed jobs, it was canceled after 12 hours max run time. 2014-10-19 02:49:15 troll-sd JobId 635915: Elapsed time=05:43:32, Transfer rate=5.095 M Bytes/second 2014-10-19 02:49:16 troll-sd JobId 635915: Sending spooled attrs to the Director. Despooling 603,418,522 bytes ... 2014-10-19 09:05:43 troll-dir JobId 635915: Fatal error: Max run time exceeded. Job canceled. 2014-10-19 09:41:17 troll-dir JobId 635915: Error: Bacula troll-dir 7.0.5 (28Jul14): the database shows already about 600k files for this jobs. mysql select count(*) from File where JobId = '635915' and LStat is not null; +--+ | count(*) | +--+ | 616848 | +--+ 1 row in set (0.00 sec) is it possible that some special file attr brings the mysql datebase into troubles ? i really cant imagine. the mysql database is almost idle after first 600k have been inserted. there is no io traffic and cpu usage is also low. it seems i have to dump spooled attrs files tomorrow and compare to database to see at which attrs have been inserted and at which one it stops. has anyone a better idea how to debug this problem? i am little bit lost :) because in the last 6 years since i am using bacula i never run into a problem like this. best regards ulrich -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://p.sf.net/sfu/Zoho ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Recycling problem.
Hello, I have not seen your original post so I respond only to comments you mention below without understanding the full issue. Yes, there can be typically a few seconds delay between when a volume is chosen for use and when it expires. The use duration is only checked when the volume is first selected and not at any other time during running the job. This can mean that a volume will be used for more time than specified in the use duration. It would not be easy to fix this, and any simple fix might cause performance problems so you must be aware of this restriction. By the way, there were quite a few race conditions concerning use durations and other time periods that affect whether or not a volume can continue to be used. Many of these race conditions were fixed in 7.0.5. If you are having problems with volumes, I strongly recommend upgrading. Best regards, Kern On 14-10-16 07:28 PM, Giuseppe Vitillaro wrote: Apologies for appending to my own post, but I found another occurence of the same pattern, I didn't notice, in another job of some months ago, again attached to this message. The same volumes are involved, and these, for what I can see from my logs, are the only occurences of the pattern. It looks like that a volume exceeding the use duration once the job has choosed the backup volume, create this problem. May I guess the routine find_next_volume_for_append() in the source next_vol.c of the director could have a bug, at least in the version 5.2.13 (19Jan13) I'm using? In all the other cases I've verified, almost one year of correctly running jobs, the use duration have not been checked just after the beginning of the job, once the director has already decided the volume to use, but at a different time. I may be on the wrong track, but if I'm right bacula may overwrite a non empty, not purged volume. Something, I guess, all the bacula users would hate, isn't? G. Vitillaro. I can't understand why the bacula director, 5.2.13 under a stable updated gentoo, recycled one volume 000506L4, the correct one in the slot 9 of my changer, but instead the storage daemon recycled the current volume mounted in drive1, from slot4, volume 000529L4 and without actually doing any pruning on the volume, pruning that was correctly performed for the 000506L4 volume. Note that the volume 000506L4 exceeded Max configure use duration just before the records for volume 000506L4 had been pruned. After this I've just a sequence, complete log attached to this message, of Recycled volume 000506L4 Recycled volume 000529L4 on device lto1 (/dev/nlto1), all previous data lost. This configuration of bacula had been running for quite a while without a glitch, almost 10 months now and I had not any hardware error on my library at the time of this job, at least for what I can see. I can't understand what is going on. Any clue? Regards, G. Vitillaro. -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://p.sf.net/sfu/Zoho ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://p.sf.net/sfu/Zoho___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] can't run concurrent restores using multiple tape drives
There is nothing I know in Bacula that specifically restricts concurrent read jobs on a storage device. If you use defaults, read/write are treated the same and are limited to maximum values configured. It is possibly, however, to restrict the number of simultaneous read jobs (at least in version 7.0). So, if your restore jobs are waiting on storage, it is most likely some restriction such as a pool or a volume that is already in uses. In version 7.0, you can even do simultaneous reads from the same disk volume, but with the restriction that there is only one job per device. I.e. with multiple devices, you can read the same disk volume simultaneously. For tapes, only one job can read from a given volume at any one time -- this is a physical limitation of the device rather than any Bacula restriction. Best regards, Kern On 14-10-13 03:54 PM, jaredk51 wrote: I'm working with Amazon VTL (Virtual Tape Library) and Bacula v 5.2.6 which functions well and can run concurrent jobs to multiple tape drives just fine. I want to speed up restores for DR purposes and make use of the 10 virtual tape drives VTL gives you. I am not sure if bacula supports restoring to multiple tape drives at the same time and haven't been able to find anything in the documentation as such. I have created multiple restore jobs and ran them concurrently just fine but each restore job waits for the first tape drive to complete before running. JobId Level Name Status == 423 RestoreFiles.2014-10-13_19.35.32_03 is running 424 RestoreFiles2.2014-10-13_19.35.53_04 is waiting on Storage Tape1 So running concurrent restores doesn't provide any net benefit as they can only run 1 at a time. If anyone has any information regarding running restore jobs at the same time using multiple tape drives please let me know. Thanks in advance. My restore job configs look like this: ## Job { Name = RestoreFiles Type = Restore Client = backup02 FileSet = Full Set Pool = Disk Messages = Standard Where = /mnt/restores Maximum Concurrent Jobs = 10 Prefer Mounted Volumes = no } Job { Name = RestoreFiles2 Type = Restore Client = backup02 FileSet = Full Set2 Pool = Disk Messages = Standard Where = /mnt/restores Maximum Concurrent Jobs = 10 Prefer Mounted Volumes = no } autochanger and Devices from bacula-sd.conf Autochanger { Name = Autochanger Device = Drive-1, Drive-2, Drive-3, Drive-4, Drive-5, Drive-6, Drive-7, Drive-8, Drive-9, Drive-10 Changer Command = /etc/bacula/scripts/mtx-changer %c %o %S %a %d Changer Device = /dev/sg10 } Device { Name = Drive-1 Drive Index = 0 Media Type = LTO Archive Device = /dev/tape/by-path/ip-192.168.1.1:3260-iscsi-iqn.1997-05.com.amazon:sgw-bcb95cd5-tapedrive-01-lun-0-nst AutomaticMount = yes; # when device opened, read it AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; LabelMedia = yes; AutoChanger = yes # Enable the Alert command only if you have the mtx package loaded Alert Command = sh -c 'tapeinfo -f %c |grep TapeAlert|cat' SpoolDirectory = /etc/bacula/spool } Device { Name = Drive-2 Drive Index = 1 Media Type = LTO Archive Device = /dev/tape/by-path/ip-192.168.1.1:3260-iscsi-iqn.1997-05.com.amazon:sgw-bcb95cd5-tapedrive-02-lun-0-nst AutomaticMount = yes; # when device opened, read it AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; LabelMedia = yes; AutoChanger = yes # Enable the Alert command only if you have the mtx package loaded Alert Command = sh -c 'tapeinfo -f %c |grep TapeAlert|cat' SpoolDirectory = /etc/bacula/spool } Device { Name = Drive-3 Drive Index = 2 Media Typ. -- View this message in context: http://bacula.10910.n7.nabble.com/can-t-run-concurrent-restores-using-multiple-tape-drives-tp79446.html Sent from the Bacula - Users mailing list archive at Nabble.com. -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://p.sf.net/sfu/Zoho ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://p.sf.net/sfu/Zoho ___ Bacula-users mailing list Bacula
Re: [Bacula-users] Recycling problem.
All the messages that you show below seem to be very consistent with the way that Bacula does/did pruning in version 5.2.x. To know exactly why it chose to recycle a particular volume, you would have to look in detail at the Volume information just before it was recycled. During the pruning process, multiple volumes can be marked purged, even if they are not immediately recycled. Even though a volume is recycled, by the Director, it may not be rewritten if the SD does not want to use it. The SD issues a message when the data has been overwritten. In your case, it appears that two volumes were recycled, but only one was actually used by the SD, at least in that particular job output. From what you show, it would be hard to conclude that Bacula has made an error (I am not saying that Bacula has no errors). Best regards, Kern On 14-10-15 05:57 AM, Giuseppe Vitillaro wrote: I can't understand why the bacula director, 5.2.13 under a stable updated gentoo, recycled one volume 000506L4, the correct one in the slot 9 of my changer, but instead the storage daemon recycled the current volume mounted in drive1, from slot4, volume 000529L4 and without actually doing any pruning on the volume, pruning that was correctly performed for the 000506L4 volume. Note that the volume 000506L4 exceeded Max configure use duration just before the records for volume 000506L4 had been pruned. After this I've just a sequence, complete log attached to this message, of Recycled volume 000506L4 Recycled volume 000529L4 on device lto1 (/dev/nlto1), all previous data lost. This configuration of bacula had been running for quite a while without a glitch, almost 10 months now and I had not any hardware error on my library at the time of this job, at least for what I can see. I can't understand what is going on. Any clue? Regards, G. Vitillaro. -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://p.sf.net/sfu/Zoho ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://p.sf.net/sfu/Zoho___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Bacula Status Report
Hello, On 14-10-13 09:38 PM, Pasi Kärkkäinen wrote: On Fri, Sep 05, 2014 at 11:23:31PM +0200, Kern Sibbald wrote: Hello, Hello, I have posted a Bacula Status report to the www.bacula.org site. It discusses the following items: 1. Bacula Release Status 2. Windows Binaries Hmm.. so there are no community windows binaries anymore? There have not been any for quite a number of years -- since 5.2.10. Are the windows binaries shipped by Bacula Systems proprietary or opensource ? They are proprietary but they can be obtained freely by Bacula open source users, and hopefully by everyone for personal use by the end of the year. The principal reason for only one version of the Windows binaries was that for several years I was way too overloaded with work and had to reduce somewhere, and since Windows is especially painful, that is where I reduced. I am now much less overloaded, so hope to correct a number of such problems by the end of the year. Best regards, Kern Thanks, -- Pasi 3. Bacula Enterprise 4. Vacation 5. Bareos The following is a link to the report. http://blog.bacula.org/bacula-status-report-30-august-2014/ Best regards, Kern -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://p.sf.net/sfu/Zoho ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] compatibility
It is highly unlikely it is compatible, and even if it works, at some point in time, it is likely to fail. I do not recommend trying it. Kern On 09/26/2014 02:16 PM, Andreas Frömmel wrote: Hello, is the bacula-client 7.05 compatible with the bacula-server 5.2.6 ? Best regards, -- Andreas Frömmel -- Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer http://pubads.g.doubleclick.net/gampad/clk?id=154622311iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer http://pubads.g.doubleclick.net/gampad/clk?id=154622311iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Mac OSX 10.8 and above support
Hello, You probably have already sufficient responses, but a few points might interest you (one already mentioned). 1. You only need to load MacPorts on one machine to build the package. 2. If you have an older Mac version loaded somewhere, the current scripts work, and apparently run perfectly fine on the new Macs. I'll see if I can build one on my old Mac here this weekend. Best regards, Kern On 09/18/2014 08:01 PM, bwellsnc wrote: Hey everyone, I am trying to see if anyone has done work on the platforms/osx code base. I am wanting to build a dmg client so I can distribute it within my network. The problem is, it looks like it has been built for 10.4 which will not work since this is still PPC code. I have tried to get it to build on 10.8 and above but with no luck. I do not want to use MacPorts since this means I have to install MacPorts on all of my machines as well. If anyone can help, I would appreciate it. Thanks! Brent -- Slashdot TV. Video for Nerds. Stuff that Matters. http://pubads.g.doubleclick.net/gampad/clk?id=160591471iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Slashdot TV. Video for Nerds. Stuff that Matters. http://pubads.g.doubleclick.net/gampad/clk?id=160591471iu=/4140/ostg.clktrk___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: Bacula: Backup Canceled of lsales2-fd Full
I've seen a number of cases like this, and it is a problem with VSS. Typically a reboot fixes the problem, and if not, it may be that VSS is not installed or not automatically started (perhaps the service was deactivated). Best regards, Kern On 09/17/2014 03:10 PM, Gary Stainburn wrote: I have a laptop FD which has suddenly stopped backing up. It's struggling with the VSS snapshot generation by the looks of it, but I don't know why. It did have a few disk errors which I fixed using chkdsk. I have uninstalled and re-installed the Baula FD client software. I've looked in the Windows system event log and found nothing. Can anyone suggest where I go next to try to fix it? Cheers Gary -- Forwarded Message -- 17-Sep 12:56 eddie1-dir JobId 90804: shell command: run BeforeJob "/etc/bacula/jobcheck.sh lsales2-fd" 17-Sep 12:56 eddie1-dir JobId 90804: BeforeJob: PING 10.6.104.200 (10.6.104.200) 56(84) bytes of data. 17-Sep 12:56 eddie1-dir JobId 90804: BeforeJob: 64 bytes from 10.6.104.200: icmp_seq=1 ttl=125 time=2.71 ms 17-Sep 12:56 eddie1-dir JobId 90804: BeforeJob: 17-Sep 12:56 eddie1-dir JobId 90804: BeforeJob: --- 10.6.104.200 ping statistics --- 17-Sep 12:56 eddie1-dir JobId 90804: BeforeJob: 1 packets transmitted, 1 received, 0% packet loss, time 0ms 17-Sep 12:56 eddie1-dir JobId 90804: BeforeJob: rtt min/avg/max/mdev = 2.711/2.711/2.711/0.000 ms 17-Sep 12:56 eddie1-dir JobId 90804: Start Backup JobId 90804, Job=lsales2.2014-09-17_12.56.12_36 17-Sep 12:56 eddie1-dir JobId 90804: Using Device "DoncStorage" to write. 17-Sep 12:56 lou-sd JobId 90804: Volume "donc14207" previously written, moving to end of data. 17-Sep 12:56 lou-sd JobId 90804: Ready to append to end of Volume "donc14207" size=3623008925 17-Sep 12:56 lou-sd JobId 90804: Spooling data ... 17-Sep 12:56 lsales2-fd JobId 90804: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="C" 17-Sep 13:00 lsales2-fd JobId 90804: Fatal error: CreateSGenerate VSS snapshots failed. ERR=The operation completed successfully. 17-Sep 13:00 lsales2-fd JobId 90804: Error: VSS API failure calling "BackupComplete". ERR=Object is not initialized; called during restore or not called in correct sequence. 17-Sep 13:00 lou-sd JobId 90804: Committing spooled data to Volume "donc14207". Despooling 392 bytes ... 17-Sep 13:00 eddie1-dir JobId 90804: Error: Bacula eddie1-dir 5.2.13 (19Jan13): Build OS: x86_64-redhat-linux-gnu redhat Cat) JobId: 90804 Job:lsales2.2014-09-17_12.56.12_36 Backup Level: Full Client: "lsales2-fd" 5.2.10 (28Jun12) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64 FileSet:"Windows 7" 2012-02-14 14:22:52 Pool: "Donc" (From Job resource) Catalog:"MyCatalog" (From Client resource) Storage:"lou-donc" (From Job resource) Scheduled time: 17-Sep-2014 12:56:06 Start time: 17-Sep-2014 12:56:15 End time: 17-Sep-2014 13:00:45 Elapsed time: 4 mins 30 secs Priority: 10 FD Files Written: 0 SD Files Written: 0 FD Bytes Written: 0 (0 B) SD Bytes Written: 0 (0 B) Rate: 0.0 KB/s Software Compression: None VSS:yes Encryption: no Accurate: no Volume name(s): Volume Session Id: 72 Volume Session Time:1410876246 Last Volume Bytes: 3,623,008,925 (3.623 GB) Non-fatal FD errors:2 SD Errors: 0 FD termination status: Error SD termination status: Running Termination:*** Backup Error *** 17-Sep 13:00 eddie1-dir JobId 90804: Rescheduled Job lsales2.2014-09-17_12.56.12_36 at 17-Sep-2014 13:00 to re-run in 600 seconds (17-Sep-2014 13:10). 17-Sep 13:00 eddie1-dir JobId 90804: Job lsales2.2014-09-17_12.56.12_36 waiting 600 seconds for scheduled start time. 17-Sep 13:06 eddie1-dir JobId 90804: Bacula eddie1-dir 5.2.13 (19Jan13): Build OS: x86_64-redhat-linux-gnu redhat Cat) JobId: 90804 Job:lsales2.2014-09-17_12.56.12_36 Backup Level: Full Client: "lsales2-fd" 5.2.10 (28Jun12) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64 FileSet:"Windows 7" 2012-02-14 14:22:52 Pool: "Donc" (From Job resource) Catalog:"MyCatalog" (From Client resource) Storage:"lou-donc" (From Job resource) Scheduled time: 17-Sep-2014 12:56:06 Start time:
Re: [Bacula-users] Cryptic SD status: zero despooling speed
Hello, The rates that are shown in the status report are meant to be the incoming data rates, and as you say do not take into account spooling/despooling. I will be very surprised if there is any decrease in throughput from version 2.4.x to 7.0.x. Concerning reporting despooling rates: as far as I can see from your output, version 7.0.x is indeed reporting the despooling rate, which is larger than for 2.4.x. The despooling rate is only reported in the job log when the spool is committed typically at the end of the job, but if it despools multiple times, it can be reported multiple times. If I remember right the status command will give you despooling rates if the command is done during despooling, but that rate is shown with the drive information not the job information. Also it appears that the precise wording of the output has changed to make it more specific (accurate). If you were previously running 5.2.x I would check to see if there is any real change in the code, which I doubt because that part of the SD hasn't changed at least from 5.2.x -- however, 2.4.x is too old any comparison of the code would probably not be useful. Bottom line: I don't see a problem other than the labels for the statistics are slightly different. Best regards, Kern On 09/14/2014 05:06 AM, Ivan Adzhubey wrote: On Saturday, September 13, 2014 06:37:31 PM Ivan Adzhubey wrote: The Running Jobs Files, Bytes, AveBytes/sec, and LastBytes/sec track spooling process only. These counters stop as soon as the spooling to disk is completed. They do *not* track despooling at all. Despooling to tape is only tracked under corresponding Device sections. I've also discovered the following inconsistency in backup job logs between v2.4.4 (which I had previously installed) and v 7.0.5 I am running now: v2.4.4: 10-Sep 08:39 rosalind-dir JobId 52600: Start Backup JobId 52600, Job=BackupCatalog.2014-09-10_08.30.00.48 10-Sep 08:39 rosalind-dir JobId 52600: Using Device Drive-1 10-Sep 08:39 rosalind-sd JobId 52600: Spooling data ... 10-Sep 08:42 rosalind-sd JobId 52600: Job write elapsed time = 00:02:38, Transfer rate = 11.14 M bytes/second ## Note: The line above reports spooling stage transfer rate 10-Sep 08:42 rosalind-sd JobId 52600: Committing spooled data to Volume LF0033. Despooling 1,762,247,516 bytes ... 10-Sep 08:43 rosalind-sd JobId 52600: Despooling elapsed time = 00:01:08, Transfer rate = 25.91 M bytes/second ## Note: Here the transfer rate during despooling to tape is reported 10-Sep 08:43 rosalind-sd JobId 52600: Sending spooled attrs to the Director. Despooling 289 bytes ... 10-Sep 08:43 rosalind-dir JobId 52600: Bacula rosalind-dir 2.4.4 (28Dec08): 10-Sep-2014 08:43:34 V7.0.5 (logs for the same job): 13-Sep 22:47 rosalind-dir JobId 52636: Start Backup JobId 52636, Job=BackupCatalog.2014-09-13_22.36.44_48 13-Sep 22:47 rosalind-dir JobId 52636: Using Device Drive-1 to write. 13-Sep 22:47 rosalind-sd JobId 52636: Spooling data ... ## Note: No transfer rate is now reported for the spooling stage at all 13-Sep 22:51 rosalind-sd JobId 52636: Committing spooled data to Volume LF0033. Despooling 2,102,934,459 bytes ... 13-Sep 22:52 rosalind-sd JobId 52636: Despooling elapsed time = 00:01:27, Transfer rate = 24.17 M Bytes/second 13-Sep 22:52 rosalind-sd JobId 52636: Elapsed time=00:05:02, Transfer rate=6.956 M Bytes/second ## Note: Transfer rate during despooling to tape is still reported 13-Sep 22:52 rosalind-sd JobId 52636: Sending spooled attrs to the Director. Despooling 291 bytes ... 13-Sep 22:52 rosalind-dir JobId 52636: Bacula rosalind-dir 7.0.5 (28Jul14) Why this has been changed? --Ivan -- Want excitement? Manually upgrade your production database. When you want reliability, choose Perforce Perforce version control. Predictably reliable. http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want excitement? Manually upgrade your production database. When you want reliability, choose Perforce Perforce version control. Predictably reliable. http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Cryptic SD status: zero despooling speed
Hello, My comments are below ... On 09/14/2014 09:25 AM, Ivan Adzhubey wrote: Hi Kern, Thank you for taking your time and trying to help me. Please scroll down for my comments. On Sunday, September 14, 2014 08:26:23 AM Kern Sibbald wrote: Hello, The rates that are shown in the status report are meant to be the incoming data rates, and as you say do not take into account spooling/despooling. Hmm, I never said they do not take into account despooling. Agreed, I wasn't contesting anything you said only trying to clarify. I will be very surprised if there is any decrease in throughput from version 2.4.x to 7.0.x. Me too, but at this point all I was trying to do is to figure out how to track the transfer rates with 7.0.5 (which was easier with 2.4.4) since that's what I need to be able to do to debug the problem. One of the problems I have is that you have clipped the output just before the place where I would expect the information to be printed. With numerous clipped outputs, I cannot really follow. If you want a better opinion, I suggest that you send me the *full* job output report from 2.4.4 and the equivalent from 7.0.5, then perhaps I can see what is going on. In a number of your listings, I have problems knowing whether it is 2.4.4 output or 7.0.5 output, so if you include the *full* output, it should be clearer to me. Since I am not sure I interpreted version 7.0.5 status reports correctly I can't tell what's going on at this point. One thing I am sure is that the backup jobs which used to take about 8 hours total with 2.4.4 took more than 48 hours after the upgrade. But I am still not sure why this happened. The most likely reason is some bottleneck in the catalog, especially if you are using MySQL or you have updated the MySQL/Postgres versions. The default configuration files are horribly tuned for Bacula. You can verify this by looking at the amount of time that it takes to despool. Concerning reporting despooling rates: as far as I can see from your output, version 7.0.x is indeed reporting the despooling rate, which is larger than for 2.4.x. That's correct for this particular job. I have specifically chosen the most simple single job for comparisons. This was done only to compare the format and contents of the status reports between 2.4.4 and 7.0.5. The despooling rate is only reported in the job log when the spool is committed typically at the end of the job, but if it despools multiple times, it can be reported multiple times. Yep, I am aware of this fact. Here's another example where a large full backup job exhausted disk spooling limit and required two iterations of spooling/despooling (and a tape change). The despooling rates were reported twice in the logs, for each despooling operation separately. No spooling rates were ever reported for the spooling parts of the process: 12-Sep 01:24 rosalind-dir JobId 52615: Using Device Drive-0 to write. 12-Sep 01:24 rosalind-sd JobId 52615: Volume LI0004 previously written, moving to end of data. 12-Sep 01:25 rosalind-sd JobId 52615: Ready to append to end of Volume LI0004 at file=106. 12-Sep 01:25 rosalind-sd JobId 52615: Spooling data ... 13-Sep 03:27 rosalind-sd JobId 52615: User specified Device spool size reached: DevSpoolSize=884,763,273,281 MaxDevSpoolSize=884,763,262,976 ## Note: Spooling hits the configured limit and job switches to despooling but no spooling rates are reported 13-Sep 03:27 rosalind-sd JobId 52615: Writing spooled data to Volume. Despooling 884,763,273,281 bytes ... 13-Sep 09:17 rosalind-sd JobId 52615: End of Volume LI0004 at 827:8233 on device Drive-0 (/dev/nst0). Write of 64512 bytes got -1. 13-Sep 09:18 rosalind-sd JobId 52615: Re-read of last block succeeded. 13-Sep 09:18 rosalind-sd JobId 52615: End of medium on Volume LI0004 Bytes=781,013,366,784 Blocks=12,106,481 at 13-Sep-2014 09:18. 13-Sep 09:18 rosalind-sd JobId 52615: 3307 Issuing autochanger unload slot 4, drive 0 command. 13-Sep 09:20 rosalind-dir JobId 52615: There are no more Jobs associated with Volume LI0007. Marking it purged. 13-Sep 09:20 rosalind-dir JobId 52615: All records pruned from Volume LI0007; marking it Purged 13-Sep 09:20 rosalind-dir JobId 52615: Recycled volume LI0007 13-Sep 09:20 rosalind-sd JobId 52615: 3304 Issuing autochanger load slot 7, drive 0 command. 13-Sep 09:20 rosalind-sd JobId 52615: 3305 Autochanger load slot 7, drive 0, status is OK. 13-Sep 09:21 rosalind-sd JobId 52615: Recycled volume LI0007 on tape device Drive-0 (/dev/nst0), all previous data lost. 13-Sep 09:21 rosalind-sd JobId 52615: New volume LI0007 mounted on device Drive-0 (/dev/nst0) at 13-Sep-2014 09:21. 13-Sep 11:04 rosalind-sd JobId 52615: Despooling elapsed time = 07:32:43, Transfer rate = 32.57 M Bytes/second ## First despooling iteration completed in 07:32 hours, at 32.57 M Bytes/second (despooling rate reported) 13-Sep 11:27 rosalind
Re: [Bacula-users] Cryptic SD status: zero despooling speed
Hello, The AveBytes/sec is the total number of bytes read from the FD for that job divided by the total number of seconds the job has been running. The LastBytes/sec is the number of bytes read from the FD for that job since the last status command using a trivial smoothing algorithm that includes the prior value of LastBytes. Note, if you use multiple status commands the LastBytes/sec will be updated if you wait at least 10 seconds between status commands. Part of the calculation is done with 32 bit integer arithmetic, so there is a possibility that there is a truncation error once the TotalBytes exceed 4 billion -- i.e. there may be a bug in the calculation that I will look at. If you can check to see if the calculations look good during the first 4 GB of backup, but then drop to zero, please open a bug report. Best regards, Kern On 09/13/2014 04:49 AM, Ivan Adzhubey wrote: Hi all, I have recently upgraded to Bacula 7.0.5 on my old backup server, which seems to have worked fine. However, I am now trying to figure out how to interpret rather detailed status messages produced by various status command. One particular puzzling thing is the following Storage status line: *status sd -sd Version: 7.0.5 (28 July 2014) i686-pc-linux-gnu ubuntu 8.04 Daemon started 12-Sep-14 01:21. Jobs: run=2, running=2. ... Running Jobs: Writing: Full Backup job JobId=52618 Volume=LF0033 pool=LargeFull device=Drive-1 (/dev/nst1) spooling=0 despooling=1 despool_wait=0 Files=292,872 Bytes=63,980,083,815 AveBytes/sec=0 LastBytes/sec=0 FDReadSeqNo=3,388,503 in_msg=2576431 out_msg=9 fd=19 The strange part is that the AveBytes/sec and LastBytes/sec values are always zero while at the same both Files and Bytes counters keep incrementing. The job seems to be busy despooling and making progress but the speed-o-meter readings are not reflecting this. Is this a known problem? Thanks, Ivan -- Want excitement? Manually upgrade your production database. When you want reliability, choose Perforce Perforce version control. Predictably reliable. http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: Restore from dead client
On 09/10/2014 02:58 PM, Martin Simmons wrote: On Tue, 09 Sep 2014 20:25:18 +0200, Kern Sibbald said: On 09/09/2014 07:46 PM, Martin Simmons wrote: It looks like removing readfifo=yes will not help, because the restore code doesn't look at it. The restore will not work without a process already reading from the fifo. The simplest Bacula restore doesn't use a fifo. That is what I am recommending that he try. Yes, but it looks like his backup contains data of type FT_FIFO, so the restore will always try to write it back into a fifo. Yes, good point. That just proves the complexity and problems one can have with a fifo. It shows the advantage of using the bpipe plugin at least one can later restore the file without the plugin. Regards, Kern __Martin However it seems that the configuration is quite complete (at least for me). Best regards, Kern __Martin On Tue, 9 Sep 2014 10:57:59 -0400, Kenny Noe said: Kern, et al I tried another backup. Here is my cliconfig. I parred it down to just the restore stuff. # # bluewhale # Client { Name = bluewhale Address= bluewhale.backup.bnesystems.com Catalog= BS01-Catalog Password = xx FileRetention = 15 days JobRetention = 15 days AutoPrune = yes MaximumConcurrentJobs = 1 } Job { Name = Restore_mail_bluewhale FileSet= Full_mail_bluewhale Type = Restore Pool = Pool_mail_bluewhale Client = bluewhale Messages = Standard } Pool { Name = Pool_mail_bluewhale PoolType = Backup Storage= Storage_bluewhale MaximumVolumeJobs = 1 CatalogFiles = yes AutoPrune = yes VolumeRetention= 1 week Recycle= yes LabelFormat= mail- } Storage { Name = Storage_bluewhale Address= 10.10.10.199 SDPort = 9103 Password = imadirector Device = File_bluewhale MediaType = NAS_bluewhale MaximumConcurrentJobs = 1 } Schedule { Name = Schedule_mail_bluewhale Run= Level=Full sun-sat at 01:00 } FileSet { Name = Full_mail_bluewhale Include { Options { signature=SHA1 } File=mail.tar } } During the restore I ran status storage from the console. I get this *status sto The defined Storage resources are: 1: Storage_asterisk 2: Storage_besc-4dvapp 3: Storage_besc-bs01 4: Storage_besc-unixmgr01 5: Storage_bluewhale 6: Storage_demo 7: Storage_dev 8: Storage_mako Select Storage resource (1-8): 5 Connecting to Storage daemon Storage_bluewhale at 10.10.10.199:9103 BS01-SD1 Version: 5.2.2 (26 November 2011) x86_64-unknown-linux-gnu ubuntu 11.10 Daemon started 09-Sep-14 09:19. Jobs: run=1, running=0. Heap: heap=598,016 smbytes=386,922 max_bytes=405,712 bufs=947 max_bufs=949 Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 mode=0,0 Running Jobs: Reading: Full Restore job Restore_mail_bluewhale JobId=12922 Volume=mail-0386 pool=Pool_mail_bluewhale device=File_bluewhale (/nas/bacula/bluewhale) Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=2320699 fd=6 Jobs waiting to reserve a drive: Terminated Jobs: JobId LevelFiles Bytes Status FinishedName === 12913 Incr10873.85 M OK 08-Sep-14 20:02 Backup_os_dev 12912 Full 461.80 G OK 08-Sep-14 20:24 Backup_app_demo 12914 Incr23057.85 M OK 09-Sep-14 00:00 Backup_os_asterisk 12916 Incr 3168.06 M OK 09-Sep-14 00:01 Backup_os_besc-unixmgr01 12917 Incr 0 0 Cancel 09-Sep-14 00:03 Backup_os_bluewhale 12918 Full 4501.3 M OK 09-Sep-14 00:04 Backup_app_dev 12915 Incr2561.099 G OK 09-Sep-14 00:06 Backup_os_besc-bs01 12919 Full 454.41 G OK 09-Sep-14 01:04 Backup_app_mako 129200 0 Cancel 09-Sep-14 09:17 Restore_mail_bluewhale 129210 0 OK 09-Sep-14 09:43 Restore_mail_bluewhale Device status: Device File_asterisk (/nas/bacula/asterisk) is not open. Device
Re: [Bacula-users] Bacula writing in wrong volumes
Hello, The problem is basically because you have one idea about how to do backups and Bacula has another idea. You want Bacula to put data on the *exact* Volume that you specify. The whole logic of Bacula is that Bacula will deal with what is on volumes and it will choose the volumes it wants, within certain constraints setup by the administrator. This is not to say that Bacula is right and you are wrong, or vise-versa, but that your views of volumes were different. At the beginning of a job if Bacula needs to label a volume, it will, then it will proceed with the backup. Only at the end of the job does Bacula learn that there was nothing to backup. In general is is difficult to force Bacula to use certain volumes and only those volumes. If you want to clearly separate Volume by clients, jobs, or by some other criteria, you probably should be using different Pools. Different pools are the most reliable way to ensure that only particular jobs, clients, ... go to a particular volume. Best regards, Kern On 09/09/2014 04:31 PM, Gean Michel Ceretta wrote: Dear users, I'm using file-based backups and configurated Bacula[bacula-dir Version: 5.2.13 (19 February 2013)] to write one volume per job, with an exclusive label containing the client name, data and time as shown bellow in the config files attached. The problems is: 1º Why Bacula creates a volume for a job if the job has no data to be backed up? That causes the created volume to stay open for writing, what causes another problem: 2º Instead of creating a new volume for the next client to be backed-up, Bacula writes in the empity volume created at problem 1. I'm dealing with a situation where an client named Git has no modifications, but a volume Git-{data}... was created. Then, the next job starts, for the client Samba, and the data end-up being recorded on the volume Git-{data}... because the empty volume created on the previous job that has no modifications, was not closed. What I've donne wrong? Suggestions? -- Want excitement? Manually upgrade your production database. When you want reliability, choose Perforce. Perforce version control. Predictably reliable. http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want excitement? Manually upgrade your production database. When you want reliability, choose Perforce. Perforce version control. Predictably reliable. http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: Restore from dead client
Hello, Unfortunately, is seems like your Storage definition is not correct. Also unfortunately, while I try to give occasional tips, I cannot supply full support, which is what you need at this point. In fact, I am very good in writing Bacula core code, but not very good in doing support. Best regards, Kern On 09/09/2014 04:57 PM, Kenny Noe wrote: Kern, et al I tried another backup. Here is my cliconfig. I parred it down to just the restore stuff. # # bluewhale # Client { Name = bluewhale Address = bluewhale.backup.bnesystems.com Catalog = BS01-Catalog Password = "xx" FileRetention = 15 days JobRetention = 15 days AutoPrune = yes MaximumConcurrentJobs = 1 } Job { Name = Restore_mail_bluewhale FileSet = Full_mail_bluewhale Type = Restore Pool = Pool_mail_bluewhale Client = bluewhale Messages = Standard } Pool { Name = Pool_mail_bluewhale PoolType = Backup Storage = Storage_bluewhale MaximumVolumeJobs = 1 CatalogFiles = yes AutoPrune = yes VolumeRetention = 1 week Recycle = yes LabelFormat = "mail-" } Storage { Name = Storage_bluewhale Address = 10.10.10.199 SDPort = 9103 Password = "imadirector" Device = File_bluewhale MediaType = NAS_bluewhale MaximumConcurrentJobs = 1 } Schedule { Name = Schedule_mail_bluewhale Run = Level=Full sun-sat at 01:00 } FileSet { Name = Full_mail_bluewhale Include { Options { signature=SHA1 } File="mail.tar" } } During the restore I ran status storage from the console. I get this *status sto The defined Storage resources are: 1: Storage_asterisk 2: Storage_besc-4dvapp 3: Storage_besc-bs01 4: Storage_besc-unixmgr01 5: Storage_bluewhale 6: Storage_demo 7: Storage_dev 8: Storage_mako Select Storage resource (1-8): 5 Connecting to Storage daemon Storage_bluewhale at 10.10.10.199:9103 BS01-SD1 Version: 5.2.2 (26 November 2011) x86_64-unknown-linux-gnu ubuntu 11.10 Daemon started 09-Sep-14 09:19. Jobs: run=1, running=0. Heap: heap=598,016 smbytes=386,922 max_bytes=405,712 bufs=947 max_bufs=949 Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 mode=0,0 Running Jobs: Reading: Full Restore job Restore_mail_bluewhale JobId=12922 Volume="mail-0386" pool="Pool_mail_bluewhale" device="File_bluewhale" (/nas/bacula/bluewhale) Files=0 Bytes=0 Bytes/sec=0
Re: [Bacula-users] Fwd: Restore from dead client
On 09/09/2014 07:46 PM, Martin Simmons wrote: It looks like removing readfifo=yes will not help, because the restore code doesn't look at it. The restore will not work without a process already reading from the fifo. The simplest Bacula restore doesn't use a fifo. That is what I am recommending that he try. However it seems that the configuration is quite complete (at least for me). Best regards, Kern __Martin On Tue, 9 Sep 2014 10:57:59 -0400, Kenny Noe said: Kern, et al I tried another backup. Here is my cliconfig. I parred it down to just the restore stuff. # # bluewhale # Client { Name = bluewhale Address= bluewhale.backup.bnesystems.com Catalog= BS01-Catalog Password = xx FileRetention = 15 days JobRetention = 15 days AutoPrune = yes MaximumConcurrentJobs = 1 } Job { Name = Restore_mail_bluewhale FileSet= Full_mail_bluewhale Type = Restore Pool = Pool_mail_bluewhale Client = bluewhale Messages = Standard } Pool { Name = Pool_mail_bluewhale PoolType = Backup Storage= Storage_bluewhale MaximumVolumeJobs = 1 CatalogFiles = yes AutoPrune = yes VolumeRetention= 1 week Recycle= yes LabelFormat= mail- } Storage { Name = Storage_bluewhale Address= 10.10.10.199 SDPort = 9103 Password = imadirector Device = File_bluewhale MediaType = NAS_bluewhale MaximumConcurrentJobs = 1 } Schedule { Name = Schedule_mail_bluewhale Run= Level=Full sun-sat at 01:00 } FileSet { Name = Full_mail_bluewhale Include { Options { signature=SHA1 } File=mail.tar } } During the restore I ran status storage from the console. I get this *status sto The defined Storage resources are: 1: Storage_asterisk 2: Storage_besc-4dvapp 3: Storage_besc-bs01 4: Storage_besc-unixmgr01 5: Storage_bluewhale 6: Storage_demo 7: Storage_dev 8: Storage_mako Select Storage resource (1-8): 5 Connecting to Storage daemon Storage_bluewhale at 10.10.10.199:9103 BS01-SD1 Version: 5.2.2 (26 November 2011) x86_64-unknown-linux-gnu ubuntu 11.10 Daemon started 09-Sep-14 09:19. Jobs: run=1, running=0. Heap: heap=598,016 smbytes=386,922 max_bytes=405,712 bufs=947 max_bufs=949 Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 mode=0,0 Running Jobs: Reading: Full Restore job Restore_mail_bluewhale JobId=12922 Volume=mail-0386 pool=Pool_mail_bluewhale device=File_bluewhale (/nas/bacula/bluewhale) Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=2320699 fd=6 Jobs waiting to reserve a drive: Terminated Jobs: JobId LevelFiles Bytes Status FinishedName === 12913 Incr10873.85 M OK 08-Sep-14 20:02 Backup_os_dev 12912 Full 461.80 G OK 08-Sep-14 20:24 Backup_app_demo 12914 Incr23057.85 M OK 09-Sep-14 00:00 Backup_os_asterisk 12916 Incr 3168.06 M OK 09-Sep-14 00:01 Backup_os_besc-unixmgr01 12917 Incr 0 0 Cancel 09-Sep-14 00:03 Backup_os_bluewhale 12918 Full 4501.3 M OK 09-Sep-14 00:04 Backup_app_dev 12915 Incr2561.099 G OK 09-Sep-14 00:06 Backup_os_besc-bs01 12919 Full 454.41 G OK 09-Sep-14 01:04 Backup_app_mako 129200 0 Cancel 09-Sep-14 09:17 Restore_mail_bluewhale 129210 0 OK 09-Sep-14 09:43 Restore_mail_bluewhale Device status: Device File_asterisk (/nas/bacula/asterisk) is not open. Device File_besc-4dvapp (/nas/bacula/besc-4dvapp) is not open. Device File_besc-bs01 (/nas/bacula/besc-bs01) is not open. Device File_besc-unixmgr01 (/nas/bacula/besc-unixmgr01) is not open. Device File_bluewhale (/nas/bacula/bluewhale) is mounted with: Volume: mail-0386 Pool:*unknown* Media type: NAS_bluewhale Total Bytes Read=17,923,756,032 Blocks Read=277,836 Bytes/block=64,512 Positioned at File=4 Block=743,886,199 Device File_demo (/nas/bacula/demo
Re: [Bacula-users] Bacula for OSX 10.9
Hello Martin, Have you been talking to Dimitri? :-) Bacula Systems has no secret script for building Mac OS. It is done using the scripts in bacula/platforms/osx with only some trivial name changes that I personally made (e.g. Bacula - Bacula Enterprise, ...). All Bacula Systems low level scripts (.rpm, .deb, ...) are published in the community version, with only one exception. The exception is the scripts to build Solaris packages, which were written by Marco van Wieringen. They are not released because his build system is too complicated (at least for me) and is 3GB+ in size the last time I backed it up :-( Some day, when I take a break from writing new features, I will rewrite it in a very simple way that should be smaller than 100KB. I wasn't aware that Apple has changed the package routines. All Bacula Enterprise binaries are still build using this original script, so I will request the build sysadmin to look into the current way of doing things. If you have any tips, they would be appreciated. Best regards, Kern On 09/08/2014 03:27 PM, Martin Simmons wrote: Unfortunately the cake is rotten now :-) PackageMaker is no longer supported by Apple so the script doesn't work on OSX 10.9. Please encourage Bacula Systems to contribute a fix to this script back to the community version and build its binaries from that, rather than using a secret cake recipe. __Martin On Sun, 07 Sep 2014 16:34:00 +0200, Kern Sibbald said: The Mac OS X client for Bacula should be a standard Mac OS X package -- a xxx.dmg file. Anything that is a tar or other form is not very professional. I am not sure what homebrew supplies, but if they have done it right it is a .dmg. The instructions for building it yourself on a Mac are in the Bacula source distribution in: bacula/platforms/osx/README Once you have the developer tools installed, it is a piece of cake. Best regards, Kern On 09/07/2014 04:06 PM, Paul Mather wrote: On Sep 7, 2014, at 5:42 AM, Kern Sibbald k...@sibbald.com wrote: On 09/07/2014 07:33 AM, Eric Dannewitz wrote: I'm interested in perhaps deploying this in my k-8 school, but I have not found a good tutorial of how to install it. Or if it even works right on Mac. Anyone have some insights on this? My idea would be to back about 30 macs to an Ubuntu server. This would be a good way to setup Bacula. The Director, SD and catalog work well on a Ubuntu server -- I recommend Trusty (14.04). For the Mac's someone probably has made the binaries and distributes them on the Internet. Otherwise if you load all the appropriate build tools on the Mac, you can easily build the FD. Later this year, Bacula Systems will provide free binaries for MacOSX which should also help. I've not used Bacula on a Mac, but I do notice that Homebrew (http://brew.sh) has a formula for bacula-fd, which could be used to install the client. Right now, it's only for the 5.x version (5.2.13), though. I hope this helps. Cheers, Paul. -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want excitement? Manually upgrade your production database. When you want reliability, choose Perforce Perforce version control. Predictably reliable. http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula for OSX 10.9
Hello Robert, Thanks for the tips. Best regards, Kern On 09/08/2014 04:16 PM, Robert Oschwald wrote: You can use MacPorts to build Bacula 7.0.4 (client by default, also supports MySQL-, PostgreSQL- and SQLite3 Server variants) Install macports (macports.org), then perform „sudo port install bacula“ This by default installs the client fd. Configure the client in /opt/local/etc/bacula/bacula-fd.conf When configured, perform „sudo port load bacula-fd“ To build a DMG file for standalone installation on other machines (which do not have MacPorts installed), you can perform sudo port mdmg bacula cd `port work bacula` .. there you find bacula-7.0.4.dmg which includes all dependencies. It’s recommended to use a separate MacPorts installation path for standalone dmg files. See https://guide.macports.org/chunked/using.binaries.html#using.binaries.binary-packages Robert Am 07.09.2014 um 07:33 schrieb Eric Dannewitz edannew...@rdschool.org: I'm interested in perhaps deploying this in my k-8 school, but I have not found a good tutorial of how to install it. Or if it even works right on Mac. Anyone have some insights on this? My idea would be to back about 30 macs to an Ubuntu server. Thanks! Sent from my iSomething -- -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want excitement? Manually upgrade your production database. When you want reliability, choose Perforce Perforce version control. Predictably reliable. http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want excitement? Manually upgrade your production database. When you want reliability, choose Perforce Perforce version control. Predictably reliable. http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula for OSX 10.9
Hello Martin, See below ... On 09/08/2014 06:12 PM, Martin Simmons wrote: Thanks, I just didn't want to OSX binaries to go down the path of the Windows binaries. No, OSX has no particular code written by Bacula Systems that is not in the community version, whereas for Windows Bacula Systems has spent a great deal of time (CHF) working on it and is willing to give out binaries but wants to wait a bit before backporting the new source code. Note, the Windows binaries are now available free to community contributors. Hopefully that will be extended to more people in the next couple of months. Best regards, Kern There is a new Xcode command productbuild, but I've not explored how to use it yet. __Martin On Mon, 08 Sep 2014 15:46:26 +0200, Kern Sibbald said: Hello Martin, Have you been talking to Dimitri? :-) Bacula Systems has no secret script for building Mac OS. It is done using the scripts in bacula/platforms/osx with only some trivial name changes that I personally made (e.g. Bacula - Bacula Enterprise, ...). All Bacula Systems low level scripts (.rpm, .deb, ...) are published in the community version, with only one exception. The exception is the scripts to build Solaris packages, which were written by Marco van Wieringen. They are not released because his build system is too complicated (at least for me) and is 3GB+ in size the last time I backed it up :-( Some day, when I take a break from writing new features, I will rewrite it in a very simple way that should be smaller than 100KB. I wasn't aware that Apple has changed the package routines. All Bacula Enterprise binaries are still build using this original script, so I will request the build sysadmin to look into the current way of doing things. If you have any tips, they would be appreciated. Best regards, Kern On 09/08/2014 03:27 PM, Martin Simmons wrote: Unfortunately the cake is rotten now :-) PackageMaker is no longer supported by Apple so the script doesn't work on OSX 10.9. Please encourage Bacula Systems to contribute a fix to this script back to the community version and build its binaries from that, rather than using a secret cake recipe. __Martin On Sun, 07 Sep 2014 16:34:00 +0200, Kern Sibbald said: The Mac OS X client for Bacula should be a standard Mac OS X package -- a xxx.dmg file. Anything that is a tar or other form is not very professional. I am not sure what homebrew supplies, but if they have done it right it is a .dmg. The instructions for building it yourself on a Mac are in the Bacula source distribution in: bacula/platforms/osx/README Once you have the developer tools installed, it is a piece of cake. Best regards, Kern On 09/07/2014 04:06 PM, Paul Mather wrote: On Sep 7, 2014, at 5:42 AM, Kern Sibbald k...@sibbald.com wrote: On 09/07/2014 07:33 AM, Eric Dannewitz wrote: I'm interested in perhaps deploying this in my k-8 school, but I have not found a good tutorial of how to install it. Or if it even works right on Mac. Anyone have some insights on this? My idea would be to back about 30 macs to an Ubuntu server. This would be a good way to setup Bacula. The Director, SD and catalog work well on a Ubuntu server -- I recommend Trusty (14.04). For the Mac's someone probably has made the binaries and distributes them on the Internet. Otherwise if you load all the appropriate build tools on the Mac, you can easily build the FD. Later this year, Bacula Systems will provide free binaries for MacOSX which should also help. I've not used Bacula on a Mac, but I do notice that Homebrew (http://brew.sh) has a formula for bacula-fd, which could be used to install the client. Right now, it's only for the 5.x version (5.2.13), though. I hope this helps. Cheers, Paul. -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want excitement? Manually upgrade your production database. When you want reliability, choose Perforce Perforce version control. Predictably reliable. http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: Restore from dead client
On 09/09/2014 02:34 AM, Kenny Noe wrote: Kern, I tried this tonight. Marked the mail.tar file only and redid the restore. It failed again with the same error. Any other suggestions? Yes, I probably should have mentioned to remove all runbefore scripts and any other thing that you may have in the job or in the fileset. It should be a very simple FileSet that has no plugins, no special condition. Best regards, Kern ---Kenny On Mon, Sep 8, 2014 at 5:46 PM, Kern Sibbald k...@sibbald.com wrote: Hello, It looks to me from the name /fifo/ and the error you are getting that you may be asking Bacula to restore a fifo, and that could easily lead to problems. I suggest one more attempt to restore. Do everything pretty much as you have outlined here, but instead of doing a mark * cd down to the file mail.tar and mark only it. Then attempt the restore. When you do the mark * you are in fact asking Bacula to restore all the directories at a higher level, and if one is a fifo, that is where there could be problems. Best regards, Kern On 09/08/2014 09:53 PM, Kenny Noe wrote: Heitor, Yes, I did change to local (/tmp) this past attempt. *restore First you select one or more JobIds that contain files to be restored. You will be presented several methods of specifying the JobIds. Then you will be allowed to select which files from those JobIds are to be restored. To select the JobIds, you have the following choices: 1: List last 20 Jobs run 2: List Jobs where a given File is saved 3: Enter list of comma separated JobIds to select 4: Enter SQL list command 5: Select the most recent backup for a client 6: Select backup for a client before a specified time 7: Enter a list of files to restore 8: Enter a list of files to restore before a specified time 9: Find the JobIds of the most recent backup for a client 10: Find the JobIds for a backup for a client before a specified time 11: Enter a list of directories to restore for found JobIds 12: Select full restore to a specified Job date 13: Cancel Select item: (1-13): 3 Enter JobId(s), comma separated, to restore: 12510 You have selected the following JobId: 12510 Building directory tree for JobId(s) 12510 ... 1 files inserted into the tree. You are now entering file selection mode where you add (mark) and remove (unmark) files to be restored. No files are initially added, unless you used the all keyword on the command line. Enter done to leave this mode. cwd is: / $ mark * 1 file marked. $ done Bootstrap records written to /etc/bacula/BS01-DIR1.restore.3.bsr The job will require the following Volume(s) Storage(s)SD Device(s) === mail-0386 Storage_bluewhale File_bluewhale Volumes marked with * are online. 1 file selected to be restored. The defined Restore Job resources are: 1: Restore_os_asterisk 2: Restore_os_besc-4dvapp 3: Restore_db_besc-bs01 4: Restore_os_besc-bs01 5: Restore_os_besc-unixmgr01 6: Restore_mail_bluewhale 7: Restore_os_bluewhale 8: Restore_os_demo 9: Restore_app_demo 10: Restore_os_dev 11: Restore_app_dev 12: Restore_os_mako 13: Restore_app_mako Select Restore Job (1-13): 6 Defined Clients: 1: asterisk 2: besc-4dvapp 3: besc-bs01 4: besc-unixmgr01 5: bluewhale 6: demo 7: dev 8: mako 9: qa 10: qa2 11: smart Select the Client (1-11): 5 Run Restore job JobName: Restore_mail_bluewhale Bootstrap: /etc/bacula/BS01-DIR1.restore.3.bsr Where: *None* Replace: always FileSet: Full_mail_bluewhale Backup Client: bluewhale Restore Client: bluewhale Storage: Storage_bluewhale When:2014-09-08 15:29:31 Catalog: BS01-Catalog Priority:10 Plugin Options: *None* OK to run? (yes/mod/no): mod Parameters to modify: 1: Level 2: Storage 3: Job 4: FileSet 5: Restore Client 6: When 7: Priority 8: Bootstrap 9: Where 10: File Relocation 11: Replace 12: JobId 13: Plugin Options Select parameter to modify (1-13): 5 The defined Client resources are: 1: asterisk 2: besc-4dvapp 3: besc-bs01 4: besc-unixmgr01 5: bluewhale 6: demo 7: dev 8: mako Select Client (File daemon) resource (1-8): 3 Run Restore job JobName: Restore_mail_bluewhale Bootstrap: /etc/bacula/BS01-DIR1.restore.3.bsr Where: *None* Replace: always FileSet: Full_mail_bluewhale Backup Client: bluewhale Restore Client: besc-bs01 Storage: Storage_bluewhale When:2014-09-08 15:29:31 Catalog: BS01-Catalog Priority
Re: [Bacula-users] bacula-dir stuck trying to mount the wrong volume
Hello, It is not a question that I will not document something, why would I write code and discuss it if I did not want to document it? It *was* a question that I incorrectly thought it was already documented. What some people tend to forget is that I am doing this for free, I volunteer for this. Most people have a job and they use Bacula to get their job done, and they get paid for what they do -- not me. For transparency: I do have a salary for Bacula Systems, but it is only symbolic. I make less than any other employee in Bacula Systems, and probably less than the cleaning lady -- this is no exaggeration. That simply means that I do everything for Bacula for free, as I have done so for 14 years. With volunteers such as myself, if one wants something, the agreeable approach that 99.9% of the people on this list take is more in the non-contemptuous spirit of this list and much more likely to get results. Thanks for pointing out the problems and undocumented features. Despite having my motivation sapped, I will see what I can do. Best regards, Kern On 09/07/2014 12:03 AM, Dmitri Maziuk wrote: On 9/6/2014 2:59 PM, Kern Sibbald wrote: ... perhaps I am overly sensitive I've been dealing with other people's software for a living for close to two decades now and familiarity brings contempt. So yeah, I don't like software -- with very few exceptions, and bacula isn't one of them, I am jaded and sarcastic, and I don't like your position in the bareos debacle. So you're to some (large) extent correct on all counts. Keep telling us about wonderful features of your product that you won't document because I looked at you funny, see how many fans that wins you. Dimitri -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore from dead client
On 09/07/2014 02:38 AM, Kenny Noe wrote: Dan, Appreciate the reply Yes this is exactly what I want to do. However when I try to just do a simple restore, the job finishes with the error previously given. Any suggestions to do this would be appreciated. Working with pipes or fifos is tricky, and the message about interrupted system call (or something along that line) indicates that your the conditions to make the pipe/fifo work are not properly setup. I recommend simplifying things. Best regards, Kern Thanks--Kenny On Sat, Sep 6, 2014 at 5:51 PM, Dan Langille d...@langille.org wrote: On Sep 5, 2014, at 5:48 PM, Kenny Noe knoe...@gmail.com wrote: Birre, Thanks for the reply. I guess this is where I get lost... The fifo is reading a file that was created in the pre-process called mail.tar. The mail.tar is made from the following directories /opt/zimbra and /var/mail/zimbra. This is where the Zimbra files and mailstore were kept. This pre-process is a script that has this : MailBackup.bash #!/bin/bash exec /dev/null MKDIR=/bin/mkdir MKFIFO=/usr/bin/mkfifo RM=/bin/rm TAR=/bin/tar DEFCODE=0 DUMPBASE=/data/backups errCode=${DEFCODE} mailDir=/var/mail/zimbra zimbraDir=/opt/zimbra Main() { service zimbra stop RunMailRestore service zimbra start ExitScript ${errCode} } RunMailRestore() { EXTENSION=.tar dumpDir=${DUMPBASE}/mail fifoDir=${dumpDir}/fifo RebuildFifoDir ${MKFIFO} ${fifoDir}/mail${EXTENSION} ${TAR} -xpf ${fifoDir}/mail${EXTENSION} 21 /dev/null } RebuildFifoDir() { if [ -d ${fifoDir} ] then ${RM} -rf ${fifoDir} fi ${MKDIR} -p ${fifoDir} } ExitScript() { exit ${1} } Main The restore script simply does a tar xpf instead of a tar cpf. Perhaps instead of doing that, just restore the data, and then do the tar xpf later. -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula for OSX 10.9
On 09/07/2014 07:33 AM, Eric Dannewitz wrote: I'm interested in perhaps deploying this in my k-8 school, but I have not found a good tutorial of how to install it. Or if it even works right on Mac. Anyone have some insights on this? My idea would be to back about 30 macs to an Ubuntu server. This would be a good way to setup Bacula. The Director, SD and catalog work well on a Ubuntu server -- I recommend Trusty (14.04). For the Mac's someone probably has made the binaries and distributes them on the Internet. Otherwise if you load all the appropriate build tools on the Mac, you can easily build the FD. Later this year, Bacula Systems will provide free binaries for MacOSX which should also help. If you have the budget, I *strongly* recommend taking the Bacula Systems Admin I training. It will provide you with everything you need to know and if you ask in advance, they can probably help you with the Mac builds. Best regards, Kern Thanks! Sent from my iSomething -- -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula for OSX 10.9
The Mac OS X client for Bacula should be a standard Mac OS X package -- a xxx.dmg file. Anything that is a tar or other form is not very professional. I am not sure what homebrew supplies, but if they have done it right it is a .dmg. The instructions for building it yourself on a Mac are in the Bacula source distribution in: bacula/platforms/osx/README Once you have the developer tools installed, it is a piece of cake. Best regards, Kern On 09/07/2014 04:06 PM, Paul Mather wrote: On Sep 7, 2014, at 5:42 AM, Kern Sibbald k...@sibbald.com wrote: On 09/07/2014 07:33 AM, Eric Dannewitz wrote: I'm interested in perhaps deploying this in my k-8 school, but I have not found a good tutorial of how to install it. Or if it even works right on Mac. Anyone have some insights on this? My idea would be to back about 30 macs to an Ubuntu server. This would be a good way to setup Bacula. The Director, SD and catalog work well on a Ubuntu server -- I recommend Trusty (14.04). For the Mac's someone probably has made the binaries and distributes them on the Internet. Otherwise if you load all the appropriate build tools on the Mac, you can easily build the FD. Later this year, Bacula Systems will provide free binaries for MacOSX which should also help. I've not used Bacula on a Mac, but I do notice that Homebrew (http://brew.sh) has a formula for bacula-fd, which could be used to install the client. Right now, it's only for the 5.x version (5.2.13), though. I hope this helps. Cheers, Paul. -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula for OSX 10.9
Hello, No I am not familiar with homebrew. Sorry, I guess I was not very clear, but my comment about not very professional was not at all directed at homebrew. It was directed at people who produce xx.tar files when there are package systems available for a particular platform whether it be .rpm, .deb, .dmg, ... My point was that it is more professional to use packages (if they exist) than .tar files. The package built by the Bacula script does not itself do automatic package updates, though it is possible that with a mac package manager it all would work. Other than having run the scripts and produced Bacula Mac packages, I am not at all familiar with the details. Best regards, Kern On 09/07/2014 06:03 PM, Paul Mather wrote: On Sep 7, 2014, at 10:34 AM, Kern Sibbald k...@sibbald.com wrote: The Mac OS X client for Bacula should be a standard Mac OS X package -- a xxx.dmg file. Anything that is a tar or other form is not very professional. I am not sure what homebrew supplies, but if they have done it right it is a .dmg. Oh, I see you're not familiar with Homebrew. It is a package manager for OS X, sort of in the same vein as Fink and MacPorts. It's popular with a lot of people who want access to lots of Unix open source software and be able to manage it on an ongoing basis. I wouldn't decry it as being not very professional unless you also consider the likes of yum, apt-get, pkg, etc. to be not very professional, too. Sure, it's a different way, but not an unfamiliar metaphor for someone working with an Ubuntu server (as the OP mentioned), which is the only reason I mentioned it. I agree that using .dmg files is more commonplace on OS X. Does the OS X version include an option to check for updates? I've never used it. As you pointed out in your original reply, For the Mac's someone probably has made the binaries and distributes them on the Internet. I did a quick Web search and it seemed that was not the case. I couldn't find any. So, it's great that Bacula Systems will be providing free OS X binaries later this year. That will be another excellent resource for the Bacula community. In the meantime, folks can build their own from source, or maybe use Homebrew to do the same. ;-) The instructions for building it yourself on a Mac are in the Bacula source distribution in: bacula/platforms/osx/README Once you have the developer tools installed, it is a piece of cake. It's pretty easy to install with Homebrew, too: brew install bacula-fd Cheers, Paul. Best regards, Kern On 09/07/2014 04:06 PM, Paul Mather wrote: On Sep 7, 2014, at 5:42 AM, Kern Sibbald k...@sibbald.com wrote: On 09/07/2014 07:33 AM, Eric Dannewitz wrote: I'm interested in perhaps deploying this in my k-8 school, but I have not found a good tutorial of how to install it. Or if it even works right on Mac. Anyone have some insights on this? My idea would be to back about 30 macs to an Ubuntu server. This would be a good way to setup Bacula. The Director, SD and catalog work well on a Ubuntu server -- I recommend Trusty (14.04). For the Mac's someone probably has made the binaries and distributes them on the Internet. Otherwise if you load all the appropriate build tools on the Mac, you can easily build the FD. Later this year, Bacula Systems will provide free binaries for MacOSX which should also help. I've not used Bacula on a Mac, but I do notice that Homebrew (http://brew.sh) has a formula for bacula-fd, which could be used to install the client. Right now, it's only for the 5.x version (5.2.13), though. I hope this helps. Cheers, Paul. -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Error: block.c:255 Write errors?
Hello, I was about to write to you based on your first email containing only the error that tape errors should be extremely rare and even non-existent. The exception is when tapes fill, the information that Bacula gets depends on the tape drive. In from what I see below, as already commented by others, this seems to be a somewhat normal end of tape condition, where Bacula receives a return indicating that the block was not written. Unfortunately, the error it gets is generally not distinguishable from an end of tape condition. In that case it then writes an end of file mark and attempts to re-read the last good block. If it succeeds as it did in your case, there is probably a 99.999% chance that the tape is perfectly valid. The only other thing to check is to see if the amount of data that was written on the volume corresponds roughly to what you expect -- generally there is a 2/1 compression done by the tape drive, but that is rather general it can vary from 1/1 (already compressed data) to 3/1 for pure text. Best regards, Kern On 09/05/2014 10:12 PM, Stephen Thompson wrote: Huh, maybe this is a misdiagnosis of the end of tape and a write error only in the sense that there is no tape left. 05-Sep 00:41 SD_L100_ JobId 389348: Error: block.c:255 Write error at 610:412 on device L100-Drive-0 (/dev/L100-Drive-0). ERR=Input/output error. 05-Sep 00:41 SD_L100_ JobId 389348: Re-read of last block succeeded. 05-Sep 00:41 SD_L100_ JobId 389348: End of medium on Volume IM0161 Bytes=1,090,307,051,520 Blocks=520,103 at 05-Sep-2014 00:41. On 09/05/2014 09:42 AM, Stephen Thompson wrote: Hello, I sporadically get these types of alerts for one on my bacula tape libraries... 05-Sep 00:41 lawson-sd_L100_ JobId 389348: Error: block.c:255 Write error at 610:412 on device L100-Drive-0 (/dev/L100-Drive-0). ERR=Input/output error. Am I correct in assuming that this was indeed a tape write error, but that bacula will attempt a 2nd write of the same block of data and if that 2nd attempt succeeds proceed on and ultimately have a successfully run job (one that can be restored without issue)? In other words, should this error worry me if it doesn't happen often? It does consistently happen -- with 100's of jobs a night, it probably happens 3-4 times a week. thanks, Stephen -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-dir stuck trying to mount the wrong volume
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 09/05/2014 09:16 PM, Dimitri Maziuk wrote: On 09/05/2014 01:41 PM, Josh Fisher wrote: On 9/5/2014 1:48 PM, Dimitri Maziuk wrote: I've another bacula setup that writes to a single filesystem. It's been running with about zero problems (knock on wood) and zero maintenance for years: auto-labelling works, volume recycling works, the only problems are spinning rust and lsi's ugly raid manglement software. The whole point of vchanger is to use multiple filesystems as a single autochanger. For a single filesystem I would recommend Bacula's built-in disk autochanger capability or else Bacula's standard disk storage handling. Right, that's my point: when you use bacula's standard disk storage handling you get - automatic volume labeling, - automatic volume recycling, and generally near zero maintenance overhead. With vchanger I - have a job split over different disks, - need to manually fix the catalog every time I sneeze, - get into weird intervention needed loops where bacula mounts a volume it's just filled up and complains it couldn't write to some other volume it shouldn't have tried in the first place. Ergo, if you want to use multiple filesystems, the smart move would be to fake the standard disk storage over multiple filesystems. (As for built-in disk autochanger, Kern's explanation of it never made much sense to me: maybe it's useful for debugging or something...) Can you tell me what my explanation of the disk autochanger was and why it did not make sense to you? By the way the built-in disk autochanger is typically called the virtual autochanger. Providing you use pools and media types correctly the virtual autochanger can actually handle multiple filesystems. Even without, I have documented in the manual how to use multiple filesystems with symlinks (a slight bit more annoying to setup). I ran very small data center in that configuration for about 10 years. The only maintenance was to update Bacula and add additional disk drives when the user's data volume increased. A very large number of our enterprise clients are using the virtual autochanger with a lot of success. As you say, once you install it, it just runs. I have absolutely nothing against vchanger, because a lot of people are very happy with it. However, it is not a Bacula product, and it seems that it works like a tape autochanger which requires much more maintenance than the virtual autochanger, which is just a simple extension of individual disk Devices. Best regards, Kern -BEGIN PGP SIGNATURE- Version: GnuPG v1 Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iEYEARECAAYFAlQKwWcACgkQNgfoSvWqwEi5vQCff51zbNhqAX/FHugOSq9W7HXz /bAAoOwykZVB4I0c+66tiOebi8cLv8ms =VJKk -END PGP SIGNATURE- -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Socket error after upgrade to 7.x
Hello, It seems to me that was because your system does not support IPv6, for which Bacula was checking. You didn't mention the exact 7.0.x version, but it seems to me that this was quickly fixed. Best regards, Kern On 09/06/2014 12:21 PM, Andrea Venturoli wrote: Hello. I've got several Bacula setup on FreeBSD 8.4. After the upgrade to 7.x all jobs results switched from Ok to Ok with warning. I believe it's due to the following error: Error: bsock.c:226 Socket open error. proto=28 port=9103. ERR=Protocol not supported However I don't have a clue where it comes from. Any hint? bye Thanks av. -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-dir stuck trying to mount the wrong volume
Hello, Yes, I likely chimed in with the statement you said, and it seems like most everything you say is correct -- I cannot find the documentation on these features. I now remember why I didn't answer you the last time and why I probably won't this time either. It is because when I read what you write to me, perhaps I am overly sensitive, but I get the feeling that you don't like Bacula, you don't like me, and you are being sarcastic. I hope I am completely wrong on all those points, but that is how I take it, so the best response is just silence. Kern On 09/06/2014 06:43 PM, Dmitri Maziuk wrote: On 9/6/2014 3:10 AM, Kern Sibbald wrote: Can you tell me what my explanation of the disk autochanger was and why it did not make sense to you? The goal was to write file volumes -- same pool, same backup set, to a set of filesystems (hosted on removable disks). The thread went on a for a couple of weeks and the conclusion was vchanger is the only way to do it. As I recall somewhere in the middle you chimed in with there's virtual autochanger and it works or something along those lines. Pretty much what you wrote again in the message I'm replying to. I haven't seen any documentation on how it works or what it does, so a) I believe you and b) it's of no use to me. Similarly, you've documented how to use symlinks for this? Great! Where? Basic Volume Management - Backing Up to Multiple Disks from 7.0 looks the same as it ever was. Is that in the enterprise manual only? Dimitri -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula Status Report
Hello, I have posted a Bacula Status report to the www.bacula.org site. It discusses the following items: 1. Bacula Release Status 2. Windows Binaries 3. Bacula Enterprise 4. Vacation 5. Bareos The following is a link to the report. http://blog.bacula.org/bacula-status-report-30-august-2014/ Best regards, Kern -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Stop unfinished backup, retain data
Hello, The Bacula Enterprise Edition has this feature. At some point in time (at the latest about 4 years from now) this feature will be back ported to the community version. Best regards, Kern On 08/27/2014 06:57 PM, Richard Fox wrote: Hi All, I use Bacula 5.2.6. If I'm not mistaken when I have a backup running and I cancel it, Bacula discards the backup records for the data it has taken to tape which requires Bacula to back up the same files again on the next run. Isn't that correct? If that is correct, is there any way to stop a running backup in which Bacula retains what it has managed to backup so far and picks up where it left off on the next run? Thanks, Rich. -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Recycling issue
Hello Martin, Bacula never checks the Media Type vs what is in the label. The problem for users who have not understood the importance of making the Media Types unique will be to modify their catalog database. Before making this change, I will provide some reasonable solution. Best regards, Kern On 08/06/2014 12:44 PM, Martin Simmons wrote: On Wed, 06 Aug 2014 07:41:59 +0200, Kern Sibbald said: In the next Bacula version, I will probably modify the SD and possibly the Dir to require unique MediaTypes, then this problem will be resolved. I hope that forcing users to change the configured MediaType won't cause a problem with old media (because the label contains the media type and won't match anymore). __Martin -- Infragistics Professional Build stunning WinForms apps today! Reboot your WinForms applications with our WinForms controls. Build a bridge from your legacy apps to the future. http://pubads.g.doubleclick.net/gampad/clk?id=153845071iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Disk based backup using vchanger, volumes being marked as Error
Hello Patti, Are you sure this is happening on 7.0.x? I worked hard on this problem between 5.2.x and 7.0.x, and I thought I had fixed the problem -- unless there is some code path I missed. It is possible that this is happening only when there is no other drive that the 3rd job can use, but if there are other drives available, Job 3 should select a different volume. Best regards, Kern On 08/06/2014 03:16 PM, Clark, Patricia A. wrote: Kern, This is exactly the problems that myself and others have been reporting with autochanger and tape volumes. Thank you Josh for the very descriptive details. One additional issue that these race conditions can also create, if the 1st 2 jobs fill the volume that the 3rd job is waiting for, the 3rd job will fail when it finds that it has mounted a read-only volume. Patti Clark Linux System Administrator RD Systems Support Oak Ridge National Laboratory From: Kern Sibbald k...@sibbald.commailto:k...@sibbald.com Date: Wednesday, August 6, 2014 at 1:52 AM To: Josh Fisher jfis...@pvct.commailto:jfis...@pvct.com, bacula-users@lists.sourceforge.netmailto:bacula-users@lists.sourceforge.net bacula-users@lists.sourceforge.netmailto:bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Disk based backup using vchanger, volumes being marked as Error On 08/04/2014 06:43 PM, Josh Fisher wrote: ... Have you set PreferMountedVolumes=no in the Job resource in bacula-dir.conf? If 3 jobs start and want to write to volumes in the same pool, then all three can be assigned the same volume. In fact, if PreferMountedVolumes=yes, (the default), then all three WILL be assigned the same volume unless the pool restricts the max number of jobs that the volume may contain. However, your device (drive) restricts the max concurrent jobs to 2. Therefore one of those three jobs will not be able to select the drive where the volume is mounted and will be forced to select another unused drive. That third job will nevertheless select the same volume as the other two and attempt to move the volume from the drive it is in into the drive that it has been assigned to. The configuration has a built-in race condition. This is the first time that I have heard this explained so clearly. I am going to try to duplicate this problem now that you have so clearly explained it. By the way, I am not really sure I would classify this as a race condition, because theoretically the SD is not blocked, the third job just waits until the Volume is free (at least that is what I programmed). However, this is clearly very inefficient. I would like to fix this, but one must keep in mind one important difficulty with Bacula. The SD knows what is going on with Volumes, but the Dir does not, and it is the Dir that proposes Volumes to the SD. Currently there is no good atomic way to pass the information in the SD to the Dir so that it can make better decisions. So, with the (current) restraint that the solution must involve changing only the SD algorithm, how could one prevent this from happening? I have some ideas, but wonder what you think. Setting PreferMountedVolumes=no causes the three jobs to select a drive that is NOT already mounted with a volume from the pool. This allows jobs writing to the same pool to select different volumes from the pool, rather than all selecting the same next available volume. This has its own caveats. It doesn't necessarily prevent two jobs from selecting the same volume in some cases, meaning that they will want to swap the volume back and forth between drives, which is another type of race condition. I have used this method successfully for a pool containing full backups only by setting PreferMountedVolumes=no in the job resource and setting MaximumVolumeJobs=1 in the pool resource. Since Bacula selects the volume for a job in an atomic manner, this forces an exclusive set of volumes for each job, thus preventing the race condition. This means that concurrency is limited only by the number of drives, but at the expense of creating a greater number of smaller volume files. I quote e xpense because on a disk vchanger it isn't usually a big issue to have more volume files. Doing this with a tape autochanger would use a lot more tapes and be truly more expensive. Of course unlimited concurrency is theoretical, since the hardware limits the USEFUL concurrency. I really do not like the PreferMountedVolumes = No option (I have probably said this many times), but I find your use of it very well explained and very interesting. Best regards, Kern ... -- Infragistics Professional Build stunning WinForms apps today! Reboot your WinForms applications with our WinForms controls. Build a bridge from your legacy apps to the future. http://pubads.g.doubleclick.net/gampad/clk?id=153845071iu
Re: [Bacula-users] Disk based backup using vchanger, volumes being marked as Error
On 08/05/2014 02:10 PM, Josh Fisher wrote: On 8/5/2014 1:36 AM, Kern Sibbald wrote: Hello Josh, Please see below ... On 08/04/2014 06:43 PM, Josh Fisher wrote: On 8/1/2014 12:27 PM, Joseph Dickson wrote: Greetings :-) I've run into this problem with Bacula in a previous installation, and I can't seem to recall if there was ever a resolution.. I'm using Bacula for disk based backups only, and I am using vchanger to manage my virtual library. I've configured a vchanger library with 100 slots and 8 drives, and have set a Maximum Volume Bytes of 100G on the pool definition that I am using, to limit each slot in the library to 100G. I have also set a Maximum Concurrent Jobs = 2 setting on each of the virtual tape drive devices in my storage director config, so that only two jobs can write to a device at a time to minimize interleaving. Everything works perfectly as long as I only kick a few jobs off at a time.. however, when my main backup windows run and 30 or 40 backup jobs kick off, I often end up with jobs that output the following sequence in the logs: Have you set PreferMountedVolumes=no in the Job resource in bacula-dir.conf? If 3 jobs start and want to write to volumes in the same pool, then all three can be assigned the same volume. In fact, if PreferMountedVolumes=yes, (the default), then all three WILL be assigned the same volume unless the pool restricts the max number of jobs that the volume may contain. However, your device (drive) restricts the max concurrent jobs to 2. Therefore one of those three jobs will not be able to select the drive where the volume is mounted and will be forced to select another unused drive. That third job will nevertheless select the same volume as the other two and attempt to move the volume from the drive it is in into the drive that it has been assigned to. The configuration has a built-in race condition. I have recently done quite a bit of work to try to avoid race conditions such as the one you describe above. Does this still happen on version 7.0.x? I ask because there is now code that *should* detect this and explicitly makes the third job (as you describe above) wait. Now it is possible that there is some code path in the SD where the new code does not apply, so I cannot exclude problems, but if any exist in 7.0.x I would like to know so I can work on it some more. With the new code, the Volume will be moved around, but at least it should be done correctly without some deadlock or failure. I haven't had a chance to update to 7.0.x yet, so I can't say. My thought is that the volume itself should have a "Maximum Concurrent Jobs" setting, in addition to the SD Device. Better still, it could be automated by forcing the volume's max concurrency to that of the SD device at mount time. That should eliminate the need for "Prefer Mounted Volumes" altogether, since once the "Maximum Concurrent Jobs" have selected the volume, subsequent jobs would reject it as unavailable and so see the drive it is mounted in as unavailable at drive selection time. Once a drive is selected, that volume would be viewed as unavailable and rejected during volume selection, at least until one of the jobs using the volume ends. So by setting "Max Concurrent Jobs" to 1, one could guarantee a volume would never be selected by more than one job at a time. Yes, I would like to do something like what you say, but unfortunately I concerned that it opens up other possibilities for race conditions due to the fact that there are 3 components dealing with the data (SD, DIR, and the catalog). I have some ideas, and I hope to implement them in the next major Bacula version. Best regards, Kern ... -- Infragistics Professional Build stunning WinForms apps today! Reboot your WinForms applications with our WinForms controls. Build a bridge from your legacy apps to the future. http:
Re: [Bacula-users] Recycling issue
Hello, Probably 95% of all such problems are due to configurations where the MediaType is not properly set. - If you are using any form of autochanger, each autochanger must have a *unique* MediaType. - Each Device configuration in the SD must have a unique MediaType for each different ArchiveDevice definition. Said the other way around, each ArchiveDevice definition must have its own unique MediaType. The .conf files you list are incomplete, so it is not possible to analyze them, but when I see: MediaType = File, that raises a red flag that indicates that there may be other Storage devices with the same MediaType, and if that is the case, sooner or later, you will find that Bacula is very confused. In the next Bacula version, I will probably modify the SD and possibly the Dir to require unique MediaTypes, then this problem will be resolved. I don't usually supply "support" because I don't have the time, but this particular problem interests me from the standpoint that I would like to prevent it, but with no console/job output showing the failures and incomplete DIR and SD confs I cannot do any more. Best regards, Kern On 08/05/2014 03:08 PM, Joe Rhodes wrote: I’m also running into this issue. In my case, I’ve setup a disk-based auto-changer (vchanger) with two pools: Full and Weekly. Each pool has multiple drives with 8 volumes on each drive. The script that mounts the disk also issues an “update slots” command in bconsole, and I can verify that bacula sees the correct volumes as “InChanger”. When I swap out disks (weekly), Bacula continues to look for volumes that were append-able, but on the previous disk (and not currently marked as “InChanger”) and refuses to write to the append-able volumes on the new disk that are marked as “InChanger”. It marks all the previous volumes it cannot access as “Error”, and only then will it begin writing to the currently loaded volumes. This line from the “Recycling Algorithm” led me to believe that it would use a volume that was InChanger first: "If the request is for an Autochanger device, look only for Volumes in the Autochanger (i.e. with InChanger set and that have the correct Storage device).” But it seems I’m missing something. I’ve included relevant bits from my bacula-dir.conf file if anyone can see what I’m doing wrong. I’m getting this on two systems, one running Bacula 5.2.12 and one running 7.0.4. My other option is to split these all into separate pools, but that’s going to make scheduling much harder. Thanks in advance! -Joe Rhodes # Definition of file Virtual Autochanger device Storage { Name = removeable-drives Address = 10.11.1.2 SDPort = 9103 Password = “password" Device = ExternalDrives Media Type = File Maximum Concurrent Jobs = 1 } # Pools Pool { Name = FullSet Pool Type = Backup Recycle = yes AutoPrune = yes Volume Use Duration = 1 week #We're on an 2 month rotation VolumeRetention = 58 days Maximum Volumes = 32 # 4 drives with 8 volumes on each Storage = removeable-drives } Pool { Name = Weekly Pool Type = Backup Recycle = yes AutoPrune = yes Volume Use Duration = 1 week VolumeRetention = 3 weeks Maximum Volumes = 40 # 5 drives with 8 volumes on each Storage = removeable-drives } And my bacula-sd.conf: # Define a Virtual autochanger Autochanger { Name = ExternalDrives Device = ExternalDrives-Drive1 Changer Command = "/usr/local/bin/vchanger -u root %c %o %S %a %d" Changer Device = "/etc/bacula/vchanger1.conf" } Device { Name = ExternalDrives-Drive1 DriveIndex = 0 Autochanger = yes DeviceType = File Media Type = File Archive Device = /var/lib/bacula/removeable-drives/0/drive0 Random Access = Yes; AutomaticMount = yes; RemovableMedia = no; AlwaysOpen = no; Maximum Concurrent Jobs = 5; Maximum Volume Size = 476250 M; # with 8 volumes pe
Re: [Bacula-users] Disk based backup using vchanger, volumes being marked as Error
On 08/04/2014 06:43 PM, Josh Fisher wrote: ... Have you set PreferMountedVolumes=no in the Job resource in bacula-dir.conf? If 3 jobs start and want to write to volumes in the same pool, then all three can be assigned the same volume. In fact, if PreferMountedVolumes=yes, (the default), then all three WILL be assigned the same volume unless the pool restricts the max number of jobs that the volume may contain. However, your device (drive) restricts the max concurrent jobs to 2. Therefore one of those three jobs will not be able to select the drive where the volume is mounted and will be forced to select another unused drive. That third job will nevertheless select the same volume as the other two and attempt to move the volume from the drive it is in into the drive that it has been assigned to. The configuration has a built-in race condition. This is the first time that I have heard this explained so clearly. I am going to try to duplicate this problem now that you have so clearly explained it. By the way, I am not really sure I would classify this as a race condition, because theoretically the SD is not blocked, the third job just waits until the Volume is free (at least that is what I programmed). However, this is clearly very inefficient. I would like to fix this, but one must keep in mind one important difficulty with Bacula. The SD knows what is going on with Volumes, but the Dir does not, and it is the Dir that proposes Volumes to the SD. Currently there is no good atomic way to pass the information in the SD to the Dir so that it can make better decisions. So, with the (current) restraint that the solution must involve changing only the SD algorithm, how could one prevent this from happening? I have some ideas, but wonder what you think. Setting PreferMountedVolumes=no causes the three jobs to select a drive that is NOT already mounted with a volume from the pool. This allows jobs writing to the same pool to select different volumes from the pool, rather than all selecting the same next available volume. This has its own caveats. It doesn't necessarily prevent two jobs from selecting the same volume in some cases, meaning that they will want to swap the volume back and forth between drives, which is another type of race condition. I have used this method successfully for a pool containing full backups only by setting PreferMountedVolumes=no in the job resource and setting MaximumVolumeJobs=1 in the pool resource. Since Bacula selects the volume for a job in an atomic manner, this forces an exclusive set of volumes for each job, thus preventing the race condition. This means that concurrency is limited only by the number of drives, but at the "expense" of creating a greater number of smaller volume files. I quote "expense" because on a disk vchanger it isn't usually a big issue to have more volume files. Doing this with a tape autochanger would use a lot more tapes and be truly more expensive. Of course unlimited concurrency is theoretical, since the hardware limits the USEFUL concurrency. I really do not like the PreferMountedVolumes = No option (I have probably said this many times), but I find your use of it very well explained and very interesting. Best regards, Kern ... -- Infragistics Professional Build stunning WinForms apps today! Reboot your WinForms applications with our WinForms controls. Build a bridge from your legacy apps to the future. http://pubads.g.doubleclick.net/gampad/clk?id=153845071iu=/4140/ostg.clktrk___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Disk based backup using vchanger, volumes being marked as Error
Hello Josh, Please see below ... On 08/04/2014 06:43 PM, Josh Fisher wrote: On 8/1/2014 12:27 PM, Joseph Dickson wrote: Greetings :-) I've run into this problem with Bacula in a previous installation, and I can't seem to recall if there was ever a resolution.. I'm using Bacula for disk based backups only, and I am using vchanger to manage my virtual library. I've configured a vchanger library with 100 slots and 8 drives, and have set a Maximum Volume Bytes of 100G on the pool definition that I am using, to limit each slot in the library to 100G. I have also set a Maximum Concurrent Jobs = 2 setting on each of the virtual tape drive devices in my storage director config, so that only two jobs can write to a device at a time to minimize interleaving. Everything works perfectly as long as I only kick a few jobs off at a time.. however, when my main backup windows run and 30 or 40 backup jobs kick off, I often end up with jobs that output the following sequence in the logs: Have you set PreferMountedVolumes=no in the Job resource in bacula-dir.conf? If 3 jobs start and want to write to volumes in the same pool, then all three can be assigned the same volume. In fact, if PreferMountedVolumes=yes, (the default), then all three WILL be assigned the same volume unless the pool restricts the max number of jobs that the volume may contain. However, your device (drive) restricts the max concurrent jobs to 2. Therefore one of those three jobs will not be able to select the drive where the volume is mounted and will be forced to select another unused drive. That third job will nevertheless select the same volume as the other two and attempt to move the volume from the drive it is in into the drive that it has been assigned to. The configuration has a built-in race condition. I have recently done quite a bit of work to try to avoid race conditions such as the one you describe above. Does this still happen on version 7.0.x? I ask because there is now code that *should* detect this and explicitly makes the third job (as you describe above) wait. Now it is possible that there is some code path in the SD where the new code does not apply, so I cannot exclude problems, but if any exist in 7.0.x I would like to know so I can work on it some more. With the new code, the Volume will be moved around, but at least it should be done correctly without some deadlock or failure. Best regards, Kern Setting PreferMountedVolumes=no causes the three jobs to select a drive that is NOT already mounted with a volume from the pool. This allows jobs writing to the same pool to select different volumes from the pool, rather than all selecting the same next available volume. This has its own caveats. It doesn't necessarily prevent two jobs from selecting the same volume in some cases, meaning that they will want to swap the volume back and forth between drives, which is another type of race condition. I have used this method successfully for a pool containing full backups only by setting PreferMountedVolumes=no in the job resource and setting MaximumVolumeJobs=1 in the pool resource. Since Bacula selects the volume for a job in an atomic manner, this forces an exclusive set of volumes for each job, thus preventing the race condition. This means that concurrency is limited only by the number of drives, but at the "expense" of creating a greater number of smaller volume files. I quote "expense" because on a disk vchanger it isn't usually a big issue to have more volume files. Doing this with a tape autochanger would use a lot more tapes and be truly more expensive. Of course unlimited concurrency is theoretical, since the hardware limits the USEFUL concurrency. 31-Jul 21:00 bacula1-dir JobId 692: Start Backup JobId 692, Job=job-evolvereports-main.2014-07-31_21.00.00_48 31-Jul 21:00 bacula1-dir JobId 692: Using Device "chg1-drive-1" to write. 31-Jul 21:00 evolvereports-fd JobId 692: DIR and FD clocks differ by 50 seconds, FD automatically compensating. 31-Jul 21:05 bacula1-sd JobId 692: 3307 Issuing autochanger "unload slot 74, drive 1" command. 31-Jul 21:
Re: [Bacula-users] Using two pools for backup
Hello, Some points: 1. You can combine your Full and Differential run directives on two directives, which will in my opinion be easier to read with: Run = Level=Full Pool=File on 1st sun jan,mar,may,jul,sep,nov at 00:00 Run = Level=Differential Pool=File on 1st sun feb,apr,jun,aug,oct,dec at 00:00 2. Separating jobs into Pools separates them for pruning (i.e. expiration) but does not separate them for restoration. This is because when doing backups and restores, Bacula considers all the jobs of the same name as a group or in its entirety. To completely disassociate the Incrementals, you need to use a different Job name. The first will upgrade to a Full, then your incrementals will be separate and more or less duplicate what you backup in the other job. 3. You can probably do something closer to what you really want, but it is a bit more complicated, by having everything running under the same job, but periodically you do a Virtual Full, which would essentially combine your Full, Differential, and all your Incrementals into one big full. To make it reliable, I recommend that you run the Accurate option on your Incremental jobs. That ensures that you will never miss backing up an important file. 4. If you do not do a Virtual Full, you will need to keep all of your incrementals at lease as long as the period between your last Full or Differential (i.e. one month). This is quite possible, but you may end up requiring a very large number of incremental jobs to do a Full restore. Best regards, Kern On 08/01/2014 09:16 PM, Ross Williamson wrote: Hi All, Pretty new to bacula so apologies if this is dumb..I would like to simulate a Mac Time Machine feature. My setup is to have a full backup every 2 months, a differential every other month (out of sync with the full) and an incremental every day. I think I have this setup as expected and it all writes to a pool. What I'm now trying to do is setup a short term hourly pool which will allow me to roll back upto say a day or twos work on hourly increments. For this I've setup a second pool that writes to a different disk. The question I have is when the incremental is done on the daily basis does it look at the other pools data (which gets refreshed after 23 hours) or the last incremental on the main backup pool? Sorry if this is confusing - I've posted relevant sections from the bacula-dir.conf below: Many thanks JobDefs { Name = DefaultJob Type = Backup Level = Incremental Client = seacat-fd FileSet = Home Directory Schedule = TwoMonth Storage = File Messages = Standard Pool = File Priority = 10 Write Bootstrap = /var/lib/bacula/%c.bsr } Job { Name = BackupHome JobDefs = DefaultJob } Schedule { Name = TwoMonth Run = Level=Full Pool=File on 1st sun jan at 00:00 Run = Level=Differential Pool=File on 1st sun feb at 00:00 Run = Level=Full Pool=File on 1st sun mar at 00:00 Run = Level=Differential Pool=File on 1st sun apr at 00:00 Run = Level=Full Pool=File on 1st sun may at 00:00 Run = Level=Differential Pool=File on 1st sun jun at 00:00 Run = Level=Full Pool=File on 1st sun jul at 00:00 Run = Level=Differential Pool=File on 1st sun aug at 00:00 Run = Level=Full Pool=File on 1st sun sep at 00:00 Run = Level=Differential Pool=File on 1st sun oct at 00:00 Run = Level=Full Pool=File on 1st sun nov at 00:00 Run = Level=Differential Pool=File on 1st sun dec at 00:00 Run = Level=Incremental Pool=File mon-sat at 23:05 Run = Level=Incremental Pool=HourlyPool mon-sun at 00:00 01:00 02:00 03:00 04:00 05:00 06:00 07:00 08:00 09:00 10:00 11:00 12:00 13:00 14:00 15:00 16:00 17:00 18:00 19:00 20:00 21:00 22:00 } # File Pool definition Pool { Name = File Pool Type = Backup Recycle = yes # Bacula can automatically recycle Volumes AutoPrune = yes # Prune expired volumes Volume Retention = 180 days # half a year Maximum Volume Bytes = 50G # Limit Volume size to something reasonable Maximum Volumes = 30 # Limit number of Volumes in Pool LabelFormat = Vol } Pool { Name = HourlyPool Pool Type = Backup Volume Retention = 23 hours Recycle = yes AutoPrune = yes Maximum Volume Bytes = 10G Maximum Volumes = 50 LabelFormat = Hourly } -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New user with Bacula
To me a "NetApp Client" means a file daemon that runs inside the NetApp box and has access to all its disks and thus can backup the NetApp box using Bacula directly without NDMP or NFS/CIFS. Best regards, Kern On 07/30/2014 02:56 PM, Radosław Korzeniewski wrote: Hello, 2014-07-29 20:40 GMT+02:00 Kern Sibbald k...@sibbald.com: Hello, No unfortunately, NetApp will not let us create a NetApp client :-( Could you explain what "NetApp Client" is/will be/could be, please. What do you mean by "NetApp Client". I'd like to understand this thread, but I'm not an english native speaker so I miss the main point of this thread. Thanks in advance. best regards -- Radosław Korzeniewski rados...@korzeniewski.net -- Infragistics Professional Build stunning WinForms apps today! Reboot your WinForms applications with our WinForms controls. Build a bridge from your legacy apps to the future. http://pubads.g.doubleclick.net/gampad/clk?id=153845071iu=/4140/ostg.clktrk___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New user with Bacula
Hello, No unfortunately, NetApp will not let us create a NetApp client :-( Best regards, Kern On 07/29/2014 04:43 PM, Dmitri Maziuk wrote: On 7/29/2014 2:59 AM, leandro.cu...@reedglobal.com wrote: Hi Dimitri, Thank you for your return. My requirement is just to keep some snapshots for a period of 30 days, and once a month an infinity retention job. I expect you'll have to mount netapp volumes someplace and run bacula client there. Unless Kern has a netapp client in the enterprise codebase. Dimitri -- Infragistics Professional Build stunning WinForms apps today! Reboot your WinForms applications with our WinForms controls. Build a bridge from your legacy apps to the future. http://pubads.g.doubleclick.net/gampad/clk?id=153845071iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Infragistics Professional Build stunning WinForms apps today! Reboot your WinForms applications with our WinForms controls. Build a bridge from your legacy apps to the future. http://pubads.g.doubleclick.net/gampad/clk?id=153845071iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula.org web site non-functional?
Hello, Thanks for the tip. Although there are a lot of very nice features in wordpress, style sheets and such are *far* more complicated than the old php website. That means that I am more or less lost in wordpress. Thanks to you pointing to the exact place, I have reduced the minimum width to 800 and adjusted the box hight to be slightly larger which makes a bit less of an overlap with a small screen size. Hopefully everyone will find this a lot better than what it was. Thanks again for the help. Best regards, Kern On 07/26/2014 11:54 PM, Mike Ruskai wrote: On 7/26/2014 3:51 PM, Brady, Mike wrote: On 2014-07-26 19:07, Wolfgang Denk wrote: Dear Luc Van der Veken, In message F41F2F82D41438499ECDB25322DA5D9E184F13EE@mail.wimionline.local you wrote: The Blog and Recent Topics sections at the top remain the same everywhere and take up so much space that I have to page down to see the actual content, which *is* there. Ah, indeed. Same for me. Well, this is a really unusable web design. Best regards, Wolfgang Denk What may be causing some confusion is that the bacula.org web site displays differently depending on the width of your browser window. On my Fedora 20 (Chrome and Firefox) the Blog and Recent Topics display in their own narrow box/column on the left of the window and the main page content is in a wider box/column on the right of the window. If I reduce the width of the window, it gets to a point where the Blog and Recent Topics box/column changes to being full window width at the top of each page. My monitor is 1920x1200 and I would say that the layout changes at about 1280 wide. Regards Mike In the CSS of the page, one finds this: @media(min-width: 1200px){ .col-lg-1, .col-lg-2, .col-lg-3, .col-lg-4, .col-lg-5, .col-lg-6, .col-lg-7, .col-lg-8, .col-lg-9, .col-lg-10, .col-lg-11, .col-lg-12 { float: left; } This is the culprit here. That's an unreasonably large minimum size. Setting it to 800px results in the column remaining on the left for much smaller windows. It introduces some formatting problems with the boxes under How to find what you need, which only allocate two lines for the title of each box. Setting it to 1000px avoids this and would make the page work better on a maximized browser at 1024x768. -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Purged volumes not being moved to recycling pool
Hello, Once a volume is marked disabled, Bacula should do *nothing* with it. We might even consider if we want to turn off pruning of disabled volumes, but I am not sure that would be a good idea as it could lead to a catalog that grows. Best regards, Kern On 07/26/2014 07:37 PM, Bill Arlofski wrote: OK, since I am having such a nice conversation with myself, I thought I would re-open this issue and continue on. OK, that is not the real reason. hehe :) Kern, I use vchanger with several removable eSATA drives, and also use a script I wrote to set the Enabled field when I change drives which sets all volumes' Enabled field to '0' except for the volumes currently available on the inserted drive - those are of course set to '1'. This solves a different problem which we have conversed about in the past on the list. My question is this: It looks like if a volume's Enabled field is set to '0', Bacula will purge it when it is supposed to, but does not move it to the defined Scratch pool, and instead purges it and leaves it in its current pool. This was the cause of my confusion which started this thread, because when I look for a vchanger magazine to use when Bacula asks for a volume, I do a: list volumes Pool=Offsite-eSATA-Scratch and was not finding anything available there. That is when I listed all media and noticed that I had purged volumes stuck in other pools - and ultimately realized that those purged volumes had their Enabled field set to '0' As a test, just now Bacula was waiting on a volume. I listed my volumes, saw that several volumes on vchanger magazine #2 were purged but left in the Offsite-eSATA-Diff pool. I inserted vchanger volume #2, ran my script which sets those volumes' Enabled field to '1', and ran an update slots command in bconsole. Bacula immediately did: 26-Jul 13:13 bacula-dir JobId 27448: Recycled volume c0_0002_0031 and the job(s) continued on. I realize that setting the Enabled field outside of Bacula is a little non-standard, but don't you think that Bacula should move a volume to its specified recycle pool even it the volume is not currently enabled? I mean, even though the volume is disabled, Bacula is respecting the retention periods and is purging all the data on the volume from the db, so why not also respect the Recycle Pool? Thanks! And thanks for Bacula! -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula.org web site non-functional?
Hello, www.bacula.org is perfectly functional. What OS and browser are you using. Systems known to work, Windows IE, Mac Safari, Linux Firefox, Windows Chrome, ... Kern On 07/25/2014 09:41 AM, Wolfgang Denk wrote: Hi, is it only for me that the bacula.org web site is non-functional? I get always only an entry page, and no matter which link I click, the content will not change - exception: the links in the Downloads menu still work. Especially, it is impossible to get access to the documentation... Or am I missing something? Best regards, Wolfgang Denk -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fatal error: askdir.c:355 NULL Volume name. This shouldn't happen!!!
On 07/22/2014 11:34 PM, Clark, Patricia A. wrote: Sadly, this error is still present in v7.0.4. There is another error, too, where there is no writeable media in the tape drive. Fatal error: spool.c:263 Fatal append error on device LTO5-2 (/dev/tape-admin2): ERR=tape_dev.c:161 Unable to open device LTO5-2 (/dev/tape-admin2): ERR=No medium found Both of these are a result of race conditions occurring on tape libraries with multiple tape drives, one job per drive, and several backup jobs running nearly simultaneously. Frequently, the storage daemon requires a restart in order to release the tape drive affected by the error since the SD still sees a running job, however, the director has already indicated the error, sent the notification, and does not have a running job to cancel. On a busy system, restarting the SD can be problematic, and losing one or more tape drives is also a problem. My question, why isn't Bacula happy with a writeable volume from the same pool if one is mounted in the tape drive assigned to a job? I don't know the answer to the question otherwise I would fix the problem. It could be for a number of reasons one being that the Volume has been pruned or otherwise expired. Most often triggering the problem has something to do with your particular configuration, which judging by where you work, is probably large and/or complicated. If you can provide more information on this, it is worth posting a bug report. I will need copies of you bacula-dir.conf and bacula-sd.conf (with passwords removed please) as well as a status storage, status dir, list Volumes, and llist volume=xxx for each Volume that is stuck on the SD when the problem occurs. This will show me a bit what is going on. Given the complexity of the problem, you will probably need to install gdb on your SD so we can examine the internal state of the SD when it gets into this condition. Are you doing Volume pruning? If so, is your Volume Retention Period set to an exact multiple of 24 hours. If that is the case, set your Volume retention to a multiple of 24 hours minus 2 hours, then sure that you properly reload your configuration and that you update all your current Volumes. If the first two conditions (pruning) are true, this has about 95% chance of eliminating your problems. If this eliminates your problems, I won't need a bug report. For the case I have just described, I know the problem, but I am not yet 100% sure what the best way to fix it is. Best regards, Kern Patti Clark Linux System Administrator RD Systems Support Oak Ridge National Laboratory -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] issue with setuid/gid on restored files
Different Linux OSes have very different behaviors, which OS are you running (distribution and version)? On 07/23/2014 12:10 AM, Stephen Thompson wrote: I'm running 7.0.4. Here's an example... (before backup) # ls -ld /bin dr-xr-xr-x 2 root root 4096 Jul 22 09:56 /bin # ls -l /bin/ping -rwsr-xr-x 1 root root 40760 Sep 17 2013 /bin/ping (after restore selecting file /bin/ping) # ls -ld /bin drwsr-xr-x 2 root root 4096 Jul 22 14:38 bin # ls -l /bin/ping -rwxr-xr-x 1 root root 40760 Sep 17 2013 ping (after restore selecting file /bin/ping and directory /bin) # ls -ld /bin dr-xr-xr-x 2 root root 4096 Jul 22 14:38 bin # ls -l /bin/ping -rwxr-xr-x 1 root root 40760 Sep 17 2013 ping In the first restore case, looks like the dir has user-write permissions as well, which isn't right, but perhaps that comes from the umask of the restore since the directory wasn't part of the restore selection. However, the setuid bit certainly wouldn't be coming from the umask. I'm jumping to the conclusion that whatever's doing the setuid bit is messing up and doing it to the parent directory instead of to the file. Stephen On 7/22/14 2:58 PM, Stephen Thompson wrote: Sorry if I have not researched this enough before bringing it to the list, but what I'm seeing is very odd. Someone else must have run into this before me. If I restore a setuid or setgid file, the file is restored without the setuid/setgid bit set. However, the directory containing the file (which did not have it's setuid/setgid bit set during the backup) winds up with the setuid/setgid bit being set. If I restore both the directory and the file, the directory ends up with the proper non-setuid/setgid attributes, but the file once again ends up without the setuid/setgid bit set. I'm assuming the directory has the bit set during an interim stage of the restore, but is then properly set when it's attributes are set during the restore (which must happen after the files that it contains). I can't say authoritatively, but I don't believe this is the way bacula used to behave for me. And to say the least, this is far from acceptable. I discovered this during a bare metal restore, and have loads of issues from no setuid or setgid bits being set on the restored system. thanks, Stephen -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] issue with setuid/gid on restored files
On 07/23/2014 04:04 PM, Stephen Thompson wrote: Redhat 6.5 x86_64 OK, that is a particularly tricky system as they have added additional system security which does not permit certain sequences of API calls even as root which other Linux OSes permit :-( I.e. we test on the latest debian/ubuntu and the code works, but not on RHEL 6.x ... I will look at the code as I may have a patch that will help, but I don't remember it having to do with the setuid bit. I recommend that you submit a bug report on this, because if I get distracted this weekend, I might miss coming back to this problem. With a bug report, it remains very visible until it is corrected. Best regards, Kern On 7/23/14 12:50 AM, Kern Sibbald wrote: Different Linux OSes have very different behaviors, which OS are you running (distribution and version)? On 07/23/2014 12:10 AM, Stephen Thompson wrote: I'm running 7.0.4. Here's an example... (before backup) # ls -ld /bin dr-xr-xr-x 2 root root 4096 Jul 22 09:56 /bin # ls -l /bin/ping -rwsr-xr-x 1 root root 40760 Sep 17 2013 /bin/ping (after restore selecting file /bin/ping) # ls -ld /bin drwsr-xr-x 2 root root 4096 Jul 22 14:38 bin # ls -l /bin/ping -rwxr-xr-x 1 root root 40760 Sep 17 2013 ping (after restore selecting file /bin/ping and directory /bin) # ls -ld /bin dr-xr-xr-x 2 root root 4096 Jul 22 14:38 bin # ls -l /bin/ping -rwxr-xr-x 1 root root 40760 Sep 17 2013 ping In the first restore case, looks like the dir has user-write permissions as well, which isn't right, but perhaps that comes from the umask of the restore since the directory wasn't part of the restore selection. However, the setuid bit certainly wouldn't be coming from the umask. I'm jumping to the conclusion that whatever's doing the setuid bit is messing up and doing it to the parent directory instead of to the file. Stephen On 7/22/14 2:58 PM, Stephen Thompson wrote: Sorry if I have not researched this enough before bringing it to the list, but what I'm seeing is very odd. Someone else must have run into this before me. If I restore a setuid or setgid file, the file is restored without the setuid/setgid bit set. However, the directory containing the file (which did not have it's setuid/setgid bit set during the backup) winds up with the setuid/setgid bit being set. If I restore both the directory and the file, the directory ends up with the proper non-setuid/setgid attributes, but the file once again ends up without the setuid/setgid bit set. I'm assuming the directory has the bit set during an interim stage of the restore, but is then properly set when it's attributes are set during the restore (which must happen after the files that it contains). I can't say authoritatively, but I don't believe this is the way bacula used to behave for me. And to say the least, this is far from acceptable. I discovered this during a bare metal restore, and have loads of issues from no setuid or setgid bits being set on the restored system. thanks, Stephen -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] v7.0.4 migrate: StartTime older than SchedTime
Hello Tom, If I remember right, I am waiting for an FLA to be able to integrate your patches. Any status on that? Best regards, Kern On 07/23/2014 04:30 PM, Thomas Lohman wrote: StartTime does not get updated when migrating a job. Is this a bug or is it the way it is supposed to be? I believe that this is the way it is supposed to work. When copying/migrating a job or when creating a virtual Full job from previous jobs, the start time of the new job gets set to the start time of the copied/migrated job or in the case of a Virtual Full to the start time of the last backup used to create the Virtual Full. This, I believe, is because that start time is used when looking to see what needs to be backed up if you're doing another backup that will be based off of that job. This can cause issues if you're assuming start time is the real start time of a job as you've discovered. I went ahead and added a realstarttime attribute to a job as part of some of my patches/extensions but those were for 5.2.13 and not the latest release 7.0.x. --tom -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Corrupted filesystem using iSCSI
Hello, In my opinion, using network mounted disks for backup is a risky business. Bacula is designed to work with direct attached disks and tapes, so when you connect them instead by a network, you introduce more errors (networks have more faults than direct attached devices), delays (latency), and buffering problems. Latency problems are particularly bad for a SCSI device because it is a very chatty protocol. Bottom line: a lot of people use NFS/CIFS or iSCSI, but I wouldn't bet my data on them. NFS tends to be very unfriendly with Bacula for two reasons: 1. If the NFS connection drops, Bacula can wait forever (something dumb in the implementation) hanging on a system call. 2. If the NFS partition fills, you may not know about it until the device is closed (end of Job) and then it is too late to do much of anything. Best regards, Kern Best regards, Kern On 07/21/2014 07:20 PM, Fábio R. Medeiros wrote: Hello folks! I've running Bacula 5.2 in a FreeBSD box. We use an iSCSI NAS as the storage device... Today I tried to make a restore test and FreeBSD says me that the iSCSI target's filesystem (UFS2+j) was corrupted and needed to be repaired. I ran fsck and all gets fine. Is this normal? If so, are there any workarounds (i.e. spool or run before/after job directives) in order to minimize the need of these checks? Does anyone have experience with Bacula and iSCSI devices? Here is my Device resource config on bacula-sd.conf: Device { Name = STORAGE Media Type = File Archive Device = /mnt/bkp LabelMedia = Yes Random Access = Yes AutomaticMount = Yes RemovableMedia = No AlwaysOpen = Yes Minimum Block Size = 32768 Maximum Block Size = 32768 Block Checksum = Yes } Regards!! Fábio -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users a -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] automatic volume counter
On 07/18/2014 11:35 AM, andreas graeper wrote: hi, 1) the keys in config file DB Pass DBpass dbpass are the whitespaces removed and the keys converted to lower/upper case internally ? i found differences in documentation. Please read the manual. This is clearly explained and is a fundamental part of Bacula conf files. I leave the rest of the questions to the list ... Kern 2) after testing i want to cleanup the storage and have two Pools with FormatLabel "client1-" and "client2-" i.e. the prefixes are used, but both use the same counter and it does not start from zero again. i found mysql.bacula.Pools.NumVols and set it manually back to 0 but no success. the next volumn got an high index and the entry NumVols got the inkremented previous value again. what is to do ? different automatic counter for different pools ? 3) i want to backup different things from a client by two directors (dont know wether this makes sense. maybe a local one and a remote one) and i would like to send message to the Message { Name=m1; Director=d1=all; append = /var/log/bacula/x1.log; } Message { Name=m2; Director=d2=all; append = /var/log/bacula/x2.log; } now i would like to know, how can i connect the director with the correct message resource ? till now i had to use Message.Name=Standard to get it work. i could not find infos. 4) most important question: when using -d100 in service-scripts the output is on stdout / stderr but would be great if it was written to /var/log/.. i would like to see on client what jobs was requested and i would like to see if it succeeded, too. how can i achieve it ? thanks in advance andreas -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] automatic volume counter
On 07/19/2014 10:35 AM, Kern Sibbald wrote: On 07/18/2014 11:35 AM, andreas graeper wrote: hi, 1) the keys in config file DB Pass DBpass dbpass are the whitespaces removed and the keys converted to lower/upper case internally ? i found differences in documentation. Please read the manual. This is clearly explained and is a fundamental part of Bacula conf files. Sorry, I forgot to add the key point: all the above variations of dbpass are identical to Bacula. I leave the rest of the questions to the list ... Kern 2) after testing i want to cleanup the storage and have two Pools with FormatLabel "client1-" and "client2-" i.e. the prefixes are used, but both use the same counter and it does not start from zero again. i found mysql.bacula.Pools.NumVols and set it manually back to 0 but no success. the next volumn got an high index and the entry NumVols got the inkremented previous value again. what is to do ? different automatic counter for different pools ? 3) i want to backup different things from a client by two directors (dont know wether this makes sense. maybe a local one and a remote one) and i would like to send message to the Message { Name=m1; Director=d1=all; append = /var/log/bacula/x1.log; } Message { Name=m2; Director=d2=all; append = /var/log/bacula/x2.log; } now i would like to know, how can i connect the director with the correct message resource ? till now i had to use Message.Name=Standard to get it work. i could not find infos. 4) most important question: when using -d100 in service-scripts the output is on stdout / stderr but would be great if it was written to /var/log/.. i would like to see on client what jobs was requested and i would like to see if it succeeded, too. how can i achieve it ? thanks in advance andreas -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's
Re: [Bacula-users] Problem accessing MySQL database: no tables ?
Hello, Despite you not finding anything in the manual, there *is* a whole chapter entitled "Installing Bacula" that specifically talks about the subject as well as specific chapters on MySQL and PostgreSQL. Given your insistence on getting an answer on the weekend, I suggest investing in a Gold support contract (just kidding, of course) :-) Kern On 07/19/2014 12:43 PM, Huub Van Niekerk wrote: Hi, After installing Bacula 5 from source with MySQL already running, I can't start Bacula but get the message it can't access the database. I've tried to find out how to create which tables, but so far I can't find any info about it in the manual. Suggestions are welcome... Thanks -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem accessing MySQL database: no tables ?
Hello, If the files are not there, then you probably installed binaries from some distribution (e.g. Ubuntu, Debian, ...), which you did not mention. If that is the case, you should ask the author of the packages. If it was a .deb package system, they generally take a lot of care to make sure that everything is installed correctly :-), if it was an rpm package system, sometimes the don't do all the hard work and silently put the needed files somewhere on your system forcing you to find them and install them manually :-(, If you built and installed from the Bacula source files, then those files you mention are definitely somewhere, and you should re-ask the list specifying this new information stating what you actually did to install Bacula. Best regards, Kern On 07/19/2014 03:51 PM, Huub Van Niekerk wrote: On Saturday, July 19, 2014 2:42 PM, Kern Sibbald k...@sibbald.com wrote: Hello, Despite you not finding anything in the manual, there *is* a whole chapter entitled "Installing Bacula" that specifically talks about the subject as well as specific chapters on MySQL and PostgreSQL. Given your insistence on getting an answer on the weekend, I suggest investing in a Gold support contract (just kidding, of course) :-) Hi, Thank you for taking the time to answer me, even in the weekend :) Let me rephrase: yes, I indeed found information about installation and database in the manual. However, in the manual is stated that after installation several executables should be there, such as make_bacula_tables. This, and the other database related commands, are missing and as far as I can find there is no information about this situation. So should I conclude then I did something wrong with respect to the database during installation? Or is something else wrong ? -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fatal error: label.c:464 Truncate error on device - ERR=No such file or directory
On 07/17/2014 08:41 PM, Stefan Lamby wrote: Got the point. I'll think about buying 2 more SATA HDs using software raid to store the precious Volumes on those. That should work well. Btw., using md, is there something wrong with using it in partnership with bacula? What is md? Kern Cheers, Stefan Kern Sibbald k...@sibbald.com hat am 17. Juli 2014 um 19:38 geschrieben: On 07/17/2014 10:38 AM, Stefan Lamby wrote: You wrote writing Volumes directly to a CIFS mount is not really a good idea for a number of reasons. What do you recommend as best practice instead? Write your Volumes to a natively mounted (not network mount) Linux filesystem. Best regards, Kern Best regards, Stefan Kern Sibbald k...@sibbald.com hat am 10. Juli 2014 um 17:36 geschrieben: Unfortunately, neither CIFS nor NFS include a truncate() function, and this problem was not noticed because not many people write Volumes directly to a CIFS/NFS mount. Doing so is not really a good idea for a number of reasons reasons. Any way, once it was discovered (quite a long time ago), I fixed it by "emulating" a truncate. Consequently, I suspect that if you upgrade to a more recent version of Bacula, it will probably work. Best regards, Kern On 07/10/2014 01:22 PM, Stefan Lamby wrote: Hello List. Once a week I got this error, when performing a backup. 19 out of 20 backup jobs work well, one fails. The nas_01 device is a small 1 TB NAS, mounted via fstab: //192.168.1.9/Volume_1 /nas01_backup cifs soft,username=**,password=**,uid=107,gid=107 0 0 The /nas01_backup/backup/ directory exists on the device and other jobs are using it successfully. Here is the output of the status mail: 13-Jun 23:39 backnix05-dir JobId 11348: Start Backup JobId 11348, Job=extranix-bkpdir-full-nas.2014-06-13_23.30.00_57 13-Jun 23:39 backnix05-dir JobId 11348: Using Device "nas_01" 13-Jun 23:39 backnix05-sd JobId 11348: Fatal error: label.c:464 Truncate error on device "nas_01" (/nas01_backup/backup): ERR=dev.c:2023 Unable to truncate device "nas_01" (/nas01_backup/backup). ERR=No such file or directory 13-Jun 23:39 backnix05-sd JobId 11348: Marking Volume "bkp-nas-0265" in Error in Catalog. 13-Jun 23:39 backnix05-sd JobId 11348: Fatal error: Job 11348 canceled. 13-Jun 22:40 extranix-fd JobId 11348: Fatal error: job.c:2390 Bad response to Append Data command. Wanted 3000 OK data , got 3903 Error append data Do you have any advice/idea? Thank you very much. Stefan -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Bl
Re: [Bacula-users] Fatal error: label.c:464 Truncate error on device - ERR=No such file or directory
On 07/17/2014 10:38 AM, Stefan Lamby wrote: You wrote writing Volumes directly to a CIFS mount is not really a good idea for a number of reasons. What do you recommend as best practice instead? Write your Volumes to a natively mounted (not network mount) Linux filesystem. Best regards, Kern Best regards, Stefan Kern Sibbald k...@sibbald.com hat am 10. Juli 2014 um 17:36 geschrieben: Unfortunately, neither CIFS nor NFS include a truncate() function, and this problem was not noticed because not many people write Volumes directly to a CIFS/NFS mount. Doing so is not really a good idea for a number of reasons reasons. Any way, once it was discovered (quite a long time ago), I fixed it by "emulating" a truncate. Consequently, I suspect that if you upgrade to a more recent version of Bacula, it will probably work. Best regards, Kern On 07/10/2014 01:22 PM, Stefan Lamby wrote: Hello List. Once a week I got this error, when performing a backup. 19 out of 20 backup jobs work well, one fails. The nas_01 device is a small 1 TB NAS, mounted via fstab: //192.168.1.9/Volume_1 /nas01_backup cifs soft,username=**,password=**,uid=107,gid=107 0 0 The /nas01_backup/backup/ directory exists on the device and other jobs are using it successfully. Here is the output of the status mail: 13-Jun 23:39 backnix05-dir JobId 11348: Start Backup JobId 11348, Job=extranix-bkpdir-full-nas.2014-06-13_23.30.00_57 13-Jun 23:39 backnix05-dir JobId 11348: Using Device "nas_01" 13-Jun 23:39 backnix05-sd JobId 11348: Fatal error: label.c:464 Truncate error on device "nas_01" (/nas01_backup/backup): ERR=dev.c:2023 Unable to truncate device "nas_01" (/nas01_backup/backup). ERR=No such file or directory 13-Jun 23:39 backnix05-sd JobId 11348: Marking Volume "bkp-nas-0265" in Error in Catalog. 13-Jun 23:39 backnix05-sd JobId 11348: Fatal error: Job 11348 canceled. 13-Jun 22:40 extranix-fd JobId 11348: Fatal error: job.c:2390 Bad response to Append Data command. Wanted 3000 OK data , got 3903 Error append data Do you have any advice/idea? Thank you very much. Stefan -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula 7 will only see the first storage resource in bacula-dir.conf
Hello, I suggest you read the new features for 7.0 in the manual. The fourth item talks specifically about the status sd command. I see absolutely nothing wrong with your config file or with what Bacula is doing. As the manual says, if you enter: status select storage you will probably get what you expected, but you will also get "duplicate" entries listed. Best regards, Kern On 07/16/2014 05:01 AM, Joe Rhodes wrote: Hey everyone! Im running Bacula 7.0.4 on Ubuntu 14.04. Im backing up to two different devices. One is a hot-swap hard drive bay which Im treating as a changer using the vchanger program. These drives get changed out and rotated off site. The other is a fixed drive. The two devices will use two distinct pools. The issue Im having is that no matter what I do, Bacula seems to see the FIRST storage resource only. This ultimately causes problems because bacula will look to the wrong device for volumes associated with the pool the job calls for. I have a similar setup on a Bacula 5.2 setup that is working great. So Im not sure what Im doing wrong. Config files look the same between the two. If anyone has some suggestions, Id be eternally grateful. The stanzas from bacula-dir.com: # # # Storage # # # Definition of file Virtual Autochanger device Storage { Name = removeable-drives Address = 10.11.1.2 # N.B. Use a fully qualified name here SDPort = 9103 Password = "RoundHouseBackup" Device = ExternalDrives Media Type = File Maximum Concurrent Jobs = 1# run up to 10 jobs a the same time } Storage { Name = LocalStorage Address = 10.11.1.2 # N.B. Use a fully qualified name here SDPort = 9103 Password = "RoundHouseBackup" Device = LocalStorage Media Type = File1 Maximum Concurrent Jobs = 1# run up to 10 jobs a the same time } And the stanzas from my bacula-sd.conf: # Define a Virtual autochanger # Autochanger { Name = ExternalDrives Device = ExternalDrives-Drive1 Changer Command = "/usr/local/bin/vchanger -u root %c %o %S %a %d" Changer Device = "/etc/bacula/vchanger1.conf" } Device { Name = ExternalDrives-Drive1 DriveIndex = 0 Autochanger = yes DeviceType = File Media Type = File Archive Device = /var/lib/bacula/removeable-drives/0/drive0 #LabelMedia = yes; # lets Bacula label unlabeled media Random Access = Yes; AutomaticMount = yes;# when device opened, read it RemovableMedia = no; AlwaysOpen = no; Maximum Concurrent Jobs = 5; Maximum Volume Size = 476250 MB; # with 8 volumes per drive, this should leave about # 4,800 MB free for other things, or about 0.125% } Device { Name = LocalStorage Device Type = File Media Type = File1 Archive Device = /mnt/localstorage/ LabelMedia = yes; # lets Bacula label unlabeled media Random Access = Yes; AutomaticMount = yes;# when device opened, read it RemovableMedia = no; AlwaysOpen = no; Maximum Volume Size = 237500 MB } When I execute status sd in bconsole, I get this: *status sd Automatically selected Storage: removeable-drives Connecting to Storage daemon removeable-drives at 10.11.1.2:9103 mail.roundhouse.local-sd Version: 7.0.4 (04 June 2014) x86_
Re: [Bacula-users] Monthly backup on 1st day except on saturdays
Hello Ana, Interesting problem. Please see below ... On 07/12/2014 04:00 PM, Ana Emlia M. Arruda wrote: Hi Fabio, I'm quite sure about a Kern's post here where he said that there is a "not" keyword for schedules. Have you tried something like the bellow? I think I was referring to a not operator such as ! However, I must have been confused with the ! in the Messages destination list. Bottom line: I don't think there is a not operator, and the "not" in your schedule below isn't likely to work. However, in including only the days/dates you want, you can effectively exclude certain combinations. The following should accomplish what you want: Schedule { ... Run = level=Full sun-fri on 1 at 2:30 ... } Although I cannot guarantee it, this schedule should run jobs only on Sunday through Friday (i.e. not Saturday) and on the first day of the month. Try the command: status schedule days=500 I get: *status schedule days=500 Scheduled Jobs: Level Type Pri Scheduled Job Name Schedule = Full Backup 10 Sun 03-Aug 02:30 NightlySave TestSched Full Backup 10 Tue 05-Aug 02:30 NightlySave TestSched Full Backup 10 Wed 03-Sep 02:30 NightlySave TestSched Full Backup 10 Fri 05-Sep 02:30 NightlySave TestSched Full Backup 10 Fri 03-Oct 02:30 NightlySave TestSched Full Backup 10 Sun 05-Oct 02:30 NightlySave TestSched Full Backup 10 Mon 03-Nov 02:30 NightlySave TestSched Full Backup 10 Wed 05-Nov 02:30 NightlySave TestSched Full Backup 10 Wed 03-Dec 02:30 NightlySave TestSched Full Backup 10 Fri 05-Dec 02:30 NightlySave TestSched Full Backup 10 Mon 05-Jan 02:30 NightlySave TestSched Full Backup 10 Tue 03-Feb 02:30 NightlySave TestSched Full Backup 10 Thu 05-Feb 02:30 NightlySave TestSched Full Backup 10 Tue 03-Mar 02:30 NightlySave TestSched Full Backup 10 Thu 05-Mar 02:30 NightlySave TestSched Full Backup 10 Fri 03-Apr 02:30 NightlySave TestSched Full Backup 10 Sun 05-Apr 02:30 NightlySave TestSched Full Backup 10 Sun 03-May 02:30 NightlySave TestSched Full Backup 10 Tue 05-May 02:30 NightlySave TestSched Full Backup 10 Wed 03-Jun 02:30 NightlySave TestSched Full Backup 10 Fri 05-Jun 02:30 NightlySave TestSched Full Backup 10 Fri 03-Jul 02:30 NightlySave TestSched Full Backup 10 Sun 05-Jul 02:30 NightlySave TestSched Full Backup 10 Mon 03-Aug 02:30 NightlySave TestSched Full Backup 10 Wed 05-Aug 02:30 NightlySave TestSched Full Backup 10 Thu 03-Sep 02:30 NightlySave TestSched Full Backup 10 Mon 05-Oct 02:30 NightlySave TestSched Full Backup 10 Tue 03-Nov 02:30 NightlySave TestSched Full Backup 10 Thu 05-Nov 02:30 NightlySave TestSched Best regards, Kern Schedule { Name = ... Run = Level=Full sat at xx:xx not on 1 at xx:xx } Regards, Ana On Fri, Jul 11, 2014 at 10:17 AM, "Fbio R. Medeiros" fab...@unicamp.br wrote: Hi guys, I've defined the schedule with a weekly and monthly cycle. The weekly cycle runs a Full backup on saturdays and the monthly cycle run a full backup every 1st day of month. Are there any way to tells Bacula to do NOT run the full backup of monthly cycle if the 1st day of the month is a saturday. If so, it would run the monthly full backup on sunday, the 2nd day of the month... Fabio -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.n
Re: [Bacula-users] Monthly backup on 1st day except on saturdays
Hello, Oops ... When I look at the schedule that was produced, it does not correspond to what I wanted to show. The status schedule was actually made with: Run = level=Full sun-fri on 3,5 at 2:30 which made reading the output of "show schedule" easier to read. The real "status schedule" that I should have attached for the following statement: Run = level=Full sun-fri on 1 at 2:30 is: *status schedule days=500 Scheduled Jobs: Level Type Pri Scheduled Job Name Schedule = Full Backup 10 Fri 01-Aug 02:30 NightlySave TestSched Full Backup 10 Mon 01-Sep 02:30 NightlySave TestSched Full Backup 10 Wed 01-Oct 02:30 NightlySave TestSched Full Backup 10 Mon 01-Dec 02:30 NightlySave TestSched Full Backup 10 Thu 01-Jan 02:30 NightlySave TestSched Full Backup 10 Sun 01-Feb 02:30 NightlySave TestSched Full Backup 10 Sun 01-Mar 02:30 NightlySave TestSched Full Backup 10 Wed 01-Apr 02:30 NightlySave TestSched Full Backup 10 Fri 01-May 02:30 NightlySave TestSched Full Backup 10 Mon 01-Jun 02:30 NightlySave TestSched Full Backup 10 Wed 01-Jul 02:30 NightlySave TestSched Full Backup 10 Tue 01-Sep 02:30 NightlySave TestSched Full Backup 10 Thu 01-Oct 02:30 NightlySave TestSched Full Backup 10 Sun 01-Nov 02:30 NightlySave TestSched which looks a lot more like what Fbio wanted. Best regards, Kern On 07/12/2014 06:03 PM, Kern Sibbald wrote: Hello Ana, Interesting problem. Please see below ... On 07/12/2014 04:00 PM, Ana Emlia M. Arruda wrote: Hi Fabio, I'm quite sure about a Kern's post here where he said that there is a "not" keyword for schedules. Have you tried something like the bellow? I think I was referring to a not operator such as ! However, I must have been confused with the ! in the Messages destination list. Bottom line: I don't think there is a not operator, and the "not" in your schedule below isn't likely to work. However, in including only the days/dates you want, you can effectively exclude certain combinations. The following should accomplish what you want: Schedule { ... Run = level=Full sun-fri on 1 at 2:30 ... } Although I cannot guarantee it, this schedule should run jobs only on Sunday through Friday (i.e. not Saturday) and on the first day of the month. Try the command: status schedule days=500 I get: *status schedule days=500 Scheduled Jobs: Level Type Pri Scheduled Job Name Schedule = Full Backup 10 Sun 03-Aug 02:30 NightlySave TestSched Full Backup 10 Tue 05-Aug 02:30 NightlySave TestSched Full Backup 10 Wed 03-Sep 02:30 NightlySave TestSched Full Backup 10 Fri 05-Sep 02:30 NightlySave TestSched Full Backup 10 Fri 03-Oct 02:30 NightlySave TestSched Full Backup 10 Sun 05-Oct 02:30 NightlySave TestSched Full Backup 10 Mon 03-Nov 02:30 NightlySave TestSched Full Backup 10 Wed 05-Nov 02:30 NightlySave TestSched Full Backup 10 Wed 03-Dec 02:30 NightlySave TestSched Full Backup 10 Fri 05-Dec 02:30 NightlySave TestSched Full Backup 10 Mon 05-Jan 02:30 NightlySave TestSched Full Backup 10 Tue 03-Feb 02:30 NightlySave TestSched Full Backup 10 Thu 05-Feb 02:30 NightlySave TestSched Full Backup 10 Tue 03-Mar 02:30 NightlySave TestSched Full Backup 10 Thu 05-Mar 02:30 NightlySave TestSched Full Backup 10 Fri 03-Apr 02:30 NightlySave TestSched Full Backup 10 Sun 05-Apr 02:30 NightlySave TestSched Full Backup 10 Sun 03-May 02:30 NightlySave TestSched Full Backup 10 Tue 05-May 02:30 NightlySave TestSched Full Backup 10 Wed 03-Jun 02:30 NightlySave TestSched Full Backup 10 Fri 05-Jun 02:30 NightlySave TestSched Full Backup 10 Fri 03-Jul 02:30 NightlySave TestSched Full Backup 10 Sun 05-Jul 02:30 NightlySave TestSched Full Backup 10 Mon 03-Aug 02:30 NightlySave TestSched Full Backup 10 Wed 05-Aug 02:30 NightlySave TestSched Full Backup 10 Thu 03-Sep 02:30 NightlySave
[Bacula-users] Windows binaries
Hello, I have been working on the next version of the Windows binaries, and I would like two people to help me testing it. One person running 5.2.x and one person running 7.0.x. These are the Bacula Enterprise Windows binaries (the *very* latest source code) that I have (I hope) tweaked to be compatible with the community DIR and SD. These binaries are not yet heavily tested so need to be used in production with caution. If you help me testing them, you will have the right to the final version that will be released (of course at no charge). You must be the first to apply and you will have to have the time to do some real testing on several different versions until it is finally released. If you don't have enough time, please do not apply. By the way, in discussing the Windows binaries with Bacula Systems, they have given me permission to give them away to my friends. First, I considered that fantastic, then I had a problem deciding who my friends are -- there are many, many friends out there. Some vocal, others just there happily (I hope) using Bacula. In the light of the Bareos affair, I will a longer blog about the quality of being a friend and how important it is. But in the short run, I really have a problem discerning who should be classified as a friend, because my own inclination would be to make a very broad definition -- perhaps too broad for Bacula Systems. In the end, I decided that I will apply the Bacula Systems offer by for the purpose of giving away the Enterprise Windows binaries to all those people who have contributed to the Bacula project as that is something that I can more easily (but not without a bit of subjectivity) define. This means that everyone who has contributed to the Bacula project (I will define that a bit later) at some point in the near future will be able to download the next version of the Enterprise Windows binaries, which I am working on now. Furthermore, if you are not a contributor and you have previously purchased a Windows binary, the upgrade to the new version will be at half price. Best regards, Kern -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fatal error: label.c:464 Truncate error on device - ERR=No such file or directory
Unfortunately, neither CIFS nor NFS include a truncate() function, and this problem was not noticed because not many people write Volumes directly to a CIFS/NFS mount. Doing so is not really a good idea for a number of reasons reasons. Any way, once it was discovered (quite a long time ago), I fixed it by "emulating" a truncate. Consequently, I suspect that if you upgrade to a more recent version of Bacula, it will probably work. Best regards, Kern On 07/10/2014 01:22 PM, Stefan Lamby wrote: Hello List. Once a week I got this error, when performing a backup. 19 out of 20 backup jobs work well, one fails. The nas_01 device is a small 1 TB NAS, mounted via fstab: //192.168.1.9/Volume_1 /nas01_backup cifs soft,username=**,password=**,uid=107,gid=107 0 0 The /nas01_backup/backup/ directory exists on the device and other jobs are using it successfully. Here is the output of the status mail: 13-Jun 23:39 backnix05-dir JobId 11348: Start Backup JobId 11348, Job=extranix-bkpdir-full-nas.2014-06-13_23.30.00_57 13-Jun 23:39 backnix05-dir JobId 11348: Using Device "nas_01" 13-Jun 23:39 backnix05-sd JobId 11348: Fatal error: label.c:464 Truncate error on device "nas_01" (/nas01_backup/backup): ERR=dev.c:2023 Unable to truncate device "nas_01" (/nas01_backup/backup). ERR=No such file or directory 13-Jun 23:39 backnix05-sd JobId 11348: Marking Volume "bkp-nas-0265" in Error in Catalog. 13-Jun 23:39 backnix05-sd JobId 11348: Fatal error: Job 11348 canceled. 13-Jun 22:40 extranix-fd JobId 11348: Fatal error: job.c:2390 Bad response to Append Data command. Wanted 3000 OK data , got 3903 Error append data Do you have any advice/idea? Thank you very much. Stefan -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fatal error: label.c:464 Truncate error on device - ERR=No such file or directory
Version 5.0.3 is quite old. You must upgrade the Director and all the SDs at the same time to the same version, as well as any FD on either the Dir or SD machine. Other FDs do not need to be updated. Best regards, Kern On 07/10/2014 06:32 PM, Stefan Lamby wrote: Thank you very much for pointing this out. My Version is 5.0.3 and it is running at an opensuse 11.4 version. Could it work if I just compile a new sd executable and put the new one with depending libraries to that machine? Or to be more spefic: will director 5.0.3 and the other (old) components work together with a current sd or do I have to renew everything? Thanks, Stefan Kern Sibbald k...@sibbald.com hat am 10. Juli 2014 um 17:36 geschrieben: Unfortunately, neither CIFS nor NFS include a truncate() function, and this problem was not noticed because not many people write Volumes directly to a CIFS/NFS mount. Doing so is not really a good idea for a number of reasons reasons. Any way, once it was discovered (quite a long time ago), I fixed it by "emulating" a truncate. Consequently, I suspect that if you upgrade to a more recent version of Bacula, it will probably work. Best regards, Kern On 07/10/2014 01:22 PM, Stefan Lamby wrote: Hello List. Once a week I got this error, when performing a backup. 19 out of 20 backup jobs work well, one fails. The nas_01 device is a small 1 TB NAS, mounted via fstab: //192.168.1.9/Volume_1 /nas01_backup cifs soft,username=**,password=**,uid=107,gid=107 0 0 The /nas01_backup/backup/ directory exists on the device and other jobs are using it successfully. Here is the output of the status mail: 13-Jun 23:39 backnix05-dir JobId 11348: Start Backup JobId 11348, Job=extranix-bkpdir-full-nas.2014-06-13_23.30.00_57 13-Jun 23:39 backnix05-dir JobId 11348: Using Device "nas_01" 13-Jun 23:39 backnix05-sd JobId 11348: Fatal error: label.c:464 Truncate error on device "nas_01" (/nas01_backup/backup): ERR=dev.c:2023 Unable to truncate device "nas_01" (/nas01_backup/backup). ERR=No such file or directory 13-Jun 23:39 backnix05-sd JobId 11348: Marking Volume "bkp-nas-0265" in Error in Catalog. 13-Jun 23:39 backnix05-sd JobId 11348: Fatal error: Job 11348 canceled. 13-Jun 22:40 extranix-fd JobId 11348: Fatal error: job.c:2390 Bad response to Append Data command. Wanted 3000 OK data , got 3903 Error append data Do you have any advice/idea? Thank you very much. Stefan -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft___ Bacula-use
Re: [Bacula-users] Bacula 7.0.4 + bacula-fd 6.0.6 still produce failed verify jobs on windows
The next version of the Windows FD will have that problem fixed. It is something that I will work on in the next few weeks. Best regards, Kern On 07/10/2014 07:43 PM, J. Echter wrote: Hi, i upgraded to bacula 7.x and bought the bacula 6.x enterprise binarys for my windows boxes, hoping the verify error will go away. Sadly, it didn't... Here' the log from the backup: 08-Jul 20:00 bacula-dir JobId 3271: No prior Full backup Job record found. 08-Jul 20:00 bacula-dir JobId 3271: No prior or suitable Full backup found in catalog. Doing FULL backup. 09-Jul 00:32 bacula-dir JobId 3271: shell command: run BeforeJob /etc/bacula/holiday.sh 09-Jul 00:32 bacula-dir JobId 3271: BeforeJob: Date is not a known vacation day. 09-Jul 00:32 bacula-dir JobId 3271: Start Backup JobId 3271, Job=Datev.2014-07-08_20.00.01_37 09-Jul 00:32 bacula-dir JobId 3271: Using Device File to write. 09-Jul 00:32 datev-fd JobId 3271: Generate VSS snapshots. Driver=Win64 VSS, Drive(s)=C 09-Jul 00:34 bacula-sd JobId 3271: End of medium on Volume file-0074 Bytes=1,073,719,618 Blocks=16,651 at 09-Jul-2014 00:34. 09-Jul 00:34 bacula-dir JobId 3271: There are no more Jobs associated with Volume file-0075. Marking it purged. 09-Jul 00:34 bacula-dir JobId 3271: All records pruned from Volume file-0075; marking it Purged 09-Jul 00:34 bacula-dir JobId 3271: Recycled volume file-0075 09-Jul 00:34 bacula-sd JobId 3271: Recycled volume file-0075 on file device File (/BACKUP/archivefiles), all previous data lost. 09-Jul 00:34 bacula-sd JobId 3271: New volume file-0075 mounted on device File (/BACKUP/archivefiles) at 09-Jul-2014 00:34. 09-Jul 00:40 bacula-sd JobId 3271: End of medium on Volume file-0075 Bytes=1,073,737,773 Blocks=16,644 at 09-Jul-2014 00:40. 09-Jul 00:40 bacula-dir JobId 3271: There are no more Jobs associated with Volume file-0076. Marking it purged. 09-Jul 00:40 bacula-dir JobId 3271: All records pruned from Volume file-0076; marking it Purged 09-Jul 00:40 bacula-dir JobId 3271: Recycled volume file-0076 09-Jul 00:40 bacula-sd JobId 3271: Recycled volume file-0076 on file device File (/BACKUP/archivefiles), all previous data lost. 09-Jul 00:40 bacula-sd JobId 3271: New volume file-0076 mounted on device File (/BACKUP/archivefiles) at 09-Jul-2014 00:40. 09-Jul 00:46 bacula-sd JobId 3271: End of medium on Volume file-0076 Bytes=1,073,737,794 Blocks=16,644 at 09-Jul-2014 00:46. 09-Jul 00:46 bacula-dir JobId 3271: There are no more Jobs associated with Volume file-0077. Marking it purged. 09-Jul 00:46 bacula-dir JobId 3271: All records pruned from Volume file-0077; marking it Purged 09-Jul 00:46 bacula-dir JobId 3271: Recycled volume file-0077 09-Jul 00:46 bacula-sd JobId 3271: Recycled volume file-0077 on file device File (/BACKUP/archivefiles), all previous data lost. 09-Jul 00:46 bacula-sd JobId 3271: New volume file-0077 mounted on device File (/BACKUP/archivefiles) at 09-Jul-2014 00:46. 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): Task Scheduler Writer, State: 0x1 (VSS_WS_STABLE) 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): VSS Metadata Store Writer, State: 0x1 (VSS_WS_STABLE) 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): Performance Counters Writer, State: 0x1 (VSS_WS_STABLE) 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): System Writer, State: 0x1 (VSS_WS_STABLE) 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): ASR Writer, State: 0x1 (VSS_WS_STABLE) 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): MSSearch Service Writer, State: 0x1 (VSS_WS_STABLE) 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): COM+ REGDB Writer, State: 0x1 (VSS_WS_STABLE) 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): SqlServerWriter, State: 0x1 (VSS_WS_STABLE) 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): Shadow Copy Optimization Writer, State: 0x1 (VSS_WS_STABLE) 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): Registry Writer, State: 0x1 (VSS_WS_STABLE) 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): WMI Writer, State: 0x1 (VSS_WS_STABLE) 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): BITS Writer, State: 0x1 (VSS_WS_STABLE) 09-Jul 00:50 datev-fd JobId 3271: shell command: run ClientAfterJob c:/netstart.bat 09-Jul 00:50 bacula-sd JobId 3271: Elapsed time=00:17:30, Transfer rate=2.640 M Bytes/second 09-Jul 00:50 datev-fd JobId 3271: ClientAfterJob: 09-Jul 00:50 datev-fd JobId 3271: ClientAfterJob: C:\Windows\system32net start MSSQL$DATEV_DBEngine 09-Jul 00:50 datev-fd JobId 3271: ClientAfterJob: SQL Server (DATEV_DBENGINE) wird gestartet.. 09-Jul 00:50 datev-fd JobId 3271: ClientAfterJob: SQL Server (DATEV_DBENGINE) wurde erfolgreich gestartet. 09-Jul 00:50 datev-fd JobId 3271: ClientAfterJob: 09-Jul 00:50 bacula-dir JobId 3271: Bacula bacula-dir
Re: [Bacula-users] Why do Concurrend Jobs on same Client wait for another?
Hello, If the client is a Windows machine as shown below, and you have VSS=yes set, then the FD forces them to be sequential. That is the VSS code as it is currently written is not re-entrant. If you turn off VSS, you can run as many simultaneous jobs as you want on the client, but then they cannot backup files that are open, which is generally not what you want. This restriction will be removed in some future version. Best regards, Kern On 07/02/2014 08:40 PM, Ralph Cunnington wrote: Hi Bacula-Users, giving: Bacula_5.2.13 (Dir and SD )on SuSE 13.1 Clients: Bacula 5.0.3 (Win64) on WinServer 2008R2, WinServer 2003 I've got 2 concurrend jobs on the same client, same Pri waiting one for the other to finish. Concurrend jobs all set in client, Storage, Director... using seperate Pools and FileTypes and Storage Devices. *status client=win08-fd Running Jobs: Writing: Full Backup job jw08-notes JobId=64 Volume="nTgm-0038" pool="nTag" device="DevNotes1tg" (/media/da2/tga/client1) spooling=0 despooling=0 despool_wait=0 Files=4 Bytes=3,829,306,501 AveBytes/sec=11,195,095 LastBytes/sec=11,609,243 FDReadSeqNo=74,623 in_msg=74612 out_msg=5 fd=5 Writing: Full Backup job jw08-notes-mail JobId=65 Volume="nTgm-0039" pool="nTagm" device="DevNotes2tg" (/media/da2/tgb/client2) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 AveBytes/sec=0 LastBytes/sec=0 FDReadSeqNo=5 in_msg=4 out_msg=3 fd=8 *status storage Used Volume status: nTgm-0038 on device "DevNotes1tg" (/media/da2/tga/client1) Reader=0 writers=1 reserves=0 volinuse=1 nTgm-0039 on device "DevNotes2tg" (/media/da2/tgb/client2) Reader=0 writers=0 reserves=1 volinuse=1 why does Volume "nTgm-0039" (writers=0, reserves=1 ?) wait and how can I fix it ?? Has anybody had seen an similar Situation, any ideas ? best regards Ralph Cunnington --- IT-Support und Systementwicklung Paderborn b.i.b. International College, Frstenallee 3-5, 33102 Paderborn Tel:+49(0)5251-30101 - Fax:+49(0)5251-301161 Ralph(dot)Cunnington[at]bib(dot)de - www.bib.de - Trger: Bildungszentrum fr informationsverarbeitende Berufe e.V., Paderborn Vorstand: Felicitas Schneider, Dr. Bernhard Hartung, Thomas Hommes, Prof. Dr. Michael Lwe Geschftsfhrer: Georg Herrmann / Registergericht: Amtsgericht Paderborn / Registernummer: VR 639 -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unintended effect of bconsole's reload command?
Hello, The reload command reloads the conf file, so whatever is in your bacula-dir.conf file will be used for all jobs that start after the reload. Since the disable command for jobs does not modify the .conf file, all disabled jobs will be lost after a reload. Best regards, Kern On 06/30/2014 03:23 PM, Bill Arlofski wrote: Hi list, Hi Kern, Recently, I have been noticing that jobs I have temporarily disabled at the bconsole prompt had been 'randomly' showing back up in the list of scheduled nightly jobs. I just noticed that this happened again to me this morning, and determined that I had just modified a config file (I made some indents and formatting changes, no actual backup configuration changes were made), and then I issued the reload command. Is the reload command supposed to enable all disabled jobs, or is this an unintended consequence? Using v7.04 Thanks! Bill -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Block checksum mismatch on file storage
On 06/30/2014 10:35 PM, John Stoffel wrote: Kern Yes, it is clear that one can do read-only tests that do not destroy Kern data. However, in this case, it seems to me more useful to do Kern read/write (it is actually write/read) tests as it appears that the Kern problem is more likely in the write ... Absolutely. And hopefully, this way you don't corrupt the existing data on the disk, but you do force the disk to do a low level re-allocation of bad blocks and sectors. But if you are seeing bad blocks on the disk, then it's time to start thinking about retiring it. Hmm. I learn something new every day; re-allocation of bad blocks. That sounds very interesting. Thanks for the information, it could be very useful for situations like this. Best regards, Kern Kern I have never heard of a non-destructive read/write test, which I assume Kern reads then rewrites the disk. Although that is clever and could be Kern useful, in this case it sounds to me risky on a disk that seems to be Kern failing. Kern Best regards, Kern Kern Kern On 06/29/2014 09:04 PM, John Stoffel wrote: Kern 3. Run read/write disk tests on your USB disk (note: this will Kern destroy any existing data). This isn't quite right. You can run read-write tests on a quiescent filesystem (ie unmounted) without problems: badblocks -svn /dev/sd? will scan the entire disk using non-destructive read-write mode. But as Kern said, check your logs as well. John -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users