[Bacula-users] post scripts not running after cancelling job?
Hi all I backup this zimbra machine, and it has a pre and post job setup. If the backup is cancelled, the post job won't be run. Is this intentional? -- Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 98013356 r...@karlsbakk.net http://blogg.karlsbakk.net/ GPG Public key: http://karlsbakk.net/roysigurdkarlsbakk.pubkey.txt -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med xenotyp etymologi. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Feature requests?
Hi all I filed a feature request on http://bugs.bacula.org/view.php?id=1866, only to have it closed with reason no change required. Is there another preferred way to file feature requests than using the bug tracker? If so, can you please remove the feature level, or at least document the reason for this level? As for the feature request, allowing independant upgrade of SD and Director, I find this a rather important one in those cases where you have multiple SDs (I have four now, two more to come, and I've talked with other people having even more). Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 98013356 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med xenotyp etymologi. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Director and FD versions question
Hi all I have a director still at 5.0.3, and a few new clients coming up. Should I use the current version (5.2.4) on these FDs, or should I keep them on 5.0.3 until the director has been upgraded? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Director and FD versions question
I have a director still at 5.0.3, and a few new clients coming up. Should I use the current version (5.2.4) on these FDs, or should I keep them on 5.0.3 until the director has been upgraded? Vennlige hilsener / Best regards It's always recommended that the director version = SD version and both of these are greater than or equal to the FD versions. Thanks a bunch - guess I'll keep to 5.0.3 until the director and SDs are upgraded, then... Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restore from specific date with bat?
Hi all Is there a way, in bat, to restore from a specific date? I can't find one... Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] WAN traffic question
Hi all I have setup Bacula and we're currently backing up three networks, the private LAN, the DMZ and a remote observatory - Birkenes. The latter is connected to a 1Mbps SHDSL link. There's a central Director with the PostgreSQL database. Each of the networks have a private SD. Now, backing up Birkenes is tedious. The WAN link seems to be saturated even though the SD is local. What could be causing this traffic? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Nuking the database entries for certain SDs
Hi all After a good portion of bad luck with a freak combination of some less-than-ideal WD drives and a set of LSI SAS controllers/expanders, I seem to need to start over for at least two of my SDs. To cut the story short, the WD drives were kicked out by ZFS, usually quite a few on the same backlane/expander. The net result is that two zpools are quite unusable and the drives are being replaced by Hitachi drives (that have shown stable in other, similar setups, also where the WDs failed). Now, it's no use crying over spilt milk, some backups are gone, but we have snapshots back in time of the most important data. Still, I don't want to start over from scratch on all SDs at once. One (smallish) SD is released already, and I want to start off with that, nuking whatever info for that SD and the servers backing up there. Later, when I see that works, I'll start with the second, and finally, if I need to, I'll scratch the third and follow the same procedure. The smallish tos-backup's data is declared gone, and the zpool is replaced. Ss, how do I do this? Is it sufficient to just remove the tapes from the media library? If so, should I use purge, delete or prune? What is the difference? And lastly, should I stick to bconsole for this type of job? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free Love Thy Logs t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Scripting restores?
Alternatively you can simply script restores via bconsole. eg bconsole EOF restore 7 /example/DUMP/Archive/P_NW.mxi /example/ptec/storman_6_amd64.deb /example/DUMP/CC_Planning_3d.mxs /example/DUMP/CC_Planning_side.mxi /example/PLE/3D_N_StageC_.c4d /example/aw/05 3d/Mark/03/ViewNo01/B /example/sit/shops/Sheet-000921.pdf /example/arket/typical_side_winder.psd /example/2.25/elements2/gtc_.psd /example/for planners/Tiff/ordnance copy. /example/102__Binder.pdf /example/Thomas/rice yes EOF Any chance of telling bconsole from which job it should extract this? Seems this will only pull the latest version from the backup, which isn't really what I want. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Magic Quadrant for Content-Aware Data Loss Prevention Research study explores the data loss prevention market. Includes in-depth analysis on the changes within the DLP market, and the criteria used to evaluate the strengths and weaknesses of these DLP solutions. http://www.accelacomm.com/jaw/sfnl/114/51385063/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Database performance issue
Hi all Starting a file-based restore job, this led to postgresql spending a full 15 minutes in a query. Any idea what can be done to fix this? http://paste.ubuntu.com/647576/ has a full explain/analyze of the query, but so far, I haven't figured out where the problem is. Anyone with an idea of how to tune this? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Magic Quadrant for Content-Aware Data Loss Prevention Research study explores the data loss prevention market. Includes in-depth analysis on the changes within the DLP market, and the criteria used to evaluate the strengths and weaknesses of these DLP solutions. http://www.accelacomm.com/jaw/sfnl/114/51385063/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issue
Starting a file-based restore job, this led to postgresql spending a full 15 minutes in a query. Any idea what can be done to fix this? http://paste.ubuntu.com/647576/ has a full explain/analyze of the query, but so far, I haven't figured out where the problem is. Anyone with an idea of how to tune this? create index file_filenameid on file(filenameid); I guess that should be part of the FAQ... Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Magic Quadrant for Content-Aware Data Loss Prevention Research study explores the data loss prevention market. Includes in-depth analysis on the changes within the DLP market, and the criteria used to evaluate the strengths and weaknesses of these DLP solutions. http://www.accelacomm.com/jaw/sfnl/114/51385063/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] New index to speed things up a bit
Hi all I had 7 seconds lookup time each time I clicked Jobs Run in Bat. Adding this one reduced the query time down to 7ms, which was a bit better :) CREATE INDEX jobmedia__jobid_jobmediaid ON jobmedia(jobid, jobmediaid); Perhaps that one should be added by default? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2d-c2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Performance options for single large (100TB) server backup?
Hi Out of curiosity, why do you do such forklift replacements when ZFS supports replacing individual drives, letting the pool resilver and then automatically grow to the new size? roy - Original Message - I have been using Bacula for over a year now and it has been providing 'passable' service though I think since day one I have been streching it to it's limits or need a paradigm shift in how I am configuring it. Basically, I have a single server which has direct atached disk (~128TB / 112 drives) and Tape drives (LTO4). It's main function is a centralized file server archival server. It has several mount points (~20) (ZFS) to break down some structures based on file size and intended use basically spawning a new mountpoint for anything a couple TB or 100,000 files. Some file systems are up to 30TB in size others are only a handful of GB. With ~4,000,000 files anywhere from 4KiB up to 32GiB in size. Data change is about 1-2TiB/month which is not that big of an issue. The problem is when I need to do full backups and restores (restores mainly ever 1-2 years when I have to do forklift replacement of drives). Bottlenecks that I see are: - File daemon is single threaded so is limiting backup performance. Is there was a way to start more than one stream at the same time for a single machine backup? Right now I have all the file systems for a single client in the same file set. - Tied in with above, accurate backups cut into performance even more when doing all the md5/sha1 calcs. Spliting this perhaps with above to multiple threads would really help. - How to stream a single job to multiple tape drives. Couldn't figure this out so that only one tape drive is being used. - spooling to disk first then to tape is a killer. if multiple streams could happen at once this may mitigate this or some type of continous spooling. How do others do this? At this point I'm starting to look at Arkeia Netbackup both with provide multistreaming and tape drive pooling, but would rather stick or send my $$ to open source if I could opposed to closed systems. I'm at a point where I can't do a 20-30day full backup. And 'virtual fulls' are not an answer. There's no way I can tie up tape drives for the hundreds of tapes at 2.5 hours per tape assuming zero processing overhead. I have plenty of cpu on the system and plenty of disk subsystem speed, just can't seem to get at it through bacula. So what options are available or how are others backing up huge single servers? -- All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2d-c2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk.-- All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2d-c2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Client / laptop backups
Hi all We're using Bacula for some backups with three SDs so far, and I wonder if it's possible somehow to allow for client / laptop backups in a good manner. As far as I can see, this will need to either be client-initiated, client saying I'm alive! or something, or having a polling process running to check if the client's online for a given period of time. Is something like this possible or in the works, or is Bacula intended only for server backups? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2d-c2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Removing failed jobs from media/database?
Hi all As far as I can understand, if a job is interrupted or failed, the data stored on tape/disk won't be freed until the normal retention is over. Would it be possible to add a flag for 'failed' data for quicker (or immediate) retention? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Question about lost 'tapes'
Hi all Seems I've lost a couple of 'tapes', or files, that is. After a multiple drive failure, some files are listed as corrupt by ZFS: errors: Permanent errors have been detected in the following files: /dbpool/bacula/data/Incr-1466 /dbpool/bacula/data/Incr-0731 Now, this wasn't meant to happen, the drives are in small RAIDz2 VDEVs, so safety is very high, but apparently, it did because of a freak combination of a hot datacentre and a bad set of WD Black drives. Now - a few questions: - How can I find which backup jobs are affected by this? - Since we rarely do full backups, and stick to incrementals, how can I find which jobs must be re-run as full because of such a 'broke chain'? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula on windows?
Is it possible to run at least the bacula storage service on windows? My drives are on a windows machine so I need the backup data stored there. Ideally I would want the director and other components running there too if possible, but I could live with linux for the director if need be. The site and documentation seem to imply that it IS possible but the installer only shows the client as an install option. I would guess installing it under cygwin might work, but YMMW, I don't know any setups like that. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] OneFS = no doesn't work
Swap the two Options clauses -- the default options must be in the last clause (see the documentation). Thanks :) Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] OneFS = no doesn't work
Hi all Working on setting up Bacula backup of a fileserver, I can't make OneFS = no work. The server is running OpenIndiana and has a few terabytes of storage. The home directories under /tos-data/home/${username} are each a ZFS filesystem/dataset. The configuration below looks good to me, but Bacula still complains about /tos-data/home/znw is a different filesystem. Will not descend from /tos-data/home into it. How can I make it decend automatically? We have ~30 users on this site, and it'll be far more flexible to just backup the lot than backing up each and every one of them roy (see below for config) # Home directories FileSet { Name = verdande.nilu.no-home-fileset Include { Options { signature = MD5 OneFS = no FSType = zfs } Options { Exclude = yes WildFile = *.mp3 } File = /tos-data/home } } -- Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] OneFS = no doesn't work
- Original Message - Hi all Working on setting up Bacula backup of a fileserver, I can't make OneFS = no work. The server is running OpenIndiana and has a few terabytes of storage. The home directories under /tos-data/home/${username} are each a ZFS filesystem/dataset. The configuration below looks good to me, but Bacula still complains about /tos-data/home/znw is a different filesystem. Will not descend from /tos-data/home into it. How can I make it decend automatically? We have ~30 users on this site, and it'll be far more flexible to just backup the lot than backing up each and every one of them roy (see below for config) # Home directories FileSet { Name = verdande.nilu.no-home-fileset Include { Options { signature = MD5 OneFS = no FSType = zfs } Options { Exclude = yes WildFile = *.mp3 } File = /tos-data/home } } AFAICS, there's some code that might relate to this in src/findlib/find_one.c:639 if(!(ff_pkt-flags FO_MULTIFS)) { ff_pkt-type = FT_NOFSCHG; recurse = false; This flag is set in src/filed/job.c:1065 case 'f': fo-flags |= FO_MULTIFS; break; Any idea what FD option that might map to this? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] [SOLVED] OneFS = no doesn't work
# Home directories FileSet { Name = verdande.nilu.no-home-fileset Include { Options { signature = MD5 OneFS = no FSType = zfs } Options { Exclude = yes WildFile = *.mp3 } File = /tos-data/home } } FileSet { Name = verdande.nilu.no-home-fileset Include { Options { signature = MD5 OneFS = no FSType = zfs Exclude = yes WildFile = *.mp3 } File = /tos-data/home } } Changing this to one single Options {} block as pasted above fixed this. I guess this should be fixed in the code for Bacula to either refuse two option blocks, or parse it correctly. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] [SOLVED] OneFS = no doesn't work
It is possible that the documentation is not as detailed or explicit as it could be, but the two different FileSets you wrote are totally different, and the parser works perfectly fine otherwise it would have reported an error. What is more likely is that the way two different Options blocks are interpreted (or executed) is non-trivial and different from what you understand. First of all, to my own defence, this configuration was something I took over after being absent from work a few weeks after an accident. We had a consultant do the initial installation, and I thought it was ok. Secondly, after looking at the code, it looks like there is some built-in support for allowing multiple option blocks. A parameter 'pass' is passed to the functions, and the options struct is only initialised if the value of 'pass' is one. However - I don't see this variable being incremented, but then, I've only spent an hour or so looking into the code, and I sometimes find object-oriented C a bit hard to follow. Last, I would think the -t argument to bacula-dir should have reported this issue Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] OneFS = no doesn't work
The docs for fstype say The permitted filesystem-type names are: ext2, jfs, ntfs, proc, reiserfs, xfs, usbdevfs, sysfs, smbfs, iso9660. I don't see zfs in that list... maybe it has to be hardcoded into the source code? Nothing has been changed in the source, but it clearly works with ZFS. Is there anything under /tos-data/home that isn't zfs? Would it be easier to exclude those manually? Everything's ZFS Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Errors with bat from windows
Hi all We have some issues with bat not showing all backup targets with the version browser. For this particular server, the browser only lists C: and not the other drives backed up. I tested from X and that looks good. Testing from my Windows VM, bat fails to see any job after the initial 41 listed, no clients in that box, and clicking refresh returns an error: No jobs were selected in the job query!!!, whether I choose one or not. Version is 5.0.3. Any ideas? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bat crash report (was Errors with bat from windows)
Hello, I would have another question. Is there a way to generate crash reports from BAT ? It's crashing all the time anytime I try it. On Windows, I don't know. On unix systems, just allow for core dumps (ulimit -c unlimited). If bat is compiled with symbols/debug info, you should be able to produce a crash report with $ gdb bat core (gdb) bt Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup interrupted
We have a Bacula 5.0.3 setup consisting of the following: - One Director with a local PostgreSQL database. - Three Bacula Storage Daemons, two with 100TB storage each (PRV and DMZ), and one with 14TB storage (TOS). Each of them are on their own local networks (private HQ, DMZ HQ, and the Tromsø office). - Currently, 66 Bacula File Daemons, 25 on PRV, 36 on DMZ and 5 on TOS. The clients are on everything from Windows XP, Windows server 2003/2008/2008R2, different Linux distros etc. They are all setup with heartbeat interval = 60 and they all work. Except dev0, a Windows 2003 VM on the DMZ, that for some reason loses its connection to the SD while backing up. Sometimes it works and the backup finishes, mostly it gets interrupted. so - any ideas how I can debug this further? FWIW, it don't need to be a bacula issue. Think network, host to busy for the guest VM and even further out of the box I guess I'll leave it as it is - the VM was a physical machine (old PC) that was migrated to a VM some time back. Since it's the only machine showing these errors, I guess a reinstall might fix it - until then, let it bleed :P -- Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup interrupted
Op 20110428 om 12:53 schreef Roy Sigurd Karlsbakk: I have a problem with a Windows 2003 server where backup is interrupted quite often. I only see the problem on this machine (dev0), but the error looks more like an SD failure. This SD is in use for several other backups, which work well. Director, FD and SD are all running Bacula 5.0.3. Also, please note that heartbeat is enabled at all of them. Any ideas what this might be? What is ment with 'This SD is in use for several other backups'? We have a Bacula 5.0.3 setup consisting of the following: - One Director with a local PostgreSQL database. - Three Bacula Storage Daemons, two with 100TB storage each (PRV and DMZ), and one with 14TB storage (TOS). Each of them are on their own local networks (private HQ, DMZ HQ, and the Tromsø office). - Currently, 66 Bacula File Daemons, 25 on PRV, 36 on DMZ and 5 on TOS. The clients are on everything from Windows XP, Windows server 2003/2008/2008R2, different Linux distros etc. They are all setup with heartbeat interval = 60 and they all work. Except dev0, a Windows 2003 VM on the DMZ, that for some reason loses its connection to the SD while backing up. Sometimes it works and the backup finishes, mostly it gets interrupted. so - any ideas how I can debug this further? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup interrupted
I have a problem with a Windows 2003 server where backup is interrupted quite often. I only see the problem on this machine (dev0), but the error looks more like an SD failure. This SD is in use for several other backups, which work well. Director, FD and SD are all running Bacula 5.0.3. Also, please note that heartbeat is enabled at all of them. Any ideas what this might be? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] backup interrupted
Hi all I have a problem with a Windows 2003 server where backup is interrupted quite often. I only see the problem on this machine (dev0), but the error looks more like an SD failure. This SD is in use for several other backups, which work well. Director, FD and SD are all running Bacula 5.0.3. Any ideas? bacula.nilu.no-dir Start Backup JobId 3689, Job=dev0.nilu.no-system.2011-04-27_04.00.00_31 bacula.nilu.no-dir Using Device IncrDevice bacula.nilu.no-dir Sending Accurate information. dev0-fd Generate VSS snapshots. Driver=VSS Win 2003, Drive(s)=CD dev0-fd C:/WINDOWS/assembly/GAC_MSIL/IEExecRemote/2.0.0.0__b03f5f7f11d50a3a is a junction point or a different filesystem. Will not descend from C:/ into it. C:/WINDOWS/assembly/GAC_32/System.EnterpriseServices/2.0.0.0__b03f5f7f11d50a3a is a junction point or a different filesystem. Will not descend from C:/ into it. dev0-fd Error: /home/kern/bacula/k/bacula/src/lib/bsock.c:393 Write error sending 65536 bytes to Storage daemon:dmz-backup.nilu.no:9103: ERR=Input/output error Fatal error: /home/kern/bacula/k/bacula/src/filed/backup.c:1024 Network send error to SD. ERR=Input/output error dev0-fd Error: /home/kern/bacula/k/bacula/src/lib/bsock.c:339 Socket has errors=1 on call to Storage daemon:dmz-backup.nilu.no:9103 bacula.nilu.no-dir Error: Bacula bacula.nilu.no-dir 5.0.3 (04Aug10): 27-Apr-2011 05:18:20 Build OS: x86_64-pc-linux-gnu ubuntu 10.04 JobId: 3689 Job:dev0.nilu.no-system.2011-04-27_04.00.00_31 Backup Level: Incremental, since=2011-04-25 04:00:13 Client: dev0.nilu.no-fd 5.0.3 (04Aug10) Linux,Cross-compile,Win32 FileSet:dev0.nilu.no-fileset 2011-04-12 04:00:00 Pool: dmz-incr (From Job resource) Catalog:MyCatalog (From Client resource) Storage:dmz-incr.nilu.no-sd (From Pool resource) Scheduled time: 27-Apr-2011 04:00:00 Start time: 27-Apr-2011 04:00:07 End time: 27-Apr-2011 05:18:20 Elapsed time: 1 hour 18 mins 13 secs Priority: 10 FD Files Written: 92 SD Files Written: 0 FD Bytes Written: 15,902,654 (15.90 MB) SD Bytes Written: 0 (0 B) Rate: 3.4 KB/s Software Compression: None VSS:yes Encryption: no Accurate: yes Volume name(s): Incr-1532 Volume Session Id: 413 Volume Session Time:1302957540 Last Volume Bytes: 53,687,090,535 (53.68 GB) Non-fatal FD errors:2 SD Errors: 0 FD termination status: Error SD termination status: Error Termination:*** Backup Error *** dev0-fd VSS Writer (BackupComplete): System Writer, State: 0x1 (VSS_WS_STABLE) VSS Writer (BackupComplete): COM+ REGDB Writer, State: 0x1 (VSS_WS_STABLE) VSS Writer (BackupComplete): Registry Writer, State: 0x1 (VSS_WS_STABLE) VSS Writer (BackupComplete): Event Log Writer, State: 0x1 (VSS_WS_STABLE) VSS Writer (BackupComplete): MSDEWriter, State: 0x1 (VSS_WS_STABLE) VSS Writer (BackupComplete): IIS Metabase Writer, State: 0x1 (VSS_WS_STABLE) VSS Writer (BackupComplete): BITS Writer, State: 0x1 (VSS_WS_STABLE) VSS Writer (BackupComplete): WMI Writer, State: 0x1 (VSS_WS_STABLE) -- Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Backing up ZFS with ACLs?
Hi all How is Bacula suited to backing off ZFS with its ACLs? We're using ZFS for Windows and unix storage, and the Windows ACLs (that is, ZFS ACLs) can be rather diverse. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Xperia(TM) PLAY It's a major breakthrough. An authentic gaming smartphone on the nation's most reliable network. And it wants your games. http://p.sf.net/sfu/verizon-sfdev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Director dies if SD crashes
Hi all I have a bacula setup now that seems to work well after some initial problems. Now, running 5.0.1 from Ubuntu Lucid (10.04), the director dies if an FD dies during backup. Does anyone know if this is a known problem? I would like to stick to Ubuntu packages if I can't avoid it... Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE: Pinpoint memory and threading errors before they happen. Find and fix more than 250 security defects in the development cycle. Locate bottlenecks in serial and parallel code that limit performance. http://p.sf.net/sfu/intel-dev2devfeb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Director dies if FD crashes (was SD....)
I have a bacula setup now that seems to work well after some initial problems. Now, running 5.0.1 from Ubuntu Lucid (10.04), the director dies if an FD dies during backup. Does anyone know if this is a known problem? I would like to stick to Ubuntu packages if I can't avoid it... The subject says SD. The content says FD. However, according to what I saw on IRC, Roy meant FD in both cases. Correct - sorry about this - if the FD dies during backup, the director dies. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE: Pinpoint memory and threading errors before they happen. Find and fix more than 250 security defects in the development cycle. Locate bottlenecks in serial and parallel code that limit performance. http://p.sf.net/sfu/intel-dev2devfeb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] AutoLabel problems
Hi all I have a bacula setup consisting of three servers, a Director and two SDs running OpenIndiana (an OpenSolaris fork()). The hardware and software configuration is identical on these servers. On the SD for the private net, prv-backup, no problems occur, but on dmz-backup, the SD somewhat works, but after a couple of days, it fails to label media somehow and goes into this state: Device status: Device FileStorage (/dbpool/bacula/data) is not open. Device is BLOCKED waiting to create a volume for: Pool:dmz-incr Media type: dmz-file CONFIGURATION From bacula-sd.conf - the Device settings are identical for prv-backup and dmz-backup except Media Type, which is set to another name (prv-file). Device { Name = FileStorage Media Type = dmz-file Archive Device = /dbpool/bacula/data LabelMedia = yes; # lets Bacula label unlabeled media Random Access = Yes; AutomaticMount = yes; # when device opened, read it RemovableMedia = no; AlwaysOpen = no; } Since dmz-backup is on the DMZ, all parts of bacula uses heartbeat interval = 600. Anyway - lack of heartbeat shouldn't (imho) hang the SD like this - should it? So - does anyone know how I can remedy this? PS: I can't find any bacula logs on the SD (on OpenIndiana). I have tried to recompile with --with-logdir=/opt/bacula/var/log and created that directory. Since bacula-sd currently runs as root (I know, don't say it), the permissions should be sufficient, but I no log file gets created - what I am I doing wrong? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] AutoLabel problems
CONFIGURATION From bacula-sd.conf - the Device settings are identical for prv-backup and dmz-backup except Media Type, which is set to another name (prv-file). Device { Name = FileStorage Media Type = dmz-file Archive Device = /dbpool/bacula/data LabelMedia = yes; # lets Bacula label unlabeled media Random Access = Yes; AutomaticMount = yes; # when device opened, read it RemovableMedia = no; AlwaysOpen = no; } Since dmz-backup is on the DMZ, all parts of bacula uses heartbeat interval = 600. Anyway - lack of heartbeat shouldn't (imho) hang the SD like this - should it? So - does anyone know how I can remedy this? PS: I can't find any bacula logs on the SD (on OpenIndiana). I have tried to recompile with --with-logdir=/opt/bacula/var/log and created that directory. Since bacula-sd currently runs as root (I know, don't say it), the permissions should be sufficient, but I no log file gets created - what I am I doing wrong? Did you define a label format in the dmz-incr pool. # Incidentially, dmz-incr and prv-incr uses the same Label Format - I didn't install this, though, is this ok? Pool { Name = dmz-incr Storage = dmz-backup.nilu.no-sd Pool Type = Backup Recycle = yes # Bacula can automatically recycle Volumes AutoPrune = yes # Prune expired volumes Volume Retention = 380 days # one year Maximum Volume Bytes = 50G # Limit Volume size to something reasonable Action On Purge = Truncate Volume Use Duration = 23h# Bare bruk et volum i opptil 23t Label Format = Incr- } Pool { Name = prv-incr Storage = prv-backup.nilu.no-sd Pool Type = Backup Recycle = yes # Bacula can automatically recycle Volumes AutoPrune = yes # Prune expired volumes Volume Retention = 380 days # one year Maximum Volume Bytes = 50G # Limit Volume size to something reasonable Action On Purge = Truncate Volume Use Duration = 23h# Bare bruk et volum i opptil 23t Label Format = Incr- } Are you limiting volumes in this pool? Not that I can see. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] AutoLabel problems
PS: I can't find any bacula logs on the SD (on OpenIndiana). I have tried to recompile with --with-logdir=/opt/bacula/var/log and created that directory. Since bacula-sd currently runs as root (I know, don't say it), the permissions should be sufficient, but I no log file gets created - what I am I doing wrong? Bacula will throw away logs from bacula-sd. you need to run bacula-sd by hand, with a debug level. try something like .../bacula-sd -d200 /opt/bacula/var/log/bacula-sd.log 21 it will fork off and run in the background. add any other options which bacula-sd is currently running with to the command if needed. # Incidentially, dmz-incr and prv-incr uses the same Label Format - I didn't install this, though, is this ok? I think it should be OK, since the number appended to the Label Format is a serial number (the media id) which is monotonically increasing regardless of pool (since Bacula 3.0 IIRC). IOW, there should not be a naming clash even if the a label format is used in multiple places. Thanks a bunch - I've enabled debugging as you wrote above, so we'll probably see something when or if this error occurs again. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] AutoLabel problems
Bacula needs two things for automatic label formatting to occur: * the pool in bacula-dir.conf needs to have a label format (LabelFormat) * the device in bacula-sd.conf needs to allow labelling (LabelMedia) The documentation for LabelFormat needs to have a referencee to LabelMedia added to it. http://www.bacula.org/5.0.x-manuals/en/main/main/Configuring_Director.html#SECTION001815 Similarly. the documentation for Device needs to refer to LabelMedia. http://www.bacula.org/5.0.x-manuals/en/main/main/Storage_Daemon_Configuratio.html#SECTION00203 This all how it works, as I said, the oiiks are set to specific backups, but somehow the SD dies and tries to find a new non-labelled device, even if it is set to label those. I may get some more debug info about that soon. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Waiting on Max Client Jobs
There are 5 or more places to use Maximum Concurrent Jobs depending on the level of concurrency you want. I believe the default in the bacula-fd.conf is already 20 so this place is not really doing much. You need to set it in the bacula-dir.conf in the director and client resources. Also keep in mind that every storage device can only load 1 volume at a time so if you are using disk volumes with multiple pools and only 1 storage do not expect jobs that go to different pools to run concurrently. I don't get it. With the following storage config, will this still only allow for one concurrent job to this machine? Storage { Name = dmz-backup.nilu.no-sd SDPort = 9103 WorkingDirectory = /opt/bacula/var/bacula/working Pid Directory = /var/run Maximum Concurrent Jobs = 20 Heartbeat Interval = 10min } Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Gaining the trust of online customers is vital for the success of any company that requires sensitive data to be transmitted over the Web. Learn how to best implement a security strategy that keeps consumers' information secure and instills the confidence they need to proceed with transactions. http://p.sf.net/sfu/oracle-sfdevnl ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Waiting on Max Client Jobs
Do you also have Maximum Concurrent Jobs set in the Director resource of bacula-dir.conf ? yes, it's set to 20. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Gaining the trust of online customers is vital for the success of any company that requires sensitive data to be transmitted over the Web. Learn how to best implement a security strategy that keeps consumers' information secure and instills the confidence they need to proceed with transactions. http://p.sf.net/sfu/oracle-sfdevnl ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Waiting on Max Client Jobs
- Original Message - Do you also have Maximum Concurrent Jobs set in the Director resource of bacula-dir.conf ? yes, it's set to 20. And do your jobs that you want to run concurrently all go to the same pool and are the same priority? Yes and yes. The storage server is hooked up on 10Gbps and has sufficient I/O speed to sustain that load. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Gaining the trust of online customers is vital for the success of any company that requires sensitive data to be transmitted over the Web. Learn how to best implement a security strategy that keeps consumers' information secure and instills the confidence they need to proceed with transactions. http://p.sf.net/sfu/oracle-sfdevnl ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: Extremly slow backup
Both full and differential backup run with same speed. Going through filesystem shouldn't affect backup speed. Rsync (which I used for testing) is doing pretty much same job - compares checksum of each and every file and transfers it if its different. Its 50 times faster than Bacula doing same job (50 MB/s against 1 MB/s). Unless Bacula is doing something more than simply comparing md5 checksums it should run at comparable speed or I'm missing something... Out of interest, which filesystem are you using on this volume? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Gaining the trust of online customers is vital for the success of any company that requires sensitive data to be transmitted over the Web. Learn how to best implement a security strategy that keeps consumers' information secure and instills the confidence they need to proceed with transactions. http://p.sf.net/sfu/oracle-sfdevnl ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] ZFS and Bacula
Hi all I'm planning a Bacula setup with ZFS on the SDs (media being disk, not tape), and I just wonder - should I use a smaller recordsize (aka largest block size) than the default setting of 128kB? Also, last I tried, with ZFS on a test box, I enabled compression, the lzjb algorithm (very lightwegith and quite decent compression). For 'normal' data, I usually get 30%+ compression with this, but for the data backed up with bacula, it didn't look that good, compression being down to 3-5%. Any idea what might cause this? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] ZFS and Bacula
If the data coming from bacula are already compressed by the bacula-fd there's little space for improvement. In your type of setup, I would disable compression on bacula-fd increasing the speed of backup, your sd doing it by zfs mechanism. thing is, I can't find anything about compression being enabled... perhaps the test set I ran first contains somehow hard-compressable data... Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Building only FD+SD?
Hi all I'm working on a Bacula setup, and I have a few questions. My plan is to setup one pretty well spec'ed up dedicated director (bunch of RAM, mirrored drives and mirrored SSDs for the indices on PostgreSQL). This will be placed on a central private network. Servers that are to be backuped up, running Linux, Solaris and Windows, are spread over three different networks, the local private one, one DMZ, and a remote private network. I plan to deploy one SD per network with 120TB boxes for the first two and a smaller 10TB box for the third one. The storage units will be setup using NexentaCore with ZFS, drives distributed in somehow smallish VDEVs to allow for multiple drive failure etc. Now, I understand only the director needs access to the database, the FDs will be contacted by the director, and the SDs will be contacted by the respective FDs. On some Linux distros, the SD or FD comes as separate pre-built packages, but on some of the other platforms, these need to be built from source. How can I build only the FD+SD? --enable-client-only seems to only build the FD, which isn't suitable for the SDs, and on the SDs I don't necessarily have database drivers installed. I tried --enable-build-dird=no, but it still complains about the lack of database drivers. thanks Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Building only FD+SD?
Now, I understand only the director needs access to the database, the FDs will be contacted by the director, and the SDs will be contacted by the respective FDs. On some Linux distros, the SD or FD comes as separate pre-built packages, but on some of the other platforms, these need to be built from source. How can I build only the FD+SD? --enable-client-only seems to only build the FD, which isn't suitable for the SDs, and on the SDs I don't necessarily have database drivers installed. I tried --enable-build-dird=no, but it still complains about the lack of database drivers. Roy, --enable-build-dird=no is the correct option to build FD plus SD. For safety, you can explicitly specify --enable-build-stored. The issue you're running into is that you still need database drivers to build the SD, because some of the tools that are built with the SD (notably bscan) may need to connect to the Catalog. One way you can work around this in a situation such as yours is to build all the daemons on a machine of the correct architecture and OS that has the database drivers, then install all the SD machines from that build. Sure, tools like bscan that are linked against database client libraries won't run; but if you're not going to try to use them anyway, you don't really care about that. Thanks for the quick answer! Another question, then. Will tools like bscan need to run locally on the SD with access to the database to be useful? If so, what would be a preferred setup for the environment described? I will be able to reach the database (on the director machine) from one of the networks, but from the DMZ, it might be a hassle involving ssh tunnels and the likes. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Deduplicating Bacula backups?
Hi all We're planning a Bacula setup soon with disk as the backup medium. The disk space will be hosted by OpenSolaris/OpenIndiana on ZFS. Since ZFS supports block-level deduplicaiton, at least theoretically (there are a few bugs aorund, but they are rumored to be fixed - I'll do some testing before jumping into it). I have heard some backup software (for instance BackupExec) makes backups hard to dedup because it doesn't care about how data is stored. Other backup software try to align data so that they are more easily deduplicated. Now, does Bacula care about possible deduplication on the media side when storing the data? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Deduplicating Bacula backups?
We're planning a Bacula setup soon with disk as the backup medium. The disk space will be hosted by OpenSolaris/OpenIndiana on ZFS. Since ZFS supports block-level deduplicaiton, at least theoretically (there are a few bugs aorund, but they are rumored to be fixed - I'll do some testing before jumping into it). I have heard some backup software (for instance BackupExec) makes backups hard to dedup because it doesn't care about how data is stored. Other backup software try to align data so that they are more easily deduplicated. Now, does Bacula care about possible deduplication on the media side when storing the data? I would say no. You can also mirror the volume files, rsync them to a second server ... and then use the duplicated ones in the future provided the catalog matches the volumes. If it does not you can use bscan to fix that.. With ZFS rsync won't really be a good deal, when zfs send/receive does the job a wee bit better. Still, has anyone in here tried to use storage with dedup capabilities for their disk backups? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] resetting the database?
hi all I've setup a test box with bacula and have done a backup or two. after that, I recreated the storage and installed the SD on the storage server directly so I won't have to use NFS for that part. Now the database contains info about former backups no longer existing. How can I reset the info in the database (or locally on the director)? Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users