[Bacula-users] backup on the schedule specific clients but not all clients
hey guys, was wandering if that is possible. did some readings on schedule/job/jobdefs resources, but still not sure if this is possible. however there may be a better way to do this, so i am open to suggestions. basically we have 35 clients to backup. schedule as follows: - weekly on sunday - full backup and these tapes go off site (this is in rotation) - daily we run incremental problem at hand, if user want to restore something from last week, i need the tapes that went off site back, so i can restore data. workaround at this time - weekly on sunday - full backup and these tapes go off site (this is in rotation) - weekly on monday - full backup and these tapes stay - daily we run incremental however given that amount of full data backup is over 3 tb, it is getting pain and long to run a full backup twice. thus, i was hoping that i can do a full backup weekly (these tapes go off site) and one full backup once every 3 months or so and then run incremental daily. this way i can restore data without requesting tapes back from off site vendor. Why i started with specific client to back up on a schedule is that i could define client1, client2, client3 and also client1-b, client2-b, client3-b (essentially these 1 and 1b, 2 and 2b are the same clients, but they treated as different in the database during the backup, so i can do 1,2,3 weekly and 1b,2b.3b monthly with incrementals based off the full 1b,2b,3b and not 1,2,3. incrementals are based on last full backup. thus i need some set of full backup in house and incremental that i can use to restore data. am i twisting this in a wrong way ?? is there a better way to do this? thanks -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] can't restore after upgrade
On 01/29/2010 08:12 AM, John Drescher wrote: so i did read about these volume utilities and did use half of them during my experience with bacula, however: - using bscan into catalog (accoriding to doc's) scanned for a while, said database updated, however running restore complain again about records are being pruned (note my volumes are all set/marked as used the ones i am trying to access) Being marked as used should have nothing at all to do with the ability to restore data. Unless the volumes are getting pruned automatically. dbcheck seem to do lot's of clean up rather finding something that may have been corrupt (which i think happen during upgrade) after all i did restore with regexp, but still would be cool to find a solution as to where are the records from db. (i could and may, will do a clean 5.0 install or something and rescan all tapes back if there are no work around in this area) So you are using 5.0.0. There were several bugs found since its release. One weird one is on first run bacula says its pruning volumes that are around 40 years old. are there any more info i can provide to help this troubleshoot ? Please post the messages you get when you try to restore any of this data. Along with any log info that says it is pruning. Like you mentioned in the section about using bscan. John let me rephrase all this isn't my problem that job retention set to short after all? thus volumes are in tact and not purged but any restore beyond 6 months (which fall in on the month we upgraded, plain coincident) need a jobid info and file records which has been pruned ? i am correct? kiryl -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] can't restore after upgrade
Hey guys, so a few months back we upgraded bacula from 2.2.8 to 3.0.2 upgraded everything (binaries, mysql, etc) and i guess we missed some tests. however, now we can't restore anything that was backed up prior to upgrade. basically all volumes are not pruned/purged, yet some dates do not show at all at restore operation, and those that shows up says no records found in database. note: everything that backed up since the upgrade, does seem to work fine. any way to repare/resync some items in database? thanks for your help -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] can't restore after upgrade
On 01/28/2010 01:31 PM, John Drescher wrote: On Thu, Jan 28, 2010 at 1:29 PM, John Drescherdresche...@gmail.com wrote: On Thu, Jan 28, 2010 at 12:53 PM, Kiryl Hakhovich khakhov...@bsolution.net wrote: Hey guys, so a few months back we upgraded bacula from 2.2.8 to 3.0.2 upgraded everything (binaries, mysql, etc) and i guess we missed some tests. however, now we can't restore anything that was backed up prior to upgrade. basically all volumes are not pruned/purged, yet some dates do not show at all at restore operation, and those that shows up says no records found in database. note: everything that backed up since the upgrade, does seem to work fine. any way to repare/resync some items in database? Yes. Bacula should be able to restore anything you have backed up regardless if it is in the catalog or the catalog was lost. The volume utility tools (read the manual) are the key. And yes there are ways of repairing the database if that is the problem. dbcheck again in the manual. John so i did read about these volume utilities and did use half of them during my experience with bacula, however: - using bscan into catalog (accoriding to doc's) scanned for a while, said database updated, however running restore complain again about records are being pruned (note my volumes are all set/marked as used the ones i am trying to access) dbcheck seem to do lot's of clean up rather finding something that may have been corrupt (which i think happen during upgrade) after all i did restore with regexp, but still would be cool to find a solution as to where are the records from db. (i could and may, will do a clean 5.0 install or something and rescan all tapes back if there are no work around in this area) are there any more info i can provide to help this troubleshoot ? kiryl -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] 2 issues that driving me nuts
Bob thanks for your input... On 10/05/2009 01:26 PM, Bob Hetzel wrote: hey fellas, have been using bacula for over 4 years now, great neat powerful! i come across two issues with bacula, that i think can be taken care of on bacula level, which are not implemented yet (or i am not aware of them): 1. using a tape library, sometimes issue arise when bacula have loaded a tape from the slot, then, some idiot (generally help desk people) put a new tape into the same slot, where tape that in the drive used to be. This causing a problem, as bacula insisting on unloading the tape into the slot where it took it. Since it is already full, it fails and all jobs fail as a result. There should be a way for bacula to check if slot is taken, get the next available slot to unload tape. I don't know for sure what happened with your instance, but in my instance I never open the main door and only use the I/O slots. In that case the bug is not really in bacula but in the autochanger. The best solution is a procedural one--just 'release' each drive before using your autochanger's import function. the problem in my environment is, full backup set is about 3-4 tapes, for a tech to use gui and mailslot will take like 20 min to pick tape, move to mail slot, take it out. i guess i can use an unload function right after the backup of catalog... that would take care of it. 2. having over 6 pools with 20-30dlt tapes, sometimes issue arise (there is no way to keep up with proper schedule as delivery people always fail): there are tapes (volumes) with status append in the pool available and they are in the tape library, however bacula seem to purge tape that has expiration date in the past, and insist on using that tape first, if that tape not in the library, bacula will wait for the tape it wants. I think bacula should look at the AL tapes that available in pool for current job, and if it is not in the library at the moment, move to the next available tape. does any one else ran into similar situation with large bacula implementation ? Thanks to all Kiryl I believe I had this issue a long time ago. If I remember correctly, it is because bacula ignores the 'InChanger' field unless you tell it you're using a changer in both the bacula-dir.conf and bacula-sd.conf files. So for me, the appropriate section of my bacula-dir.conf file is... Storage { Name = Dell-PV136T Autochanger = yes Address = gyrus SDPort = 9103 Device = Dell-PV136T Media Type = LTO-2 Password = snip-password-here Maximum Concurrent Jobs = 12 } Note the Autochanger = yes line above. i do have the autochanger set to yes, but that does not solve for me. Bob -- Come build with us! The BlackBerryreg; Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9#45;12, 2009. Register now#33; http://p.sf.net/sfu/devconf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] 2 issues that driving me nuts
On 10/05/2009 01:31 PM, Kiryl Hakhovich wrote: Bob thanks for your input... On 10/05/2009 01:26 PM, Bob Hetzel wrote: hey fellas, have been using bacula for over 4 years now, great neat powerful! i come across two issues with bacula, that i think can be taken care of on bacula level, which are not implemented yet (or i am not aware of them): 1. using a tape library, sometimes issue arise when bacula have loaded a tape from the slot, then, some idiot (generally help desk people) put a new tape into the same slot, where tape that in the drive used to be. This causing a problem, as bacula insisting on unloading the tape into the slot where it took it. Since it is already full, it fails and all jobs fail as a result. There should be a way for bacula to check if slot is taken, get the next available slot to unload tape. I don't know for sure what happened with your instance, but in my instance I never open the main door and only use the I/O slots. In that case the bug is not really in bacula but in the autochanger. The best solution is a procedural one--just 'release' each drive before using your autochanger's import function. the problem in my environment is, full backup set is about 3-4 tapes, for a tech to use gui and mailslot will take like 20 min to pick tape, move to mail slot, take it out. i guess i can use an unload function right after the backup of catalog... that would take care of it. 2. having over 6 pools with 20-30dlt tapes, sometimes issue arise (there is no way to keep up with proper schedule as delivery people always fail): there are tapes (volumes) with status append in the pool available and they are in the tape library, however bacula seem to purge tape that has expiration date in the past, and insist on using that tape first, if that tape not in the library, bacula will wait for the tape it wants. I think bacula should look at the AL tapes that available in pool for current job, and if it is not in the library at the moment, move to the next available tape. does any one else ran into similar situation with large bacula implementation ? Thanks to all Kiryl I believe I had this issue a long time ago. If I remember correctly, it is because bacula ignores the 'InChanger' field unless you tell it you're using a changer in both the bacula-dir.conf and bacula-sd.conf files. So for me, the appropriate section of my bacula-dir.conf file is... Storage { Name = Dell-PV136T Autochanger = yes Address = gyrus SDPort = 9103 Device = Dell-PV136T Media Type = LTO-2 Password = snip-password-here Maximum Concurrent Jobs = 12 } Note the Autochanger = yes line above. i do have the autochanger set to yes, but that does not solve for me. now that i think about it more... i think if i add update slots before the job... that may help this issue :) Bob -- Come build with us! The BlackBerryreg; Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9#45;12, 2009. Register now#33; http://p.sf.net/sfu/devconf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Come build with us! The BlackBerryreg; Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9#45;12, 2009. Register now#33; http://p.sf.net/sfu/devconf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] max volume jobs
Hey Fellas, i have a question that i was unable to find answer in documentation, however if i missed it please direct to the right place to read on. Basically i have the following: Pool { Name = 15_Day Pool Type = Backup Recycle = yes AutoPrune = yes Volume Retention = 29 days Maximum Volume Jobs = 8 Maximum Volumes = 1 } Now when it comes time when i need to change Max Vol Jobs from 8 to let's say 10. What is the best way to do this? Seems like when i change the number the entire backup schema breaks, bacula complain about the volumes and etc. Should i do more than just changing the Max Vol number? should i reinitialize the volumes? Thanks. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users