[Bacula-users] volume recycling problem
I'm having a problem with over-writing recycled volumes. I have my jobs setup so that I retain file information for 90 days and job retention for 6 months: File Retention = 90 days# 90 days Job Retention = 6 months# six months And my catalog has: Volume REtention = 6 months I have my tapes labelled sequentially and I overwrite them - no earlier than 6 months. However sometimes it will decide to skip a tape - I don't know why. I have purged the volume when putting it into my autoloader, so it should be considered available. The most recent time this happened, I noticed that it shows the tape as being written less than 6 months ago. That apparently happened when I did a restore from that tape - and for some reason bacula decided it had written to the tape. I'm pretty sure that when I did the restore, I set the tape read-only out of paranoia I'd forget the tape in the drive and it would've been over written. I believe I did unset the read-only switch on the tape and I did purge the volume: +-++---+-+--+--+--+-+--+---+---+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-++---+-+--+--+--+-+--+---+---+-+ +-++---+-+--+--+--+-+--+---+---+-+ | 85 | Keck-084 | Full | 1 | 590132745216 | 720 | 15552000 | 1 | 1| 1 | LTO-3 | 2009-04-11 17:48:50 | | 86 | Keck-085 | Full | 1 | 583355114496 | 585 | 15552000 | 1 | 2| 1 | LTO-3 | 2009-04-12 00:04:31 | | 87 | Keck-086 | Purged| 1 | 579806631936 | 583 | 15552000 | 1 | 3| 1 | LTO-3 | 2009-01-14 13:08:05 | | 88 | Keck-087 | Full | 1 | 573925976064 | 596 | 15552000 | 1 | 4| 1 | LTO-3 | 2009-04-13 20:53:37 | | 89 | Keck-088 | Append| 1 | 106350418944 | 151 | 15552000 | 1 | 5| 1 | LTO-3 | 2009-04-15 02:40:12 | So you can see it skipped tape Keck-086. How can I make it use this tape? Thanks for any help. -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] restore can't create directory - permission denied
My apologies if this has a simple solution, but I couldn't find anything with a (quick) search: I've been running bacula 1.38.x for quite awhile and it's been very nice, except for the massive amount of time the database attr spooling takes - mine is huge due to the tremendous number of files my users create with their data. My 1.38 setup was packaged and built against sqlite (2.8?) and I decided to upgrade bacula and switch to sqlite3. So I built bacula-2.2.4 enabling sqlite3, used the upgrade sqlite script to go from 9 to 10, dumped the sqlite database, imported that into sqlite3 and setup to run the new bacula. The database seems OK and so I went to test by doing a restore. Well, the restore seems to have located the file on the tape, but couldn't write into the scratch area I setup to dump it into. My packaged 1.38 bacula setup was configured to run as user bacula, group bacula and so I ran my new daemons also as user bacula, group bacula. I haven't had any restore issues with the 1.38 setup, generally I restore into scratch areas and all ownership, permissions have come back OK. I'm running on linux - is there something I've missed building/configuring my new 2.2.4 bacula daemons ? The daemons aren't and weren't suid. The messages were: 12-Oct 11:43 localhost-dir: Start Restore Job RestoreFiles.2007-10-12_11.43.51 12-Oct 11:43 localhost-dir: Using Device Kecktape 12-Oct 11:43 localhost-sd: 3301 Issuing autochanger loaded? drive 0 command. 12-Oct 11:43 localhost-sd: 3302 Autochanger loaded? drive 0, result: nothing loaded. 12-Oct 11:43 localhost-sd: 3304 Issuing autochanger load slot 3, drive 0 command. 12-Oct 11:44 localhost-sd: 3305 Autochanger load slot 3, drive 0, status is OK. 12-Oct 11:44 localhost-sd: 3301 Issuing autochanger loaded? drive 0 command. 12-Oct 11:44 localhost-sd: 3302 Autochanger loaded? drive 0, result is Slot 3. 12-Oct 11:44 localhost-sd: Ready to read from volume Keck-033 on device Kecktape (/dev/nst0). 12-Oct 11:44 localhost-sd: Forward spacing Volume Keck-033 to file:block 410:0. 12-Oct 11:45 localhost-fd: RestoreFiles.2007-10-12_11.43.51 Error: Cannot create directory /webdav/tmp/var: ERR=Permission denied 12-Oct 11:45 localhost-sd: End of Volume at file 410 on device Kecktape (/dev/nst0), Volume Keck-033 12-Oct 11:45 localhost-sd: End of all volumes. 12-Oct 11:45 localhost-dir: RestoreFiles.2007-10-12_11.43.51 Error: Bacula localhost-dir 2.2.4 (14Sep07): 12-Oct-2007 11:45:02 Build OS: x86_64-unknown-linux-gnu mandrake (Official) JobId: 1977 Job:RestoreFiles.2007-10-12_11.43.51 Restore Client: localhost-fd Thanks for any help, Dirk - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] restore can't create directory - permission denied
On Fri, 12 Oct 2007, Arno Lehmann wrote: Doh ! I knew it was simple ! I looked at the original package startup scripts and they don't start the file daemon as user bacula. So my single file restore seems to have worked just fine when the file daemon runs as root. I agree that sqlite is probably not the best for large databases, but a) it is what the original packages were built for (one argument against pre-packaged software - cf FreeBSD's ports system) and b) I've seen MySQL database hosed by a server crash. That said, I've been pretty conservative with my bacula sqlite database, dumping it to ascii input every week. Thanks again very much for your help. Dirk Hi, 12.10.2007 22:03,, Dirk Kleinhesselink wrote:: My apologies if this has a simple solution, but I couldn't find anything with a (quick) search: I've been running bacula 1.38.x for quite awhile and it's been very nice, except for the massive amount of time the database attr spooling takes - mine is huge due to the tremendous number of files my users create with their data. My 1.38 setup was packaged and built against sqlite (2.8?) and I decided to upgrade bacula and switch to sqlite3. So I built bacula-2.2.4 enabling sqlite3, used the upgrade sqlite script to go from 9 to 10, dumped the sqlite database, imported that into sqlite3 and setup to run the new bacula. If you see performance problems, SQlite is probably not the best catalog backend for you. MySQL and PostgreSQL deliver a better performance, I believe. The database seems OK and so I went to test by doing a restore. Well, the restore seems to have located the file on the tape, but couldn't write into the scratch area I setup to dump it into. My packaged 1.38 bacula setup was configured to run as user bacula, group bacula and so I ran my new daemons also as user bacula, group bacula. I haven't had any restore issues with the 1.38 setup, generally I restore into scratch areas and all ownership, permissions have come back OK. I'm running on linux - is there something I've missed building/configuring my new 2.2.4 bacula daemons ? The daemons aren't and weren't suid. The FD should run as user root as it typically needs to be able to access all files on your system. Otherwise, you'll find you have to set up permissions in a way that I can only describe as a nightmare. As a quick work-around, you might consider changing the permissions of your scratch restore area to allow the FD write access. Arno - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula client (1.38.10) won't run on XP
On Thu, 29 Mar 2007, Ryan Novosielski wrote:
Ok, here's the configuration file -- although shouldn't the debug test
produce output one way or another ?
My server is running 1.38.x so I thought I should stay consistent.
C:\bacula\bin\bacula-fd.conf
#
# Default Bacula File Daemon Configuration file
#
# For Bacula release 1.38.10 (08 June 2006) -- cygwin 1.5.18(0.132/4/2)
#
# There is not much to change here except perhaps the
# File daemon Name to
#
#
# List Directors who are permitted to contact this File daemon
#
Director {
Name = localhost-dir
Address = 128.218.64.241
Password = x
}
#
# Global File daemon configuration specifications
#
FileDaemon { # this is me
Name = lark-fd
FDport = 9102 # where we listen for the director
WorkingDirectory = /bacula/working
Pid Directory = /bacula/working
}
# Send all messages except skipped files back to Director
Messages {
Name = Standard
Address = 128.218.64.241
Password = x
director = localhost-dir = all, !skipped
}
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
Dan Langille wrote:
On 29 Mar 2007 at 13:40, Dirk Kleinhesselink wrote:
I've installed the windows bacula client on a windows XP system I want to
back up. It's installed in C:\bacula\bin and the configuration file
is there, but the service fails to start. Per the user's guide section
on windows clients, I've tried to run the command with debugging from
a console window: bacula-fd -d100 -c c:\bacula\bin\bacula-fd.conf
but this produces no output - the prompt simply returns. I've checked
the task manager process list and there isn't a running bacula process.
Show us your config file.
Also, consider Bacula has made great strides, particularly on Windows,
in 2.0.x.
- --
_ _ _ _ ___ _ _ _
|Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III
|$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922)
\__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.3 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iD8DBQFGDCjzmb+gadEcsb4RArSVAJ41mfQ5W5/I8DSPVlKhM1WmC3szoQCgs520
PnYOgK76XmmQRcY1M26g+do=
=Klp1
-END PGP SIGNATURE-
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] can I have multiple catalogs ?
I have a large fileserver with 2 tape libraries and I have each library handling a different set of filesystems. Can I have 2 catalogs, one for each library and the jobs it backs up, even though they are on the same system ? Thanks, Dirk - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] very slow backup (database update ?)
I've been running bacula 1.38 on my linux fileserver with 2 exabyte magnum LTO-3 libraries for several months and I recently had problems with a couple of full backups failing due to lost communication with the FD daemon. I was writing directly to the tape drive and decided to try data spooling to improve data transfer to the LTO-3 drive and setup a 250GB disk area for the spool. Last night I ran a full backup of a 350GB disk area and it started around 2AM and was still running this morning. I could see that it had done one 250GB chunk and was on the remaining 100GB chunk, which finished dumping to the disk spool area in more or less reasonable time and then seemed to be spooled to the tape device - in perhaps not as ideal a time, but nonetheless finished and then no more data is being sent to the tape drive, the intermediate spool file has been deleted, but the job still isn't finished. Status says it is still running and the SD status says it is: Attr spooling: 1 active jobs, 2,153,030,897 bytes, 3 total jobs, 2,188,188,495 max bytes. I got curious and wondered if it was related to the database, so I checked its status and I can see the time being updated on the bacula sqlite database file. The first byte counter in the SD status Attr line is decreasing, but very, very slowly. Does anyone know what the job is now doing (updating the database, presumably) ? And why should it be taking so long ? Some more information - prior to the full backup, I had a running job that was an incremental that had been promoted to a full of about 27GB. This job also did the data spool to disk and then spool to tape in reasonable time but then took more than 4 hours to complete the Attr spooling part. Thanks for any assistance, Dirk - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] End of Back-up Problems
On Wed, 16 Aug 2006, Kern Sibbald wrote: For what it's worth, I found that if I unloaded and re-loaded the SCSI controller, tape (st) and generic (sg) drivers on my system (linux, mandriva 2006) that would fix occasional problems with my tape and autoloader. My SCSI controller only has the tape/autoloader on it -- no disks. Dirk On Wednesday 16 August 2006 16:39, Rupert Finnigan wrote: Hello, I wander if anyone could help - I've got a problem with Bacula. We've been using Bacula for about three months or so now, with varying degrees of success. Recently, I've simplified our configuration and have been having no problems at all with our backups, until now. Bacula runs successfully, recognizes that a valid tape from the correct pool is available in the Autoloader, loads the tape, runs the scripts, does the backup, but then won't release the Drive. It appears that the drive locks up, and when I stop the bacula-sd daemon I can't control the drive (Linux tells me that it's not found in /etc/fstab or /etc/mtab. So, I basically have to re-boot the server to get SCSI to realize it's there again. This is annoying! But, I can't work out why it would have changed. I've not altered the configuration for ages. I though originally it was because the backup size had got very close (if not exceeded) the size of the tape, but after moving some files around it's not well below the tape size (Tape=200GB, file=180GB). We're Redhat ES8 with a Quantum Superloader 3. Can anyone point me towards a solution/answer to this? I'd be grateful if you could! Well, tape drives don't (or shouldn't) ever show up in /etc/fstab or /etc/mtab. I'm not familiar with ES8, but since it is RedHat, the drives are probably controlled by udev. In the default configuration the SD never releases the drive because it is not a particularly good idea. If you shutdown the SD or modify your SD conf file appropriately (not recommended) Bacula will release the drive. Then it is simply a matter of having your udev setup correctly, which should be done by default. Regards, Rupert Finnigan ***Confidentiality and Privilege Notice*** The material contained in this message is privileged and confidential to the addressee. If you are not the addressee indicated in this message or responsible for delivery of the message to such person, you may not copy or deliver this message to anyone, and you should destroy it and kindly notify the sender by reply email. Information in this message that does not relate to the official business of Weatherbeeta must be treated as neither given nor endorsed by Weatherbeeta. Weatherbeeta, its employees, contractors or associates shall not be liable for direct, indirect or consequential loss arising from transmission of this message or any attachments Registered office address Greenway House, Sugarswell Business Park, Shenington, Banbury, Oxon, OX15 6HW. Company number 3006765 - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] 2 autoloader configuration, can't restore from 2nd autoloader
On Sat, 29 Jul 2006, Kern Sibbald wrote: This solution solved the problem, thanks very much: I defined the media type for the tape drive in one of the autoloaders to be LTO-4, leaving the other one as LTO-3 and now I can restore from backups made to either autoloader. Thanks again, Dirk Hello, On Friday 28 July 2006 22:56, Dirk Kleinhesselink wrote: I'm new to bacula and am setting bacula up for backing up a large raidserver. I have 2 7-slot (single drive) Exabyte Magnum LTO-3 autoloaders connected to the server. I've gone through the basic setup and tested the tapes and autoloaders for general functionality and everything seems good. I've labelled tapes for each autoloader and put in corresponding pools and defined jobs that will backup to each autoloader. I've run a few jobs and both autoloaders seem to be correctly used. However I went to test restoring what was backed up and one of my restore test jobs keeps trying to use the wrong autoloader and so complains that it can't find the tape. Backups that went to autoloader 1 can be restored OK, but backups where the tapes are in autoloader 2 fail because it seems it will only try to use autoloader 1, even though I've said the storage device should be autoloader 2 and the backup job wrote to the tapes in autoloader 2. I'm running bacula-1.38.11 on Mandriva 2006 x86_64. I'm also only backing up the local server. On bacula 1.38 and below, the Storage resource that is used is determined by the MediaType. If you have two Storage devices using the same MediaType, Bacula will freely choose either one (probably the first resource in your bacula-dir.conf file). So, you will probably have better luck if you assign different MediaTypes to the two autochangers. Hopefully this problem is fixed in 1.39, though I haven't yet had the time to test it. Thanks for any help. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] multiple job question
Bacula-users, This may be discussed somewhere, but I couldn't find it: I have 2 backup devices on my system. I'm only backing up the local server with bacula. I've defined several backup jobs for the server, because I don't want one giant full backup, but rather several smaller fulls to run at various times (weekends) over a month, with daily incrementals. Particularly for the incremental jobs, I'd like to use both backup devices in parallel, but have queued jobs stacked that run sequentially when the selected tape device becomes free. At setup, I have limited the director to only run one job and to my delight, I can submit multiple jobs and they sit there queued and run as soon as the previous job finishes. So I guess my question is: if I enable 2 simultaneous jobs and my scheduler queues the (incremental) jobs like this: job1 - device 1 job2 - device 1 job3 - device 2 job4 - device 1 job5 - device 2 job6 - device 2 as the top 2 jobs to run both want device 1, will it make the 2nd job wait and start the 3rd job on device 2 - and then job2 will run when job2 finishes ? And is there any problem that the client for both jobs is running on the same machine ? I can't imagine that would be a problem, but I thought I'd ask. Thanks for any help. Dirk - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] 2 autoloader configuration, can't restore from 2nd autoloader
On Wed, 2 Aug 2006, Alan Brown wrote: Well, there is NO such thing as an LTO-4 drive. They are both LTO-3 drives. I'm not sure that media type declaration does anything specific for a real media type, at least not in this case. I'm guessing it's just used as a name or label. Dirk On Wed, 2 Aug 2006, Dirk Kleinhesselink wrote: On Sat, 29 Jul 2006, Kern Sibbald wrote: This solution solved the problem, thanks very much: I defined the media type for the tape drive in one of the autoloaders to be LTO-4, leaving the other one as LTO-3 and now I can restore from backups made to either autoloader. How can you backup LTO-3 media in the LTO-4 drive? This is one limitation I could never see a way of working around, unless bacula allowed multiple media type definitions on a drive. AB - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] 2 autoloader configuration, can't restore from 2nd autoloader
I'm new to bacula and am setting bacula up for backing up a large raidserver. I have 2 7-slot (single drive) Exabyte Magnum LTO-3 autoloaders connected to the server. I've gone through the basic setup and tested the tapes and autoloaders for general functionality and everything seems good. I've labelled tapes for each autoloader and put in corresponding pools and defined jobs that will backup to each autoloader. I've run a few jobs and both autoloaders seem to be correctly used. However I went to test restoring what was backed up and one of my restore test jobs keeps trying to use the wrong autoloader and so complains that it can't find the tape. Backups that went to autoloader 1 can be restored OK, but backups where the tapes are in autoloader 2 fail because it seems it will only try to use autoloader 1, even though I've said the storage device should be autoloader 2 and the backup job wrote to the tapes in autoloader 2. I'm running bacula-1.38.11 on Mandriva 2006 x86_64. I'm also only backing up the local server. Thanks for any help. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
