Re: [Bacula-users] Tape problems after updating to version 3.0.0
> On Tue, 21 Apr 2009 11:13:04 -0400, Russell Sutherland said: > > Ok... > > I updated the VolStatus to append. DId that. All seems well. > > ... > Now when a job is rerun, things break again. > > Does this mean I have to change the tape? That becomes more likely if you make changes to the catalog and run more jobs without finding the cause of the initial problem. You need to find out why it broke before trying to fix it. Did you change the SD configuration at all during the upgrade? Does the SD's setting for TWO EOF match the drive's settings reported by mt geteotmodel? __Martin -- Stay on top of everything new and different, both inside and around Java (TM) technology - register by April 22, and save $200 on the JavaOne (SM) conference, June 2-5, 2009, San Francisco. 300 plus technical and hands-on sessions. Register today. Use priority code J9JMT32. http://p.sf.net/sfu/p ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Canceling jobs in 3.0.0 results in "Terminated with error"
> On Wed, 22 Apr 2009 16:07:49 -0700, Stephen Thompson said: > > I recently upgrade from 2.4.4 to 3.0.0. Everything went very smoothly > and the new version is running at least as well as the previous. > > Once peculiar thing I've noticed is that if I cancel a job, rather than > the job being set to a "Canceled by user" state, it winds up being set > to "Terminated with error". > > Anyone else notice this and/or have ideas why this might be happening? What does the log output show? __Martin -- Stay on top of everything new and different, both inside and around Java (TM) technology - register by April 22, and save $200 on the JavaOne (SM) conference, June 2-5, 2009, San Francisco. 300 plus technical and hands-on sessions. Register today. Use priority code J9JMT32. http://p.sf.net/sfu/p ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Is Maximum Spool Size = 0 the same as turning off spooling?
> On Thu, 23 Apr 2009 22:49:27 +1000, James Harper said: > > I have two devices on the same sd, and I want to make sure that spooling > is disabled for one and enabled for the other. The only way I can see to > do that is to set Maximum Spool Size = 0 in the sd for the device that I > don't want to spool. > > Is that the way to do it or is there a better way? I think 0 means infinite, so you can't control it per-device. You can set SpoolData as a Job-override in the schedule though. __Martin -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensign option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] "Will not descend" messages
> On Tue, 28 Apr 2009 13:37:18 +1000, James Harper said: > > When backing up Windows 2008, there are a large number of "xxx is a > different filesystem. Will not descend from ..." messages due to the > number of reparse points used. I'd rather not see those messages as they > don't tell me anything useful and could obscure some important messages. Have you tried a restore? I'm not sure if Bacula recreates them, so each one might indicates a potential problem when you restore. > Is there any way to turn those off? I already have !skipped which > doesn't do it. !notsaved might do the trick, but then that would also > skip messages about other types of notsaved files which I don't want. They are info messages so there is no way to turn them off without editing the source code. __Martin -- Register Now & Save for Velocity, the Web Performance & Operations Conference from O'Reilly Media. Velocity features a full day of expert-led, hands-on workshops and two days of sessions from industry leaders in dedicated Performance & Operations tracks. Use code vel09scf and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Two EOF
> On Wed, 29 Apr 2009 16:45:17 +0200, SZÉKELYI Szabolcs said: > > Hi, > > We configured our tape storage with > > Two EOF = Yes > BSF at EOM = Yes > > and found that this works fine as long as the tape is not ejected and > reloaded. After that, Bacula complains about number of files on the > volume not matching that recorded in the catalog. What is the number of files on the volume and the catalog in the error message? > We ran bscan on the volume, it gave the same number of files as the > catalog had. > > Btape test runs without errors. > > Is this a bug in Bacula or in our thinking? :) Which operating system and version of Bacula? __Martin -- Register Now & Save for Velocity, the Web Performance & Operations Conference from O'Reilly Media. Velocity features a full day of expert-led, hands-on workshops and two days of sessions from industry leaders in dedicated Performance & Operations tracks. Use code vel09scf and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] 100% static linked bacula-sd
> On Thu, 30 Apr 2009 21:46:51 +0200, Bastian Schern said: > > Hallo everybody, > > I try to install the Bacula Storage Daemon (bacula-sd) v3.0.1 directly > on a Linux NAS. > > I used the following configure command to build the static linked binary: > ./configure --disable-build-dird --enable-build-stored \ > --enable-static-sd --enable-static-tools --with-mysql \ > --without-openssl --without-python > > But if I execute the binary on the NAS I always got this error: > --- snip --- > r...@127.0.0.1:/raid/data/bacula/bin# ./static-bacula-sd > ./static-bacula-sd: error while loading shared libraries: libbacpy.so.1: > cannot open shared object file: No such file or directory > --- snap --- > > IMHO this means that the binary is not statically linked. > What's going wrong? Try adding --disable-libtool to the configure (this is new in v3.0). __Martin -- Register Now & Save for Velocity, the Web Performance & Operations Conference from O'Reilly Media. Velocity features a full day of expert-led, hands-on workshops and two days of sessions from industry leaders in dedicated Performance & Operations tracks. Use code vel09scf and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Two EOF
>>>>> On Sat, 02 May 2009 01:24:57 +0200, SZÉKELYI Szabolcs said: > > Martin Simmons wrote: > >>>>>> On Wed, 29 Apr 2009 16:45:17 +0200, SZÉKELYI Szabolcs said: > >> Hi, > >> > >> We configured our tape storage with > >> > >> Two EOF = Yes > >> BSF at EOM = Yes > >> > >> and found that this works fine as long as the tape is not ejected and > >> reloaded. After that, Bacula complains about number of files on the > >> volume not matching that recorded in the catalog. > > > > What is the number of files on the volume and the catalog in the error > > message? > > Bacula says it can find only 686 files on the tape while there sould be > 687. Here's the exact log from Bacula: > > ---8< > 10-Apr 22:55 bacula-sd JobId 93: 3307 Issuing autochanger > "unload slot 25, drive 1" command. > 10-Apr 22:57 bacula-dir JobId 93: Using Device "bacula-LTO3-0-Device" > 10-Apr 22:57 bacula-sd JobId 93: 3301 Issuing autochanger > "loaded? drive 1" command. > 10-Apr 22:57 bacula-sd JobId 93: 3302 Autochanger > "loaded? drive 1", result: nothing loaded. > 10-Apr 22:57 bacula-sd JobId 93: 3304 Issuing autochanger > "load slot 21, drive 1" command. > 10-Apr 22:58 bacula-sd JobId 93: 3305 Autochanger > "load slot 21, drive 1", status is OK. > 10-Apr 22:58 bacula-sd JobId 93: Volume "21" previously written, > moving to end of data. > 10-Apr 22:59 bacula-sd JobId 93: Error: Bacula cannot write on tape > Volume "21" because: > The number of files mismatch! Volume=686 Catalog=687 > 10-Apr 22:59 bacula-sd JobId 93: Marking Volume "21" > in Error in Catalog. > 10-Apr 22:59 bacula-sd JobId 93: 3307 Issuing autochanger > "unload slot 21, drive 1" command. > ---8< It looks like some data has been lost from the tape, maybe because it was overwritten. That could happen if the Two EOF setting is wrong. > > Which operating system and version of Bacula? > > The OS is CentOS 5.3. > > Since we were unable to find official packages for CentOS, our > installation of Bacula is a simple rebuild of > bacula-2.4.4-1.fc10.src.rpm found in the Fedora source repository. Why are you using Two EOF with this device? The recommended setup for Linux systems is Two EOF = No BSF at EOM = No __Martin -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Two EOF
>>>>> On Thu, 07 May 2009 02:55:32 +0200, SZÉKELYI Szabolcs said: > > Martin Simmons wrote: > >>>>>> On Sat, 02 May 2009 01:24:57 +0200, SZÉKELYI Szabolcs said: > >> Martin Simmons wrote: > >>>>>>>> On Wed, 29 Apr 2009 16:45:17 +0200, SZÉKELYI Szabolcs said: > >>>> Hi, > >>>> > >>>> We configured our tape storage with > >>>> > >>>> Two EOF = Yes > >>>> BSF at EOM = Yes > >>>> > >>>> and found that this works fine as long as the tape is not ejected and > >>>> reloaded. After that, Bacula complains about number of files on the > >>>> volume not matching that recorded in the catalog. > >>> What is the number of files on the volume and the catalog in the error > >>> message? > >> Bacula says it can find only 686 files on the tape while there sould be > >> 687. Here's the exact log from Bacula: > >> > >> ---8< > >> 10-Apr 22:55 bacula-sd JobId 93: 3307 Issuing autochanger > >> "unload slot 25, drive 1" command. > >> 10-Apr 22:57 bacula-dir JobId 93: Using Device "bacula-LTO3-0-Device" > >> 10-Apr 22:57 bacula-sd JobId 93: 3301 Issuing autochanger > >> "loaded? drive 1" command. > >> 10-Apr 22:57 bacula-sd JobId 93: 3302 Autochanger > >> "loaded? drive 1", result: nothing loaded. > >> 10-Apr 22:57 bacula-sd JobId 93: 3304 Issuing autochanger > >> "load slot 21, drive 1" command. > >> 10-Apr 22:58 bacula-sd JobId 93: 3305 Autochanger > >> "load slot 21, drive 1", status is OK. > >> 10-Apr 22:58 bacula-sd JobId 93: Volume "21" previously written, > >> moving to end of data. > >> 10-Apr 22:59 bacula-sd JobId 93: Error: Bacula cannot write on tape > >> Volume "21" because: > >> The number of files mismatch! Volume=686 Catalog=687 > >> 10-Apr 22:59 bacula-sd JobId 93: Marking Volume "21" > >> in Error in Catalog. > >> 10-Apr 22:59 bacula-sd JobId 93: 3307 Issuing autochanger > >> "unload slot 21, drive 1" command. > >> ---8< > > > > It looks like some data has been lost from the tape, maybe because it was > > overwritten. That could happen if the Two EOF setting is wrong. > > So bscan and the normal backup process report differing number of files > with the same configuration for the same tape. This sounds like a bug in > either. Not necessarily. If the configuration is broken, then they might differ as well. > >>> Which operating system and version of Bacula? > >> The OS is CentOS 5.3. > >> > >> Since we were unable to find official packages for CentOS, our > >> installation of Bacula is a simple rebuild of > >> bacula-2.4.4-1.fc10.src.rpm found in the Fedora source repository. > > > > Why are you using Two EOF with this device? The recommended setup for Linux > > systems is > > > > Two EOF = No > > BSF at EOM = No > > We have an outstanding problem with the low-level tape device that we > tried to track down. The symptom is: > > 27-Apr 23:19 bacula-sd JobId 473: Error: > Unable to position to end of data on device "bacula-LTO3-1-Device" > (/dev/nst0): ERR=dev.c:895 ioctl > MTEOM error on "bacula-LTO3-1-Device" (/dev/nst0). > ERR=Input/output error. > > and the related syslog entries: > > Apr 27 23:19:07 backup.lvs.iif.hu kernel: st0: Current: > sense key: Medium Error > Apr 27 23:19:07 backup.lvs.iif.hu kernel: Add. Sense: > Recorded entity not found > Apr 27 23:19:07 backup.lvs.iif.hu kernel: > Apr 27 23:19:07 backup.lvs.iif.hu kernel: Info fld=0x7fff75 > Apr 27 23:19:07 backup.lvs.iif.hu kernel: st0: Current: > sense key: Medium Error > Apr 27 23:19:07 backup.lvs.iif.hu kernel: Add. Sense: > Medium format corrupted > > We managed to reproduce the error using mt. However, when mt stops, we > couldn't tell if it stops because of the error above or if it really > reached the end of the written data. So we introduced Two EOF so that we > can distinguish the two: if there are two successive EOF marks on the > tape at the current position, we are at the end of the data, otherwise > we ran into the error (again). > > Maybe this error is similar to the one reported recently to this list by > yvan. What do you think? If it h
Re: [Bacula-users] preserving ownership of restored files
> On Wed, 13 May 2009 18:57:43 -0700, David Newman said: > > A server crashed here after an upgrade/reboot. Much mayhem and sleep > deprivation ensued. Ugh. > > Bacula came through with most of the files needed, but restored > everything as root:wheel. This was from running bconsole, running > restore, picking the Job IDs, and selecting files. > > The UID/GIDs did not exist on the new system at the time of the restore, > but they do now. In this case I needed the files first so I'd know what > UIDs/GIDs to use on the new system. > > How to preserve ownership/groups during a restore? I would expect restore to do that automatically, using the numeric UIDs/GIDs. This should work even if they aren't in the user/group databases. Did you restore all files in the backup? Does bls show non root:wheel ownership for the files on these volumes? __Martin -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] preserving ownership of restored files
>>>>> On Thu, 14 May 2009 06:26:00 -0700, David Newman said: > > On 5/14/09 4:56 AM, Martin Simmons wrote: > >>>>>> On Wed, 13 May 2009 18:57:43 -0700, David Newman said: > >> A server crashed here after an upgrade/reboot. Much mayhem and sleep > >> deprivation ensued. Ugh. > >> > >> Bacula came through with most of the files needed, but restored > >> everything as root:wheel. This was from running bconsole, running > >> restore, picking the Job IDs, and selecting files. > >> > >> The UID/GIDs did not exist on the new system at the time of the restore, > >> but they do now. In this case I needed the files first so I'd know what > >> UIDs/GIDs to use on the new system. > >> > >> How to preserve ownership/groups during a restore? > > > > I would expect restore to do that automatically, using the numeric > > UIDs/GIDs. > > This should work even if they aren't in the user/group databases. > > That didn't happen, at least not for me. Can you repeat it by doing another restore now that you have the user/groups set up correctly? Does OpenBSD run some kind of periodic security job that resets the ownership of files with unknown UIDs/GIDs? > > Did you restore all files in the backup? > > No. In bconsole, I did this: > > 1. restore > > 2. Option 3, pick relevant job IDs (eight of them, in this case -- one > full plus seven incremental backups) > > 3. cd /directory_to_be_restored > > 4. mark * > > 5. done > > 6. select host to be restored > > 7. proceed OK, that should definitely set the UIDs/GIDs of all of the marked files. Note however that it won't set them for /directory_to_be_restored or any directories that Bacula created above this. > > Does bls show non root:wheel ownership for the files on these volumes? > > Sorry, me bacula newbie, not familiar with bls. Where do I run this > (director or client) and what syntax to use? bls is a command line program that you run on the Storage Daemon, probably from /usr/local/sbin. The syntax is like this: bls -V MyVolume MyStorage MyVolume is the name of the volume and MyStorage is the device "name" given in the bacula-sd.conf. If you are using tapes, unmount the drive from bconsole. If you put your bacula-sd.conf in a non-standard place, then you'll need to pass the -c option as well (see bls -\?). __Martin -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] preserving ownership of restored files
>>>>> On Thu, 14 May 2009 13:35:22 -0700, David Newman said: > > On 5/14/09 8:29 AM, Martin Simmons wrote: > >>>>>> On Thu, 14 May 2009 06:26:00 -0700, David Newman said: > >> On 5/14/09 4:56 AM, Martin Simmons wrote: > >>>>>>>> On Wed, 13 May 2009 18:57:43 -0700, David Newman said: > >>>> A server crashed here after an upgrade/reboot. Much mayhem and sleep > >>>> deprivation ensued. Ugh. > >>>> > >>>> Bacula came through with most of the files needed, but restored > >>>> everything as root:wheel. This was from running bconsole, running > >>>> restore, picking the Job IDs, and selecting files. > >>>> > >>>> The UID/GIDs did not exist on the new system at the time of the restore, > >>>> but they do now. In this case I needed the files first so I'd know what > >>>> UIDs/GIDs to use on the new system. > >>>> > >>>> How to preserve ownership/groups during a restore? > >>> I would expect restore to do that automatically, using the numeric > >>> UIDs/GIDs. > >>> This should work even if they aren't in the user/group databases. > >> That didn't happen, at least not for me. > > > > Can you repeat it by doing another restore now that you have the user/groups > > set up correctly? > > Yes. This time the files were restored with the correct UID/GIDs. The original problem is still a mystery then. I suggest doing a test with some arbitrary UID/GIDs that are not known. Create a file and change its owner/group e.g. with chown 12345:12345. Check that ls -l shows 12345 and then backup and restore these files and see what happens. > >>> Did you restore all files in the backup? > >> No. In bconsole, I did this: > >> > >> 1. restore > >> > >> 2. Option 3, pick relevant job IDs (eight of them, in this case -- one > >> full plus seven incremental backups) > >> > >> 3. cd /directory_to_be_restored > >> > >> 4. mark * > >> > >> 5. done > >> > >> 6. select host to be restored > >> > >> 7. proceed > > > > OK, that should definitely set the UIDs/GIDs of all of the marked files. > > Note > > however that it won't set them for /directory_to_be_restored or any > > directories that Bacula created above this. > > Might that be the problem? I created a /home/bacula/bacula-restore > directory on the new server as root before running the restore. That shouldn't cause a problem. __Martin -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] fileset question
>>>>> On Thu, 14 May 2009 16:35:47 -0400, Jeff Dickens said:
>
> Here it is:
>
> FileSet {
> Name = "XP_WS3"
> Include {
> Options {
> exclude = yes
> RegEx = ".*\.lnk"
> RegEx = ".*\.mp3"
> RegEx = ".*\.wma"
> }
> Options {
> signature = MD5
> compression=GZIP
> WildDir = "C:/Documents and Settings/*/My Documents"
> Wild = "C:/Documents and Settings/*/My
> Documents/*"
> WildDir = "C:/Documents and Settings/*/Desktop"
> Wild = "C:/Documents and Settings/*/Desktop/*"
> RegExDir = "C:/Documents and Settings/[^/]+$"
> }
> Options {
> exclude = yes
> Wild = "C:/Documents and Settings/*"
> }
> File = "C:/Documents and Settings"
> }
> }
>
> Thanks to those that responded to Robin Bonin's thread about a year ago,
> in particular Martin Simmons.
>
> I have two follow-up questions:
>
> What exactly is the RegExDir directive doing? I understand what the
> regex is doing, but how does that help here, since all the WildDirs are
> getting "ored" together.. what does it match that the others don't?
The RegExDir matches the directories directly within C:/Documents and
Settings/ but nothing within those directories. It is needed because none of
the other WildDirs match those directories.
Bacula walks over the filesystem from the File= lines and doesn't descend into
any directory that matches an exclude rule. The RegExDir clause is needed to
allow it to descend into those directories, otherwise it will not even
consider the Desktop etc subdirectories.
> Secondly, does anyone else agree that it would be desirable to have the
> fileset look more like this:
>
> Include {
>Rational_Filespec: = "C:/Documents and Settings/*/My Documents"
>Rational_Filespec: = "C:/Documents and Settings/*/Desktop"
> }
>
> instead of the dog's breakfast?
Yes, but it is difficult to implement efficiently in more general cases
without scanning the whole filesystem looking for matches. The current
algorithm allows large parts of the filesystem to be ignored completely.
__Martin
--
Crystal Reports - New Free Runtime and 30 Day Trial
Check out the new simplified licensing option that enables
unlimited royalty-free distribution of the report engine
for externally facing server and web deployment.
http://p.sf.net/sfu/businessobjects
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] fileset question
> On Thu, 14 May 2009 17:24:19 -0400, Jeff Dickens said:
>
> Maybe if I had the answers to those questions I would understand why
> this fileset is totally non-functional. It backs up just the top level
> directories under "Documents and Settings".
>
> FileSet {
> Name = "XP_WS4"
> Include {
> Options {
> exclude = yes
> RegEx = ".*\.lnk"
> RegEx = ".*\.mp3"
> RegEx = ".*\.wma"
> }
> Options {
> signature = MD5
> compression=GZIP
> WildDir = "C:/Documents and Settings/*/Application
> Data/Thunderbird"
> WildDir = "C:/Documents and Settings/*/Application
> Data/Thunderbird/*"
> RegExDir = "C:/Documents and Settings/[^/]+$"
> }
> Options {
> exclude = yes
> Wild = "C:/Documents and Settings/*"
> }
> File = "C:/Documents and Settings"
> }
> }
It is because you didn't tell it to back up
C:/Documents and Settings/*/Application Data
__Martin
--
Crystal Reports - New Free Runtime and 30 Day Trial
Check out the new simplified licensing option that enables
unlimited royalty-free distribution of the report engine
for externally facing server and web deployment.
http://p.sf.net/sfu/businessobjects
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] volume management & holidays
> On Tue, 26 May 2009 15:17:50 +0200, Olaf Zevenboom said: > > Dear List, > > We have got a single-slot tapedrive and therefor do not have the luxury > of letting Bacula decide which volume/tape to use. So our configuration > forces Bacula to use a Monday-volume(tape), a Tuesday-volume(tape) etc. > I have implemented a RunBeforeJob which checks if the current date is a > holiday or not and forces the backup to be canceled if needed. > However this leads to the need of multiple manual interventions as soon > as the holidayperiod has ended: when a pool of volumes is pruned for > instance the Monday volume gets pruned and on Tuesday (not being a > holiday) Bacula want the oldest available volume being the Monday > volume. The next day same issue. This obviously continues until the > retention-period in that pool is reached again. > > How can I let Bacula skip that volume one more entire retention period > (through a script)? Have you tried adding Recycle Current Volume = yes to the pool? Alternatively, you could have a pool for each day of the week. __Martin -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers & brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, & iPhoneDevCamp as they present alongside digital heavyweights like Barbarian Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Expiry policy: Last remaining full backup?
> On Tue, 26 May 2009 15:26:13 +0100 (BST), Alan Brown said: > > If memory serves me correctly, Bacula will not prune a volume which > contains the last remaining full backup of any given job. > > Unfortunately I can't find the documentation for this feature. Can someone > remind me where it's lurking? The doc for Volume Retention says the opposite. __Martin -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers & brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, & iPhoneDevCamp as they present alongside digital heavyweights like Barbarian Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] volume management & holidays
>>>>> On Wed, 27 May 2009 15:44:07 +0200, Olaf Zevenboom said: > > Basically I think I have the following options: > 1. Have a admin job call a script which enables/disables volumes > comparing dates with holiday dates to be run in advance of every backup > session. > Requires extensive scripting and does not allow for manual disablement > of volumes. > 2. Move a week pool definition to system where every day has it's own Pool. > Not difficult. Just many extra lines in bacula-dir.conf and requires > catalog maintenance. > 3. add to my config: Recycle Current Volume = yes > > I think that is also the sequence of options which requires most work to > the least work. > Option 2 sounds the safest. > However on the subject of option 3: > Will it honor retention times: Yes, Recycle Current Volume = yes does honor retention times. It also only recycles if the current volume is marked as Full or Used. > If for instance tape "Monday" is inserted on Tuesday will Bacula error > and demand the Tuesday-volume/tape to be inserted or will it overwrite > the Monday tape although the Monday-volume-retentiontime is not yet reached? No, it will append to the Monday tape, which I assume is what happens with your current configuration as well. If you want Bacula to demand the Tuesday tape, then you will need to use option 1 or 2. __Martin > Martin Simmons wrote: > >>>>>> On Tue, 26 May 2009 15:17:50 +0200, Olaf Zevenboom said: > >>>>>> > >> Dear List, > >> > >> We have got a single-slot tapedrive and therefor do not have the luxury > >> of letting Bacula decide which volume/tape to use. So our configuration > >> forces Bacula to use a Monday-volume(tape), a Tuesday-volume(tape) etc. > >> I have implemented a RunBeforeJob which checks if the current date is a > >> holiday or not and forces the backup to be canceled if needed. > >> However this leads to the need of multiple manual interventions as soon > >> as the holidayperiod has ended: when a pool of volumes is pruned for > >> instance the Monday volume gets pruned and on Tuesday (not being a > >> holiday) Bacula want the oldest available volume being the Monday > >> volume. The next day same issue. This obviously continues until the > >> retention-period in that pool is reached again. > >> > >> How can I let Bacula skip that volume one more entire retention period > >> (through a script)? > >> > > > > Have you tried adding > > > > Recycle Current Volume = yes > > > > to the pool? > > > > Alternatively, you could have a pool for each day of the week. > > > > __Martin > > > > -- > > Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT > > is a gathering of tech-side developers & brand creativity professionals. > > Meet > > the minds behind Google Creative Lab, Visual Complexity, Processing, & > > iPhoneDevCamp as they present alongside digital heavyweights like Barbarian > > Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com > > ___ > > Bacula-users mailing list > > Bacula-users@lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/bacula-users > > > > > -- > Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT > is a gathering of tech-side developers & brand creativity professionals. Meet > the minds behind Google Creative Lab, Visual Complexity, Processing, & > iPhoneDevCamp as they present alongside digital heavyweights like Barbarian > Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers & brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, & iPhoneDevCamp as they present alongside digital heavyweights like Barbarian Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] followup
> On Tue, 26 May 2009 15:28:44 -0400, cpreston said: > > This is an edited version of a previous post > > > I'm replying to my own post via the forum. I originally said: > > > > 26-May 08:43 backup-fd: RestoreFiles.2009-05-26_08.38.43 Error: > > attribs.c:471 Unable to set file flags /backup/bacula-restores/home/ > > backup/weekly/mysql-dump/local.19.sql.gz: ERR=Operation not supported > > > > I wonder.. which operation is not supported? > > > By the way, the restore did occur.. I just don't know what this error > indicates > and if I can get it to show success instead of failure > > Bacula-dir is running on Linux and the client is FreeBSD > > Could that have something to do with it? It means that the chflags(2) system call is failing. Maybe the filesystem format on the client doesn't support flags? Does /bin/chflags work on that file? __Martin -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers & brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, & iPhoneDevCamp as they present alongside digital heavyweights like Barbarian Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] files pruned immediately after backup
> On Fri, 29 May 2009 00:17:51 -0700, Justin T Pryzby said:
>
> I'm attempting to configure a semi-permanent full monthly backup, in
> addition to a weekly full backup with 4 daily incrementals.
>
> When last month's backup completed, it seems to have immediately
> pruned the files from the catalog:
>
> | Termination:Backup OK
>
> | 03-May 22:37 ariel-dir JobId 156: Begin pruning Jobs.
> | 03-May 22:37 ariel-dir JobId 156: No Jobs found to prune.
> | 03-May 22:37 ariel-dir JobId 156: Begin pruning Files.
> | 03-May 22:37 ariel-dir JobId 156: Pruned Files from 3 Jobs for client
> ariel-fd from catalog.
> | 03-May 22:37 ariel-dir JobId 156: End auto prune.
>
> I'm not sure why, since the month pool has "AutoPrune = no" (2 new
> tapes were added to the pool), the job doesn't have "prune=yes", and
> the client has "File Retention = 30 days". The relevant pool has
> "Volume Retention = 15y".
>
> Any help is much appreciated. A pruned director config is attached.
The pruning you see here is caused by "AutoPrune = yes" in the client
definition:
> Client {
> Name = ariel-fd
> Address = localhost
> FDPort = 9102
> Catalog = Catalog
> Password =
> File Retention = 30 days
> Job Retention = 6 months
> AutoPrune = yes
> }
Unfortunately, this prunes all jobs that run on that client, so you lose the
files from the monthly job after 30 days too. AFAIK, there is no way to
automatically prune the files for a specific tuple (job,client).
The "AutoPrune = no" directive in your pool prevents pruning of volumes, not
of jobs or files.
The purpose of file/job pruning is to reduce the size of the catalog, whereas
volume pruning is part of recycling.
If you need to keep the file info for longer, you could try setting "File
Retention = 6 months" in the client. The weekly/daily volumes will still be
recycled correctly based on their volume retention.
__Martin
--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
is a gathering of tech-side developers & brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing, &
iPhoneDevCamp as they present alongside digital heavyweights like Barbarian
Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] unmount after last job
> On Wed, 27 May 2009 22:09:36 +0200, Falk Sauer said:
>
> have anybody a suggestion how to configure a admin job that only does
> the unmount? This job would i start with a priority after the
> BackupCatalog.
Yes, something like this:
Job {
Name = "UnMountTape"
Type = Admin
JobDefs = "FileJob"
FileSet="Catalog"
Priority = 499
Schedule = "AdminAlwaysCycle"
RunBeforeJob = "/usr/local/bin/ensure_storage_unmounted"
}
/usr/local/bin/ensure_storage_unmounted is a script like this:
echo "unmount storage=my-storage-device" | bconsole -c bconsole.conf
__Martin
--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
is a gathering of tech-side developers & brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing, &
iPhoneDevCamp as they present alongside digital heavyweights like Barbarian
Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula filling the / (root)
> On Sat, 30 May 2009 21:35:06 +0200, Johan van Vliet said: > > Hi... > > A couple of weeks ago posted the message below. Today I upgraded the system > to OpenBSD 4.5 (Flashboot) and installed "lsof" inorder to tackle to > problem. > > If I run "lsof" every few minutes with a full backup I see one line that > gets my attention: > COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME > ... > bacula-di 1248 bacula 14u VREG 17,0 30902272 6173 / > (/dev/rd0a) > ... > > This is exactly the size of the space that I'm "missing" in root but I have > no clue why bacula-dir does this. As I said in my previous mail: the working > directory for bacula(-dir) is: /mnt/archive/working > > Any advice on how to trace this futher and avoid this "writing" to root? The lsof output (slash followed by the device in parens) means that the file was deleted but still open, so perhaps it is a temporary file used by Sqlite? Is it always fd 14? Is it open only when a backup is running? If so, try using ktrace/kdump to see what opens or unlinks it. __Martin > > J. > > > Hi, > > > > I have been using bacula/SQLite for a couple of months now (almost a year) > > and it has been running fine up till a week ago. I run a schedule of: > > daily incremental > > weekly (sunday) differential > > monthly full. > > > > On March 1st I upgraded my OS (OpenBSD 4.3 build as a flashboot image) to > > OpenBSD 4.4 (also flashboot) > > > > Since then my differentials (incrementals are fine) fail. They result in an > > SQL error causes by an disk/IO error. When I run dmesg on the bacula > > machine > > apparently the disk was full: > > uid 250 on /: file system full > > > > However I have configured bacula to use working on /mnt/archive. So it > > should not even try to write in /. The /mnt/archive (I know: bad name) has > > plenty of space (30% in use) > > > > What could be writing outside of /mnt/archive/working ? I can only find one > > reference to /tmp in the config file and that is for a restore job. Not the > > case here. > > > > It is possible/likely that my Old 4.3 ramdrive image had a bit more space > > in > > /. > > > > Extra info; > > Hardware : PC Engine (so no memory upgrade possible) > > OS : Flashboot (mindrot.org) OpenBSD 4.4 (so ramdrive OS) > > Bacula : 2.2.8 (latest OpenBSD) > > Database : Sqlite > > Storage : File (USB disk mounted at /mnt/archive) > > > > $ df -h > > Filesystem SizeUsed Avail Capacity Mounted on > > /dev/rd0a 19.3M 16.0M3.3M83%/ > > mfs:18385 14.5M 10.1M3.6M73%/usr/local > > /dev/sd0a 458G131G305G30%/mnt/archive > > /dev/wd0a 3.7G 13.5M3.5G 0%/flash > > > > J. > > -- > Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT > is a gathering of tech-side developers & brand creativity professionals. Meet > the minds behind Google Creative Lab, Visual Complexity, Processing, & > iPhoneDevCamp as they present alongside digital heavyweights like Barbarian > Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers & brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, & iPhoneDevCamp as they present alongside digital heavyweights like Barbarian Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] restore from tape problem
> On Wed, 27 May 2009 12:38:25 -0400, aa1767a said: > > > > > It means that the chflags(2) system call is failing. Maybe the filesystem > > format on the client doesn't support flags? Does /bin/chflags work on that > > file? > > > > __Martin > > > > > Thanks Martin > Apparently FreeBSD does not support chflags > > [r...@backup] # chflags arch test > chflags: test: Operation not supported >(09:37:50) ~/ > [r...@backup] # > > Oh well.. that's a good place to start. Flags are supported by the default FreeBSD filesystem (UFS2). What do mount and dumpfs show about the filesystem? __Martin -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers & brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, & iPhoneDevCamp as they present alongside digital heavyweights like Barbarian Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] files pruned immediately after backup
>>>>> On Fri, 29 May 2009 13:56:12 -0700, Justin T Pryzby said: > > Hi Martin, > > Trying to understand here.. Please keep posting to the list. > > On Fri, May 29, 2009 at 06:38:21PM +0100, Martin Simmons wrote: > > >>>>> On Fri, 29 May 2009 00:17:51 -0700, Justin T Pryzby said: > > > > Unfortunately, this prunes all jobs that run on that client, so you lose the > > files from the monthly job after 30 days too. > So, do you understand why did the files get pruned not after 30 days > but *immediately* after the backup was run? No, that doesn't make any sense to me. I had assumed "Pruned Files from 3 Jobs" referred to older jobs, which is how it normally works. __Martin -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers & brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, & iPhoneDevCamp as they present alongside digital heavyweights like Barbarian Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] incremental backups of restored data
> On Tue, 2 Jun 2009 10:54:24 +0300, Silver Salonen said: > > Hello. > > Currently I see this behavior in Bacula 3.0.0 (on FreeBSD): > > I backup a directory (having 6 files), then remove the original directory and > restore it from backup. When I run an incremental backup of the same > directory > then, all the files are getting backed up again, although they should be > exactly the same as they were before removing/restoring. Is there any > parameter of files that is not restored and that causes them to be backed up > again? > > Is this behavior inevitable with Bacula? Unfortunately, restoring a file will set its ctime to the current time and there is not much you can do about that. By default, Bacula uses the ctime and mtime to detect changes for incremental backups. You could set the mtimeonly=yes fileset option, but that would cause you to lose incremental backups of files where the permissions have been changed or someone has manipulated the mtime to be in the past. __Martin -- OpenSolaris 2009.06 is a cutting edge operating system for enterprises looking to deploy the next generation of Solaris that includes the latest innovations from Sun and the OpenSource community. Download a copy and enjoy capabilities such as Networking, Storage and Virtualization. Go to: http://p.sf.net/sfu/opensolaris-get ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] please help with understanding WildDir
> On Wed, 3 Jun 2009 07:59:00 -0500, Mike Eggleston said: > > Morning, > > I have been running bacula for quite some time (wonderful system). I'm > tweaking my backups to reduce just how much stuff is backed up and > eliminate those things that can be reinstalled rather than restored if > needed. Today I'm looking at a series of files that are copied from an > internal source code repositiory. Since the source code repository is > backed up nightly, I don't want to backup up an individual's copies of > those files (the individuals are by company policy required to manage > any files checked out that have changes that are not yet checked back > in to the source code repository). > > In my bacula-dir.conf I have a line: WildDir = > "/opt/data/*/p4" In last night's backup I have the > following file that was backed up: (query, 12, $jobid) > /opt/data/user/p4/user_shared/product/dist_sdk/PluginSDK/src/plugins/CaeXML/x64/Debug/runtimeWrite.obj > > My understanding, that I must have wrong, is that since the > bacula-dir.conf this section of the File Set has Exclude = yes that > /opt/data/*/p4 is excluded that also implies that anything under > /opt/data/*/p4 is also excluded. I do have a statement further down > in the File Set section of 'File = /opt/data' so that everything else > is included. > > Is there a conflict in what I have done? Is there a better way to > exclude part and include the rest? Your approach should work, but the description of your fileset was too vague for me to tell why it doesn't. I recommend that you post the complete fileset definition to the list. __Martin -- OpenSolaris 2009.06 is a cutting edge operating system for enterprises looking to deploy the next generation of Solaris that includes the latest innovations from Sun and the OpenSource community. Download a copy and enjoy capabilities such as Networking, Storage and Virtualization. Go to: http://p.sf.net/sfu/opensolaris-get ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] please help with understanding WildDir
>>>>> On Wed, 3 Jun 2009 14:20:43 -0500, Mike Eggleston said:
>
> On Wed, 03 Jun 2009, Martin Simmons might have said:
>
> > >>>>> On Wed, 3 Jun 2009 07:59:00 -0500, Mike Eggleston said:
> > >
> > > Morning,
> > >
> > > I have been running bacula for quite some time (wonderful system). I'm
> > > tweaking my backups to reduce just how much stuff is backed up and
> > > eliminate those things that can be reinstalled rather than restored if
> > > needed. Today I'm looking at a series of files that are copied from an
> > > internal source code repositiory. Since the source code repository is
> > > backed up nightly, I don't want to backup up an individual's copies of
> > > those files (the individuals are by company policy required to manage
> > > any files checked out that have changes that are not yet checked back
> > > in to the source code repository).
> > >
> > > In my bacula-dir.conf I have a line: WildDir =
> > > "/opt/data/*/p4" In last night's backup I have the
> > > following file that was backed up: (query, 12, $jobid)
> > > /opt/data/user/p4/user_shared/product/dist_sdk/PluginSDK/src/plugins/CaeXML/x64/Debug/runtimeWrite.obj
> > >
> > > My understanding, that I must have wrong, is that since the
> > > bacula-dir.conf this section of the File Set has Exclude = yes that
> > > /opt/data/*/p4 is excluded that also implies that anything under
> > > /opt/data/*/p4 is also excluded. I do have a statement further down
> > > in the File Set section of 'File = /opt/data' so that everything else
> > > is included.
> > >
> > > Is there a conflict in what I have done? Is there a better way to
> > > exclude part and include the rest?
> >
> > Your approach should work, but the description of your fileset was too vague
> > for me to tell why it doesn't.
> >
> > I recommend that you post the complete fileset definition to the list.
> >
> > __Martin
>
> Thanks, Martin.
>
> Here's the file set. I didn't want to send a huge message to the list.
> Looking at the File Set I see I misspelled backula. Great! That one
> change will reduce the size of the backup on the bacula host.
>
> Mike
>
> File Set {
> Name = Unix-Files
> Ignore Fileset Changes = yes
> Include {
It should work if you insert
Options {
Exclude = yes
WildDir = "/opt/data/*/p4"
}
here.
> Options {
> signature = MD5
> }
> File = /
> File = /boot
> File = /home
> File = /opt
> File = /opt/CVS
> File = /opt/backups
> File = /opt/bacula
> File = /opt/pointwise
> File = /opt/pwi
> File = /etc
> File = /var
> File = /usr/share
> File = /var/lib
> File = /var/lib/imap
> File = /var/lib/ldap
> File = /var/lib/mysql
> File = /var/spool
> File = /var/spool/imap
> File = /var/spool/mail
> File = /var/spool/samba
> File = /var/www
> File = /var/www/html
> File = /var/www/html/bugzilla
> File = /var/yp
Are these all separately mounted filesystems? If not, you'll get duplication
when Bacula walks down from /opt into /opt/bacula etc.
__Martin
--
OpenSolaris 2009.06 is a cutting edge operating system for enterprises
looking to deploy the next generation of Solaris that includes the latest
innovations from Sun and the OpenSource community. Download a copy and
enjoy capabilities such as Networking, Storage and Virtualization.
Go to: http://p.sf.net/sfu/opensolaris-get
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] compiling bacula v3.0.1 on FreeBSD v7.1
> On Mon, 8 Jun 2009 15:51:07 -0400, Lars Nordin said: > > Anyone out there tried compiling bacula v.3.0.1 on FreeBSD v7.1? > > When I try I get this error: > > Compiling jcr.c > jcr.c: In function 'void _dbg_print_jcr(FILE*)': > jcr.c:1067: error: cast from 'pthread*' to 'int' loses precision > *** Error code 1 Is this 64-bit FreeBSD? It looks like a bug to me, because the code is casting pthread_t to int. It probably doesn't complain on most 32-bit systems, but it isn't allowed by the standard. As a hackaround, trying changing (int) to (int)(long) on line 1067 of src/lib/jcr.c. That is not correct either, but it might remove the error. I suggest you file a bug report. __Martin -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] to-disk differentials now using multiple volumes?
> On Thu, 11 Jun 2009 10:43:43 -0400, Jeff Dickens said: > > Bumping my own note here.. > > Does anyone know why things might be different under 3.0 with this "end > of media" thing? The message just before was: End of Volume "ted2-diff-0003" at 0:2111477919 on device "ted2-filedev" (/bacula/ted2). Write of 64512 bytes got 1888. This suggents your disk is (or was) full. Check the syslogs on the SD machine. __Martin > Jeff Dickens wrote: > > I'm using pretty much the same configuration for my differential > > backups as I did under Bacula 2.2.8, but for some reason under 3.0.1 > > it's getting "end of media" on a disk volume and moving to a new > > volume. There seems to be some kind of new behavior here.. It's > > possible the storage disk could have run out of space. Could anyone > > explain what is happening here? > > > > 05-Jun 22:34 packrat-dir JobId 31991: Start Backup JobId 31991, > > Job=ted2.2009-06-05_22.20.01_15 > > 05-Jun 22:34 packrat-dir JobId 31991: Purging oldest volume > > "ted2-diff-0003" > > 05-Jun 22:34 packrat-dir JobId 31991: 1 File on Volume > > "ted2-diff-0003" purged from catalog. > > 05-Jun 22:34 packrat-dir JobId 31991: There are no more Jobs > > associated with Volume "ted2-diff-0003". Marking it purged. > > 05-Jun 22:34 packrat-dir JobId 31991: All records pruned from Volume > > "ted2-diff-0003"; marking it "Purged" > > 05-Jun 22:34 packrat-dir JobId 31991: Using Device "ted2-filedev" > > 05-Jun 22:34 ted2-fd JobId 31991: DIR and FD clocks differ by -39 > > seconds, FD automatically compensating. > > 05-Jun 22:34 packrat-sd JobId 31991: Recycled volume "ted2-diff-0003" > > on device "ted2-filedev" (/bacula/ted2), all previous data lost. > > 05-Jun 22:34 packrat-dir JobId 31991: Volume used once. Marking Volume > > "ted2-diff-0003" as Used. > > 05-Jun 22:34 ted2-fd JobId 31991: Generate VSS snapshots. Driver="VSS > > WinXP", Drive(s)="C" > > 05-Jun 22:40 packrat-sd JobId 31991: End of Volume "ted2-diff-0003" at > > 0:2111477919 on device "ted2-filedev" (/bacula/ted2). Write of 64512 > > bytes got 1888. > > 05-Jun 22:40 packrat-sd JobId 31991: End of medium on Volume > > "ted2-diff-0003" Bytes=2,111,477,920 Blocks=32,730 at 05-Jun-2009 22:40. > > 05-Jun 22:40 packrat-dir JobId 31991: There are no more Jobs > > associated with Volume "ted2-diff-0448". Marking it purged. > > 05-Jun 22:40 packrat-dir JobId 31991: All records pruned from Volume > > "ted2-diff-0448"; marking it "Purged" > > 05-Jun 22:40 packrat-dir JobId 31991: Recycled volume "ted2-diff-0448" > > 05-Jun 22:40 packrat-sd JobId 31991: Recycled volume "ted2-diff-0448" > > on device "ted2-filedev" (/bacula/ted2), all previous data lost. > > 05-Jun 22:40 packrat-dir JobId 31991: Volume used once. Marking Volume > > "ted2-diff-0448" as Used. > > 05-Jun 22:40 packrat-sd JobId 31991: New volume "ted2-diff-0448" > > mounted on device "ted2-filedev" (/bacula/ted2) at 05-Jun-2009 22:40. > > 05-Jun 22:48 packrat-sd JobId 31991: End of Volume "ted2-diff-0448" at > > 1:152619127 on device "ted2-filedev" (/bacula/ted2). Write of 64512 > > bytes got 1928. > > 05-Jun 22:48 packrat-sd JobId 31991: End of medium on Volume > > "ted2-diff-0448" Bytes=4,447,586,424 Blocks=68,942 at 05-Jun-2009 22:48. > > 05-Jun 22:48 packrat-dir JobId 31991: There are no more Jobs > > associated with Volume "ted2-diff-0449". Marking it purged. > > 05-Jun 22:48 packrat-dir JobId 31991: All records pruned from Volume > > "ted2-diff-0449"; marking it "Purged" > > 05-Jun 22:48 packrat-dir JobId 31991: Recycled volume "ted2-diff-0449" > > 05-Jun 22:49 packrat-sd JobId 31991: Recycled volume "ted2-diff-0449" > > on device "ted2-filedev" (/bacula/ted2), all previous data lost. > > 05-Jun 22:49 packrat-dir JobId 31991: Volume used once. Marking Volume > > "ted2-diff-0449" as Used. > > 05-Jun 22:49 packrat-sd JobId 31991: New volume "ted2-diff-0449" > > mounted on device "ted2-filedev" (/bacula/ted2) at 05-Jun-2009 22:49. > > 05-Jun 22:52 ted2-fd JobId 31991: VSS Writer (BackupComplete): > > "MSDEWriter", State: 0x1 (VSS_WS_STABLE) > > 05-Jun 22:52 ted2-fd JobId 31991: VSS Writer (BackupComplete): > > "Microsoft Writer (Bootable State)", State: 0x1 (VSS_WS_STABLE) > > 05-Jun 22:52 ted2-fd JobId 31991: VSS Writer (BackupComplete): > > "Microsoft Writer (Service State)", State: 0x1 (VSS_WS_STABLE) > > 05-Jun 22:52 ted2-fd JobId 31991: VSS Writer (BackupComplete): "WMI > > Writer", State: 0x1 (VSS_WS_STABLE) > > 05-Jun 22:53 packrat-sd JobId 31991: Job write elapsed time = > > 00:18:24, Transfer rate = 7.030 M bytes/second > > 05-Jun 22:53 packrat-dir JobId 31991: Bacula packrat-dir 3.0.1 > > (30Apr09): 05-Jun-2009 22:53:26 > > Build OS: i686-redhat-linux-gnu redhat > > JobId: 31991 > > Job:ted2.2009-06-05_22.20.01_15 > > Backup Level: Differential, since=2009-05-21 04:00:04 > > Client: "ted2-fd" 2.2.6 (10Nov07) > > Linux,Cross-com
Re: [Bacula-users] Performance with MySQL queries since 3.0.0 (Dir inserting attributes hang)
> On Tue, 16 Jun 2009 15:05:18 +0200, Tom Sommer said: > > Hi, > > I have a somewhat pressing problem with the performance of my Bacula > installation. > > My MySQL database currently holds 247,342,127 (36GB) records in the File > table, and 78,576,199 (10GB) records in the Filename table. > > Since 3.0.0, but even more since 3.0.1, I have a problem with queries > being really slow. Basically when doing a full backup of a server > (mailserver, LOTS of small files), I can have my MySQL hanging for up to > 24+ hours on queries like this: > > INSERT INTO Filename( Name ) > SELECT a.Name > FROM ( > > SELECT DISTINCT Name > FROM batch > ) AS a > WHERE NOT > EXISTS ( > > SELECT Name > FROM Filename AS f > WHERE f.Name = a.Name > ) > > with the status "Sending data", and a lot of other similar queries in > queue with the status "Locked". One of these queries take approx 10.000 > seconds to execute, but is just followed by another similar (identical) > query with the same duration. This is a problem mostly because it > prevents me doing restores while backups are "Dir inserting attributes" > > Obviously I would think it's a MySQL performance issue, but I was > wondering if anything had been done to the queries? They seem to be a > LOT slower and a LOT heavier. > I've just put more RAM into the server, but it's done little to improve > the duration of the queries. My server now has 4GB RAM (will update to > 6GB) - but again it's a recent issue, because Bacula has been running > perfectly for many months on 2GB RAM, until I updated to 3.0.1 > > I've done REPAIR TABLE and OPTIMIZE TABLE and seen no improvement. > > Finally if anyone have any specific ideas to improve performance on my > huge SQL database, please share :) Sorry, I don't know how to optimize it. These queries are part of the new "batch insert" code. You can turn that off by passing --disable-batch-insert to configure when building Bacula. __Martin -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] MySQL errors
> On Tue, 16 Jun 2009 14:29:25 +0100, John Kennedy said: > > We keep getting the following errors when running backups and any time > we query: > > 16-Jun 13:56 ceres-dir JobId 8703: Fatal error: sql_get.c:359 > sql_get.c:359 query SELECT VolumeName,MAX(VolIndex) FROM JobMedia,Media > WHERE JobMedia.JobId=8703 AND JobMedia.MediaId=Media.MediaId GROUP BY > VolumeName ORDER BY 2 ASC failed: > Can't create/write to file '/tmp/#sql_555_0.MYI' (Errcode: 30) > > I can not find any problems with MySQL and /tmp is not full nor are > there any permission issues. > I am relatively new to Bacula and know a bit about MySQL (just short of > Jr DBA level). Errcode 30 means "Read-only file system" so I think you might have problems with your /tmp directory. What are the permissions on it? Can you create files in /tmp from the shell when running as the same user as mysqld? Is it a separate partition and does mount show rw for it? Have you tried rebooting in single user mode and doing an fsck to check for errors? __Martin -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Performance with MySQL queries since 3.0.0 (Dir inserting attributes hang)
>>>>> On Wed, 17 Jun 2009 13:48:58 +0200, Tom Sommer said: > > Martin Simmons wrote: > >>>>>> On Tue, 16 Jun 2009 15:05:18 +0200, Tom Sommer said: > >>>>>> > >> Hi, > >> > >> I have a somewhat pressing problem with the performance of my Bacula > >> installation. > >> > >> My MySQL database currently holds 247,342,127 (36GB) records in the File > >> table, and 78,576,199 (10GB) records in the Filename table. > >> > >> Since 3.0.0, but even more since 3.0.1, I have a problem with queries > >> being really slow. Basically when doing a full backup of a server > >> (mailserver, LOTS of small files), I can have my MySQL hanging for up to > >> 24+ hours on queries like this: > >> > >> INSERT INTO Filename( Name ) > >> SELECT a.Name > >> FROM ( > >> > >> SELECT DISTINCT Name > >> FROM batch > >> ) AS a > >> WHERE NOT > >> EXISTS ( > >> > >> SELECT Name > >> FROM Filename AS f > >> WHERE f.Name = a.Name > >> ) > >> > >> with the status "Sending data", and a lot of other similar queries in > >> queue with the status "Locked". One of these queries take approx 10.000 > >> seconds to execute, but is just followed by another similar (identical) > >> query with the same duration. This is a problem mostly because it > >> prevents me doing restores while backups are "Dir inserting attributes" > >> > >> Obviously I would think it's a MySQL performance issue, but I was > >> wondering if anything had been done to the queries? They seem to be a > >> LOT slower and a LOT heavier. > >> I've just put more RAM into the server, but it's done little to improve > >> the duration of the queries. My server now has 4GB RAM (will update to > >> 6GB) - but again it's a recent issue, because Bacula has been running > >> perfectly for many months on 2GB RAM, until I updated to 3.0.1 > >> > >> I've done REPAIR TABLE and OPTIMIZE TABLE and seen no improvement. > >> > >> Finally if anyone have any specific ideas to improve performance on my > >> huge SQL database, please share :) > >> > > > > Sorry, I don't know how to optimize it. > > > > These queries are part of the new "batch insert" code. You can turn that > > off > > by passing --disable-batch-insert to configure when building Bacula. > > > what does this mean in practice? 1 query per file? or? The non-batch approach makes several queries per file. > My real problem is these huge queries lock the File table, so no other > jobs can touch it for many hours. The batch queries update the Filename and Path tables atomically, so locking is expected. __Martin -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Performance with MySQL queries since 3.0.0 (Dir inserting attributes hang)
>>>>> On Thu, 18 Jun 2009 17:11:04 +0200, Michel Meyers said: > > Martin Simmons wrote: > >>>>>> On Wed, 17 Jun 2009 13:48:58 +0200, Tom Sommer said: > >> Martin Simmons wrote: > >>>>>>>> On Tue, 16 Jun 2009 15:05:18 +0200, Tom Sommer said: > >>>>>>>> > >>>> Hi, > >>>> > >>>> I have a somewhat pressing problem with the performance of my Bacula > >>>> installation. > >>>> > >>>> My MySQL database currently holds 247,342,127 (36GB) records in the File > >>>> table, and 78,576,199 (10GB) records in the Filename table. > >>>> > >>>> Since 3.0.0, but even more since 3.0.1, I have a problem with queries > >>>> being really slow. Basically when doing a full backup of a server > >>>> (mailserver, LOTS of small files), I can have my MySQL hanging for up to > >>>> 24+ hours on queries like this: > >>>> > >>>> INSERT INTO Filename( Name ) > >>>> SELECT a.Name > >>>> FROM ( > >>>> > >>>> SELECT DISTINCT Name > >>>> FROM batch > >>>> ) AS a > >>>> WHERE NOT > >>>> EXISTS ( > >>>> > >>>> SELECT Name > >>>> FROM Filename AS f > >>>> WHERE f.Name = a.Name > >>>> ) > [...] > >>> Sorry, I don't know how to optimize it. > >>> > >>> These queries are part of the new "batch insert" code. You can turn that > >>> off > >>> by passing --disable-batch-insert to configure when building Bacula. > >>> > >> what does this mean in practice? 1 query per file? or? > > > > The non-batch approach makes several queries per file. > > But it will do so as it backs up the files, as opposed to the batch > approach where it collects all the queries and does them at the end of > the job, right? Yes, but if you have spooling turned on, then it will spool the attributes too and insert them all at the end using several queries per file. __Martin -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Performance with MySQL queries since 3.0.0 (Dir inserting attributes hang)
> On Fri, 19 Jun 2009 03:00:54 +0300, Jari Fredriksson said: > > > > > INSERT INTO Filename( Name ) > > SELECT a.Name > > FROM ( > > > > SELECT DISTINCT Name > > FROM batch > > ) AS a > > WHERE NOT > > EXISTS ( > > > > SELECT Name > > FROM Filename AS f > > WHERE f.Name = a.Name > > ) > > > > That looks silly. > > I would write it shorter as > > INSERT INTO Filename(Name) > SELECT DISTINCT Name > FROM batch AS a > WHERE NOT EXISTS > ( > SELECT Name > FROM Filename AS f > WHERE f.Name = a.Name > ) Maybe, but perhaps it quicker to remove the duplicates from batch.name before comparing them to the rows in Filename.name? __Martin -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Performance with MySQL queries since 3.0.0 (Dir inserting attributes hang)
>>>>> On Fri, 19 Jun 2009 09:51:20 +0200, Tom Sommer said: > > Martin Simmons wrote: > >>>>>> On Thu, 18 Jun 2009 17:11:04 +0200, Michel Meyers said: > >>>>>> > >> Martin Simmons wrote: > >> > >>>>>>>> On Wed, 17 Jun 2009 13:48:58 +0200, Tom Sommer said: > >>>>>>>> > >>>> Martin Simmons wrote: > >>>> > >>>>>>>>>> On Tue, 16 Jun 2009 15:05:18 +0200, Tom Sommer said: > >>>>>>>>>> > >>>>>>>>>> > >>>>>> Hi, > >>>>>> > >>>>>> I have a somewhat pressing problem with the performance of my Bacula > >>>>>> installation. > >>>>>> > >>>>>> My MySQL database currently holds 247,342,127 (36GB) records in the > >>>>>> File > >>>>>> table, and 78,576,199 (10GB) records in the Filename table. > >>>>>> > >>>>>> Since 3.0.0, but even more since 3.0.1, I have a problem with queries > >>>>>> being really slow. Basically when doing a full backup of a server > >>>>>> (mailserver, LOTS of small files), I can have my MySQL hanging for up > >>>>>> to > >>>>>> 24+ hours on queries like this: > >>>>>> > >>>>>> INSERT INTO Filename( Name ) > >>>>>> SELECT a.Name > >>>>>> FROM ( > >>>>>> > >>>>>> SELECT DISTINCT Name > >>>>>> FROM batch > >>>>>> ) AS a > >>>>>> WHERE NOT > >>>>>> EXISTS ( > >>>>>> > >>>>>> SELECT Name > >>>>>> FROM Filename AS f > >>>>>> WHERE f.Name = a.Name > >>>>>> ) > >>>>>> > >> [...] > >> >>>>> Sorry, I don't know how to optimize it. > >>>>> >>>>> These queries are part of the new "batch insert" code. You can turn that >>>>> off >>>>> by passing --disable-batch-insert to configure when building Bacula. >>>>> >>>>> > >>>> what does this mean in practice? 1 query per file? or? > >>>> > >>> The non-batch approach makes several queries per file. > >>> > >> But it will do so as it backs up the files, as opposed to the batch > >> approach where it collects all the queries and does them at the end of > >> the job, right? > >> > > > > Yes, but if you have spooling turned on, then it will spool the attributes > > too > > and insert them all at the end using several queries per file. > > > Well, the problem is really that first is spends time storing the files, > and then it spends time saving information about the backup in the database. > It would make more sense, for larger clients, to spend the idle database > time (while taking the file backup) more wisely. > > I'm having a hard time judging if turning off batch-inserts is the right > action, if I would gain anything from this. AFAIK, the non-batch approach in Bacula 3.x does the same queies as Bacula 2.x. Since you started the thread by saying that backups are slower in 3.x because of the queries, turning off batch-inserts might solve that. __Martin -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Heads up -- no Bacula encryption on FreeBSD Release 7
> On Sun, 21 Jun 2009 11:55:43 -0400, Dan Langille said:
>
> Kern Sibbald wrote:
> > Hello Dan,
> >
> > This is to warn you that Bacula will probably not be able to be compiled
> > and
> > run with encryption on Release 7 of FreeBSD. This is because the version
> > of
> > pthreads in that release has pthread_t defined as a structure, which is
> > incompatible with OpenSSL.
>
> Initial conversations indicate that pthread_t is a point to a structure.
>
> From /usr/include/sys/_pthreadtypes.h
>
> typedef struct pthread *pthread_t;
>
> See http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/sys/_pthreadtypes.h
>
> Does this help?
I concur. AFAIK, pthread_t is a pointer in all of the FreeBSD thread
libraries so far.
> > This will not work with the new FreeBSD implementation of pthreads. Perhaps
> > the FreeBSD pthreads developers have a FreeBSD specific solution for this
> > problem. If so, could you please let me know. If not, Bacula encryption
> > will
> > unfortunately not be available on the new version of FreeBSD.
>
> A FreeBSD project
>
> The FreeBSD port applies these thread related patches to the Bacula source:
>
> d...@polo:/usr/ports/sysutils/bacula-server/files] $ cat patch-src_lib_jcr.c
> --- src/lib/jcr.c.orig 2009-04-12 11:07:07.079940037 -0400
> +++ src/lib/jcr.c 2009-04-12 11:07:20.116947254 -0400
> @@ -1063,8 +1063,8 @@
> fprintf(fp, "\tuse_count=%i\n",
> jcr->use_count());
> #else
> - fprintf(fp, "\tuse_count=%i threadid=0x%x\n",
> - jcr->use_count(), (int)jcr->my_thread_id);
> + fprintf(fp, "\tuse_count=%i threadid=0x%lx\n",
> + jcr->use_count(), (long)jcr->my_thread_id);
> #endif
> fprintf(fp, "\tJobType=%c JobLevel=%c\n",
> jcr->get_JobType(), jcr->get_JobLevel());
> [...@polo:/usr/ports/sysutils/bacula-server/files] $
>
>
>
> --- src/cats/sql.c.orig 2009-04-12 11:07:46.218959381 -0400
> +++ src/cats/sql.c 2009-04-12 11:08:15.509974021 -0400
> @@ -759,7 +759,7 @@
> if (mdb->lock.valid == RWLOCK_VALID) {
> fprintf(fp, "\tRWLOCK=%p w_active=%i w_wait=%i\n", &mdb->lock,
> mdb->lock.w_active, mdb->lock.w_wait);
> #ifndef HAVE_WIN32
> - fprintf(fp, "\t\tthreadid=0x%x mutex=%p\n",
> (int)mdb->lock.writer_id, &mdb->lock.mutex);
> + fprintf(fp, "\t\tthreadid=0x%lx mutex=%p\n",
> (long)mdb->lock.writer_id, &mdb->lock.mutex);
> #endif
> }
> }
These should be merged into Bacula, right?
__Martin
--
Are you an open source citizen? Join us for the Open Source Bridge conference!
Portland, OR, June 17-19. Two days of sessions, one day of unconference: $250.
Need another reason to go? 24-hour hacker lounge. Register today!
http://ad.doubleclick.net/clk;215844324;13503038;v?http://opensourcebridge.org
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring large directory does not work
> On Tue, 23 Jun 2009 16:09:57 -0700, mehma sarja said: > > > > > Did you wait till the cpu went back to low cpu usage? > > No, it stays high overnight and my patience runs out before cpu pegging > does. I suggest attaching gdb to the bacula-dir process to see what it is doing, e.g. thread apply all bt Then detach gdb, let it run some more, and do the above again to see how it differs. You might need to build a debugging version of Bacula to get useful backtraces. __Martin -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring large directory does not work
> On Wed, 24 Jun 2009 10:41:03 -0700, mehma sarja said: > > (gdb) thread apply all bt > > Thread 4 (Thread 0x801902180 (LWP 100350)): > #0 0x0008016f98cc in nanosleep () from /lib/libc.so.7 > #1 0x0008009078c5 in nanosleep () from /lib/libthr.so.3 > #2 0x0044e21e in bmicrosleep () > #3 0x0042408d in wait_for_next_job () > #4 0x00408a3c in main () > > Thread 3 (Thread 0x801902480 (LWP 100192)): > #0 0x000801715afc in select () from /lib/libc.so.7 > #1 0x0008009074d4 in select () from /lib/libthr.so.3 > #2 0x0044f9b2 in bnet_thread_server () > #3 0x00438ba8 in connect_thread () > #4 0x000800908a27 in pthread_getprio () from /lib/libthr.so.3 > #5 0x in ?? () > Error accessing memory address 0x7fbff000: Bad address. > #0 0x0040c043 in add_findex () The function add_findex is interesting, but I think like your bacula-dir was compiled without debugging info so it is difficult to see what is happening. Try the following gdb commands (I assume you are running 64-bit FreeBSD): break *add_findex commands printf "arguments: %x %x %x\n", $rdi, $rsi, $rdx end continue This sets a breakpoint at the start of the function add_findex to print the arguments and starts Bacula running again. It should stop in gdb when it reaches the beginning of add_findex again (with a message like Breakpoint 1...in add_findex...). When it stops, enter the continue command again and time how long it takes before it stops again. Do this a few times and post the results (including the "arguments:" output). __Martin -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring large directory does not work
> On Wed, 24 Jun 2009 13:59:26 -0700, mehma sarja said: > > Thanks for all your help you guys. I am impressed with the level of > expertise here! > > > Error accessing memory address 0x7fbff000: Bad address. > > > #0 0x0040c043 in add_findex () > > > > The function add_findex is interesting, but I think like your bacula-dir > > was > > > > Try the following gdb commands (I assume you are running 64-bit FreeBSD): > > > > break *add_findex > > commands > > printf "arguments: %x %x %x\n", $rdi, $rsi, $rdx > > end > > continue > > > > When it stops, enter the continue command again and time how long it takes > > before it stops again. > > > > Do this a few times and post the results (including the "arguments:" > > output). > > > > Yes, it is FreeBSD 64 bit. The continue command comes right back with these > arguments: > > Breakpoint 1, 0x0040bfc0 in add_findex () > arguments: 1b17068 a0 5fe00b > arguments: 1b17068 a0 5fe00b > arguments: 1b17068 a0 5fe00b > arguments: 1b17068 a0 5fe00b > (gdb) continue > Continuing. > > Breakpoint 1, 0x0040bfc0 in add_findex () > arguments: 1b17068 a0 5fe039 > arguments: 1b17068 a0 5fe039 > arguments: 1b17068 a0 5fe039 > arguments: 1b17068 a0 5fe039 > (gdb) continue > Continuing. > > Breakpoint 1, 0x0040bfc0 in add_findex () > arguments: 1b17068 a0 5fe055 > arguments: 1b17068 a0 5fe055 > arguments: 1b17068 a0 5fe055 > arguments: 1b17068 a0 5fe055 > (gdb) continue > Continuing. > > Breakpoint 1, 0x0040bfc0 in add_findex () > arguments: 1b17068 a0 5fe060 > arguments: 1b17068 a0 5fe060 > arguments: 1b17068 a0 5fe060 > arguments: 1b17068 a0 5fe060 > (gdb) continue > Continuing. > > Breakpoint 1, 0x0040bfc0 in add_findex () > arguments: 1b17068 a0 5fe071 > arguments: 1b17068 a0 5fe071 > arguments: 1b17068 a0 5fe071 > arguments: 1b17068 a0 5fe071 > (gdb) continue > Continuing. > > Breakpoint 1, 0x0040bfc0 in add_findex () > arguments: 1b17068 a0 5fe079 > arguments: 1b17068 a0 5fe079 > arguments: 1b17068 a0 5fe079 > arguments: 1b17068 a0 5fe079 > (gdb) continue > Continuing. > > Breakpoint 1, 0x0040bfc0 in add_findex () > arguments: 1b17068 a0 5fe0ac > arguments: 1b17068 a0 5fe0ac > arguments: 1b17068 a0 5fe0ac > arguments: 1b17068 a0 5fe0ac OK, this shows why it is slow. The algorithm in add_findex is only efficient when called with consecutive index values (the third number printed). The code for "restore all" in 2.4.4 doesn't do that, so it can take a very long time to complete. This was fixed in later version, so I think the best solution is to upgrade Bacula. __Martin -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring large directory does not work
> On Fri, 26 Jun 2009 11:53:26 -0700, mehma sarja said: > > Thanks Martin, > > You have put a good closure on the quest for knowledge. If I upgrade Bacula, > will I have to upgrade the database? Meaning do I have to run those update > table scripts. I am on postgresql version 8.29. Sorry, I don't know. Check the version table in the catalog. The latest Bacula uses version 11, so if your version table is the same then there should be no need to run update scripts. __Martin -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tip: How to relabel an old tape without interrupting a running job that needs it
> On Mon, 06 Jul 2009 16:37:00 -0400, Phil Stracchino said: > > Problem: > > You have a running job which turns out to need one volume more than you > anticipated. You don't have another labelled tape ready. You DO have > some available tapes waiting to be relabelled, but they're volumes with > a different label scheme from an earlier installation. > > You can't use the label command because the tapes are already labelled. > You can't use btape to label them because the sd has your tape drive > locked, and you can't release the tape drive without stopping the sd, > which will interrupt the job. Did you try the bconsole umount command? That releases the drive for me without stopping th sd. __Martin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/blackberry ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula 2.4.4 backup error
> On Tue, 07 Jul 2009 08:13:43 +0200, Thomas Kempf said: > > hello, > i've got some problems with bacula 2.4.4. on Debian Lenny and postgresql > 8.3. Basically I'm facing the problem with postgresql discarding the > complete batch insert after a job because there are some invalid utf8 > byte-sequences in it. There were already some discussions on this > subject with the proposal to dump the db and to reload it with encoding > SQL_ASCII which is what i did. This did not solve my problem. The backup > of some machines still produces this annoying error. Now i have two > questions. > > 1. Why does bacula send me messages with the backup status of ok for > those machines instead of telling me at least, that the batch copy > failed. IMO there should be at least a warning that attribute despooling > failed. If this happens with the latest version of Bacula, then please make a bug report. > 2. How can i solve that problem. There is nothing in the bacula logs and > the db-log just tells me that the batch insert failed at line xyz. But > as the attribute spool-file is deleted after the job, i can't look which > file produces the error. Is it something which is adressed in bacula v3. > If so, i would take the pain and upgrade by self-compiling the new > bacula instead of taking the deb-packages. What is the exact error you see in the db logs? What does psql -l print? __Martin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Speed writing to tape drive
> On Mon, 6 Jul 2009 10:14:09 -0700, Hayden Katzenellenbogen said: > > Hello, > > Thanks to a patch published two weeks ago I am finally making headway > into the wonderful world of Bacula. I have a single machine right now > with about 1.2T of data I am backing up. > > When I run the btape fill test I get write speeds of around 70MB/s when > I run a full backup from the local machine I get about 20MB/s is there > anyway to figure out where the bottle neck is? Are you using software compression (gzip) in Bacula? What do "top" and "iostat 10" show when running a backup? You could try using tar to check the speed of your filesystem, e.g. time tar cf /dev/null /some/very/large/directory __Martin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup size is bigger that sum of size of files
> On Mon, 6 Jul 2009 09:42:37 -0400, Victor Hugo dos Santos said:
>
> hello,
>
> today I receive a strange report from bacula (about my two proxys servers),
> see:
>
> = yesterday
> JobId: 13223
> Job:proxy2.2009-07-05_00.05.41
> Backup Level: Full
> FileSet:"Linux-Proxy" 2008-02-29 00:05:14
> Scheduled time: 05-Jul-2009 00:05:00
> Start time: 05-Jul-2009 03:40:54
> End time: 05-Jul-2009 03:57:52
> Elapsed time: 16 mins 58 secs
> FD Files Written: 2,275
> SD Files Written: 2,275
> FD Bytes Written: 6,381,070,677 (6.381 GB)
> SD Bytes Written: 6,381,342,582 (6.381 GB)
> === today ==
> JobId: 13246
> Job:proxy2.2009-07-06_00.05.40
> Backup Level: Incremental, since=2009-07-05 03:40:54
> FileSet:"Linux-Proxy" 2008-02-29 00:05:14
> Scheduled time: 06-Jul-2009 00:05:00
> Start time: 06-Jul-2009 00:19:57
> End time: 06-Jul-2009 00:35:26
> Elapsed time: 15 mins 29 secs
> FD Files Written: 431
> SD Files Written: 431
> FD Bytes Written: 6,296,577,452 (6.296 GB)
> SD Bytes Written: 6,296,630,147 (6.296 GB)
> =
>
>
> now.. my FileSet:
> =
> FileSet {
> Name = "Linux-Proxy"
> Include {
> Options { signature = SHA1; compression=GZIP5 }
> File = /home
> File = /etc
> File = /root
> File = /var/log/squid3
> File = /var/log/dansguardian
> File = /var/spool/cron
> }
> }
> =
>
> and finally the size of my folders.
> =
> $ sudo du --max-depth=0 -h /home/ /etc/ /root/ /var/log/squid3/
> /var/log/dansguardian/ /var/spool/cron/ -c
> 67M/home/
> 156M /etc/
> 36K/root/
> 2.5G /var/log/squid3/
> 43M /var/log/dansguardian/
> 20K /var/spool/cron/
> 2.8G total
> =
>
> can you view the problem ??.. my file system only have 2.8GB, but my
> backup have a a size > that 6 GB.
Maybe you have some sparse files? You could check this by looking for large
files using something like this:
sudo find /home /etc /root /var/log/squid3 /var/log/dansguardian
/var/spool/cron -xdev -size +200 -ls
You could also do this in bconsole to see which files are in the Incremental
backup and check their sizes:
list files jobid=13246
I assume one of those files is sparse.
Bacula has a fileset option to handle sparse files.
__Martin
--
Enter the BlackBerry Developer Challenge
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize
details at: http://p.sf.net/sfu/Challenge
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup size is bigger that sum of size of files
>>>>> On Wed, 8 Jul 2009 12:53:43 -0400, Victor Hugo dos Santos said: > > On Wed, Jul 8, 2009 at 12:26 PM, Martin Simmons wrote: > > > You could also do this in bconsole to see which files are in the Incremental > > backup and check their sizes: > > > > list files jobid=13246 > > mmm.. before of send my mail. I ran this commando to check files > included on backup, but not show problem or extra files for this job. > > +++-+--+---+--+---+---+ > | jobid | name | starttime | type | level | jobfiles | > jobbytes | jobstatus | > +++-+--+---+--+---+---+ > | 13,246 | proxy2 | 2009-07-06 00:19:57 | B| I | 431 | > 6,296,577,452 | T | > +++-+--+---+--+---+---+ That is strange -- the list files command should print all 431 of the file names. Has Bacula pruned the database already? You could try using the shell command "bls -v" to list the contents of the media. That should print the stat.st_size of each file. __Martin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem with Verify Jobs
It fails because you have two different job names for InitCatalog and Catalog.
The Verify Job option isn't used for Catalog verifies.
You need to run the Catalog verify using the same job as the InitCatalog but
with the Level=Catalog option to the run command.
__Martin
> On Thu, 09 Jul 2009 09:20:27 +0200, Christoph Kaminski said:
>
> Christoph Kaminski schrieb:
>
> no one a hint for me?
>
> have started the InitCatalog Job as first, then the Verify Job but I get
> ever these errors :/
>
> Greetz
>
> > Hi all!
> >
> > Im new on the list. I have a problem with verify jobs:
> >
> > lilith-fd JobId 95: Could not stat /etc/exports: ERR=No such file
> > or directory
> > 07-Jul 09:39 lilith-dir JobId 95: Bacula lilith-dir 2.4.4 (28Dec08):
> > 07-Jul-2009 09:39:12
> >Build: x86_64-pc-linux-gnu debian lenny/sid
> >JobId: 95
> >Job:lilith_InitCatalog.2009-07-07_09.36.20.39
> >FileSet:Verify Set
> >Verify Level: InitCatalog
> >Client: lilith-fd
> >Verify JobId: 0
> >Verify Job: lilith_Verify
> >Start time: 07-Jul-2009 09:36:22
> >End time: 07-Jul-2009 09:39:12
> >Files Examined: 37,401
> >Non-fatal FD errors:1
> >FD termination status: OK
> >Termination:Verify OK
> >
> > 07-Jul 09:39 lilith-dir JobId 95: Begin pruning Jobs.
> > 07-Jul 09:39 lilith-dir JobId 95: No Jobs found to prune.
> > 07-Jul 09:39 lilith-dir JobId 95: Begin pruning Files.
> > 07-Jul 09:39 lilith-dir JobId 95: No Files found to prune.
> > 07-Jul 09:39 lilith-dir JobId 95: End auto prune.
> >
> > 07-Jul 12:06 lilith-dir JobId 96: Fatal error: Unable to find JobId of
> > previous InitCatalog Job.
> > Please run a Verify with Level=InitCatalog before
> > running the current Job.
> > 07-Jul 12:06 lilith-dir JobId 96: Error: Bacula lilith-dir 2.4.4
> > (28Dec08): 07-Jul-2009 12:06:41
> >Build: x86_64-pc-linux-gnu debian lenny/sid
> >JobId: 96
> >Job:lilith_Verify.2009-07-07_12.06.39.40
> >FileSet:Verify Set
> >Verify Level: Catalog
> >Client: lilith-fd
> >Verify JobId: 0
> >Verify Job: lilith_InitCatalog
> >Start time: 07-Jul-2009 12:06:41
> >End time: 07-Jul-2009 12:06:41
> >Files Examined: 0
> >Non-fatal FD errors:0
> >FD termination status:
> >Termination:*** Verify Error ***
> >
> > the config for this jobs:
> >
> > Job {
> >Name = "lilith_InitCatalog"
> >Client = lilith-fd
> >JobDefs = "DefaultInitCatalog"
> >FileSet = "Verify Set"
> > }
> >
> > Job {
> >Name = "lilith_Verify"
> >Client = lilith-fd
> >JobDefs = "DefaultVerifyJob"
> >FileSet = "Verify Set"
> >Verify Job = lilith_InitCatalog
> > }
> >
> > What Im doing wrong?
> >
> > Greetz
> >
> >
> > --
> > Enter the BlackBerry Developer Challenge
> > This is your chance to win up to $100,000 in prizes! For a limited time,
> > vendors submitting new applications to BlackBerry App World(TM) will have
> > the opportunity to enter the BlackBerry Developer Challenge. See full prize
> > details at: http://p.sf.net/sfu/blackberry
> > ___
> > Bacula-users mailing list
> > Bacula-users@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
> --
> Enter the BlackBerry Developer Challenge
> This is your chance to win up to $100,000 in prizes! For a limited time,
> vendors submitting new applications to BlackBerry App World(TM) will have
> the opportunity to enter the BlackBerry Developer Challenge. See full prize
> details at: http://p.sf.net/sfu/Challenge
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
Enter the BlackBerry Developer Challenge
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize
details at: http://p.sf.net/sfu/Challenge
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem with Verify Jobs
>>>>> On Thu, 09 Jul 2009 12:15:52 +0200, Christoph Kaminski said: > > Martin Simmons schrieb: > > It fails because you have two different job names for InitCatalog and > > Catalog. > > The Verify Job option isn't used for Catalog verifies. > > > > You need to run the Catalog verify using the same job as the InitCatalog but > > with the Level=Catalog option to the run command. > > > > __Martin > > > > YEP it works now... > > but I dont understand the function of this conf option then: > > Verify Job: lilith_Verify > > > Have read the doc but still dont understand it... Can someone explain it > with a example? The Verify Job option is only used for verifying backups. I don't know why Catalog verify ignores is, but it may be a bug. OTOH, you never need two jobs for InitCatalog/Catalog so it is simpler to have only one. __Martin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] What to do with "Error" Disk Volumes
> On Wed, 15 Jul 2009 13:27:31 -0400, Mingus Dew said: > > All, > I have a disk volume with a status of "Error" > > 149 | ShopCart-FS_Full-0149 | Error | 1 | 97,820,348,233 > | 22 |1,814,400 | 1 |0 | 0 | ShopCart_File | > 2009-07-02 02:59:40 > > Just wondering what is the proper method to clear or recover from this > error? The best thing is to find out why it happened, before deciding how to correct it. Check the Bacula logs. __Martin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backuping 2000+ host with bacula?
> On Thu, 16 Jul 2009 12:09:32 +0200, Marcin Radczuk said: > > Hi, > > I'm trying use bacula more than a month. I have more than 2000 hosts to > backup. We want to do everyday backup. One Full backup per month and > Incrementals every other day. Now I have 10 bacula-sd and one bacula-dir > and I was add only 300 hosts to schedule. I automated hosts add to > bacula-dir, and I have one config file per host. Every host have his own > Job, Pool and Fileset in his config. Problem is that bacula can do one > backup per bacula-sd. I use Maximum Concurrent Jobs = 900 but I have one > Pool per host and bacula can't run another job on bacula-sd if other job > is running. Is that mean that I must do one pool per sd? The concurrency in the sd is limited by the number of Device entries, because each device can only load one volume at a time. Therefore you can use more than one pool concurrenly per sd if you define more than one Device in the sd config. Each device should have its own Media Type, which is used for the volumes in the pool. See http://www.bacula.org/en/rel-manual/Basic_Volume_Management.html#SECTION00265 __Martin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Spool block too big
> On Thu, 16 Jul 2009 16:28:28 -0400, teksupptom said: > > Hello, > > We've been intermittently having an issue with backups failing due to the > error "Spool block too big". It's happened exactly 10 times since > 4/27/09. It generally happens during large backups (900GB+). > > The most recent error happened after the data had been spooled, and was > being written to tape. These usually occur overnight so I don't always get > to see what's going on, but this one happened during my normal shift. Prior > to it happening I had noticed that the SD status showed the correct data > spool file size, but showed 0 bytes for the attribute spool size. I double > checked the directory we use to store the attribute spool file (same > directory where the mail files are kept, but different from where we spool > the data), and there was a 6GB+ attribute spool file for the job. > > Not sure if this is what other people are seeing when this error occurs, but > I'm hoping it can help in tracking down the source. > > We're running Bacula 2.4.4 using PostGreSQL 7.4.19. I think this can only be caused by a bug, so it is probably a good idead to upgrade to Bacula 3.0.1 to see if that fixes it. Are you using simultaneous jobs? What values does the error give for the sizes of the blocks? __Martin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] building bacula storage daemon only
> On Mon, 20 Jul 2009 01:34:53 -0500, Bobby Castleberry said: > > Hello all, I am testing Bacula out and running into a bit of confusion. > From the documentation it appears that I can have the storage daemon and > director installed on separate systems. Yes. > When searching for > documentation for just building the storage daemon alone it seems like > either it's not possible or nobody is really doing it. When I attempt a > configure using: > ./configure --sbindir=/opt/bacula/bin/ --sysconfdir=/opt/bacula/etc/ > --mandir=/opt/bacula/man/ --disable-build-dird --enable-largefile > --disable-nls > It complains about not having an sql library defined. Does the storage > daemon have a direct connection to the sql server without going through > the director? Is there something obvious that I'm missing with > configuration options? It isn't possible, because the storage daemon makefile also makes bscan, which does need the database. You'll need to install sqlite or the MySQL client package on the storage daemon build machine. __Martin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Compression
> On Sun, 19 Jul 2009 15:54:35 +0100, Gavin McCullagh said:
>
> Hi,
>
> On Sun, 19 Jul 2009, Bruno Friedmann wrote:
>
> > > Another useful feature might be a wildcard "excludefromcompression"
> > > directive so you could say:
>
> > > This might avoid wasting time trying to compress the unccompressible while
> > > gaining the compression ratio on those files which gain from it?
> >
> > Wouah, that would be nice, is this already working with recent bacula
> > version ?
>
> Not that I've heard of. I was just thinking out loud.
You can do it already using multiple Options clauses:
Options {
# Files that we don't want to compress.
signature = MD5
wild = *.gz
wild = *.Z
wild = *.mp3
}
Options {
# Default clause to compress all other files
signature = MD5
compression = GZIP
}
Remember to put all other options (such as signature) into both clauses.
__Martin
--
Enter the BlackBerry Developer Challenge
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize
details at: http://p.sf.net/sfu/Challenge
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] incremental from different job
> On Mon, 20 Jul 2009 11:57:51 +0200, C Keschnat said: > > is it somehow possible to use a Full backup from a different job for an > incremental backup of another job? No. > I have jobs for clients which run under a "normal" schedule (differential > daily, full weekly). Some Server need to be backed up hourly. What I'd > like to do is use the full or differential backup from the night before > and from there start the incremental backups. The thing is that at night a > script to dump all mysql-databases is called by bacula. I want mysqldump > to run only at night, during the day I backup the binary logs. I have a > solution for this, which is to simply run mysqldump via cronjob before > bacula starts its work, but if this is solvable with bacula, I'd prefer > that way You could add %l to the RunScript Command, which will pass the backup level to the script as $1. __Martin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Strange problem with authentication
> On Mon, 27 Jul 2009 16:10:35 -0300, Marcelo Terres said: > > Nobody have any idea of what could cause this error ? The authentication between the sd and fd uses a session key generated by the director, so it is unclear how this can fail. Try running the 3 daemons at debug level 200 and see if that gives useful info. __Martin > > Regards, > > Marcelo H. Terres > mhter...@gmail.com > > ICQ: 6649932 > MSN: mhter...@hotmail.com > Jabber: mhter...@jabber.org > http://twitter.com/mhterres > http://identi.ca/mhterres > http://mhterres.jaiku.com/ > > http://mundoopensource.blogspot.com/ > http://offtopicsandfun.blogspot.com/ > http://www.propus.com.br > > > On Fri, Jul 17, 2009 at 4:58 PM, Marcelo Terres wrote: > > > Hi, > > > > I've got an odd problem. Let me explain. > > > > I had several clients and all of them was working perfectly until the end > > of last month (when I take some days off). I returned last wednesday, and 3 > > clients are reporting this problem: > > > > > > 17-Jul 16:38 backup-dir JobId 9073: Start Backup JobId 9073, > > Job=app253.2009-07-17_16.38.24 > > 17-Jul 16:38 backup-dir JobId 9073: Using Device "TapeDriveLTO3" > > 17-Jul 16:38 backup-sd JobId 9073: Fatal error: Incorrect authorization key > > from File daemon at client rejected. > > > > > > Please see http://www.bacula.org/rel-manual/faq.html#AuthorizationErrors > > for help. > > 17-Jul 16:38 backup-sd JobId 9073: Fatal error: Incorrect authorization key > > from File daemon at client rejected. > > > > > > Please see http://www.bacula.org/rel-manual/faq.html#AuthorizationErrors > > for help. > > 17-Jul 16:38 backup-sd JobId 9073: Fatal error: Unable to authenticate File > > daemon > > > > > > 17-Jul 16:38 app253-fd JobId 9073: Fatal error: Authorization key rejected > > by Storage daemon. > > Please see http://www.bacula.org/rel-manual/faq.html#AuthorizationErrors > > for help. > > > > > > 17-Jul 16:38 app253-fd JobId 9073: Fatal error: Failed to authenticate > > Storage daemon. > > 17-Jul 16:38 backup-dir JobId 9073: Fatal error: Socket error on Storage > > command: ERR=No data available > > > > > > If I ask the client status in bconsole everything is fine: > > > > Connecting to Client app253 at 10.0.253.2:9102 > > > > app253-fd Version: 2.4.4 (28 December 2008) i486-pc-linux-gnu debian 4.0 > > Daemon started 17-Jul-09 16:37, 0 Jobs run since started. > > Heap: heap=138,492 smbytes=10,262 max_bytes=11,648 bufs=56 max_bufs=77 > > Sizeof: boffset_t=8 size_t=4 debug=0 trace=0 > > > > Running Jobs: > > Director connected at: 17-Jul-09 16:52 > > No Jobs running. > > > > > > So, I discard the possibility of password mismatch. > > > > This 3 servers are behind and router (a linux server), but they were behind > > this server for months without backup errors. > > > > Anybody has some tips to me ? The only thing I know is that the router had > > some changes, but nothing looks different, cause the other applications are > > working fine. > > > > I tried to turn off the firewall in the router but the problem persist, so > > I discard the firewall too. > > > > I'm using bacula 2.4.3 in the server and 2.4.4 in this client (the other 2 > > servers use 1.38 and I had a lot of 1.38 clients ini the network without > > problems) > > > > Regards, > > > > Marcelo H. Terres > > mhter...@gmail.com > > > > ICQ: 6649932 > > MSN: mhter...@hotmail.com > > Jabber: mhter...@jabber.org > > http://twitter.com/mhterres > > http://identi.ca/mhterres > > http://mhterres.jaiku.com/ > > > > http://mundoopensource.blogspot.com/ > > http://offtopicsandfun.blogspot.com/ > > http://www.propus.com.br > > Sent from Porto Alegre, RS, Brazil -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Diferential Backup
> On Tue, 28 Jul 2009 15:31:14 -0300, Luiz Gustavo P Tonello said: > > Hello guys, > > > I'm a newbie in Bacula, but i configure this in my office. > > So, i have one ask for us on the Diferential Backup: > Bacula make one Full backup for week (Sunday), and one Diferential > backup for day. > But, i delete an archive on Friday. > > So, I don't know in which day this file was exclude. > I will have to look in all jobs? or, as this archive existing in the > last full job, i will find this in the last job? > > > Sorry my bad english, ok? And I wait that they have understood. You can find the job using bconsole commands: Option 2 or 7 in the restore command. Option 1 or 2 in the query command. __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Resore Directory Tree
> On Wed, 8 Jul 2009 20:55:08 + (UTC), Volker said: > > Hi there, > > i wonder how i could restore a directory with all subdirectories and files > with > bacula. > Assuming i did a full backup of / and now i only want to restore /srv/www/... > with 100 subdirectories and thousands of files. And there so space left on the > systems to restore the full / to a tmp directory. :( > > any ideas? The manual is a good starting point: http://www.bacula.org/manuals/en/concepts/concepts/Restore_Command.html#SECTION001113 __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Device open but no Bacula Volume is mounted
> On Fri, 24 Jul 2009 16:52:49 +0100, Kris Monstad said: > > Hi, > > We're using Bacual v2.2.5 on Centos 4.7. > > After a power cut which affected only our LTO4 drive (server on UPS) > none of our tapes are mounting properly. The output is as follows: > > > *mount LTO4 > block.c:995 Read error on fd=5 at file:blk 0:0 on device "LTO4" > (/dev/st0). ERR=Input/output error. > block.c:995 Read error on fd=5 at file:blk 0:0 on device "LTO4" > (/dev/st0). ERR=Input/output error. > 3902 Cannot mount Volume on Storage Device "LTO4" (/dev/st0) because: > Requested Volume "" on "LTO4" (/dev/st0) is not a Bacula labeled Volume, > because: ERR=block.c:995 Read error on fd=5 at file:blk 0:0 on device > "LTO4" (/dev/st0). ERR=Input/output error. > 3905 Device "LTO4" (/dev/st0) open but no Bacula volume is mounted. > If this is not a blank tape, try unmounting and remounting the Volume. > > > Unmounting and re-mounting gives the same message. > > Any advice or thoughts on what is happening here are appreciated! I would guess that this is a hardware or operating system issue. Did you check the system logs for errors? __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How do Jobs Queue?
> On Thu, 30 Jul 2009 15:23:33 -0400, teksupptom said: > > Greetings! > > I've been working on adding automated Verify jobs to my configuration. I'd > like to abuse my tape drive as little as possible, so I have the backups set > to run as a group, then the verifies set to run at a later time as a group. > > On a normal weeknight (like tonight), I have two Incremental jobs for each > client, backing up two different FileSets. The Scheduled queue in the > Director status for tonight shows my normal Incremental jobs, apparently > sorted by client, starting with the last client in the config file and going > backwards to the first client. These jobs are set to start at the same time. > > After this section I see the Verify jobs listed. The odd thing is that the > list begins with the verify for one fileset only, listing that job from the > first client in the configuration file to the last, and then lists the other > verify job from the last client to the first. This will cause a ton of tape > movement. > > What I was hoping to see would be that the backups would proceed as normal, > both jobs for each client, then the verify jobs would follow the same > pattern, so that the tape used would only need to rewind and move forward > one time. I think they are considered in the order that the Job definitions appear in the bacula-dir.conf. To guarantee the order, it is best to use different priorities. I use priorities 1, 2, 3 etc for the backups and 201, 202, 203 etc for the corresponding verifies. __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] rejected Hello command
> On Tue, 30 Jun 2009 10:58:26 -0400, Shawn said: > > The problem is the following: > > 30-Jun 10:31 skydro-dir JobId 0: Fatal error: File daemon at > "10.6.4.230:9102" rejected Hello command > > This happens on Microsoft Windows Vista x64, Windows 2008 Server > x64, and Windows 2003 x64. > > Version I am using on the client ends are "win64bacula-3.0.1.exe" > > The file server itself is an Ubuntu 64-bit, jaunty, server edition, > with latest bacula-director package, using mysql locally for a DB. The error sounds like a version mismatch to me. What is the exact version of your bacula-director package? I think it must be 3.x to work with a 3.x file daemon. If you are running a 3.x director, then try setting debug level 200 and see what output that generates. In particular, the "http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Catalog too big / not pruning?
The job table is probably not causing the bloat, unless you have millions of rows. The space is usually consumed by the file table and its indexes. Try running vacuumdb with the --analyze and --verbose options, which prints info about the number of pages used by each table/indexes and also the number of unused rows. You can also get info from the SQL query SELECT relname, reltuples, relpages FROM pg_class ORDER BY relpages DESC; Which version of postgresql are you using? With postgresql 7, I found that regularly doing reindex on the file table indexes was needed to prevent bloat. __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] empty storage resource used for restore jobs
> On Wed, 05 Aug 2009 12:08:55 -0500, Brian Clarkson said: > > I've almost completed my upgrades from 1.36.3 to 2.4.1 but I've > encountered one last problem. I don't know the answer to your question. but 2.4.1 is an old release and is not even the latest in the 2.4.x branch. Can you try 3.0.2? __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Catalog too big / not pruning?
> On Thu, 6 Aug 2009 05:59:24 -0700, Jeremy Koppel said: > > We're running Postgresql 8.0.8; we can't currently update this machine > (we'll have to move Bacula to a newer box when we have one available). Ran > that query, and the top 4 do have very large numbers: > > > relname | reltuples | relpages > -+-+-- > file| 3.28168e+07 | 592614 OK, that is 147 bytes per row, which is about what you would expect. > file_fp_idx | 3.28168e+07 | 378580 > file_jobid_idx | 3.28168e+07 | 368832 > file_pkey | 3.28168e+07 | 364870 > > And running vacuumdb with the --analyze flag says: > > INFO: "file": found 0 removable, 32828342 nonremovable row versions in > 592867 pages > DETAIL: 0 dead row versions cannot be removed yet. > Nonremovable row versions range from 113 to 154 bytes long. > > ... > > I ran the full vacuum after that, and now it is down to 5.9GB, so I guess > all those records really weren't taking up much space. Also, the indexes > actually got bigger: > > relname | reltuples | relpages > -+-+-- > file| 3.28283e+07 | 592684 > file_fp_idx | 3.28283e+07 |90029 > file_jobid_idx | 3.28283e+07 |71896 > file_pkey | 3.28283e+07 |71895 > > I read up on it and saw that this was expected behavior, and that running a > reindex on the table should fix it. So I ran REINDEX TABLE file;, but that > didn't have any effect. I'll do some looking into that today. Look again at the sizes -- they actually got 5x smaller! Initially they were very bloated compared to the table size. > Also, I found the output from dbcheck curious. Of all the orphaned records > it found, the file records were an even number: 10,000,000. It sort of > seems like maybe dbcheck can only clean 10,000,000 records at a time. : ) > So, I have just now started running it again, and so far it has found 0 bad > Path records, 0 bad Filename records, etc., all 0 this time, until it got to > File records, where it says again: Found 1000 File records, Deleting > 1000 orphaned File records. Yes, I think there is a limit on the number of file records it will delete each time. __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] number of files mismatch question
> On Wed, 05 Aug 2009 12:05:32 -0400, uhog-v9e4 said: > > Hi all, > > I am a new bacula user running 3.02 on Ubuntu 8.04 LTS. I am backing up > about 7 clients(mix of windows and linux) to a DDS3 tape autochanger. After > testing and configuring for a few days I went live with this on Sunday with > a full backup of all clients and doing incrementals Mon-Fri. > > So the problem... Yesterday I had a power outage. Bacula was idle, but there > was a volume mounted in the drive. Today when the incrementals fired, I got > an error: Maybe the power outage caused the drive to corrupt the tape? > 05-Aug 10:25 pendual-dir JobId 39: Start Backup JobId 39, > Job=mrc-vm1-backup.2009-08-05_10.25.39_04 > 05-Aug 10:25 pendual-dir JobId 39: Using Device "Drive-1" > 05-Aug 10:25 mrc-vm1-fd JobId 39: DIR and FD clocks differ by 12 seconds, FD > automatically compensating. > 05-Aug 10:25 pendual-sd JobId 39: Volume "90m_1_1" previously written, moving > to end of data. > 05-Aug 10:26 pendual-sd JobId 39: Error: Bacula cannot write on tape Volume > "90m_1_1" because: > The number of files mismatch! Volume=1 Catalog=14 > 05-Aug 10:26 pendual-sd JobId 39: Marking Volume "90m_1_1" in Error in > Catalog. Were there any syslog messages at this time? > It correctly loaded the next volume in the autochanger and did the backups > but I'm not sure why I am getting this error? A bls on the volume shows 14 > files, but does have an interesting entry at the end. > # bls -j -V 90m_1_1 -c /etc/opt/bacula/conf/bacula-sd.conf Drive-1|tee > 90m_1_1.out > > # grep JobId= 90m_1_1.out |grep -v "Volume Record"|wc -l > 28 > > 90m_1_1.out > ... > Begin Job Session Record: File:blk=13:1 SessId=3 SessTime=1249401525 JobId=31 >Job=mrc6320-backup.2009-08-04_17.00.00_06 Date=04-Aug-2009 17:19:06 > Level=I Type=B > End Job Session Record: File:blk=13:579 SessId=3 SessTime=1249401525 JobId=31 >Date=04-Aug-2009 17:24:18 Level=I Type=B Files=417 Bytes=37,303,402 > Errors=0 Status=T > 05-Aug 10:16 bls JobId 0: Error: block.c:1010 Read error on fd=3 at file:blk > 14:0 on device "Drive-1" (/dev/nst0). ERR=Input/output error. What is the TWO EOFs setting for the device in Bacula's sd config? Does this match the setting in the drive? __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Catalog too big / not pruning?
> On Fri, 7 Aug 2009 07:55:08 -0700, Jeremy Koppel said: > > I ended up running dbcheck 3 more times. The first time got another > 10,000,000, the second another 8,000,000+, and the 3rd was trivial. Running > it a fourth time came up all 0s. Running another full vacuum got the DB > size down to 597MB, which sounds right. Nice space saving! In theory Bacula will remove stale file records, but there was a bug in some version that could leave them. > So, there has been a job in the crontab that runs the standard vacuumdb (not > full), but, it does this while Bacula is running. For the past few days, > while running the full vacuum, I shut it off as a precaution. Perhaps I > should modify the script to shut down Bacula during the standard vacuum? Is > this needed? It is probably better to avoid vacuuming while Bacula is updating the database, but there is no need to shut it down. You could run the vacuum from a Bacula admin job rather than cron if you want to control it better. I run it after the backups, so pruning has had a chance to remove records. __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Migration job marking destination volume used!
> On Thu, 6 Aug 2009 14:17:00 -0600, Robert LeBlanc said: > > I'm attempting to migrate some back-ups from our Data Domain box to tape and > am migrating our first set of jobs. Once it finished migrating the first job > it marked the LTO3 tape as used with only 50GB written. I thought the > migration jobs would leave the volume in Append until it was full or met > other criteria (volume use duration, etc) was satisfied. We are using 2.4.4. > Any help on fixing this for the rest of the jobs? Look in the Bacula log to see if it says *why* it was marked as used at that point. Also check the syslog for messages about the tape drive device. __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] number of files mismatch question
> On Fri, 7 Aug 2009 23:33:37 -0400, Mike Chisholm said: > > Were there any syslog messages at this time? > Yes > Aug 5 10:13:07 pendual kernel: [ 7737.941074] st0: Sense Key : Medium Error > [current] > Aug 5 10:13:07 pendual kernel: [ 7737.941150] Info fld=0xfc00 > Aug 5 10:13:07 pendual kernel: [ 7737.941161] st0: Add. Sense: Sequential > positioning error > This repeated 3 more times at > Aug 5 10:14:04 > Aug 5 10:16:24 > Aug 5 10:16:24 Looks very much like a hardware problem (tape corrupted). > > What is the TWO EOFs setting for the device in Bacula's sd config? Does > > this > > match the setting in the drive? > > There is no setting in the SD config so I think the default is TWO > EOF=no. I'm not sure how to check this on the drive itself. I have tried > various st, mtx, tapeinfo, and smartctl commands but none of them return > something that is obvious to me. Sorry, I don't know on Linux (on FreeBSD mt has a geteotmodel command). It is probably set to one EOF by default like Bacula. > FWIW, the last two days of backups to the > next tape have performed flawlessly so perhaps this is a bad piece of > media. It just seems pretty coincidental that I had this problem after a > power failure. I'm working on getting this system hooked to a UPS as > well. I'm not sure it's worth a lot of effort to try to figure this out, I > mainly wanted to make sure I wasn't missing something obvious. I am willing > to continue digging in it if anyone is really curious, otherwise I think I > will just let thing continue and see how it goes. Assuming there was just > some glitch caused by loss of power, I would think the next time bacula goes > to write to this media it will read the header and begin writing new data > with a new EOF after the first volume, then just appending additional > volumes and writing new EOF's after each one, correct? So any count problem > will just get overwritten. If it is actually bad media I will probably hit > it again but then I'll know and can just toss the tape. Yes, a purged and recycled tape will be written from the start next time. __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: Migration job marking destination volume used!
> On Fri, 7 Aug 2009 13:53:01 -0600, Robert LeBlanc said: > > It is really weird, I marked it as append and then when it filled up the > second tape it was using with multiple migration jobs, it tried to use the > first tape again since it was in the append state. It gave the message > "07-Aug 09:31 babacula-dir JobId 40116: Max configured use duration > exceeded. Marking Volume "43L3" as Used." The very odd thing is that it > recycled this tape before the first migration job. There is a use duration > of 20 days for tapes in this pool. I don't believe that 1.5 hours exceeds > that. Again, the second tape that is used did not have this problem and it > was recycled as well. I've marked the tape append again to see if it happens > when the thrid tape is full. This is very confusing. It does sound confusing. Yoy could check that the tape itself has the correct use duration (the pool's use duration is only used to set the value for the tape when it is added to the catalog). The llist media pool= command will show this. __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] disabling 'accurate' for a restore
> On Thu, 13 Aug 2009 10:05:14 +1000, James Harper said: > > I do a full backup once a week, and then incremental backups for the > rest of the week. > > MSSQL is configured to back up transaction logs every day and keep the > backup for 3 days (by which time it would have been backed up). It's > Thursday today and I want to restore the most recent full backup > (Saturday night) and all the subsequent transaction logs, but of course > because accurate backup is on I'm going to have to do multiple restores > at various points - restore as at Monday night to get Saturday + Sunday > logfiles, then restore at Wednesday night to get Monday + Tuesday > logfiles, etc. Restoring as at last nights backup will only give me the > logfiles that existed at the time. So why are you using accurate backups for this case? __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula backups and restores
> On Thu, 13 Aug 2009 06:13:11 -0400, tqz said: > > --===6257829277651962677== > > > Hello all > > Lets say in the event that disaster strikes and all data on my server is > lost for whatever reason. I have encrypted backups of the data on the server > stored on tapes (on and off site) and NAS. > > After reinstalling my database management system, and then firing up bacula > using copies I have of the director, client and storage daemon files how can > I then read the catalog from the encrypted tape. Is there any way I can test > this without overwriting the bacula database. Also is there a way to read > files (the director, storage and daemon) off the encrypted storage and then > restoring them using bacula command line tools or non bacula command line > tools .or am I not making any sense?! The command line tool bextract can read tapes, but it can't read encrypted backups, so you would need to dump the catalog unencrypted. That may be OK, because all the information within it is stored on the tapes unencrypted anyway (Bacula only encrypts the contents of the files, not the filenames etc). Alternatively, you could use the Write Bootstrap option in the catalog backup job and keep a copy of this file for use with the restore command in bconsole. You need to keep a copy of each backup, since it records the information about the tape. > Second thing is that I am noticing that the size of the backups on my > different storage devices are different. So for example the first backup > occurs on the tape and the size of the backup is 14.09gb, then on my second > storage device it will be 14.12gb and my third one is 14.16gb. They are all > full backups ??? Any idea why there may be different sizes Maybe encryption is non-deterministic? __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] level: Since?
The "Since" level is not implemented and AFAIK noone is working on it. Try using the bscan program to put the Full backup into the catalog. __Martin > On Tue, 25 Aug 2009 13:47:23 +0200, Mapper ict department said: > > Does anyone have an answer on this yet? The reason i ask is because exactly > at the end of the -one before last- full backup the server running the > director > and storage deamon crashed due to a kernel panic. > > At that moment the runbeforejob (dumping the bacula database / bacula catalog > from mysql) f rom our job that writes the catalog to tape was busy. > It might sound weird (or not) since there was only being read (i guess that's > the > only thing happening with a dump) from the database; tables were found > corrupt. > > Now the full backup was level F(ull) and ended with status T(erminated > normally). > We were also able to cd through the directories and files, mark files and > restore > them. > > The next incremental job wanted to run a full because there was no proper full > backup job found. Because of time constraints we were not able to run a full > backup again. > > If the level: "since" is what i think it is we could have run "manual > incremental > jobs" and set the date so that files are backuped from that one day only, > every night until the next full backup comes around again. > > Only there is not asked for a date and when the job runs with LEVEL SINCE it > fails. Error mentions something like: this level is not supported. > It would be nice though if it were possible. Does somebody has this working > already? > > With kind regards, > > Tony > > >>> "Mapper ict department" 20-8-2009 19:12 >>> > Hello, > > Can anyone tell me what the Since level is for? > > I get there by: > > - typing run > - choosing a job > - typing mod > - selecting 1: level > > With kind regards, > > Tony -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to verify an old volume
> On Tue, 25 Aug 2009 10:03:43 -0600 (MDT), James L Rogers said:
>
> Hi,
>
> I am running Bacula "Version: 3.0.2 (18 July 2009)
> x86_64-unknown-linux-gnu redhat" on "CentOS release 5.3".
>
> I want to verify a volume that was written several jobs ago. The volume
> was written to a USB drive and I am afraid that the file is corrupted. The
> volume is a differential backup that consists of 18 jobs (one job per file
> set) from 2 different clients.
>
> I have found several setups via google for the Verify job resource but
> nothing with my exact situation. Here is my current job resource which
> only tried to verify the last backup (incremental) of fileset0k and not
> the previous differential backup of fileset0k.
>
> Job {
>Name = VerifyUSB
>Type = Verify
>Level = VolumeToCatalog
>Messages = Standard
>Pool = differential
> # Client=server1.prinmath.com-fd
>Client = server2.prinmath.com-fd
>FileSet = fileset0k
>Verify Job = fileset0k
> }
>
> Here are my questions:
>
> 1) How do I specify the "VerifyJob" resource if I want an older job than
> the last backup of the specified fileset? Apparently a job number does
> work here.
There is no way to do that with a VerifyJob at the moment. It always verifies
the last matching jobid that ran.
> 2) Do I have to set up 18 Verify Jobs and run each one to verify the
> entire volume or can I address the volume in it's entirety (remembering
> that two clients wrote a total of 18 jobs to the volume).
>
> 3) Can anyone point me to a solution that is similar to my situation?
You could check the low level consistency of the volume by using the bls
command line tool, which should check at least that every block matches its
checksum.
__Martin
--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How do Jobs Queue?
>>>>> On Mon, 31 Aug 2009 13:59:29 -0400, teksupptom said: > > Martin Simmons wrote: > > > > I think they are considered in the order that the Job definitions appear in > > the bacula-dir.conf. > > > > To guarantee the order, it is best to use different priorities. I use > > priorities 1, 2, 3 etc for the backups and 201, 202, 203 etc for the > > corresponding verifies. > > > > __Martin > > > Hi Martin, > > I wish it were that simple, unfortunately the testing I've done shows there > is more involved than just the order. My nightly Incrementals are set for > the same time, and they get scheduled in the order they appear in the > file. Then the different verify jobs are scheduled at the same time, but the > verifies for one job type get scheduled, then the verifies for the other job > type. Also, the first gets scheduled in one order (first client to last), > while the other gets scheduled in opposite (last client to first). > > It's like Bacula scans the job list from top to bottom, then back up, and > back down, etc, until all jobs are queued for that day. > > I like your suggestion about priorities, but the way I read the instructions > was that jobs of a lower priority would wait until all jobs of a higher > priority finish before starting. Since we have two tape drives, and use one > of them for our large filesets, there would be times where the first tape > drive would sit idle for a day or two while waiting for all the higher > priority jobs to complete. > > Am I misunderstanding the way priority is implemented? I don't run concurrent jobs, so I'm not sure. If you set Allow Mixed Priority = yes in all jobs, then they may run concurrently at different priorities. __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Show disabled jobs
> On Fri, 4 Sep 2009 20:12:08 -0300, Daniel Bareiro said: > > I've a productive server with Debian GNU/Linux Etch for Sparc which has > installed Bacula 1.38.11. Is there in this version some way to obtain a > listing of disabled jobs? The show jobs command prints it. __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] allways full even if incremental
> On Tue, 08 Sep 2009 14:05:19 +0200, Gerald Leier said: > > hello, > > i noticed some strange behaviour when backing up > one of our linux hosts with bacula. > > bacula allways backs up everything. if i run it > 3 times in a row it allways produces the same amount > of files (Incremental backup) > > at first i thought it may be because of some timestamps > missing.. > > but the mount options are the same on hosts that dont > do a "allways full never incremental even if incremental" > backup. > > any suggestions how to debug that, or any ideas what > can cause that behaviour? > > bacula version is 3.0.1 > the filesystem taht makes trouble: > / type ext3 (rw,acl,user_xattr) > kernel: 2.6.16.60 Does Bacula upgrade all of the jobs to Full or is it running them as Incremental? The log output shows this. Are you using the same fileset for working and broken hosts? __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Building just SD from source
> On Wed, 9 Sep 2009 11:32:45 +, Joseph L Casale said: > > Is this possible to do so that mysql binaries and libraries are not > needed? Alas not, because building the SD also builds the tools like bscan, which do need a database. However, you can build Bacula with sqlite instead of mysql as long as you only need the bacula-sd program. Sqlite can be built from source in the depkgs download. __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Building just SD from source
> On Wed, 9 Sep 2009 14:45:18 +, Joseph L Casale said: > Accept-Language: en-US > Content-Language: en-US > > >Alas not, because building the SD also builds the tools like bscan, which do > >need a database. > > > >However, you can build Bacula with sqlite instead of mysql as long as you > >only > >need the bacula-sd program. Sqlite can be built from source in the depkgs > >download. > > Thanks for that info! Is it feasible for me to just jumpstart a vm quickly > and compile it as per the manual, then copy the directory to the server in > question and install just the SD, or am I overcomplicating? That should work, but I think you will need to Bacula's shared libraries as well as bacula-sd. Running ldd bacula-sd should show which ones (ignore anything in /usr/lib). __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Device "FileStorage" with MediaType "File" requested by DIR not found in SD Device resources.
> On Mon, 14 Sep 2009 09:35:41 +0200, Roger Meier said:
>
> Hi all
>
> We have some problem with bacula. I don't know where the Problem is,
> because all of our
> 7 hosts have the same configuration (only different include/exclude file
> list and hostname)
>
> All works fine now for some weeks, but now since 3-4 days we have the
> following problem,
> on some of our system (not all, some works):
>
> 14-Sep 01:05 lin-backup1-sd JobId 990: Fatal error:
> Device "FileStorage" with MediaType "File" requested by DIR not found in
> SD Device resources.
> 14-Sep 01:05 lin-backup1-dir JobId 990: Fatal error:
> Storage daemon didn't accept Device "FileStorage" because:
> 3924 Device "FileStorage" not in SD Device resources.
> 14-Sep 01:05 lin-backup1-dir JobId 990: Fatal error: Max wait time exceeded.
> Job canceled.
What does
status storage=File
print, in particular the "Device status" part?
> We have setup a cancel after 4 hours, but this shoul'd not happen,
> because the run of the
> backup is max. 1-2 hours.
>
> We have one Backup Host with one DIR and hone SD Daemon. See config
> snipped below:
>
> bacula-dir.conf:
> # Definition of file storage device
> Storage {
> Name = File
> Address = lin-backup1.intra
> SDPort = 9103
> Password = "pw4backup-sd"
> Device = FileStorage
> Media Type = File
> Maximum Concurrent Jobs = 20
> }
>
> bacula-sd.conf:
> Device {
> Name = FileStorage
> Media Type = File
> Archive Device = /data/backup
> LabelMedia = yes;
> Random Access = Yes;
> AutomaticMount = yes;
> RemovableMedia = no;
> AlwaysOpen = no;
> Autochanger = no
> }
>
> I don't know where the Problem is , because this config works some weeks
> but now this Errors :(
Maybe the SD read a different config file?
__Martin
--
Come build with us! The BlackBerry® Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9-12, 2009. Register now!
http://p.sf.net/sfu/devconf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] regular expressions in FileSets
> On Fri, 11 Sep 2009 09:07:57 +0200, Juergen Koch said: > > Hi, > > I want to split my vhost-Dir in 2 Jobs. > I use this in the FileSet: > > File = /var/www/vhosts/[a-m]* > > and > > File = /var/www/vhosts/[n-z]* > > The Job starts, but I receive this message: > > Could not stat /var/www/vhosts/[n-z]*: ERR=File or Directory not found > > But, I think, I can use regular expessions in FileSets. > > Can anybody help? See the /home/a* example in "FileSet Examples" http://www.bacula.org/3.0.x-manuals/en/install/install/Configuring_Director.html#SECTION0068 __Martin -- Come build with us! The BlackBerry® Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9-12, 2009. Register now! http://p.sf.net/sfu/devconf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Device "FileStorage" with MediaType "File" requested by DIR not found in SD Device resources.
> On Wed, 16 Sep 2009 09:05:01 +0200, Roger Meier said:
>
> The Device Status Part of "status storage=File" prints out the following:
>
> Device status:
> Device "File" (/data/backup) is not open.
> Device "LTO-2" (/dev/nst0) is not open.
> Device "LTO-3" (/dev/nst1) is not open.
OK, this shows that the SD saw the Device Name "File" in the SD config. That
doesn't match what you posted:
> bacula-sd.conf:
> Device {
> Name = FileStorage
The most likely reasons I can think of are
* this is a different config file
* the config file is corrupted, e.g. extra entries at the start
* lin-backup1.intra resolves to a different machine.
> > Maybe the SD read a different config file
> I think not, because in the init.d Script i have the following:
> daemon /usr/sbin/bacula-sd $2 ${SD_OPTIONS} -c /etc/bacula/bacula-sd.conf
> And this config is the correct, with the snipped that i have posted.
Does this command line show up in the output of ps augxww?
__Martin
--
Come build with us! The BlackBerry® Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9-12, 2009. Register now!
http://p.sf.net/sfu/devconf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Want to backup pst files in vista in addition to desktop and documents
> On Mon, 21 Sep 2009 15:08:15 -0700, Syn, Joonho said: > > Here is my new FileSet for Vista clients. It backs up these locations: > Documents > Desktop > Default pst location for outlook > Mozilla Firefox profiles > Internet Explorer Favorites > > I tried to get rid of as much cruft as possible and I only used exclude > statements since I found using includes to not be workable in any manner > that made sense. As such, if many other programs are installed besides > office and firefox there will be more cruft to get rid of but it should be a > trivial matter to add exclude lines for those as well. If you have further > refinements please share, especially if they make this list shorter! I'll > post another one for XP as soon as I get one up and running. You might get some ideas on how to do it from this example: http://article.gmane.org/gmane.comp.sysutils.backup.bacula.devel/12576 __Martin -- Come build with us! The BlackBerry® Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9-12, 2009. Register now! http://p.sf.net/sfu/devconf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Building bacula-fd on OpenBSD 4.5
> On Sun, 11 Oct 2009 20:43:22 -0300, Daniel Bareiro said: > > I'm trying to compile Bacula 3.0.2 with the source code from the > official site. For it I've dowloaded the bacula-3.0.2.tar.gz file. > <...> > Making libbaccfg.la ... > /tmp/bacula-3.0.2/libtool --silent --tag=CXX --mode=link /usr/bin/g++-o > libbaccfg.la parse_conf$(DEFAULT_OBJECT_TYPE) res$(DEFAULT_OBJECT_TYPE) > -export-dynamic -rpath /usr/lib -version-info 1:0:0 > /bin/sh: DEFAULT_OBJECT_TYPE: not found > /bin/sh: DEFAULT_OBJECT_TYPE: not found It is the same with FreeBSD 4.9 -- some BSD make implementations can't handle Bacula's makefiles. Try using gmake (GNU make). __Martin -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Building bacula-fd on OpenBSD 4.5
>>>>> On Mon, 12 Oct 2009 11:12:58 -0300, Daniel Bareiro said: > Hi, Martin. > > On Monday, 12 October 2009 11:36:38 +0100, > Martin Simmons wrote: > > > >>>>> On Sun, 11 Oct 2009 20:43:22 -0300, Daniel Bareiro said: > > > > > > I'm trying to compile Bacula 3.0.2 with the source code from the > > > official site. For it I've dowloaded the bacula-3.0.2.tar.gz file. > > > <...> > > > Making libbaccfg.la ... > > > /tmp/bacula-3.0.2/libtool --silent --tag=CXX --mode=link /usr/bin/g++ > > > -o libbaccfg.la parse_conf$(DEFAULT_OBJECT_TYPE) > > > res$(DEFAULT_OBJECT_TYPE) -export-dynamic -rpath /usr/lib -version-info > > > 1:0:0 > > > /bin/sh: DEFAULT_OBJECT_TYPE: not found > > > /bin/sh: DEFAULT_OBJECT_TYPE: not found > > > It is the same with FreeBSD 4.9 -- some BSD make implementations can't > > handle Bacula's makefiles. Try using gmake (GNU make). > > With gmake it seems that no longer appear the errors that I've mentioned > before: Great. > <...> > The make of console draws attention to me since I am only installing > bacula-fd. I think the client-only install includes the console because you sometimes want to run that on the client machine too. > Then I get another problem with 'make install'. It will be that I need to > install autoconf? > > > fugu:/tmp/bacula-3.0.2# gmake install > ./autoconf/mkinstalldirs /usr/sbin > gmake: ./autoconf/mkinstalldirs: Command not found > gmake: *** [installdirs] Error 127 > > I tried installing it, but I continue obtaining the same message of error. Does ./autoconf/mkinstalldirs exist in your build directory? It is part of the Bacula source distribution. __Martin -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Building bacula-fd on OpenBSD 4.5
> On Wed, 14 Oct 2009 07:08:24 -0300, Daniel Bareiro said: > > <...> > fugu:~# uname -a > OpenBSD fugu.freesoftware.org 4.5 KVM3#0 i386 > > fugu:~# ps ax|grep bacula > 12613 ?? Ss 0:03.20 /usr/sbin/bacula-fd -u _bacula -g _bacula -v -c > /etc/bacula/bacula-fd.conf > > fugu:~# netstat -at|grep 9102 > tcp0 0 *.9102 *.*LISTEN > > > In the director: > > *status client=fugu-fd > Connecting to Client fugu-fd at fugu.freesoftware.org:9102 > > fugu-fd Version: 3.0.2 (18 July 2009) i386-unknown-openbsd4.5 openbsd 4.5 > Daemon started 12-Oct-09 20:25, 2 Jobs run since started. > Heap: heap=0 smbytes=7,384 max_bytes=417,683 bufs=48 max_bufs=102 > Sizeof: boffset_t=8 size_t=4 debug=0 trace=0 > > Running Jobs: > Director connected at: 14-Oct-09 06:37 > No Jobs running. > > > Terminated Jobs: > JobId LevelFiles Bytes Status FinishedName > > 2325 Full8391.585 M OK 13-Oct-09 02:08 Fugu > 2333 Incr 0 0 OK 14-Oct-09 02:07 Fugu > > > > In the FileSet resource for this client I'm doing backup of all the > /etc, but there are some files and directories which aren't able to be > copied. I consider that this is because the process (running with > bacula: bacula) cannot access to those files and directories by the > restrictive permissions that these have. Normally the bacula-fd should be run as root. Only the bacula-dir and possibly the bacula-sd shluld be run as the bacula user. __Martin -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bextract -- restore single occurrence of file
> On Thu, 15 Oct 2009 02:40:33 -0700 (PDT), cby said: > > Running bacula on Centos 5.2 I have a tape volume which has more than one > occurrence of the same filename as a result of appending to tape. I needed > to restore the first file. > > I fired up bextract (standard bacula restore is not appropriate in this > case) which restored the first occurrence of the file as expected. However, > instead of halting after restoring the file, bextract continued to the end > of the tape and found a second occurrence with the same filename which it > duly restored replacing the originally restored file. > > Bearing in mind that the file is over 300GB (Veeam backup) I want to avoid a > repeat of this exercise without being able to halt bextract after the > initial file restore. I have looked through the bacula documentation and > usual places but there does not appear to be an obvious way to instruct > bextract to restore the first occurrence of a file. > > Fortunately the two files were written some distance apart on the tape so I > can kill the bextract process once the first file has been restored. Not > exactly elegant but it should work. > > I'd be grateful for any suggestions in how bextract itself can achieve this > without recourse to my sledgehammer approach! It can be done by creating a bootstrap file: http://www.bacula.org/en/rel-manual/Volume_Utility_Tools.html#SECTION003962000 http://www.bacula.org/en/rel-manual/Bootstrap_File.html#BootstrapChapter __Martin -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Building bacula-fd on OpenBSD 4.5
>>>>> On Thu, 15 Oct 2009 07:34:57 -0300, Daniel Bareiro said: > > On Wednesday, 14 October 2009 17:38:59 +0100, > Martin Simmons wrote: > > > > In the FileSet resource for this client I'm doing backup of all the > > > /etc, but there are some files and directories which aren't able to > > > be copied. I consider that this is because the process (running with > > > bacula: bacula) cannot access to those files and directories by the > > > restrictive permissions that these have. > > > Normally the bacula-fd should be run as root. Only the bacula-dir and > > possibly the bacula-sd shluld be run as the bacula user. > > Perfect. Thanks for the indication, Martin. > > Do you think that it is appropriate to starting bacula-fd with the > script in /etc/bacula/scripts using the following lines in the > /etc/rc.local file? > > # DGB - 20091012 > # Starting bacula-fd on boot > if [ -x /etc/bacula/scripts/bacula-ctl-fd ]; then > /etc/bacula/scripts/bacula-ctl-fd start > fi > > There is some way to normally stop daemon during shutdown/reboot of the > operating system? If OpenBSD uses /usr/local/etc/rc.d like FreeBSD, then it would be better to add a script there. Otherwise, /etc/rc.local would be fine for startup. __Martin -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape Volumes
This probably won't fix the problem here, but I suggest changing /dev/st0 to
/dev/nst0. Using /dev/st0 can cause data loss if the tape rewinds without
Bacula knowing.
__Martin
> On Thu, 15 Oct 2009 09:30:33 -0300, Pedro Bordin Hoffmann said:
>
> Thanks for all your help.
> I think Im understanding a little more of bacula :P
>
> im in my 3 tape, and is asking me this:
>
> Device "Fita" (/dev/st0) is not open.
> Device is BLOCKED waiting to create a volume for:
>Pool:FullBackupsTapePool
>Media type: Tape
>
>
> What is that?
>
> Thanks
>
> 2009/10/14 terryc
>
> > Pedro Bordin Hoffmann wrote:
> > > Hello!
> > > Im doing some backup that required 2, 3 tapes.. so my question is..
> > > The label of first tape is monday. and when I put a second tape.. should
> > I
> > > name it like monday-2 ? or something else? Or Monday again?
> >
> > Yes, you can label the second tape monday-2 or similar
> >
> > > When will I make a second time this backup, should I need to label the
> > tape
> > > again? Or just put the tape when the other fills up?
> >
> > Once you label the tapes, they retain that label "forever" in baculas view.
> >
> > Bacula is different from other backup programs. It keeps track of the
> > tapes and their contents (until record expiry dates are met) and runs
> > things from the tape it decideds it wants (oldest expired).
> >
> > If you are accustomed to a GFS backup system, then you need to set up a
> > seperate pool for each level. If you are one of those places that
> > backups up stuff on monday to a specific set of tapes on monday, then
> > you need a pool of tapes for such an activity.(you also need to carefuly
> > set expiry dates so those tapes are available when next needed (say five
> > days for a week or 12 days for a fortnight).
> >
> > If you want to post to the list an outline of your backup policy, then
> > I'm sure people will give you some guidance/suggestions.
> >
> >
> >
> > --
> > Terry Collins {:-)}
> > Bicycles, Appropriate Technology, Natural Environment, Welding
> >
> >
> > --
> > Come build with us! The BlackBerry(R) Developer Conference in SF, CA
> > is the only developer event you need to attend this year. Jumpstart your
> > developing skills, take BlackBerry mobile applications to market and stay
> > ahead of the curve. Join us from November 9 - 12, 2009. Register now!
> > http://p.sf.net/sfu/devconference
> > ___
> > Bacula-users mailing list
> > Bacula-users@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/bacula-users
> >
--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bextract -- restore single occurrence of file
> On Sat, 17 Oct 2009 04:34:52 -0700 (PDT), cby said: > > Jesper > > > Jesper Krogh wrote: > > > >> I fired up bextract (standard bacula restore is not appropriate in this > >> case) which restored the first occurrence of the file as expected. > >> However, > >> instead of halting after restoring the file, bextract continued to the > >> end > >> of the tape and found a second occurrence with the same filename which it > >> duly restored replacing the originally restored file. > > > > I suggest you open a bug-report/feature request on this.. this seems > > like a really nasty situation to get into if stuff really "burns". > > > > Jesper > > > > > > > Interestingly, I tried Martin's suggestion of using a bootstrap file. I > defined two parameters: Volume name = volname and Count = 1. My > understanding was that once the number of restored files hit the Count value > bextract would stop. This wasn't the case. That may be a bug. > I also used an include-list file > when running bextract so there may be a clash when using -b and -i > command-line options. I wasn't able to provide all the parameters to use > just a bootstrap file. I think you can get the job-related parameters by running bls. __Martin -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] version 3
> On Thu, 22 Oct 2009 03:23:11 -0400, glynd said: > > When the backup runs I keep getting this error: > > 22-Oct 09:09 glyn-laptop-fd JobId 161: Could not stat > "/var/lib/bacula/bin/bacula.sql": ERR=The system cannot find the path > specified. > > The file exists and is owned by bacula.root and chmod is 664 > > Why would this happen? > > This is the backup of the catalog, BTW Do have the correct client in the job definition? It is looking for the file on glyn-laptop-fd. __Martin -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] version 3
> On Fri, 23 Oct 2009 09:56:49 -0400, glynd said:
>
> Sorry forget this
> # Backup the catalog database (after the nightly save)
> Job {
> Name = "SugarCatalog"
> JobDefs = "SugarJob"
> ...
>
> Job {
> Name = "CumulusCatalog"
> JobDefs = "CumulusJob"
> ...
>
> Job {
> Name = "ColynCatalog"
> JobDefs = "ColynJob"
> ...
>
> Job {
> Name = "GlynCatalog"
> JobDefs = "GlynJob"
> ...
>
> Job {
> Name = "TyphoonCatalog"
> JobDefs = "TyphoonJob"
> ...
Wow, you have 5 different catalogs?! That's unusual.
Are they running on 5 different machines (specified via the JobDefs), which
are all different from your Bacula Director machine?
If so, then you'll either need to use ClientRunBeforeJob and ClientRunAfterJob
to dump the backups on the correct machine or have variants of the
make_catalog_backup script to connect to the correct machine.
Don't forget that the catalog backup job is just a normal job that uses a
normal Bacula FD. You have to ensure that the sql file is present on that
Bacula FD.
__Martin
--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] losing directory permissions and ownership
> On Mon, 26 Oct 2009 10:52:47 +0200, Avi Rozen said: > > Hi, > > I'm at my wits end here. I'd appreciate any feedback on this. > > I have the following directory > > /home/avrozen/temp/bacula-test/owned-by-root/owned-by-avrozen/owned-by-bacula/bacula-test > > with some files in it. I've specifically chowned the directories and > files to different users and groups. > > The relevant director configuration is at the bottom of this message. > Note the single File directive pointing to the directory above. > > When I restore the files all parent directories except for bacula-test > lose their permissions and owner/group (all are set to 0751/drwxr-x--x > root:root). > > I'd like to cherry pick directories to backup and have them restored > with correct ownership and permissions... > > What am I doing wrong? Is this the expected behavior? Yes, this is the expected behavior. During a backup, Bacula looks inside the directories you give in the 'File =' lines and doesn't save any information about the parents. It is difficult to get the cherry picking behaviour, but I think it is possible. You need to start higher up the tree and use two Options clauses to select the files to include and exclude. The first Options clause must match only what you want to back up (the parent directories themselves plus the cherry picked files/directories, but not other contents of the parent directories). The second Options clause should use wild = "*" and Exclude=yes to remove everything else. __Martin -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] version 3
> On Mon, 26 Oct 2009 02:17:49 -0400, glynd said: > > Martin, Cedric, Thanks for the input. > I think my understanding as to how to set up Bacula is a bit off! > The configuration is this: > > mistral Ubuntu machine runs the Director, fd and sd with a USB hard drive > connected to back up to. mistral hosts sugarcrm and the database is backed > up. cumulus is a NAS without a client and an nfs mount point allows it to be > backed up. > > typhoon Ubuntu machine runs a client and is backed up using the typhoon-fd > > Both glyn-laptop and colyn-acer-7 are windows laptops and are running > clients. Both are backed up during the daytime schedule using the file > daemons. > > From what you are saying, I don't need multiple catalogs, am I right? Correct. All of the jobs can share a single catalog. > I would appreciate a critique of the director.conf which I have pasted > below, so I can get Bacula running smoothly. I hope you don't mind pasting > such a large lump... At a quick glance, it looks OK except for the catalog backups. You already have a single catalog, which is good. To back it up, you need only one Catalog backup job, specifying Client = mistral-fd. __Martin -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] losing directory permissions and ownership
>>>>> On Tue, 27 Oct 2009 00:22:37 +0200, Avi Rozen said:
>
> Martin Simmons wrote:
> >>
> >> I'd like to cherry pick directories to backup and have them restored
> >> with correct ownership and permissions...
> >>
> >> What am I doing wrong? Is this the expected behavior?
> >>
> >
> > Yes, this is the expected behavior.
> >
> > During a backup, Bacula looks inside the directories you give in the 'File
> > ='
> > lines and doesn't save any information about the parents.
> >
> >
>
> Would be nice if it did...
>
> > It is difficult to get the cherry picking behaviour, but I think it is
> > possible. You need to start higher up the tree and use two Options clauses
> > to
> > select the files to include and exclude. The first Options clause must
> > match
> > only what you want to back up (the parent directories themselves plus the
> > cherry picked files/directories, but not other contents of the parent
> > directories). The second Options clause should use wild = "*" and
> > Exclude=yes
> > to remove everything else.
> >
>
> Thanks for the explanation and tips.
>
> I tried it and a few other file set configurations, based on the
> examples in [1], specifically the following, which is supposed to
> include only home directories of users whose usernames start with either
> 'a' or 'b':
>
> FileSet {
> Name = "Full Set"
> Include {
> Options {
> wilddir = "/home/a*"
> wilddir = "/home/b*"
> }
> Options {
> RegexDir = ".*"
> exclude = yes
> }
> File = /home
> }
> }
>
> But I can't get bacula to do what I want. I tried the following file
> set to backup files in my test directory, but it excludes everything
> except for files in the root directory:
>
> FileSet {
> Name = test-fileset
> Include {
> Options {
> wilddir =
> "/home/avrozen/temp/bacula-test/owned-by-root/owned-by-avrozen/owned-by-bacula"
> }
> Options {
> regexdir = ".*"
> Exclude = yes
> }
> File = /
> }
> }
>
> Any ideas? What am I missing?
You need to match the parent directories themselves and then the contents of
owned-by-bacula:
FileSet {
Name = test-fileset
Include {
Options {
# Match all directories leading up to the cherry picked directory
regexdir = "^/home$"
regexdir = "^/home/avrozen$"
regexdir = "^/home/avrozen/temp$"
regexdir = "^/home/avrozen/temp/bacula-test$"
regexdir = "^/home/avrozen/temp/bacula-test/owned-by-root$"
regexdir =
"^/home/avrozen/temp/bacula-test/owned-by-root/owned-by-avrozen$"
# Match the cherry picked directory itself
regexdir =
"^/home/avrozen/temp/bacula-test/owned-by-root/owned-by-avrozen/owned-by-bacula$"
# Match the contents of the cherry picked directory
wild =
"/home/avrozen/temp/bacula-test/owned-by-root/owned-by-avrozen/owned-by-bacula/*"
}
Options {
# Skip everything else
wild = "*"
Exclude = yes
}
File = /
}
}
Note the $ at the end of each regexdir to make it match only the directory and
nothing else with that prefix.
__Martin
--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] losing directory permissions and ownership
>>>>> On Wed, 28 Oct 2009 06:25:54 +0200, Avi Rozen said:
>
> Martin Simmons wrote:
> > You need to match the parent directories themselves and then the contents of
> > owned-by-bacula:
> >
> > FileSet {
> > Name = test-fileset
> > Include {
> > Options {
> > # Match all directories leading up to the cherry picked directory
> > regexdir = "^/home$"
> > regexdir = "^/home/avrozen$"
> > regexdir = "^/home/avrozen/temp$"
> > regexdir = "^/home/avrozen/temp/bacula-test$"
> > regexdir = "^/home/avrozen/temp/bacula-test/owned-by-root$"
> > regexdir =
> > "^/home/avrozen/temp/bacula-test/owned-by-root/owned-by-avrozen$"
> > # Match the cherry picked directory itself
> > regexdir =
> > "^/home/avrozen/temp/bacula-test/owned-by-root/owned-by-avrozen/owned-by-bacula$"
> > # Match the contents of the cherry picked directory
> > wild =
> > "/home/avrozen/temp/bacula-test/owned-by-root/owned-by-avrozen/owned-by-bacula/*"
> > }
> > Options {
> > # Skip everything else
> > wild = "*"
> > Exclude = yes
> > }
> > File = /
> > }
> > }
> >
> > Note the $ at the end of each regexdir to make it match only the directory
> > and
> > nothing else with that prefix.
> >
> > __Martin
> >
> >
> Works! Thanks!
>
> It also works if I replace regexdir with wilddir (and remove the ^ and $).
Ah, yes, wilddir will suffice here. I was just overly cautious about wilddir
matching a prefix, but that only happens with a trailing *, for example
merging
wilddir = "/a/b/c/owned-by-bacula"
wild = "/a/b/c/owned-by-bacula/*"
into one line like this:
wild = "/a/b/c/owned-by-bacula*"
will spuriously match /a/b/c/owned-by-bacula-but-unwanted.
__Martin
--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Files/directories missing in backup
> On Thu, 29 Oct 2009 11:07:30 +0100, "Kjartan Kvamme said: > > I have a backup job set up to back up among other things several > Mercurial repositories. > > Yesterday, I accidentally overwrote one of the "hgrc" files, so I wanted > to restore it from a backup, but then I discovered that the backup > apparently contained none of the "hgrc" files from any of the > repositories, even though the other content (most of it at least) of the > directory was in the backup. > > When I decided to look into it a bit more today, I found that the new > "hgrc" file I had created as a replacement for the one I accidentally > overwrote had now been included in the nightly backup, even though no > copies of the previous versions had been backed up. Also, a new > repository that was created yesterday had its "hgrc" included in the > backup as well. Every other repository created before yesterday were > missing their "hgrc" files. > > On further examination, I also discovered that some repository > directories were missing entirely from the backup, and attempting to > restore one of the repositories reveals that lots of files are missing > from within it as well. > > The directory structure is like this: > > /home/source/hg/repos/ - Contains all repositories - some of these are > included in the backup (except "hgrc") and some were missing entirely > from the backup > > Bacula is currently configured to back up "/etc", "/var/lib/mysql" and > "/home/source". > > A full backup was run initially, and incremental backups run nightly. > > The operating system is Ubuntu 9.04. > > What could be causing this problem? The problem will occur if the files appear to be older than the date of the full backup. You can check for that by running /usr/bin/stat on one of the missing files. If that is the problem, then it could happened if you used mv to move an old tree of files into the /home/source/hg/repos/ directory from somewhere else. The solution is to either touch the files (I don't know if Mercurial will be confused by that) or use the Accurate option in Bacula 3.0 to ensure that it tracks these "old" new files. __Martin -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] hang immediately after "Start UA server"
>>>>> On Mon, 2 Nov 2009 18:57:09 -0800, Jo Rhett said: > > On Oct 22, 2009, at 11:10 AM, Martin Simmons wrote: > > I recommend getting rid of that MySQL client installation and using > > the > > precompiled package for the mysql-client port, which doesn't have this > > problem. Version 5.0 is on the media and other versions are on the > > FreeBSD > > ftp site. > > I downloaded mysql51-client from the freebsd site, and tried it out. > Results? > > 1. Using it with the bacula compiled against the old revision > produced an immediate error at the exact same point, saying it > couldn't find the pthread function. So yeah, bacula had bound to a > pthread call inside mysql and the downloaded client didn't have it. > > Great! So now I just recompile bacula against this mysql and it > should fall through to the system pthread implementation, right? Nope. > > /d/usr/ports/sysutils/bacula-server/work/bacula-3.0.3/libtool --silent > --tag=CXX --mode=link /usr/bin/c++ -L/usr/local/lib -L../lib -L../ > cats -L../findlib -o bacula-dir dird.o admin.o authenticate.o > autoprune.o backup.o bsr.o catreq.o dir_plugins.o dird_conf.o expand.o > fd_cmds.o getmsg.o inc_conf.o job.o jobq.o migrate.o mountreq.o > msgchan.o next_vol.o newvol.o pythondir.o recycle.o restore.o > run_conf.o scheduler.o ua_acl.o ua_cmds.o ua_dotcmds.o ua_query.o > ua_input.o ua_label.o ua_output.o ua_prune.o ua_purge.o ua_restore.o > ua_run.o ua_select.o ua_server.o ua_status.o ua_tree.o ua_update.o > vbackup.o verify.o -lbacfind -lbacsql -lbacpy -lbaccfg -lbac -lm -L/ > usr/local/lib/mysql -lmysqlclient_r -lz -lpthread -lintl -lwrap - > lssl -lcrypto > backup.o(.text+0x1691): In function `send_accurate_current_files(JCR*)': > : undefined reference to `db_accurate_get_jobids(JCR*, B_DB*, > JOB_DBR*, db_list_ctx*)' > backup.o(.text+0x16d6): In function `send_accurate_current_files(JCR*)': > : undefined reference to `db_list_handler(void*, int, char**)' > ua_restore.o(.text+0x2076): In function > `user_select_jobids_or_files(UAContext*, RESTORE_CTX*)': > : undefined reference to `db_accurate_get_jobids(JCR*, B_DB*, > JOB_DBR*, db_list_ctx*)' > vbackup.o(.text+0xe95): In function `do_vbackup(JCR*)': > : undefined reference to `db_accurate_get_jobids(JCR*, B_DB*, > JOB_DBR*, db_list_ctx*)' > /usr/local/lib/libbacsql.so: undefined reference to > `__er...@libmysqlclient_16' > *** Error code 1 Do you have the broken bacula package installed in /usr/local still (or at least is /usr/local/lib/libbacsql.so still there)? This build is erroneously trying to link against it, which looks like a bug in the Makefile (putting -L/usr/local/lib at the beginning). That should be fixable by uninstalling the old bacula package first. > Each subdirectory below this also fails out with the same problem. > > So I got the latest port from freebsd 5.1.40 and compiled that, and > compiled 3.0.3 against that and it compiles fine back we're back to > the same problem. Sorry, I can't parse your last sentence. Is this success or failure? __Martin -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore job don't know in which storage is the volume
> On Fri, 30 Oct 2009 16:13:58 -0300, Victor Hugo dos Santos said: > ... > > If I select yes... bacula show this message: > > == > 30-Oct 15:13 bacula-sd JobId 16787: Please mount Volume > "oracle-completo-0901" for: > Job: Restaurar.2009-10-30_15.13.09 > Storage: "FileStorage" (/var/bacula) > Pool: Default > Media type: File > == > > because the volumen isn't on storage0, but yes on storage1. > > well.. IMHO, the problem is in this line: > -- > Storage "" not found, using Storage "Storage0" from MediaType "File". > Bootstrap records written to /var/lib/bacula/bacula-dir.restore.2.bsr > -- > > why bacula, don't know in which local/storage it saved the volume and > try to use the "storage0" for default ?? Bacula uses the media type to choose the storage. You need to configure different media types for each storage and then update the existing volumes to match. __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Verify Job: Warning: The following files are in the Catalog but not on the Volume(s):
>>>>> On Tue, 10 Nov 2009 10:54:26 +0100, Ralf Gross said: > > Martin Simmons schrieb: > > >>>>> On Tue, 3 Nov 2009 09:51:17 +0100, Ralf Gross said: > > > > > > bacula 3.0.2, psql, debian etch > > > > > > Every now and then I receive error mails about missing files from verify > > > jobs > > > where I can't find the problem. > > > > Does it report all files as missing in that case or is it some subset? > > Not all. > > > > What does the end of the email look like, i.e. the job report from "Build > > OS:" > > to "Termination:"? > > > This verify job complained only about missing files in /usr. Ah, this is a good clue. What is the fileset definition? Maybe it includes the /usr directory twice? __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] command line editing
> On Wed, 11 Nov 2009 09:28:13 +0100, Christoph Litauer said: > > Dear bacula users, > > another question: I wonder if I can configure or compile bconsole in a > way that I can use history and/or command line editing in a linux/mac > terminal? > Now, even typing a backspace confuses my terminal ... Try building with the --disable-conio argument to configure. Then Bacula will use readline if you have it installed (on Linux you'll need readline-devel as well). __Martin -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Files Examined?
> On Sat, 22 Dec 2007 08:29:54 -0500 (EST), Steve Thompson said: > > Here's something interesting. Bacula 2.2.4 on both client (64-bit CentOS > 4.5) and director (32-bit CentOS 4.5). > > During a backup: > > JobId 3516 Job asimov_data7.2007-12-20_23.00.08 is running. > Backup Job started: 20-Dec-07 23:44 > Files=111,850 Bytes=1,863,801,574 Bytes/sec=15,977 Errors=0 > Files Examined=16,999,856 > Processing file: /mnt/mda/data7/XXX > SDReadSeqNo=5 fd=14 > > The "Files Examined" count will eventually go to about 18.5 million by the > end of the backup (for every full or incremental backup). However, the > include list for this job includes only a single relatively static file > system, on which there are only just over 13 million inodes in use: > > FilesystemInodes IUsed IFree IUse% Mounted on > /dev/sdh136552704 13377854 23174850 37% /mnt/mda/data7 > > So what is the "Files Examined" count really telling me? The JobFiles > count from a 'list job' is correct, however. Do you have lots of hard links in that filesystem? Bacula will count those as files but df will not show them. > Secondly, note the very low bytes/sec figure for this backup. This is an > ext3 file system with dir_index turned off: an incremental backup takes > 25-30 hours to complete. I have an identical copy of this file system on > the same client with dir_index turned on: an incremental backup of this > takes only 4 hours. Both are SAS 300GB 10k rpm, RAID-1. Lots of > directories over 4K, I suspect, but I don't know the count. A Bacula backup has to stat every file in the filesystem, so dir_index could make quite a difference. __Martin - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Compiling on AIX
> On Thu, 27 Dec 2007 23:52:42 +0100, V Lanny Rosicky said: > > I am trying to install on AIX 5.3.0 running make install after > configuring thusly > > ./configure --enable-client-only > > after > > make install I get > > make: Cannot find a rule to create target ../findlib/libfind.a from > dependencies. It probably didn't build libfind.a for some reason. Did you run ``make'' before ``make install''? That is necessary. __Martin - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] port 9101 not closed after bacula-director stop
> On Wed, 02 Jan 2008 15:23:09 +0100, le dahut said: > > Hello, > > I wrote a few weeks ago about the error "Cannot bind port 9101". > > Here is an output from once I have stopped bacula-director using the > standard inti scripts : > > And from : > [EMAIL PROTECTED]:~# netstat -anpee|grep 91 > tcp0 0 0.0.0.0:91010.0.0.0:* LISTEN 0 > 10165548 20136/slapd That is bizare, slapd (presumably) is actually listening on that port. Maybe your /etc/services is corrupted so all names map to 9101? Or you get the services db from NIS etc and that is corrupt (check the "services" line in /etc/nsswitch.conf)? __Martin - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Compiling on AIX
>>>>> On Wed, 2 Jan 2008 13:18:42 +0100, V Lanny Rosicky said: > > On 2-Jan-08, at 12:14 , Martin Simmons wrote: > > >>>>>> On Thu, 27 Dec 2007 23:52:42 +0100, V Lanny Rosicky said: > >> > >> I am trying to install on AIX 5.3.0 running make install after > >> configuring thusly > >> > >> ./configure --enable-client-only > >> > >> after > >> > >> make install I get > >> > >> make: Cannot find a rule to create target ../findlib/libfind.a from > >> dependencies. > > > > It probably didn't build libfind.a for some reason. > > > > Did you run ``make'' before ``make install''? That is necessary. > > > > __Martin > > Yes, I did make but it did not do anything but say target ".PATH" is > up to date. > > After make distclean I get > > Stop. > make: The error code from the last command is 1. .PATH is not real target, so something is confused. Is this IBM's make? My guess is that you'll need to use GNU make (maybe called gmake) to build Bacula. __Martin p.s. Please keep the list CCed so everyone can contribute. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
