Re: [Bacula-users] Bacula 5.2.11: Director crashes
Hello Stephen, On 09/12/2012 09:39 PM, Stephen Thompson wrote: We updated our bacula server from 5.2.10 to 5.2.11 earlier today. A few hours later the bacula-dir crashed. This is on RedHat 6.3. No traceback generated. Marco has founded the problem and he has pushed a fix in the git repository. If you want to stay on 5.2.11, you need to apply the patch as advised in http://bugs.bacula.org/view.php?id=1932 or c8bd70b8d23c60f10afa134e347e778450dd0c33 in the git repository. Bye Stephen On 09/12/2012 05:45 AM, Uwe Schuerkamp wrote: Hi folks, I updated one of our bacula servers to 5.2.11 today (CentOS 6.x, compiled from source), but sadly the director crashes after a couple of copy jobs which were due this morning. Any idea how to go about debugging the issue? The server has a dir-bactrace file, but it appears to be empty, also the last couple of lines in the log file don't give away much beyond the selected jobids for copying. All the best, Uwe -- Need professional help and support for Bacula ? Visit http://www.baculasystems.com -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Problem on restore job
Hi all, I have a production machine and a second one as Disaster Recovery. What I want is that the first machine after his normal backup was restored on the DR server I made a cron script that run this restore but I receive always this error: 13-set 07:02 bacula-dir JobId 11294: Start Restore Job RestoreFiles.2012-09-13_07.02.06_51 13-set 07:02 bacula-dir JobId 11294: Using Device DEV-nas 13-set 07:02 bacula-sd JobId 11294: Ready to read from volume V-weekly-0002 on device DEV-nas (/mnt/backup/backup). 13-set 07:02 bacula-sd JobId 11294: Forward spacing Volume V-weekly-0002 to file:block 0:210. 13-set 07:05 bacula-sd JobId 11294: Error: block.c:319 Volume data error at 2:878168506! Block checksum mismatch in block=146766 len=61032: calc=801dc935 blk=f00063ce 13-set 07:05 bacula-sd JobId 11294: Fatal error: fd_cmds.c:169 Command error with FD, hanging up. 13-set 07:05 bacula-dir JobId 11294: Error: Bacula bacula-dir 5.2.10 (28Jun12): Build OS: i686-pc-linux-gnu redhat JobId: 11294 Job: RestoreFiles.2012-09-13_07.02.06_51 Restore Client: webhoster-dr-fd Start time: 13-set-2012 07:02:08 End time: 13-set-2012 07:05:59 Files Expected: 203,262 Files Restored: 2,746 Bytes Restored: 154,595,398 Rate: 669.2 KB/s FD Errors: 0 FD termination status: OK SD termination status: Error Termination: *** Restore Error *** - What does it means? I use CentOS 5.4 + Bacula 5.2.10 Thank you --- Carlo Filippetto -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula repository for RHEL/CentOS/Fedora (5.2.11 + crash fix)
Hello, yesterday I updated the repository to version 5.2.11, I'll be pushing another build for the same version in the next hours that fixes the director crash (bug #1932) plus some other small changes. http://repos.fedorapeople.org/repos/slaanesh/bacula/README.txt http://repos.fedorapeople.org/repos/slaanesh/bacula Regards, --Simone -- You cannot discover new oceans unless you have the courage to lose sight of the shore (R. W. Emerson). -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem on restore job
On Thu, 13 Sep 2012 10:11:27 +0200 Carlo Filippetto carlo.filippe...@gmail.com wrote: [...] 13-set 07:02 bacula-sd JobId 11294: Ready to read from volume V-weekly-0002 on device DEV-nas (/mnt/backup/backup). 13-set 07:02 bacula-sd JobId 11294: Forward spacing Volume V-weekly-0002 to file:block 0:210. 13-set 07:05 bacula-sd JobId 11294: Error: block.c:319 Volume data error at 2:878168506! Block checksum mismatch in block=146766 len=61032: calc=801dc935 blk=f00063ce 13-set 07:05 bacula-sd JobId 11294: Fatal error: fd_cmds.c:169 Command error with FD, hanging up. [...] Looks like you're backing up into file volumes, right? Can you verify you don't have faulty disk hardware? -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Script fail, continue backup, report error
Hi
Despite Bacula is quite easy to operate I got a small problem.
On a server I run a script before the backup is started (mysqldump).
Sometimes it happens that the script fails on a part of the job. The
situation is then that data is not complete but that is better than
nothing. I want the backup to continue and do the actual backup. When
the job is finish I want to have a failure report by email if the script
failed.
My beforeScript looks like this:
RunScript {
RunsWhen = Before
FailJobOnError = No
RunsOnFailure = yes
RunsOnClient = Yes
Command = /etc/backup/dump_all_db
}
The FailJobOnError makes the backup continue despite the error, but
the error report says OK.
How can I get failure report and also a backup of the data which is OK?
--
Venlig hilsen
Hans Schou
tel:46923438
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Script fail, continue backup, report error
On 13/09/2012 10:01 PM, Hans Schou wrote:
Hi
Despite Bacula is quite easy to operate I got a small problem.
On a server I run a script before the backup is started (mysqldump).
Sometimes it happens that the script fails on a part of the job. The
situation is then that data is not complete but that is better than
nothing. I want the backup to continue and do the actual backup. When
the job is finish I want to have a failure report by email if the script
failed.
My beforeScript looks like this:
RunScript {
RunsWhen = Before
FailJobOnError = No
RunsOnFailure = yes
RunsOnClient = Yes
Command = /etc/backup/dump_all_db
}
The FailJobOnError makes the backup continue despite the error, but
the error report says OK.
How can I get failure report and also a backup of the data which is OK?
Make the /etc/backup/dump_all_db script do the reporting?
Cheers,
GaryB-)
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restoring catalog backup from old volume
Hi folks, I need to restore files from 4+ yrs back. I know the volume(s) where the files are backed up but the backup records have been pruned. Since I do have the db catalog backed up on a daily basis following is what I am planning to do. 1. /etc/bacula/bin/bls -j -V volume_name devicename 2. /etc/bacula/bin/bextract My question is, what parameters do I give to extract the db catalog file? The Bacula utility document has examples for restoring files but as far as I am aware of, not for extracting the db catalog back to a directory you specify on the server. Following is an example of my catalog backup report: - start --- 12-Sep 09:48 baculaserver-dir JobId 44234: BeforeJob: run command /etc/bacula/config/make_catalog_backup bacula bacula BACULA localhost 12-Sep 09:55 baculaserver-dir JobId 44234: Start Backup JobId 44234, Job=BackupCatalog.2012-09-12_07.00.3 9 12-Sep 09:55 baculaserver-dir JobId 44234: Using Device LTO4_1 12-Sep 09:56 baculaserver-sd JobId 44234: 3307 Issuing autochanger unload slot 33, drive 0 command. 12-Sep 09:56 baculaserver-sd JobId 44234: 3304 Issuing autochanger load slot 4, drive 0 command. 12-Sep 09:57 baculaserver-sd JobId 44234: 3305 Autochanger load slot 4, drive 0, status is OK. 12-Sep 09:57 baculaserver-sd JobId 44234: 3301 Issuing autochanger loaded? drive 0 command. 12-Sep 09:57 baculaserver-sd JobId 44234: 3302 Autochanger loaded? drive 0, result is Slot 4. 12-Sep 09:57 baculaserver-sd JobId 44234: Volume 21 previously written, moving to end of data. 12-Sep 10:03 baculaserver-sd JobId 44234: Ready to append to end of Volume 21 at file=197. 12-Sep 10:06 baculaserver-sd JobId 44234: Job write elapsed time = 00:02:42, Transfer rate = 45.12 M byte s/second 12-Sep 10:06 baculaserver-dir JobId 44234: Bacula baculaserver-dir 2.2.6 (10Nov07): 12-Sep-2012 10:06:31 Build OS: x86_64-unknown-linux-gnu redhat Enterprise release JobId: 44234 Job:BackupCatalog.2012-09-12_07.00.39 Backup Level: Full Client: baculaserver-fd 2.2.6 (10Nov07) x86_64-unknown-linux-gnu,redhat,Enterprise re lease FileSet:Catalog 2007-12-03 04:00:00 Pool: Fulls (From Job resource) Storage:TS3200_1_DRV1 (From Pool resource) Scheduled time: 12-Sep-2012 07:00:00 Start time: 12-Sep-2012 09:55:28 End time: 12-Sep-2012 10:06:31 Elapsed time: 11 mins 3 secs Priority: 11 FD Files Written: 1 SD Files Written: 1 FD Bytes Written: 7,310,385,734 (7.310 GB) SD Bytes Written: 7,310,385,854 (7.310 GB) Rate: 11026.2 KB/s Software Compression: None VSS:no Encryption: no Volume name(s): 21 Volume Session Id: 82 Volume Session Time:1347168483 Last Volume Bytes: 97,360,865,280 (97.36 GB) Non-fatal FD errors:0 SD Errors: 0 FD termination status: OK SD termination status: OK Termination:Backup OK 12-Sep 10:06 baculaserver-dir JobId 44234: Begin pruning Jobs. 12-Sep 10:06 baculaserver-dir JobId 44234: No Jobs found to prune. 12-Sep 10:06 baculaserver-dir JobId 44234: Begin pruning Files. 12-Sep 10:06 baculaserver-dir JobId 44234: Pruned Files from 1 Jobs for client baculaserver-fd from catal og. 12-Sep 10:06 baculaserver-dir JobId 44234: End auto prune. 12-Sep 10:06 baculaserver-dir JobId 44234: AfterJob: run command /etc/bacula/config/delete_catalog_backu p 12-Sep 10:18 baculaserver-dir JobId 44234: AfterJob: run command /etc/bacula/bin/daily_JobID_list.sh --- end - Thanks, Win -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring catalog backup from old volume
On Thu, 13 Sep 2012 10:39:39 -0400 Win Htin win.h...@gmail.com wrote: Hi folks, I need to restore files from 4+ yrs back. I know the volume(s) where the files are backed up but the backup records have been pruned. Since I do have the db catalog backed up on a daily basis following is what I am planning to do. 1. /etc/bacula/bin/bls -j -V volume_name devicename 2. /etc/bacula/bin/bextract My question is, what parameters do I give to extract the db catalog file? The Bacula utility document has examples for restoring files but as far as I am aware of, not for extracting the db catalog back to a directory you specify on the server. Following is an example of my catalog backup report: - start --- 12-Sep 09:48 baculaserver-dir JobId 44234: BeforeJob: run command /etc/bacula/config/make_catalog_backup bacula bacula BACULA localhost [...] You seems to be unaware of how catalog backup works in your Bacula install. The truth here is that Bacula does not have any special means to back up its catalog--the script listed in your backup job output supposedly just calls something like `mysqldump` to dump the specified database to a file (supposedly placed somewhere under /var/lib/bacula and named something like bacula.sql). That file then gets backed in a way no different from all those other files backed up on the same host. A matching post-job script then deletes the file containing the database dump. Note that this file is only backed up if the rules in the FileSet resource used by the backup job matche that file. So you have to go this route: 1) Read the /etc/bacula/config/make_catalog_backup script and deduce how the file it creates is named. 2) Then use bls on the relevant volumes and save its output to a file. 3) Inspect the generated listing looking for files matching the name you deduced on step (1). 4) If you're lucky and your search turns out to be successful, copy and paste the name of the relevant file exactly as it is listed to another file, say, /tmp/include. Notice the name of the volume which contains the relevant file. 5) Run bextract on the volume defined on step (4) and pass it the include file using the -i command line argument. After bextract finishes, you'll get your catalog dump file on disk. 6) Use a tool appropriate for your database engine to restore the catalog (for MySQL that would supposedly be `mysql -u bacula -p bacula /path/to/the/dump.sql`). Be sure to first back up the existing catalog! Having said that, I should note two things. First, if you need to just restore several files, it mighe be more sensible to not bother with catalog at all: just run bls on the relevant volume(s), find the needed files, construct the include file and run bextract to extract those files. If your files have well-known names, then just use bextract directly. Second, there is a pitfall related to excavation of *expired* jobs: after certain operations, Bacula performs a run over the catalog trying to scavenge expired job records etc, and this process will happily delete the records you restored. To combat this, you have to temporatily adjust your expiration policy for that client -- it must be set to a longer period than the age of the oldest job you intend to restore. After you have restored what's needed, revert the expiration period back. -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring catalog backup from old volume
On Thu, Sep 13, 2012 at 12:12 PM, Konstantin Khomoutov flatw...@users.sourceforge.net wrote: On Thu, 13 Sep 2012 10:39:39 -0400 Win Htin win.h...@gmail.com wrote: Hi folks, I need to restore files from 4+ yrs back. I know the volume(s) where the files are backed up but the backup records have been pruned. Since I do have the db catalog backed up on a daily basis following is what I am planning to do. 1. /etc/bacula/bin/bls -j -V volume_name devicename 2. /etc/bacula/bin/bextract My question is, what parameters do I give to extract the db catalog file? The Bacula utility document has examples for restoring files but as far as I am aware of, not for extracting the db catalog back to a directory you specify on the server. Following is an example of my catalog backup report: - start --- 12-Sep 09:48 baculaserver-dir JobId 44234: BeforeJob: run command /etc/bacula/config/make_catalog_backup bacula bacula BACULA localhost [...] You seems to be unaware of how catalog backup works in your Bacula install. The truth here is that Bacula does not have any special means to back up its catalog--the script listed in your backup job output supposedly just calls something like `mysqldump` to dump the specified database to a file (supposedly placed somewhere under /var/lib/bacula and named something like bacula.sql). That file then gets backed in a way no different from all those other files backed up on the same host. A matching post-job script then deletes the file containing the database dump. Note that this file is only backed up if the rules in the FileSet resource used by the backup job matche that file. So you have to go this route: 1) Read the /etc/bacula/config/make_catalog_backup script and deduce how the file it creates is named. 2) Then use bls on the relevant volumes and save its output to a file. 3) Inspect the generated listing looking for files matching the name you deduced on step (1). 4) If you're lucky and your search turns out to be successful, copy and paste the name of the relevant file exactly as it is listed to another file, say, /tmp/include. Notice the name of the volume which contains the relevant file. 5) Run bextract on the volume defined on step (4) and pass it the include file using the -i command line argument. After bextract finishes, you'll get your catalog dump file on disk. 6) Use a tool appropriate for your database engine to restore the catalog (for MySQL that would supposedly be `mysql -u bacula -p bacula /path/to/the/dump.sql`). Be sure to first back up the existing catalog! Having said that, I should note two things. First, if you need to just restore several files, it mighe be more sensible to not bother with catalog at all: just run bls on the relevant volume(s), find the needed files, construct the include file and run bextract to extract those files. If your files have well-known names, then just use bextract directly. Second, there is a pitfall related to excavation of *expired* jobs: after certain operations, Bacula performs a run over the catalog trying to scavenge expired job records etc, and this process will happily delete the records you restored. To combat this, you have to temporatily adjust your expiration policy for that client -- it must be set to a longer period than the age of the oldest job you intend to restore. After you have restored what's needed, revert the expiration period back. Thanks, I'll try it out and post the results. Also, can I provide a wildcard * in the include file since I need to restore multiple sub-directories under the /share/backup/ directory? Win -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring catalog backup from old volume
On Thu, 13 Sep 2012 12:28:14 -0400 Win Htin win.h...@gmail.com wrote: [...] Thanks, I'll try it out and post the results. Also, can I provide a wildcard * in the include file since I need to restore multiple sub-directories under the /share/backup/ directory? Sorry, I never tried this so don't know. -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Non-interactive restore
On Thu, 9 Aug 2012 16:58:32 +0100 Gary Stainburn g...@ringways.co.uk wrote: Hi folks. Google has burried me once again as this seems to be a recurring question. What is the best method of starting a restore without an interactive interface. Basically, I want to be able to start a restore of the last backup state (option 5) for a client, specifying a difference restoreclient. In an idea world I'd like to run a script after a successful completion. I've tried: restore all client=gary-fd restoreclient=eddie-fd but it still asks for a resture type which I want to default to 5 and then asks me for a FileSet resource. I now only have one fileset resource for Linux but it still insists on giving me two choices including one I no long have in the config files. Gary echo restore client=$HOST-fd where=$where_you_want restoreclient=$FD_TO_RESTORE_TO bootstrap=/var/lib/bacula/$HOST-fd.bsr select current all done yes | bconsole /dev/null That is what I use. It restores everything from though the latest backup with out me telling it what to do. Fair warning. Running several of these at a time in parallel has caused my DIR to lockup several times with not warning. -- Craig Van Tassle HUBzero.org System Administrator YONG 1006 Desk Phone : (765)496-6413 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Build catalog from tape using bscan
I am using Bacula 5.0.3 on an Ubuntu 10.04 server with a LTO-3 tape drive. I have two identical servers at different locations running bacula and my need is to restore data to server A from server B. I have a recent backup tape from server B and have used the bscan utility to add its records to the existing catalog on server A so that I might then restore the data I need. The command I used on server A was: bscan -c /etc/bacula/bacula-sd.conf -v -P password -V 32X006 /dev/nst0 And the result of this command are: bscan: bscan.c:683 294,912 file records. At file:blk=84:10,812 bytes=84,643,888,964 bscan: bscan.c:526 SOS_LABEL: Job record not found for JobId: 0 bscan: bscan.c:1006 Could not get Client record. ERR=Client record not found in Catalog. 13-Sep 14:00 bscan JobId 0: End of Volume at file 95 on device Dell_LTO-3 (/dev/nst0), Volume 32X006 bscan: bscan.c:337-800 == JobId=0 13-Sep 14:00 bscan JobId 0: End of all volumes. bscan: bscan.c:637 End of all Volumes. VolFiles=95 VolBlocks=0 VolBytes=93,392,369,358 Records would have been added or updated in the catalog: 1 Media 1 Pool 3 Job 299581 File When I look for this job in the catalog I am not able to find it. Could someone tell me what I am doing wrong? Thanks for your help. Jack Cobb -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula repository for RHEL/CentOS/Fedora (5.2.11 + crash fix)
Simone, thank you very much for maintaining that build and repo. I'm very happy with it. Just one minor inconvenience: after every update, I have to start my SD manually. The director and FD are restarted automatically, but the SD remains stopped. service bacula-sd status reports dead, but lockfile exists. Not a big deal, but it would be nice if the SD would also come back up by its own. Thanks, Tilman signature.asc Description: OpenPGP digital signature -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
