[Bacula-users] Using bsr files to restore / re-catalog DB
Hi, I hope someone can help me with this one. Someone approached me to help with their Bacula but the guy who set it up has left and they are in a bit of a sticky situation. First the nitty gritty: Bacula 1.38.1 with MySQL RHEL 4 Using a Dell PV-124T with LTO3 These people have different backups pools namely - Daily with 10 volumes Weekly with 4 volumes Monthly with 36 volumes and should have had a volume retention period of 1095 days because they keep the Monthly backups for three years The client wants to restore a file on a volume that is 1 year old and because the File, job and volume retentions were specified incorrectly the entire job was purged from the catalog, a long with other monthly backup jobs, and I have no reference of those Volumes or jobs in the catalog except for the bsr files. Is there a way that I can restore files from that volume using the bsr files or one better, can I use the bsr files to rebuild the catalog and set the correct retention periods where applicable and if that is possible how will I go about doing it? I tried searching the net, the user list and the manual for similar situations but was unable to find anything. Can anyone help me or GENTLY point out that it is in the manual and that I missed it? -- Janco van der Merwe Open Solutions Tel: 011 305 2887 Cell: 083 291 8536 Fax: 0866978875 __ Think not those faithful who praise all thy words and actions; but those who kindly reprove thy faults. Socrates - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using bsr files to restore / re-catalog DB
Hi janco, I think the right command are bscan and bextract, pp 485 on the latest printed manual, pp 513 on the PDF. Cheers' michael lewinger On 10/29/07, Janco van der Merwe [EMAIL PROTECTED] wrote: Hi, I hope someone can help me with this one. Someone approached me to help with their Bacula but the guy who set it up has left and they are in a bit of a sticky situation. First the nitty gritty: Bacula 1.38.1 with MySQL RHEL 4 Using a Dell PV-124T with LTO3 These people have different backups pools namely - Daily with 10 volumes Weekly with 4 volumes Monthly with 36 volumes and should have had a volume retention period of 1095 days because they keep the Monthly backups for three years The client wants to restore a file on a volume that is 1 year old and because the File, job and volume retentions were specified incorrectly the entire job was purged from the catalog, a long with other monthly backup jobs, and I have no reference of those Volumes or jobs in the catalog except for the bsr files. Is there a way that I can restore files from that volume using the bsr files or one better, can I use the bsr files to rebuild the catalog and set the correct retention periods where applicable and if that is possible how will I go about doing it? I tried searching the net, the user list and the manual for similar situations but was unable to find anything. Can anyone help me or GENTLY point out that it is in the manual and that I missed it? -- Janco van der Merwe Open Solutions Tel: 011 305 2887 Cell: 083 291 8536 Fax: 0866978875 __ Think not those faithful who praise all thy words and actions; but those who kindly reprove thy faults. Socrates - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Michael Lewinger MBR Computers http://mbrcomp.co.il - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using bsr files to restore / re-catalog DB
Hello, 29.10.2007 09:34,, Janco van der Merwe wrote:: Hi, I hope someone can help me with this one. Someone approached me to help with their Bacula but the guy who set it up has left and they are in a bit of a sticky situation. Always a bad thing, especially if they don't have good enough documentation :-) First the nitty gritty: Bacula 1.38.1 with MySQL RHEL 4 Using a Dell PV-124T with LTO3 These people have different backups pools namely - Daily with 10 volumes Weekly with 4 volumes Monthly with 36 volumes and should have had a volume retention period of 1095 days because they keep the Monthly backups for three years The client wants to restore a file on a volume that is 1 year old and because the File, job and volume retentions were specified incorrectly the entire job was purged from the catalog, a long with other monthly backup jobs, and I have no reference of those Volumes or jobs in the catalog except for the bsr files. Do you have the bsr files that were current when the files they want back were backed up? A recent bsr file won't help you as it doesn't reference older backups. Is there a way that I can restore files from that volume using the bsr files or one better, can I use the bsr files to rebuild the catalog and set the correct retention periods where applicable and if that is possible how will I go about doing it? I assume you don't have the old bsr files for now. I tried searching the net, the user list and the manual for similar situations but was unable to find anything. Can anyone help me or GENTLY point out that it is in the manual and that I missed it? :-) Ok, I try to be very gently... First, you should know which tapes you need. If you've absolutely no idea which tapes the jobs are on, you have some work before you. First, see if they archive the job report mails or the console log - both are excellent sources to search for the relevant volume names. Once you've got the volumes, you can use bls to see their contents. If you want the contents back in the catalog, you'd use bscan, but only after you fixed the retention times,reloaded the configuration, and probably set the volume attributes so they reflect the retention times you really want. If you don't want the whole stuff in the catalog again, with the output from bls, you can use bextract to locally store the needed files to disk. Does this help you, or do you want some more details? (By the way - there was a discussion started by Maria McKinley a while ago, with the subject old recovery. I think you'll find valuable information in there. That's the most recent elaboration of the solutions to this sort of problems, I think.) Arno -- Arno Lehmann IT-Service Lehmann www.its-lehmann.de - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] prevent bacula to backup recently restored files
Thanks a lot, it perfectly fits my needs. added following two options to conf file: noatime = yes mtimeonly = yes RTFM may help sometimes ;) But I was unsure about which ressource has got needed options, now it's clear as mud. kind regards Martin On 10/28/07, Chris Howells [EMAIL PROTECTED] wrote: mtimeonly=yes—no If enabled, tells the Client that the selection of #64257;les during Incremental and Di#64256;erential backups should based only on the st mtime value in the stat() packet. The default is no which means that the selection of #64257;les to be backed up will be based on both the st mtime and the st ctime values. In general, it is not recommended to use this option. - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using bsr files to restore / re-catalog DB
Thanks guys, I'll try and let you know how it worked out. Hello, 29.10.2007 09:34,, Janco van der Merwe wrote:: Hi, I hope someone can help me with this one. Someone approached me to help with their Bacula but the guy who set it up has left and they are in a bit of a sticky situation. Always a bad thing, especially if they don't have good enough documentation :-) First the nitty gritty: Bacula 1.38.1 with MySQL RHEL 4 Using a Dell PV-124T with LTO3 These people have different backups pools namely - Daily with 10 volumes Weekly with 4 volumes Monthly with 36 volumes and should have had a volume retention period of 1095 days because they keep the Monthly backups for three years The client wants to restore a file on a volume that is 1 year old and because the File, job and volume retentions were specified incorrectly the entire job was purged from the catalog, a long with other monthly backup jobs, and I have no reference of those Volumes or jobs in the catalog except for the bsr files. Do you have the bsr files that were current when the files they want back were backed up? A recent bsr file won't help you as it doesn't reference older backups. Is there a way that I can restore files from that volume using the bsr files or one better, can I use the bsr files to rebuild the catalog and set the correct retention periods where applicable and if that is possible how will I go about doing it? I assume you don't have the old bsr files for now. I tried searching the net, the user list and the manual for similar situations but was unable to find anything. Can anyone help me or GENTLY point out that it is in the manual and that I missed it? :-) Ok, I try to be very gently... First, you should know which tapes you need. If you've absolutely no idea which tapes the jobs are on, you have some work before you. First, see if they archive the job report mails or the console log - both are excellent sources to search for the relevant volume names. Once you've got the volumes, you can use bls to see their contents. If you want the contents back in the catalog, you'd use bscan, but only after you fixed the retention times,reloaded the configuration, and probably set the volume attributes so they reflect the retention times you really want. If you don't want the whole stuff in the catalog again, with the output from bls, you can use bextract to locally store the needed files to disk. Does this help you, or do you want some more details? (By the way - there was a discussion started by Maria McKinley a while ago, with the subject old recovery. I think you'll find valuable information in there. That's the most recent elaboration of the solutions to this sort of problems, I think.) Arno -- Arno Lehmann IT-Service Lehmann www.its-lehmann.de - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] win98 and unicode
Hi there, I have recently confirmed a FEATURE/BUG of bacula - not a serious bug, but nevertheless it made me worry for a while. It happened on a bacula testbed I installed locally on my machine. Setup: server version 2.2.5 on winxp, local mysql dbase on xampp. The same machine also runs the storage daemon to a local file Client: version 2.2.5 on win98 hebrew-enabled OS, fileset contains several files with hebrew names. Situation: cannot see filenames on the client bacula status windows or in the command line bconsole. On the dbase the file names on the filenames table are stored as UTF8 and are properly exported to CSV and read correctly when UTF8 encoding is used Problem: Restoring files from the win98 client to the winxp machine (server) produces messed up filenames. All non-latin characters become spaces. Solution: restoring to the win98 client produces correct filenames. Cheers, -- Michael Lewinger MBR Computers http://mbrcomp.co.il - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] prevent bacula to backup recently restored files
For the sake of completeness, as I mentioned in my first posting we're using bacula version 1.38.x. So noatime = yes is removed from my config file. On 10/29/07, Martin Vogt [EMAIL PROTECTED] wrote: added following two options to conf file: noatime = yes mtimeonly = yes - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Device blocked.
On Saturday 27 October 2007 14:46, Arno Lehmann wrote: At this point, what is the 'sta sd=larry2-leeds' output? Normally, things should work now, I think... Arno As you can see below, it still says it's blocked. It also says there's 4 jobs writing to it too which I don't understand. I thought you could onnly have one job per device. Any ideas anyone? Gary *sta sd=larry2-leeds Connecting to Storage daemon larry2-leeds at larry2.ringways.co.uk:9103 larry2-sd Version: 2.2.4 (14 September 2007) i686-pc-linux-gnu redhat Daemon started 19-Oct-07 16:56, 143 Jobs run since started. Heap: heap=872,448 smbytes=641,805 max_bytes=707,072 bufs=215 max_bufs=222 Sizes: boffset_t=8 size_t=4 int32_t=4 int64_t=8 Running Jobs: Writing: Differential Backup job ladmin9 JobId=491 Volume= pool=Leeds device=LeedsStorage (/var/bacula/leeds) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=4 fd=6 Writing: Full Backup job ladmin1 JobId=649 Volume=leeds0040 pool=Leeds device=LeedsStorage (/var/bacula/leeds) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=5 fd=8 Writing: Full Backup job ladmin2 JobId=650 Volume=leeds0044 pool=Leeds device=LeedsStorage (/var/bacula/leeds) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=5 fd=10 Writing: Incremental Backup job ladmin7 JobId=653 Volume=leeds0044 pool=Leeds device=LeedsStorage (/var/bacula/leeds) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=4 fd=12 Jobs waiting to reserve a drive: Terminated Jobs: JobId LevelFiles Bytes Status FinishedName === 643 Full 0 0 Other26-Oct-07 14:10 lpartsl 644 Incr 91168.8 M OK 26-Oct-07 14:12 lserv1 645 Incr 9971.41 M OK 26-Oct-07 14:13 lserv4 646 Incr133978.9 M OK 26-Oct-07 14:16 lserv6 647 Incr 88560.7 M OK 26-Oct-07 14:18 lserv9 648 Incr186127.5 M OK 26-Oct-07 14:19 lservg 676 Incr1221.200 G OK 26-Oct-07 15:43 dadmin1 677 Incr 78283.4 M OK 26-Oct-07 16:04 dadmin4 651 Full 0 0 Other26-Oct-07 16:58 ladmin4 652 Incr 0 0 Other26-Oct-07 17:28 ladmin6 Device status: Device LeedsStorage (/var/bacula/leeds) is not open. Device is BLOCKED waiting to create a volume for: Pool:Leeds Media type: leeds-tape Device HalesStorage (/var/bacula/hales) is not open. Device PrimaStorage (/var/bacula/prima) is not open. Device DoncStorage (/var/bacula/donc) is not open. In Use Volume status: leeds0044 on device LeedsStorage (/var/bacula/leeds) Reader=0 writers=0 reserved=4 * -- Gary Stainburn This email does not contain private or confidential material as it may be snooped on by interested government parties for unknown and undisclosed purposes - Regulation of Investigatory Powers Act, 2000 - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Device blocked.
Hi Gary, It seems jobid 491 is stuck. Maybe you should cancel it is the director. Wait a couple of minutes (at least in the latest bacula version) to release the volume. If after 10 minutes the job hasn't been effectively cancelled, restart the storage daemon. PS: You may lose the jobs currently waiting for the SD. Cheers, Michael Lewinger On 10/29/07, Gary Stainburn [EMAIL PROTECTED] wrote: On Saturday 27 October 2007 14:46, Arno Lehmann wrote: At this point, what is the 'sta sd=larry2-leeds' output? Normally, things should work now, I think... Arno As you can see below, it still says it's blocked. It also says there's 4 jobs writing to it too which I don't understand. I thought you could onnly have one job per device. Any ideas anyone? Gary *sta sd=larry2-leeds Connecting to Storage daemon larry2-leeds at larry2.ringways.co.uk:9103 larry2-sd Version: 2.2.4 (14 September 2007) i686-pc-linux-gnu redhat Daemon started 19-Oct-07 16:56, 143 Jobs run since started. Heap: heap=872,448 smbytes=641,805 max_bytes=707,072 bufs=215 max_bufs=222 Sizes: boffset_t=8 size_t=4 int32_t=4 int64_t=8 Running Jobs: Writing: Differential Backup job ladmin9 JobId=491 Volume= pool=Leeds device=LeedsStorage (/var/bacula/leeds) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=4 fd=6 Writing: Full Backup job ladmin1 JobId=649 Volume=leeds0040 pool=Leeds device=LeedsStorage (/var/bacula/leeds) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=5 fd=8 Writing: Full Backup job ladmin2 JobId=650 Volume=leeds0044 pool=Leeds device=LeedsStorage (/var/bacula/leeds) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=5 fd=10 Writing: Incremental Backup job ladmin7 JobId=653 Volume=leeds0044 pool=Leeds device=LeedsStorage (/var/bacula/leeds) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=4 fd=12 Jobs waiting to reserve a drive: Terminated Jobs: JobId LevelFiles Bytes Status FinishedName === 643 Full 0 0 Other26-Oct-07 14:10 lpartsl 644 Incr 91168.8 M OK 26-Oct-07 14:12 lserv1 645 Incr 9971.41 M OK 26-Oct-07 14:13 lserv4 646 Incr133978.9 M OK 26-Oct-07 14:16 lserv6 647 Incr 88560.7 M OK 26-Oct-07 14:18 lserv9 648 Incr186127.5 M OK 26-Oct-07 14:19 lservg 676 Incr1221.200 G OK 26-Oct-07 15:43 dadmin1 677 Incr 78283.4 M OK 26-Oct-07 16:04 dadmin4 651 Full 0 0 Other26-Oct-07 16:58 ladmin4 652 Incr 0 0 Other26-Oct-07 17:28 ladmin6 Device status: Device LeedsStorage (/var/bacula/leeds) is not open. Device is BLOCKED waiting to create a volume for: Pool:Leeds Media type: leeds-tape Device HalesStorage (/var/bacula/hales) is not open. Device PrimaStorage (/var/bacula/prima) is not open. Device DoncStorage (/var/bacula/donc) is not open. In Use Volume status: leeds0044 on device LeedsStorage (/var/bacula/leeds) Reader=0 writers=0 reserved=4 * -- Gary Stainburn This email does not contain private or confidential material as it may be snooped on by interested government parties for unknown and undisclosed purposes - Regulation of Investigatory Powers Act, 2000 - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Michael Lewinger MBR Computers http://mbrcomp.co.il - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Connection reset by peer after backup finishes
Hi, I'm having some trouble with one particular client on my Bacula server. I've been running Bacula for over a year now and for this particular client I'm seeing an odd sequence of events: 29-Oct 03:36 client: DIR and FD clocks differ by 402 seconds, FD automatically adjusting. ... 29-Oct 03:45 client: ClientAfterJob: run command /usr/local/bin/watchdog.pl [EMAIL PROTECTED] client 726 OK 29-Oct 03:38 upsilon1-dir JobId 726: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer 29-Oct 03:38 upsilon1-dir JobId 726: Error: bsock.c:444 Read error from Client: sloates-fd:216.145.98.42:9102: ERR=Connection reset by peer 29-Oct 03:38 upsilon1-dir JobId 726: Error: Bacula upsilon1-dir 2.2.5 (09Oct07): ... Scheduled time: 29-Oct-2007 03:00:00 Start time: 29-Oct-2007 03:30:17 End time: 29-Oct-2007 03:38:46 Elapsed time: 8 mins 29 secs Priority: 10 FD Files Written: 82 SD Files Written: 82 FD Bytes Written: 40,421,521 (40.42 MB) SD Bytes Written: 40,433,386 (40.43 MB) Rate: 79.4 KB/s Software Compression: 78.2 % VSS:yes Encryption: no ... Volume Session Id: 8 Volume Session Time:1193408649 Last Volume Bytes: 40,493,085 (40.49 MB) Non-fatal FD errors:1 SD Errors: 0 FD termination status: Error SD termination status: OK Termination:*** Backup Error *** So it looks like the backup is finishing, it's invoking my Client After Job command to send an email to notify the client that their backup has completed successfully and then the backup fails even though it is, at least in theory, already finished. The odd time discrepancy appears to be an artifact of the time difference between the fd and sd. But I'm confused as to why it would end with status Ok, trigger the RunAfterJob trigger, and then fail. It doesn't happen all the time with this client but so far has been happening about half the time. Can anyone explain to me what's going on here? -- Tyler Bannister NetAccess Systems 905-524-2001 ext 224 - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Problem with mtx
Bacula 2.2.4 Solaris 9 Sparc mtx 1.3.9 StorageTek L700 tape library I'm having problems with mtx: once it loads a tape into a drive, mtx status then incorrectly reports the slot from which the tape came, e.g. (using mtx via mtx-changer) : $ mtx-changer /dev/changer load 388 /dev/rmt/0cbn 16 Loading media from Storage Element 388 into drive 16...done $ mtx-changer /dev/changer loaded 388 /dev/rmt/0cbn 16 131 $ mtx status Storage Changer /dev/changer:18 Drives, 638 Slots ( 20 Import/Export ) Data Transfer Element 15:Full (Storage Element 112 Loaded):VolumeTag = DE1385 Data Transfer Element 16:Full (Storage Element 131 Loaded):VolumeTag = SE2042 Slot 131 is indeed empty. It looks like mtx is just reporting the 1st slots listed as free, as being where the loaded tapes came from. Anyone seen anything like this, or any suggestions as to how to resolve? As a work around I'm going to use a NetBackup utility/driver which reports correctly, but I'm trying to move away from NetBackup in this environment... I had this configuration working fine with a smaller tape library (L1000). I am aware the L700 isn't listed as supported by mtx, but weirdly, it seems to work OK in a different, but similarly configured, environment with another L700. I am also aware there is an mtx 1.3.11, but can't currently get this to work at all. thanks, Phil Phil Weber Storage Technical Services - Senior UNIX Technologist Business Technology Phone: 01384 26 4136 Egg Banking plc - Egg is a trading name of the Egg group of companies which includes: Egg Financial Intermediation Ltd (reg no 3828289) and Egg Banking plc (reg no 2999842). Egg Banking plc and Egg Financial Intermediation Ltd are authorised and regulated by the Financial Services Authority (FSA) and are entered in the FSA register under numbers 205621 and 309551 respectively. These members of the Egg group are registered in England and Wales. Registered office: Citigroup Centre, Canada Square, London E14 5LB. This e-mail is confidential and for use by the addressee only. If you are not the intended recipient of this e-mail and have received it in error, please return the message to the sender by replying to it and then delete it from your mailbox. Internet e-mails are not necessarily secure. The Egg group of companies do not accept responsibility for changes made to this message after it was sent. Whilst all reasonable care has been taken to avoid the transmission of viruses, it is the responsibility of the recipient to ensure that the onward transmission, opening or use of this message and any attachments will not adversely affect its systems or data. No responsibility is accepted by the Egg group of companies in this regard and the recipient should carry out such virus and other checks as it considers appropriate. This communication does not create or modify any contract. - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restore Problems
Hello all,
When I try to restore a file through the console, everything looks fine
and I get a sucessful message and a email saying that file was restored
sucessfully, but when I go to the location where the restored file
should be, nothing is there.
I'm using bacula 2.0.3 with a RedHat AS 4 kernel 2.6.9-42. There's no
error in the logs.
Follows below my restore job configured at bacula-dir:
Job {
Name = RestoreFiles
Type = Restore
Client=client-name-fd
FileSet=Full
Storage = File
Pool = Default
Messages = Standard
Where = /tmp
}
Please let me know if you need any further information in order to help
solve this problem. I think it's something simple, but was not able to find.
Thanks in advance!
Luiz
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now http://get.splunk.com/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] TSM-style perpetual-full?
I like bacula and what it does for me (thank you development team). One issue I have is not really bacula, the issue is the long time required to write backups to tape. Is there anything in bacula like TSM's perpetual full where I can see the most current files from the client in the 'restore' command, files removed the client are kept for a specific number of days, and only the files that have changed during the night are written to backup tape ad infinitium? Mike - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Cannot Connect to Client Error
Hi All, Im evaluating Bacula for a client. So far I like what I see, but I'm having trouble adding a second (remote) client. I am following the Brief Tutorial to become familar with Bacula and have successfully set up the local machine backup and restores. However, setting up a second client is giving me troubles. I've followed the section in the Brief Tutorial entitled Adding a Second Client which entails simply copying the bacula-fd binary and bacula-fd.conf file from the bacula director machine to the client that I want to back up. I've changed the name of the machine from the director to my client in the bacula-fd.conf file as instructed in that section. However, when I try attempt to get the status of that client from the director machine's bconsole, it cannot connect (mi01.fusion is the remote machine that is giving me problems): *status Status available for: 1: Director 2: Storage 3: Client 4: All Select daemon type for status (1-4): 3 The defined Client resources are: 1: mi01-fd 2: mi01.fusion Select Client (File daemon) resource (1-2): 2 Connecting to Client mi01.fusion at xx.xx.xx.xx:9102 Failed to connect to Client mi01.fusion. You have messages. * 29-Oct 10:20 mi01-dir JobId 0: Fatal error: Unable to authenticate with File daemon at mi01.fusion..xxx:9102. Possible causes: Passwords or names not the same or Maximum Concurrent Jobs exceeded on the FD or FD networking messed up (restart daemon). Please see http://www.bacula.org/rel-manual/faq.html#AuthorizationErrors for help. I apologize for the domain mame and IP address obsfucation but I do not have authorization to post any significant network information to the Internet. I have read the AuthorizationErrors page, but as near as I can tell most of these types of errors are differing passwords between the director and the fd.conf files. Since I just copied the bacula-fd.conf file from the working director machine to the remote client, the password is the same. I have also verified that the concurrent jobs is set to 10 and there is only one running at any given time during testing. I have verified the network connectivity. The director machine can resolve the second client's name and can also route to its IP correctly. The director machine can also telnet to the client on port 9102 and the FD picks up. I have also verified that the bacula-fd daemon is indeed running on the client: [EMAIL PROTECTED] /]# ps ax | grep fd 16358 ?Ssl0:00 bacula-fd 17936 pts/3S+ 0:00 grep fd [EMAIL PROTECTED] /]# telnet localhost 9102 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. ^] I can't seem to find a log anywhere that has more meaningful information in it than 'cannot connect'. I suspect that I've done something wrong with the client machine, but I don't know how to trace that down. All I did on the second client was to copy the bacula-fd binary from the director machine and the bacula-fd.conf file to the client machine. I then made the necessary change to the bacula-fd.conf file as I indicated above. Can someone help me troubleshoot this issue further? Thanks, Jon - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore Problems
hello luiz,
you didnt mention where you expect the file to be restored...the
restore-location given in the job is /tmp .. did you look there ?
christof klaus.
Luiz Gustavo R. Nogueira schrieb:
Hello all,
When I try to restore a file through the console, everything looks fine
and I get a sucessful message and a email saying that file was restored
sucessfully, but when I go to the location where the restored file
should be, nothing is there.
I'm using bacula 2.0.3 with a RedHat AS 4 kernel 2.6.9-42. There's no
error in the logs.
Follows below my restore job configured at bacula-dir:
Job {
Name = RestoreFiles
Type = Restore
Client=client-name-fd
FileSet=Full
Storage = File
Pool = Default
Messages = Standard
Where = /tmp
}
Please let me know if you need any further information in order to help
solve this problem. I think it's something simple, but was not able to find.
Thanks in advance!
Luiz
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now http://get.splunk.com/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] iSCSI-Tape problems
Wolfgang Denk wrote: In message [EMAIL PROTECTED] you wrote: Curious as to why tar worked when btape did not, I found this. For portability reasons, tar appears to always use a physical block size of 512 bytes. See http://www.gnu.org/software/tar/manual/html_section/tar_73.html. Perhaps that explains the difference in how tar writes to tape versus how btape writes to tape. This is a misinterpretation. The physical *tape* block size or record size is a multiple of the 512 byte block size, as determined by the '-b' resp. '--blocking-factor' option. You are correct. Tar full_write() and safe_write() functions end up trying to write an entire record of bs*512 bytes with a write() system call. Looking at btape.c, it looks like btape rawfill_cmd() writes a block (of blocksize bytes) with a single write() system call as well. So this is a very strange problem, indeed. The only difference that I can see is that the full_write() / safe_write() functions in tar attempt the write multiple times if need be and attempt to finish (it seems) partial writes. Btape fails immediately if the write() system call fails to write the requested number of bytes. However, btape should be issuing a Write failed at block message if the write fails. That error message contains an error string corresponding to the errno that was set when the write() failed, which could be helpful. Christopher Litauer's initial message does not include such an error message after the Begin writing raw blocks of message, so I don't know if he just didn't include it or if the only messages he saw were the bad page state syslog messages. If there was no Write failed at block message, then the write() system call never returned, in which case it is a real mystery (to me) as to how tar can possibly work with the same block size. This is definitely a driver problem. Still, it is a bit frustrating that btape does not work when tar does. Best regards, Wolfgang Denk - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] python support
On 2007.10.27. 17:27, Arno Lehmann wrote:
...
2. if Scripts Directory is specified in director configuration file,
director can't be stopped with ctrl+c, when run in foreground;
I don't know if this qualifies as a bug - because, in normal
circumstances, you should only run the DIR in foreground under the
debugger (Kern says ;-) - but I don't think this is serious.
yeah, but consistency and obeying ctrl+c in foreground are good ;)
...
1. the example is using both lines with spacing and without spacing
around equal sign (a=b and a = b). which would be a better style choice ?
I prefer the spaces around operators because it creates much better
readability. Others disagree.
actually, i don't care that much about the method used as for it being
consistent in the example script :)
...
4. does somebody have example on writing out datetime string that would
reproduce behaviour that label format currently produces for
${Year}.${Month:p/2/0/r}.${Day:p/2/0/r}-${Hour:p/2/0/r}.${Minute:p/2/0/r}
?
Again, no examples, manuals, or even working code, but something like
import datetime
and this is where it breaks.
just adding that line to the script prevents director from starting at all :
Fatal Python error: Interpreter not initialized (version mismatch?)
Kaboom! bacula-dir, backup_1-dir got signal 6 - IOT trap. Attempting
traceback.
Kaboom! exepath=/sbin/
Calling: /sbin/btraceback /sbin/bacula-dir 32340
execv: /sbin/btraceback failed: ERR=No such file or directory
Traceback complete, attempting cleanup ...
Orphaned buffer: backup_1-dir 16 bytes buf=820b150 allocated at
watchdog.c:86
Orphaned buffer: backup_1-dir 16 bytes buf=82330a8 allocated at
watchdog.c:87
on #python, it was suggested that :
that error is caused by importing a module compiled for a different
version of Python, on Windows.
but i don't understand how could that be possible
where could the problem be ?
...
5. a (slightly modified) line reads :
job.JobReport = Exists=%d %s % (job.DoesVolumeExist(Vol), Vol)
if i understand correctly, it would only add a line to the report and
proceed, right ?
Yup.
it seems that in such a case job simply stucks, waiting for a manual
volume specification.
can i make a check that would error out if such a volume already exists ?
Sure. Check the volume name you just created using DoesVolumeExist,
and if it already exists, append or modify a suffix and loop.
Otherwise, continue.
actually, i would prefer to error out in such a case - if volume exists,
something's broken.
looking over the example, i could not find a way to cancel the job - how
would i do that ?
Hope this helps,
it did a lot, huge thanks.
i hope that the result of my pain will help somebody else :)
Arno
--
Rich
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] python support
On 2007.10.29. 19:09, Rich wrote: ... import datetime and this is where it breaks. just adding that line to the script prevents director from starting at all : Fatal Python error: Interpreter not initialized (version mismatch?) Kaboom! bacula-dir, backup_1-dir got signal 6 - IOT trap. Attempting traceback. Kaboom! exepath=/sbin/ Calling: /sbin/btraceback /sbin/bacula-dir 32340 execv: /sbin/btraceback failed: ERR=No such file or directory Traceback complete, attempting cleanup ... Orphaned buffer: backup_1-dir 16 bytes buf=820b150 allocated at watchdog.c:86 Orphaned buffer: backup_1-dir 16 bytes buf=82330a8 allocated at watchdog.c:87 on #python, it was suggested that : that error is caused by importing a module compiled for a different version of Python, on Windows. a bit more on this :) You have to make aboslutely sure that what Bacula links against, at runtime, is the right version. You also have to make sure that the modules you end up importing at runtime are for the same Python version, and also that this Bacula program properly initializes the Python it embeds. as i have no idea how to proceed, i would appreciate any help in debugging and resolving python scripting in bacula. ... -- Rich - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] How to see which volumes are in which pools?
Hi, Is there a way to see which volumes are present/known about by Bacula and which Pool they belong to? Or for that matter which Pools are available, although I can see that from looking at the configuration (but other users without that privilege might not). If this involves SQL statements, how do I add it to a command that can be executed from within bconsole? ___ Want ideas for reducing your carbon footprint? Visit Yahoo! For Good http://uk.promotions.yahoo.com/forgood/environment.html - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] File table empty?
Hi, 25.10.2007 18:25,, David Fix wrote:: Hey guys, I went to restore some of my data, but the file table is empty! I've never seen this before... The filename table has the filename I'm looking for, and the path table has the path of it... But there is NO data in the file table... And I have no idea what could have happened to it! Any ideas on what may have happened, and possibly how I could rebuild this? Is it pruned? Unless your catalog database is broken, you can either restore the whole job, or bscan the volumes into it (and ensure the data is not purged immediately...) or use bls / bextract to get back your data. If the catalog is broken, bls / bextract are your only choices to recover data before the catalog is re-populated. You can also restore the whole backup or a previous catalog if you use WriteBootStrap option. See http://www.bacula.org/rel-manual/Restore_Command.html#SECTION002213 Bye - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Cannot Connect to Client Error
Hi Jon, I read somewhere (in the conf file ?) that localhost should not be used. Add an alias to 127.0.0.1 in your /etc/hosts file and use it instead. Michael Lewinger On 10/29/07, Jon [EMAIL PROTECTED] wrote: Hi All, Im evaluating Bacula for a client. So far I like what I see, but I'm having trouble adding a second (remote) client. I am following the Brief Tutorial to become familar with Bacula and have successfully set up the local machine backup and restores. However, setting up a second client is giving me troubles. I've followed the section in the Brief Tutorial entitled Adding a Second Client which entails simply copying the bacula-fd binary and bacula-fd.conf file from the bacula director machine to the client that I want to back up. I've changed the name of the machine from the director to my client in the bacula-fd.conf file as instructed in that section. However, when I try attempt to get the status of that client from the director machine's bconsole, it cannot connect (mi01.fusion is the remote machine that is giving me problems): *status Status available for: 1: Director 2: Storage 3: Client 4: All Select daemon type for status (1-4): 3 The defined Client resources are: 1: mi01-fd 2: mi01.fusion Select Client (File daemon) resource (1-2): 2 Connecting to Client mi01.fusion at xx.xx.xx.xx:9102 Failed to connect to Client mi01.fusion. You have messages. * 29-Oct 10:20 mi01-dir JobId 0: Fatal error: Unable to authenticate with File daemon at mi01.fusion..xxx:9102. Possible causes: Passwords or names not the same or Maximum Concurrent Jobs exceeded on the FD or FD networking messed up (restart daemon). Please see http://www.bacula.org/rel-manual/faq.html#AuthorizationErrors for help. I apologize for the domain mame and IP address obsfucation but I do not have authorization to post any significant network information to the Internet. I have read the AuthorizationErrors page, but as near as I can tell most of these types of errors are differing passwords between the director and the fd.conf files. Since I just copied the bacula-fd.conf file from the working director machine to the remote client, the password is the same. I have also verified that the concurrent jobs is set to 10 and there is only one running at any given time during testing. I have verified the network connectivity. The director machine can resolve the second client's name and can also route to its IP correctly. The director machine can also telnet to the client on port 9102 and the FD picks up. I have also verified that the bacula-fd daemon is indeed running on the client: [EMAIL PROTECTED] /]# ps ax | grep fd 16358 ?Ssl0:00 bacula-fd 17936 pts/3S+ 0:00 grep fd [EMAIL PROTECTED] /]# telnet localhost 9102 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. ^] I can't seem to find a log anywhere that has more meaningful information in it than 'cannot connect'. I suspect that I've done something wrong with the client machine, but I don't know how to trace that down. All I did on the second client was to copy the bacula-fd binary from the director machine and the bacula-fd.conf file to the client machine. I then made the necessary change to the bacula-fd.conf file as I indicated above. Can someone help me troubleshoot this issue further? Thanks, Jon - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Michael Lewinger MBR Computers http://mbrcomp.co.il - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TSM-style perpetual-full?
Hi Mike, It looks all things are covered in Bacula: retention times, incremental backup. But then I'm not a TSM expert. Michael On 10/29/07, Mike Eggleston [EMAIL PROTECTED] wrote: I like bacula and what it does for me (thank you development team). One issue I have is not really bacula, the issue is the long time required to write backups to tape. Is there anything in bacula like TSM's perpetual full where I can see the most current files from the client in the 'restore' command, files removed the client are kept for a specific number of days, and only the files that have changed during the night are written to backup tape ad infinitium? Mike - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Michael Lewinger MBR Computers http://mbrcomp.co.il - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restore Problems
hello Christof,
yes I looked there ...I tried changing the location to other folders,
checked permissions and nothing ...
thanks,
Luiz Nogueira
-
Date: Mon, 29 Oct 2007 16:45:13 +0100
From: Christof Klaus [EMAIL PROTECTED]
Subject: Re: [Bacula-users] Restore Problems
To: bacula-users@lists.sourceforge.net
Message-ID: [EMAIL PROTECTED]
Content-Type: text/plain; charset=iso-8859-1
hello luiz,
you didnt mention where you expect the file to be restored...the
restore-location given in the job is /tmp .. did you look there ?
christof klaus.
Luiz Gustavo R. Nogueira schrieb:
Hello all,
When I try to restore a file through the console, everything looks fine
and I get a sucessful message and a email saying that file was restored
sucessfully, but when I go to the location where the restored file
should be, nothing is there.
I'm using bacula 2.0.3 with a RedHat AS 4 kernel 2.6.9-42. There's no
error in the logs.
Follows below my restore job configured at bacula-dir:
Job {
Name = RestoreFiles
Type = Restore
Client=client-name-fd
FileSet=Full
Storage = File
Pool = Default
Messages = Standard
Where = /tmp
}
Please let me know if you need any further information in order to help
solve this problem. I think it's something simple, but was not able to
find.
Thanks in advance!
Luiz
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now http://get.splunk.com/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Disk-to-disk-tape backups
Hey Gang, Can Bacula handle D2D2T backups? /\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\ David Gardner email: djgardner(at)yahoo.com Yahoo! IM: djgardner AIM: dgardner09 Everything is a learning experience, even a mistake. __ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TSM-style perpetual-full?
On Mon, 29 Oct 2007, Michael Lewinger might have said: Hi Mike, It looks all things are covered in Bacula: retention times, incremental backup. But then I'm not a TSM expert. Michael On 10/29/07, Mike Eggleston [EMAIL PROTECTED] wrote: I like bacula and what it does for me (thank you development team). One issue I have is not really bacula, the issue is the long time required to write backups to tape. Is there anything in bacula like TSM's perpetual full where I can see the most current files from the client in the 'restore' command, files removed the client are kept for a specific number of days, and only the files that have changed during the night are written to backup tape ad infinitium? The big difference I can see is the perpetual full. Bacula will upgrade a backup level to Full if no other Full is found for the client. TSM will backup any files you tell it to regardless of backup level, and TSM will keep the file for a certain amount of time (30 days, etc) after the file is deleted from the client. TSM also knows what the most current files for a client are, so like 'restore' in bacula you can choose which files to load back to the client. You do not have to select a file by job id. You can ask for a list of 'active' and 'inactive' versions of a given file or wild card and like bacula's 'restore' you can choose which files to load back. The biggest difference for what I'm wanting between bacula and TSM is the 'perpetual full'. Just backup the files from the client and let me choose which files by date to restore (bacula does the latter). I greatly agreed with the idea of Full/Differential/Incremental backups (levels 0/1/2 from BSD) until I started with TSM. The TSM method, once you understand what it is doing, works very well. I was very skeptical at first of TSM until I had used it a while. The idea is similar to CVS or RCS. Only the files that have been modified get new version numbers. Does that make sense or am I rambling? Mike - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TSM-style perpetual-full?
On Mon, 29 Oct 2007, Michael Lewinger might have said: Hi Mike, Yes, I agree that Bacula's method for upgrading an incremental backup to full if no full backups are found is a good feature (expected though) but it does not work the way I'd like it to. For instance there is an explicit ignore fileset changes options to circunvent a methodic upgrade-to-full when changing fileset - why such an option ?. If we're calculating MD5 signatures to each file, in this case, I'd expect Bacula to transfer only NEW files and replenish the old full backup with the new data according to the new fileset - more or less add to the jobid XXX those files as they're new. Bend the rules a little, it is not like bacula can be used by the average home user. Transferring the WHOLE set of data again is the easy way to say full is full, and data transfer is cheap, which is not always the case. It seems to me that in bacula's restore you can choose both by point in time, by most recent full backup, and particular folders/files, so Finally, regarding your question - eventually I'm reacting to it. I'm not sure that I understand the TSM perpetual feature, maybe the name is misleading. RTFM 4 me will do it, but until then - is there no parallel feature in Bacula, or a procedure for emulating this feature ? Michael On 10/29/07, Mike Eggleston [EMAIL PROTECTED] wrote: On Mon, 29 Oct 2007, Michael Lewinger might have said: Hi Mike, It looks all things are covered in Bacula: retention times, incremental backup. But then I'm not a TSM expert. Michael On 10/29/07, Mike Eggleston [EMAIL PROTECTED] wrote: I like bacula and what it does for me (thank you development team). One issue I have is not really bacula, the issue is the long time required to write backups to tape. Is there anything in bacula like TSM's perpetual full where I can see the most current files from the client in the 'restore' command, files removed the client are kept for a specific number of days, and only the files that have changed during the night are written to backup tape ad infinitium? The big difference I can see is the perpetual full. Bacula will upgrade a backup level to Full if no other Full is found for the client. TSM will backup any files you tell it to regardless of backup level, and TSM will keep the file for a certain amount of time (30 days, etc) after the file is deleted from the client. TSM also knows what the most current files for a client are, so like 'restore' in bacula you can choose which files to load back to the client. You do not have to select a file by job id. You can ask for a list of 'active' and 'inactive' versions of a given file or wild card and like bacula's 'restore' you can choose which files to load back. The biggest difference for what I'm wanting between bacula and TSM is the 'perpetual full'. Just backup the files from the client and let me choose which files by date to restore (bacula does the latter). I greatly agreed with the idea of Full/Differential/Incremental backups (levels 0/1/2 from BSD) until I started with TSM. The TSM method, once you understand what it is doing, works very well. I was very skeptical at first of TSM until I had used it a while. The idea is similar to CVS or RCS. Only the files that have been modified get new version numbers. Does that make sense or am I rambling? The perpetual backup, maybe that's only how I think of what TSM does, backups up a file from the client to the server and keeps a TSM admin defined (even per client defined) number of versions of that file before the oldest version falls off the back. If the file is deleted on the client, the TSM server keeps at a minimum the last, most current version of the deleted file for X number of days before that file falls out of the TSM server. The first time a client is backed up, all the files defined for that server are backed up. Each time after unless the admin or some schedule specifies, only changed files are copied. There is no need for a Full. Though some sites do a periodic or monthly full, you can setup the TSM server for incremental forever. My issue right now is that my tape drive is so slow that I want only the incrementals and not the fulls. Mike - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Beaten about the head and shoulders with a BAT...
On Friday 26 October 2007 3:52:41 pm Chris Howells wrote: Flak Magnet wrote: h is weird because I told it right where it was with: --with-qwt=/usr/local/qwt-5.0.2/lib You need '--with-qwt=/usr/local/qwt-5.0.2' Aw geez. Tried it. It worked. Feel kind d'oh for not noticing that while reading over the output. Tnx! -- -- Flak Magnet (Tim) www.flakmagnet.com - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] sql query to list volumes per pool
I believe that someone was asking for an SQL query to report on the assignment of pools to volumes. Perhaps this will help...it lists volumes in each pool, after prompting for the pool name. Suggestions in improving the SQL are welcome. # 21 :List Volumes per Pool *Enter Pool Name: SELECT VolumeName AS VolName,MediaID AS ID,Pool.Name AS Pool,MediaType AS Type,VolStatus AS Status,VolErrors AS Errs,Media.LastWritten AS LastWritten, FROM_UNIXTIME( UNIX_TIMESTAMP(Media.LastWritten) + (Media.VolRetention) ) AS Expires FROM Media,Pool,Storage WHERE Media.PoolId=Pool.PoolId AND Media.StorageId=Storage.StorageId AND Pool.Name='%1' ORDER BY VolumeName; Mark Bergman [EMAIL PROTECTED] System Administrator Section of Biomedical Image Analysis 215-662-7310 Department of Radiology, University of Pennsylvania http://pgpkeys.pca.dfn.de:11371/pks/lookup?search=mark.bergman%40.uphs.upenn.edu - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TSM-style perpetual-full?
Hi Mike, Yes, I agree that Bacula's method for upgrading an incremental backup to full if no full backups are found is a good feature (expected though) but it does not work the way I'd like it to. For instance there is an explicit ignore fileset changes options to circunvent a methodic upgrade-to-full when changing fileset - why such an option ?. If we're calculating MD5 signatures to each file, in this case, I'd expect Bacula to transfer only NEW files and replenish the old full backup with the new data according to the new fileset - more or less add to the jobid XXX those files as they're new. Bend the rules a little, it is not like bacula can be used by the average home user. Transferring the WHOLE set of data again is the easy way to say full is full, and data transfer is cheap, which is not always the case. It seems to me that in bacula's restore you can choose both by point in time, by most recent full backup, and particular folders/files, so Finally, regarding your question - eventually I'm reacting to it. I'm not sure that I understand the TSM perpetual feature, maybe the name is misleading. RTFM 4 me will do it, but until then - is there no parallel feature in Bacula, or a procedure for emulating this feature ? Michael On 10/29/07, Mike Eggleston [EMAIL PROTECTED] wrote: On Mon, 29 Oct 2007, Michael Lewinger might have said: Hi Mike, It looks all things are covered in Bacula: retention times, incremental backup. But then I'm not a TSM expert. Michael On 10/29/07, Mike Eggleston [EMAIL PROTECTED] wrote: I like bacula and what it does for me (thank you development team). One issue I have is not really bacula, the issue is the long time required to write backups to tape. Is there anything in bacula like TSM's perpetual full where I can see the most current files from the client in the 'restore' command, files removed the client are kept for a specific number of days, and only the files that have changed during the night are written to backup tape ad infinitium? The big difference I can see is the perpetual full. Bacula will upgrade a backup level to Full if no other Full is found for the client. TSM will backup any files you tell it to regardless of backup level, and TSM will keep the file for a certain amount of time (30 days, etc) after the file is deleted from the client. TSM also knows what the most current files for a client are, so like 'restore' in bacula you can choose which files to load back to the client. You do not have to select a file by job id. You can ask for a list of 'active' and 'inactive' versions of a given file or wild card and like bacula's 'restore' you can choose which files to load back. The biggest difference for what I'm wanting between bacula and TSM is the 'perpetual full'. Just backup the files from the client and let me choose which files by date to restore (bacula does the latter). I greatly agreed with the idea of Full/Differential/Incremental backups (levels 0/1/2 from BSD) until I started with TSM. The TSM method, once you understand what it is doing, works very well. I was very skeptical at first of TSM until I had used it a while. The idea is similar to CVS or RCS. Only the files that have been modified get new version numbers. Does that make sense or am I rambling? Mike -- Michael Lewinger MBR Computers http://mbrcomp.co.il - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Moving volumes to a new
Hi there,
Isn't that migration ? Chapter 26, pp 377 of the manual (pp 405 on the
PDF).
Michael
On 10/29/07, Russell Sutherland [EMAIL PROTECTED] wrote:
In order to create more space on one of my SD machines, I have created a
new Device entry
in the sd.conf file:
Device {
Name = Tank-device
Media Type = Tank-file
Archive Device = /backup/bacula
LabelMedia = yes; # lets Bacula label unlabeled media
Random Access = Yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = no;
AlwaysOpen = no;
}
Device {
Name = Tank-large-device
Media Type = Tank-large-file
Archive Device = /opt/bacula
LabelMedia = yes; # lets Bacula label unlabeled media
Random Access = Yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = no;
AlwaysOpen = no;
}
I added the new disk partition /opt/bacula as /backup/bacula was getting
full.
To free up space on the old Device area, I wanted to move the job volumes
from the old device to the new device, and just change the Storage field
in
the job to the one that accesses the new Device.
Job {
Name = utm-wireless-system
Enabled = yes
JobDefs = DefaultJob
Client = utm-wireless-fd
FileSet = NS-System
Storage = Storage-remote-tank-large --- new larger storage area
Full Backup Pool = utm-wireless-full
Differential Backup Pool = utm-wireless-diff
Incremental Backup Pool = utm-wireless-inc
}
Storage {
Name = Storage-remote-tank
# Do not use localhost here
Address = tank.a.b.org # N.B. Use a fully qualified name here
SDPort = 9103
Password = asdasdsd
Device = Tank-device
Media Type = Tank-file
}
Storage {
Name = Storage-remote-tank-large
# Do not use localhost here
Address = tank.a.b.org # N.B. Use a fully qualified name here
SDPort = 9103
Password = asasdasd
Device = Tank-large-device
Media Type = Tank-large-file
}
My question is, is there a method for moving my current related volume
files
over to the the new Storage device (/opt/bacula) seamlessly? They look
like:
tank: ls -ltr utm*
-rw-r- 1 bacula bacula 376261049 Apr 1 2007
utm-wireless-full-0002
-rw-r- 1 bacula bacula 287201254 May 9 15:24
utm-wireless-full-0003
-rw-r- 1 bacula bacula 204155050 Jul 25 02:50
utm-wireless-diff-0003
-rw-r- 1 bacula bacula 163371571 Aug 12 12:28
utm-wireless-diff-0004
-rw-r- 1 bacula bacula 174128939 Aug 21 22:29
utm-wireless-diff-0005
-rw-r- 1 bacula bacula 176373784 Aug 26 07:35
utm-wireless-diff-0001
-rw-r- 1 bacula bacula 243285162 Sep 4 11:36
utm-wireless-full-0004
-rw-r- 1 bacula bacula 1252243055 Oct 4 05:29
utm-wireless-inc-0002
-rw-r- 1 bacula bacula 834878651 Oct 11 00:04
utm-wireless-full-0001
-rw-r- 1 bacula bacula 3829161368 Oct 11 03:34
utm-wireless-inc-0003
-rw-r- 1 bacula bacula 530104601 Oct 14 03:00
utm-wireless-diff-0002
-rw-r- 1 bacula bacula 2944219361 Oct 26 14:19
utm-wireless-inc-0001
--
Russell Sutherland
russ AT madhaus . cns . utoronto . ca
+1.416.978.0470 [ voice ]
+1.416.978.6620 [ fax ]
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Michael Lewinger
MBR Computers
http://mbrcomp.co.il
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now http://get.splunk.com/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Moving volumes to a new
In order to create more space on one of my SD machines, I have created a new
Device entry
in the sd.conf file:
Device {
Name = Tank-device
Media Type = Tank-file
Archive Device = /backup/bacula
LabelMedia = yes; # lets Bacula label unlabeled media
Random Access = Yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = no;
AlwaysOpen = no;
}
Device {
Name = Tank-large-device
Media Type = Tank-large-file
Archive Device = /opt/bacula
LabelMedia = yes; # lets Bacula label unlabeled media
Random Access = Yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = no;
AlwaysOpen = no;
}
I added the new disk partition /opt/bacula as /backup/bacula was getting
full.
To free up space on the old Device area, I wanted to move the job volumes
from the old device to the new device, and just change the Storage field
in
the job to the one that accesses the new Device.
Job {
Name = utm-wireless-system
Enabled = yes
JobDefs = DefaultJob
Client = utm-wireless-fd
FileSet = NS-System
Storage = Storage-remote-tank-large --- new larger storage area
Full Backup Pool = utm-wireless-full
Differential Backup Pool = utm-wireless-diff
Incremental Backup Pool = utm-wireless-inc
}
Storage {
Name = Storage-remote-tank
# Do not use localhost here
Address = tank.a.b.org # N.B. Use a fully qualified name here
SDPort = 9103
Password = asdasdsd
Device = Tank-device
Media Type = Tank-file
}
Storage {
Name = Storage-remote-tank-large
# Do not use localhost here
Address = tank.a.b.org # N.B. Use a fully qualified name here
SDPort = 9103
Password = asasdasd
Device = Tank-large-device
Media Type = Tank-large-file
}
My question is, is there a method for moving my current related volume files
over to the the new Storage device (/opt/bacula) seamlessly? They look like:
tank: ls -ltr utm*
-rw-r- 1 bacula bacula 376261049 Apr 1 2007 utm-wireless-full-0002
-rw-r- 1 bacula bacula 287201254 May 9 15:24 utm-wireless-full-0003
-rw-r- 1 bacula bacula 204155050 Jul 25 02:50 utm-wireless-diff-0003
-rw-r- 1 bacula bacula 163371571 Aug 12 12:28 utm-wireless-diff-0004
-rw-r- 1 bacula bacula 174128939 Aug 21 22:29 utm-wireless-diff-0005
-rw-r- 1 bacula bacula 176373784 Aug 26 07:35 utm-wireless-diff-0001
-rw-r- 1 bacula bacula 243285162 Sep 4 11:36 utm-wireless-full-0004
-rw-r- 1 bacula bacula 1252243055 Oct 4 05:29 utm-wireless-inc-0002
-rw-r- 1 bacula bacula 834878651 Oct 11 00:04 utm-wireless-full-0001
-rw-r- 1 bacula bacula 3829161368 Oct 11 03:34 utm-wireless-inc-0003
-rw-r- 1 bacula bacula 530104601 Oct 14 03:00 utm-wireless-diff-0002
-rw-r- 1 bacula bacula 2944219361 Oct 26 14:19 utm-wireless-inc-0001
--
Russell Sutherland
russ AT madhaus . cns . utoronto . ca
+1.416.978.0470 [ voice ]
+1.416.978.6620 [ fax ]
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now http://get.splunk.com/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Device blocked.
Hi, 29.10.2007 11:41,, Gary Stainburn wrote:: On Saturday 27 October 2007 14:46, Arno Lehmann wrote: At this point, what is the 'sta sd=larry2-leeds' output? Normally, things should work now, I think... Arno As you can see below, it still says it's blocked. It also says there's 4 jobs writing to it too which I don't understand. I thought you could onnly have one job per device. No, more than one job can use a device simultaneously. Of course, internally, Bacula has to sequence the actual write operations, but non the less, jobs as a whole can run simultaneously. You set this up in the configuration, by the way - by default, job concurrency is not enabled. Any ideas anyone? Gary *sta sd=larry2-leeds Connecting to Storage daemon larry2-leeds at larry2.ringways.co.uk:9103 larry2-sd Version: 2.2.4 (14 September 2007) i686-pc-linux-gnu redhat Daemon started 19-Oct-07 16:56, 143 Jobs run since started. Heap: heap=872,448 smbytes=641,805 max_bytes=707,072 bufs=215 max_bufs=222 Sizes: boffset_t=8 size_t=4 int32_t=4 int64_t=8 Running Jobs: Writing: Differential Backup job ladmin9 JobId=491 Volume= pool=Leeds device=LeedsStorage (/var/bacula/leeds) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=4 fd=6 Writing: Full Backup job ladmin1 JobId=649 Volume=leeds0040 pool=Leeds device=LeedsStorage (/var/bacula/leeds) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=5 fd=8 Writing: Full Backup job ladmin2 JobId=650 Volume=leeds0044 pool=Leeds device=LeedsStorage (/var/bacula/leeds) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=5 fd=10 Writing: Incremental Backup job ladmin7 JobId=653 Volume=leeds0044 pool=Leeds device=LeedsStorage (/var/bacula/leeds) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=4 fd=12 As we see (Files= Bytes=) all these jobs actually don't transfer data but rather wait for something to happen. In this case, I think the SD is currently trying to create a volume. I assume this because there are different volume names active, which can only happen while one job noticed that it needed another volume, and the others simply have to wait, but are not yet informed of the volume change. Jobs waiting to reserve a drive: Terminated Jobs: JobId LevelFiles Bytes Status FinishedName === 643 Full 0 0 Other26-Oct-07 14:10 lpartsl 644 Incr 91168.8 M OK 26-Oct-07 14:12 lserv1 645 Incr 9971.41 M OK 26-Oct-07 14:13 lserv4 646 Incr133978.9 M OK 26-Oct-07 14:16 lserv6 647 Incr 88560.7 M OK 26-Oct-07 14:18 lserv9 648 Incr186127.5 M OK 26-Oct-07 14:19 lservg 676 Incr1221.200 G OK 26-Oct-07 15:43 dadmin1 677 Incr 78283.4 M OK 26-Oct-07 16:04 dadmin4 651 Full 0 0 Other26-Oct-07 16:58 ladmin4 652 Incr 0 0 Other26-Oct-07 17:28 ladmin6 Device status: Device LeedsStorage (/var/bacula/leeds) is not open. Device is BLOCKED waiting to create a volume for: Pool:Leeds Media type: leeds-tape Device HalesStorage (/var/bacula/hales) is not open. Device PrimaStorage (/var/bacula/prima) is not open. Device DoncStorage (/var/bacula/donc) is not open. Currently, Bacula tries to create a volume automatically, or waits for user intervention. In Use Volume status: leeds0044 on device LeedsStorage (/var/bacula/leeds) Reader=0 writers=0 reserved=4 Here you can see that the four jobs reported above wait for a volume to become available. * What happens if you try to create a volume manually? This output looks like automatic volume creation failed, but there should be a more detailed operator request mail. Of course, the console messages or the console log file should have more information, too. If they don't, I recommend to set debug output tracing with a command like 'setdebug level=200 trace=1 sd=larry2-leeds', issue a mount command, and then inspect the trace file, if you don't get anything useful in the messages. Arno -- Arno Lehmann IT-Service Lehmann www.its-lehmann.de - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list
Re: [Bacula-users] python support
Hi,
29.10.2007 18:09,, Rich wrote::
On 2007.10.27. 17:27, Arno Lehmann wrote:
...
2. if Scripts Directory is specified in director configuration file,
director can't be stopped with ctrl+c, when run in foreground;
I don't know if this qualifies as a bug - because, in normal
circumstances, you should only run the DIR in foreground under the
debugger (Kern says ;-) - but I don't think this is serious.
yeah, but consistency and obeying ctrl+c in foreground are good ;)
True, but given the relatively low impact of this you'll have to be
good at nagging Kern into fixing it - or do it yourself :-)
...
1. the example is using both lines with spacing and without spacing
around equal sign (a=b and a = b). which would be a better style choice ?
I prefer the spaces around operators because it creates much better
readability. Others disagree.
actually, i don't care that much about the method used as for it being
consistent in the example script :)
Good point. But then, especially given this discussion, I get the
impression the python scripting chapter needs a major rework anyway...
...
4. does somebody have example on writing out datetime string that would
reproduce behaviour that label format currently produces for
${Year}.${Month:p/2/0/r}.${Day:p/2/0/r}-${Hour:p/2/0/r}.${Minute:p/2/0/r}
?
Again, no examples, manuals, or even working code, but something like
import datetime
and this is where it breaks.
just adding that line to the script prevents director from starting at all :
Fatal Python error: Interpreter not initialized (version mismatch?)
That looks like a python problem... or something related to the way
python is embedded into Bacula. You should consider a bug report at
bugs.bacula.org, and point out that this might be a configure or
linking problem, or even one of finding the right python module path.
Currently, I have no idea how to fix or further diagnose this.
Kaboom! bacula-dir, backup_1-dir got signal 6 - IOT trap. Attempting
traceback.
Kaboom! exepath=/sbin/
Calling: /sbin/btraceback /sbin/bacula-dir 32340
execv: /sbin/btraceback failed: ERR=No such file or directory
Traceback complete, attempting cleanup ...
Orphaned buffer: backup_1-dir 16 bytes buf=820b150 allocated at
watchdog.c:86
Orphaned buffer: backup_1-dir 16 bytes buf=82330a8 allocated at
watchdog.c:87
on #python, it was suggested that :
that error is caused by importing a module compiled for a different
version of Python, on Windows.
but i don't understand how could that be possible
where could the problem be ?
configure, linking, module path - I suppose you need to be good with
software building and gdb to find a solution here.
...
5. a (slightly modified) line reads :
job.JobReport = Exists=%d %s % (job.DoesVolumeExist(Vol), Vol)
if i understand correctly, it would only add a line to the report and
proceed, right ?
Yup.
it seems that in such a case job simply stucks, waiting for a manual
volume specification.
can i make a check that would error out if such a volume already exists ?
Sure. Check the volume name you just created using DoesVolumeExist,
and if it already exists, append or modify a suffix and loop.
Otherwise, continue.
actually, i would prefer to error out in such a case - if volume exists,
something's broken.
Well, relying onto the number of volumes in a pool is not safe, for
example. Imagine you have volumes V1, V2, V4 in a pool and label with
'V'+number. The next volume will be the fourth one, so you'd end up
with V4 a second time.
As this can happen easily when you delete volumes, precautions are
important.
looking over the example, i could not find a way to cancel the job - how
would i do that ?
I don't know - perhaps return the null value from the method. You'll
have to try :-)
Hope this helps,
it did a lot, huge thanks.
i hope that the result of my pain will help somebody else :)
Definitely... at least me. If I find the time, I'll play with python
scripting. Perhaps even this year or 2008 ;-)
Arno
Arno
--
Arno Lehmann
IT-Service Lehmann
www.its-lehmann.de
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] File table empty?
Hi, 29.10.2007 19:41,, Eric Bollengier wrote:: Hi, 25.10.2007 18:25,, David Fix wrote:: Hey guys, I went to restore some of my data, but the file table is empty! I've never seen this before... The filename table has the filename I'm looking for, and the path table has the path of it... But there is NO data in the file table... And I have no idea what could have happened to it! Any ideas on what may have happened, and possibly how I could rebuild this? Is it pruned? Unless your catalog database is broken, you can either restore the whole job, or bscan the volumes into it (and ensure the data is not purged immediately...) or use bls / bextract to get back your data. If the catalog is broken, bls / bextract are your only choices to recover data before the catalog is re-populated. You can also restore the whole backup or a previous catalog if you use WriteBootStrap option. If you've got a bootstrap file of the point in time you want to recover... which in this case, I doubt. Arno See http://www.bacula.org/rel-manual/Restore_Command.html#SECTION002213 Bye - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Arno Lehmann IT-Service Lehmann www.its-lehmann.de - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore Problems
Hi Luis, bom dia, como vai ? The files are restored by default to the client, not to the server. Use mod for changing the client's destination on the restore console. I'm marking the relevant lines with ^^^ begin--- Connecting to Director 192.168.2.102:9101 1000 OK: michaelpc-dir Version: 2.2.5 (09 October 2007) Enter a period to cancel a command. *restore all Automatically selected Catalog: MyCatalog Using Catalog MyCatalog First you select one or more JobIds that contain files to be restored. You will be presented several methods of specifying the JobIds. Then you will be allowed to select which files from those JobIds are to be restored. To select the JobIds, you have the following choices: 1: List last 20 Jobs run 2: List Jobs where a given File is saved 3: Enter list of comma separated JobIds to select 4: Enter SQL list command 5: Select the most recent backup for a client 6: Select backup for a client before a specified time 7: Enter a list of files to restore 8: Enter a list of files to restore before a specified time 9: Find the JobIds of the most recent backup for a client 10: Find the JobIds for a backup for a client before a specified time 11: Enter a list of directories to restore for found JobIds 12: Cancel Select item: (1-12): 5 Defined Clients: 1: michaelpc 2: saar Select the Client (1-2): 2 Automatically selected FileSet: saar +---+---+--+---+-++ | JobId | Level | JobFiles | JobBytes | StartTime | VolumeName | +---+---+--+---+-++ | 139 | F | 12,924 | 2,353,980,429 | 2007-10-26 08:36:29 | saar | | 142 | I |1 |11,556 | 2007-10-26 19:27:39 | saar | +---+---+--+---+-++ You have selected the following JobIds: 139,142 Building directory tree for JobId 139 ... + Building directory tree for JobId 142 ... 2 Jobs, 12,845 files inserted into the tree and marked for extraction. You are now entering file selection mode where you add (mark) and remove (unmark) files to be restored. No files are initially added, unless you used the all keyword on the command line. Enter done to leave this mode. cwd is: / $ done Bootstrap records written to C:\Documents and Settings\All Users\Application Data\Bacula\Work/michaelpc-dir.restore.1.bsr The job will require the following Volume(s) Storage(s)SD Device(s) === saar external disk 12,924 files selected to be restored. Run Restore job JobName: RestoreFiles Bootstrap: C:\Documents and Settings\All Users\Application Data\Bacula\Work/michaelpc-dir.restore.1.bsr Where: C:\tmp\bacula-restores Replace: always FileSet: Windows Full Set Backup Client: saar ^^^ Restore Client: saar ^^^ Storage: external When:2007-10-29 21:53:15 Catalog: MyCatalog Priority:10 ^^^ OK to run? (yes/mod/no): mod ^^^ Parameters to modify: 1: Level 2: Storage 3: Job 4: FileSet ^^^ 5: Restore Client ^^^ 6: When 7: Priority 8: Bootstrap 9: Where 10: File Relocation 11: Replace 12: JobId Select parameter to modify (1-12): 5 The defined Client resources are: 1: michaelpc 2: saar ^^^ Select Client (File daemon) resource (1-2): 1 ^^^ Run Restore job JobName: RestoreFiles Bootstrap: C:\Documents and Settings\All Users\Application Data\Bacula\Work/michaelpc-dir.restore.1.bsr Where: C:\tmp\bacula-restores Replace: always FileSet: Windows Full Set Backup Client: saar ^^^ Restore Client: michaelpc ^^^ Storage: external When:2007-10-29 21:53:15 Catalog: MyCatalog Priority:10 OK to run? (yes/mod/no):yes end-- Michael On 10/29/07, Luiz Gustavo R. Nogueira [EMAIL PROTECTED] wrote: hello Christof, yes I looked there ...I tried changing the location to other folders, checked permissions and nothing ... thanks, Luiz Nogueira - Date: Mon, 29 Oct 2007 16:45:13 +0100 From: Christof Klaus [EMAIL PROTECTED] Subject: Re: [Bacula-users] Restore Problems To: bacula-users@lists.sourceforge.net Message-ID: [EMAIL PROTECTED] Content-Type: text/plain;
Re: [Bacula-users] Disk-to-disk-tape backups
Sure, here it is. Everything derived from pp 423 of the manual.
on the storage daemon:
Device {
Name = disk#
Media Type = file
Device Type = file
Archive Device = C:/bacula/backup_data
AutomaticMount = yes # when device opened, read it
AlwaysOpen = yes
RemovableMedia = no
RandomAccess = yes
^^
Spool Directory = C:/bacula/temp
^^
}
on the director daemon:
JobDefs {
Name = DefaultJob
Type = Backup
Level = Incremental
Client = michaelpc
FileSet = docs
Schedule = default
Storage = disk
Messages = Standard
Pool = Default
Priority = 10
^^
SpoolData = yes
^^
}
Cheers,
Michael
On 10/29/07, David Gardner [EMAIL PROTECTED] wrote:
Michael,
I'd like that. The only stipulation is that I try it myself first. I have
found the documentation a little confusing and may give up quicker than I
like to admit.
I do however need the reference for the information on spooling. Do you
have that to start me off?
/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\
David Gardner
email: djgardner(at)yahoo.com
Yahoo! IM: djgardner
AIM: dgardner09
Everything is a learning experience, even a mistake.
- Original Message
From: Michael Lewinger [EMAIL PROTECTED]
To: David Gardner [EMAIL PROTECTED]
Sent: Monday, October 29, 2007 2:45:18 PM
Subject: Re: [Bacula-users] Disk-to-disk-tape backups
Sure,
A pity bacula does not support resuming creation of spool files... I do
have this slow connection problem as well, solved partially by spooling.
Once it is finished the file does go straight to tape though. Do you need
help with the spooling ?
Michael
On 10/29/07, David Gardner [EMAIL PROTECTED] wrote:
Michael,
I need the D2D2T feature or at the very least disk spooling because I am
stuck using an HP Ext. USB(v2) DAT72 drive and the links between servers are
slow. I suppose I could setup Rsync between the servers then fire off the
backup
I've successfully used the backup to file feature but the remote disk to
tape fails consistently.
/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\
David Gardner
email: djgardner(at)yahoo.com
Yahoo! IM: djgardner
AIM: dgardner09
Everything is a learning experience, even a mistake.
- Original Message
From: Michael Lewinger [EMAIL PROTECTED]
To: David Gardner [EMAIL PROTECTED]
Sent: Monday, October 29, 2007 1:05:09 PM
Subject: Re: [Bacula-users] Disk-to-disk-tape backups
Hi David,
Maybe it can, maybe it can't but I'm sure it can be emulated. bacula's
volumes on disk (media type = file) for instance are similar to tape
streams, so technically speaking you can use bacula's own duplicate backup
mechanism for making a backup to disk and to tape immediately after which
looks more or less like d2d2t to me. Mind, this is not using disk spooling
which is a different feature altogether.
What feature of d2d2t is so important ?
Michael
On 10/29/07, David Gardner [EMAIL PROTECTED] wrote:
Hey Gang,
Can Bacula handle D2D2T backups?
/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\
David Gardner
email: djgardner(at)yahoo.com
Yahoo! IM: djgardner
AIM: dgardner09
Everything is a learning experience, even a mistake.
__
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a
browser.
Download your FREE copy of Splunk now http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Michael Lewinger
MBR Computers
http://mbrcomp.co.il
__
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Michael Lewinger
MBR Computers
http://mbrcomp.co.il
Re: [Bacula-users] Restore Problems
Hi Michael, obrigado! I found the files now! My fault not reading the docs completely... thanks a lot, Luiz Nogueira 2007/10/29, Michael Lewinger [EMAIL PROTECTED]: Hi Luis, bom dia, como vai ? The files are restored by default to the client, not to the server. Use mod for changing the client's destination on the restore console. I'm marking the relevant lines with ^^^ begin--- Connecting to Director 192.168.2.102:9101 1000 OK: michaelpc-dir Version: 2.2.5 (09 October 2007) Enter a period to cancel a command. *restore all Automatically selected Catalog: MyCatalog Using Catalog MyCatalog First you select one or more JobIds that contain files to be restored. You will be presented several methods of specifying the JobIds. Then you will be allowed to select which files from those JobIds are to be restored. To select the JobIds, you have the following choices: 1: List last 20 Jobs run 2: List Jobs where a given File is saved 3: Enter list of comma separated JobIds to select 4: Enter SQL list command 5: Select the most recent backup for a client 6: Select backup for a client before a specified time 7: Enter a list of files to restore 8: Enter a list of files to restore before a specified time 9: Find the JobIds of the most recent backup for a client 10: Find the JobIds for a backup for a client before a specified time 11: Enter a list of directories to restore for found JobIds 12: Cancel Select item: (1-12): 5 Defined Clients: 1: michaelpc 2: saar Select the Client (1-2): 2 Automatically selected FileSet: saar +---+---+--+---+-++ | JobId | Level | JobFiles | JobBytes | StartTime | VolumeName | +---+---+--+---+-++ | 139 | F | 12,924 | 2,353,980,429 | 2007-10-26 08:36:29 | saar | | 142 | I |1 |11,556 | 2007-10-26 19:27:39 | saar | +---+---+--+---+-++ You have selected the following JobIds: 139,142 Building directory tree for JobId 139 ... + Building directory tree for JobId 142 ... 2 Jobs, 12,845 files inserted into the tree and marked for extraction. You are now entering file selection mode where you add (mark) and remove (unmark) files to be restored. No files are initially added, unless you used the all keyword on the command line. Enter done to leave this mode. cwd is: / $ done Bootstrap records written to C:\Documents and Settings\All Users\Application Data\Bacula\Work/michaelpc-dir.restore.1.bsr The job will require the following Volume(s) Storage(s)SD Device(s) === saar external disk 12,924 files selected to be restored. Run Restore job JobName: RestoreFiles Bootstrap: C:\Documents and Settings\All Users\Application Data\Bacula\Work/michaelpc-dir.restore.1.bsr Where: C:\tmp\bacula-restores Replace: always FileSet: Windows Full Set Backup Client: saar ^^^ Restore Client: saar ^^^ Storage: external When:2007-10-29 21:53:15 Catalog: MyCatalog Priority:10 ^^^ OK to run? (yes/mod/no): mod ^^^ Parameters to modify: 1: Level 2: Storage 3: Job 4: FileSet ^^^ 5: Restore Client ^^^ 6: When 7: Priority 8: Bootstrap 9: Where 10: File Relocation 11: Replace 12: JobId Select parameter to modify (1-12): 5 The defined Client resources are: 1: michaelpc 2: saar ^^^ Select Client (File daemon) resource (1-2): 1 ^^^ Run Restore job JobName: RestoreFiles Bootstrap: C:\Documents and Settings\All Users\Application Data\Bacula\Work/michaelpc-dir.restore.1.bsr Where: C:\tmp\bacula-restores Replace: always FileSet: Windows Full Set Backup Client: saar ^^^ Restore Client: michaelpc ^^^ Storage: external When:2007-10-29 21:53:15 Catalog: MyCatalog Priority:10 OK to run? (yes/mod/no):yes end-- Michael On 10/29/07, Luiz Gustavo R. Nogueira [EMAIL PROTECTED] wrote: hello Christof, yes I looked there ...I tried changing the location to other folders, checked
Re: [Bacula-users] error with 2.2.5
On Fri, 2007-10-26 at 10:55 -0700, Craig White wrote: CentOS 5 - MySQL 5 # uname -r -v -m -p -o 2.6.18-8.1.14.el5 #1 SMP Thu Sep 27 18:58:54 EDT 2007 i686 i686 GNU/Linux # rpm -qa |grep bacula bacula-mtx-2.2.5-1 bacula-mysql-2.2.5-1 # rpm -qa |grep mysql mysql-devel-5.0.22-2.1.0.1 libdbi-dbd-mysql-0.8.1a-1.2.2 mysql-connector-odbc-3.51.12-2.2 php-mysql-5.1.6-15.el5 mysql-5.0.22-2.1.0.1 mysql-server-5.0.22-2.1.0.1 bacula-mysql-2.2.5-1 Monday through Wednesday, single tape went fine. Last night started a 'Full' backup which would span to second tape. Things went fine until it tried to write the first file from the 3rd job onto the second tape for this Pool, then... 26-Oct 08:30 LINSERV1-sd JobId 14: Wrote label to prelabeled Volume 1_Friday_Week_2 on device LTO (/dev/nst0) 26-Oct 08:30 LINSERV1-sd JobId 14: New volume 1_Friday_Week_2 mounted on device LTO (/dev/nst0) at 26-Oct-2007 08:30. 26-Oct 08:30 LINSERV1 JobId 14: Fatal error: sql_create.c:732 sql_create.c:732 insert INSERT INTO batch VALUES (16858,14,'E:/WinShares/PR/P R CLIENTS/Toll Brothers #535/2006/Phoenix/Correspondence/Clips/Phoenix 2 April - June Clips/','Apr Arizona Republic 4-21.jpg','A A IH/ B A A A 9S5 A A BHGA+/ BEV2T2 BEV2T2 A A L','0') failed: Table 'bacula.batch' doesn't exist 26-Oct 08:30 LINSERV1 JobId 14: Fatal error: catreq.c:404 Attribute create error. Query failed: DROP INDEX DelInx1: ERR=You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '' at line 1 26-Oct 08:30 LINSERV1-sd JobId 14: Job NAS-Backup.2007-10-25_20.00.12 marked to be canceled. ? I was really hoping someone could explain this sql error or if I am going to run into that same error on Full backup again this week. Craig - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TSM-style perpetual-full?
Hello Mike, What you are talking about is regular practice, and is what is attained by the incremental feature, so I guess that TSM and bacula are the same there. The first time it is run, an inc. backup will be promoted to full, and afterwards, only inc. will be performed. Good backup practices demand that a full backup be performed at least once a month in case a tape fails. HOWEVER once a file is deleted, it will only be effectively removed from a restore when a FULL backup takes place thus skipping it (it was deleted, right ?). Until then, post-deletion recoveries will produce the deleted file, updated to its latest version. (duh). In practice, until you do a second full backup, you'll keep recovering long-ago unnecessary, deleted files, hence the need for some full backup policy. It would be easier on a slow network to recreate full backups using MD5 and files already present in bacula's volumes but this would complicate tape maintenance enormously. The keep-number-of-files feature is interesting though, as an alternative to date-based retention times. AFAIK bacula does not have this feature. Maybe - this is a BIG maybe - there should be an option of reusing already stored files, and make full backups assembly on slow networks: 1) check MD5 on client, 2) Compare file identity to file table on catalog 3) HEY, I have this file already ! Let's make a list of volumes necessary, and ask the user to supply us the required volumes, 4) Spool the reused files (as if they were d/l) 5) Voila ! It looks to me this is the base backup level, but until more of this feature shows up on the docs... Michael On 10/29/07, Mike Eggleston [EMAIL PROTECTED] wrote: On Mon, 29 Oct 2007, Michael Lewinger might have said: The perpetual backup, maybe that's only how I think of what TSM does, backups up a file from the client to the server and keeps a TSM admin defined (even per client defined) number of versions of that file before the oldest version falls off the back. If the file is deleted on the client, the TSM server keeps at a minimum the last, most current version of the deleted file for X number of days before that file falls out of the TSM server. The first time a client is backed up, all the files defined for that server are backed up. Each time after unless the admin or some schedule specifies, only changed files are copied. There is no need for a Full. Though some sites do a periodic or monthly full, you can setup the TSM server for incremental forever. My issue right now is that my tape drive is so slow that I want only the incrementals and not the fulls. Mike -- Michael Lewinger MBR Computers http://mbrcomp.co.il - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TSM-style perpetual-full?
On Tue, 30 Oct 2007, Michael Lewinger might have said: Hello Mike, What you are talking about is regular practice, and is what is attained by the incremental feature, so I guess that TSM and bacula are the same there. The first time it is run, an inc. backup will be promoted to full, and afterwards, only inc. will be performed. Good backup practices demand that a full backup be performed at least once a month in case a tape fails. HOWEVER once a file is deleted, it will only be effectively removed from a restore when a FULL backup takes place thus skipping it (it was deleted, right ?). Until then, post-deletion recoveries will produce the deleted file, updated to its latest version. (duh). In practice, until you do a second full backup, you'll keep recovering long-ago unnecessary, deleted files, hence the need for some full backup policy. It would be easier on a slow network to recreate full backups using MD5 and files already present in bacula's volumes but this would complicate tape maintenance enormously. The keep-number-of-files feature is interesting though, as an alternative to date-based retention times. AFAIK bacula does not have this feature. Maybe - this is a BIG maybe - there should be an option of reusing already stored files, and make full backups assembly on slow networks: 1) check MD5 on client, 2) Compare file identity to file table on catalog 3) HEY, I have this file already ! Let's make a list of volumes necessary, and ask the user to supply us the required volumes, 4) Spool the reused files (as if they were d/l) 5) Voila ! It looks to me this is the base backup level, but until more of this feature shows up on the docs... Just occurred to me, if I change the primary schedule so that Fulls are pulled quarterly or every six months (bi-annually?) then I am closer to the perpetual incremental. I understand a failing tape and am looking at external drives that I can use for sending off-site instead of nine DLT-8000 tapes. The external drives I'm looking at are around $200 USD each. Changing bacula so that it tracks files instead of jobs I bet is a major paradigm shift inside the code and not to be started lightly. I think the per-job approach might be better for small sites (lesser amounts backed up) and the per-file approach might be better for larger sites (lots of files or data backed up). I have modified my setup so that I am using disk based volumes for my nightly backups, then after all the primary nightly jobs finish I have a single job that grabs all recently modified disk-based-volumes and writes them to tape. The real epiphany to my setup was realizing I could use bacula to manage the final disk-to-tape job instead of writing my own script. TSM does all the file checking before hand and on windows (and on AIX, but last time I used TSM it didn't work well there) you have the option have having a client-local journal file of backed up files. The local client gets the backup specification, generates a list of files, compares that list of files to the journal file, and only sends over the network the files that have truely changed. Without the local journal file the client and server must discuss each file to see if the client needs to send the file to the server. Mike - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TSM-style perpetual-full?
Hi, 29.10.2007 23:03,, Michael Lewinger wrote:: Hello Mike, What you are talking about is regular practice, and is what is attained by the incremental feature, so I guess that TSM and bacula are the same there. The first time it is run, an inc. backup will be promoted to full, and afterwards, only inc. will be performed. Good backup practices demand that a full backup be performed at least once a month in case a tape fails. HOWEVER once a file is deleted, it will only be effectively removed from a restore when a FULL backup takes place thus skipping it (it was deleted, right ?). Until then, post-deletion recoveries will produce the deleted file, updated to its latest version. (duh). In practice, until you do a second full backup, you'll keep recovering long-ago unnecessary, deleted files, hence the need for some full backup policy. It would be easier on a slow network to recreate full backups using MD5 and files already present in bacula's volumes but this would complicate tape maintenance enormously. The keep-number-of-files feature is interesting though, as an alternative to date-based retention times. AFAIK bacula does not have this feature. Right. Maybe - this is a BIG maybe - there should be an option of reusing already stored files, and make full backups assembly on slow networks: 1) check MD5 on client, 2) Compare file identity to file table on catalog 3) HEY, I have this file already ! Let's make a list of volumes necessary, and ask the user to supply us the required volumes, 4) Spool the reused files (as if they were d/l) 5) Voila ! It looks to me this is the base backup level, but until more of this feature shows up on the docs... This is about what the feature request no. 1 is about, as found in the current projects file. The thing Mike wrote about is, as far as I understand, covered by the featore request 3, Synthetic Full Backups. You only do incrementals, and Bacula, internally, rearranges the files stored so that you always have a recent full backup available. Both feature requests result in two different ways to allow exact full restores - the one requires less work by the DIR but will need many jobs and hence volumes during a restore; the other one loads the DIR and SDs more but ensures you have a recent full backup on your volumes even if you only ever run incrementals. Base jobs are different again - they will (once implemented) allow a template backup of a machine to be created, and use this templare for other clients. Like when you run the same OS on all your servers, you have to back up the base OS only once and all clients are covered by it. Only changes against that base file set need to be loaded from the clients, even if running full backups. (I think that these three things will have lots of behind-the-scenes action in common, so I assume they will be implemented more or less at the same time - once somebody starts working on them.) Arno Michael On 10/29/07, *Mike Eggleston * [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: On Mon, 29 Oct 2007, Michael Lewinger might have said: The perpetual backup, maybe that's only how I think of what TSM does, backups up a file from the client to the server and keeps a TSM admin defined (even per client defined) number of versions of that file before the oldest version falls off the back. If the file is deleted on the client, the TSM server keeps at a minimum the last, most current version of the deleted file for X number of days before that file falls out of the TSM server. The first time a client is backed up, all the files defined for that server are backed up. Each time after unless the admin or some schedule specifies, only changed files are copied. There is no need for a Full. Though some sites do a periodic or monthly full, you can setup the TSM server for incremental forever. My issue right now is that my tape drive is so slow that I want only the incrementals and not the fulls. Mike -- Michael Lewinger MBR Computers http://mbrcomp.co.il - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Arno Lehmann IT-Service Lehmann www.its-lehmann.de - This SF.net email is
Re: [Bacula-users] Disk-to-disk-tape backups
Michael, I need the D2D2T feature or at the very least disk spooling because I am stuck using an HP Ext. USB(v2) DAT72 drive and the links between servers are slow. I suppose I could setup Rsync between the servers then fire off the backup I've successfully used the backup to file feature but the remote disk to tape fails consistently. /\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\ David Gardner email: djgardner(at)yahoo.com Yahoo! IM: djgardner AIM: dgardner09 Everything is a learning experience, even a mistake. - Original Message From: Michael Lewinger [EMAIL PROTECTED] To: David Gardner [EMAIL PROTECTED] Sent: Monday, October 29, 2007 1:05:09 PM Subject: Re: [Bacula-users] Disk-to-disk-tape backups Hi David, Maybe it can, maybe it can't but I'm sure it can be emulated. bacula's volumes on disk (media type = file) for instance are similar to tape streams, so technically speaking you can use bacula's own duplicate backup mechanism for making a backup to disk and to tape immediately after which looks more or less like d2d2t to me. Mind, this is not using disk spooling which is a different feature altogether. What feature of d2d2t is so important ? Michael On 10/29/07, David Gardner [EMAIL PROTECTED] wrote:Hey Gang, Can Bacula handle D2D2T backups? /\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\ David Gardner email: djgardner(at)yahoo.com Yahoo! IM: djgardner AIM: dgardner09 Everything is a learning experience, even a mistake. __ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Michael Lewinger MBR Computers http://mbrcomp.co.il __ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TSM-style perpetual-full?
Michael Lewinger wrote: Hi Mike, It looks all things are covered in Bacula: retention times, incremental backup. But then I'm not a TSM expert. Michael On 10/29/07, * Mike Eggleston* [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: I like bacula and what it does for me (thank you development team). One issue I have is not really bacula, the issue is the long time required to write backups to tape. Is there anything in bacula like TSM's perpetual full where I can see the most current files from the client in the 'restore' command, files removed the client are kept for a specific number of days, and only the files that have changed during the night are written to backup tape ad infinitium? That sounds just like Retrospect's Incremental Plus. With either, when you say ad infinitum, I am concerned about redundancy and potential tape failure. After you've been backing up for however long ad infinitum is, you only have one copy of all your backed up files. You can configure almost any backup software to do that, but you should probably think about balancing the risks inherent in your backup strategy against your concerns about the time it takes to back up. --- Chris Hoogendyk - O__ Systems Administrator c/ /'_ --- Biology Geology Departments (*) \(*) -- 140 Morrill Science Center ~~ - University of Massachusetts, Amherst [EMAIL PROTECTED] --- Erdös 4 - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] scsi problems
seem to be having some scsi problems with btape test. this test is with a spectra T50/LTO-4 attached via an LSI LSIU320 controller. i ran 100GB of data onto the drive with tar with no issue. but when i run this: ./btape -c bacula-sd.conf /dev/nst0 test i get: *test === Write, rewind, and re-read test === I'm going to write 1000 records and an EOF then write 1000 records and an EOF, then rewind, and re-read the data to verify that it is correct. This is an *essential* feature ... btape: btape.c:827 Wrote 1000 blocks of 64412 bytes. btape: btape.c:501 Wrote 1 EOF to LTO4 (/dev/nst0) btape: btape.c:843 Wrote 1000 blocks of 64412 bytes. btape: btape.c:501 Wrote 1 EOF to LTO4 (/dev/nst0) btape: btape.c:852 Rewind OK. 1000 blocks re-read correctly. 29-Oct 21:27 btape JobId 0: Error: block.c:995 Read error on fd=3 at file:blk 0:1000 on device LTO4 (/dev/nst0). ERR=No such device or address. btape: btape.c:864 Read block 1001 failed! ERR=No such device or address and i the kernel ring buffer log: st0: Block limits 1 - 16777215 bytes. mptbase: ioc0: LogInfo(0x11010f00): F/W: bug! MID not found mptbase: ioc0: LogInfo(0x11010f00): F/W: bug! MID not found mptbase: ioc0: IOCStatus(0x004b): SCSI IOC Terminated st0: Error 8 (sugg. bt 0x0, driver bt 0x0, host bt 0x8). mptscsih: ioc0: attempting task abort! (sc=81011bf35240) st 5:0:15:0: command: Read(6): 08 00 00 fc 00 00 mptbase: Initiating ioc0 recovery mptscsih: ioc0: task abort: SUCCESS (sc=81011bf35240) mptbase: ioc0: IOCStatus(0x0043): SCSI Device Not There mptscsih: ioc0: attempting target reset! (sc=81011bf35240) st 5:0:15:0: command: Read(6): 08 00 00 fc 00 00 mptscsih: ioc0: target reset: SUCCESS (sc=81011bf35240) mptbase: ioc0: IOCStatus(0x0043): SCSI Device Not There mptscsih: ioc0: attempting bus reset! (sc=81011bf35240) st 5:0:15:0: command: Read(6): 08 00 00 fc 00 00 mptscsih: ioc0: bus reset: SUCCESS (sc=81011bf35240) mptbase: ioc0: IOCStatus(0x0047): SCSI Protocol Error mptscsih: ioc0: Attempting host reset! (sc=81011bf35240) mptbase: Initiating ioc0 recovery mptbase: ioc0: IOCStatus(0x0047): SCSI Protocol Error st 5:0:15:0: scsi: Device offlined - not ready after error recovery st0: Error 8 (sugg. bt 0x0, driver bt 0x0, host bt 0x8). target5:0:15: Beginning Domain Validation target5:0:15: Domain Validation skipping write tests target5:0:15: Ending Domain Validation target5:0:15: FAST-80 WIDE SCSI 160.0 MB/s DT (12.5 ns, offset 126) target5:0:15: Beginning Domain Validation target5:0:15: Domain Validation skipping write tests target5:0:15: Ending Domain Validation target5:0:15: FAST-80 WIDE SCSI 160.0 MB/s DT (12.5 ns, offset 126) target5:0:15: Beginning Domain Validation target5:0:15: Domain Validation skipping write tests target5:0:15: Ending Domain Validation target5:0:15: FAST-80 WIDE SCSI 160.0 MB/s DT (12.5 ns, offset 126) target5:0:15: Beginning Domain Validation target5:0:15: Domain Validation skipping write tests target5:0:15: Ending Domain Validation target5:0:15: FAST-80 WIDE SCSI 160.0 MB/s DT (12.5 ns, offset 126) i've reseated my cables and terminator. reseated the scsi card. any idea where the problem is? this is centOS 5, kernel is: 2.6.18-8.1.14.el5 #1 SMP Thu Sep 27 19:05:32 EDT 2007 x86_64 x86_64 x86_64 GNU/Linux -- michael - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Cannot Connect to Client Error
Hi, I'm not using localhost anywhere in the conf. I am just using it to telnet. Thanks Jon Michael Lewinger wrote: Hi Jon, I read somewhere (in the conf file ?) that localhost should not be used. Add an alias to 127.0.0.1 http://127.0.0.1 in your /etc/hosts file and use it instead. Michael Lewinger On 10/29/07, *Jon* [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Hi All, Im evaluating Bacula for a client. So far I like what I see, but I'm having trouble adding a second (remote) client. I am following the Brief Tutorial to become familar with Bacula and have successfully set up the local machine backup and restores. However, setting up a second client is giving me troubles. I've followed the section in the Brief Tutorial entitled Adding a Second Client which entails simply copying the bacula-fd binary and bacula-fd.conf file from the bacula director machine to the client that I want to back up. I've changed the name of the machine from the director to my client in the bacula-fd.conf file as instructed in that section. However, when I try attempt to get the status of that client from the director machine's bconsole, it cannot connect (mi01.fusion is the remote machine that is giving me problems): *status Status available for: 1: Director 2: Storage 3: Client 4: All Select daemon type for status (1-4): 3 The defined Client resources are: 1: mi01-fd 2: mi01.fusion Select Client (File daemon) resource (1-2): 2 Connecting to Client mi01.fusion at xx.xx.xx.xx:9102 Failed to connect to Client mi01.fusion. You have messages. * 29-Oct 10:20 mi01-dir JobId 0: Fatal error: Unable to authenticate with File daemon at mi01.fusion..xxx:9102. Possible causes: Passwords or names not the same or Maximum Concurrent Jobs exceeded on the FD or FD networking messed up (restart daemon). Please see http://www.bacula.org/rel-manual/faq.html#AuthorizationErrors for help. I apologize for the domain mame and IP address obsfucation but I do not have authorization to post any significant network information to the Internet. I have read the AuthorizationErrors page, but as near as I can tell most of these types of errors are differing passwords between the director and the fd.conf files. Since I just copied the bacula-fd.conf file from the working director machine to the remote client, the password is the same. I have also verified that the concurrent jobs is set to 10 and there is only one running at any given time during testing. I have verified the network connectivity. The director machine can resolve the second client's name and can also route to its IP correctly. The director machine can also telnet to the client on port 9102 and the FD picks up. I have also verified that the bacula-fd daemon is indeed running on the client: [EMAIL PROTECTED] /]# ps ax | grep fd 16358 ?Ssl0:00 bacula-fd 17936 pts/3S+ 0:00 grep fd [EMAIL PROTECTED] /]# telnet localhost 9102 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. ^] I can't seem to find a log anywhere that has more meaningful information in it than 'cannot connect'. I suspect that I've done something wrong with the client machine, but I don't know how to trace that down. All I did on the second client was to copy the bacula-fd binary from the director machine and the bacula-fd.conf file to the client machine. I then made the necessary change to the bacula-fd.conf file as I indicated above. Can someone help me troubleshoot this issue further? Thanks, Jon - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net mailto:Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users https://lists.sourceforge.net/lists/listinfo/bacula-users -- Michael Lewinger MBR Computers http://mbrcomp.co.il - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/
Re: [Bacula-users] Cannot Connect to Client Error
Hi Jon, can you post the client fd.conf and the director's respective client, job and director directives, maybe without obfuscation ? If not, please post the same data with simulated IPs, as if theose were the client and dir IP, and use them as obfuscated IPs in the conf files. Cheers, Michael On 10/30/07, Jon [EMAIL PROTECTED] wrote: Hi, I'm not using localhost anywhere in the conf. I am just using it to telnet. Thanks Jon Michael Lewinger wrote: Hi Jon, I read somewhere (in the conf file ?) that localhost should not be used. Add an alias to 127.0.0.1 http://127.0.0.1 in your /etc/hosts file and use it instead. Michael Lewinger On 10/29/07, *Jon* [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Hi All, Im evaluating Bacula for a client. So far I like what I see, but I'm having trouble adding a second (remote) client. I am following the Brief Tutorial to become familar with Bacula and have successfully set up the local machine backup and restores. However, setting up a second client is giving me troubles. I've followed the section in the Brief Tutorial entitled Adding a Second Client which entails simply copying the bacula-fd binary and bacula-fd.conf file from the bacula director machine to the client that I want to back up. I've changed the name of the machine from the director to my client in the bacula-fd.conf file as instructed in that section. However, when I try attempt to get the status of that client from the director machine's bconsole, it cannot connect (mi01.fusion is the remote machine that is giving me problems): *status Status available for: 1: Director 2: Storage 3: Client 4: All Select daemon type for status (1-4): 3 The defined Client resources are: 1: mi01-fd 2: mi01.fusion Select Client (File daemon) resource (1-2): 2 Connecting to Client mi01.fusion at xx.xx.xx.xx:9102 Failed to connect to Client mi01.fusion. You have messages. * 29-Oct 10:20 mi01-dir JobId 0: Fatal error: Unable to authenticate with File daemon at mi01.fusion..xxx:9102. Possible causes: Passwords or names not the same or Maximum Concurrent Jobs exceeded on the FD or FD networking messed up (restart daemon). Please see http://www.bacula.org/rel-manual/faq.html#AuthorizationErrors for help. I apologize for the domain mame and IP address obsfucation but I do not have authorization to post any significant network information to the Internet. I have read the AuthorizationErrors page, but as near as I can tell most of these types of errors are differing passwords between the director and the fd.conf files. Since I just copied the bacula-fd.conf file from the working director machine to the remote client, the password is the same. I have also verified that the concurrent jobs is set to 10 and there is only one running at any given time during testing. I have verified the network connectivity. The director machine can resolve the second client's name and can also route to its IP correctly. The director machine can also telnet to the client on port 9102 and the FD picks up. I have also verified that the bacula-fd daemon is indeed running on the client: [EMAIL PROTECTED] /]# ps ax | grep fd 16358 ?Ssl0:00 bacula-fd 17936 pts/3S+ 0:00 grep fd [EMAIL PROTECTED] /]# telnet localhost 9102 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. ^] I can't seem to find a log anywhere that has more meaningful information in it than 'cannot connect'. I suspect that I've done something wrong with the client machine, but I don't know how to trace that down. All I did on the second client was to copy the bacula-fd binary from the director machine and the bacula-fd.conf file to the client machine. I then made the necessary change to the bacula-fd.conf file as I indicated above. Can someone help me troubleshoot this issue further? Thanks, Jon - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net mailto:Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] scsi problems
Hi Michael, tar is not checking while writing, but bacula does. Is the read error on subsequent tests failing at the same block ? 29-Oct 21:27 btape JobId 0: Error: block.c:995 Read error on fd=3 at file:blk 0:1000 I'd suggest cleaning the tape head anyway (how frequently do you do it ?), reformat the tape, and check again. Michael On 10/30/07, Michael Galloway [EMAIL PROTECTED] wrote: seem to be having some scsi problems with btape test. this test is with a spectra T50/LTO-4 attached via an LSI LSIU320 controller. i ran 100GB of data onto the drive with tar with no issue. but when i run this: ./btape -c bacula-sd.conf /dev/nst0 test i get: *test === Write, rewind, and re-read test === I'm going to write 1000 records and an EOF then write 1000 records and an EOF, then rewind, and re-read the data to verify that it is correct. This is an *essential* feature ... btape: btape.c:827 Wrote 1000 blocks of 64412 bytes. btape: btape.c:501 Wrote 1 EOF to LTO4 (/dev/nst0) btape: btape.c:843 Wrote 1000 blocks of 64412 bytes. btape: btape.c:501 Wrote 1 EOF to LTO4 (/dev/nst0) btape: btape.c:852 Rewind OK. 1000 blocks re-read correctly. 29-Oct 21:27 btape JobId 0: Error: block.c:995 Read error on fd=3 at file:blk 0:1000 on device LTO4 (/dev/nst0). ERR=No such device or address. btape: btape.c:864 Read block 1001 failed! ERR=No such device or address and i the kernel ring buffer log: st0: Block limits 1 - 16777215 bytes. mptbase: ioc0: LogInfo(0x11010f00): F/W: bug! MID not found mptbase: ioc0: LogInfo(0x11010f00): F/W: bug! MID not found mptbase: ioc0: IOCStatus(0x004b): SCSI IOC Terminated st0: Error 8 (sugg. bt 0x0, driver bt 0x0, host bt 0x8). mptscsih: ioc0: attempting task abort! (sc=81011bf35240) st 5:0:15:0: command: Read(6): 08 00 00 fc 00 00 mptbase: Initiating ioc0 recovery mptscsih: ioc0: task abort: SUCCESS (sc=81011bf35240) mptbase: ioc0: IOCStatus(0x0043): SCSI Device Not There mptscsih: ioc0: attempting target reset! (sc=81011bf35240) st 5:0:15:0: command: Read(6): 08 00 00 fc 00 00 mptscsih: ioc0: target reset: SUCCESS (sc=81011bf35240) mptbase: ioc0: IOCStatus(0x0043): SCSI Device Not There mptscsih: ioc0: attempting bus reset! (sc=81011bf35240) st 5:0:15:0: command: Read(6): 08 00 00 fc 00 00 mptscsih: ioc0: bus reset: SUCCESS (sc=81011bf35240) mptbase: ioc0: IOCStatus(0x0047): SCSI Protocol Error mptscsih: ioc0: Attempting host reset! (sc=81011bf35240) mptbase: Initiating ioc0 recovery mptbase: ioc0: IOCStatus(0x0047): SCSI Protocol Error st 5:0:15:0: scsi: Device offlined - not ready after error recovery st0: Error 8 (sugg. bt 0x0, driver bt 0x0, host bt 0x8). target5:0:15: Beginning Domain Validation target5:0:15: Domain Validation skipping write tests target5:0:15: Ending Domain Validation target5:0:15: FAST-80 WIDE SCSI 160.0 MB/s DT (12.5 ns, offset 126) target5:0:15: Beginning Domain Validation target5:0:15: Domain Validation skipping write tests target5:0:15: Ending Domain Validation target5:0:15: FAST-80 WIDE SCSI 160.0 MB/s DT (12.5 ns, offset 126) target5:0:15: Beginning Domain Validation target5:0:15: Domain Validation skipping write tests target5:0:15: Ending Domain Validation target5:0:15: FAST-80 WIDE SCSI 160.0 MB/s DT (12.5 ns, offset 126) target5:0:15: Beginning Domain Validation target5:0:15: Domain Validation skipping write tests target5:0:15: Ending Domain Validation target5:0:15: FAST-80 WIDE SCSI 160.0 MB/s DT (12.5 ns, offset 126) i've reseated my cables and terminator. reseated the scsi card. any idea where the problem is? this is centOS 5, kernel is: 2.6.18-8.1.14.el5 #1 SMP Thu Sep 27 19:05:32 EDT 2007 x86_64 x86_64 x86_64 GNU/Linux -- michael - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Michael Lewinger MBR Computers http://mbrcomp.co.il - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
