Re: [Bacula-users] Failed on backup volume 2 suddenly
Hi Heitor, Many thanks! But tried to recreate a new database and catalog since I stuck there for some times. Now, the backup job was running and doing volume 3 data backup. Hope it will be accomplished in this weekend. BTW, any advise/references of tuning DB dir inserting faster? Thanks in advance! Best regards,Keith On Wednesday, November 12, 2014 8:35 PM, hei...@bacula.com.br hei...@bacula.com.br wrote: Keith, Did you check this? It's for MySQL, but for PgSQL I think would be the same logic. Fixing table 'bacula.batch' doesn't exist Newer versions of Bacula create a temporary working table in order to do batch inserts, which can greatly speed up inserting attributes into the catalog. Unfortunately, if the MySQL connection gets dropped for any reason (such as a timeout) the temporary table goes away. If you're seeing these problems, there are two workarounds.The simplest one is to turn off batch inserts. This will revert to the older, somewhat slower behavior, but it should avoid this particular glitch.The other option is to alter the MySQL timeouts to a sufficiently long value that the connection never gets yanked out from under Bacula. For example, adding these two lines to your my.cnf file in the [mysqld] block will set the relevant timeouts to 8 days.wait_timeout=691200 interactive_timeout=691200Future versions of MySQL will automatically set the timeout values, which should prevent the problem without requiring changing the global MySQL timeout values. Source: http://wiki.bacula.org/doku.php?id=faq What I mean: it's not a database integrity problem, it should be fine, and perhaps the error you should observe is the abrupt backup connection termination. Regards,= Heitor Medrado de Faria Faltam poucos dias - Treinamento Telepresencial Bacula: http://www.bacula.com.br/?p=2174 61 2021-8260 | 8268-4220 Site: www.bacula.com.br | Facebook: heitor.faria | Gtalk: heitorfa...@gmail.com == -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://pubads.g.doubleclick.net/gampad/clk?id=154624111iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Failed on backup volume 2 suddenly
Hi Heitor, Thanks for your kind reply! No upgrade had done in those few months for Bacula. If DB got error, just query why volume 1 has no problem but always stuck at volume 2? Is it able to check/repair the DB comes with bacula? Or shall I check postgresql manual? I ran the job again after replaced another USB docking and HDD to see whether it would be the issue related. DB: postgresql-8.4.9-1.fc14.x86_64 Catalog size: 4.6TB [root@baculab]# echo list jobs|bconsole|grep MTHLY | 828 | COMMTHLY1 | 2014-05-15 11:41:40 | B | F | 12,041,875 | 3,186,454,529,352 | T | | 833 | COMMTHLY2 | 2014-05-18 10:13:00 | B | F | 1,709,675 | 6,256,974,076,676 | T | | 928 | COMMTHLY2 | 2014-07-08 09:56:23 | B | F | 1,743,758 | 6,575,280,360,690 | T | | 964 | COMMTHLY1 | 2014-08-03 08:00:05 | B | F | 12,286,436 | 3,598,328,180,140 | T | | 965 | COMMTHLY2 | 2014-08-05 12:22:48 | B | F | 1,673,471 | 6,415,007,319,252 | T | | 1,098 | COMMTHLY1 | 2014-11-02 22:09:18 | B | F | 0 | 0 | A | | 1,099 | COMMTHLY2 | 2014-11-05 11:25:33 | B | F | 0 | 0 | A | | 1,113 | COMMTHLY1 | 2014-11-10 09:55:34 | B | F | 0 | 0 | R | Thanks and best regards,Keith On Monday, November 10, 2014 8:44 PM, hei...@bacula.com.br hei...@bacula.com.br wrote: 10-Nov 01:12 bacula-fd JobId 1105: Error: bsock.c:429 Write error sending 29424 bytes to Storage daemon:localhost:910 3: ERR=Connection reset by peer 10-Nov 01:12 bacula-fd JobId 1105: Fatal error: backup.c:1200 Network send error to SD. ERR=Connection reset by peer 10-Nov 01:45 bacula-dir JobId 1105: Fatal error: sql_create.c:860 Fill File table Query failed: INSERT INTO File (Fil eIndex, JobId, PathId, FilenameId, LStat, MD5, DeltaSeq) SELECT batch.FileIndex, batch.JobId, Path.PathId, Filename.F ilenameId,batch.LStat, batch.MD5, batch.DeltaSeq FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN Filename ON (b atch.Name = Filename.Name): ERR=ERROR: relation batch does not exist LINE 1: ...ameId,batch.LStat, batch.MD5, batch.DeltaSeq FROM batch JOIN... Mr. Keith: this is a database error. Probably related with batch insert feature. Was it upgraded before the problem starts to happen?Other causes to the similar problem: disk partition full on the database host; backup volumes loop inferno when PurgestOldestVolume is enabled. Regards,= Heitor Medrado de Faria Faltam poucos dias - Treinamento Telepresencial Bacula: http://www.bacula.com.br/?p=2174 61 2021-8260 | 8268-4220 Site: www.bacula.com.br | Facebook: heitor.faria | Gtalk: heitorfa...@gmail.com == -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Failed on backup volume 2 suddenly
Hi there, Since last two month the monthly job always failed when backup data to volume 2 (around 73%) with below error message. I should not do any change of bacula configuration in this period. Any idea? Thanks in advance! Connecting to Director baculab:9101 1000 OK: bacula-dir Version: 5.2.13 (19 February 2013) Enter a period to cancel a command. message 10-Nov 01:12 bacula-fd JobId 1105: Error: bsock.c:429 Write error sending 29424 bytes to Storage daemon:localhost:910 3: ERR=Connection reset by peer 10-Nov 01:12 bacula-fd JobId 1105: Fatal error: backup.c:1200 Network send error to SD. ERR=Connection reset by peer 10-Nov 01:45 bacula-dir JobId 1105: Fatal error: sql_create.c:860 Fill File table Query failed: INSERT INTO File (Fil eIndex, JobId, PathId, FilenameId, LStat, MD5, DeltaSeq) SELECT batch.FileIndex, batch.JobId, Path.PathId, Filename.F ilenameId,batch.LStat, batch.MD5, batch.DeltaSeq FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN Filename ON (b atch.Name = Filename.Name): ERR=ERROR: relation batch does not exist LINE 1: ...ameId,batch.LStat, batch.MD5, batch.DeltaSeq FROM batch JOIN... ^ 10-Nov 01:45 bacula-dir JobId 1105: Error: Bacula bacula-dir 5.2.13 (19Jan13): Build OS: x86_64-unknown-linux-gnu redhat JobId: 1105 Job: COMMTHLY1.2014-11-05_23.31.32_13 Backup Level: Full Client: baculab-fd 5.2.13 (19Jan13) x86_64-unknown-linux-gnu,redhat, FileSet: baculab Monthly Backup FS1 2014-06-01 08:00:00 Pool: MonthlyPool (From Job resource) Catalog: MyCatalog (From Client resource) Storage: usbstorage1 (From Job resource) Scheduled time: 05-Nov-2014 23:31:31 Start time: 05-Nov-2014 23:31:35 End time: 10-Nov-2014 01:45:21 Elapsed time: 4 days 2 hours 13 mins 46 secs Priority: 9 FD Files Written: 53,612,033 SD Files Written: 0 FD Bytes Written: 3,432,140,478,966 (3.432 TB) SD Bytes Written: 0 (0 B) Rate: 9705.6 KB/s Software Compression: None VSS: no Encryption: yes Accurate: no Volume name(s): COMHKM10HDD1|COMHKM10HDD2 Volume Session Id: 2 Volume Session Time: 1415159058 Last Volume Bytes: 1,450,907,925,271 (1.450 TB) Non-fatal FD errors: 587 SD Errors: 0 FD termination status: Error SD termination status: Running Termination: *** Backup Error *** Best regards,Keith -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unable to recover data using bscan
Hi Ana, Thanks for the point! I think I could not avoid setup the previous old version for this recovery when the new version currently use seems not working. I had already tried bextract command and failed as it seems to be not possible for encrypted data referring to some posts. Thanks much again for your helps! Best regards,Keith On Thursday, October 30, 2014 9:17 PM, Ana Emília M. Arruda emiliaarr...@gmail.com wrote: Hi Keith, I'm affraid it's a database version problem. Your 2012 backups have database vesion=12 and your current catalog uses version 14. If this is the problem, I'm not sure it is, then you can solve it creating an 5.0.3 director virtual machine with an empty database and restore the 8 volumes and jobs with bscan. For old backups, I normally use bextract for restores, mainly because I don't have file retention times too long and with bextract I can easly do full restores or select folders/files I want be restored (and you can use only one volume or all of them). Best regards,Ana On Thu, Oct 30, 2014 at 1:23 AM, Keith T keithb...@yahoo.com wrote: Hi Ana, Thanks for your kind advise! Will post after tried. But I would ask whether it is possible to restore data with one volume instead of multiple volume since the full backup done for eight volumes (and seems not able to restore it without creating the first volume). Besides, if possible, I shall use the job id (e.g.7) that has created when bscan multiple volumes as bscan one volume did not see a new job ID created? When use job ID 7, no more folders recovered after only bscan volume 7 even volfiles has value 232 now (re-run bscan -V COMHKOB2012HDD7 -v -s -S -m -c /etc/bacula/bacula-sd.conf /mnt/usb3docking1). [root@BSVR iscsi]# echo list media|bconsole Connecting to Director BSVR:9101 1000 OK: bacula-dir Version: 5.2.13 (19 February 2013) Enter a period to cancel a command. list media Automatically selected Catalog: MyCatalog Using Catalog MyCatalog Pool: Default No results to list. Pool: YearlyPool +-+-+---+-+-+--+--+-+--+---+---+-+ | mediaid | volumename | volstatus | enabled | volbytes | volfiles | volretention | recycle | slot | inchanger | mediatype | lastwritten | +-+-+---+-+-+--+--+-+--+---+---+-+ | 11 | COMHKOB2012HDD1 | Archive | 1 | 998,951,619,932 | 0 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-18 09:56:26 | | 12 | COMHKOB2012HDD2 | Archive | 1 | 999,122,570,931 | 0 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-19 01:13:42 | | 13 | COMHKOB2012HDD3 | Archive | 1 | 999,118,420,008 | 0 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-19 10:16:15 | | 14 | COMHKOB2012HDD4 | Archive | 1 | 999,122,062,160 | 232 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-19 22:43:03 | | 15 | COMHKOB2012HDD5 | Archive | 1 | 999,126,549,297 | 0 | 31,536,000 | 0 | 0 | 0 | File | | | 16 | COMHKOB2012HDD6 | Archive | 1 | 999,121,777,768 | 232 | 31,536,000 | 0 | 0 | 0 | File | | | 17 | COMHKOB2012HDD7 | Archive | 1 | 999,126,642,823 | 232 | 31,536,000 | 0 | 0 | 0 | File | | | 18 | COMHKOB2012HDD8 | Archive | 1 | 398,969,357,878 | 92 | 31,536,000 | 0 | 0 | 0 | File | | +-+-+---+-+-+--+--+-+--+---+---+-+ Best regards,Keith On Wednesday, October 29, 2014 7:17 PM, Ana Emília M. Arruda emiliaarr...@gmail.com wrote: Hi Keith, Have you checked with bls the contents of these volumes? Best regards,Ana On Wed, Oct 29, 2014 at 6:34 AM, Keith T keithb...@yahoo.com wrote: Dear All, I was trying to restore data that had been backup on year 2012 but some folders not found after recreated Catalog using the command bscan as described on below. Appreciate if you have any idea to fix this. #Tried recovery catalog by bscan command bscan -V COMHKOB2012HDD1\|COMHKOB2012HDD2\|COMHKOB2012HDD3\|COMHKOB2012HDD4\|COMHKOB2012HDD5\|COMHKOB2012HDD6\|COMHKOB2012HDD7\|COMHKOB2012HDD8 -v -s -S -m -c /etc/bacula/bacula-sd.conf /mnt/usb3docking1 All the eight medias have been created but some have 0 volfiles? Pool: YearlyPool +-+-+---+-+-+--+--+-+--+---+---+-+ | mediaid | volumename | volstatus | enabled | volbytes
[Bacula-users] Unable to recover data using bscan
Dear All, I was trying to restore data that had been backup on year 2012 but some folders not found after recreated Catalog using the command bscan as described on below. Appreciate if you have any idea to fix this. #Tried recovery catalog by bscan command bscan -V COMHKOB2012HDD1\|COMHKOB2012HDD2\|COMHKOB2012HDD3\|COMHKOB2012HDD4\|COMHKOB2012HDD5\|COMHKOB2012HDD6\|COMHKOB2012HDD7\|COMHKOB2012HDD8 -v -s -S -m -c /etc/bacula/bacula-sd.conf /mnt/usb3docking1 All the eight medias have been created but some have 0 volfiles? Pool: YearlyPool +-+-+---+-+-+--+--+-+--+---+---+-+ | mediaid | volumename | volstatus | enabled | volbytes | volfiles | volretention | recycle | slot | inchanger | mediatype | lastwritten | +-+-+---+-+-+--+--+-+--+---+---+-+ | 11 | COMHKOB2012HDD1 | Archive | 1 | 998,951,619,932 | 0 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-18 09:56:26 | | 12 | COMHKOB2012HDD2 | Archive | 1 | 999,122,570,931 | 0 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-19 01:13:42 | | 13 | COMHKOB2012HDD3 | Archive | 1 | 999,118,420,793 | 0 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-19 10:16:15 | | 14 | COMHKOB2012HDD4 | Archive | 1 | 999,122,061,957 | 232 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-19 22:43:03 | | 15 | COMHKOB2012HDD5 | Archive | 1 | 999,126,549,297 | 0 | 31,536,000 | 0 | 0 | 0 | File | | | 16 | COMHKOB2012HDD6 | Archive | 1 | 999,121,771,369 | 0 | 31,536,000 | 0 | 0 | 0 | File | | | 17 | COMHKOB2012HDD7 | Archive | 1 | 999,126,642,823 | 0 | 31,536,000 | 0 | 0 | 0 | File | | | 18 | COMHKOB2012HDD8 | Archive | 1 | 398,969,357,878 | 92 | 31,536,000 | 0 | 0 | 0 | File | | +-+-+---+-+-+--+--+-+--+---+---+-+ [root@BSVR temp]# echo list jobs |bconsole Connecting to Director BSVR:9101 1000 OK: bacula-dir Version: 5.2.13 (19 February 2013) Enter a period to cancel a command. list jobs Automatically selected Catalog: MyCatalog Using Catalog MyCatalog +---+---+-+--+---+---+---+---+ | jobid | name | starttime | type | level | jobfiles | jobbytes | jobstatus | +---+---+-+--+---+---+---+---+ | 7 | COMYRLY1 | 2013-02-18 09:56:27 | B | F | 2,915,058 | 3,992,442,976,336 | E | | 2 | BackupCatalog | 2014-09-30 23:10:03 | B | F | 0 | 0 | E | | 3 | BackupCatalog | 2014-10-01 23:10:03 | B | F | 0 | 0 | E | #Tried to restore one volume COMHKOB08HDD7 as I guess the expected data should be backed up on it. But the expected folders still not found. bscan -V COMHKOBHDD7 -v -s -S -m -c /etc/bacula/bacula-sd.conf /mnt/usb3docking1 #bacula version backup data used version 5.0.3 while doing recovery on a version bacula-5.2.13 Thanks! Best regards,Keith-- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unable to recover data using bscan
Hi Ana, Thanks for your kind advise! Will post after tried. But I would ask whether it is possible to restore data with one volume instead of multiple volume since the full backup done for eight volumes (and seems not able to restore it without creating the first volume). Besides, if possible, I shall use the job id (e.g.7) that has created when bscan multiple volumes as bscan one volume did not see a new job ID created? When use job ID 7, no more folders recovered after only bscan volume 7 even volfiles has value 232 now (re-run bscan -V COMHKOB2012HDD7 -v -s -S -m -c /etc/bacula/bacula-sd.conf /mnt/usb3docking1). [root@BSVR iscsi]# echo list media|bconsole Connecting to Director BSVR:9101 1000 OK: bacula-dir Version: 5.2.13 (19 February 2013) Enter a period to cancel a command. list media Automatically selected Catalog: MyCatalog Using Catalog MyCatalog Pool: Default No results to list. Pool: YearlyPool +-+-+---+-+-+--+--+-+--+---+---+-+ | mediaid | volumename | volstatus | enabled | volbytes | volfiles | volretention | recycle | slot | inchanger | mediatype | lastwritten | +-+-+---+-+-+--+--+-+--+---+---+-+ | 11 | COMHKOB2012HDD1 | Archive | 1 | 998,951,619,932 | 0 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-18 09:56:26 | | 12 | COMHKOB2012HDD2 | Archive | 1 | 999,122,570,931 | 0 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-19 01:13:42 | | 13 | COMHKOB2012HDD3 | Archive | 1 | 999,118,420,008 | 0 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-19 10:16:15 | | 14 | COMHKOB2012HDD4 | Archive | 1 | 999,122,062,160 | 232 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-19 22:43:03 | | 15 | COMHKOB2012HDD5 | Archive | 1 | 999,126,549,297 | 0 | 31,536,000 | 0 | 0 | 0 | File | | | 16 | COMHKOB2012HDD6 | Archive | 1 | 999,121,777,768 | 232 | 31,536,000 | 0 | 0 | 0 | File | | | 17 | COMHKOB2012HDD7 | Archive | 1 | 999,126,642,823 | 232 | 31,536,000 | 0 | 0 | 0 | File | | | 18 | COMHKOB2012HDD8 | Archive | 1 | 398,969,357,878 | 92 | 31,536,000 | 0 | 0 | 0 | File | | +-+-+---+-+-+--+--+-+--+---+---+-+ Best regards,Keith On Wednesday, October 29, 2014 7:17 PM, Ana Emília M. Arruda emiliaarr...@gmail.com wrote: Hi Keith, Have you checked with bls the contents of these volumes? Best regards,Ana On Wed, Oct 29, 2014 at 6:34 AM, Keith T keithb...@yahoo.com wrote: Dear All, I was trying to restore data that had been backup on year 2012 but some folders not found after recreated Catalog using the command bscan as described on below. Appreciate if you have any idea to fix this. #Tried recovery catalog by bscan command bscan -V COMHKOB2012HDD1\|COMHKOB2012HDD2\|COMHKOB2012HDD3\|COMHKOB2012HDD4\|COMHKOB2012HDD5\|COMHKOB2012HDD6\|COMHKOB2012HDD7\|COMHKOB2012HDD8 -v -s -S -m -c /etc/bacula/bacula-sd.conf /mnt/usb3docking1 All the eight medias have been created but some have 0 volfiles? Pool: YearlyPool +-+-+---+-+-+--+--+-+--+---+---+-+ | mediaid | volumename | volstatus | enabled | volbytes | volfiles | volretention | recycle | slot | inchanger | mediatype | lastwritten | +-+-+---+-+-+--+--+-+--+---+---+-+ | 11 | COMHKOB2012HDD1 | Archive | 1 | 998,951,619,932 | 0 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-18 09:56:26 | | 12 | COMHKOB2012HDD2 | Archive | 1 | 999,122,570,931 | 0 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-19 01:13:42 | | 13 | COMHKOB2012HDD3 | Archive | 1 | 999,118,420,793 | 0 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-19 10:16:15 | | 14 | COMHKOB2012HDD4 | Archive | 1 | 999,122,061,957 | 232 | 31,536,000 | 0 | 0 | 0 | File | 2013-02-19 22:43:03 | | 15 | COMHKOB2012HDD5 | Archive | 1 | 999,126,549,297 | 0 | 31,536,000 | 0 | 0 | 0 | File | | | 16 | COMHKOB2012HDD6 | Archive
Re: [Bacula-users] Problem of configuring Autochanger for Bacula 5.2.13
Hi Radoslaw, I am trying to backup data to two HDDs using two USB dockings. I tried the configurations as below but still failed. #bacula-sd.conf Autochanger { Name = usb-changer-1 Device = usb-changer-1-drive-0 Device = usb-changer-1-drive-1 Changer Command = #if not added, got error Changer Device = /dev/null #if not added, got error } Device { Name = usb-changer-1-drive-0 Drive Index = 0 Autochanger = yes; Device Type = File Media Type = Disk Archive Device = /mnt/usbdocking1 LabelMedia = yes; Random Access = Yes; AutomaticMount = yes; RemovableMedia = no; AlwaysOpen = yes; Maximum Concurrent Jobs = 5 } Device { Name = usb-changer-1-drive-1 Drive Index = 1 Autochanger = yes; Device Type = File Media Type = Disk #Archive Device = /mnt/usbdocking1 Archive Device = /mnt/usbdocking2 LabelMedia = yes; Random Access = Yes; AutomaticMount = yes; RemovableMedia = no; AlwaysOpen = yes; Maximum Concurrent Jobs = 5 } #bacula-dir.conf JobDefs { Name = TestJob Type = Backup Level = Full Client = bacula-fd FileSet = Test Backup Storage = usbchanger1 Messages = Standard Pool = TestPool Priority = 11 } Storage { Name = usbchanger1 Address = localhost SDPort = 9103 Password = WfYdG2,/8P Device = usb-changer-1 Media Type = File Autochanger = yes; } Pool { Name = TestPool Pool Type = Backup Recycle = no AutoPrune = yes Volume Retention = 7 days Label Format = Test- } #Error 27-May 19:18 bacula-dir JobId 867: Start Backup JobId 867, Job=TestBkup.2014-05-27_19.18.40_03 27-May 19:18 bacula-sd JobId 867: Fatal error: Device reservation failed for JobId=867: 27-May 19:18 bacula-dir JobId 867: Fatal error: Storage daemon didn't accept Device usb-changer-1 because: 3924 Device usb-changer-1 not in SD Device resources or no matching Media Type. 27-May 19:18 bacula-dir JobId 867: Error: Bacula bacula-dir 5.2.13 (19Jan13): Build OS: x86_64-unknown-linux-gnu redhat JobId: 867 Job: TestBkup.2014-05-27_19.18.40_03 Backup Level: Full Client: bacula-fd 5.2.13 (19Jan13) x86_64-unknown-linux-gnu,redhat, FileSet: Test Backup 2014-05-27 12:40:48 Pool: TestPool (From Job resource) Catalog: MyCatalog (From Client resource) Storage: usbchanger1 (From Job resource) Scheduled time: 27-May-2014 19:18:38 Start time: 27-May-2014 19:18:42 End time: 27-May-2014 19:18:42 Elapsed time: 0 secs Priority: 11 FD Files Written: 0 SD Files Written: 0 FD Bytes Written: 0 (0 B) SD Bytes Written: 0 (0 B) Rate: 0.0 KB/s Software Compression: None VSS: no Encryption: no Accurate: no Volume name(s): Volume Session Id: 1 Volume Session Time: 1401189512 Last Volume Bytes: 0 (0 B) Non-fatal FD errors: 1 SD Errors: 0 FD termination status: SD termination status: Termination: *** Backup Error *** When changed Media Type from Disk to File', I could run the job but a new volume was created on usbdocking1 but not usbdocking2 when HDD is full on usbdocking1? If using same archive device (e.g. usbdocking1), it won't backup on to another even the HDD is full. Any hints? Thanks in advance! Regards, Keith On Thursday, May 15, 2014 1:26 PM, Radosław Korzeniewski rados...@korzeniewski.net wrote: Hello, 2014-05-13 13:26 GMT+02:00 Keith T keithb...@yahoo.com: Thanks all for your reply and informative document! As stated on my previous message, I was using root to run bacula services and assumed it has no privilege issue. But not sure whether I have to run as bacula ID since I saw some suggested to do so? root 14419 1 4 May08 ? 06:03:09 /sbin/bacula-sd -v -c /etc/bacula/bacula-sd.conf root 14440 1 25 May08 ? 1-07:39:19 /sbin/bacula-fd -v -c /etc/bacula/bacula-fd.conf root 14463 1 0 May08 ? 00:02:01 /sbin/bacula-dir -v -c /etc/bacula/bacula-dir.conf I wonder why the command prompted me to check sg device but not sd device since I was connected a USB docking with dual slots. Recap: #Bacula is running as root [root@backupsys bacula]# /etc/bacula/mtx-changer /etc/bacula/usbchanger1.conf list /etc/bacula/usbchanger1.conf is not an sg device, or old sg driver In My Very Humble Opinion you are going in the wrong way!!! Stop before someone gets hurt. :) First of all. Do you have a tape library or autochanger connected into your Bacula server? Could you show an output of the command (run as root): # lsscsi -g If you do not have any tape library then please forget about mtx-changer script. It is for tape library/autochanger not disks. In this case
[Bacula-users] Backup failed after sixth days
Hi there, It seems to be running job had terminated after 6 days (or running the sixth HDD) for bacula 5.2.13. I tried several times using a new set HDD but got same error while previous monthly backup is okay, which used 4 2TB HDDs. I am using postgresql 8.4.9 as a DB for bacula 5.2.13. Any advises are appreciate. Thanks! 14-May 18:50 bacula-dir JobId 819: Error: Watchdog sending kill after 518401 secs to thread stalled reading File daemon. 14-May 18:50 bacula-dir JobId 819: Fatal error: Network error with FD during Backup: ERR=Interrupted system call 14-May 18:50 bacula-dir JobId 819: Fatal error: No Job status returned from FD. 14-May 18:50 bacula-dir JobId 819: Error: Bacula bacula-dir 5.2.13 (19Jan13): Build OS: x86_64-unknown-linux-gnu redhat JobId: 819 Job: MTHLY1.2014-05-08_18.50.20_04 Backup Level: Full Client: bro-fd 5.2.13 (19Jan13) x86_64-unknown-linux-gnu,redhat, FileSet: BRO Monthly Backup 2012-11-07 01:46:47 Pool: MonthlyPool (From Job resource) Catalog: MyCatalog (From Client resource) Storage: usb3docking1b (From Job resource) Scheduled time: 08-May-2014 18:50:18 Start time: 08-May-2014 18:50:23 End time: 14-May-2014 18:50:25 Elapsed time: 6 days 2 secs Priority: 10 FD Files Written: 0 SD Files Written: 0 FD Bytes Written: 0 (0 B) SD Bytes Written: 0 (0 B) Rate: 0.0 KB/s Software Compression: None VSS: no Encryption: no Accurate: no Volume name(s): M04HDD1|M04HDD2|M04HDD3|M04HDD4|M04HDD5 Volume Session Id: 1 Volume Session Time: 1399541333 Last Volume Bytes: 345,977,842,826 (345.9 GB) Non-fatal FD errors: 1 SD Errors: 0 FD termination status: Error SD termination status: Running Termination: *** Backup Error *** Best regards, Keith-- Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE Instantly run your Selenium tests across 300+ browser/OS combos. Get unparalleled scalability from the best Selenium testing platform available Simple to use. Nothing to install. Get started now for free. http://p.sf.net/sfu/SauceLabs___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem of configuring Autochanger for Bacula 5.2.13
Thanks all for your reply and informative document! As stated on my previous message, I was using root to run bacula services and assumed it has no privilege issue. But not sure whether I have to run as bacula ID since I saw some suggested to do so? root 14419 1 4 May08 ? 06:03:09 /sbin/bacula-sd -v -c /etc/bacula/bacula-sd.conf root 14440 1 25 May08 ? 1-07:39:19 /sbin/bacula-fd -v -c /etc/bacula/bacula-fd.conf root 14463 1 0 May08 ? 00:02:01 /sbin/bacula-dir -v -c /etc/bacula/bacula-dir.conf I wonder why the command prompted me to check sg device but not sd device since I was connected a USB docking with dual slots. Recap: #Bacula is running as root [root@backupsys bacula]# /etc/bacula/mtx-changer /etc/bacula/usbchanger1.conf list /etc/bacula/usbchanger1.conf is not an sg device, or old sg driver [root@backupsys bacula]# su bacula /etc/bacula/mtx-changer /etc/bacula/usbchanger1.conf list cannot open SCSI device '/etc/bacula/usbchanger1.conf' - Permission denied I am going to have more information by the command with debug option as shown on Dan's website (It's great! Appreciate to share with us!). Thanks in advance! Best regards, Keith Th On Tuesday, May 13, 2014 1:07 AM, Radosław Korzeniewski rados...@korzeniewski.net wrote: Hello, 2014-05-10 7:58 GMT+02:00 Kern Sibbald k...@sibbald.com: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hello, It sounds to me like you are trying to force an Autochanger, which is a Bacula device that typically works with physical tape autochangers to work with USB keys. While this is possible (example disk-changer, virtual-changer), you need to either use an existing script or you need to understand the details of the Autochanger implementation. There are two other possibilities: 1. The Bacula built-in virtual autochanger that has been discussed on this list a number of times, and rejected by a number of people, but it does work in large production environments. I can confirm Kern's words - one of the largest Bacula build-in virtual autochanger configuration which I was implemented consist of 80 devices in a single autochanger. It works a far better then any disk-changer or vchanger scripts. best regards -- Radosław Korzeniewski rados...@korzeniewski.net-- Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE Instantly run your Selenium tests across 300+ browser/OS combos. Get unparalleled scalability from the best Selenium testing platform available Simple to use. Nothing to install. Get started now for free. http://p.sf.net/sfu/SauceLabs___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Problem of configuring Autochanger for Bacula 5.2.13
Hi there, I upgraded Bacula from 5.0.3-2 to 5.2.13. Ithas no problem to run a backup job and back data directly on to USB deviceexcept Autochanger setting. I was trying to configure Autochanger to swap USB drives automatically fordata backupin order that I need not to manual exchange and mount HDD when one HDD is full. I got below errors when trying below commands. #Bacula is running as root [root@backupsys bacula]# /etc/bacula/mtx-changer /etc/bacula/usbchanger1.conf list /etc/bacula/usbchanger1.conf is not an sg device, or old sg driver [root@backupsys bacula]# su bacula /etc/bacula/mtx-changer /etc/bacula/usbchanger1.conf list cannot open SCSI device '/etc/bacula/usbchanger1.conf' - Permission denied Also tried to run bacula as ID bacula but failed too Configuration info: Bacula version: bacula-5.2.13 OS: Fedora 14 (2.6.35.14-106.fc14.x86_64) Postgresql: postgresql-8.4.9-1.fc14.x86_64 #setting in bacula-dir.conf file JobDefs { Name = TestJob Type = Backup Level = Full Client = bacula-fd FileSet = Test Backup Storage = usbchanger1 Messages = Standard Pool = TestPool Priority = 10 } Storage { Name = usbchanger1 Address = localhost SDPort = 9103 Password = PASSWORD Device = usb-changer-1 Media Type = File Autochanger = yes; } #setting in bacula-sd.conf file Autochanger { Name = usb-changer-1 Device = usb-changer-1-drive-0 Device = usb-changer-1-drive-1 Changer Command = /etc/bacula/mtx-changer %c %o %S %a %d Changer Device = /etc/bacula/usbchanger1.conf } Device { Name = usb-changer-1-drive-0 Drive Index = 0 Autochanger = yes; Device Type = File Media Type = File Archive Device = /var/spool/bacula/usbchanger1/drive0 #symlink to /mnt/usbchanger1/magazine/volfiles Random Access = Yes; RemovableMedia = no; } #setting in usbchanger1.conf file baculasd=usbchanger1 baculasd_user=bacula bconsole=/etc/bacula/bconsole magslots=2 maxdrive=1 mountpoint=/mnt/usbchanger1/magazine statedir=/var/spool/bacula/usbchanger1 Appreciate much for your help! Thanks in advance! Regards, Keith -- Is your legacy SCM system holding you back? Join Perforce May 7 to find out: #149; 3 signs your SCM is hindering your productivity #149; Requirements for releasing software faster #149; Expert tips and advice for migrating your SCM now http://p.sf.net/sfu/perforce___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Director keeps becoming unresponsive
On 05/07/2012 08:32, Uwe Schuerkamp wrote: On Tue, Jul 03, 2012 at 09:08:02PM +0100, Keith wrote: Hi, Our Bacula director keeps locking up and so far I've been unable to identify exactly why it's happening. Basically everything seems fine until we run a scheduled Full backup then after a minute or so BAT bconsole stop working. Maybe it's busy recycling volumes? What's the load on the server when this happens? Cheers, Uwe Doing a netstat -an on the director machine I can still see port 9102 and I can see that clients are connected. I can telnet to the director on port 9102 for a remote machine and get a response. I've looked through the logs in /var/bacula/working/ but can't see anything wrong. The Storage daemon is on another server and seems ok. We use file based backups, By doing a df -h I can see that the backups stop as the backup files stop increasing. Doing just a bacula stop / bacula start and we can connect to the director again. Our Bacula install was working quite well until last week. Unfortunately I've changed loads since then and It's only since last weekends full backups failed that I've realized that there's something not quite right. RECENT HISTORY... Until a week ago we were using Bacula 5.2.3 Last week we upgrade the director to 5.2.9. The catalog was already at the latest version (I think V13) I realised that LZO compression only works on unix clients Doh!!! Gzip is now enabled on our Windows servers (The manual doesn't make that very clear) I was trying to get data encription to work and managed ! WooHoo but have disabled it on my test client until this issues is resolved. I realized that the director and storage daemon should be on that version. Upgraded Bacula and Storage to 5.2.10 MY HUNCH We have two networks A B We have two Schedules A B It seems like there's an issue with something on Schedule A. ( Currently I am eliminating clients form schedule-A and trying it to do a FULL backup. If anyone has any ideas they would be really appreciated. Cheers Keith -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users Thanks for the reply, it seems like it's actually the version of Bacula that's the problem. I rolled back to 5.2.3 and Bacula started to work again and then upgraded to 5.2.6 and it carried on working. I'm away for the next week and will do some more investigation as to what the problem is when I return. The Director is running on a OpenBSD 5.1 x64 virtual server and I think it might be the OS that's the problem but I don't have the time to test just now. Keith -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Director keeps becoming unresponsive
Hi, Our Bacula director keeps locking up and so far I've been unable to identify exactly why it's happening. Basically everything seems fine until we run a scheduled Full backup then after a minute or so BAT bconsole stop working. Doing a netstat -an on the director machine I can still see port 9102 and I can see that clients are connected. I can telnet to the director on port 9102 for a remote machine and get a response. I've looked through the logs in /var/bacula/working/ but can't see anything wrong. The Storage daemon is on another server and seems ok. We use file based backups, By doing a df -h I can see that the backups stop as the backup files stop increasing. Doing just a bacula stop / bacula start and we can connect to the director again. Our Bacula install was working quite well until last week. Unfortunately I've changed loads since then and It's only since last weekends full backups failed that I've realized that there's something not quite right. RECENT HISTORY... Until a week ago we were using Bacula 5.2.3 Last week we upgrade the director to 5.2.9. The catalog was already at the latest version (I think V13) I realised that LZO compression only works on unix clients Doh!!! Gzip is now enabled on our Windows servers (The manual doesn't make that very clear) I was trying to get data encription to work and managed ! WooHoo but have disabled it on my test client until this issues is resolved. I realized that the director and storage daemon should be on that version. Upgraded Bacula and Storage to 5.2.10 MY HUNCH We have two networks A B We have two Schedules A B It seems like there's an issue with something on Schedule A. ( Currently I am eliminating clients form schedule-A and trying it to do a FULL backup. If anyone has any ideas they would be really appreciated. Cheers Keith -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Is this strategy sensible ?
We been using Bacula for just over a month now and want to get our offsite backups in place. We do file based backups with the following schedule. Name = WeeklyCycle Run = Level=Full Pool=Full-Pool 1st sun at 20:40 Run = Level=Differential Pool=Diff-Pool 2nd-5th sun at 20:40 Run = Level=Incremental Pool=Inc-Pool mon-sat at 20:40 The above schedule works fine, But I want to rsync the backup files to another data center automatically. The above schedule works fine but when a full backup happens there's to much data to transfer over the network. So I am thinking about modifying the schedule so that the full backups only happen once every 6 months and using weekly Diff's as these's are much easier to transfer as our data doesn't change that often. Then every 6 months we'd manualy trawnsfer the full backup files. Is this a good idea ? If we do the above it would be nice to have a seperate Full backup schedule that we run in addition just as a precaution. We couldn't transfer the full backups anywhere they would just be there in case. If we were to do this we would need the additional full backups to run without modifying the files on the clients. Is this possible ? Thanks Keith -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Can't get multiple catalogs to work.
I can't get bacula to work with two catalogs, if I have two catalog entries in the bacula-dir.conf file and start Bacula it starts up ok but if I then run a job via BAT or the Webmin Bacula gui the job doesn't seem to start. So I've striped out all of the additional catalog stuff from the bacula-dir.conf file and restarted bacula. Ran a job via Webmin and the job ran as expected ! So if I add an additional catalog to the bacula-dir.conf as follows Catalog { Name = Cat-Full dbname = bacula_full; dbuser = bacula; dbpassword = secret } Catalog { Name = Cat-Standard dbname = bacula; dbuser = bacula; dbpassword = secret } Restart Bacula try and run a job and nothing seems to happen. I haven't realy used bconsole as BAT Webmin were great, just hoping that they can cope with two cataloges Can anyone help ? Cheers Keith -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Schedule virtual servers so their not running concurrently
We have about 80 virtual servers running on 20 Physical servers that need backed up. Our Bacula implementation is now at scheduling stage and we are stuck trying to figure out how to get the virtual servers to backup without them all running concurrently overwhelming the physical servers that they are on. Our current plan is to have just one Schedule that will start at 1am then we will give each virtual server a unique priority, We plan to give the the first Job a priority of 5 then the next 10 and on.This seems a messy but I can't see any other way to stop or limit the number of virtual servers on the same physical server from running at the same time. There must be other people with load of virtual servers that have the same issues. This has probably been that forth or fifth email that I have written to this group. I've never sent the previous ones as I 've always found a solution before sending the email, but this time I'm stuck. It seems that the people that make Bacula what it is have though of everything and I'm just hoping there an elegant solution to my problem. Any help is really appreciated. Thanks Keith -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Disk backup strategy advice / help
On 04/01/2012 21:52, Adrian Reyer wrote: On Wed, Jan 04, 2012 at 12:16:55PM +, keith wrote: 460M Dec 29 23:19 Full-0001 26.3G Dec 30 23:52 Full-0003 702MDec 24 23:05 Inc-0001 10.0GDec 30 01:54 Inc-0002 2.3G Dec 31 00:06 Inc-0004 3.1G Dec 31 00:56 Inc-0005 611MDec 31 00:56 Inc-0006 Is the 10G on 24th mostly additional, changed or moved data? Are these compressed backups? Hi Adrian, The 10G was just a new additional client being introduced into the Bacula. Now that the backups seems to be working I need to figure out how to implement an offsite strategy, I want to use a combination of removable disks and rsync to do this. I think bacula is not the ideal tool for running additional offsite backups. And very likely rsync is not a good way if you use bacula. Oh ok I have 3 possibilities in mind: 1. If you are not talking about windows clients, I'd consider using rsync (e.g. via rsnapshot) to run the complete offsite backup unrelated to bacula. Run one rsync/rsnapshot job per client and the 'new' client will just run longer, independent of the others except the shared bandwidth. Via rsnapshot you only need to do 1 full backup per client, changed files just lead to new full backupsets, but only the difference needs to be transferred. We do that on several locations and wrote a wrapper round rsnapshot (which is a wrapper round rsync), debian packages are available at deb http://ftp.lihas.de/debian stable main package rsnapshot-backup. If you add some file unification tool, you get away with far less used diskspace. + only changes need to be transferred + initial backup can easily be transferred on external media to save bandwidth - no bacula, no bacula indexes - no backup of windows clients / anything that doesn't have rsync We have some Unix servers but the bulk of our servers are Windows. Our old/current backup strategy is to do full backups nightly and these are about 450G Compressed. If I could I would like to do some type of copy jobs where I copy the Incremental files to another place on the server and then get rsync to down these files knowing that they were just the incrementals. 2. Alternatively you can use the normal bacula backup + a copy job. As copy jobs only work on same bacula-sd, you could e.g. NFS-mount some external server and store the target pools there. The copy full pool is to local disks on individual mountpoints. Move the volumes to the remote location and replace it with links to remote NFS. + works with all clients - regularily transporting volumes offsite is required Only just read about Migration / Copy jobs last night (I am slowly getting through the Bacula manual) and will probably try to get one of these jobs working later today. I plan to have one dedicated bacula-fd server and have also planned to put the removable disks (Offsite Backup) into this server. If I can get Bacula manage my offsite disks and to also know whats on these disk will be great. 3. Run a complete seperate job instance to the remote site using a bacula-sd installed there. Use virtual full backups to create the fulls from the full/diff/inc backups. Initially a full backup has to pass the remote connection. + works with all clients 0 initial full might be expensive in bandwidth Currently I use 1. and 2. myself. With 3. I ran into trouble selecting the correct pools in my environment and virtual full in general including a tape changer with a single drive. There are network / firewall issue outwith my control that would make remote Bacula backups an issue. If I add a new server to be backed up to Bacula midweek it does a full backup in the INC pool. This might be a big backup and screw-up my Rsync job. Does this seem like a good idea and goes anyone know how keep Full backups out of the INC or DIFF pool Just do a manual initial full backup on the new client. As I assume they don't appear magically in your backup setup. Regards, Adrian Your right, they shouldn't just be appearing but they are while I play with Bacula :) But in the future when adding new clients in then it makes sense to manually kick off a full backup. Adrian, thanks for the detailed answers. I give the copy jobs a try and see how I get on. Cheers Keith. -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Disk backup strategy advice / help
I have Bacula 5.2.3 up and running and need some advice with the following I used this tutorial http://bacula.org/fr/dev-manual/Automated_Disk_Backup.html as a starting point and it's working well and I have backups appearing as follows... 460M Dec 29 23:19 Full-0001 26.3G Dec 30 23:52 Full-0003 702MDec 24 23:05 Inc-0001 10.0GDec 30 01:54 Inc-0002 2.3G Dec 31 00:06 Inc-0004 3.1G Dec 31 00:56 Inc-0005 611MDec 31 00:56 Inc-0006 Now that the backups seems to be working I need to figure out how to implement an offsite strategy, I want to use a combination of removable disks and rsync to do this. I want to use removable disks to take a backup offsite either weekly or forthnightly. (Just copy that most recent Full- file to the removable disk) I would like to rsync the daily INC Weekly Diff backups offsite if possible (100MB Link). My plan is that for complete recovery I will use a combination of the full backup that i will get from the Removable disks and the Rsync'd INC / Diff If I add a new server to be backed up to Bacula midweek it does a full backup in the INC pool. This might be a big backup and screw-up my Rsync job. Does this seem like a good idea and goes anyone know how keep Full backups out of the INC or DIFF pool Thanks Keith -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Slow spooling
We're seeing very slow spooling from a locally-attached disk: 12-Jun 10:31 rodney-sd JobId 179: User specified spool size reached. 12-Jun 10:44 rodney-sd JobId 179: Spooling data again ... 12-Jun 15:11 rodney-sd JobId 179: User specified spool size reached. 12-Jun 15:23 rodney-sd JobId 179: Spooling data again ... 12-Jun 19:59 rodney-sd JobId 179: User specified spool size reached. 12-Jun 20:12 rodney-sd JobId 179: Spooling data again ... 12-Jun 23:33 rodney-sd JobId 179: User specified spool size reached. 12-Jun 23:46 rodney-sd JobId 179: Spooling data again ... The spool size is set to 40Gb, so the above shows around 12-13 minutes to despool 40Gb to tape (sounds reasonable: tape is LT04), but between about 3.5hrs and 4.5hrs to copy the data to the spooling area. Both the spooling area and and source disk are locally mounted SCSI disks. No other Bacula jobs are running. A manual copy of data from the source disk to the spooling area seems not unreasonably slow: 11G copied in 5m15s, which would suggest that the 40Gb spool size should be copied in around 19 minutes. I fully accept that this slow spooling may be due to factors other than Bacula, but given that manual copy is running around 10-12 faster than the Bacula spool, I was wondering if there are any known issues with Bacula spooling? (Also grateful for other suggestions or tests we can run). Bacula version 2.4.4 Thanks, Keith -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Slow spooling
Apologies: I should have added that this was a full backup, so the slowness is not due to searching for newer files. -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] one time local full and then remote differentials
I dug around in the archives but didn't find this yet so I'll ask. I need to do a 50 gig remote backup with only a T-1 at the remote site. I want to perform the initial full backup of the data locally from a USB drive image of the remote data, and then update the bacula client and job configurations to point to the remote server and somehow trick Bacula into performing only differential backups of the remote site using the backup from the USB drive. With sufficient thrust, pigs fly just fine. However, this is not necessarily a good idea. -- RFC 1925 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Remote backup
I hope this isn't an old question. I did a little archive searching but didn't find anything. I want to do a FULL 50 gig backup locally (on the LAN), from a usb drive snapshot of a remote servers data maybe once or twice a year. Subsequently, I want to run INCREMENTAL backups over the Internet. i.e. I don't want a FULL triggered in any way for the over the Internet runs. So the differences between the two backups would be 1. a change in the client config (IP address), and 2. initially there would be no state file on the remote client server to agree with the cataloged FULL job record created from the local FULL snapshot. I don't know about director and/or storage daemon state files if any. Does the backup level selection logic tie into the clients state file job history or is the level choice completely director/catalog based? If its a director only decision, will I need to make any manual updates to the FULL job record prior to beginning the INCREMENTAL runs? Thanks in advance if anyone knows. -- Keith Stevens With sufficient thrust, pigs fly just fine. However, this is not necessarily a good idea. -- RFC 1925 -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] status jobs shows odd sizes
We're seeing some odd sizes reported for incremental backups. A 'status jobs' shows, firstly, for a full backup: 338 Full 19,796,3962.916 T OK 06-Apr-09 04:07 Client1 That looks right: nearly 20 million files and nearly 3Tb. Now an incremental: 340 Incr 1,0851.313 T OK 07-Apr-09 13:10 Client1 Just over a thousand files (believable) but 1.3Tb of data (not believable). That would suggest an average file size of over a gigabyte whereas the full back suggests an average file size of around 150K, which is much more believable. Quite apart from anything else, it's unlikely that 1.3Tb would even fit on an AIT5 tape. Whilst the backups seem to run successfully, it would be good to fix this erroneous reporting. Any suggestions for doing so would be appreciated. Bacula 2.4.2 Thanks, Keith -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Changing file-daemon hosts while keeping existing jobs, filesets without doing FULL backup
Keith Gunderson wrote: - Forwarded Message From: Keith Gunderson kr...@yahoo.com To: bacula-users@lists.sourceforge.net Sent: Tuesday, March 31, 2009 11:55:10 AM Subject: [Bacula-users] Changing file-daemon hosts while keeping existing jobs, filesets without doing FULL backup Hi There, I've been unsubscribed to bacula-users for a number of months... no issues is good, right? But my apologies if this has been asked a lot. I didn't find the answer by searching. I just did a some testing and figured it out for myself. Nothing that follows is recommended (by me) unless you're comfortable with db-admin tasks, sql, and probably C so that you can look into bacula source code to confirm your suspicions about how things work. But actually, doing what follows was pretty easy. We're running bacula 2.2.8 on Debian. I'd like to replace our main fileserver without having to do a full backup of the jobs immediately after the switch. Just to clarify, our fileserver is just computer running bacula-fd. We have about 25 TB of data on some FC disk arrays. Our filesystems are xfs and we use LVM for some nice flexibilty. We'll unplug our old server from the FC switch and plug our new server in. Mount the filesystems and go from there. This worked really well. Copying the /etc/lvm configuration from old to new is what's needed. What is my best bet for getting incrementals to work the next evening? 1) Alter the client table. (I.e. add a new client entry, immediately stop bacula, manually change the two client entries in database table so that the new server has the old servers clientID.) 2) Alter the jobs table (i.e. alter the clientID entry for every job row so that the new servers clientID is listed where the old server used to be.) 3) Buy new tapes dude, you're screwed. If so, why? Thanks! Keith Option 2 was the path I took. After backing up the bacula config and db to my hearts content, I configured the new client and ran a simple backup. Then I looked into the client table and saw what I wanted. Then I ran: update job set clientid = 14 where clientid = 2; (Your query may be different and involve more in the where clause depending on your setup.) Then I updated the jobs jobdefs so that the new fileserver replace the old fileserver. Now its like the old filesystems are on a new server, and I can do incremental backups immediately. If you want to do this, make sure you test it all yourself. Thanks! Keith From: Keith Gunderson kr...@yahoo.com To: bacula-users@lists.sourceforge.net Sent: Tuesday, March 31, 2009 11:55:10 AM Subject: [Bacula-users] Changing file-daemon hosts while keeping existing jobs, filesets without doing FULL backup Hi There, I've been unsubscribed to bacula-users for a number of months... no issues is good, right? But my apologies if this has been asked a lot. I didn't find the answer by searching. We're running bacula 2.2.8 on Debian. I'd like to replace our main fileserver without having to do a full backup of the jobs immediately after the switch. We have about 25 TB of data on some FC disk arrays. Our filesystems are xfs and we use LVM for some nice flexibilty. We'll unplug our old server from the FC switch and plug our new server in. Mount the filesystems and go from there. What is my best bet for getting incrementals to work the next evening? 1) Alter the client table. (I.e. add a new client entry, immediately stop bacula, manually change the two client entries in database table so that the new server has the old servers clientID.) 2) Alter the jobs table (i.e. alter the clientID entry for every job row so that the new servers clientID is listed where the old server used to be.) 3) Buy new tapes dude, you're screwed. If so, why? Thanks! Keith -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Changing file-daemon hosts while keeping existing jobs, filesets without doing FULL backup
Hi There, I've been unsubscribed to bacula-users for a number of months... no issues is good, right? But my apologies if this has been asked a lot. I didn't find the answer by searching. We're running bacula 2.2.8 on Debian. I'd like to replace our main fileserver without having to do a full backup of the jobs immediately after the switch. We have about 25 TB of data on some FC disk arrays. Our filesystems are xfs and we use LVM for some nice flexibilty. We'll unplug our old server from the FC switch and plug our new server in. Mount the filesystems and go from there. What is my best bet for getting incrementals to work the next evening? 1) Alter the client table. (I.e. add a new client entry, immediately stop bacula, manually change the two client entries in database table so that the new server has the old servers clientID.) 2) Alter the jobs table (i.e. alter the clientID entry for every job row so that the new servers clientID is listed where the old server used to be.) 3) Buy new tapes dude, you're screwed. If so, why? Thanks! Keith -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula restore incomplete
Hi there, We are running bacula 2.2.8 on an Ubuntu 8.04 distro. We are backing up a Windows 2003Server, 5 XP PC's and the Ubuntu server. A relatively small system. Everything appears to be set up ok. The Director is running happily with reports coming through on e-mail. The Server2003 machine holds our teacher Users directory with 25 teachers (each with their own directory. We also back up the Mail directory - also 25 teachers. When we restore (as a trial to test it) we find only a few Directories reappearing for the Users and Mail directories. Why is this? I am at a complete loss. We are postulating that only the Incrementals are restored??? Any ideas? - Keith in Cape Town, RSA. - Original Message - From: bacula-users-requ...@lists.sourceforge.net To: bacula-users@lists.sourceforge.net Sent: Tuesday, February 10, 2009 2:15 AM Subject: Bacula-users Digest, Vol 34, Issue 13 Send Bacula-users mailing list submissions to bacula-users@lists.sourceforge.net To subscribe or unsubscribe via the World Wide Web, visit https://lists.sourceforge.net/lists/listinfo/bacula-users or, via email, send a message with subject or body 'help' to bacula-users-requ...@lists.sourceforge.net You can reach the person managing the list at bacula-users-ow...@lists.sourceforge.net When replying, please edit your Subject line so it is more specific than Re: Contents of Bacula-users digest... Today's Topics: 1. Re: Cannot find any appendable volumes. (John Drescher) 2. Re: Cannot find any appendable volumes. (KNOPS Manfred) 3. How to delete volumes ? (ML mail) 4. Re: Debian/Ubuntu and openssl (Lukasz Szybalski) 5. Re: Debian/Ubuntu and openssl (Philipp Geschke) 6. Re: Debian/Ubuntu and openssl (John Goerzen) 7. Re: Debian/Ubuntu and openssl (Kern Sibbald) 8. Re: copy and compression (Hemant Shah) 9. Re: tape error and bacula: ...block numbers differ (Martin Simmons) 10. Re: Feature request: Enable/disable spooling when using run (Wolfgang Denk) 11. Backup on SD Cards (S?bastien WENSKE) 12. Re: Setup advices for some heterogenous set of server (Thomas Manson) 13. Monthly Schedule Question (Hillel Seltzer) 14. Finding performance issues ((private) HKS) 15. auto-changer help (Steve Hood) 16. Re: auto-changer help (John Drescher) -- Message: 1 Date: Mon, 9 Feb 2009 08:13:04 -0500 From: John Drescher dresche...@gmail.com Subject: Re: [Bacula-users] Cannot find any appendable volumes. To: KNOPS Manfred manfred.kn...@3ds.com, bacula-users Bacula-users@lists.sourceforge.net Message-ID: 387ee2020902090513x213a20f3kbf9ebf5d4bd8e...@mail.gmail.com Content-Type: text/plain; charset=ISO-8859-1 On Mon, Feb 9, 2009 at 7:51 AM, KNOPS Manfred manfred.kn...@3ds.com wrote: Hello together, I hope someone can help me. Last Saturday bacula should make fullbackup for 22 clients. It starts at 20:05 with the first client. helios-Pool At Sunday morning 04:04 it send me messages like this: 08-Feb 04:04 backupserver-sd JobId 232: Job helios-Automatic-Backup.2009-02-07_20.05.21 waiting. Cannot find any appendable volumes. Please use the label command to create a new Volume for: Storage: helios-Device (/backup/helios) Pool: helios-Pool Media type: File how about the output of list media pool=helios-Pool John -- Message: 2 Date: Mon, 9 Feb 2009 14:43:48 +0100 From: KNOPS Manfred manfred.kn...@3ds.com Subject: Re: [Bacula-users] Cannot find any appendable volumes. To: John Drescher dresche...@gmail.com, bacula-users Bacula-users@lists.sourceforge.net Message-ID: f8dfbc137e18114aa4e6c3a44bc8bc7e74f...@corp-sur-exb02.ds Content-Type: text/plain; charset=us-ascii Here are the output of list media pool=helios-Pool list media pool=helios-Pool +-+-+---+-+---+- -+--+-+--+---+---+-- ---+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-+-+---+-+---+- -+--+-+--+---+---+-- ---+ | 73 | helios-0073 | Recycle | 1 | 1 |0 |0 | 1 |0 | 0 | File | 2009-01-29 03:18:59 | | 74 | helios-0074 | Full | 1 | 4,509,711,266 |1 |2,592,000 | 1 |0 | 0 | File | 2009-01-29 04:03:36 | | 75 | helios-0075 | Full | 1 | 4,509,711,086 |1 |2,592,000 | 1 |0 | 0 | File | 2009-01-29 04:38:43 | | 76 | helios-0076 | Full | 1 | 4,509,711,368 |1 |2,592,000 | 1 |0 | 0 | File | 2009-01
[Bacula-users] Changing backup completely / blanking or relabel tapes quickly
Hi Guys, Currently we backup every day to tape, we are changing to backup every thing to NAS each night and then backing the NAS up with Bacula every Friday. I am wondering what is the quickest way to blank / relabel a tape. I have a whole pile of tapes I need to add to Fridays job pool that are currently in other pools. I was thinking about having 24 friday tapes, friday1, friday2, friday3 etc and putting them in the pool Friday. Many Thanks Keith - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Changing backup completely / blanking or relabel tapes quickly
Alan Brown wrote: On Mon, 6 Oct 2008, Keith Sudbury wrote: I am wondering what is the quickest way to blank / relabel a tape. Use the purge command in bconsole Bacula will recycle and relabel the tape itself, you don't need to do so manually (and doing so will usually mess things up) I have a whole pile of tapes I need to add to Fridays job pool that are currently in other pools. I was thinking about having 24 friday tapes, friday1, friday2, friday3 etc and putting them in the pool Friday. If you want to change the label, use the relabel command. Can I change the job pool the tape uses as well? Cheers Keith AB - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Using Bacula with CentOS + Xen
Hi Guys, I am new to Bacula, however I have done some reading on the project. I am wanting to use it on my Xen box, I will be running Bacula on the Dom0 which will be CentOS and the two virtual machines will be Windows 2003 SBS and a CentOS 5.1. I will be deploying agents on the the two virtual machines and run the Bacula server on the Dom0 where the tape drive is connected, I will be backing up MS SQL and MS Exchange databases on the Windows box plus standard file backups. Does this sound sane? I am also wondering what is the best way to install Bacula on RHEL and it's clones like CentOS? This must be a popular version of Linux to install Bacula on? Are there any RPM's available? I need to be running Bacula 2.0+ for the Exchange feature, I did stumble across some RPM's for version 2.0.3 I am not sure if there are any issues with that version and windows open file / Exchange / MS SQL backing up? Many Thanks Keith -- Keith Sudbury Netzen Solutions Ltd Web:http://www.netzensolutions.com Email: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] Tel:+44 (0)1225 588 588 Mob:+44 (0)7970 165 190 Fax:+44 (0)1225 580 061 - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Pool Type definition in Pool Resource
We're currently trying to come up with a system for permanently archiving projects to tape. I noticed one of the options for the Pool Type directive was Archive and was curious about what it does or will do. Thanks for you response. -Keith -Original Message- From: Dan Langille [mailto:[EMAIL PROTECTED] Sent: Monday, January 28, 2008 1:36 PM To: [EMAIL PROTECTED] Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Pool Type definition in Pool Resource Keith Roberts wrote: Hi, Where can I find more detail about the different Pool Types listed in the Bacula manual: Chapter 11, pg.178? There is a note specifying Backup as being the only type currently available - are the others coming soon? AFAIK, no. They are not under any active development. Why do you ask? Is there something in particular you wish to get from those other backup types? FYI, current work/projects are here: http://www.bacula.org/en/?page=projects The top five projects have a * and they are the current priority. BTW, I understand more and more people are quoting the PDF manual in their questions. In this case, it is page 178, but it's actually physical page 206, which is what most people need to know in order to find it. No worries, I never thought about this until just now either. :) -- Dan Langille BSDCan - The Technical BSD Conference : http://www.bsdcan.org/ PGCon - The PostgreSQL Conference: http://www.pgcon.org/ - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Spooling
Has anyone got spooling to work with an OpenBSD client ? I'm using 1.38. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] problems with Autochanger
It looks like sg3 should be the device name for your changer (sg2 is the drive device). Change your superload item in the sd.conf and try some more. Email me if you have more questions. Keith Christoph Buchli [EMAIL PROTECTED] wrote: Hy list I give up trying and start hoping... hoping someone here could help me... My problem is, that bacula (and even mtx) won't use my autochanger as it would be built for... mtx recognises it [1] but that's all. According to this, I set up my bacula-sd.conf: [2] Everything looks great so far, doesn't it? (I'm pretty shure that sg2 is the right device but although I tested with sg3: Same behaviour. The problem is now that bacula won't accept or even detect some Tapes. The 'label' command prints me some mtx-errors [3] and prints: Label command failed for Volume TestTape001. I have added some outputs of bconsole [4]... Confusing is, that the it seems that there is somewhere a tape labeled with Montag but it is not mounted although bconsole tells that it is mounted. The 'create' command responses with an error too that say something like: 'Pool Default already exists'. Why the hell is he trying the slots command on Drive-1, my archive-device [5]? I guess it's just a lack of understanding how this whole tape-thing works. Of corse I've read through the documentation an found a lot of helpful things but at the moment I can turn page about page but can't find anything... Thanks a lot in advice. sincerely, christoph __ [1] perl -e 'my @v = ( 0,1,2,3 ) ; foreach ( @v ) { my $cmd = `mtx -f /dev/sg$_ inquiry` ; print $cmd\r\r ; }' Product Type: Disk Drive Vendor ID: 'Areca ' Product ID: 'ARC-1260-VOL#00 ' Revision: 'R001' Attached Changer: No Product Type: Processor Vendor ID: 'Areca ' Product ID: 'RAID controller ' Revision: 'R001' Attached Changer: Yes Product Type: Tape Drive Vendor ID: 'CERTANCE' Product ID: 'ULTRIUM 3 ' Revision: '1856' Attached Changer: No Product Type: Medium Changer Vendor ID: 'QUANTUM ' Product ID: 'UHDL' Revision: '0031' Attached Changer: No [2] cat /usr/sepp/var-svn/bacula/srv-rhein/bacula-sd.conf | grep .. | grep -v ^\# [...] Autochanger { Name = Superloader Device = Drive-1 Changer Device = /dev/sg2 Changer Command = /usr/pack/bacula_mysql-2.0.3-rp/amd64-debian-linux3.1/scripts/mtx-changer %c %o %S %a %d } Device { Name = Drive-1 Drive Index = 0 Media Type = LTO-3 Archive Device = /dev/nst0# Normal archive device Minimum block size = 1024 Maximum blocksize = 1024 Autochanger = yes LabelMedia = no; AutomaticMount = yes; AlwaysOpen = yes; } [...] [3] root(cbu)@srv-rhein# mtx -f /dev/sg2 status mtx: Request Sense: 70 00 05 00 00 00 00 1E 00 00 00 00 20 00 00 00 00 00 00 00 READ ELEMENT STATUS Command Failed root(cbu)@srv-rhein# mtx -f /dev/sg3 status mtx: Request Sense: 70 00 02 00 00 00 00 1E 00 00 00 00 04 03 00 00 00 00 00 00 READ ELEMENT STATUS Command Failed root(cbu)@srv-rhein# mtx -f /dev/sg3 inventory mtx:inventory failed [4] bconsole * mount 2(Superloader) Slot:1 [...] 3001 Mounted Volume: Montag 3001 Device Drive-1 (/dev/nst0) is already mounted with Volume Montag * list pools Automatically selected Catalog: MyCatalog Using Catalog MyCatalog ++-+-+-+--+-+ | PoolId | Name| NumVols | MaxVols | PoolType | LabelFormat | ++-+-+-+--+-+ | 1 | Default | 1 | 0 | Backup | * | ++-+-+-+--+-+ *list volumes Pool: Default +-+--+---+-++--+--+-+--+---+---+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-+--+---+-++--+--+-+--+---+---+-+ | 1 | TestVolumeTmp001 | Append| 1 | 18,513,823 |0 | 31,536,000 | 1 |0 | 1 | File | 2007-05-16 15:51:40 | +-+--+---+-++--+--+-+--+---+---+-+ [5] *update Update choice: 1: Volume parameters 2: Pool from resource 3: Slots from autochanger Choose catalog item to update (1-3): 3 The defined Storage resources are: 1: File 2: Superloader Select Storage resource (1-2): 2 Connecting to Storage daemon Superloader at srv-rhein:9103 ... 3306 Issuing autochanger slots command. Device Drive-1 has 0 slots. No slots in changer to scan. * - This SF.net email is sponsored by DB2 Express Download DB2 Express C
Re: [Bacula-users] Unable to Connect fo File daemon. ERR:No Route to host
A little bit more detail, if you need it. See if iptables is blocking the port, after your host configs are done. You may want to do a quick test on the director and storage host. (Save the settings, stop iptables, test bacula, start iptables, then configure iptables correctly.) I won't make suggestions about the last step, but its probably documented somewhere. Steps 1,2, 4 are: /etc/init.d/iptables save /etc/init.d/iptables stop /etc/init.d/iptables start I don't suppose this is dangerous for a short testing period, but would anyone suggest that you not do this? Ralf Winkler [EMAIL PROTECTED] wrote: A error like this happen normally if the directory can not resolve the name of the client. Make sure you have a valid route to the client. Do you use subnetting? Can you ping the client from the director computer? Ralf On 4/21/07, Mike Vasquez [EMAIL PROTECTED] wrote: This is happened to two new machines running CentOS 4.4. In the logs it says SD termination status: Waiting on FD Here is my settings on one of them. Client { Name = hl72 Address = 192.168.1.3 FDPort = 9102 Catalog = MyCatalog Password = bacula # password for FileDaemon } Pool { Name = hl72_Full Pool Type = Backup Recycle = yes AutoPrune = yes Volume Retention = 12h Maximum Volume Jobs = 1 Label Format = ${Job}_${Level} Maximum Volumes = 6 } Job { Name = hl72 JobDefs = hl72 Write Bootstrap = /etc/bacula/bootstrap/hl72.bsr } JobDefs { Name = hl72 Type = Backup Client = hl72 FileSet = Default Schedule = DailyCycle Storage = Storage_hl72 messages = Standard Pool = hl72_Full Priority = 5 } Storage { Name = Storage_hl72 # Do not use localhost here Address = my.hostname.domainname.com# N.B. Use a fully qualified name here SDPort = 9103 Password = bacula Device = Backup_hl72 Media Type = File Autochanger = no } I have a couple more machines to setup but I need the above to work. I followed what the documentation said. Is there a specific version of the bacula-client that CentOS prefers. I am using version 1.36.2 of bacula-dir and 1.36.3-1 of the bacula-client. I have even modified hl72's host file to make sure it knows how to get the the director and I still have this problem. Any help would be appreciated. Mike V -- View this message in context: http://www.nabble.com/Unable-to-Connect-fo-File-daemon.--ERR%3ANo-Route-to-host-tf3619783.html#a10107377 Sent from the Bacula - Users mailing list archive at Nabble.com. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Ahhh...imagining that irresistible new car smell? Check outnew cars at Yahoo! Autos.- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula issues with Linux Fibre Channel drive
Hello, I'm having a hard time tracking down some issues with bacula on my Linux2.6.9k system. I have the sense that the issue could be the result of a misconfiguration of a wide variety of sub-systems. I've spent a lot of time learning how to update firmware, verify driver versions and Fibre Channel topology. So with apologies in advance for my inability to identify the important info first... here's my issue. I have a 4-cpu Xeon system that runs RedHat AS4. This has an Overland 11 slot changer (/dev/sg12) with an HP LTO3 drive (/dev/nst0). This runs through a AIC7xxx type of scsi card. I rebuilt to bacula 2.0.2 last month. I also had the same issues last year using 1.3.36. I use postgres 7.4.13 as the db. The bacula system seems to function well on its own as tests with btape have no issues. But, when jobs are run, the jobs run very slowly with long halts. Also, thousands of these messages are put in the kernel ring buffer while the jobs are spooling to the staging area. The database is on one Fibre Chan. drive. The spooling directory is on another Fibre Channel drive. Most of data getting backed up is from those and other FC drives. All of those drives are on Fibre channel arrays on ioc0 using the mpt-fusion driver. mptbase: ioc0: LogInfo(0x2008): SubCl={FCP Initiator} mptbase: ioc0: LogInfo(0x2008): SubCl={FCP Initiator} mptbase: ioc0: LogInfo(0x2008): SubCl={FCP Initiator} mptbase: ioc0: LogInfo(0x2008): SubCl={FCP Initiator} mptbase: ioc0: LogInfo(0x2008): SubCl={FCP Initiator} mptbase: ioc0: LogInfo(0x2008): SubCl={FCP Initiator} mptbase: ioc0: LogInfo(0x2008): SubCl={FCP Initiator} This bacula issue is the only issue that I have with the system. I can't determine if the issue is related to bacula directly or if it is an indirect problem that only appears during bacula due to the high throughput. Have there been issue related to bacula's file usage on similar systems? (Just grasping at straws.) Can anyone offer suggestions one identifying or solving the problem? Keith - Now that's room service! Choose from over 150,000 hotels in 45,000 destinations on Yahoo! Travel to find your fit.Hello,I'm having a hard time tracking down some issues with my Linux2.6 system. I have the sense that the issue could be the result of a misconfiguration of a wide variety of sub-systems. I've done a fair bit tracking down hardware/ firmware issues, but I'm not convinced of my analysis. So with apolgies in advance for my inability to identify the importants first... here's my issue.I have a 4-core Xeon system that runs RedHat AS4. This has an Overland 11 slot changer (/dev/sg12) with an HP LTO3 drive (/dev/nst0). This runs through a AIC7xxx type of scis card.I rebuilt to bacula 2.0.2 last month. I also had the same issues last year using 1.3.36. I use postgres 7.4.13 as the db. The bacula system seems to function well on its own as tests with btape have no issues. But, when jobs are run, the jobs run very slowly. Also, thousands of these messages are put in the kernel ring buffer while the jobs are spooling to the staging area.I'm guessing that the issue is the device that houses the bacuala database. That drive is on a Fibre channel array on ioc0. mptbase: ioc0: LogInfo(0x2008): SubCl={FCP Initiator}mptbase: ioc0: LogInfo(0x2008): SubCl={FCP Initiator}mptbase: ioc0: LogInfo(0x2008): SubCl={FCP Initiator}mptbase: ioc0: LogInfo(0x2008): SubCl={FCP Initiator}mptbase: ioc0: LogInfo(0x2008): SubCl={FCP Initiator}mptbase: ioc0: LogInfo(0x2008): SubCl={FCP Initiator}mptbase: ioc0: LogInfo(0x2008): SubCl={FCP Initiator}- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bweb Bconsole Error Message
Thanks Eric, After pointing to the correct console I was able to get bweb working properly. Bweb does require -n in the website configuration in order to use Expect. Regards, Keit -Original Message- From: Eric Bollengier [mailto:[EMAIL PROTECTED] Sent: Sunday, February 18, 2007 7:42 AM To: Keith Thomas Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] bweb Bconsole Error Message Hi, I have bweb running and can view jobs as well as change the configuration file in /etc/bacula/bweb.conf. However when I try to use a command through bweb it doesn't work. I suspected it was bconsole and did some searching through the support archives. I ran across a test.pl to verify output using bconsole and instead of getting the expected information I received the error messages below. Can anyone help me figure out what is missing or misconfigured so that I can execute bconsole commands through bweb? Spawned '/etc/bacula/bconsole -n -c /bacula/etc/bconsole.conf' You must use /usr/bin/bconsole binary instead of /etc/bacula/bconsole script. Bconsole script don't use -n switch. Bye This e-mail message and its attachments may contain confidential or legally privileged information and are for the sole use of the designated recipient(s). If you are not a designated recipient of this message, please do not read, copy, use, or disclose this message or its attachments; and notify the sender by replying to this message, and delete or destroy all copies of this message and attachments in all media. Thank you. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bweb Bconsole Error Message
Host: i686-pc-linux-gnu - redhat (CentOS4) Bacula version: 2.0.2 (28 January 2007) I have bweb running and can view jobs as well as change the configuration file in /etc/bacula/bweb.conf. However when I try to use a command through bweb it doesn't work. I suspected it was bconsole and did some searching through the support archives. I ran across a test.pl to verify output using bconsole and instead of getting the expected information I received the error messages below. Can anyone help me figure out what is missing or misconfigured so that I can execute bconsole commands through bweb? Test.pl script [EMAIL PROTECTED] bweb]# vi test.pl #!/usr/bin/perl -w use strict; use Bconsole; my $c = new Bconsole(pref = { bconsole = '/etc/bacula/bconsole -n -c /bacula/etc/bconsole.conf', }, debug = 1); print fileset : , join(',', $c-list_fileset()), \n; print job : , join(',', $c-list_job()), \n; print storage : , join(',', $c-list_storage()), \n; print status client :\n; $c-send_cmd(status client=bacula); test.pl ouput is below. [EMAIL PROTECTED] bweb]# ./test.pl Spawned '/etc/bacula/bconsole -n -c /bacula/etc/bconsole.conf' spawn id(3) Pid: 16252 Tty: /dev/pts/2 at /usr/lib/perl5/site_perl/5.8.5/Expect.pm line 179 Expect::spawn('Expect=GLOB(0x975d7bc)', '/etc/bacula/bconsole', '-n', '-c', '/bacula/etc/bconsole.conf') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 152 Bconsole::connect('Bconsole=HASH(0x9428b3c)') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 186 Bconsole::send_cmd('Bconsole=HASH(0x9428b3c)', '.filesets') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 319 Bconsole::list_fileset('Bconsole=HASH(0x9428b3c)') called at ./test.pl line 9 Use of uninitialized value in scalar assignment at /usr/lib/perl5/5.8.5/Bconsole.pm line 153. Starting EXPECT pattern matching... at /usr/lib/perl5/site_perl/5.8.5/Expect.pm line 559 Expect::expect('Expect=GLOB(0x975d7bc)', 20, '*') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 107 Bconsole::expect_it('Bconsole=HASH(0x9428b3c)', '*') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 164 Bconsole::connect('Bconsole=HASH(0x9428b3c)') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 186 Bconsole::send_cmd('Bconsole=HASH(0x9428b3c)', '.filesets') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 319 Bconsole::list_fileset('Bconsole=HASH(0x9428b3c)') called at ./test.pl line 9 Connecting to Director bacula:9101 1000 OK: bacula-dir Version: 2.0.2 (28 January 2007) Enter a period to cancel a command. *Starting EXPECT pattern matching... at /usr/lib/perl5/site_perl/5.8.5/Expect.pm line 559 Expect::expect('Expect=GLOB(0x975d7bc)', 20, 'gui on') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 107 Bconsole::expect_it('Bconsole=HASH(0x9428b3c)', 'gui on') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 190 Bconsole::send_cmd('Bconsole=HASH(0x9428b3c)', 'gui on') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 165 Bconsole::connect('Bconsole=HASH(0x9428b3c)') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 186 Bconsole::send_cmd('Bconsole=HASH(0x9428b3c)', '.filesets') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 319 Bconsole::list_fileset('Bconsole=HASH(0x9428b3c)') called at ./test.pl line 9 Starting EXPECT pattern matching... at /usr/lib/perl5/site_perl/5.8.5/Expect.pm line 559 Expect::expect('Expect=GLOB(0x975d7bc)', 20, '-re', 'Regexp=SCALAR(0x976daa4)') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 107 Bconsole::expect_it('Bconsole=HASH(0x9428b3c)', '-re', 'Regexp=SCALAR(0x976daa4)') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 192 Bconsole::send_cmd('Bconsole=HASH(0x9428b3c)', 'gui on') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 165 Bconsole::connect('Bconsole=HASH(0x9428b3c)') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 186 Bconsole::send_cmd('Bconsole=HASH(0x9428b3c)', '.filesets') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 319 Bconsole::list_fileset('Bconsole=HASH(0x9428b3c)') called at ./test.pl line 9 Starting EXPECT pattern matching... at /usr/lib/perl5/site_perl/5.8.5/Expect.pm line 559 Expect::expect('Expect=GLOB(0x975d7bc)', 20, '.filesets') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 107 Bconsole::expect_it('Bconsole=HASH(0x9428b3c)', '.filesets') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 190 Bconsole::send_cmd('Bconsole=HASH(0x9428b3c)', '.filesets') called at /usr/lib/perl5/5.8.5/Bconsole.pm line 319 Bconsole::list_fileset('Bconsole=HASH(0x9428b3c)') called at ./test.pl line 9 Starting EXPECT pattern matching... at /usr/lib/perl5/site_perl/5.8.5/Expect.pm line 559 Expect::expect('Expect=GLOB(0x975d7bc)', 20, '-re',
[Bacula-users] Ubuntu missing mysql scripts?
After RTFM/Google/Gmame/etc., I still can't find a way to re-init the bacula mysql db. The bacula manual directs you to use 'drop_bacula_tables' and 'bacula_tables,' but nothing close to them exists on my system (per locate command). I just want to empty the mysql database so I can start over with new volumes and new backup schedules. I am using Ubuntu 6.10 (Edgy) on x86 running bacula 1.38.11. -- Keith Reed [EMAIL PROTECTED] -- http://www.fastmail.fm - mmm... Fastmail... - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] the DREADED autochanger won't load problem
Wow that was a helpful reply Arno. Thank you. Your btape advice will be heeded. Bacula is fantasic. Could it be that I was only missing the update slots command? (see below) Message: 1 Date: Fri, 17 Nov 2006 00:50:27 +0100 (MET) From: Arno Lehmann [EMAIL PROTECTED] Subject: Re: [Bacula-users] the DREADED autochanger won't load problem To: bacula-users@lists.sourceforge.net Message-ID: [EMAIL PROTECTED] Content-Type: text/plain; charset=windows-1252; format=flowed I?ve been able to get through about 5 tapes of full backup by manually loading and mounting the tapes. That is, the jobs are working fine, but the jobs are much bigger than the tapes? and bacula won?t change the tapes itself. Ok, first thing to try: Use the query command and check which volumes Bacula thinks are in the changer (hopefully that query is in your version...). Then: Use the 'Update slots scan' command and see what it reports. When I ran query, it reported there were only 2 tapes in the changer instead of the 11 newly labeled tapes. I ran update slots without problem and now query reports the tapes correctly. I started a job and bacula went off and loaded tapes and got things moving. Success! Bacula: 1.38.5 (run as root) RHEL4 We have a 11 slot LTO3 changer with no barcodes on the tapes. I?ve manually labeled all of the tapes in bconsole (via mtx /dev/sg8 load 1, then label.) How exactly did your label command look? My changer.volumes You mean you've got Bacula set up with the fake autochanger feature? I would NOT recommend to use that. Does that mean you recommend using barcoded labels? Or is there more too the fake autochanger setup that I'm using? ... Giving the mtx ?f /dev/sg8 status : ... looks normal. ... Starting a job: 16-Nov 16:52 backup3-dir: Start Backup JobId 537, Job=data.2006-11-16_16.52.32 16-Nov 16:52 backup3-sd: 3301 Issuing autochanger loaded drive 0 command. 16-Nov 16:52 backup3-sd: 3302 Autochanger loaded drive 0, result: nothing loaded. 16-Nov 16:52 backup3-sd: 3301 Issuing autochanger loaded drive 0 command. 16-Nov 16:52 backup3-sd: 3302 Autochanger loaded drive 0, result: nothing loaded. 16-Nov 16:52 backup3-sd: Please mount Volume F06T06 on Storage Device drive1 (/dev/nst0) for Job data.2006-11-16_16.52.32 Normal so far, because because it's quite possible that Bacula doesn't know the volme it wants is in the autochanger. ... I think we have a stock mtx-changer: ... then it's time to fix it, erm, to make it better suit your needs :-) ... especially here: # Increase the sleep time if you have a slow device # or remove the sleep and add the following: # wait_for_drive $device ... I'd usually recommend to use the wait_for_drive function if it works on your system. How will I know if the wait_for_drive function works? By uncommenting it and testing it with btape? ... Any pointers would be appreciated. It will probably really help you if you started with btape, checking your hardware setup, and learning how it works. Once you really need that knowledge there might be people around telling you to get at your data really soon.. I understand. Thanks very much. Anyway, I suspect you're only missing how to operate Bacula together with an autochanger. The key point is that Bacula needs to know which volumes are in the autochanger. Arno -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de Sponsored Link $420k for $1,399/mo. Think You Pay Too Much For Your Mortgage? Find Out! www.LowerMyBills.com/lre- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] the DREADED autochanger won't load problem
barcodes and need an inventory # $(MTX) -f $ctl inventory #kab# ${MTX} -f $ctl status ${TMPFILE} rtn=$? #kab# cat ${TMPFILE} | grep *Storage Element [0-9]*:.*Full | awk {print \$3 \$4} | sed s/Full *\(:VolumeTag=\)*// cat ${TMPFILE} | grep ^Data Transfer Element [0-9]*:Full (Storage Element [0-9] | awk '{printf %s:%s\n,$7,$10}' #kab# rm -f ${TMPFILE} 21 /dev/null # # If you have a VXA PacketLoader and the above does not work, try # turning it off and enabling the following line. # ${MTX} -f $ctl status | grep *Storage Element [0-9]*:.*Full | sed s/*S torage Element // | sed s/Full :VolumeTag=// #kab# fake barcodes cat /etc/bacula/changer.volumes exit $rtn ;; loaded) # debug Doing mtx -f $ctl $drive -- to find what is loaded make_temp_file ${MTX} -f $ctl status ${TMPFILE} rtn=$? cat ${TMPFILE} | grep ^Data Transfer Element $drive:Full | awk {print \ $7} cat ${TMPFILE} | grep ^Data Transfer Element $drive:Empty | awk {print 0} rm -f ${TMPFILE} 21 /dev/null exit $rtn ;; slots) # debug Doing mtx -f $ctl -- to get count of slots ${MTX} -f $ctl status | grep *Storage Changer | awk {print \$5} ;; esac Any pointers would be appreciated. Thanks Keith G Sponsored Link $420k for $1,399/mo. Think You Pay Too Much For Your Mortgage? Find Out! www.LowerMyBills.com/lre- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bad response to Append Data command.
I seem to be past the Appendable media issue I've been having - now I'm getting something totally different when I try and run this backup: You have messages. * * * *messages 02-Oct 13:59 bacula-atl2-sd: 3302 Autochanger loaded drive 0, result is Slot 8. 02-Oct 13:59 bacula-atl2-sd: taurus.2006-10-02_13.59.13 Warning: Director wanted Volume 2006-09-16-s8. Current Volume 2006-09-16-S8 not acceptable because: 1998 Volume 2006-09-16-S8 status is Append, not in Pool. 02-Oct 13:59 bacula-atl2-sd: 3301 Issuing autochanger loaded drive 0 command. 02-Oct 13:59 bacula-atl2-sd: 3302 Autochanger loaded drive 0, result is Slot 8. 02-Oct 13:59 bacula-atl2-sd: taurus.2006-10-02_13.59.13 Warning: Director wanted Volume 2006-09-16-s8. Current Volume 2006-09-16-S8 not acceptable because: 1998 Volume 2006-09-16-S8 status is Append, not in Pool. 02-Oct 13:59 bacula-atl2-sd: 3301 Issuing autochanger loaded drive 0 command. 02-Oct 13:59 bacula-atl2-sd: 3302 Autochanger loaded drive 0, result is Slot 8. 02-Oct 13:59 bacula-atl2-sd: taurus.2006-10-02_13.59.13 Warning: Director wanted Volume 2006-09-16-s8. Current Volume 2006-09-16-S8 not acceptable because: 1998 Volume 2006-09-16-S8 status is Append, not in Pool. 02-Oct 13:59 bacula-atl2-sd: 3301 Issuing autochanger loaded drive 0 command. 02-Oct 13:59 bacula-atl2-sd: 3302 Autochanger loaded drive 0, result is Slot 8. 02-Oct 13:59 bacula-atl2-sd: taurus.2006-10-02_13.59.13 Warning: Director wanted Volume 2006-09-16-s8. Current Volume 2006-09-16-S8 not acceptable because: 1998 Volume 2006-09-16-S8 status is Append, not in Pool. 02-Oct 13:59 bacula-atl2-sd: taurus.2006-10-02_13.59.13 Fatal error: Too many errors trying to mount device /dev/nrsa0. 02-Oct 13:59 taurus-fd: taurus.2006-10-02_13.59.13 Fatal error: job.c:1665 Bad response to Append Data command. Wanted 3000 OK data , got 3903 Error append data 02-Oct 13:59 bacula-atl2-dir: taurus.2006-10-02_13.59.13 Error: Bacula 1.36.3 (22Apr05): 02-Oct-2006 13:59:26 JobId: 6152 Job:taurus.2006-10-02_13.59.13 Backup Level: Full Client: taurus-fd FileSet:taurus disk 2005-07-28 17:09:19 Pool: Full_A Storage:ATL2-TAPE1 Start time: 02-Oct-2006 13:59:15 End time: 02-Oct-2006 13:59:26 FD Files Written: 0 SD Files Written: 0 FD Bytes Written: 0 SD Bytes Written: 0 Rate: 0.0 KB/s Software Compression: None Volume name(s): Volume Session Id: 5 Volume Session Time:1159802982 Last Volume Bytes: 0 Non-fatal FD errors:0 SD Errors: 0 FD termination status: Error SD termination status: Error Termination:*** Backup Error *** This is an older version of Bacula (1.36.3) running on FreeBSD(4.9 Release) I'm getting ready to build a RHES solution box and install a newer version on there, but right now, I'd like to get this box working as it's attached to the tape changer. The other won't be for some time. -Keith - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems with hard links
Good Afternoon, I was wondering if there was a way to purge all the pending jobs out of the database. I've managed to purge the ones with the Volstatus was error. Now they're set to purged. However, there are months and months of stuff in there that need to be wiped out - if there is a console command to do this, I am unable to find it. Regards, -Keith - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Productive Steps (was New Admin)
? Best Regards, -Keith - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] New Admin
Good Day, I'm taking over as one of our sysadmins at work and have found that we're using Bacula to implement our datacenter backups. It seems to have been installed and at one time worked, but our last admin decided documentation was a form of unholy evil and stayed fully away from it. So I'm trying to get up to speed post haste to start our backup cycles again. At this time, I just have some silly questions but the answers will really help me out as to finding out the problem and getting it solved. When I first logged in I had some messages, I typed 'messages' and got them - sort of skimmed through to see what kinds of messages bacula gives. I made the poor assumption that they'd still be there when I went back - I was incorrect. Is there a log that these are logged to somewhere? There were valid errors in there about labels that I would like to see. Also, if it's stating: Archive DATACENTER-TAPE1 is not open or does not exist. Is this a permissions issue perhaps? I'm currently going through the tutorial I found looking for instances of this. Any other advice you guys may have would be most appreciated. I really need to get my head wrapped around this program quickly as it's priority number one in my department. Best Regards, -Keith - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] TL891 Autochanger madness
Keith Hopkins (Bacula) wrote: Hi list, I have two Compaq(Digital) StorageWorks TL892 mini-libraries (TL892=TL891 with 2x DLT7000 drives). When I run the autochanger test in btape, it always hangs while waiting for a tape to load. The tape gets loaded, it spends a while calibrating in the drive (about 45 seconds), then the drive goes 'IDLE' (per the mini-lib's LCD). btape doesn't seem to recognize the tape is ready, and instead times out. The test falls into a loop, extending the time out 30 sec each time, but it fails in the same spot (open/rewind) again and again. This happens on both libs/all 4 drives. Any clues on how to work around this? I'm using the bacula-mysql-1.38.9-1 rpm for SuSE10 dl from sourceforge. The machine is a AMD K7 1.4G, 1.5G SDRAM, IDE. The drives libs/drives are attached via two Adaptec 2944UW cards. Kernel is 2.6.13-15.8-default from SuSE. The only unusual thing from dmesg is MTSETDRVBUFFER only allowed for root. # btape -d 4 -c ./bacula-sd.conf DLT01 -v (tape test runs without error) === Autochanger test === 3301 Issuing autochanger loaded command. Slot 2 loaded. I am going to unload it. 3302 Issuing autochanger unload 2 1 command. unload status=OK 0 3303 Issuing autochanger load 1 1 command. 3303 Autochanger load 1 1 status is OK. 08-May 19:12 btape: 3301 Issuing autochanger loaded drive 1 command. 08-May 19:12 btape: 3302 Autochanger loaded drive 1, result is Slot 1. btape: btape.c:338 open device DLT01 (/dev/nst1): OK 08-May 19:12 btape: 3301 Issuing autochanger loaded drive 1 command. 08-May 19:12 btape: 3302 Autochanger loaded drive 1, result is Slot 1. btape: btape.c:1198 Bad status from rewind. ERR=dev.c:678 Rewind error on DLT01 (/dev/nst1). ERR=Input/output error. While it is waiting with the drive in the idle state: # lsof /dev/nst1 COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME btape 6039 root3u CHR 9,129 15362 /dev/nst1 # mtst -f /dev/nst1 /dev/nst1: Device or resource busy /etc/bacula/bacula-sd.conf Autochanger { Name = TL891Left Device = DLT00 Device = DLT01 Changer Command = /etc/bacula/mtx-changer %c %o %S %a %d Changer Device = /dev/sg0 } Autochanger { Name = TL891Right Device = DLT02,DLT03 Changer Command = /etc/bacula/mtx-changer %c %o %S %a %d Changer Device = /dev/sg3 } Device { Name = DLT00 Archive Device = /dev/nst0 Device Type = Tape Media Type = DLT7000 AutoChanger = Yes Drive Index = 0 AutoSelect = Yes Maximum Changer Wait = 180 Maximum Rewind Wait = 180 Maximum Open Wait = 180 AlwaysOpen = Yes Maximum Open Wait = 180 Removable media = Yes Random access = No Automatic Mount = Yes } Device { Name = DLT01 Archive Device = /dev/nst1 Device Type = Tape Media Type = DLT7000 AutoChanger = Yes Drive Index = 1 AutoSelect = Yes Maximum Changer Wait = 180 Maximum Rewind Wait = 180 Maximum Open Wait = 180 AlwaysOpen = Yes Maximum Open Wait = 180 Removable media = Yes Random access = No Automatic Mount = Yes } Device { Name = DLT02 Archive Device = /dev/nst2 Device Type = Tape Media Type = DLT7000 AutoChanger = Yes Drive Index = 0 AutoSelect = Yes Maximum Changer Wait = 180 Maximum Rewind Wait = 180 Maximum Open Wait = 180 AlwaysOpen = Yes Maximum Open Wait = 180 Removable media = Yes Random access = No Automatic Mount = Yes } Device { Name = DLT03 Archive Device = /dev/nst3 Device Type = Tape Media Type = DLT7000 AutoChanger = Yes Drive Index = 1 AutoSelect = Yes Maximum Changer Wait = 180 Maximum Rewind Wait = 180 Maximum Open Wait = 180 AlwaysOpen = Yes Maximum Open Wait = 180 Removable media = Yes Random access = No Automatic Mount = Yes } I do see where someone has the TL891 working under FreeBSD (http://www.freebsddiary.org/digital-tl891.php) -- Keith For what it's worth, the drive status during calibration is: # mtst -f /dev/nst0 status SCSI 2 tape drive: File number=-1, block number=-1, partition=0. Tape block size 0 bytes. Density code 0x0 (default). Soft error count since last status=0 General status bits on (1): IM_REP_EN and after it does to an idle state, it is: # mtst -f /dev/nst0 status SCSI 2 tape drive: File number=0, block number=0, partition=0. Tape block size 0 bytes. Density code 0x1b (DLT 35GB). Soft error count since last status=0 General status bits on (4101): BOT ONLINE IM_REP_EN --Keith --- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] TL891 Autochanger madness
Hi list, I have two Compaq(Digital) StorageWorks TL892 mini-libraries (TL892=TL891 with 2x DLT7000 drives). When I run the autochanger test in btape, it always hangs while waiting for a tape to load. The tape gets loaded, it spends a while calibrating in the drive (about 45 seconds), then the drive goes 'IDLE' (per the mini-lib's LCD). btape doesn't seem to recognize the tape is ready, and instead times out. The test falls into a loop, extending the time out 30 sec each time, but it fails in the same spot (open/rewind) again and again. This happens on both libs/all 4 drives. Any clues on how to work around this? I'm using the bacula-mysql-1.38.9-1 rpm for SuSE10 dl from sourceforge. The machine is a AMD K7 1.4G, 1.5G SDRAM, IDE. The drives libs/drives are attached via two Adaptec 2944UW cards. Kernel is 2.6.13-15.8-default from SuSE. The only unusual thing from dmesg is MTSETDRVBUFFER only allowed for root. # btape -d 4 -c ./bacula-sd.conf DLT01 -v (tape test runs without error) === Autochanger test === 3301 Issuing autochanger loaded command. Slot 2 loaded. I am going to unload it. 3302 Issuing autochanger unload 2 1 command. unload status=OK 0 3303 Issuing autochanger load 1 1 command. 3303 Autochanger load 1 1 status is OK. 08-May 19:12 btape: 3301 Issuing autochanger loaded drive 1 command. 08-May 19:12 btape: 3302 Autochanger loaded drive 1, result is Slot 1. btape: btape.c:338 open device DLT01 (/dev/nst1): OK 08-May 19:12 btape: 3301 Issuing autochanger loaded drive 1 command. 08-May 19:12 btape: 3302 Autochanger loaded drive 1, result is Slot 1. btape: btape.c:1198 Bad status from rewind. ERR=dev.c:678 Rewind error on DLT01 (/dev/nst1). ERR=Input/output error. While it is waiting with the drive in the idle state: # lsof /dev/nst1 COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME btape 6039 root3u CHR 9,129 15362 /dev/nst1 # mtst -f /dev/nst1 /dev/nst1: Device or resource busy /etc/bacula/bacula-sd.conf Autochanger { Name = TL891Left Device = DLT00 Device = DLT01 Changer Command = /etc/bacula/mtx-changer %c %o %S %a %d Changer Device = /dev/sg0 } Autochanger { Name = TL891Right Device = DLT02,DLT03 Changer Command = /etc/bacula/mtx-changer %c %o %S %a %d Changer Device = /dev/sg3 } Device { Name = DLT00 Archive Device = /dev/nst0 Device Type = Tape Media Type = DLT7000 AutoChanger = Yes Drive Index = 0 AutoSelect = Yes Maximum Changer Wait = 180 Maximum Rewind Wait = 180 Maximum Open Wait = 180 AlwaysOpen = Yes Maximum Open Wait = 180 Removable media = Yes Random access = No Automatic Mount = Yes } Device { Name = DLT01 Archive Device = /dev/nst1 Device Type = Tape Media Type = DLT7000 AutoChanger = Yes Drive Index = 1 AutoSelect = Yes Maximum Changer Wait = 180 Maximum Rewind Wait = 180 Maximum Open Wait = 180 AlwaysOpen = Yes Maximum Open Wait = 180 Removable media = Yes Random access = No Automatic Mount = Yes } Device { Name = DLT02 Archive Device = /dev/nst2 Device Type = Tape Media Type = DLT7000 AutoChanger = Yes Drive Index = 0 AutoSelect = Yes Maximum Changer Wait = 180 Maximum Rewind Wait = 180 Maximum Open Wait = 180 AlwaysOpen = Yes Maximum Open Wait = 180 Removable media = Yes Random access = No Automatic Mount = Yes } Device { Name = DLT03 Archive Device = /dev/nst3 Device Type = Tape Media Type = DLT7000 AutoChanger = Yes Drive Index = 1 AutoSelect = Yes Maximum Changer Wait = 180 Maximum Rewind Wait = 180 Maximum Open Wait = 180 AlwaysOpen = Yes Maximum Open Wait = 180 Removable media = Yes Random access = No Automatic Mount = Yes } I do see where someone has the TL891 working under FreeBSD (http://www.freebsddiary.org/digital-tl891.php) -- Keith --- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO3 performance
Rudolf Cejka wrote: Keith Brautigam wrote (2006/02/15): Quinton Jansen wrote: What speeds are others getting when using an LTO-3 drive? I take up interest just in direct writing speed to the tape reported by iostat, which I have typically about 60-80 MB/s, but still I think that it should be better, because 80 MB/s is native speed of LTO-3 drives without compression, so with compression it should be possible to go above 100 MB/s (look for example at http://h18006.www1.hp.com/products/quickspecs/11739_div/11739_div.html). What actual speed are you getting now during the de-spooling process? Also, how would you recommend measuring how fast you are writing to the tape (I realize you're on FreeBSD not Linux)? I'm new to having such a fast drive and am also interested in in creasing write performance. If I'm reading the numbers correctly, 2GB in 13 minutes (10GB/hour) is way too slow (should be around 200G/hour). From bacula report? There is a problem, that there are counted all times, like data spooling and attributes despooling (I suppose, that you do use spooling, because it is almost a must for LTO-3 drive). Feb 15 00:39:23 localhost kernel: scsi0 : Adaptec AIC79XX PCI-X SCSI HBA DRIVER, Rev 1.3.11 Feb 15 00:39:23 localhost kernel: Adaptec 29320ALP Ultra320 SCSI adapter Feb 15 00:39:23 localhost kernel: aic7901: Ultra320 Wide Channel A, SCSI Id=7, PCI-X 67-100Mhz, 512 SCBs It would be interesting to see the real agreed communication speed, beause I still have problem to run LTO-3 drive from HP with Adaptec using 320 MB/s (it is known bug). It works just with 160 MB/s, so I had to buy LSILogic, which does work with my LTO-3 over 320 MB/s very well. However, I did not get any speed differences :o( My dedicated bacula server is a dual Athlon MP 2GzH system with 4 SATA drives (add-in non-RAID 4 port Promise controller) and a Gig NIC running Linux Ubuntu 5.10. I have the same version of bacula, and it is also compiled from source. FreeBSD 6.0-STABLE, dual Intel Xeon 3.6 GHz, spooling is on 3ware 9500 with 7 drive RAID-0. How did you arrive at using hardware RAID and seven drives? Was that convenient with your hardware, or did you first try a smaller number of drives (like I have) and find they were not enough? The main performance enhancement for me was switching to a system with more CPU power. The second most important performance enhancement was how I configured the systems four drives, so as to not be disk I/O bound This is what I already said before: Bacula has and will have more and more performance problems with high speed backup cofigurations. MD5 checksums should be either precomputed before writing data to the tape, or maybe there would help two writing threads instead of just one: One thread would read data and compute md5, the second thread would just try to write data to the tape. (although that's still the slows part of the system). Two of the drives are configured with software RAID1 for the OS etc. The other two (250GB each) are configured as software RAID0 with XFS, and serve as a dedicated data spool for bacula. I also spool attributes so that data entry into the catalog does not slow writing to the tape. The second problem is that there can be just one spooling area, where one read + write RAID array may have performance problems even in very good configuration. There would be good to have some possibility to say, that spooling area is exclusively reserved for despooling process (or atleast more independent spooling areas, some reservation feature, ...). not sure). I believe the advertised speed for LTO3 is around 60 MB/sec, 80 MB/s but I think seeing a 44 MB/sec average in real world performance (on a relatively old and cheap server) is pretty decent. However for LTO-3 it is not very satisfactory, because minimal physical speed accomodation for LTO-3 drives is 27 MB/s (HP) or 40 MB/s (IBM), so 44 MB/s is the lowver bound for IBM drives for best effectivity. It would be interesting to see, how many repositions is done during write. There is one value in HP drives (Repositions Per 100 MB), which can help in performance diagnostics. And I think that there are even better counters in IBM drives. How do you find/set the number of repositions? What other sorts of tuning did you perform on the drive? Also, I'm using an older SCSI controller card (160 not 320) and have never tried to tune the drive with mt or any other utility. My experiences are not so good among 160 MB/s and 320 MB/s - I have the same performance in both cases for now. So it sounds like I should be okay with an older Adaptec 160 MB/s card? --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching
Re: [Bacula-users] LTO3 performance
into the catalog does not slow writing to the tape. With this configuration I'm getting between 40 and 54 MB/sec write to the tape drive during the de-spooling process with an average around 44 MB/sec. During that time bacula uses about 50% of the system's CPU power (I think this may be because I have md5 sums turned on, but I'm not sure). I believe the advertised speed for LTO3 is around 60 MB/sec, but I think seeing a 44 MB/sec average in real world performance (on a relatively old and cheap server) is pretty decent. Also, I'm using an older SCSI controller card (160 not 320) and have never tried to tune the drive with mt or any other utility. Keith --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Drive Compatibility Question
I just purchased a LoaderXpress LTO 3 11 tape changer (drive made by HP). mt and mtx commands work fine as well as using tar to write to /dev/nst0, so I don't expect any problems with bacula. I'll be seeing what kind of throughput I really get out of it and testing it with bacula over the next couple of days. Let me know if you want more feedback... Keith Steve Loughran wrote: I use Bacula on a PowerLoader LTO3 17 slot without any problems at all, if that helps... Steve William Reid wrote: Hi there, We are looking into purchasing an LoaderXpress LTO2 11 tape changer drive and was wondering if anyone has had any experience working with this unit within Bacula. From reading the docs I can see there is support for LTO2 drives, but no mention on this specific model, if you need some more info, here's a link.. http://overlandstorage.com/products/loaderxpress.html# Thanks, Wm --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] multiple catalogs
I've made the standard, DefaultCatalog, and one additional catalog named TestCatalog. I then created some tapes in pool 'Test' while connected to TestCatalog. In bcosonle I issue the 'use' command to connect to TestCatalog. Then I start a job. However, the job does not see the volumes in the Test pool. So it seems the job is using the DefaultCatalog, which can see the pool Test, but shows no volumes in it. What am I missing? Is there some place I should specify what catalog a job should use? Thanks, Keith --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://ads.osdn.com/?ad_id=7637alloc_id=16865op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] File retention issue
How can I set different file retention periods for each Fileset or job when they are on the same bacula client? From reading the docs it seems this can't be done since File retention is specified in the client resource, which is a problem for me (unless I'm missing something). Suggestions anyone? I can do something like set long file retention period, do a db query to fine the File Records I don't want, and then purge them. But that seems very hackish compared to just specifying the File retention along with the job or file set and having bacula take care of the purging. Has this been an issue for anyone else? Also, I have different Pools, but that doesn't seem helpful because I need to keep all volume and job records for the same amount of time (1 year). However, for some jobs I don't need or want the file records because I'd only restore entire Filesets and there are millions of files, so the size of the catalog will be problematic. For other Filesets I do need all the file records since I'm most likely to restore individual files here and there. Thanks, Keith --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://ads.osdn.com/?ad_id=7637alloc_id=16865op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] VXA2 packetloader tape change issues
Zack, I'm using bacula 1.38.2. so I use the auto-changer resource. Here's what I have: Autochanger { Name = AutoPakChanger Device = AutoPakDrive1 Changer Device = /dev/sg2 Changer Command = /etc/bacula/mtx-changer %c %o %S %a %d } Device { Name = AutoPakDrive1 Media Type = AutoPakVXA17 Archive Device = /dev/nst0 AutomaticMount = yes; AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; Drive Index = 0 AutoChanger = yes Alert Command = sh -c 'tapeinfo -f %c |grep TapeAlert|cat' } You may also need to edit the following part of the mtx-changer script... # enable the following line if you need to eject the cartridge # mt -f $device offline An easy way to test if the mtx-changer script works for your autoloader is to run it by hand. Or you can use 'btape autochanger' You might want to double-check using /dev/nst0 vs /dev/st0 since I use nst0 and you have st0 since the VXA drives are non-autorewinding devices. Also, make sure that 'btape test' works. I got by without the Hardware End of Medium and Fast Forward Space File directives. If you haven't already I'd also recommend getting vxaTool from Exabyte, which lets you enable/disable hardware compression on the VXA drives. I hope that helps, Keith Zachariah Mully wrote: Hello all- I've got a new VXA2 packetloader that appears to have a problem changing tapes. Can somebody else out there with one of these please help me verify my settings? I'm running Bacula 1.36.2 on Debian 3.1. Device { Name = VXA Media Type = 8mm Archive Device = /dev/st0 Autochanger = Yes Changer Device = /dev/sg1 Changer Command = /etc/bacula/scripts/mtx-changer %c %o %S %a % d Maximum Changer Wait = 240 # seconds Alert Command = sh -c 'tapeinfo -f %c | grep TapeAlert|cat' Always Open = Yes AutomaticMount = Yes Removable media = Yes Random access = No Hardware End of Medium = Yes Fast Forward Space File = Yes Maximum Network Buffer Size = 65536 } My backups have begun to fail with: 07-Dec 01:13 backup-sd: mojojojo.2005-12-07_01.05.01 Fatal error: Cannot write block. Device at EOM. Many thanks, Zack --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://ads.osdn.com/?ad_id=7637alloc_id=16865op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://ads.osdn.com/?ad_id=7637alloc_id=16865op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] autochanger and tape use
Short version - bacula is attempting to use a tape that is not loaded into the autochanger even though a different, usable tape is loaded in the autochanger. According to the documentation (that I have seen), bacula should always prefer to use tapes in the changer to avoid unnecessary operator intervention. Has anyone else run into this kind of problem? Is there something obvious that I'm missing? I'm new to bacula and am otherwise very impressed. Thanks! Keith Long version detail - I am using bacula 1.38 on Linux and have also seen the same problem with bacula 1.37.4 on the same platform. Basically, I have a bunch of tapes with bar codes already labeled by bacula. I use, say, all of tapes 1-7 and part of tape 8. I then pull out tapes 1-8 to store off site having completed a full backup and load in two unused tapes - 9 and 10. I inform bacula of the change with 'update slots' and run a job. The problem is that bacula still tries to use tape 8 even though it's not in the changer. All the tapes are in the same Pool. I can see that when I issue status for the storage daemon from the console. Here's the output from mtx showing the tapes loaded in the changer: mtx -f /dev/sg0 status Storage Changer /dev/sg0:2 Drives, 31 Slots ( 1 Import/Export ) Data Transfer Element 0:Empty Data Transfer Element 1:Empty Storage Element 15:Full :VolumeTag=USER0009 Storage Element 16:Full :VolumeTag=USER0010 Here's the output from `update slots` showing that it works: * update slots Catalog record for Volume USER0009 updated to reference slot 15. Catalog record for Volume USER0010 updated to reference slot 16. Here's the status for the storage daemon after the job starts. Notice that it says User0008 is in use: * st st Device status: Autochanger 430Changer with devices: 430Drive1 (/dev/nst0) 430Drive2 (/dev/nst1) Device 430Drive1 (/dev/nst0) is not open or does not exist. Device is being initialized. Drive 0 is not loaded. Device 430Drive2 (/dev/nst1) open but no Bacula volume is mounted. Drive 1 is not loaded. Total Bytes Read=0 Blocks Read=0 Bytes/block=0 Positioned at File=0 Block=0 In Use Volume status: USER0008 on device 430Drive1 (/dev/nst0) Here's bacula's information about the volumes: * list volumes USER0007 | Full | 114,585,430,714 | USER0008 | Append| 57,777,346,198 | USER0009 | Append| 1 | USER0010 | Append| 1 | --- SF.Net email is sponsored by: Tame your development challenges with Apache's Geronimo App Server. Download it for free - -and be entered to win a 42 plasma tv or your very own Sony(tm)PSP. Click here to play: http://sourceforge.net/geronimo.php ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] autochanger and tape use
Kern Sibbald wrote: On Tuesday 08 November 2005 18:31, Keith Brautigam wrote: Short version - bacula is attempting to use a tape that is not loaded into the autochanger even though a different, usable tape is loaded in the autochanger. According to the documentation (that I have seen), bacula should always prefer to use tapes in the changer to avoid unnecessary operator intervention. Has anyone else run into this kind of problem? Is there something obvious that I'm missing? I'm new to bacula and am otherwise very impressed. Thanks! If it always happens with the last slot in your autochanger, then it is a bug introduced in 1.38. This is fixed in the branch Branch-1_38_0 of the CVS and barring any new problems, I will release it as 1.38.1 at the end of the week. This is happening with slots 15 16 of 30 total slots. Slots 1-16 are loaded, although slots 1-14 have tapes from a different Pool loaded. The remaining slots are empty. Thanks for looking at this post. Is there any additional information that would be helpful, or anything you would like me to try? Keith Keith Long version detail - I am using bacula 1.38 on Linux and have also seen the same problem with bacula 1.37.4 on the same platform. Basically, I have a bunch of tapes with bar codes already labeled by bacula. I use, say, all of tapes 1-7 and part of tape 8. I then pull out tapes 1-8 to store off site having completed a full backup and load in two unused tapes - 9 and 10. I inform bacula of the change with 'update slots' and run a job. The problem is that bacula still tries to use tape 8 even though it's not in the changer. All the tapes are in the same Pool. I can see that when I issue status for the storage daemon from the console. Here's the output from mtx showing the tapes loaded in the changer: mtx -f /dev/sg0 status Storage Changer /dev/sg0:2 Drives, 31 Slots ( 1 Import/Export ) Data Transfer Element 0:Empty Data Transfer Element 1:Empty Storage Element 15:Full :VolumeTag=USER0009 Storage Element 16:Full :VolumeTag=USER0010 Here's the output from `update slots` showing that it works: * update slots Catalog record for Volume USER0009 updated to reference slot 15. Catalog record for Volume USER0010 updated to reference slot 16. Here's the status for the storage daemon after the job starts. Notice that it says User0008 is in use: * st st Device status: Autochanger 430Changer with devices: 430Drive1 (/dev/nst0) 430Drive2 (/dev/nst1) Device 430Drive1 (/dev/nst0) is not open or does not exist. Device is being initialized. Drive 0 is not loaded. Device 430Drive2 (/dev/nst1) open but no Bacula volume is mounted. Drive 1 is not loaded. Total Bytes Read=0 Blocks Read=0 Bytes/block=0 Positioned at File=0 Block=0 In Use Volume status: USER0008 on device 430Drive1 (/dev/nst0) Here's bacula's information about the volumes: * list volumes USER0007 | Full | 114,585,430,714 | USER0008 | Append| 57,777,346,198 | USER0009 | Append| 1 | USER0010 | Append| 1 | --- SF.Net email is sponsored by: Tame your development challenges with Apache's Geronimo App Server. Download it for free - -and be entered to win a 42 plasma tv or your very own Sony(tm)PSP. Click here to play: http://sourceforge.net/geronimo.php ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- SF.Net email is sponsored by: Tame your development challenges with Apache's Geronimo App Server. Download it for free - -and be entered to win a 42 plasma tv or your very own Sony(tm)PSP. Click here to play: http://sourceforge.net/geronimo.php ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] autochanger and tape use
My apologies! It looks like I sent this to the announce list by accident. Here it is in the right list... I can reproduce this on two separate bacula installs and two different autochangers. The easiest way is to make two volumes for catalog backups, and create a backup schedule for the catalog. Then, when you query status of the director it will tell you which tape it expects to use (always seems to be the fist volume created) for the scheduled job. If you only load the second created into the autochanger, update the slots, and then query the director again bacula still wants to use the first tape created. When the job actually runs it still tries to use the fist tape even though the second is present in the library (you can see that with an *st st), which causes the job to hang and eventually to be canceled. Am I forgetting something in the config files? I am using the autochanger resource. I have also confirmed that the job runs okay when you give bacula the volume it wants. Has anyone else with an autochanger seen the same problem? Can anyone else reproduce the problem? Kern - is this the same issue that you mentioned is fixed in branch Branch-1_38_0 of the CVS? It sounds different to me. Thanks for your help, Keith Keith Brautigam wrote: Kern Sibbald wrote: On Tuesday 08 November 2005 18:31, Keith Brautigam wrote: Short version - bacula is attempting to use a tape that is not loaded into the autochanger even though a different, usable tape is loaded in the autochanger. According to the documentation (that I have seen), bacula should always prefer to use tapes in the changer to avoid unnecessary operator intervention. Has anyone else run into this kind of problem? Is there something obvious that I'm missing? I'm new to bacula and am otherwise very impressed. Thanks! If it always happens with the last slot in your autochanger, then it is a bug introduced in 1.38. This is fixed in the branch Branch-1_38_0 of the CVS and barring any new problems, I will release it as 1.38.1 at the end of the week. This is happening with slots 15 16 of 30 total slots. Slots 1-16 are loaded, although slots 1-14 have tapes from a different Pool loaded. The remaining slots are empty. Thanks for looking at this post. Is there any additional information that would be helpful, or anything you would like me to try? Keith Keith Long version detail - I am using bacula 1.38 on Linux and have also seen the same problem with bacula 1.37.4 on the same platform. Basically, I have a bunch of tapes with bar codes already labeled by bacula. I use, say, all of tapes 1-7 and part of tape 8. I then pull out tapes 1-8 to store off site having completed a full backup and load in two unused tapes - 9 and 10. I inform bacula of the change with 'update slots' and run a job. The problem is that bacula still tries to use tape 8 even though it's not in the changer. All the tapes are in the same Pool. I can see that when I issue status for the storage daemon from the console. Here's the output from mtx showing the tapes loaded in the changer: mtx -f /dev/sg0 status Storage Changer /dev/sg0:2 Drives, 31 Slots ( 1 Import/Export ) Data Transfer Element 0:Empty Data Transfer Element 1:Empty Storage Element 15:Full :VolumeTag=USER0009 Storage Element 16:Full :VolumeTag=USER0010 Here's the output from `update slots` showing that it works: * update slots Catalog record for Volume USER0009 updated to reference slot 15. Catalog record for Volume USER0010 updated to reference slot 16. Here's the status for the storage daemon after the job starts. Notice that it says User0008 is in use: * st st Device status: Autochanger 430Changer with devices: 430Drive1 (/dev/nst0) 430Drive2 (/dev/nst1) Device 430Drive1 (/dev/nst0) is not open or does not exist. Device is being initialized. Drive 0 is not loaded. Device 430Drive2 (/dev/nst1) open but no Bacula volume is mounted. Drive 1 is not loaded. Total Bytes Read=0 Blocks Read=0 Bytes/block=0 Positioned at File=0 Block=0 In Use Volume status: USER0008 on device 430Drive1 (/dev/nst0) Here's bacula's information about the volumes: * list volumes USER0007 | Full | 114,585,430,714 | USER0008 | Append| 57,777,346,198 | USER0009 | Append| 1 | USER0010 | Append| 1 | --- SF.Net email is sponsored by: Tame your development challenges with Apache's Geronimo App Server. Download it for free - -and be entered to win a 42 plasma tv or your very own Sony(tm)PSP. Click here to play: http://sourceforge.net/geronimo.php ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users