I believe I have found a bug in the VolumeToCatalog verify. I posted
the following messages on the user list over the last two Mondays but
no replies so I am sending them here for verification.

---------- Forwarded message ----------
From: John Drescher <dresche...@gmail.com>
Date: Mon, Feb 14, 2011 at 10:36 AM
Subject: Verify VolumeToCatalog not working as expected.
To: bacula-users <bacula-us...@lists.sourceforge.net>


For some reason Verify VolumeToCatalog is not working as expected. I
tried to verify a 1.86TB job to verify that the data on the 6 LTO2
tapes is correct with fileset ImageData-ds3-fs but it appears that
bacula is mixed up trying to verify the catalog backup job instead.
Here is the log:

14-Feb 10:23 fileserver-dir JobId 24252: Verifying against JobId=24249
Job=BackupCatalog.2011-02-14_01.10.00_21
14-Feb 10:23 fileserver-dir JobId 24252: Bootstrap records written to
/var/lib/bacula/fileserver-dir.restore.5.bsr
14-Feb 10:23 fileserver-dir JobId 24252: Start Verify JobId=24252
Level=VolumeToCatalog
Job=Verify_ImageData-ds3-Job.2011-02-14_10.23.31_27
14-Feb 10:23 fileserver-dir JobId 24252: Using Device "LTO2-0"
14-Feb 10:25 dev6-sd JobId 24252: acquire.c:117 Changing read device.
Want Media Type="File" have="LTO-2"
 device="LTO2-0" (/dev/nst0)
14-Feb 10:25 dev6-sd JobId 24252: Fatal error: acquire.c:166 No
suitable device found to read Volume "Catalogs-0007"
14-Feb 10:25 datastore3-fd JobId 24252: Fatal error: job.c:2031 Bad
response to Read Data command. Wanted 3000 OK data
, got 3000 error

14-Feb 10:23 fileserver-dir JobId 24252: Warning: The following files
are in the Catalog but not on the Volume(s):
14-Feb 10:23 fileserver-dir JobId 24252:       /var/lib/bacula/bacula.sql
14-Feb 10:23 fileserver-dir JobId 24252: Fatal error: No Job status
returned from FD.
14-Feb 10:23 fileserver-dir JobId 24252: Error: Bacula fileserver-dir
5.0.3 (04Aug10): 14-Feb-2011 10:23:35
 Build OS:               x86_64-pc-linux-gnu gentoo
 JobId:                  24252
 Job:                    Verify_ImageData-ds3-Job.2011-02-14_10.23.31_27
 FileSet:                ImageData-ds3-fs
 Verify Level:           VolumeToCatalog
 Client:                 datastore3-fd
 Verify JobId:           24249
 Verify Job:
 Start time:             14-Feb-2011 10:23:33
 End time:               14-Feb-2011 10:23:35
 Files Expected:         1
 Files Examined:         2,800
 Non-fatal FD errors:    0
 FD termination status:  Error
 SD termination status:  Error
 Termination:            *** Verify Error ***


BTW, the level in this Verify Job was originally DiskToCatalog and I
used the mod command in bconsole to switch it to Volume to Catalog.
Previously I did a "DiskToCatalog" verify and got the expected result.

datastore3-fd Version: 5.0.3 (04 August 2010)  x86_64-pc-linux-gnu gentoo
Daemon started 11-Feb-11 19:53. Jobs: run=9 running=0.
 Heap: heap=626,688 smbytes=15,604 max_bytes=264,665 bufs=60 max_bufs=226
 Sizeof: boffset_t=8 size_t=8 debug=0 trace=0

Running Jobs:
Director connected at: 14-Feb-11 10:33
No Jobs running.
====

Terminated Jobs:
 JobId  Level    Files      Bytes   Status   Finished        Name
======================================================================
 24212  Full          1    3.264 G  OK       11-Feb-11 01:23 BackupCatalog
 24213  Disk    133,209    83.97 G  Cancel   11-Feb-11 21:26
Verify_ImageData-ds3-Job
 24216                1    17.04 M  OK       11-Feb-11 15:32 TMImagesRestore
 24214  Disk   1,464,967    1.861 T  OK       11-Feb-11 21:51
Verify_ImageData-ds3-Job
 24227  Full          1    1.997 G  Error    12-Feb-11 01:20 BackupCatalog
 24238  Full          1    2.996 G  Error    13-Feb-11 01:22 BackupCatalog
 24249  Full          1    3.266 G  OK       14-Feb-11 01:23 BackupCatalog
 24250  Volu          0         0   Error    14-Feb-11 10:22
Verify_ImageData-ds3-Job
 24251  Volu          0         0   Error    14-Feb-11 10:23
Verify_ImageData-ds3-Job
 24252  Volu          0         0   Error    14-Feb-11 10:25
Verify_ImageData-ds3-Job


---------- Forwarded message ----------
From: John Drescher <dresche...@gmail.com>
Date: Mon, Feb 21, 2011 at 11:04 AM
Subject: Re: Verify VolumeToCatalog not working as expected.
To: bacula-users <bacula-us...@lists.sourceforge.net>


I tried a few other jobs and it seems that regardless of the verify
fileset you choose the VolumeToCatalog verify always picks the last
backup that was performed on the client and not the last full backup
for a given fileset or similar. The job I want to verify uses LTO2
media to the  LTO2-Archived-Data pool.

Run Verify job
JobName:     Verify_Exempt_MRI-Archive-Job
Level:       VolumeToCatalog
Client:      datastore3-fd
FileSet:     Exempt_MRI-Archive-fs
Pool:        LTO2-Archived-Data (From Job resource)
Storage:     DEV6-Changer (From Job resource)
Verify Job:
Verify List:
When:        2011-02-21 10:54:42
Priority:    10
OK to run? (yes/mod/no): yes
Job queued. JobId=24341

Here is the log for that:

fileserv ~ # less /var/log/bacula/verify.log
21-Feb 10:55 fileserver-dir JobId 24341: Verifying against JobId=24340
Job=BackupCatalog.2011-02-21_01.10.00_12
21-Feb 10:55 fileserver-dir JobId 24341: Bootstrap records written to
/var/lib/bacula/fileserver-dir.restore.10.bsr
21-Feb 10:55 fileserver-dir JobId 24341: Start Verify JobId=24341
Level=VolumeToCatalog
Job=Verify_Exempt_MRI-Archive-Job.2011-02-21_10.54.58_15
21-Feb 10:55 fileserver-dir JobId 24341: Using Device "LTO2-0"
21-Feb 10:58 dev6-sd JobId 24341: acquire.c:117 Changing read device.
Want Media Type="File" have="LTO-2"
 device="LTO2-0" (/dev/nst0)
21-Feb 10:58 dev6-sd JobId 24341: Fatal error: acquire.c:166 No
suitable device found to read Volume "Catalogs-0005"
21-Feb 10:58 datastore3-fd JobId 24341: Fatal error: job.c:2031 Bad
response to Read Data command. Wanted 3000 OK data
, got 3000 error

21-Feb 10:55 fileserver-dir JobId 24341: Warning: The following files
are in the Catalog but not on the Volume(s):
21-Feb 10:55 fileserver-dir JobId 24341:       /var/lib/bacula/bacula.sql
21-Feb 10:55 fileserver-dir JobId 24341: Fatal error: No Job status
returned from FD.
21-Feb 10:55 fileserver-dir JobId 24341: Error: Bacula fileserver-dir
5.0.3 (04Aug10): 21-Feb-2011 10:55:02
 Build OS:               x86_64-pc-linux-gnu gentoo
 JobId:                  24341
 Job:                    Verify_Exempt_MRI-Archive-Job.2011-02-21_10.54.58_15
 FileSet:                Exempt_MRI-Archive-fs
 Verify Level:           VolumeToCatalog
 Client:                 datastore3-fd
 Verify JobId:           24340
 Verify Job:
 Start time:             21-Feb-2011 10:55:00
 End time:               21-Feb-2011 10:55:02
 Files Expected:         1
 Files Examined:         2,800
 Non-fatal FD errors:    0
 FD termination status:  Error
 SD termination status:  Error
 Termination:            *** Verify Error ***

It appears again that bacula is verifying against the last job run
which in this case was the catalog backup.


Select Client (File daemon) resource (1-29): 4
Connecting to Client datastore3-fd at datastore3:9102

datastore3-fd Version: 5.0.3 (04 August 2010)  x86_64-pc-linux-gnu gentoo
Daemon started 11-Feb-11 19:53. Jobs: run=26 running=0.
 Heap: heap=626,688 smbytes=15,604 max_bytes=483,041 bufs=60 max_bufs=239
 Sizeof: boffset_t=8 size_t=8 debug=0 trace=0

Running Jobs:
Director connected at: 21-Feb-11 11:04
No Jobs running.
====

Terminated Jobs:
 JobId  Level    Files      Bytes   Status   Finished        Name
======================================================================
 24280  Volu      1,802         0   OK       16-Feb-11 17:56
VerifyVolume_ImageData-ds3-Job
 24292  Full          1    3.267 G  OK       17-Feb-11 01:27 BackupCatalog
 24281         1,464,818    1.860 T  Error    17-Feb-11 11:54 TMImagesRestore
 24303  Full          1    3.268 G  OK       18-Feb-11 01:24 BackupCatalog
 24304  Incr     42,999    17.88 G  OK       18-Feb-11 09:05
Exempt_MRI-Archive-Job
 24305  Incr     48,051    86.75 G  OK       18-Feb-11 20:23 ImageData-ds3-Job
 24318  Full          1    3.288 G  OK       19-Feb-11 01:24 BackupCatalog
 24329  Full          1    1.997 G  Error    20-Feb-11 01:21 BackupCatalog
 24340  Full          1    3.290 G  OK       21-Feb-11 01:24 BackupCatalog
 24341  Volu          0         0   Error    21-Feb-11 10:58
Verify_Exempt_MRI-Archive-Job

John



-- 
John M. Drescher

------------------------------------------------------------------------------
Free Software Download: Index, Search & Analyze Logs and other IT data in 
Real-Time with Splunk. Collect, index and harness all the fast moving IT data 
generated by your applications, servers and devices whether physical, virtual
or in the cloud. Deliver compliance at lower cost and gain new business 
insights. http://p.sf.net/sfu/splunk-dev2dev 
_______________________________________________
Bacula-devel mailing list
Bacula-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-devel

Reply via email to