On Thursday, October 6, 2016 at 12:01:20 PM UTC+2, Robert N wrote:
> On Friday, August 12, 2016 at 11:10:54 AM UTC+2, Robert N wrote:
> > Hi, 
> > 
> > I do backup to disk and than copy the jobs to tapes with 
> > 
> >   SelectionPattern = "."
> >   SelectionType = PoolUncopiedJobs
> > 
> > but sometime I found the same job copied twice, for ex. jobid 1032 was 
> > copied once with 1054 and then with 1789, although the 1054 finished 
> > succesfully.
> > 
> > 
> > list joblog jobid=1054
> > Automatically selected Catalog: MyCatalog
> > Using Catalog "MyCatalog"
> >  2016-07-21 01:18:02 pro-backup-1-dir JobId 1054: Copying using JobId=1032 
> > Job=sccm-1.2016-07-21_00.13.00_58
> >  2016-07-21 01:18:02 pro-backup-1-dir JobId 1054: Bootstrap records written 
> > to /data/bareos/pro-backup-1-dir.restore.57.bsr
> >  2016-07-21 02:32:32 pro-backup-1-dir JobId 1054: Start Copying JobId 1054, 
> > Job=CopyToTape.2016-07-21_01.18.02_20
> >  2016-07-21 02:32:32 pro-backup-1-dir JobId 1054: Using Device 
> > "DiskDeviceIncr" to read.
> >  2016-07-21 02:32:32 pro-backup-1-dir JobId 1054: Using Device 
> > "DriveDevice" to write.
> >  2016-07-21 02:32:32 pro-backup-1-sd JobId 1054: Ready to read from volume 
> > "Incr-0368" on device "DiskDeviceIncr" (/data/bareos-storage/Incr).
> >  2016-07-21 02:33:29 pro-backup-1-sd JobId 1054: Volume "000005L6" 
> > previously written, moving to end of data.
> >  2016-07-21 02:34:17 pro-backup-1-sd JobId 1054: Ready to append to end of 
> > Volume "000005L6" at file=78.
> >  2016-07-21 02:34:17 pro-backup-1-sd JobId 1054: Forward spacing Volume 
> > "Incr-0368" to file:block 0:4082851165.
> >  2016-07-21 02:34:41 pro-backup-1-sd JobId 1054: End of Volume at file 1 on 
> > device "DiskDeviceIncr" (/data/bareos-storage/Incr), Volume "Incr-0368"
> >  2016-07-21 02:34:41 pro-backup-1-sd JobId 1054: Ready to read from volume 
> > "Incr-0369" on device "DiskDeviceIncr" (/data/bareos-storage/Incr).
> >  2016-07-21 02:34:41 pro-backup-1-sd JobId 1054: Forward spacing Volume 
> > "Incr-0369" to file:block 0:220.
> >  2016-07-21 02:35:31 pro-backup-1-sd JobId 1054: End of Volume at file 0 on 
> > device "DiskDeviceIncr" (/data/bareos-storage/Incr), Volume "Incr-0369"
> >  2016-07-21 02:35:31 pro-backup-1-sd JobId 1054: End of all volumes.
> >  2016-07-21 02:35:31 pro-backup-1-sd JobId 1054: Elapsed time=00:01:14, 
> > Transfer rate=67.32 M Bytes/second
> >  2016-07-21 02:35:35 pro-backup-1-dir JobId 1054: Bareos pro-backup-1-dir 
> > 15.2.3 (07Mar16):
> >   Build OS:               x86_64-redhat-linux-gnu redhat CentOS release 6.7 
> > (Final)
> >   Prev Backup JobId:      1032
> >   Prev Backup Job:        sccm-1.2016-07-21_00.13.00_58
> >   New Backup JobId:       1055
> >   Current JobId:          1054
> >   Current Job:            CopyToTape.2016-07-21_01.18.02_20
> >   Backup Level:           
> >   Client:                 hyper-3
> >   FileSet:                "StdLinux"
> >   Read Pool:              "DiskDaily" (From Job resource)
> >   Read Storage:           "DiskStorageIncr" (From Pool resource)
> >   Write Pool:             "TapeDaily" (From Job Pool's NextPool resource)
> >   Write Storage:          "TapeStorage" (From Storage from Pool's NextPool 
> > resource)
> >   Next Pool:              "TapeDaily" (From Job Pool's NextPool resource)
> >   Catalog:                "MyCatalog" (From Job resource)
> >   Start time:             21-Jul-2016 02:32:32
> >   End time:               21-Jul-2016 02:35:35
> >   Elapsed time:           3 mins 3 secs
> >   Priority:               12
> >   SD Files Written:       4
> >   SD Bytes Written:       4,982,268,060 (4.982 GB)
> >   Rate:                   27225.5 KB/s
> >   Volume name(s):         000005L6
> >   Volume Session Id:      397
> >   Volume Session Time:    1467639834
> >   Last Volume Bytes:      79,054,233,137 (79.05 GB)
> >   SD Errors:              0
> >   SD termination status:  OK
> >   Termination:            Copying OK
> > 
> > 
> > 
> > 
> > list joblog jobid=1789
> > Automatically selected Catalog: MyCatalog
> > Using Catalog "MyCatalog"
> >  2016-08-08 02:26:47 pro-backup-1-dir JobId 1789: Copying using JobId=1032 
> > Job=sccm-1.2016-07-21_00.13.00_58
> >  2016-08-08 02:26:47 pro-backup-1-dir JobId 1789: Bootstrap records written 
> > to /data/bareos/pro-backup-1-dir.restore.14.bsr
> >  2016-08-08 02:26:47 pro-backup-1-dir JobId 1789: Start Copying JobId 1789, 
> > Job=CopyToTape.2016-08-08_02.26.47_05
> >  2016-08-08 02:26:47 pro-backup-1-dir JobId 1789: Using Device 
> > "DiskDeviceIncr" to read.
> >  2016-08-08 02:26:47 pro-backup-1-dir JobId 1789: Max configured use 
> > duration=82,800 sec. exceeded. Marking Volume "000005L6" as Used.
> >  2016-08-08 02:26:47 pro-backup-1-dir JobId 1789: There are no more Jobs 
> > associated with Volume "000011L6". Marking it purged.
> >  2016-08-08 02:26:47 pro-backup-1-dir JobId 1789: All records pruned from 
> > Volume "000011L6"; marking it "Purged"
> >  2016-08-08 02:26:47 pro-backup-1-dir JobId 1789: Recycled volume "000011L6"
> >  2016-08-08 02:26:47 pro-backup-1-dir JobId 1789: Using Device 
> > "DriveDevice" to write.
> >  2016-08-08 02:26:47 pro-backup-1-sd JobId 1789: Ready to read from volume 
> > "Incr-0368" on device "DiskDeviceIncr" (/data/bareos-storage/Incr).
> >  2016-08-08 02:26:47 pro-backup-1-sd JobId 1789: 3307 Issuing autochanger 
> > "unload slot 9, drive 0" command.
> >  2016-08-08 02:28:06 pro-backup-1-sd JobId 1789: 3304 Issuing autochanger 
> > "load slot 14, drive 0" command.
> >  2016-08-08 02:28:59 pro-backup-1-sd JobId 1789: 3305 Autochanger "load 
> > slot 14, drive 0", status is OK.
> >  2016-08-08 02:29:18 pro-backup-1-sd JobId 1789: Recycled volume "000011L6" 
> > on device "DriveDevice" (/dev/nst0), all previous data lost.
> >  2016-08-08 02:29:18 pro-backup-1-sd JobId 1789: Forward spacing Volume 
> > "Incr-0368" to file:block 0:4082851165.
> >  2016-08-08 02:29:55 pro-backup-1-sd JobId 1789: End of Volume at file 1 on 
> > device "DiskDeviceIncr" (/data/bareos-storage/Incr), Volume "Incr-0368"
> >  2016-08-08 02:29:55 pro-backup-1-sd JobId 1789: Ready to read from volume 
> > "Incr-0369" on device "DiskDeviceIncr" (/data/bareos-storage/Incr).
> >  2016-08-08 02:29:55 pro-backup-1-sd JobId 1789: Forward spacing Volume 
> > "Incr-0369" to file:block 0:220.
> >  2016-08-08 02:34:37 pro-backup-1-sd JobId 1789: End of Volume at file 0 on 
> > device "DiskDeviceIncr" (/data/bareos-storage/Incr), Volume "Incr-0369"
> >  2016-08-08 02:34:37 pro-backup-1-sd JobId 1789: End of all volumes.
> >  2016-08-08 02:34:37 pro-backup-1-sd JobId 1789: Elapsed time=00:05:19, 
> > Transfer rate=15.61 M Bytes/second
> >  2016-08-08 02:35:13 pro-backup-1-dir JobId 1789: Bareos pro-backup-1-dir 
> > 15.2.3 (07Mar16):
> >   Build OS:               x86_64-redhat-linux-gnu redhat CentOS release 6.7 
> > (Final)
> >   Prev Backup JobId:      1032
> >   Prev Backup Job:        sccm-1.2016-07-21_00.13.00_58
> >   New Backup JobId:       1790
> >   Current JobId:          1789
> >   Current Job:            CopyToTape.2016-08-08_02.26.47_05
> >   Backup Level:           
> >   Client:                 hyper-3
> >   FileSet:                "StdLinux"
> >   Read Pool:              "DiskDaily" (From Job resource)
> >   Read Storage:           "DiskStorageIncr" (From Pool resource)
> >   Write Pool:             "TapeDaily" (From Job Pool's NextPool resource)
> >   Write Storage:          "TapeStorage" (From Storage from Pool's NextPool 
> > resource)
> >   Next Pool:              "TapeDaily" (From Job Pool's NextPool resource)
> >   Catalog:                "MyCatalog" (From Job resource)
> >   Start time:             08-Aug-2016 02:26:47
> >   End time:               08-Aug-2016 02:35:13
> >   Elapsed time:           8 mins 26 secs
> >   Priority:               12
> >   SD Files Written:       4
> >   SD Bytes Written:       4,982,268,060 (4.982 GB)
> >   Rate:                   9846.4 KB/s
> >   Volume name(s):         000011L6
> >   Volume Session Id:      861
> >   Volume Session Time:    1467639834
> >   Last Volume Bytes:      4,985,963,233 (4.985 GB)
> >   SD Errors:              0
> >   SD termination status:  OK
> >   Termination:            Copying OK
> 
> Hi,
> 
> any input on this? it's occurring over and over again,  but I cannot really 
> find a pattern to describe it better.
> 
> Thanks.
> Robert

turned out that the duplicate copy jobs are because the Copy jobs are getting 
pruned before the Backup jobs, so Bareos thinks those weren't yet copied.
The Pool in which the Backup jobs are sent have more space than required for 
the volume retention period, so the Volumes are getting purged after the volume 
retention expires, simple said, the Backup jobs outlive the Copy jobs.

solution:
introduced recyclepool in the Pool where the original Backup jobs go, so the 
volumes are automatically pruned according to the volume retention, and not by 
the need of new volumes.

it may be helpful for others...

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to