Re: [Bacula-users] waiting on max Job jobs - not cancelled?
Oops... On 01/04/2020 16:10, Bernie Elbourn wrote: Hi, Oddly, jobs run sequentially as follows rather than duplicates being cancelled: Running Jobs: Console connected at 29-Mar-20 12:36 JobId Type Level Files Bytes Name Status == 70172 Back Diff 120 36.70 M Backup-pc is running 70173 Back Incr 0 0 Backup--pc is waiting on max Job jobs Are there any pointers to trace why the duplicate job 70173 is not cancelled? Obfuscation error both above should read Backup-pc - they were same name. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Simple disk storage devices migrations/backups
> On Wed, 1 Apr 2020 16:02:59 +0200, Pierre Bernhardt said: > > I think to correct the problems on existing backups a bscan -m -s should also > fix this issues permanently so a patch of bscan is needed, too. AFAICS (I've not tried it), bscan will not fail if it gets these errors. It will print the error messages but will still update the database. __Martin ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] waiting on max Job jobs - not cancelled?
Hi, Oddly, jobs run sequentially as follows rather than duplicates being cancelled: Running Jobs: Console connected at 29-Mar-20 12:36 JobId Type Level Files Bytes Name Status == 70172 Back Diff 120 36.70 M Backup-pc is running 70173 Back Incr 0 0 Backup--pc is waiting on max Job jobs Are there any pointers to trace why the duplicate job 70173 is not cancelled? The job is configured with: Allow Duplicate Jobs = no Cancel Queued Duplicates = yes Cancel Lower Level Duplicates = yes The file daemon on the PC is default: Maximum Concurrent Jobs = 10 The storage daemon: Maximum Concurrent Jobs = 20 The client: Maximum Concurrent Jobs = 10 The director: Maximum Concurrent Jobs = 6 Versions: Director: 7.4.4 (202Sep16) PC: 7.4.4 (28Sep16) Microsoft Professional (build 9200), 64-bit,Cross-compile,Win64 Director and storage server are same: running Debian old stable PC: Windows 10 Huge thanks Bernie ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Simple disk storage devices migrations/backups
Am 01.04.20 um 15:19 schrieb Martin Simmons: > Yes, I think 1 is the best solution, but it will not fix existing backups. > > Migration could also be changed to allow certain types of error, like restore > does with the "Restore OK -- with errors" status. I think to correct the problems on existing backups a bscan -m -s should also fix this issues permanently so a patch of bscan is needed, too. Cheers, Pierre ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Solved: Execute command on client
Am 01.04.20 um 12:37 schrieb Wanderlei Huttel:
> ClientRunBeforeJob - Run In client before backup (single line config)
> ClientRunAfterJob - Run In client after backup (single line config)
> RunScript - (multiples line config)
>
> You can take a look in the Job Resource in manual and look for "RunScript
> {body-of-runscript}" parameter
> https://www.bacula.org/9.6.x-manuals/en/main/Configuring_Director.html#SECTION00213
That is the information which I'd not found. Thank you.
Cheers,
Pierre
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Simple disk storage devices migrations/backups
> On Wed, 1 Apr 2020 11:36:22 +0200, Pierre Bernhardt said: > > Am 01.04.20 um 00:25 schrieb Pierre Bernhardt: > > Am 01.04.20 um 00:11 schrieb Pierre Bernhardt: > > So now I restarted again a migration to check the result. > > Here the content from the migration job: > The migration back to the tape has now been finshed without problems: Great! > By the way, do you have an idea how it should be fixed? I think, this > workaround is not > the correct solution, isn't it? Yes, the workaround is a bad solution because it might hide real errors. > In my opinion at the time the job has to been written and splitted to the > disks there two > solutions possible: > At the end the unexpected file write has been identified and before the next > disk has to been > ask for: > 1. The short block should be truncated and not written to the database > or > 2. The short block should be ignored to write to the database. > or > 3. The short block should be marked as invalid in the database and should be > ignored. > > After this step the block should be rewritten on the next volume. > > 1. looks like me for the cleanest solution because in read this block is not > there > > 2. looks like me a little bit problematic because if eg. bscan is used it > must also > fix/ignore this block. > > 3. this is a good solution if there exists already mechanism in all tools and > bacule > to ignore such parts in backup volume data. Yes, I think 1 is the best solution, but it will not fix existing backups. Migration could also be changed to allow certain types of error, like restore does with the "Restore OK -- with errors" status. __Martin ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Execute command on client
Hello Pierre
Yes, it possible.
For run scripts in bacula there are basically 5 options:
RunBeforeJob - Run In server before backup (single line config)
RunAfterJob - Run In server after backup (single line config)
ClientRunBeforeJob - Run In client before backup (single line config)
ClientRunAfterJob - Run In client after backup (single line config)
RunScript - (multiples line config)
You can take a look in the Job Resource in manual and look for "RunScript
{body-of-runscript}" parameter
https://www.bacula.org/9.6.x-manuals/en/main/Configuring_Director.html#SECTION00213
Best regards
*Wanderlei Hüttel*
Em qua., 1 de abr. de 2020 às 07:19, Pierre Bernhardt <
pie...@starcumulus.owl.de> escreveu:
> Hello,
>
> is it possible to execute scripts or commands on a client to e.g. create
> snapshots before
> backup them? I did not found a description about this feature.
> I need to execute a script/command before and after a backup has to been
> produced to
> create and remove the lvm snapshot.
>
> Cheers,
> Pierre
>
>
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Execute command on client
Hello, is it possible to execute scripts or commands on a client to e.g. create snapshots before backup them? I did not found a description about this feature. I need to execute a script/command before and after a backup has to been produced to create and remove the lvm snapshot. Cheers, Pierre ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Simple disk storage devices migrations/backups
Am 01.04.20 um 00:25 schrieb Pierre Bernhardt: > Am 01.04.20 um 00:11 schrieb Pierre Bernhardt: > So now I restarted again a migration to check the result. Here the content from the migration job: The migration back to the tape has now been finshed without problems: 01-Apr 00:19 backup-dir JobId 47775: The following 1 JobId was chosen to be migrated: 47704 01-Apr 00:19 backup-dir JobId 47775: Migration using JobId=47704 Job=nihilnihil_home.2020-03-21_20.23.31_49 01-Apr 00:19 backup-dir JobId 47775: Start Migration JobId 47775, Job=MigrateFile2Drive.2020-04-01_00.19.07_04 01-Apr 00:19 backup-dir JobId 47775: Using Device "DiskStorage2" to read. 01-Apr 00:19 backup-sd JobId 47775: Ready to read from volume "DISK016" on File device "DiskStorage2" (/media/baculadisk2). 01-Apr 00:19 backup-sd JobId 47775: Forward spacing Volume "DISK016" to addr=217 01-Apr 05:27 backup-sd JobId 47775: block.c:682 [SE0208] Volume data has error at 0:0! Short block of 57010 bytes on device "DiskStorage2" (/media/baculadisk2) discarded. 01-Apr 05:27 backup-sd JobId 47775: read_records.c:160 block.c:682 [SE0208] Volume data has error at 0:0! Short block of 57010 bytes on device "DiskStorage2" (/media/baculadisk2) discarded. 01-Apr 05:27 backup-sd JobId 47775: End of Volume "DISK016" at addr=972406571008 on device "DiskStorage2" (/media/baculadisk2). 01-Apr 05:28 backup-sd JobId 47775: Ready to read from volume "DISK017" on File device "DiskStorage2" (/media/baculadisk2). 01-Apr 05:28 backup-sd JobId 47775: Forward spacing Volume "DISK017" to addr=213 01-Apr 06:27 backup-sd JobId 47775: End of Volume "DISK017" at addr=110838477984 on device "DiskStorage2" (/media/baculadisk2). 01-Apr 06:27 backup-sd JobId 47775: Elapsed time=06:07:56, Transfer rate=49.02 M Bytes/second 01-Apr 08:30 backup-dir JobId 47775: Bacula backup-dir 9.4.2 (04Feb19): Build OS: x86_64-pc-linux-gnu debian buster/sid Prev Backup JobId: 47704 Prev Backup Job:nihilnihil_home.2020-03-21_20.23.31_49 New Backup JobId: 47776 Current JobId: 47775 Current Job:MigrateFile2Drive.2020-04-01_00.19.07_04 Backup Level: Full Client: backup-fd FileSet:"Full Set" 2017-10-09 08:53:50 Read Pool: "Migrate" (From Job resource) Read Storage: "Disk2" (From Pool resource) Write Pool: "Monthly" (From Job Pool's NextPool resource) Write Storage: "FibreCAT TX48 S2" (From Job Pool's NextPool resource) Catalog:"MyCatalog" (From Client resource) Start time: 01-Apr-2020 00:19:11 End time: 01-Apr-2020 08:25:40 Elapsed time: 8 hours 6 mins 29 secs Priority: 21 SD Files Written: 1,030,385 SD Bytes Written: 1,082,331,572,757 (1.082 TB) Rate: 37080.1 KB/s Volume name(s): LTO40025|LTO40026 Volume Session Id: 1 Volume Session Time:1585692943 Last Volume Bytes: 270,297,861,120 (270.2 GB) SD Errors: 0 SD termination status: OK Termination:Migration OK Here from migration-backup job: 01-Apr 00:19 backup-dir JobId 47776: Recycled current volume "LTO40025" 01-Apr 00:19 backup-dir JobId 47776: Using Device "HPUltrium4-2" to write. 01-Apr 00:19 backup-sd JobId 47776: Recycled volume "LTO40025" on Tape device "HP Ultrium 4-2" (/dev/tape/by-id/scsi-HU19145705-nst), all previous data lost. 01-Apr 04:30 backup-sd JobId 47776: [SI0202] End of Volume "LTO40025" at 812:15489 on device "HP Ultrium 4-2" (/dev/tape/by-id/scsi-HU19145705-nst). Write of 64512 bytes got -1. 01-Apr 04:30 backup-sd JobId 47776: Re-read of last block succeeded. 01-Apr 04:30 backup-sd JobId 47776: End of medium on Volume "LTO40025" Bytes=812,947,258,368 Blocks=12,601,488 at 01-Apr-2020 04:30. 01-Apr 04:30 backup-sd JobId 47776: 3307 Issuing autochanger "unload Volume LTO40025, Slot 17, Drive 1" command. 01-Apr 04:32 backup-dir JobId 47776: Recycled volume "LTO40026" 01-Apr 04:32 backup-sd JobId 47776: 3304 Issuing autochanger "load Volume LTO40026, Slot 9, Drive 1" command. 01-Apr 04:34 backup-sd JobId 47776: 3305 Autochanger "load Volume LTO40026, Slot 9, Drive 1", status is OK. 01-Apr 04:34 backup-sd JobId 47776: Recycled volume "LTO40026" on Tape device "HP Ultrium 4-2" (/dev/tape/by-id/scsi-HU19145705-nst), all previous data lost. 01-Apr 04:34 backup-sd JobId 47776: New volume "LTO40026" mounted on device "HP Ultrium 4-2" (/dev/tape/by-id/scsi-HU19145705-nst) at 01-Apr-2020 04:34. 01-Apr 06:30 backup-sd JobId 47776: Elapsed time=06:07:02, Transfer rate=49.14 M Bytes/second 01-Apr 06:30 backup-sd JobId 47776: Sending spooled attrs to the Director. Despooling 300,838,146 bytes ... I've compared the file which was stored in the short block: The restored file from the migration to tape has the same sha1sum as the one which I restored from the two disks and the original file. So
[Bacula-users] Windows backup slow
Hello, Just started using Bacula and at this time (early stages) I find my UNIX/Solaris full backups are running at a good speed, but our window server is slow. There is a chance it is just the number of files (Yes, I am ignoring profiles). My questions: 1) I have added "Maximum Concurrent Jobs" to my clients FileDaemon, but is there a way to prove that Windows client is using it? 2) Any web links to how I can monitor a client backup, to examine what is happening. Thanks Andrew -- ** At home during the crisis trying to work ** Support Request to s...@dcs.bbk.ac.uk ** Andrew Watkins * Birkbeck, University of London * Computer Science * * http://notallmicrosoft.blogspot.com * ::e-mails are only read & actioned between 0900 and 1730 hours (Monday - Friday) ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
