[Bacula-users] Fatal error on catalogue backup

[Ian Douglas]

hi all

Can someone who knows please advise if this is an issue with my database, my 
tape server, the tape machine, or the tape?

The director machine (this machine) died (power failure) without being shut 
down properly.

Tape server is HP, as is tape drive. Tape was out of drive, and I shut down 
tape machine and tape server manually (via power buttons) before UPS expired.

I've tried a few times, including restarting MariaDB and the tape machine.

Google search showed other people with similar issue, but few years ago.

Thanks, Ian

01-Feb 00:04 trooper-dir JobId 33471: shell command: run BeforeJob "/usr/
libexec/bacula/make_catalog_backup.pl MyCatalog"
01-Feb 00:04 trooper-dir JobId 33471: Start Backup JobId 33471, 
Job=BackupCatalog.2020-02-01_00.04.11_10
01-Feb 00:04 trooper-dir JobId 33471: Using Device "LTO-6" to write.
01-Feb 00:05 TapeServer JobId 33471: Volume "IncDiff-0012" previously written, 
moving to end of data.
01-Feb 00:06 TapeServer JobId 33471: Ready to append to end of Volume 
"IncDiff-0012" at file=1237.
01-Feb 00:06 trooper-dir JobId 33471: Fatal error: catreq.c:426 Invalid 
Catalog request: CatReq JobId=33471 UpdateMedia VolName=IncDiff-0012 
VolJobs=327 VolFiles=1237 VolBlocks=14646107 VolBytes=944849719296 VolABytes=0 
VolHoleBytes=0 VolHoles=0 VolMounts=131 VolErrors=0 VolWrites=256589848 
MaxVolBytes=0 EndTime=1580508390 VolStatus=Append Slot=0 relabel=0 InChanger=0 
VolReadTime=15412473 VolWriteTime=93282860606 VolFirstWritten=0 VolType=2 
VolParts=0 VolCloudParts=0 LastPartBytes=0 Enabled=1
01-Feb 00:06 trooper-fd JobId 33471: Fatal error: job.c:3015 Bad response from 
SD to Append Data command. Wanted 3000 OK data
, got len=491 msg="3903 Error append data: Error getting Volume info: 1990 
Invalid Catalog Request: CatReq JobId=33471 UpdateMedia VolName=IncDiff-0012 
VolJobs=327 VolFiles=1237 VolBlocks=14646107 VolBytes=944849719296 VolABytes=0 
VolHoleBytes=0 VolHoles=0 VolMounts=131 Vol"
01-Feb 00:06 TapeServer JobId 33471: Fatal error: Error getting Volume info: 
1990 Invalid Catalog Request: CatReq JobId=33471 UpdateMedia 
VolName=IncDiff-0012 VolJobs=327 VolFiles=1237 VolBlocks=14646107 
VolBytes=944849719296 VolABytes=0 VolHoleBytes=0 VolHoles=0 VolMounts=131 
VolErrors=0 VolWrites=256589848 MaxVolBytes=0 EndTime=1580508390 
VolStatus=Append Slot=0 relabel=0 InChanger=0 VolReadTime=15412473 
VolWriteTime=93282860606 VolFirstWritten=0 VolType=2 VolParts=0 
VolCloudParts=0 LastPartBytes=0 Enabled=1
01-Feb 00:06 trooper-dir JobId 33471: Error: Bacula trooper-dir 9.4.4 
(28May19):

[rest cut... normal job output stuff]

-- 
i...@zti.co.za http://www.zti.co.za
Zero 2 Infinity - The net.works
Phone +27-21-975-7273




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Fatal error on catalogue backup

[Ian Douglas]

On Saturday, 01 February 2020 00:15:07 SAST you wrote:

> I've tried a few times, including restarting MariaDB and the tape machine.

I mean Postgresql. Keep forgetting Bacula runs with Postgresql :-)

Thanks, Ian

-- 
i...@zti.co.za http://www.zti.co.za
Zero 2 Infinity - The net.works
Phone +27-21-975-7273




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

[Dimitri Maziuk via Bacula-users]

On 1/31/20 10:36 AM, Josh Fisher wrote:
> 
> Actually, it is pretty tricky from user space and why the need for the
> md kernel module in Linux. For true RAIT, like for RAID, it should be a
> device driver.

Yes, iff you need true RAIT. If all you want is to write to 2 file
descriptors instead of one, I'll need to dig up my Stevens and do some
light reading to refresh my memory and see if a simple dup() will
suffice. And no, that's not the same as a copy job: one is parallel, the
other: serial.

I expect the fun bit is fitting it into bacula's universe of tapes and
volumes and catalogs. Like if you want to restore, how do you chose the
copy to restore from.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

[Josh Fisher]

On 1/31/2020 10:25 AM, dmaziuk via Bacula-users wrote:

On 1/31/2020 3:33 AM, Radosław Korzeniewski wrote:



Amanda had "RAIT" since forever.



If you would be so kind and have an idea how it could be implemented in
bacula and so kind to describe it on this list it would be 
implemented by

developers.


I don't have any idea how it could be implemented *in bacula* since I 
never looked at any bacula code.


In general sending the same stream of bytes to two different places 
instead of one is not exactly rocket science. I guess it and can be 
implemented in several places, e.g. special storage inside SD, or two 
different SDs.



Actually, it is pretty tricky from user space and why the need for the 
md kernel module in Linux. For true RAIT, like for RAID, it should be a 
device driver. Most do not need RAIT, but I know some (Oak Ridge 
National Lab, for one) use RAIT systems both for redundancy and 
striping. Similarly, DRBD does this for block devices located on 
separate machines, a network RAID-1, and again requires kernel-space 
drivers. So implementing this in user space is still just making a copy, 
because there would be no way to make a write atomic. And in that case, 
what is wrong with using Copy jobs?





I would probably send to two SDs at once because it allows for more 
flexible setups: the 2nd SD can write to "the cloud", it can be on the 
off-site box, etc. Whereas amanda-style RAIT device only protects 
against single disk/tape failure.


Dima



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

[dmaziuk via Bacula-users]

On 1/31/2020 3:33 AM, Radosław Korzeniewski wrote:



Amanda had "RAIT" since forever.



If you would be so kind and have an idea how it could be implemented in
bacula and so kind to describe it on this list it would be implemented by
developers.


I don't have any idea how it could be implemented *in bacula* since I 
never looked at any bacula code.


In general sending the same stream of bytes to two different places 
instead of one is not exactly rocket science. I guess it and can be 
implemented in several places, e.g. special storage inside SD, or two 
different SDs.


I would probably send to two SDs at once because it allows for more 
flexible setups: the 2nd SD can write to "the cloud", it can be on the 
off-site box, etc. Whereas amanda-style RAIT device only protects 
against single disk/tape failure.


Dima



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] [EXTERNAL] Re: Bacula - waiting to reserve a device

[Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] via Bacula-users]

Radosław,

Sorry I made a mistake in my earlier email. We recently upgraded to version 
9.4.4 not 7.4.4.

I was trying to find out if I can disable bacula from sending those messages?

Any ideas please let me know.

Thanks,
Uthra



From: Radosław Korzeniewski 
Sent: Friday, January 31, 2020 4:37 AM
To: Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] 
Cc: bacula-users@lists.sourceforge.net
Subject: [EXTERNAL] Re: [Bacula-users] Bacula - waiting to reserve a device

Hello,

czw., 30 sty 2020 o 16:43 Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] via 
Bacula-users 
mailto:bacula-users@lists.sourceforge.net>> 
napisał(a):
Hi,

After I upgraded to bacula-7.4.4


AFAR, there was a bug which keeps sending those annoying messages forever or 
until reservation resolves.
You should upgrade to 9.4.x or newer (9.6 will be released soon I hope).

best regards
--
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Why would bacula consider duplicate jobs as fatal?

[Radosław Korzeniewski]

Hello,

śr., 29 sty 2020 o 17:51 William Muriithi 
napisał(a):

> Hello,
>
> Was trying to reduce the number of mails coming from Bacula, and was
> combing through the logs to see what I can filter out.  Currently, almost
> all noise comes from bacula attempting to schedule a job and then realizing
> the previous isn't yet done.  I have configured bacula not to allow
> duplicates to avoid jobs piling up in case I miss replacing tapes when all
> are full.
>
> Anyway as I was doing so, I noticed that, sometime, bacula do consider
> duplicate fatal?


Yes, this is correct.


>   How would this make sense considering it was intentionally configured?


I think I do miss your point. Why anyone on Earth would like to configure a
backup job in such a way that the next job will intentionally run when a
previous job did not complete and intentionally setup cancelation of the
duplicated job?
IMVHO if I knew that my backup job is running for i.e. 8H then I'll never
schedule next backup job on 4H period and setup a cancellation of the
duplicate job because it will cancel every second job by design. It would
be insane, right?


>   Kind of confused by these instances.
>
> 22-Jan 17:50 bacula-dir JobId 25338: Fatal error: JobId 25266 already
> running. Duplicate job not allowed.
>
>
Well, this is a job message which inform you about the cause of the job
cancelation, as the job termination status is "cancelled" and not "fatal
error".
What would you like to change in this message?

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula - waiting to reserve a device

[Radosław Korzeniewski]

Hello,

czw., 30 sty 2020 o 16:43 Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] via
Bacula-users  napisał(a):

> Hi,
>
>
>
> After I upgraded to bacula-7.4.4
>
>
>
AFAR, there was a bug which keeps sending those annoying messages forever
or until reservation resolves.
You should upgrade to 9.4.x or newer (9.6 will be released soon I hope).

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

[Radosław Korzeniewski]

Hello,

czw., 30 sty 2020 o 17:30 dmaziuk via Bacula-users <
bacula-users@lists.sourceforge.net> napisał(a):

> Amanda had "RAIT" since forever.
>

If you would be so kind and have an idea how it could be implemented in
bacula and so kind to describe it on this list it would be implemented by
developers.

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users