[Bacula-users] First post and question.

[Miguel Angel Fernández]

Hello everybody!!

This is my presentation as a new bacula user (but aged sysadmin ;-) )!!

I've been testing version 9.6.7 on CentOS and I see it fit for my backup
needs.

I've used rpms from the binaries repository. But now I've seen that version
11.0.1 has reached the released state and I want to give it a try, but no
rpms are available as per today.

Is there any scheduled date for this release?

Many thanks!!
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Problem with missing EOD/EOF on LTO-5 Tape

[Alan Brown]

Is the OP using lin_tape driver by any chance?


On 24/02/2021 11:42, Martin Simmons wrote:
> That is a strange error.  ERR=Erfolg (Success) means that ioctl returned
> non-zero but didn't set any errno.
>
> Is there anything logged in the syslog (e.g. /var/log/messages or the system
> console)?
>
> Is this Linux?  Which kernel driver are you using for the tape?
>
> __Martin
>
>
>> On Tue, 23 Feb 2021 15:31:36 +0100 (CET), Christian Lehmann said:
>> Dear all,
>>  
>> I have just missed the errors:
>>  
>> so I was performing a backup (which is finished).
>>  
>> Do an umount and take out of the tape (including rewinding).
>>  
>> Put in this tape and mount it (no error)
>>  
>> starting a new short backup --> tape is forwarded to the corresponding 
>> position creating this error:
>>  
>> 23-Feb 15:12 fritzie15-sd JobId 14182: Volume "LTO-5-Tape0004-128K" 
>> previously written, moving to end of data.
>> 23-Feb 15:14 fritzie15-sd JobId 14182: Error: Unable to position to end of 
>> data on Tape device "LTO-5-128K" (/dev/nst0): ERR=tape_dev.c:363 ioctl 
>> MTIOCGET error on "LTO-5-128K" (/dev/nst0). ERR=Erfolg.
>> 23-Feb 15:14 fritzie15-sd JobId 14182: Marking Volume "LTO-5-Tape0004-128K" 
>> in Error in Catalog.
>>  
>>  
>>  
>>  
>>  
>> -Original-Nachricht-
>> Betreff: [Bacula-users] Problem with missing EOD/EOF on LTO-5 Tape
>> Datum: 2021-02-23T15:19:37+0100
>> Von: "Christian Lehmann" 
>> An: "bacula-users@lists.sourceforge.net" 
>> 
>>  
>>  
>>  
>> Hello everybody,
>>  
>> I have a problem with a single LTO-5 Tape drive (Tandberg LTO-5 HH).
>> I do backups spanning multiple Tapes, changing them manually.
>> So I configured the storage daemon that it is automatically pushing out the 
>> tape as soon as it is full.
>> So my users (and me) can see this and load a new/the next tape. Than bacula 
>> automatically mounts it and continue with the backup. This works fine.
>> But problems arise as soon as I have a tape, which is not full and I want 
>> to unload it (for example to label a new tape or to restart bacula or the 
>> server). If I just restart tape is pushed out as soon as bacula is shutting 
>> down or during the restart (it is also rewinded as expected). The same 
>> happens, if I "unmount" the tape using bconsole.
>> But, as soon as I start a new backup, which wants to use this tape and I 
>> mount it again, bacula cannot find the position to continue with the backup 
>> (someone suggested that this might be due to a missing EOD mark, but if I 
>> write this one manually by mt, this does not change the behaviour).
>>  
>> btape testing is working fine, if I disable the automatic pushout of the 
>> tape (as my tape drive is not able to get the tape back in again by 
>> itself).
>>  
>> Any help/ideas is/are apreciated.
>>  
>> Thank you all in advance!
>>  
>> Christian
>>  
>> Here is my bacula-sd.conf:
>>  
>> Storage { # definition of myself
>>   Name = fritzie15-sd
>>   SDPort = 9103 # Director's port
>>   WorkingDirectory = "/var/lib/bacula"
>>   Pid Directory = "/var/run"
>>   Maximum Concurrent Jobs = 20
>>   # SDAddresses = {
>>   # ipv4 = {addr = 127.0.0.1; port = 9103;}
>>   # ipv4 = {addr = 141.67.100.240; port = 9103;}
>>   # }
>>   SDAddress = 141.67.101.230
>> }
>> #
>> # List Directors who are permitted to contact Storage daemon
>> #
>> Director {
>>   Name = fritzie15-dir
>>   Password = "Something-very secret"
>> }
>>  
>>  
>> Device {
>>   Name = FileStorage
>>   Media Type = File
>>   Archive Device = /srv/ag_dudziak_backup1/bacula
>>   LabelMedia = yes; # lets Bacula label unlabeled media
>>   Random Access = Yes;
>>   AutomaticMount = yes; # when device opened, read it
>>   RemovableMedia = no;
>>   AlwaysOpen = no;
>>   Maximum Volume Size = 100G;
>>   Maximum Concurrent Jobs = 2
>> }
>>  
>>  
>>  
>> Device {
>>   Name = LTO-5-128K
>>   Archive Device = /dev/nst0
>>   Device Type = Tape
>>   Media Type = LTO-5-128K
>>   Labelmedia = yes
>>   Random Access = no
>>   # AutomaticMount = no
>>   AutomaticMount = yes
>>   RemovableMedia = yes
>>   AlwaysOpen = yes
>>   Maximum Concurrent Jobs = 1
>>   Maximum File Size = 400G
>>   Maximum Changer Wait = 2h
>>   Volume Poll Interval = 5min
>>   Offline on Unmount = yes
>>   # Offline on Unmount = no
>>   Spool Directory = /srv/ag_dudziak/bacula-spool/LTO-5-1M
>>   Maximum Block Size = 128K
>> }
>>  
>> I sticked to the block size of 128K as anything bigger did not work (even 
>> with btape).
>>  
>>  
>> 
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Fbacula-users&data=04%7C01%7C%7Cb431572cc5154bdc10a608d8d8b97d15%7C1faf88fea9984c5b93c9210a11d9a5c2%7C0%7C0%7C637497638469372129%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=f4pcml8PSoGpHSU8BjW9rMqMJ0EuLrLsgrxoHax3j8o%3D&reserve

Re: [Bacula-users] Bacula For Mac Clients

[Radosław Korzeniewski]

Hello,

śr., 24 lut 2021 o 12:42 Josh Fisher  napisał(a):

> On 2/24/21 5:14 AM, Radosław Korzeniewski wrote:
>
> Hello,
>
> wt., 23 lut 2021 o 21:29 David Brodbeck 
> napisał(a):
>
>>
>>
>> On Mon, Feb 22, 2021 at 11:50 PM Radosław Korzeniewski <
>> rados...@korzeniewski.net> wrote:
>>
>>> The newest Bacula Clients should use kIOPMAssertionTypeNoIdleSleep with
>>> kIOPMAssertionLevelOn to prevent OS from sleeping. So external hacks should
>>> not be required any more. :)
>>>
>>> best regards
>>> --
>>> Radosław Korzeniewski
>>> rados...@korzeniewski.net
>>>
>>
>> Oh, very nice! Do you happen to know what the first version to have this
>> feature was?
>>
>
> I do not know. It is on 11.0 for sure. The commit was:
>
> commit 0c202c6389c03b0730c31650ac443c9a83a6ba9b
> Author: Radosław Korzeniewski 
> Date:   Sat Dec 14 15:52:59 2019 +0100
>
> Redesigning PM management add missing files.
>
> I hope it helps.
>
>
> Does anyone know if this IOPMAssertionCreate() call has the same effect as
> the 'pmset noidle' command?
>
https://developer.apple.com/documentation/iokit/kiopmassertiontypenoidlesleep

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula For Mac Clients

[Josh Fisher]

On 2/24/21 5:14 AM, Radosław Korzeniewski wrote:

Hello,

wt., 23 lut 2021 o 21:29 David Brodbeck > napisał(a):




On Mon, Feb 22, 2021 at 11:50 PM Radosław Korzeniewski
mailto:rados...@korzeniewski.net>> wrote:

The newest Bacula Clients should use
kIOPMAssertionTypeNoIdleSleep with kIOPMAssertionLevelOn to
prevent OS from sleeping. So external hacks should not be
required any more. :)

best regards
-- 
Radosław Korzeniewski

rados...@korzeniewski.net 


Oh, very nice! Do you happen to know what the first version to
have this feature was?


I do not know. It is on 11.0 for sure. The commit was:

commit 0c202c6389c03b0730c31650ac443c9a83a6ba9b
Author: Radosław Korzeniewski mailto:rad...@inteos.pl>>
Date:   Sat Dec 14 15:52:59 2019 +0100

    Redesigning PM management add missing files.

I hope it helps.



Does anyone know if this IOPMAssertionCreate() call has the same effect 
as the 'pmset noidle' command?




--
Radosław Korzeniewski
rados...@korzeniewski.net 


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Problem with missing EOD/EOF on LTO-5 Tape

[Martin Simmons]

That is a strange error.  ERR=Erfolg (Success) means that ioctl returned
non-zero but didn't set any errno.

Is there anything logged in the syslog (e.g. /var/log/messages or the system
console)?

Is this Linux?  Which kernel driver are you using for the tape?

__Martin


> On Tue, 23 Feb 2021 15:31:36 +0100 (CET), Christian Lehmann said:
> 
> Dear all,
>  
> I have just missed the errors:
>  
> so I was performing a backup (which is finished).
>  
> Do an umount and take out of the tape (including rewinding).
>  
> Put in this tape and mount it (no error)
>  
> starting a new short backup --> tape is forwarded to the corresponding 
> position creating this error:
>  
> 23-Feb 15:12 fritzie15-sd JobId 14182: Volume "LTO-5-Tape0004-128K" 
> previously written, moving to end of data.
> 23-Feb 15:14 fritzie15-sd JobId 14182: Error: Unable to position to end of 
> data on Tape device "LTO-5-128K" (/dev/nst0): ERR=tape_dev.c:363 ioctl 
> MTIOCGET error on "LTO-5-128K" (/dev/nst0). ERR=Erfolg.
> 23-Feb 15:14 fritzie15-sd JobId 14182: Marking Volume "LTO-5-Tape0004-128K" 
> in Error in Catalog.
>  
>  
>  
>  
>  
> -Original-Nachricht-
> Betreff: [Bacula-users] Problem with missing EOD/EOF on LTO-5 Tape
> Datum: 2021-02-23T15:19:37+0100
> Von: "Christian Lehmann" 
> An: "bacula-users@lists.sourceforge.net" 
> 
>  
>  
>  
> Hello everybody,
>  
> I have a problem with a single LTO-5 Tape drive (Tandberg LTO-5 HH).
> I do backups spanning multiple Tapes, changing them manually.
> So I configured the storage daemon that it is automatically pushing out the 
> tape as soon as it is full.
> So my users (and me) can see this and load a new/the next tape. Than bacula 
> automatically mounts it and continue with the backup. This works fine.
> But problems arise as soon as I have a tape, which is not full and I want 
> to unload it (for example to label a new tape or to restart bacula or the 
> server). If I just restart tape is pushed out as soon as bacula is shutting 
> down or during the restart (it is also rewinded as expected). The same 
> happens, if I "unmount" the tape using bconsole.
> But, as soon as I start a new backup, which wants to use this tape and I 
> mount it again, bacula cannot find the position to continue with the backup 
> (someone suggested that this might be due to a missing EOD mark, but if I 
> write this one manually by mt, this does not change the behaviour).
>  
> btape testing is working fine, if I disable the automatic pushout of the 
> tape (as my tape drive is not able to get the tape back in again by 
> itself).
>  
> Any help/ideas is/are apreciated.
>  
> Thank you all in advance!
>  
> Christian
>  
> Here is my bacula-sd.conf:
>  
> Storage { # definition of myself
>   Name = fritzie15-sd
>   SDPort = 9103 # Director's port
>   WorkingDirectory = "/var/lib/bacula"
>   Pid Directory = "/var/run"
>   Maximum Concurrent Jobs = 20
>   # SDAddresses = {
>   # ipv4 = {addr = 127.0.0.1; port = 9103;}
>   # ipv4 = {addr = 141.67.100.240; port = 9103;}
>   # }
>   SDAddress = 141.67.101.230
> }
> #
> # List Directors who are permitted to contact Storage daemon
> #
> Director {
>   Name = fritzie15-dir
>   Password = "Something-very secret"
> }
>  
>  
> Device {
>   Name = FileStorage
>   Media Type = File
>   Archive Device = /srv/ag_dudziak_backup1/bacula
>   LabelMedia = yes; # lets Bacula label unlabeled media
>   Random Access = Yes;
>   AutomaticMount = yes; # when device opened, read it
>   RemovableMedia = no;
>   AlwaysOpen = no;
>   Maximum Volume Size = 100G;
>   Maximum Concurrent Jobs = 2
> }
>  
>  
>  
> Device {
>   Name = LTO-5-128K
>   Archive Device = /dev/nst0
>   Device Type = Tape
>   Media Type = LTO-5-128K
>   Labelmedia = yes
>   Random Access = no
>   # AutomaticMount = no
>   AutomaticMount = yes
>   RemovableMedia = yes
>   AlwaysOpen = yes
>   Maximum Concurrent Jobs = 1
>   Maximum File Size = 400G
>   Maximum Changer Wait = 2h
>   Volume Poll Interval = 5min
>   Offline on Unmount = yes
>   # Offline on Unmount = no
>   Spool Directory = /srv/ag_dudziak/bacula-spool/LTO-5-1M
>   Maximum Block Size = 128K
> }
>  
> I sticked to the block size of 128K as anything bigger did not work (even 
> with btape).
>  
>  
> 


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula For Mac Clients

[Radosław Korzeniewski]

Hello,

wt., 23 lut 2021 o 21:29 David Brodbeck  napisał(a):

>
>
> On Mon, Feb 22, 2021 at 11:50 PM Radosław Korzeniewski <
> rados...@korzeniewski.net> wrote:
>
>> The newest Bacula Clients should use kIOPMAssertionTypeNoIdleSleep with
>> kIOPMAssertionLevelOn to prevent OS from sleeping. So external hacks should
>> not be required any more. :)
>>
>> best regards
>> --
>> Radosław Korzeniewski
>> rados...@korzeniewski.net
>>
>
> Oh, very nice! Do you happen to know what the first version to have this
> feature was?
>

I do not know. It is on 11.0 for sure. The commit was:

commit 0c202c6389c03b0730c31650ac443c9a83a6ba9b
Author: Radosław Korzeniewski 
Date:   Sat Dec 14 15:52:59 2019 +0100

Redesigning PM management add missing files.

I hope it helps.
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Error on despooling attributes in catreq.c: wanted xxx bytes, maximum permitted 10000000 bytes

[Martin Simmons]

> On Wed, 24 Feb 2021 08:54:11 +0100, Uwe Schuerkamp said:
> 
> On Tue, Feb 23, 2021 at 05:52:02PM +0100, Josip Deanovic wrote:
> > On Monday 2021-02-22 16:06:42 David Brodbeck wrote:
> > > On Wed, Feb 17, 2021 at 6:12 AM Josip Deanovic
> > > 
> > > wrote:
> > > > It's interesting that the job had almost 2GB of attributes to
> > > > despool. That's quite a large amount of attributes.
> > > 
> > > I have a few jobs that despool that much, and one that despools over 18
> > > GB.  The machine in question has 51 million files.
> > 
> > Just to be sure... Are you talking about the attribute spool file that
> > gets created in running directory and not about the spool file that gets 
> > created in the spool directory?
> > 
> 
> I'd suspect he is talking about the attribute spool file. The size
> sounds about right (1,9GB on my end for around 5 million files, 19GB
> for his attribute spool with a tenfold amount of files in the backup job).
> 
> I'm just wondering why David's job appears to be working fine without a
> modification of the attribute spool size parameter in catreq.c as
> outlined above...

The parameter (1000) in catreq.c is not the total size of the spool file.
It is the maximum record size within the spool file, which is typically
several orders of magnitude smaller than 1000.


>   then again our job used to work for years without
> any issues, things only started to go wrong on bacula 9.6.5 or
> thereabouts.

That's interesting.  There was a bug in 9.6.4 which changed the way that
Bacula locks access to the catalog (but I'm not sure how it would cause this
problem).

Do you run concurrent jobs?

If so, you could try updating to 9.6.7 plus this patch:

https://www.bacula.org/git/cgit.cgi/bacula/commit/bacula/src/dird/dird.c?h=Branch-11.0&id=9ddd829414bb4b1f8330f71824f0ef5675e957a8

Don't be mislead by the change reason in this patch -- it changes much more
than just the 'show catalog' command.  This patch will probably work in 9.6.5
as well.

__Martin


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users