Re: [Bacula-users] Performance testing simultaneous spooling and despooling

2024-09-16 Thread Gary R. Schmidt

On 17/09/2024 08:58, B. Smith wrote:

Good evening,

I have a ZFS pool as a dedicated Bacula spool. The pool contains six 4TB 
drives, configured as three mirrors of two striped disks. My tape drive 
is LTO8. All the data is local to the server. When I despool without 
simultaneously spooling another job, my despool rate is about 280 
MB/sec. However, I noticed that when I allow a second job to spool at 
the same time I despool, the despool rate goes down to as low as 75 
MB/sec, with the drive stopping relatively frequently to refill the cache.


I'd like to try to figure out what the bottleneck is in this 
configuration. I looked at using fio, but I don't want to test random 
reads and writes... I want to test sequentially reading from one file on 
the pool while sequentially writing to another. Can anyone suggest a 
good way of testing this, or maybe point me to some other way of 
determining the bottleneck? I realize it could be as simple as the disks 
having poor simultaneous r/w performance, or it could be a limitation 
with the backplane, HBA, or motherboard. Just trying to drill-down to 
figure out what, if anything, I can upgrade.



Which ZFS are you using?  Solaris, BSD, or Linux?

What's the HBA?  NICs?

Are the disks SATA (so one-way only) or SAS (two-way)?

How much physical RAM does the system have?

I don't see this, but I am running Solaris with SAS disks in a RAIDZ 
pool and 72Gb of RAM.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Director migration question

2024-09-01 Thread Gary R. Schmidt

On 02/09/2024 05:02, Phil Stracchino wrote:

On 9/1/24 14:48, Phil Stracchino wrote:


Actually I already see that one issue is I don't want both directors
trying to run the same jobs.  In this situation, if I disable a job in
one Director, does that GLOBALLY disable the job, or only in that
Director?  If so, I could — for now — disable all jobs in the
"read-only" Director ...



...And answering my own question again, yes, this looks fine


Apart from the problem when one director tries to do something - like a 
restore - while the other is running a backup.


Data corruption is the name of the game...

Short answer, don't do it, kill the old one, start the new one, there is 
no need for two to exist.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Very long retention time

2024-08-14 Thread Gary R. Schmidt

On 14/08/2024 16:19, Mehrdad Ravanbod wrote:


hello everyone

I need to set up backups for a set of files that need to be saved and be 
possible to access for a very long time(approx. 10 years, for compliance 
reasons), is this possible in Bacula or even advisable?? Or do we need 
to solve this some other way


The first problem you have is finding media that is guaranteed to last 
for 10+ years.


Tape is generally considered the best for this, but...  YMMV if you 
don't store it correctly.


Another option is long-term optical disk, which is not the same as DVD 
or Blu-Ray.


Talk to the suppliers of archival services in your country for 
information on what is available and sensible.


The second problem is storage for the database.  If you have millions of 
files that change frequently you will need a lot of space for the database.


Non-Bacula solution: Back when I was at SGI we offered HFS - 
Hierarchical File System - for people who had this sort of problem.  And 
very, very deep pockets.
I don't know if Rackable kept it alive when they purchased SGI, maybe 
talk to them?


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula suddenly running very slow

2024-08-07 Thread Gary R. Schmidt

On 08/08/2024 04:27, Rob Gerber wrote:
I am not sure, but having done 'cat bacula.sql |more' I believe there 


Please don't promulgate useless uses of "cat".

Either "more bacula.sql" or "less bacula.sql".

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Tape drive repair recommendations?

2024-08-01 Thread Gary R. Schmidt

On 02/08/2024 04:14, B. Smith wrote:
I know this isn't directly Bacula related, but there aren't too many 
resources on the internet that I know of for tape drive enthusiasts.
I have an HPE 1/8 G2 Autoloader with an HPE LTO-8 30750 drive. Recently, 
when attempting to load tapes, it would keep reading for a very long 
time (probably to the end of the tape). The support ticket generated by 
the RMI stated "may be having problems finding servo code after loading 
a cartridge." After upgrading the firmware to P381 (I don't have the 
very latest as it is behind a paywall), the autoloader now reports "HE: 
drive broken: needs repair Code: F3 01" and the drive status is 
"Exception F3 50 -  Error."


Does anyone have any recommendations for a tape drive repair company?


Country??  State/Canton/Shire?? City???

Not much use pointing you at someone in Canberra.  :-)

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Use of Multiple Tape Drives at Once

2024-07-24 Thread Gary R. Schmidt

On 24/07/2024 17:04, Radosław Korzeniewski wrote:

Hello,

pon., 1 lip 2024 o 23:03 Bill Arlofski via Bacula-users 
> napisał(a):


It is generally recommended to stick to the same priority for your
normal backup
and Restore Jobs, and then set the small number of "special" jobs
(Admin, CopyControl, MigrationControl, Verify, etc) to
something else so they they do not run as the same time as "normal"
jobs.


Fully agreed. This "priority" parameter is misleading too. In most cases 
users expect higher priority jobs to overrule lower priority.
But it happens on queue only, not at job runtime. As waiting for a job 
in queue should be and in most cases is a very rare event this 
"priority" does not work at all.


I found the priority option useful for separating "normal" jobs from 
"special" ones, as Bill described above. Unless your Bacula is busy 
working 24/7 doing backup jobs and lower priority jobs will never start.

best regards


I found the "priority" option very useful for ensuring that jobs are 
executed in a - to me - sensible order.


Incremental jobs (48), then differential jobs (49), then full jobs (50). 
 Then catalogue backups (91).  :-)


Some of the differentials and fulls can take more than 24 hours to 
complete, so I run them on different weekends.


Fortunately it doesn't matter if they run into the next week.  (No 24*7 
development here!  ;-)  (Bug fixes, that's different.  :-( ))


If you play with scheduling and priorities you can get quite useful 
variations that avoid the, "Oh, no, it's full backup time, come back 
next week/month/year!" pain.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula client vs server version

2024-07-04 Thread Gary R. Schmidt

On 05/07/2024 03:53, Adam Weremczuk wrote:

I'm considering connecting:

bacula client 9.6.7-7 Debian:12.6/stable (the latest version for Debian 12)

to

bacula server 9.6.7-3 Debian:11.6/oldstable (the latest version for 
Debian 11)


 From what I understand, client version should always be <= server 
version but perhaps the above would be ok?



What version strings are in the actual binaries?

Usually the extra versioning is only applied to the packaging, so they 
might both report 9.6.7.


That said, without knowing exactly why they felt the need to patch 
9.6.7, who knows what they might have broken?


At best it's a suck-it-and-see, and worst it will fail immediately, but 
I'd keep a close eye on it for a few weeks.


But then I build from source on all my systems to avoid any problems 
like this.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Again LTO9 and performances...

2024-06-17 Thread Gary R. Schmidt

On 17/06/2024 17:45, Marco Gaiarin wrote:
[SNIP]
> > So, literaly, if one of the job fill the 'MaximumSpoolSize' buffer, 
*ALL*

job involved (in the same pool, i think) start to write down spool to tape.


MaximumSpoolSize is the total space used in the spool area, by all jobs.

Once that is hit, the spoofles are written to tape, during which active 
jobs have to wait because the spool is full.



But this does not interleave nothing! There's some way to have job 22200
spooling while job 22201 are despooling? What are the gain of having
synchronized despooling?
Sounds good, maybe you should write it, or fund someone to write it.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] LTO-8 tape report error

2024-06-13 Thread Gary R. Schmidt

On 13/06/2024 22:43, Adam Weremczuk wrote:
1. Are you suggesting running a round with a cleaning cartridge? The 
drive is not asking for it (by showing "C").


I've seen HP drives throw these errors which go away after a clean.  It 
may be an indicator that the drive is dying or the head has gone out of 
alignment.


Another cause I've heard of is a screwed SCSI terminator or cable.


2. I don't get what you mean. This is a new thread.

No, it's not.  From your initial post ("> " pre-pended to make sure 
nothing thinks it's a real header):

> References: 
>  
>  
>  
>  <00c41d8c-a902-4863-8a58-e487aa291...@mcleod-schmidt.id.au>
>  <62627549-4851-4f11-9c9c-c56b10f46...@xunil.at>

And please don't top-post.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Again LTO9 and performances...

2024-06-13 Thread Gary R. Schmidt

On 13/06/2024 20:12, Stefan G. Weichinger wrote:


interested as well, I need to speedup my weekly/monthly FULL runs 
(with LTO6, though: way slower anyway).


Shouldn't the file daemon do multiple jobs in parallel?

To tape you can only write ONE stream of data.

To the spooling disk there could be more than one stream.


Yes, that seems wrong:
$ grep Concurrent *.conf
bacula-dir.conf:  Maximum Concurrent Jobs = 50
bacula-dir.conf:  Maximum Concurrent Jobs = 50
bacula-fd.conf:  Maximum Concurrent Jobs = 50
bacula-sd.conf:  Maximum Concurrent Jobs = 50


Sorry, I still don't understand what to adjust ;-)

that interleaving to tape sounds dangerous to me.


That's how Bacula works - and has since day one.

We've been using it like that since 2009, starting with an LTO-4 
autoloader, currently using an LTO-6, and I'm about to start agitating 
to upgrade to LTO-9.


What I want to have: the fd(s) should be able to dump backups to the 
spooling directory WHILE in parallel the sd spools previous backup jobs 
from spooling directory to tape (assuming I have only one tape drive, 
which is the case)


Bacula does not work that way.  No doubt if you tried really hard with 
priority and concurrency and pools you could maybe make it work like 
that, but just RTFM and use it as designed.



-> parallelizing things more
It all seems quite parallel to me.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] LTO-8 tape report error

2024-06-13 Thread Gary R. Schmidt

On 13/06/2024 21:12, Adam Weremczuk wrote:
This was working until yesterday when I rebooted the Bacula/LTO server 
and now gives:


-

  sg_raw -o - -r 1024 -t 60 -v /dev/sg1 8c 00 00 00 00 00 00 00  00 00 
00 00 04 00 00 00

     cdb to send: [8c 00 00 00 00 00 00 00 00 00 00 00 04 00 00 00]
SCSI Status: Check Condition

Sense Information:
Fixed format, current; Sense key: Illegal Request
Additional sense: Invalid command operation code
  Raw sense data (in hex), sb_len=21, embedded_len=21
     70 00 05 00 00 00 00 0d  00 00 00 00 20 00 00 00
     00 00 00 00 00

Error 9 occurred, no data received
Illegal request, Invalid opcode

-

All scheduled backups were written last night and all other Bacula 
scripts executed fine.


Any idea what's going on?


1 - Clean your heads.

2 - Don't hijack threads, start a new one.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Again LTO9 and performances...

2024-06-11 Thread Gary R. Schmidt

On 11/06/2024 18:56, Stefan G. Weichinger wrote:

Am 06.06.24 um 15:57 schrieb Marco Gaiarin:

Mandi! Josh Fisher via Bacula-users
   In chel di` si favelave...


Not for a single job. When the storage daemon is writing a job's spooled
data to tape, the client must wait. However, if multiple jobs are
running in parallel, then the other jobs will continue to spool their
data while one job is despooling to tape.


I come back on this. I've setup on director's storage Autochanger{}
configuration:

Maximum Concurrent Jobs = 5

but i've set on storage configuration, in the Device{} stanza:

Maximum Concurrent Jobs = 1

as suggested for tapes; clearly i've only one device/tape. I've 
defined two

jobs, but the first run, the second:

is waiting on Storage "BPBKPLOMAutochanger"

And don't start to spool data, wait there indefinetively.


What i'm missing?! Thanks.


interested as well, I need to speedup my weekly/monthly FULL runs (with 
LTO6, though: way slower anyway).


Shouldn't the file daemon do multiple jobs in parallel?

To tape you can only write ONE stream of data.

To the spooling disk there could be more than one stream.


Yes, that seems wrong:
$ grep Concurrent *.conf
bacula-dir.conf:  Maximum Concurrent Jobs = 50
bacula-dir.conf:  Maximum Concurrent Jobs = 50
bacula-fd.conf:  Maximum Concurrent Jobs = 50
bacula-sd.conf:  Maximum Concurrent Jobs = 50

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup Error on Full Backups

2024-06-09 Thread Gary R. Schmidt

On 09/06/2024 16:08, Dr. Thorsten Brandau wrote:

Hi there
@bill arlofski I installed the latest version of the 
MTX-Changer-python-script and now it seems as I cannot do any backup 
anymore.



What happens when you use the original shell version of mtx-changer?

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] LTO tape performances, again...

2024-05-20 Thread Gary R. Schmidt

On 20/05/2024 21:35, Heitor Faria wrote:

Hello Marco,


 > i have:
 > Maximum blocksize = 512K

I usually don't like setting fixed block sizes, but letting Bacula 
determine. But Maximum Block Size = 1 MB or even a little bit more 
should be safe for LTO-9.


https://www.bacula.lat/otimizando-a-velocidade-de-fitas/ 



https://www.bareos.com/whitepapers/optimizing-the-tape-speed.pdf 



You can use the btape speed test to verify the best values.

The File Size also exerts a role in performance, a trade-off if I 
remember well between backup and restore speeds.


Hmm, I ended up with Maximum Block Size = 262144 for my LTO-6, which is 
FC, YMMV using another connect.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Again LTO9 and performances...

2024-05-20 Thread Gary R. Schmidt

On 20/05/2024 21:25, Heitor Faria wrote:

Hello Marco,

 > Anyway, i'm hit another trouble. Seems that creating the spool file 
took an

insane amount of time: source to backup are complex dirs, with millions of
files. Filesystem is ZFS.

Is the ZFS local? Does it have ZFS compression or dedup enabled? I 
wouldn't use those options for data spooling. You have to also consider 
the number of disks: 
https://arstechnica.com/gadgets/2020/05/zfs-versus-raid-eight-ironwolf-disks-two-filesystems-one-winner/ 


You can test Disks reading and writing capacity with hdparm, dd/iostat. 
https://www.bacula.lat/benchmarking-disks-reading-and-writing-capacity/?lang=en 


And network with iperf: 
https://www.bacula.lat/testing-bacula-machines-network-capacity-iperf/?lang=en 


I wouldn't also use Bacula compression software compression for tapes.

 > How can i do to improve the spooling performance? What factors impact 
more?


Probably better network and better/more disks, such as Enterprise Grade 
NVMe/SSDs.


And a sensible amount of RAM - millions of files on ZFS should not be a 
problem - unless you're doing it on a system with 32G of RAM or the like.


Oh, and is it Solaris, BSD, or Linux?

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Fix documentation on deduplication

2024-04-24 Thread Gary R. Schmidt

On 25/04/2024 00:47, Martin Simmons wrote:

On Wed, 24 Apr 2024 23:40:31 +1000, Gary R Schmidt said:


On 24/04/2024 22:33, Gary R. Schmidt wrote:

On 24/04/2024 21:30, Roberto Greiner wrote:


Em 24/04/2024 04:30, Radosław Korzeniewski escreveu:

Hello,

wt., 23 kwi 2024 o 13:33 Roberto Greiner 
napisał(a):


     Em 23/04/2024 04:34, Radosław Korzeniewski escreveu:

     Hello,

     śr., 17 kwi 2024 o 14:01 Roberto Greiner 
     napisał(a):


     The error is at the end of the page, where it says that you
     can see how
     much space is being used using 'df -h', but the problem is
     that df can't
     actually see the space gain from dedup, it shows how much
     would be used
     without dedup.


     This command (df -h) shows how much allocated and free space is
     available on the filesystem. So when you have a dedup ratio 20:1,
     and you wrote 20TB, then your df command shows 1TB allocated.


     But that is the exact problem I had. df did NOT show 1TB
     allocated. It indicated 20TB allocated (yes, in ZFS).

I have not used ZFS Dedup for a long time (I'm a ZFS user from the
first beta in Solaris), so I'm curious - if your zpool is 2TB in size
and you have a 20:1 dedup ratio with 20TB saved and 1TB allocated
then what df shows for you?
Something like this?
Size: 2TB
Used: 20TB
Avail: 1TB
Use%: 2000%


No, the values are quite different. I wrote 20tb to stay with the
example previously given. My actual numbers are:

df: 2,9TB used
zpool list: 862GB used, 3.4x dedup level.
Actual partition size: 7.2TB


You use zpool list to examine filespace.
Or zfs list.


On FreeBSD at least, zfs list will show the same as df (i.e. will include all
copies of the deduplicated data in the USED column).

I think the reason is that deduplication is done at the pool level, so there
is no single definition of which dataset owns each deduplicated block.  As a
result, the duplicates have to be counted multiple times.  This is different
from a cloned dataset, where the original dataset owns any blocks that are
shared.
That's correct, zfs list gives the logical filespace in use.  Sorry.


If you do "zfs get used,compressratio filesystem" then you can play with 
the values returned...


$ for i in `zfs list -r zpool | sed 1d | awk '{print $1}'`
do
zfs get used,compressratio $i | sed 1d
done
gives a list of very interesting numbers.  :-)

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Fix documentation on deduplication

2024-04-24 Thread Gary R. Schmidt

On 24/04/2024 22:33, Gary R. Schmidt wrote:

On 24/04/2024 21:30, Roberto Greiner wrote:


Em 24/04/2024 04:30, Radosław Korzeniewski escreveu:

Hello,

wt., 23 kwi 2024 o 13:33 Roberto Greiner  
napisał(a):



    Em 23/04/2024 04:34, Radosław Korzeniewski escreveu:

    Hello,

    śr., 17 kwi 2024 o 14:01 Roberto Greiner 
    napisał(a):


    The error is at the end of the page, where it says that you
    can see how
    much space is being used using 'df -h', but the problem is
    that df can't
    actually see the space gain from dedup, it shows how much
    would be used
    without dedup.


    This command (df -h) shows how much allocated and free space is
    available on the filesystem. So when you have a dedup ratio 20:1,
    and you wrote 20TB, then your df command shows 1TB allocated.


    But that is the exact problem I had. df did NOT show 1TB
    allocated. It indicated 20TB allocated (yes, in ZFS).

I have not used ZFS Dedup for a long time (I'm a ZFS user from the 
first beta in Solaris), so I'm curious - if your zpool is 2TB in size 
and you have a 20:1 dedup ratio with 20TB saved and 1TB allocated 
then what df shows for you?

Something like this?
Size: 2TB
Used: 20TB
Avail: 1TB
Use%: 2000%

No, the values are quite different. I wrote 20tb to stay with the 
example previously given. My actual numbers are:


df: 2,9TB used
zpool list: 862GB used, 3.4x dedup level.
Actual partition size: 7.2TB


You use zpool list to examine filespace.
Or zfs list.



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Fix documentation on deduplication

2024-04-24 Thread Gary R. Schmidt

On 24/04/2024 21:30, Roberto Greiner wrote:


Em 24/04/2024 04:30, Radosław Korzeniewski escreveu:

Hello,

wt., 23 kwi 2024 o 13:33 Roberto Greiner  napisał(a):


Em 23/04/2024 04:34, Radosław Korzeniewski escreveu:

Hello,

śr., 17 kwi 2024 o 14:01 Roberto Greiner 
napisał(a):


The error is at the end of the page, where it says that you
can see how
much space is being used using 'df -h', but the problem is
that df can't
actually see the space gain from dedup, it shows how much
would be used
without dedup.


This command (df -h) shows how much allocated and free space is
available on the filesystem. So when you have a dedup ratio 20:1,
and you wrote 20TB, then your df command shows 1TB allocated.


But that is the exact problem I had. df did NOT show 1TB
allocated. It indicated 20TB allocated (yes, in ZFS).

I have not used ZFS Dedup for a long time (I'm a ZFS user from the 
first beta in Solaris), so I'm curious - if your zpool is 2TB in size 
and you have a 20:1 dedup ratio with 20TB saved and 1TB allocated then 
what df shows for you?

Something like this?
Size: 2TB
Used: 20TB
Avail: 1TB
Use%: 2000%

No, the values are quite different. I wrote 20tb to stay with the 
example previously given. My actual numbers are:


df: 2,9TB used
zpool list: 862GB used, 3.4x dedup level.
Actual partition size: 7.2TB


You use zpool list to examine filespace.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] advice about tape drives

2024-04-22 Thread Gary R. Schmidt

On 23/04/2024 00:58, Alan Polinsky wrote:
I have used Bacula for many years, since version 5. In the past, I have 
mentioned my two Nas's along with various Windows and Linux machines get 
backed up on a nightly basis to tape. Currently that tape drive is an 
LTO3 based drive. Some of the older backups are on LTO2 tapes. My tape 
drive is starting to show its age, and within a period of time it will 
have to be replaced. (Since I am a retired programmer on a fixed income, 
cost, as always becomes an issue.) I need to understand the backward 
capabilities of more recent drives. How high could I go with LTO based 
machines while still maintaining the ability to read (and hopefully 
write) those old LTO2 tapes?



Thank you everyone for your help.



All anyone could ever want to know about LTO tapes: 
.


The rule of thumb is read two back, and write one, but that changed with 
LTO-8.  Sort of.  Sigh.  Read the wikipedia page.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Issue with size of the backup

2024-04-11 Thread Gary R. Schmidt

On 11/04/2024 22:00, Borut Rozman via Bacula-users wrote:

Hi there,

I was wondering if anyone noticed something like this in their
environment, I have a bacula director ver 11.0.6. (10.3.2022)
connecting to serveral clients with versions from 5 onwards. I have
this particular client which runs on debain 12. ver. 9.6.7(20dec20),
underlaying storage is ZFS.

The underlying storage is ~800gb in size. All of the sudden incremental
backups started to increase exponentially

1.4. - 93M
2.4. - 574.5M
3.4. - 115.5GB
4.4. - 951.3GB
5.4. - 1.7TB
6.4. - 2.5TB
7.4. - 3.4TB
8.4. - 4.1TB
9.4. - 4.7TB
10.4.- 5.4TB

so last backup says 5,471,496,436,363 (5.471 TB) written, and last 4
backups from this client with several others were written to this tape
which is LTO6 - so max 2.5TB should be written (6.25 compressed).

For some reason estimation of the size of the backup is way off and
data written on the tape as now that tape says it has 18T written -
Vol. bytes  18.3TB

which is absolutely wrong...

even if I move that data to some other folder on that server I get the
same result.

Any ideas?

Borut


Have you got Accurate set to Yes in JobDefs?

My ZFS systems are Solaris, so YMMV.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] moving from mysql (mariadb) to postgresql

2024-04-04 Thread Gary R. Schmidt

On 05/04/2024 07:32, Alan Polinsky wrote:
I am a retired programmer, with a small Lan at home; two Nas's, three 
Linux and one Windows client, and an old LTO3 tape drive. The smaller 
Nas gets backed up on a nightly basis, while the larger one, being used 
mostly as an archive, is backed up only as needed. I've been using 
bacula 9,6.7 with Mariadb as the database. Everything works perfectly. 
In order to push my learning, I'm thinking of migrating from Maria to 
Postgresql. My normal backup set has 31 tapes in the catalog; about an 
additional 15 are used for selected backups. Is there a relatively 
simple way to move from Maridb to Postgresql? I realize there may be a 
problem with the difference in column definition. Is there anything else 
I should consider?



Basically, set up the PostgreSQL database with the Bacula tables, 
mysqldump the existing data, and then write scripts to massage the SQL 
until the PostgreSQL system accepts it.


That's what I did, you can grab my scripts from 
 and try 
them, but I did it back in 2018, so they're out of date, and I have no 
recollection of what order I did things in!  ;-)


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using LTO drives with bacula

2024-03-19 Thread Gary R. Schmidt

On 20/03/2024 00:56, Anders Gustafsson wrote:

Hi!

We used to use tape a long time ago. Then it was CA Arcserve for Linux, ran 
fine, but CA dropped the product
so we switched to Bacula and backing up to disk. The recent surges in ransom 
attacks has made us think of
airgapping again and even a resonably small LTO drive would work for our 
immediate needs. So the plan is to
get one, plus a SAS card and install in a separate PC and run the storage agent 
on it. At this point I am just
fishing for advice and pointers. As I see it, the PC does not even need to be 
server class and the SAS card
can be a humble 4-port HBA (Adaptec HBA 1100-4i ). Does this sound like a 
reasonable plan? Anything to watch
out for?

Unless you are running a small and static data set, go for FC rather 
than SAS, and an autoloader rather than just a drive.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] HP Store Ever MSL 1/8 autocharger LTO-8

2024-03-03 Thread Gary R. Schmidt

On 04/03/2024 05:28, enrico.becche...@gmail.com wrote:
What do you think about MSL 2040 instead of MSL 1/8 ? Are there the same 
autochager

capabilities ?
 From Bacula point of view is the same device ?
Bye
Enrico

The differences are more slots and the ability to have two drives in the 
2040, apart from that they are the same.


The mtx tool will drive it just the same, configuring Bacula to use two 
drives is in the documentation, if you have the funds, I say do it.


Cheers,
GaryB-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] HP Store Ever MSL 1/8 autocharger LTO-8

2024-03-02 Thread Gary R. Schmidt

On 03/03/2024 03:50, enrico.becche...@gmail.com wrote:


Dear all, I need to build a backup system and I would like to use 
Bacula. My project involves an HP Store Ever MSL 1/8 library with an 
LTO-8 fiber channel drive. The Bacula server will be an HP Proliant 
DL380 Gen8 running Almalinux 8 or 9. My idea is to have automatic tape 
management with Bacula sending the tape change command when needed, and 
the library identifying the correct cartridge using the barcode. Do you 
think Bacula can handle all of this with the hardware I have specified?


Yes.  I have a previous version of that autoloader running an LTO06 tape 
drive.


I had to set the timeouts to 30 seconds in mtx-changer.conf, and changed 
the mtx-changer script thus:


===
wait_for_drive() {
  i=0
  while [ $i -le 300 ]; do  # Wait max 300 seconds
# grs, try once before checking...
mt -f $1 status > /dev/null 2>&1
if mt -f $1 status 2>&1 | grep "${ready}" >/dev/null 2>&1; then
  break
fi
debug $dbglvl "Device $1 - not ready, retrying..."
sleep 1
i=`expr $i + 1`
  done
}
===

And, in the "list)" command, I changed
===
##  cat ${TMPFILE} | grep " Storage Element [0-9]*:.*Full" | awk 
"{print \$3 \$4}" | sed "s/Full *\(:VolumeTag=\)*//"

## grs 20150529
cat ${TMPFILE} | grep " Storage Element [0-9].*:.*Full"| sed 
"s/.*Storage Element //" | sed "s? IMPORT/EXPORT??" | sed "s/Full 
:VolumeTag=//"

===
To recognise the mail slot correctly.

Be wary of line-wrapping in the above code.

I haven't updated for a while, newer versions of mtx-changer may not 
need these changes.


And the Python version may not either.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula-fd hangs during backup

2024-02-12 Thread Gary R. Schmidt

On 13/02/2024 11:08, Phil Stracchino wrote:

On 2/12/24 18:35, Peter Sjoberg wrote:

Hi all

I have a strange problem and (on my system) reproducible problem. When 
I do backup of some directories then bacula-fd just hangs and never 
complete.
The directories in question are not very strange and backup of them 
works find with older versions of -fd



Silly question:  Do the problem directories contain named pipes or sockets?

Another possibly silly question: Are there any soft links that may cause 
a loop?


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula: Backup OK -- with warnings - what warning?

2024-01-17 Thread Gary R. Schmidt

On 18/01/2024 01:54, Dan Langille wrote:

On Fri, Dec 29, 2023, at 6:26 PM, Martin Simmons wrote:

On Fri, 29 Dec 2023 12:35:59 -0500, Dan Langille said:


On Fri, Dec 29, 2023, at 12:10 PM, Martin Simmons wrote:

9.6.6 certainly displayed them for me, so I suspect a config issue.

The messages would be omitted if !notsaved is in the Messages resource (but
they would still be counted as "Non-fatal FD errors" which makes it add "with
warnings" to the status).

Maybe that changed in the client's bacula-fd.conf when you upgraded it?


That's a good idea.

[17:29 r730-01 dvl ~] % sudo ls -l /usr/local/etc/bacula/bacula-fd.conf
-rw-r-  1 root bacula 1497 Feb 25  2023 /usr/local/etc/bacula/bacula-fd.conf

[17:31 r730-01 dvl ~] % sudo md5 /usr/local/etc/bacula/bacula-fd.conf
MD5 (/usr/local/etc/bacula/bacula-fd.conf) = e41a7d835766f563253c0a93418a1c61


No change since February.

Let's look at snapshots taken before Dec 25, the date of the job in question.

[17:32 r730-01 dvl /.zfs/snapshot] % cd autosnap_2023-12-20_00:00:09_daily
[17:32 r730-01 dvl /.zfs/snapshot/autosnap_2023-12-20_00:00:09_daily] % sudo 
md5 usr/local/etc/bacula/bacula-fd.conf
MD5 (usr/local/etc/bacula/bacula-fd.conf) = e41a7d835766f563253c0a93418a1c61


I'm confident this file has not changed.


Hmm, looking at src/lib/message.h, I suspect this change broke version
compatibility in the message filtering infrastructure:

commit fd926fc4671b054234fd3d5957bc05d303d87763
Author: Eric Bollengier 
Date:   Fri Nov 6 21:27:05 2020 +0100

 Fix unexpected connection event sent by the FD when the Message
resource is not configured

The problem is that the message types have been renumbered by moving M_EVENTS
higher up, but messages sent to the Director from other daemons use the
numeric value of the type so this is an incompatible change in the wire
protocol.

Dispite the date of this change, it looks like it first appeared in Bacula 13,
so will cause problems if a Client < 13 sends a message to a Director >= 13 as
in your case.


That is concerning. It means backups may be incomplete and you don't know it.

This has happened at home, and today I noticed it at $WORK.

It is no longer the case that versions can follow the rule:

   bacula-dir=bacula-sd>bacula-fd

That rule has been in effect as long as I've been associated with the project 
(about 20 years). Is there any possibility of this being fixed? Or is this 
change irrevocable?

If irrevocable, the users really need to be notified via an announcement. 
Clients must be upgraded or the risk of data loss is present. In my case, 
things I expected to be backed up were not being backed up. I could not tell 
because the warnings were not presented to me.


If true, this is a major WTF and Not Upgrading level screw-up.

That ancient clients Just Worked has been one of the major strength of 
Bacula.


Sigh.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Restoring a file from an unknown backup

2023-12-14 Thread Gary R. Schmidt

On 14/12/2023 02:58, Borut Rozman wrote:

Hi,
I inherited a bacula backup solution, and now I got a request to
restore a file or set of files from backups. I only know a folder name,
and nothing else. Is there a way inside bconsole to search for a
specific string.

Query/option 20 does not give me any results.

Using bacula 11 with pgsql 14, any help appreciated.
B.


Fire up psql with the appropriate options (e.g. $ psql bacula bacula).

bacula=> select * from path where path like '%mypath%';

That will give you a pathid.

bacula=> select * from file where pathid = mypathid;

Now you've got a bunch of JobId's and FilenameId's to play with.

Keep going and you'll find the one(s) you want.

Cheers,
GaryB-)







___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] compression with lto?

2023-05-12 Thread Gary R. Schmidt

On 11/05/2023 13:49, Dr. Thorsten Brandau wrote:

Hi
I use an lto-9 drive for backup. I activated hardware compression on the tape 
(i think) but all the logs of bacula show a tape change at 18TB which should be 
the native (uncompressed) capacity. From experience I would expect a ratio of 
at last 1:1.2. Is there any way to make sure to use compression (or as last 
resort activate software compression)?


Are you using the actual compressed device in your bacula-sd.conf?

On Solaris I use /dev/rmt/0cbn to turn on compression.  (But I started 
out handling tape back when they were huge upright things, throwing 
pseudo-random characters into device names is reflex.  :-) )


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] client version newer than the server

2023-03-22 Thread Gary R. Schmidt

On 23/03/2023 03:35, Adam Weremczuk wrote:

Hi all,

I run server 9.6.7 on Debian 11 which appears to be working fine with a 
range of clients: 5.2.6, 9.4.2 and 9.6.7.


I'm wondering what typically happens when i.e. user decides to distro 
upgrade Ubuntu 20 to 22 and, as a result, the client upgrades to a 
version > 9.6.7?


Will it likely continue working without issues as long as the version 
gap is not too big?


Will I get a stern warning on the server if there is a problem?

Or could it fail silently only for a serious issue to be discovered on 
restore?



It is simple, DIR == SD >= FD.

That was pretty much set in stone when Bacula started out, Kern 
understood that backup and restore has to keep working, changes that 
interfere with that were not acceptable.


I have systems running 3.0.3 still happily talking to a 9.6.7 director.

And the people now managing Bacula development appear to be immune to 
the, "Oooh, shiny, we don't care if it breaks existing behaviour", 
effect that plagues FLOSS projects.


So yes, if you are using distribution-based Bacula for your clients you 
will get a failure when one breaks the rules.


This is why you should build from source.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup fails with Fatal error: catreq.c:736 attribute create error. ERR=

2023-02-19 Thread Gary R. Schmidt

On 20/02/2023 05:26, Nick Bright wrote:

As per subject line, one of my backup client devices is failing with

Fatal error: catreq.c:736 attribute create error. ERR=

While this host has a great deal of files, the inode usage on Bacula 
shows 1% for my backup data partition, with 8.5T of 16T consumed; 
there's plenty of free storage as well. In short, I don't think it's a 
capacity issue.


Any suggestions?


/tmp and /usr/tmp, how are they?

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Messages resources and spurious email...

2023-02-03 Thread Gary R. Schmidt

On 04/02/2023 02:04, Marco Gaiarin wrote:

Mandi! Ana Emília M. Arruda
   In chel di` si favelave...

[ Could you please stop putting me in TO/CC?! mailman is so dumb that don't
   send email if i'm on To:/CC:, and all my email archive goes bad. Thanks.  ]


It's not Mailman, it's you.

Login to the bacula mailman system, and change this:
"Avoid duplicate copies of messages?

When you are listed explicitly in the To: or Cc: headers of a list 
message, you can opt to not receive another copy from the mailing list. 
Select Yes to avoid receiving copies from the mailing list; select No to 
receive copies.


If the list has member personalized messages enabled, and you elect to 
receive copies, every copy will have a X-Mailman-Copy: yes header added 
to it."


to "No".

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] LTO8 tape jukebox fails where LTO5 worked fine

2023-01-19 Thread Gary R. Schmidt

On 20/01/2023 04:30, Lee Damon wrote:

We recently replaced a working LTO5 + Scalar i40 jukebox with an IBM
LTO8 tape + Scalar i3 jukebox. The controller and all software remained
the same. I am suspecting a configuration problem and would greatly
appreciate guidance.

When I tried to label the new tapes it loaded the first one fine, labled
it fine, then failed miserably to unload it. I tried adding the "Offline
On Unmount" command to the config (see below) but that didn't help.

I then tried running
  /usr/bin/sudo /sbin/btape -c /etc/bacula/bacula-sd.conf /dev/tape/0
which worked fine until it got to the 'test the autochanger' part of the 
test,
then failed just as miserably. The results are different (I/O errors) if 
the unmount

setting is there, but it fails either way.

I'll attach two script files that show various btape runs. Note that between
the tests I did the following reset:
    sudo mt -f /dev/tape/0 rewoffl
    sudo mtx -f /dev/changer/0 unload 1
    sudo mtx -f /dev/changer/0 load 1

Nothing interesting shows up in the system logs.

I would turn on debug in mtx-changer.conf - set debug_level=100 - and 
see what comes out.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup Catalog

2022-10-19 Thread Gary R. Schmidt

On 19/10/2022 21:07, Gina Costa wrote:

Hi.

I’m using bacula 11, that has a default job “Backup Catalog”  to make 
backup of Bacula Catalog (database).

When I run the job I get the following message:

shell command: run BeforeJob "/opt/bacula/scripts/make_catalog_backup.pl 
MyCatalog"
BeforeJob: sh: 1: cannot create /opt/bacula/working/bacula.sql: Permission 
denied


The directory /opt/bacula/scripts/ is configured with this privileges:

drwxrwxrwx 3 bacula www-data 4096 Oct 19 11:02 working

Anyone can help me


Note the subtle difference:
/opt/bacula/working
versus:
/opt/bacula/scripts

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Tape Library with Multiple LTO types

2022-10-03 Thread Gary R. Schmidt

On 04/10/2022 08:26, Andrew via Bacula-users wrote:
I am a bacula newb, but have it working with file backup storage. I 
recently acquired a tape library with a LTO-5 drive. Along with this 
came 10 brand new LTO-4 tapes. When I purchase more media, I would like 
to purchase LTO-5 since there is not much of a cost difference.


How do I setup bacula for the two different tape types? So far my 
google-fu has failed me. I have the Autochanger and Device setup, 
currently with Media Type = LTO4 and was able to run the btape tests 
successfully.



Just use it.

Don't set any maximum values related to the amount of data the tape can 
swallow, and you'll be fine.


The "Media Type" value is merely an identifier, it has no meaning, you 
could have used "LTOx" or "MyMagTape" or "SnotGoblin" and it would all work.


Just start using the LTO-4's and when the LTO-5's arrive, label them and 
away you go.


Cheers,
GaryB-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] ERR=Input/output error

2022-09-17 Thread Gary R. Schmidt

On 17/09/2022 13:56, Doug Eubanks via Bacula-users wrote:

This is getting weirder.  The mt eof, rewind and status commands work.  The tar 
command failed.

[SNIP]


root@dl160g11:/opt/bacula/etc# tar zcf /dev/nst0 /opt/bacula ; echo "Error code: 
$?"
tar: Removing leading `/' from member names
tar (child): /dev/nst0: Cannot write: Input/output error
tar (child): Error is not recoverable: exiting now
tar: /dev/nst0: Wrote only 4096 of 10240 bytes
tar: Child returned status 2
tar: Error is not recoverable: exiting now
Error code: 2

I'm wondering if I need to try something other than Ubuntu 22.04.


Have you checked the tape cartridge is writeable?

Have you checked the entire device chain is writeable?

Simpler test: dd if=/dev/urandom of=/dev/nst bs=1024 count=1024

And you shouldn't use the 'z' option to "tar" when testing, in this case 
it is harmless but it is a bad habit.


Cheers,
GaryB-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula on Nas

2022-07-05 Thread Gary R. Schmidt

On 06/07/2022 01:55, rkasmoll...@gmail.com wrote:

Dear Sir or Madam,

I am doing my thesis on open source projects and one of them I have 
chosen is Bacula.


My question regarding Bacula would be if it is possible to configure 
Bacula in NAS even with the community edition model.

If u have any articel about it, I will be happy to have it.

I would be glad to get an answer.
With kind regards
Redian kasmollari

It works fine on my NAS heads - but I use Solaris 11 for my NAS heads, 
which may not be what you think "NAS" means.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Compatibility between Dir/SD 9.4 and FD 5.X ...

2022-06-22 Thread Gary R. Schmidt

On 23/06/2022 02:39, Marco Gaiarin wrote:


I'm setting up a Bacula installation for a set of servers, using debian
buster package (9.4.2-2+deb10u1) for director and storage daemons.

All works as expected until we use file daemon versions 7+, but some very
old servers that have bacula 5.0 or 5.2 does not work.


Communication works as expected, backup start but stalls after some Kbytes,
for example:

  *status client=merlot-fd
  Connecting to Client merlot-fd at merlot.ps.lnf.it:9102
  
  merlot-fd Version: 5.2.6 (21 February 2012)  x86_64-pc-linux-gnu debian 7.0

  Daemon started 22-giu-22 15:53. Jobs: run=0 running=0.
   Heap: heap=724,992 smbytes=176,337 max_bytes=176,484 bufs=116 max_bufs=117
   Sizeof: boffset_t=8 size_t=8 debug=0 trace=0
  Running Jobs:
  JobId 56 Job Merlot.2022-06-22_15.56.40_19 is running.
  Full Backup Job started: 22-giu-22 15:56
  Files=3 Bytes=132,602 Bytes/sec=185 Errors=0
  Files Examined=3
  Processing file: /var/backups/aptitude.pkgstates.0
  SDReadSeqNo=5 fd=5
  Director connected at: 22-giu-22 16:08
  

I've checked communication between dir, sd and fd with wireshark, and i've
not found troubles (eg, no filtered packet, retransmission, ...) that feels
me of ''network troubles'' (my first think).


I've also tried to enable spooling (not needed: media are disks), and if i
enable spooling i can see fd send all the spool chunk to sd, then when the
sd start to write to media, backup stall and after some timeout stop.


It's feel to me as some 'metadata' trouble, for that i'm asking of
compatibility between these bacula versions.
But hint on how troubleshoot this carefully are welcomed!


Just some data points, probably not directly helpful...

I'm still running old FDs - 3.0.3 on some AIX boxes being the oldest - 
talking to a 9.4.2 DIR/SD on Solaris 11.3, and all is good.


One thing is I build all components - except for Windows - myself, I 
prefer things to be done my way.


And as I use tape, spooling is turned on.

But this:
"> sd start to write to media, backup stall and after some timeout stop."
makes me wonder...

How much RAM is on your server, and how are the disks you use for 
storage connected?


It could be something to do with disk activity blocking network traffic, 
which I have seen before (not related to Bacula) on VM systems where 
things are over-subscribed up the wazoo.

Or when the storage is a NAS on the same network as everything else.
Or just a cheap-shit HBA.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Getting a LTO8 drive work with Bacula.

2022-04-12 Thread Gary R. Schmidt

On 13/04/2022 09:46, Hector Barrera wrote:

Hello Gentlemen,

I wonder if any of you had a chance to make an IBM LTO8 Tape Drive work 
with Bacula 11.0.1


Previously we had an IBM LTO7 that worked great, but this new drive is 
not working as expected, the btape test function throws out an error.


I followed the Bacula chapter: "Testing Your Tape Drive With Bacula"

Here's some information about our setup:

*_Tape Drive:_*

[root@bacula02 tmp]# tapeinfo -f /dev/nst0



   ArchiveDevice = "/dev/tape/by-id/scsi-35000e111cc2d8001-nst"


You are referring to things using different names.

What happens if you change them to be consistent?

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Compiling v9.6.7 for Raspian 64 bit

2022-04-01 Thread Gary R. Schmidt

On 01/04/2022 21:13, Chris Wilkinson wrote:
I built this from source and found it would not run due to a permissions 
error with the daemons bacula-* and dbcheck. It seems the make builds 
them with permissions 750, root:root. I run the director as 
bacula:bacula, the fd as root:root and sd as bacula:tape. User bacula is 
a member of the sudo group. Changing the daemons and dbcheck to 755 
fixed this.


Does that suggest the make is in error or maybe my choices of what user 
to run the daemons as is incorrect?


NOTE: I've not built on Raspian, but it looks like you've missed the 
"--with-XXX-user=" options to configure.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Compiling v9.6.7 for Raspian 64 bit

2022-04-01 Thread Gary R. Schmidt

On 01/04/2022 21:13, Chris Wilkinson wrote:
I built this from source and found it would not run due to a permissions 
error with the daemons bacula-* and dbcheck. It seems the make builds 
them with permissions 750, root:root. I run the director as 
bacula:bacula, the fd as root:root and sd as bacula:tape. User bacula is 
a member of the sudo group. Changing the daemons and dbcheck to 755 
fixed this.


Does that suggest the make is in error or maybe my choices of what user 
to run the daemons as is incorrect?


NOTE: I've not built on Raspian, but it looks like you've missed the 
"--with-XXX-user=" options to configure.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Reusing schedule resource

2022-02-16 Thread Gary R. Schmidt

On 17/02/2022 00:18, Chris Wilkinson wrote:

I tried a schedule like so to test this out by deleting the Pool= part.

Schedule {
   Name = "archive"
#  Run = Pool="archive-full" Level="Full" 1st sun at 4:00
   Run = Level="Full" 1st sun at 4:00
   Run = Pool="archive-diff" Level="Differential" 2nd-5th sun at 4:00
   Run = Pool="archive-incr" Level="Incremental" mon-sat at 4:00
}

Look into using the "Priority" setting, my Incremental backups run at 
48, Differentials at 49, and Fulls at 50.  Catalog is at 91.


Oh, and set "Allow Mixed Priority" to Yes to allow lower priority 
(higher number) jobs to start and wait for the higher priority (lower 
number) jobs to finish.


My systems all do Incrementals Tuesday to Friday at 00:01, and different 
groups do either a Differential or Full on Saturday at 00:01 - alas some 
of the fulls now take more than the entire weekend, but we don't do much 
then.  :-)


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula for QNAP?

2022-01-04 Thread Gary R. Schmidt

On 05/01/2022 00:43, Dmitri Maziuk wrote:

On 1/3/2022 8:05 PM, Gary R. Schmidt wrote:

On 04/01/2022 05:47, David Brodbeck wrote:

...



I could see iSCSI maybe working better, but I haven't tried it.

iSCSI is not the same as NFS (or SMB), it shares a "raw device" which 
the mounting system then formats and uses, the device can't be shared 
on/from the iSCSI server.


I think he means if you use an iSCSI device for your storage you should 
avoid most of the shared-FS problems: it's not like you *need* your 
volumes shared to multiple servers.


But if your network is dodgy, then iSCSI may be just as dodgy as NFS. 
(iSCSI over FC, however, works very well.)



 > ...   (Well, it can be shared by simulating
 > sneaker-net, mount-fiddle about-umount-mount elsewhere-fiddle
 > about-umount-etc.)

In theory ZFS will let you make a mirror from a local drive and an iSCSI 
device, and then you could restart each half in "degraded" state...


Not theoretical - I have done exactly this when moving Solaris systems 
to new hardware, both SPARC[1] and x64.  Once you've done the hard yakka 
getting it to boot and run on the new box it Just Works(TM).


Cheers,
GaryB-)

1 - Okay, it didn't work well going from the old T-series to the new 
S-series, but that was a, "Will it work?", thing, not an, "It must 
work", thing.  The S2 is going to be a completely new system, someday, 
RSN, in the fullness of time...  ;-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula for QNAP?

2022-01-03 Thread Gary R. Schmidt

On 04/01/2022 05:47, David Brodbeck wrote:
[SNIP]


I found bacula-sd and NFS were not a very happy combination. It was very 
quick to react to network glitches by marking the entire volume as 
failed, then trying and failing several more volumes before things 
finally got moving again. I was constantly having to manually recycle 
failed volumes.


That can sometimes be fixed by setting the mount to be soft rather than 
hard, or vice-versa, but the Linux implementation of NFS leaves a lot to 
be desired, at both ends.  (Speaking as a person who was a tech lead at 
SGI's "File Serving Systems" and wrote many, many tests for NFS and 
really developed a distaste for the subtle gotchas in NFS.  If I ever 
hear someone defending the, "Oh, it can't fall back from v4 to v3 
because they're different protocols", again, I will strangle the 
.)


Or carefully sequentially re-booting all the systems, in the right 
order, so that the NFS state is nice and fresh before you start 
hammering it.  (And what about a circular mount state?  This server 
mounts that server mounts another server mounts this server.  Fun.  Not.)



I could see iSCSI maybe working better, but I haven't tried it.

iSCSI is not the same as NFS (or SMB), it shares a "raw device" which 
the mounting system then formats and uses, the device can't be shared 
on/from the iSCSI server.  (Well, it can be shared by simulating 
sneaker-net, mount-fiddle about-umount-mount elsewhere-fiddle 
about-umount-etc.)


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup Windows 10 and selective restore after changing to Linux Mint

2021-12-30 Thread Gary R. Schmidt

On 30/12/2021 23:13, Josip Deanovic wrote:

On 2021-12-30 12:59, Earl Harper wrote:

Backup Windows 10 and selective restore after changing to Linux Mint
Hello,
I want to backup my Windows 10 computer before I erase it and set up 
Linux

Mint on it.
Then I would like to be able to selectively restore files from the 
windows

10 backup to the new linux mint system.
I know that I could just copy some file over but, knowing my luck, I 
would

miss something important.

Will any of these programs allow me to do this?
I know that I would need a copy for windows to do the backup and a 
copy for

linux to restore any files. My fear is can the windows and linux programs
open the data for the other?



Hi Earl

If migration from Windows to Linux is the only reason for the backup
you plan to perform then I would say that Bacula is huge overkill
in this case. Especially if you don't have previous experience with
Bacula.

Linux has support for NTFS and FAT access (read/write) but to access
files on Linux file systems from Windows you would need to install
tools and drivers which would bring support for a specific Linux file
systems on Windows OS.

Also, when copying files between NTFS or FAT file systems to Linux
file systems, you will not get the exact mapping of the permissions
and you might lose some other file system specific metadata.

As Josip has stated, Bacula is massive overkill for what you are doing, 
and I suspect you may not really know what you are trying to do...


Linux is a different Operating System to Windows, the only files that 
can be shared between the two are (some) data files, and most of those 
will be somewhere under your C:\users\$ME directory.


You would be better served getting a large enough external USB disk and 
just replicating your Windows system onto that, using one of the many 
tools available for that task.


Or better still, and infinitely quicker, get a brand new drive, and an 
external case, pull the existing drive out and put it in the case, then 
put the new drive into the system and install Linux on that.  That way 
if you change your mind you can just swap things back.


Cheers,
GaryB-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] How are "new" files determined?

2021-12-30 Thread Gary R. Schmidt

On 30/12/2021 20:03, Sebastian Suchanek wrote:

Hi everyone!

How exactly are "new" files, which have to be backed up, determined by
Bacula?

The reason for asking: Recently, I migrated my main data to a new set of
hard drives. I did so by using "rsync -aH" which *should* leave all file
timestamps etc. untouched. After the migration was finished, also all
paths etc. were exactly the same as before, just with a new set of HDDs
"underneath". However, in the next scheduled Bacula run (which was
scheduled as Incremental), Bacula stared to backup *everything* of the
abovementioned data.
(I cancelled the job and will resume doing backups on this particular
fileset with next regular Full backup which is scheduled for the
upcoming Sunday anyway.)

So - what went wrong here and how could this have been avoided?

The inodes *all* changed, it is effectively a new file system, it will 
need to be fully backed up.


Cheers,
GaryB-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula-fd version

2021-12-28 Thread Gary R. Schmidt

On 29/12/2021 13:18, Richard Couture wrote:

The client bacula-fd is version 7.4.3 (18 June 2016)

and the director and storage daemons are
version 9.6.7 (10 December 2020)

Is that too great a version disparity?


No.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula-fd version

2021-12-28 Thread Gary R. Schmidt

On 29/12/2021 11:27, Phil Stracchino wrote:

On 12/28/21 18:22, Richard Couture wrote:

Does the bacula-fd client version have to be the same or newer than the
server version of bacula

or

does the server version of bacula have to be the same or newer than the
bacula-fd client version?

my server version is 9.6.7 and the bacula-fd client version on one of
the machines is much older


How much older is "much older"?

Bacula directors and storage daemons should always be the same version. 
  Clients (file daemons) can be older *within reason*, but you may run 
into problems if the client is *too* old.


I still have FD's running 5.0.2 with my DIR and SD at 9.4.2, "within 
reason" is a big space.  :-)


Why??  Old systems can't build new stuff without fiddling that might 
damage the development environment.  And yes, I really *am* required to 
maintain ancient versions.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Distributed Bacula daemons

2021-12-20 Thread Gary R. Schmidt

On 21/12/2021 13:52, Shaligram Bhagat, Yateen (Nokia - IN/Bangalore) wrote:

Hi all,

We need to host bacula-dir, bacula-sd and PostgreSQL on different 
servers, what is an efficient architecture amongst the two options given 
below:


 1. Hosting bacula-dir and PostgreSQL together on one host, bacula-sd on
another host
 2. Hosting bacula-dir on one host, bacula-sd and PostgreSQL together on
another host


Director and Storage Daemon on one system.
Database on another.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Query failed: ERROR: relation "filename" does not exist

2021-12-14 Thread Gary R. Schmidt

On 14/12/2021 21:59, Uwe Schuerkamp wrote:

Hi folks,

I think it's a problem with the query file. Something changed in 11.x
that broke the standard queries I've been using since 5.x or
thereabouts. Maybe you can check the mailing list archives for earlier
posts w/r to that issue, I seem to recall someone posted a patch.

The query.sql file got deprecated, and subsequently nulled (I think) a 
while ago.


What is in the current source archive?  That's canon, as opposed to 
anything else.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] META: Repeated posts

2021-11-30 Thread Gary R. Schmidt

Hi,

I don't know if this is down to Sourceforge or the OP, but every ten 
minutes my filters catch a duplicate delivery of Bill Arlofski's message 
with the Message ID: .


So either Bill's mail system has the hiccups, or Sourceforge has been 
into the cheap meth.


I can't see multiple copies in the archives, so I'd put my money on 
Sourceforge...


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Restore Session

2021-11-29 Thread Gary R. Schmidt

On 30/11/2021 15:13, Bill Arlofski via Bacula-users wrote:

On 11/29/21 12:07, Neil Balchin wrote:

Recently, I had to reconfigure a large ZFS disk array.  Prior to the 
reconfiguration, It was shared to my bacula-fd instance  across NFS and I was 
doing daily incrementals, the pool was configured with a scratch pool of blank 
tapes and I kept the backups without any pruning or recycling, veal more of an 
archive than a backup.

After reconfiguring the disk system I ran a restore job and all my files went 
back into place with permissions perfectly in tact.

3 days later the scheduled backup job started running and instead of 
recognizing the existing files it ran the backup like a Full, never been backed 
up before job.

I have to do this 4 more times on different disk arrays,  how can I avoid 
re-backing up all the files I’ve just restored ?


Neil B


Hello Neil,

First, before running a new job after the restore, or when editing a Fileset, I 
recommend always using the bconsole commands:

* @tall /tmp/file_list.txt  (opens a log of bconsole i/o)

Note: If @tall does not work, use the older @tee command)

* estimate listing job=xxx level=incremental  (or differential if that is what 
you need)

* @tall (with no filename closes the log and stops logging bconsole i/o)

Then open that file in your favorite editor (vim of course :) and have a look.

This is so that you can see what Bacula thinks it needs to backup. This can 
save you a lot of time (and media if writing to
tapes)


Next, what you have described "should not happen"™  :)

If possible, I would check to make sure that attributes (ownership, 
permissions, etc) of the restored files match what was
backed up.  The linux 'stat' command is great for this.   IF you can run this 
on some files after they are backed up and
before the array is re-built you might be able to identify what is is happening.

Then, you can add the 'Accurate = yes" to your backup job, and the "Accurate = 
" setting in your FileSet's Options{}
block to tell Bacula what attributes to compare when deciding if a file needs 
to be backed up.

See the "accurate=" section in the "FileSet Resource" section of the 
Main Manual for full information on this option.

We have seen cases where a customer had a script that ran each Saturday which 
(much to their surprise) 'touched' every file
in a directory tree, so the next day's Incremental backed up every file as if 
it were a full backup because the modification
or change time (I forget which it was) had changed, and it was one of the 
default things Bacula looks at when determining if
a file needs to be backed up.

I think, by default (if not specified), the default options are 'pcms' - I can 
never remember this for sure though. :)

Also, be aware that you have created a completely new file system, all 
the inodes will be different, and the access/modify/change/birth times 
on all the directories will be set to when the new directory was created 
- i.e. when it started to be populated by the restore.


And everything will have different dev and rdev values.

Since it's a new file system, it all gets backed up anew.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Tape changers for bacula

2021-11-25 Thread Gary R. Schmidt

On 26/11/2021 01:10, Tomasz Świderski wrote:
Do you have any proven tape changers working with Bacula? I am talking 
about models that are available on the market.


I use the HP stuff, just a preference, no real reason, if I was grabbing 
one today it's be an MSL 1/8 G2 with the latest/largest LTO I can get.


Oh, and I use FibreConnect for them, I find it less problematic than SCSI.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] back up RHEL 8 server from Centos 7

2021-10-28 Thread Gary R. Schmidt

n 29/10/2021 01:54, Clouse, Raymond [JT4 LLC] wrote:

After much trial and tribulation I've finally got Bacula working with our tape 
autochanger and backing itself up and another remote server on our air gapped development 
network.  Problem is, our autochanger is not compatible with RHEL 8 yet so we had to use 
Centos 7.  And while we can back up other Centos 7 servers, we get a "key not 
authorized" error when trying to back up a RHEL 8 server.

I've tried installing the version of bacula-fd from Centos 7 on a RHEL 8 server 
but I get tons of dependency issues so we're not doing that.

Anyone out there solved this?
--


Build it from source, that avoids all of those tiresome problems.


    Cheers,

        Gary    B-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Issue with tape library setup (btape fill command)

2021-10-25 Thread Gary R. Schmidt

On 25/10/2021 23:57, jean-baptiste.gualtiero...@auxenion-research.com wrote:


Dear Bacula Community Users,

We have run into a problem when setting up our tape library and were 
hoping one of you might be able to advise us.


We were following the 11.0.x community documentation “Testing Your 
Tape Drive With Bacula” and ran into issues during step 6, the btape 
fill command.


Indeed, during our three attempts (on two different tapes) when btape 
had written about 1.8-2 Tb of data to a tape it encountered a write 
error and failed.


The cleaning light on our autoloader lit up after each of these errors 
and the system required cleaning before further use.


As the btape test command passed we believe our bacula_sd.conf is set 
up properly.


Have any of you encountered a similar problem before?

Did we receive a faulty drive or were unlucky and received two faulty 
tapes?


Or are we wrong and our configuration might the source of this issue?

Thanks in advance and best regards to all.

Jean-Baptiste

Here are the setup details and error messages we got.

Bacula: v11.0.5-1

Autoloader: HPE MSL 1/8 G2 0-drive Tape Autoloader(firmware version 
5.5/2.6n)


Drive: HPE StoreEver MSL LTO-8 Ultrium 30750 SA(Ultrium 8-SCSi, 
firmware revision M571)


tapes:HPE LTO-8 ULTRIUM 30TB RW



I had a similar problem long ago when using a SCSI-connected HP 
auto-loader, every now and then a tape would error, and it would ask to 
be cleaned.



We replaced the SCSI version with a Fibre-Channel version, and have had 
no problems since.



    Cheers,

        Gary    B-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula change expire date volume?

2021-10-22 Thread Gary R. Schmidt


On 22/10/2021 17:29, Agiofws Holylight wrote:


I have a specific problemI have testedan incremental jobsomany times 
that my volumes have been usedand I don't have spare volumes that have 
expired sothe jobs that are scheduled for an incremental backup do not 
take place they have not have expired. Is there a way to change the 
expire date of the volumes? This also happened becausethe amount of 
data that was getting backed upincreased, so the job used two or three 
or four volumes to get all the data on to themsoI ran out of out of 
volumes and then i added now ones manually  probablyso my question is 
that can I change the expired date ofthe volumes safelyor how would 
you goabout this to solve it?

tps://lists.sourceforge.net/lists/listinfo/bacula-users



You could "purge" old volumes, that wipes them out, and loses all data 
in them.



And please post in ASCII.


    Cheers,

        Gary    B-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] - RunScript failed

2021-09-09 Thread Gary R. Schmidt

On 10/09/2021 06:28, Fábio Santos wrote:
Hello, I can't run the command below on the client that displays the 
error below, I believe the problem is in the PGPASSWORD variable, but 
I haven't identified the correct way.


Client OS: CentOS Linux release 7.7

Director-IP12-dir JobId 11943: Fatal error: Client "client01-fd" 
RunScript failed.
Director-IP12-dir JobId 11943: Fatal error: Bad response to 
RunBeforeNow command: wanted 2000 OK RunBeforeNow, got 2905 Bad 
RunBeforeNow command.
client01-fd JobId 11943: Error: Runscript: ClientBeforeJob returned 
non-zero status=208. ERR=No such file or directory
client01-fd JobId 11943: shell command: run ClientBeforeJob 
"PGPASSWORD="postgres2021" pg_dump -h 192.168.10.13 -p 5432 -U 
postgres -d postgres -f /tmp/postgres.sql"

Director-IP12-dir JobId 11943: Using Device "FileChgr1-Dev1" to write.


Runscript {
    Command = "PGPASSWORD=\"postgres202\" pg_dump -h 192.168.10.13 -p 
5432 -U postgres -d postgres -f /tmp/postgres.sql"

    RunsWhen = "Before"
  }


The command does not get started in a shell.


You need to put it into a shell script, then use something like, 
"Command="/bin/sh /path/to/my_script.sh", to run it.



    Cheers,

        Gary    B-)




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem disable all schedules but jobs starts

2021-07-18 Thread Gary R. Schmidt

On 16/07/2021 21:36, Pierre Bernhardt wrote:

Hello,

I have bacula on debian buster. The configured jobs will start at the estimate 
times althoug
the schedules are manually disabled and in bconsole status dir shown no 
scheduled jobs.

Only if I disable manually the jobs one by one they will not start.

I don't know why they start after schedules has been disabled.

Is this a normal behavior?

A cause of this is changing the bacula-dir.conf file and not using the 
"reload" command to tell the director about it.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Which OS is best for bacula ?

2021-07-11 Thread Gary R. Schmidt

On 12/07/2021 07:10, Josip Deanovic wrote:
[SNIP complete and utter drivel.]

This is the sort of misinformation that Microsoft has been derided for 
over the decades, as an administrator /and/ developer for nearly forty 
years I find it bizarre that someone could state such things.


I will single out three:

   - "Developers usually don't have to bother with the software 
deployment and the service maintenance."


Regardless of which hat I am wearing, whether as a developer, sysadmin, 
or QA lead[1], maintaining the code I have been involved in has been my, 
and the other members of my team's, job.  There may be first- and 
second-level support teams that filter out PEBKAC items, but the buck 
stops with me and the other developers.
One of my ongoing tasks in my current role is developing and maintaining 
installation programs.


   - "Using /opt is usually a sign of a bad support (e.g. packaging and 
testing) for a specific system."


As a sysadmin, when I go looking for what-the-hell-is-happening I find 
it far easier when I can drop into /opt/XYZ and start looking, rather 
than having to guess whether things are under /etc or /var.  (And don't 
get me started on fools creating directories under /mnt.)


   - "Another problem is that it is most likely that libraries shipped 
with a third-party software will receive their security and bugfix 
updates far too slow"


Some of my customer's customers are in the, "We really, /really/, need 
security", bucket.  It may be security theatre, but it's what they want, 
 we usually ship updated OpenSSL libraries within two days of 
notification, and they are deployed within a week.  And the end customer 
doesn't have to open their firewall, or risk taking an update to 
something they don't want to change.  And if you don't think an unwanted 
update can be a problem, you're a fool to yourself and a burden to others.


So, as someone who remembers reading those initial posts in 
comp.os.minix and thinking, "The lucky bastard's got a '386!", it 
saddens me that so many useful practices got thrown out with the bath 
water, and replaced with less simple solutions.


Cheers,
GaryB-)

1 - I have done/do all three, usually in some combination or 
permutation.  :-)
As a sysadmin, maintaining any scripts or programs I have written is my 
job, whether they are written in sh, csh(!!), DCL, BLISS, C, Python, or 
whatever.  As QA lead I've written many tools, to make life easier for 
the minions, and generate pretty reports for the PHBs, which means 
everybody is happy!



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Which OS is best for bacula ?

2021-07-10 Thread Gary R. Schmidt

On 10/07/2021 23:12, Jose Alberto wrote:

This brings us to other discussions haha.

Installation preference?

What's to discuss??  Binaries, scripts, configuration and so on go under 
/opt/bacula, messages get logged to syslogd, and if the package spits 
mail, have it spit mail somewhere sensible.



Compiled or official binaries?

After the debacle with OpenSSL - Oh, look, it was Debian who did it - I 
find it very hard to trust any of the Linux distros, too many of the 
people involved are so very, very, very smart that they refuse to listen 
to anybody who has experience in the field.


So build anything critical from source.

I'm not quite at the NSA level of, "Delete everything on the supplied 
disk(s), compile everything from inspected source, including the kernel, 
on a known, safe system", but I'm about one more screw-up or 
Poetterer(sp?) away from it.  (And in another decade I may have enough 
super to be able to recover, and then it's SEP.  (Of course, I may take 
permanent recovery before then, which means it concerns me even less.))


Fortunately, as a known BOFH, (people used to ask me if my name was 
Simon, or why don't I have a Kiwi accent), I get to specify how our 
systems are configured, and since we use different UNIX and Linux 
systems, as well as Windows, having everything in the same place on a 
system running XYZ Linux as it does on an AIX system makes life much easier.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula first install on WinServer ; Director params

2021-07-07 Thread Gary R. Schmidt

On 07/07/2021 14:09, Marc Ferrand wrote:
Hello, I'm a noob and just installed bacula on WinServer 2012 R2 from 
binary, during install, it asks for Director parameters: name, address 
(and passwd). What should I fill in, please?


The address and details for your Bacula Director - which will be on a 
UNIX or Linux system, usually where your Bacula Storage Daemon runs as 
well, to manage your tape drive or other storage.


There hasn't been a Windows Director or Storage Daemon for a long, long 
time.


Cheers,
GaryB-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Which OS is best for bacula ?

2021-07-06 Thread Gary R. Schmidt

On 07/07/2021 15:18, Marc Ferrand wrote:

If you had a choice, on which system would you install bacula and why ?
These are OSes I'm familiar with in order or preference :
lint Mint (20, fork of Ubuntu/Debian), CentOS 7 (free version of RHEL), 
Windows 10 (Desktop), DragonFly BSD (fork of freeBSD), Windows Server 
2012 R2.

Any advice or suggestion is welcome, thanks in advance, Marc.


Well, Solaris 11.4, but I am an ancient BOFH and know my Operating Systems.

What ever you go with, go with a recent version - Centos 7 is out of 
support, so you should get Centos 8.x, frex.  (But Centos is going to be 
problematic soon, as well.  Sigh.)


And Windows is only available as a File Daemon, that means it's a 
machine to be backed up, not one that manages scheduling or storage, (as 
in runs the Director or Storage Daemon).


Oh, and I would also advise building from source, because that way you 
get the right thing, not, as is sometimes the case, what someone who is 
convinced they are much cleverer than everybody else has decided on.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula version compatibility matrix

2021-06-09 Thread Gary R. Schmidt

On 09/06/2021 21:06, armin.v...@mmlab.de wrote:

Hi!

Is there a compatibility matrix for bacula? I must migrate CentOS 7 
instances to CentOS 8. This includes bacula client version change from 
5.2.13 to 9.0.6. The backup director is also 5.2.13, running on CentOS 7.


I know that bacula client 9.0.6 won't work with director 5.2.13. the 
question is: Will bacula director 9.0.6 work with the currently deployed 
bacula clients 5.2.13?


Does anybody have an answer or is there an interoperability matrix 
regarding different bacula versions?


Thanks a lot!


'Tis quite simple:

Director == Storage Daemon >= File Daemon

Cheers,
GaryB-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Copy job stops me from conecting to bconsole

2021-05-29 Thread Gary R. Schmidt

On 30/05/2021 13:44, Bill Arlofski via Bacula-users wrote:

‐‐‐ Original Message ‐‐‐
On Friday, May 28, 2021 2:09 AM, Diogo Neves  wrote:

I Have raised and commented the maximum concurrent jobs in the copy 
job resource and I still couldn't connect to bconsole.


Hello Diogo,
You need to make sure the MaximumConcurrentJobs is also set in the 
"Director{}" section of the bacuila-dir.conf file.


Additionally, each of the other daemons (FD and SD) have this setting. 
If not specified, then it is "1", and I am pretty sure most recent 
versions of Bacula community ship configurations with this set to "20" 
for each of the daemons.


So, keep in mind that if you have an SD where 20 copy jobs were 
triggered, and the MaximumConcurrentJobs is set to 20, then you will not 
even be able to get a "status storage"  output from this SD because the 
connection from the Director to make this request counts a s a job, and 
there are 20 slots already used.


There are quite a few places where MaximumConcurrentJobs can be set 
(Client, SD, DIR, Job, Storage/Autochanger in the Director, each Device 
in an SD)  and keep in mind that if it is not set, the default is always 1.


A "status director" can help you to determine where the bottleneck is 
when jobs are sitting when you think they should be running. For 
example, you might see:

- waiting on maximum Job Jobs
- waiting on maximum Client Jobs
- waiting on maximum Storage Jobs
...and so on to give you a hint as to what is holding up a job.

And as you can't connect you will need to restart the Bacula ecosystem 
where the director is running after making these changes.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] How to install storage daemon only from source

2021-05-26 Thread Gary R. Schmidt

On 27/05/2021 06:18, Denis Morejón wrote:
I want to install bacula 11 from source code in one or two storage 
daemon servers, without the director. The director will be installed on 
another server.
When I try ./configure there are just two options: Either 
--with-postgresql or client only. But It seems to be no other options.



Hmm, where did you get your source from?

"./configure --help" should give you a large number of options, like so 
(this is in the source tree extracted from "bacula-11.0.3.tar.gz"):

==
`configure' configures bacula 11.0.0 to adapt to many kinds of systems.

Usage: ./configure [OPTION]... [VAR=VALUE]...

To assign environment variables (e.g., CC, CFLAGS...), specify them as
VAR=VALUE.  See below for descriptions of some of the useful variables.

Defaults for the options are specified in brackets.

Configuration:
  -h, --help  display this help and exit
  --help=shortdisplay options specific to this package
  --help=recursivedisplay the short help of all the included 
packages

  -V, --version   display version information and exit
  -q, --quiet, --silent   do not print `checking ...' messages
  --cache-file=FILE   cache test results in FILE [disabled]
  -C, --config-cache  alias for `--cache-file=config.cache'
  -n, --no-create do not create output files
  --srcdir=DIRfind the sources in DIR [configure dir or `..']

Installation directories:
  --prefix=PREFIX install architecture-independent files in PREFIX
  [/usr/local]
  --exec-prefix=EPREFIX   install architecture-dependent files in EPREFIX
  [PREFIX]

By default, `make install' will install all the files in
`/usr/local/bin', `/usr/local/lib' etc.  You can specify
an installation prefix other than `/usr/local' using `--prefix',
for instance `--prefix=$HOME'.

For better control, use the options below.

Fine tuning of the installation directories:
  --bindir=DIRuser executables [EPREFIX/bin]
  --sbindir=DIR   system admin executables [EPREFIX/sbin]
  --libexecdir=DIRprogram executables [EPREFIX/libexec]
  --sysconfdir=DIRread-only single-machine data [PREFIX/etc]
  --sharedstatedir=DIRmodifiable architecture-independent data 
[PREFIX/com]

  --localstatedir=DIR modifiable single-machine data [PREFIX/var]
  --libdir=DIRobject code libraries [EPREFIX/lib]
  --includedir=DIRC header files [PREFIX/include]
  --oldincludedir=DIR C header files for non-gcc [/usr/include]
  --datarootdir=DIR   read-only arch.-independent data root 
[PREFIX/share]
  --datadir=DIR   read-only architecture-independent data 
[DATAROOTDIR]

  --infodir=DIR   info documentation [DATAROOTDIR/info]
  --localedir=DIR locale-dependent data [DATAROOTDIR/locale]
  --mandir=DIRman documentation [DATAROOTDIR/man]
  --docdir=DIRdocumentation root [DATAROOTDIR/doc/bacula]
  --htmldir=DIR   html documentation [DOCDIR]
  --dvidir=DIRdvi documentation [DOCDIR]
  --pdfdir=DIRpdf documentation [DOCDIR]
  --psdir=DIR ps documentation [DOCDIR]

X features:
  --x-includes=DIRX include files are in DIR
  --x-libraries=DIR   X library files are in DIR

System types:
  --build=BUILD configure for building on BUILD [guessed]
  --host=HOST   cross-compile to build programs to run on HOST [BUILD]

Optional Features:
  --disable-option-checking  ignore unrecognized --enable/--with options
  --disable-FEATURE   do not include FEATURE (same as 
--enable-FEATURE=no)

  --enable-FEATURE[=ARG]  include FEATURE [ARG=yes]
  --enable-libtoolenable building using GNU libtool [default=yes]
  --enable-shared[=PKGS]  build shared libraries [default=yes]
  --enable-static[=PKGS]  build static libraries [default=no]
  --enable-fast-install[=PKGS]
  optimize for fast installation [default=yes]
  --disable-libtool-lock  avoid locking (might break parallel builds)
  --enable-includes   enable installing of include files [default=no]
  --disable-nls   do not use Native Language Support
  --disable-rpath do not hardcode runtime library paths
  --enable-batenable build of bat Qt4/5 GUI [default=no]
  --enable-smartalloc enable smartalloc debugging support [default=no]
  --enable-lockmgrenable lock manager support [default=no]
  --enable-static-tools   enable static tape tools [default=no]
  --enable-static-fd  enable static File daemon [default=no]
  --enable-static-sd  enable static Storage daemon [default=no]
  --enable-static-dir enable static Director [default=no]
  --enable-static-consenable static Console [default=no]
  --enable-client-onlybuild client (File daemon) only [default=no]
  --enable-build-dird enable building of dird (Director) [d

Re: [Bacula-users] FD more detailed statistics

2021-05-18 Thread Gary R. Schmidt

On 19/05/2021 14:48, fk+bacula--- via Bacula-users wrote:

Hi there,

I do running a daily incremental backup with a file set of multiple 
directories.
The daily incremental backup time fluctuates between 4 and 16 hours, 
where are 3 between 10 GB of data collected.


For optimizing the process it would be nice to find out, how many time 
the FD has taken for each directory and how many files and size are send 
to the SD.


An useful hints to get monitored this?

Thanks for any help, Frank


Fiddling with the code in the file daemon for this probably won't happen 
unless there's a massive outcry for it, but you can get the list of 
files by running the equivalent file search on the system at the same time.


Something like "find / -mtime -1 -o -ctime -1" would be a starting point.

Asking the people who are generating the data, "Why is it so?", might 
also be helpful.


Cheers,
GaryB-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Issue of Bacula!

2021-04-25 Thread Gary R. Schmidt

On 23/04/2021 20:42, Redjon Pjetri via Bacula-users wrote:

Hello,

i'am trying to install bacula client on the macOS. I have installed 
bacula-fd(11.0.2) while in bacula.dir i have the version( 9.4.2). After 
the necessary configurations I do not connect bacula dir with bacula client.



The rules is DIR == SD >= FD.

Your setup won't work, use a 9.4.x client, or update your director and 
storage daemon.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] backup volumes in read able folder (posix) browse backups without any extra tools

2021-03-01 Thread Gary R. Schmidt

On 01/03/2021 21:57, Zeeshan Ali Shah wrote:

Thanks Radosław,

what i mean is to use simple tar or zip or even ( ls volume)to list all 
the backup directories/files simply .


Short answer - that would require a fairly substantial re-write of the 
Bacula storage daemon, for no real advantage, and several real 
disadvantages.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [Bacula-devel] Release 11.0.1

2021-02-08 Thread Gary R. Schmidt

On 07/02/2021 04:17, Eric Bollengier via Bacula-devel wrote:

Hello,

We are pleased to announce the release of Bacula version 11.0.1. This is
a minor release of the new stable version.


[SNIP]

11.0.1 is a minor bug fix release.

  - Add PGSQL detection for macOS and MacPorts.
  - BEE Backport bacula/src/tools/dbcheck.c
  - Fix #7079 About a segfault in a copyjob when the fileset is no longer
defined
  - Fix #7168 About incorrect start time displayed for canceled jobs not yet
   running
  - Fix #7207 About 'dbcheck -n' not working properly
  - Fix #7214 Adapt mtx-changer.conf for GNU cpio mt version
  - Fix #7247 About incorrect variable substitution with the query command
  - Fix MySQL update procedure with incorrect handling of the FileIndex type
  - Fix compilation warnings with Solaris Studio
  - Fix copy/migration job selection
  - Fix org#2579 About incorrect JSON generated from empty Messages resource
  - Fix org#2587 Improve btraceback output
  - Fix org#2588 About incorrect Object/ObjectId type in
update_postgresql_tables
  - Fix update_sqlite3_tables to upgrade from 9.6 to 11.0
  - Initialize StartTime in db_create_job_record()
  - Remove deprecated sbrk in macOS and Windows.
  - Use PKG_PROG_PKG_CONFIG macro to search for pkg-config. It is
cross-compile
   safe.
  - alist: Fix for memory overflow access.

I can't see the fix for the short strcpy() problem that vexed Phil, and 
has kept me from updating for a few versions.


Has that mistake been totally rolled back, only partially applied, or 
forgotten?


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] sqlite to postgres|maridb migration -- how to confirm success?

2021-01-15 Thread Gary R. Schmidt

On 16/01/2021 07:16, Ken Johnson wrote:

Thanks for the helpful advice.  It sounds like an issue with timestamp 
translation, though I am far from a database expert.

I am working on the same approach, pgloader to postgresql.  I do not do 
incrementals, so that particular issue will not be a problem here.  Of course, 
full backups five times/week probably contributes to the 5GB size of the 
database, which adds challenges of its own.

If my energy holds up and my to-do list is not too long, I hope to post a 
summary here when complete.


I'd say that 5GB isn't much.

When I moved from MySQL to PostgreSQL I had to massage ~45Gb of data, I 
never looked at how long it took, it was just fire it off and check for 
it being finished, as I wasn't going to start using the new database 
until I was sure that it was complete.


It took about a week of running the various scripts I came up with to 
get a final set, I then ran them in the morning, changed Bacula to see 
the new server in the arvo, and it all worked.


Mild disclaimer: I've written databases - in the sense of the underlying 
code that stores and fetches the various values - for a living.  Writing 
chains of shell and perl and whatever scripts to move data from here to 
there is almost organic these days!


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] sqlite to postgres|maridb migration -- how to confirm success?

2020-12-22 Thread Gary R. Schmidt

On 23/12/2020 11:03, Ken Johnson wrote:

Hello,

I am facing the sqlite to postgres or mariadb (mysql) migration of the
Bacula database.  The current db file is about 5GB, after a vacuum.  Right
now I think I will choose the one with the best migration tools I can get
for it.  Otherwise, I do not know of a reason to care.  I have done more
admin on mariadb, I have done more coding (not that much) using postgres.
On the server in question; both postgres and mariadb are already installed.

I am aware of the two scripts from 2006 in examples/database/ in the source
distribution.

I have just under 50 media in the database, with 10 stored offsite; bscan is
not a usable option for me.


Here is my question:  when I think the conversion is complete, what is the
best reasonable method to confirm the success of the conversion?


I would suggest moving to PostgreSQL rather than MariaDB.

PostgreSQL is fully supported by Bacula, MariaDB has thrown up a few 
nasties where is is not quite the same as MySQL, and those will probably 
increase.


Also, SQLite3 takes it cues from PostgreSQL, there may be less massaging 
of data needed to get it right.


I moved from MySQL to PostgreSQL a few years ago, after looking at the 
various scripts out there I decided I would just do it my way.


First, I set up an empty schema on PostgreSQL using the Bacula 
installation script "create_postgresql_database".


Then I took a dump of the Bacula data and wrote a script to remove the 
various "CREATE" statements from it.


I then fed that to psql, looked at the errors, and wrote sed, shell, and 
SQL scripts to munge things until it was swallowed without any errors.


It took a few iterations to get it right - it was a background task, no 
rush to move - but once it worked, I dropped and re-created the 
PostgreSQL database, took a new dump, fed it in, pointed Bacula at 
PostgreSQL, ran a few commands that use the database - list media, 
status dir, update volume, frex - manually ran a backup and a restore, 
then let Bacula just do its thing.


It's worked fine ever since.  :-)

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] How to get started as a new user?

2020-12-12 Thread Gary R. Schmidt

On 13/12/2020 02:55, Eric H. Bowen via Bacula-users wrote:

I'm currently managing three "networks"...although all are small. One is
my home office and video business, with everything from Windows 10 to XP
to Linux and a couple of Raspberry Pis thrown in. I also (as a
volunteer) manage my church's computers and network, as well as the
machines for my somewhat technically challenged parents ('somewhat', my
Dad helped put men on the moon...Windows throws him, but give him a
keypunch machine and a PDP-8 and stand back!).

I'm currently using a hodgepodge of Acronis and DejaDup backup versions,
plus Aomei at the church (which is too cheap to pay for anything).
They're being backed up to NAS machines locally on each network. I'd
like to have a single, unified backup solution, and I prefer open source
software when possible. I've been subscribed to the Bacula-users group
for a while, but if there has been any information or tutorials for new
users referred to I've missed them.

Would someone be willing to point me in the right direction?Eric.


First off - read the documentation.

All of it.  Twice.  And again, for good luck.  :-)

Like most FLOSS they're probably not up to date, but so much is 
explained in them that it makes life easier in the long run.


Then, when you have questions, ask them here.

I was lucky enough to be able to set up Bacula in a test environment 
when I started using it, so I could break things willy-nilly and it 
would not cause problems.  (This is still my preferred way of learning a 
new system, why change something that has worked for nigh on four 
decades!  ;-) )


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Error to compile bacula 9.6.5 in CentOS 7.8

2020-09-12 Thread Gary R. Schmidt

On 12/09/2020 22:35, Kern Sibbald wrote:

Hello Wanderlei,

using:

make -j 8

is improper syntax and will probably cause a failure.  If you want to 
run 8 simultaneous compiles, you must use:


make -j8

Note: without the space.


That's wrong, Kern.

GNU make - like about 99% of UNIX and UNIX-derived commands - accepts 
any number of  and  characters between the option and the value.


Now, if you were using "-jobs=n", then yes, spaces aren't accepted.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] how to tell 9.6 director to use mysql?

2020-07-20 Thread Gary R. Schmidt

On 21/07/2020 10:38, Greg Woods wrote:



On Mon, Jul 20, 2020 at 5:43 PM Dmitri Maziuk <mailto:dmitri.maz...@gmail.com>> wrote:


On 7/20/2020 6:31 PM, Gary R. Schmidt wrote:
 > On 21/07/2020 09:21, Greg Woods wrote:
 >>
 >> Has this always been the case?
 > Yes.
 >

Wow. I could swear I installed a backend-specific library RPM and
made a
symlink or something in the version we're using. It all must've been a
figment of my imagination I guess.


Maybe not, because I found the answer. I tried downgrading as I 
suggested to myself above, but it didn't work. I was running the exact 
same RPM packages for Bacula that I was running on my older system, and 
it still complained that Bacula was compiled for Postgres.


It turns out that Fedora has this "alternatives" system. It defines, for 
example, whether "/usr/bin/sendmail" will point to "sendmail" or 
"postfix" for mail delivery. They have done this for Bacula too; there 
is a library called "libbaccats.so" which is apparently linked to by 
their Bacula binaries, and the alternatives system can be used to 
determine whether this points to a MySQL, PostgreSQL, or SQLite3 
version. I finally hit upon the right Google search words to find this: 
https://src.fedoraproject.org/rpms/bacula . Since I have always run my 
Director on a Fedora machine, this explains why I didn't realize Bacula 
was designed to be hard-compiled for a single database backend.


After reading this, I knew that PostgreSQL is the default, but it can be 
changed by running "alternatives --config libbaccats.so" and selecting 
the MySQL option.


The alternatives system is quite slick as can be seen here; it's easy to 
use one set of Bacula packages no matter which database you are using; 
no separate package or compiling from source necessary. But it's not 
always easy to figure out which things have "alternatives" and how to 
use them. Worse still, it appears that I must have gone down this road 
before, as even on my older system, Postgres is the default but it had 
already been set to use MySQL. I really wish my Google search fu was 
better, then I could have avoided all this.




Every day that you learn something new is a good day!

I had no idea that Fedora had anything like that - I've seen it on 
Solaris - I will have to add it to my "things that you needed to know 
before you broke that" list.  :-)


Cheers,
GaryB-)




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] how to tell 9.6 director to use mysql?

2020-07-20 Thread Gary R. Schmidt

On 21/07/2020 09:21, Greg Woods wrote:



On Mon, Jul 20, 2020 at 4:56 PM Gary R. Schmidt 
mailto:g...@mcleod-schmidt.id.au>> wrote:


Bacula can only be built with support for one database, if you want
to use MySQL you will either have to ask the distribution 
maintainers to produce one, or build Bacula yourself from source.



Has this always been the case?

Yes.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] how to tell 9.6 director to use mysql?

2020-07-20 Thread Gary R. Schmidt

On 2020-07-21 08:29, Greg Woods wrote:

I am migrating my Bacula director and database from a Fedora 31 machine running 9.4 to a new 
Fedora 32 machine running 9.6. I am having what seems like a simple configuration issue but I can't figure it out after about an hour of Googling around and trying different things by trial and error. The error I get is this:


[root@seveneves greg]# bacula-dir -t -c /etc/bacula/bacula-dir.conf
bacula-dir: dird.c:1248-0 Dbdriver field within director config file "mysql" mismatched 
with the Database argument "PostgreSQL" passed during Bacula compilation.


You have Bacula built for PostgreSQL, that is what the message is
telling you. 


Bacula can only be built with support for one database, if you want to
use MySQL you will either have to ask the distribution  maintainers to
produce one, or build Bacula yourself from source. 

   Cheers, 


   GaryB-)___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Maximum file size

2020-07-15 Thread Gary R. Schmidt

On 15/07/2020 20:52, armin.v...@mmlab.de wrote:

Hi Bacula users!

I wonder if you can configure a global maximum size for files to be 
backed up.


Didn't find this option, so far.

Does anybody know?

Thanks in advance!


That, IMNSHO, is a very foolish idea.

But you do it by writing a program to supply the list of files to be 
backed up.


The general concept is covered in the Bacula documentation.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Windows 2016/19

2020-06-23 Thread Gary R. Schmidt

On 23/06/2020 20:58, Fernando Miranda wrote:

Hi,

Can we assume that Bacula client can also be installed on Windows 2016/19?
Or is it only certain to work well (or has been tested) in the EE?


They work for me, on 2016 and 2019.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Supported Windows versions

2020-06-16 Thread Gary R. Schmidt

On 17/06/2020 01:06, Fernando Miranda wrote:

Hi,

I'm starting an analysis to choose an open source sw backup, so I have 
some basic doubts (sorry if these are very simple questions).
Is there any document that states what are the limitations of the free 
Bacula version, versus de EE, if any (besides the ones stated in the EE 
subscription levels table)?


For example, are there limitations to the number of clients, number of 
backup jobs, total GBs to backup?



No, there are no limitations with the Community version.

People backup hundreds of machines and multiple terabytes[1] of data 
using it.


Cheers,
GaryB-)

1 - I'm not sure if anyone has crossed the petabyte barrier yet.  :-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula 9.6.5 compilation: How to set the value of PREFIX = /opt/bacula ?

2020-06-13 Thread Gary R. Schmidt

On 14/06/2020 11:07, r0...@nxlplyx.com wrote:

On 6/13/20 12:55 PM, r0...@nxlplyx.com wrote:

[SNIP]

I spoke too soon.

This is a Debian 10 install with postgres.

I compiled and installed the S3 module with no errors or warnings.

But the main Bacula 9.6.5 program was different:

It configured with no errors or warnings.

It compiled with no errors or warnings.

However, even with the modified configure with --prefix=/opt/bacula ,
'make install'  installed stuff elsewhere.

What's worse, after the installation, I get a flurry of  "cannot open
mtab" error windows that pop up.

My configure file is:

CFLAGS="-g -O2 -Wall" \
./configure --prefix=/opt/bacula \
--sbindir=${PREFIX}/bin \
--sysconfdir=${PREFIX}/etc \
--docdir=${PREFIX}/html \
--htmldir=${PREFIX}/html \
--with-working-dir=${PREFIX}/working \
--with-pid-dir=${PREFIX}/working \
--with-scriptdir=${PREFIX}/scripts \
--with-plugindir=${PREFIX}/plugins \
--libdir=${PREFIX}/lib \
--enable-smartalloc \
--enable-conio \
--disable-bat \
--with-postgresql \
--with-dump-email=user1@localhost \
--with-job-email=user1@localhost \
--with-smtp-host=mail.localhost \
--with-baseport=9101 \
--with-openssl

Can anyone tell me what I am doing wrong?


First - don't top post, and please trim your replies.

Second, don't over-specify:
./configure CFLAGS="-g -O2 -Wall" \
--prefix=/opt/bacula \
--enable-smartalloc \
--enable-conio \
--disable-bat \
--with-postgresql \
--with-dump-email=user1@localhost \
--with-job-email=user1@localhost \
--with-smtp-host=mail.localhost \
--with-openssl

Is all that you need.

Telling configure to do the default thing is unnecessary.  E.g. 
"--prefix=X" sets PREFIX inside configure, so "sbindir" will become 
"X/bin", your use of configure led to it being "/bin," etcetera.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula 9.6.5 compilation: How to set the value of PREFIX = /opt/bacula ?

2020-06-13 Thread Gary R. Schmidt

On 13/06/2020 22:26, r0...@nxlplyx.com wrote:

This is a noob question.

I believe, the ./configure script uses the PREFIX value to set the 
installation directory.


I am concerned that I may set PREFIX as a system-wide setting that is 
used by other computer programs I try to compile.


Can anyone tell me how and where, in the Bacula 9.6.5 compilation 
system, can I set the value of PREFX = /opt/bacula , so that it only 
affects the Bacula 9.6.5 compilation?



./configure --prefix=/opt/bacula

The "--prefix" flag is a default autoconf/automake option.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bscan cannot open my tapes - help!

2020-05-29 Thread Gary R. Schmidt

On 30/05/2020 00:03, Nico De Ranter wrote:
But I also tried without manually mounting the tape but that didn't work 
either.  So I need to mount the tape first and then umount it to unlock 
it, correct?
I also tried without bacula-sd running (to prevent it from locking the 
drive), but that didn't work either, hence my confusion.


Oh, mayhap something has changed, I haven't run bscan since, um, last 
decade?  But I have been caught by the drive locking from time to time  :-)


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bscan cannot open my tapes - help!

2020-05-29 Thread Gary R. Schmidt

On 29/05/2020 22:28, Nico De Ranter wrote:
Weird. It actually started reading from the tape when I did an unmount 
in bconsole (which is now blocked because the tape is in use)


Not weird, the Bacula SD locks the drive when told to mount a tape, so 
it needs to be unlocked for anything else to use it.


As bscan is stand-alone, not something that drives the SD, it needs the 
tape unlocked.


Having Bacula umount the tape also means that the Bacula scheduler can't 
come along and bugger things up.


Cheers,
GaryB-)




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] areas for improvement?

2020-05-27 Thread Gary R. Schmidt

On 27/05/2020 23:17, Alan Brown wrote:


I've been running Bacula for ~15 years (community/enterprise) and have
identified a few areas which are in desperate of improvement:

For an "enterprise" grade backup system, it's amazingly fragile in a few
areas (particularly in actual Enterprise networks!)


Bacula DOES NOT LIKE and does not handle network interruptions _at all_
if backups are in progress. This _will_ cause backups to abort - and
these aborted backups are _not_ resumable

Similarly, if there's any kind of disruption between the director and
database, the only fix is to restart the director


What that means is that Bacula _cannot_ be used with a High Availability
database because network interruptions (when switching servers) are part
of the HA paradigm.

It also means that operators have to be _extremely_ careful about
allowing automated or other system upgrades


In days of multi-TB backup sets, this is turning into a showstopping
problem.

As we are an Enteprise customer this has been raised with Baculasystems
but been given _very_ low priority.   I'd like to hear opinions from the
wider community on this


Opinion: I know bugs aren't sexy to work on but these need fixing, not
being brushed off. This is the difference between LAN-quality and actual
Enterprise grade software.

I do not consider these to be bugs - they aren't simple errors where 
someone made a mistake or used the wrong sized variable - they require a 
large amount of re-design and reimplementation of Bacula's communication 
modules, and the scheduler, and no doubt other bits to go away.


Bacula started life twenty years ago, and the environment has changed 
since then, and, while Bacula has kept up with a some things, disk as a 
target rather than tape, frex, something like re-startable jobs is, as I 
have said, not just an extension or addition to what is there, but a big 
change to a large part of Bacula.


And that's a massive risk, it's the sort of task I would be looking at 
having a whole team work on, a couple of designers, six to ten 
programmers, and a QA team with a nasty manager who was not restricted 
from saying, "No!" when things don't work quite right.


And the mob above all have a *really* good understanding of how the 
various bits of Bacula work, and interact, and are capable of and 
allowed to replace ancient groaning bits of code with newer versions 
that just aren't as wrong.  (First task - rename all files so the 
extensions represent the C++ code inside them, and for the really 
cruddy^Wannoying stuff, G++.)


And, from the commercial stand-point, that the changes could be made 
without interrupting the existing income stream.


Then there's the projected time-line before it could be released?
I don't want to think about that, Bacula is fragile as it is, ripping it 
apart and stitching it back together would be a massive task!


And Bacula does not have that capability, not in the OSS space nor in 
the Enterprise space.


All the above said, I think that re-startable jobs would be a great 
enhancement for Bacula, but how often and for how long does it try by 
default before giving up?  :->


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Crashed / Segementation Violation

2020-05-14 Thread Gary R. Schmidt

On 14/05/2020 16:19, Chaz Vidal wrote:

Hi All
I got a segmentation violation again whilst attempting a restore operation 
while a number of backups were still occurring.


Call me old-fashioned, but I wouldn't do this.

Bacula started life when all we had was a single tape-drive, on which we 
physically mounted and umounted tapes[1].


I would not be surprised to find some problem that is only triggered 
when attempting antithetical operations in parallel, and that fixing it 
breaks everything.


Cheers,
GaryB-)

1 - Yes, I started out using 9-track tapes, a DEC TU-10, IIRC.


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Compilation Errors of Bacula 9.6.3 on Ubuntu 18.04

2020-05-04 Thread Gary R. Schmidt

On 05/05/2020 06:59, r0...@nxlplyx.com wrote:

Hi,

I am attempting to compile Bacula 9.6.3 on Ubuntu 18.04, but am getting 
the following errors.  Can anyone help out?


What options did you configure the build with?  And what was the output 
from configure?


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] waiting on max Job jobs - not cancelled?

2020-04-19 Thread Gary R. Schmidt

On 19/04/2020 20:49, Pierre Bernhardt wrote:
[SNIP]

For running jobs only that the running job with same level or higher will be 
abortet the running.
For queued job it is ok, but for running job it should not start a new at same 
level.
Better want to wait or want to cancel.
If there is a way that a higher job will wait for each running job has to been 
finished
would be also welcome. So I can start a new full after a inc has to been 
canceled.

But for queued jobs the behavior is exactly as expected and needed.

So any idea what I must change to have the effect on running jobs without 
changing the
queued behavior?

Are your full/differential/incremental jobs running with different 
priorities?


You haven't shown anything that sets them differently, there is no 
priority difference between full/differential/incremental jobs unless 
you set it.


Cheers,
GaryB-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Can't make brestore work.

2020-04-05 Thread Gary R. Schmidt

On 05/04/2020 22:52, Erik P. Olsen wrote:

Hello,

Where can I find description on how to use bat/brestore? I haven't so far been 
able to
restore using bat. I invariably end up getting error message from the restore 
job saying:
level = "" not valid. I don't find any help in the various manuals and neither 
by
googling.


Does it work if you do it using bconsole?

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] waiting on max Job jobs - not cancelled?

2020-04-03 Thread Gary R. Schmidt

On 03/04/2020 19:38, Bernie Elbourn wrote:

On 03/04/2020 03:58, Pierre Bernhardt wrote:


It is exactly same job configured?


A good thought but yes it is same simple job with no inherited defaults.

Some extra detail this time using sed to reliably obfuscate :-)

Running Jobs:
Console connected at 29-Mar-20 12:36
  JobId  Type Level Files Bytes  Name  Status
==
  70172  Back Diff    120    36.70 M Backup-pc is running
  70173  Back Incr  0 0  Backup-pc is waiting on max Job 
jobs


And the reason it doesn't get cancelled is because they are *not* 
identical jobs, one is "Differential" and the other is "Incremental."


You need to run the Differential, Incremental, and Full jobs at 
different priorities - that reflect how you want things done - and set 
"Cancel Lower Level Duplicate = Yes" and "Allow Mixed Priority = Yes" in 
them all.


I have my schedule set that Full jobs run at 50, Differential Jobs run 
at 49, and Incremental Jobs run at 48, as some of my Full jobs last more 
than 24 hours.
I have a several machines, and some of them cannot be fully backed-up in 
twenty-four hours.
I run Differential and Full backups on Saturday mornings (at 00:01), but 
nor for *all* machines, and no backup on Sunday morning.  All machines 
do an incremental backup from Monday to Friday.


And I have a complicated schedule:
Schedule {
  Name = "WeeklyOneNoSun"
  Run = Level=Full FullPool=Full DifferentialPool=Differential 
IncrementalPool=Incremental 1st sat at 00:01
  Run = Level=Differential FullPool=Full DifferentialPool=Differential 
IncrementalPool=Incremental Priority=49 2nd-5th sat at 00:01
  Run = Level=Incremental FullPool=Full DifferentialPool=Differential 
IncrementalPool=Incremental Priority=48 mon-fri at 00:01

}

Schedule {
  Name = "WeeklyTwoNoSun"
  Run = Level=Full FullPool=Full DifferentialPool=Differential 
IncrementalPool=Incremental 2nd sat at 00:01
  Run = Level=Differential FullPool=Full DifferentialPool=Differential 
IncrementalPool=Incremental Priority=49 1st,3rd-5th sat at 00:01
  Run = Level=Incremental FullPool=Full DifferentialPool=Differential 
IncrementalPool=Incremental Priority=48 mon-fri at 00:01

}

Schedule {
  Name = "WeeklyThreeNoSun"
  Run = Level=Full FullPool=Full DifferentialPool=Differential 
IncrementalPool=Incremental 3rd sat at 00:01
  Run = Level=Differential FullPool=Full DifferentialPool=Differential 
IncrementalPool=Incremental Priority=49 1st,2nd,4th,5th sat at 00:01
  Run = Level=Incremental FullPool=Full DifferentialPool=Differential 
IncrementalPool=Incremental Priority=48 mon-fri at 00:01

}

Schedule {
  Name = "WeeklyFourNoSun"
  Run = Level=Full FullPool=Full DifferentialPool=Differential 
IncrementalPool=Incremental 4th sat at 00:01
  Run = Level=Differential FullPool=Full DifferentialPool=Differential 
IncrementalPool=Incremental Priority=49 1st-3rd,5th sat at 00:01
  Run = Level=Incremental FullPool=Full DifferentialPool=Differential 
IncrementalPool=Incremental Priority=48 mon-fri at 00:01

}

I hope this helps, and gives you some ideas on how to get your schedule 
to do what you want.  :-)


Cheers,
GaryB-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Windows client compatible with Bacula 9.0.6

2020-03-20 Thread Gary R. Schmidt

On 21/03/2020 03:30, Shawn Rappaport wrote:
Hi, I'm running Bacula 9.0.6 on CentOS 7.5 (Director and SDs). I'm 
looking for a copy of the Windows binary for Windows Server 2016 that 
will work with that version of Bacula. I tried downloading the 9.0.8 
binary from this location but the link on that page is no longer valid 
(I get a 404):

https://www.bacula.org/binary-download-center/

Is there another location where I can download that binary?


I've got 9.0.7, grab them from here:



They may not work, however, the rule is (DIR == SD) >= FD.

Best to update your director and storage daemon, then use current things.

    Cheers,
        Gary B-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula 9.6.x: "volume use duration" not working as expected

2020-03-20 Thread Gary R. Schmidt

On 20/03/2020 22:21, Heitor Faria wrote:

Hello Uwe,

No, it is not.
VUD will change the volume status to used at its endpoint, making sure 
the VolRetention is applied.

Bacula volumes selection algo always try to write on last written tape.
The only when to implement the round-robin tape rotation you want is 
using different pools for each week day.


I wonder, would using one pool for Monday, Wednesday, Friday, and 
Sunday, and another pool for Tuesday, Thursday, and Saturday also work?


I originally though about odd and even days, but that will obviously 
fail every now and then.


Just a random thought, that's all.  :-)

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] New tape drive

2020-03-10 Thread Gary R. Schmidt

On 11/03/2020 02:26, Steven Hammond wrote:
We are currently using a LTO-5 drive.  We are upgrading to a LTO-7 
drive.  I noticed the directive in our pools STORAGE=LTO-5. I'd like the 
existing pools to use LTO-7 (since it can still read LTO-5 tapes).  Can 
I just change the directive in the pool to use our new LTO-7 tape drive 
OR will this mess up the existing LTO-5 tapes in the pool.  I was 
wanting to use the existing pools, but I could create new ones if 
necessary.  Thanks.


It's just a tag, it has no meaning, you could use "Bilbo-Baggins" and as 
long as you are consistent it doesn't matter what the contents of the 
"Storage" directive is.


Cheers,
GaryB-)

P.S.  It's considered impolite to change the Subject of an existing 
thread on a mailing list to start a new discussion, it buggers up MUAs 
that use the "Reference:" header to group things.



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bar code labels suggestion

2020-03-05 Thread Gary R. Schmidt

On 06/03/2020 09:22, William Muriithi wrote:

Hello,

We have 2 dozen tapes that we haven't been using because we don't have extra 
bar code labels.  The odd thing is most places, they wouldn't sell the bar code 
labels if you aren't buying tapes.  This is not ideal, as we obviously already 
have more than enough tapes.

What have you guys done when faced with similar problem?  I googled, and it 
looks like there is sites that can generate this label, but what about the 
media where one have to print?  Does it need to have a specific attribute?

I used programs I've found on the 'net, and a couple of web sites that 
generate them.


And then print them out on a single sheet of sticky paper, and cut them 
to size.


All of them have worked for me.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Very slow "SD despooling Attributes"

2020-02-27 Thread Gary R. Schmidt

On 26/02/2020 22:34, Andrew Watkins wrote:

Hello,

I am new to Bacula, but I am slowing getting it working. I am using 
Bacula 9.4.4 on Solaris and a remote MySQL server as the back end.


I have a couple of problem but will start with just the one for now. 
"SD despooling Attributes" is taking forever for a full backup. I come 
from using Networker software so am I expect to much?



First of all - have you tuned your MySQL instance?  It is notorious for 
being useless out of the box.


I spent some time getting MySQL to do the right things on Solaris over a 
few years, last time I updated various bits I switched to PostgreSQL, 
and things got a lot faster.  (Note I build our own versions of MySQL 
and PostgreSQL, I don't like the choices that Sun/Oracle made when 
building them.)


Grab a copy of 
 
and go to town.


If that doesn't point out anything obvious - other than something like, 
"You are on a 4Gb machine, and I would really like 16G," post the output 
and we can have a go at it.



I've run both local and remote MySQL and PostgreSQL DB for Bacula on 
Solaris, and have noticed no real difference - except obvious ones like 
running on a system with more RAM and faster disks and so on.



Secondly, Solaris MySQL has a threadsafe client library, it's 
libmysqlclient_r.so, I thought that configure had finally been hammered 
enough to pick this up, perhaps I was munging things to use it?  Too 
long ago now, and I'm over-used to hand-zapping stuff to get it to do 
what I want.



    Cheers,

        Gary    B-)






___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup immediately fails

2019-11-04 Thread Gary R. Schmidt

On 05/11/2019 08:04, Jose Alberto wrote:
You Fd is:   Client:                 "svnserver-fd" 9.0.6 (20Nov17) 
x86_64-redhat-linux-gnu,redhat,(Core)


You Director   is  9 ?

If seven (7).   It will generate errors. It is recommended that the 
agents are not versions superior to the Directors.



This is not merely recommended, it is required:

DIR == SD >= FD

Your director is very, very old:
04-Nov 07:03 bacula-dir JobId 28: Error: Bacula bacula-dir 5.2.13 (19Jan13)

Your FD is not recent, but not dreadfully old:
  Client: "svnserver-fd" 9.0.6 (20Nov17) 
x86_64-redhat-linux-gnu,redhat,(Core


This will not work, upgrade the director to 9.something and keep an eye 
on versions in the future.


If you are using the RedHat repositories to maintain things, you may 
want to add the EPEL[1] repository, as that is reportedly more 
up-to-date, but may not be for your system(s).


Cheers,
GaryB-)

1 - Better still would be to build Bacula from source for all of your 
systems, this avoids distro-lag and general wrongness.



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Need help installing Bacula on RHEL 7

2019-10-18 Thread Gary R. Schmidt

On 18/10/2019 22:05, Kienzle, Jonathan-David wrote:

Hey there,

I was following this guide: 
https://tyler-hitzeman.github.io/bacula/install-server.html

All went well till I got to the real installation of Bacula.
Because I work on a VM without internet connection, I had to bypass the 
wget commands via scp.


Now my problem:
I ran the configuration script with
chmod +x setup.sh

and

sh ./setup.sh (in the Bacula folder)

and got this output:

./setup.sh: line 3: ./configure: Permission denied
./setup.sh: line 7: --sbindir=/opt/bacula/bin: No such file or directory

I checked that I have /opt/bacula/bin.

This is the content of ./setup.sh:

#!/bin/bash
CFLAGS="-g -Wall" \
./configure \
     #--enable-bat \  #Only needed if you plan on using the BAT GUI 
(which can be very difficult to get to work)

     --sbindir=/opt/bacula/bin \
     --sysconfdir=/opt/bacula/etc \
     --with-pid-dir=/opt/bacula/work \
     --with-subsys-dir=/opt/bacula/work \
     --enable-smartalloc \
     --with-postgresql=/usr/pgsql-9.6 \
     --with-python=/usr/bin/python \
     --with-working-dir=/opt/bacula/work \
     --with-dump-email=$USER

I really hope, that someone can help me. If something is missing, don’t 
blame me I’m new here.

chmod a+x ./configure


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] False "Intervention needed" flood

2019-09-26 Thread Gary R. Schmidt

On 26/09/2019 18:37, Kern Sibbald wrote:

See below ...

On 9/25/19 7:38 PM, Andrea Venturoli wrote:

[SNIP]


Yes: as I said it's not a big problem, just an annoyance.
*Not* solving the resource contention problem, but just avoiding to
nag about it would probably be enough (at least to me).


Bacula is not capable of solving resource contentions itself other than
trying again.


Would it be very difficult to change Bacula so that rather than trying 
every five (or whatever) minutes it did an exponential back-off?


Such as, after the first failure try again in five minutes, then again 
in fifteen, then in sixty minutes, then two hours, four, eight, sixteen, 
too many retries I am giving up?


I don't think this change would be simple, but I think it should be 
possible.


Cheers,
Garyb-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] False "Intervention needed" flood

2019-09-25 Thread Gary R. Schmidt

On 25/09/2019 18:19, Radosław Korzeniewski wrote:

Hello,

sob., 21 wrz 2019 o 00:52 David Brodbeck > napisał(a):


I think this is a somewhat unfortunate design decision, to be
honest. (...)


So what should be the best design in this case which should solve the 
problem?



The standard exponential back-off sort of thing springs to mind...

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] IBM LTO-4 TS3200 Changer

2019-06-19 Thread Gary R. Schmidt

On 20/06/2019 01:05, Jasen Lentz wrote:

Any suggestions on what I need to install for Centos6 drivers?

You should use at least Centos 7, Centos 6 went out of "Full Update" 
support in May 2017, and is going out of "Maintenance Support" totally 
in November 2020...


Centos 7 goes out of support in 2024...

So you should use Centos 8, that will be supported until 2029.

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Debugging a backup job

2019-05-30 Thread Gary R. Schmidt

On 30/05/2019 22:15, Gestió Servidors wrote:

Hello,

after doing some new test, I think the problem was being caused because
of the backup size and network topology. Between my bacula server and my
"backup" server there are 2 firewall. Also, my server is sharing some
NFS resources, so its load sometimes is hard... After modifying fileset
and exclude two very big folders, backup job has finished OK.

You still need to implement the heartbeat settings, as pointed out 
earlier, that will make such failures less likely in the future.


And allow you to put the big directories back into the backup.

And when a directory grows big enough to cause the problem again, it 
won't happen because you have stopped it happening.


Cheers,
GaryB-)



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Verify job succeeds, but restore fails with checksum error?

2019-05-08 Thread Gary R. Schmidt

On 09/05/2019 03:07, Wanderlei Huttel wrote:

Hello Mike

Try to upgrade your very old bacula client to a new one (at least as the 
same version of bacula-dir)


Slight correction, clients (file daemons) can not be newer than 
directors or storage daemons, so only update to the same version as your 
director, if possible.


Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


  1   2   3   >