Re: [Bacula-users] Conflict When Upgrading from Bacula 9.4.4 to 11.0.5

[Davide Franco]

Hi,

This is something I’d like to fix since time with bacula rpm packages.

You’re right, as of now, you need to uninstall the bacula-client and then
install bacula-postgresql rpm package.

Best regards

Davide

On Fri, 5 Nov 2021 at 18:39 Radosław Korzeniewski 
wrote:

> Hello,
>
> pt., 5 lis 2021 o 15:36 J W  napisał(a):
>
>>
>>> yum list installed|grep bacula shows no bacula rpms installed.
>>>
>>> Below I tried to install using yum. I get a msg. that there is a
>>> conflict between bacula-postgresql-11.0.5-1.x86_64 and bacula-client.
>>>
>>> Any idea how to fix?
>>>
>>>
> Did you try to skip the "bacula-client" package from installation? I think
> the "server" package includes the client files already.
>
> best regards
> --
> Radosław Korzeniewski
> rados...@korzeniewski.net
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] feedback requested on new backup strategy

[mark . bergman]

I've been using bacula for many years, but as the volume of our data
has grown and we've gotten a new tape library, I'm about to implement
a new strategy for our backup jobs and I'd like your feedback.

Environment:scientific research center
Data volume:~400TB
Growth rate:~20TB/month (new data)
Churn rate: ~10TB/month (total size of files that exist and 
change in content but not significantly in size)
Backup device:  tape library, 3x LTO8 drives, 80x LTO tapes
Backup window:  undefined
Restore window: undefined
Bacula version: 9.6.7

We're using the GPFS filesystem, and doing filesystem snapshots every
15 minutes, with a limited set retained for at least 2 months. The
snapshots allow for almost instant restores of recent data and comparision
between different versions of files, without system administrator
intervention.

Because of snapshots, I'm planning to eliminate all nightly incremental
& differential backups to tape. Tape backups would be only for
archival/disaster-recovery purposes and for compliance with grant and
data management requirements.

The new strategy would be to do a full backup every 2 months, kept for
5 months. One backup would be kept for at least 2 years, the others would
be rotated (media reused). For example:

January 2021keep until January 2023
March 2021  keep until August 2021
May 2021keep until October 2021
July 2021   keep until December 2021
September 2021  re-use March 2021 media, keep until February 
2022
November 2021   re-use May 2021 media, keep until April 2022
January 2022keep until January 2024


All tape backups would be done from a snapshot, so that no files within
the source of the backup change during the process. A "run before job"
script would dump coherent copies of databases, then create a filesystem
snapshot dedicated to the backup. That snapshot would be removed when
the backup is complete.

We've got about 700 top-level directories for user accounts and research
projects. We'll probably run an individual backup job for each group of
directories alphabetically (A*, B*, etc), so that the 400TB will be spread
(unevenly) across about 45 Bacula jobs.


Thoughts? Suggestions?

Thanks,

Mark

-- 
Mark Bergman   voice: 215-746-4061  
 
mark.berg...@pennmedicine.upenn.edu  fax: 215-614-0266
http://www.med.upenn.edu/cbica/
IT Technical Director, Center for Biomedical Image Computing and Analytics
Department of Radiology University of Pennsylvania


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Can't Label Tapes

[Radosław Korzeniewski]

Hello,

pt., 5 lis 2021 o 17:52 Jeffrey Di Domenico 
napisał(a):

> Hi,
>
> I have loaded new tapes with physical labels but Bacula can't label them,
> I get the timeout error below but I've had them in the past and Bacula has
> still labelled the tapes, I can't see that there is anything wrong with the
> drives and it doesn't seem to be taking that long but it fails every time.
> Any suggestions for what I can do to resolve this would be greatly
> appreciated.
>
I assume you are trying to use a standard SCSI library and not the ACSLS
managed one, right?

First of all check if your library is working with standard mtx utility
(i.e. mtx -f /dev/sg0 status). If not, solve it in the first place as
Bacula is using mtx to manage tape cartridges in your library.
Then check if a standard bacula mtx-changer script is working with the
command: listall (i.e. mtx-changer /dev/sg0 listall).

The `/dev/sg0` device in the examples above is the scsi generic device for
your changer. To check which device to use, check with lsscsi -g command.

I hope this helps.
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Conflict When Upgrading from Bacula 9.4.4 to 11.0.5

[Radosław Korzeniewski]

Hello,

pt., 5 lis 2021 o 15:36 J W  napisał(a):

>
>> yum list installed|grep bacula shows no bacula rpms installed.
>>
>> Below I tried to install using yum. I get a msg. that there is a conflict
>> between bacula-postgresql-11.0.5-1.x86_64 and bacula-client.
>>
>> Any idea how to fix?
>>
>>
Did you try to skip the "bacula-client" package from installation? I think
the "server" package includes the client files already.

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Can't Label Tapes

[Jeffrey Di Domenico]

Hi,

I have loaded new tapes with physical labels but Bacula can't label 
them, I get the timeout error below but I've had them in the past and 
Bacula has still labelled the tapes, I can't see that there is anything 
wrong with the drives and it doesn't seem to be taking that long but it 
fails every time. Any suggestions for what I can do to resolve this 
would be greatly appreciated.



Label command failed for Volume IGL559L5.
Sending label command for Volume "IGL544L5" Slot 29 ...
3304 Issuing autochanger "load slot 29, drive 1" command.
3992 Bad autochanger "load slot 29, drive 1": ERR=Child died from signal 
15: Termination.

Results=Program killed by Bacula (timeout)

--
Jeffrey Di Domenico
Systems Administrator

Direct: +44 020 7608 7463

Email:jdidomen...@integrafin.co.uk
Transact - take control

Phone: +44 (0)20 7608 4900
Web:www.transact-online.co.uk
Address: 29 Clement's Lane, London EC4N 7AE
Please consider the environment before printing this email
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Conflict When Upgrading from Bacula 9.4.4 to 11.0.5

[J W]

I tried to revert back to 9.4.4 and get the same error. I installed
everything but bacula-client and it seems that the client is already
installed with bacula-postgresq.

I must have known this the first time I installed 9.4.4.

I guess the instructions do not say to install the client on the server.
They only discuss installing the client on the clients and I just assumed
it was necessary.

I will uninstall 9.44 then install 11.0.5 and see what happens.

THanks



On Fri, Nov 5, 2021 at 7:51 AM J W  wrote:

> I am trying to upgrade from Bacula 9.4.4 to 11.0.5.
> My OS is Centos 7.
>
> I backed up my Bacula installation and catalog then uninstalled Bacula
> 9.4.4.
>
>
> yum list installed|grep bacula shows no bacula rpms installed.
>
> Below I tried to install using yum. I get a msg. that there is a conflict
> between bacula-postgresql-11.0.5-1.x86_64 and bacula-client.
>
> Any idea how to fix?
>
> [root@jw bacula]# yum install bacula-aligned-11.0.5-1.el7.x86_64.rpm
> bacula-client-11.0.5-1.el7.x86_64.rpm bacula-libs-11.0.5-1.el7.x86_64.rpm
> bacula-postgresql-11.0.5-1.el7.x86_64.rpm
> bacula-updatedb-11.0.5-1.el7.x86_64.rpm
> Loaded plugins: fastestmirror, langpacks
> Examining bacula-aligned-11.0.5-1.el7.x86_64.rpm:
> bacula-aligned-11.0.5-1.x86_64
> Marking bacula-aligned-11.0.5-1.el7.x86_64.rpm to be installed
> Examining bacula-client-11.0.5-1.el7.x86_64.rpm:
> bacula-client-11.0.5-1.x86_64
> Marking bacula-client-11.0.5-1.el7.x86_64.rpm to be installed
> Examining bacula-libs-11.0.5-1.el7.x86_64.rpm: bacula-libs-11.0.5-1.x86_64
> Marking bacula-libs-11.0.5-1.el7.x86_64.rpm to be installed
> Examining bacula-postgresql-11.0.5-1.el7.x86_64.rpm:
> bacula-postgresql-11.0.5-1.x86_64
> Marking bacula-postgresql-11.0.5-1.el7.x86_64.rpm to be installed
> Examining bacula-updatedb-11.0.5-1.el7.x86_64.rpm:
> bacula-updatedb-11.0.5-1.x86_64
> Marking bacula-updatedb-11.0.5-1.el7.x86_64.rpm to be installed
> Resolving Dependencies
> --> Running transaction check
> ---> Package bacula-aligned.x86_64 0:11.0.5-1 will be installed
> ---> Package bacula-client.x86_64 0:11.0.5-1 will be installed
> ---> Package bacula-libs.x86_64 0:11.0.5-1 will be installed
> ---> Package bacula-postgresql.x86_64 0:11.0.5-1 will be installed
> ---> Package bacula-updatedb.x86_64 0:11.0.5-1 will be installed
> --> Processing Conflict: bacula-postgresql-11.0.5-1.x86_64 conflicts
> bacula-client
> Loading mirror speeds from cached hostfile
>  * base: centos.mirror.far.fi
>  * epel: epel.mirror.omnilance.com
>  * extras: centos.mirror.far.fi
>  * updates: centos.mirror.far.fi
> --> Processing Conflict: bacula-client-11.0.5-1.x86_64 conflicts
> bacula-postgresql
> --> Finished Dependency Resolution
> Error: bacula-postgresql conflicts with bacula-client-11.0.5-1.x86_64
> Error: bacula-client conflicts with bacula-postgresql-11.0.5-1.x86_64
>  You could try using --skip-broken to work around the problem
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Slow transfer rate - MS Win 2019

[Heitor Faria]

Just in time: 
.

Rgds.
--
MSc Heitor Faria (Miami/USA)
CEO Bacula LatAm
mobile1: + 1 909 655-8971
mobile2: + 55 61 98268-4220

América Latina
[ http://bacula.lat/]___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Slow transfer rate - MS Win 2019

[Heitor Faria]

Hello Andras,

I would use an external tool such as diskspd or any other to validate the DFS 
directory reading speed. E.g. 
.
IMHO Clustered Filesystems will hardly have the same speed of regular ones. 
Hadoop has even a special command (distcp) to copy data from several nodes.
The best way of finding a performance bottleneck is the scientific. You gotta 
test each one of the involved components, including client disk reading, 
network capacity and actual negotiation (even faulty cable can matters). VSS 
snapshot also can impact, as mentioned before.

Atte.
--
MSc Heitor Faria (Miami/USA)
CEO Bacula LatAm
mobile1: + 1 909 655-8971
mobile2: + 55 61 98268-4220

América Latina
[ http://bacula.lat/]___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Slow transfer rate - MS Win 2019

[Andras Horvai]

Unfortunately, I do not see Event 513 in the application log in Event
viewer. :(
I did an estimate last night to check how much data and files we are about
to backup, I was not able to wait for the result. Today morning I checked
and this is the result:
2000 OK estimate files=444,041 bytes=271,286,711,691
I do not think it is too much. As I mentioned, the estimate operation also
took too long. (is VSS involved by bacula when doing an estimate?)
I cannot find anything useful in the debug log:

dc4-fd: filed/job.c:317-0  Accurate= BaseJob=
flags=<74754>
dc4-fd: filed/job.c:467-0 Calling term_find_files
dc4-fd: filed/job.c:470-0 Done with term_find_files
dc4-fd: lib/bsockcore.c:1203-0 WSAIoctl(SIO_GET_EXTENSION_FUNCTION_POINTER,
WSAID_DISCONNECTEX) ret = 0
dc4-fd: filed/job.c:473-0 Done with free_jcr



On Fri, Nov 5, 2021 at 12:34 PM Josh Fisher  wrote:

>
> On 11/4/21 19:10, Andras Horvai wrote:
>
>
> I think the issue is the number of files/directories on the file server I
> want to backup. Bacula-fd cannot count them... but bacula-fd.exe daemon
> does not use/does not want to use more resources
> on the system. Can I ask bacula-fd somehow to use more resources to speed
> up its operation? :)
>
>
> Your problem may be the result of creating a VSS snapshot on a DFS
> replicated folder. Do you see any Event 513 errors in the Application log
> on the Windows machine? If so, see
> https://docs.microsoft.com/en-US/troubleshoot/windows-server/backup-and-storage/event-id-513-vss-windows-server.
> Is it taking a long time to generate the VSS snapshot?  In DFS management
> console, you can configure the DFS Replication group schedule for 'No
> replication' during certain times. Try turning off DFS replication during
> the time the backup job is running.
>
> Cheers,
> Josh Fisher
>
>
>
> Thanks,
>
> Andras
>
> On Thu, Nov 4, 2021 at 1:12 PM Jose Alberto  wrote:
>
>> Client:.  11.0.5 (03Jun21) Microsoft Windows Server
>> 2008 R2 Enterprise Edition Service Pack 1 (build 7601),
>> 64-bit,Cross-compile,Win64
>> Rate:   26497.7 KB/s
>> Software Compression:   None
>> Comm Line Compression:  80.7% 5.2:1
>>
>> Hosts,,  guest  on vmware.
>>
>>
>>
>>
>> On Wed, Nov 3, 2021 at 8:48 PM Jose Alberto  wrote:
>>
>>> Personally. I have seen the highest speeds in AIX, then in Linux and
>>> finally in Windows. With Windows of 40MB I have not passed.
>>>
>>> Virtual or physical server, antivirus, vss, type of data to be backed
>>> up, are factors that influence Windows
>>>
>>> On Tue, Nov 2, 2021 at 5:00 PM Andras Horvai 
>>> wrote:
>>>
 1. AV exclusion did not solve the issue. Backup is still
 incredibly slow from this client.

 I forgot to mention that I am trying to backup a folder which is DFS
 synchronized. I do not know if it matters or not.
 During the backup I do not see high cpu or memory utilization on client
 caused by bacula-fd.
 It looks like that bacula-fd "cannot find out" what to send to the
 storage daemon...  strage...
 This is the first time I have such issue...


 On Mon, Nov 1, 2021 at 11:19 PM Heitor Faria 
 wrote:

> "1. The windows 2019 server has the default Virus and Threat
> protection settings no 3rd party virus scanner is deployed on the server.
> Can you recommend what to check? How to exclude bacula-fd?"
>
> Consult your AV provider to find out.
>
> "2. This would be a bigger project in our case but sure I will
> consider this... "
>
> The 11.x version (odd) from bacula.org is also open source. Do not
> confuse with the Bacula Enterprise Edition (even) versions.
>
> Rgds.
> --
> MSc Heitor Faria (Miami/USA)
> CEO Bacula LatAm
> mobile1: + 1 909 655-8971
> mobile2: + 55 61 98268-4220
>
> América Latina
> [ http://bacula.lat/]
>
>
>  Original Message 
> From: Andras Horvai 
> Sent: Monday, November 1, 2021 04:40 PM
> To: bacula-users 
> Subject: Re: [Bacula-users] Slow transfer rate - MS Win 2019
>
> Hello Heitor,
>
> How much is very slow? i think on a 1 Gigabit/s connection around 100
> Mbit/s is slow considering that the network test between sd and the client
> gives 925.6 Mbit/s - 977.6 Mbtit/s result
> (I used bacula to test it) The problem is that  when it comes to real
> backup it drops to around 100 Mbit/s.
> 1. The windows 2019 server has the default Virus and Threat protection
> settings no 3rd party virus scanner is deployed on the server. Can you
> recommend what to check? How to exclude bacula-fd?
> 2. This would be a bigger project in our case but sure I will consider
> this...
> 3. Well this is something I can take into account as well
>
>
> Thanks,
>
> Andras
>
>
>
> On Sun, Oct 31, 2021 at 1:47 PM Heitor Faria 
> wrote:
>
>> Hello Andras,
>>
>> How much 

[Bacula-users] Conflict When Upgrading from Bacula 9.4.4 to 11.0.5

[J W]

I am trying to upgrade from Bacula 9.4.4 to 11.0.5.
My OS is Centos 7.

I backed up my Bacula installation and catalog then uninstalled Bacula
9.4.4.


yum list installed|grep bacula shows no bacula rpms installed.

Below I tried to install using yum. I get a msg. that there is a conflict
between bacula-postgresql-11.0.5-1.x86_64 and bacula-client.

Any idea how to fix?

[root@jw bacula]# yum install bacula-aligned-11.0.5-1.el7.x86_64.rpm
bacula-client-11.0.5-1.el7.x86_64.rpm bacula-libs-11.0.5-1.el7.x86_64.rpm
bacula-postgresql-11.0.5-1.el7.x86_64.rpm
bacula-updatedb-11.0.5-1.el7.x86_64.rpm
Loaded plugins: fastestmirror, langpacks
Examining bacula-aligned-11.0.5-1.el7.x86_64.rpm:
bacula-aligned-11.0.5-1.x86_64
Marking bacula-aligned-11.0.5-1.el7.x86_64.rpm to be installed
Examining bacula-client-11.0.5-1.el7.x86_64.rpm:
bacula-client-11.0.5-1.x86_64
Marking bacula-client-11.0.5-1.el7.x86_64.rpm to be installed
Examining bacula-libs-11.0.5-1.el7.x86_64.rpm: bacula-libs-11.0.5-1.x86_64
Marking bacula-libs-11.0.5-1.el7.x86_64.rpm to be installed
Examining bacula-postgresql-11.0.5-1.el7.x86_64.rpm:
bacula-postgresql-11.0.5-1.x86_64
Marking bacula-postgresql-11.0.5-1.el7.x86_64.rpm to be installed
Examining bacula-updatedb-11.0.5-1.el7.x86_64.rpm:
bacula-updatedb-11.0.5-1.x86_64
Marking bacula-updatedb-11.0.5-1.el7.x86_64.rpm to be installed
Resolving Dependencies
--> Running transaction check
---> Package bacula-aligned.x86_64 0:11.0.5-1 will be installed
---> Package bacula-client.x86_64 0:11.0.5-1 will be installed
---> Package bacula-libs.x86_64 0:11.0.5-1 will be installed
---> Package bacula-postgresql.x86_64 0:11.0.5-1 will be installed
---> Package bacula-updatedb.x86_64 0:11.0.5-1 will be installed
--> Processing Conflict: bacula-postgresql-11.0.5-1.x86_64 conflicts
bacula-client
Loading mirror speeds from cached hostfile
 * base: centos.mirror.far.fi
 * epel: epel.mirror.omnilance.com
 * extras: centos.mirror.far.fi
 * updates: centos.mirror.far.fi
--> Processing Conflict: bacula-client-11.0.5-1.x86_64 conflicts
bacula-postgresql
--> Finished Dependency Resolution
Error: bacula-postgresql conflicts with bacula-client-11.0.5-1.x86_64
Error: bacula-client conflicts with bacula-postgresql-11.0.5-1.x86_64
 You could try using --skip-broken to work around the problem
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Slow transfer rate - MS Win 2019

[Josh Fisher]

On 11/4/21 19:10, Andras Horvai wrote:


I think the issue is the number of files/directories on the file 
server I want to backup. Bacula-fd cannot count them... but 
bacula-fd.exe daemon does not use/does not want to use more resources
on the system. Can I ask bacula-fd somehow to use more resources to 
speed up its operation? :)



Your problem may be the result of creating a VSS snapshot on a DFS 
replicated folder. Do you see any Event 513 errors in the Application 
log on the Windows machine? If so, see 
https://docs.microsoft.com/en-US/troubleshoot/windows-server/backup-and-storage/event-id-513-vss-windows-server. 
Is it taking a long time to generate the VSS snapshot?  In DFS 
management console, you can configure the DFS Replication group schedule 
for 'No replication' during certain times. Try turning off DFS 
replication during the time the backup job is running.


Cheers,
Josh Fisher




Thanks,

Andras

On Thu, Nov 4, 2021 at 1:12 PM Jose Alberto  wrote:

Client:                .  11.0.5 (03Jun21) Microsoft Windows
Server 2008 R2 Enterprise Edition Service Pack 1 (build 7601),
64-bit,Cross-compile,Win64
Rate:                   26497.7 KB/s
Software Compression:   None
Comm Line Compression:  80.7% 5.2:1

Hosts,,  guest  on vmware.




On Wed, Nov 3, 2021 at 8:48 PM Jose Alberto  wrote:

Personally. I have seen the highest speeds in AIX, then in
Linux and finally in Windows. With Windows of 40MB I have not
passed.

Virtual or physical server, antivirus, vss, type of data to be
backed up, are factors that influence Windows

On Tue, Nov 2, 2021 at 5:00 PM Andras Horvai
 wrote:

1. AV exclusion did not solve the issue. Backup is still
incredibly slow from this client.

I forgot to mention that I am trying to backup a folder
which is DFS synchronized. I do not know if it matters or
not.
During the backup I do not see high cpu or memory
utilization on client caused by bacula-fd.
It looks like that bacula-fd "cannot find out" what to
send to the storage daemon...  strage...
This is the first time I have such issue...


On Mon, Nov 1, 2021 at 11:19 PM Heitor Faria
 wrote:

"1. The windows 2019 server has the default Virus and
Threat protection settings no 3rd party virus scanner
is deployed on the server. Can you recommend what to
check? How to exclude bacula-fd?"

Consult your AV provider to find out.

"2. This would be a bigger project in our case but
sure I will consider this... "

The 11.x version (odd) from bacula.org
 is also open source. Do not
confuse with the Bacula Enterprise Edition (even)
versions.

Rgds.
--
MSc Heitor Faria (Miami/USA)
CEO Bacula LatAm
mobile1: + 1 909 655-8971
mobile2: + 55 61 98268-4220

América Latina
[ http://bacula.lat/]



 Original Message 
From: Andras Horvai 
Sent: Monday, November 1, 2021 04:40 PM
To: bacula-users 
Subject: Re: [Bacula-users] Slow transfer rate - MS
Win 2019

Hello Heitor,

How much is very slow? i think on a 1 Gigabit/s
connection around 100 Mbit/s is slow considering that
the network test between sd and the client gives 925.6
Mbit/s - 977.6 Mbtit/s result
(I used bacula to test it) The problem is that  when
it comes to real backup it drops to around 100 Mbit/s.
1. The windows 2019 server has the default Virus and
Threat protection settings no 3rd party virus scanner
is deployed on the server. Can you recommend what to
check? How to exclude bacula-fd?
2. This would be a bigger project in our case but sure
I will consider this...
3. Well this is something I can take into account as
well


Thanks,

Andras



On Sun, Oct 31, 2021 at 1:47 PM Heitor Faria
 wrote:

Hello Andras,

How much is very low?
Bacula only displays the transfer rate after the
sw compression reduction, what IMHO is very
misleading since it is a "higher-the better"
value. Worst decision ever.
You gotta divide the ReadBytes by the Job Duration
to have the