Re: [Bacula-users] Wild card expansion

[Heitor Faria]

You should use the WildDir FileSet Options sub-resource directive, together 
with the Exclude one.

Rgds.
--
MSc Heitor Faria (Miami/USA)
CIO Bacula LatAm
mobile1: + 1 909 655-8971
mobile2: + 55 61 98268-4220
[ http://bacula.lat/]

 Original Message 
From: Richard Couture 
Sent: Sunday, January 2, 2022 08:11 PM
To: bacula-users@lists.sourceforge.net
Subject: [Bacula-users] Wild card expansion

>Greetings and happy 2022 to all
>
>In my filesets.conf I have a bunch of includes and excludes like
>
>File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/2012"
>File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/2013"
>File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/2014"
>File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2012"
>File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2013"
>File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2014"
>File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2015"
>
>Can I write
>File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/201[234]
>File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/201[2345]
>
>or some such
>
>Also in the includes can I write
>
>File = "/var/spool/samba/netdrive/home/*/Historical
>instead of listing each and every one??
>
>Thanks
>
>
>Richard
>
>-- 
>LinuxCabal Asociación Civil
>Ing. Richard Couture
>Novell CNE, ECNE, MCNE
>HP/Compaq ASE
>Tel.: (+52) (333) 145-2638
>Cel.: (+52) (044) 333 377-7505
>Web: http://www.LinuxCabal.org
>E-Mail: r...@linuxcabal.org
>Hosted en la nube Cloud Sigma - www.CloudSigma.com
>
>AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su 
>caso, los archivos adjuntos al mismo, pueden contener información de 
>carácter confidencial y/o privilegiada, y se envían a la atención única 
>y exclusivamente de la persona y/o entidad a quien va dirigido. La 
>copia, revisión, uso, revelación y/o distribución de dicha información 
>confidencial sin la autorización por escrito de LinuxCabal está 
>prohibida. Si usted no es el destinatario a quien se dirige el presente 
>correo, favor de contactar al remitente respondiendo al presente correo 
>y eliminar el correo original incluyendo sus archivos, así como 
>cualesquiera copia del mismo. Mediante la recepción del presente correo 
>usted reconoce y acepta que en caso de incumplimiento de su parte y/o de 
>sus representantes a los términos antes mencionados, LinuxCabal tendrá 
>derecho a los daños y perjuicios que esto le cause.
>
>
>
>___
>Bacula-users mailing list
>Bacula-users@lists.sourceforge.net
>https://lists.sourceforge.net/lists/listinfo/bacula-users
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Wild card expansion

[Richard Couture]

Greetings and happy 2022 to all

In my filesets.conf I have a bunch of includes and excludes like

File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/2012"
File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/2013"
File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/2014"
File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2012"
File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2013"
File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2014"
File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2015"

Can I write
File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/201[234]
File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/201[2345]

or some such

Also in the includes can I write

File = "/var/spool/samba/netdrive/home/*/Historical
instead of listing each and every one??

Thanks


Richard

--
LinuxCabal Asociación Civil
Ing. Richard Couture
Novell CNE, ECNE, MCNE
HP/Compaq ASE
Tel.: (+52) (333) 145-2638
Cel.: (+52) (044) 333 377-7505
Web: http://www.LinuxCabal.org
E-Mail: r...@linuxcabal.org
Hosted en la nube Cloud Sigma - www.CloudSigma.com

AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su 
caso, los archivos adjuntos al mismo, pueden contener información de 
carácter confidencial y/o privilegiada, y se envían a la atención única 
y exclusivamente de la persona y/o entidad a quien va dirigido. La 
copia, revisión, uso, revelación y/o distribución de dicha información 
confidencial sin la autorización por escrito de LinuxCabal está 
prohibida. Si usted no es el destinatario a quien se dirige el presente 
correo, favor de contactar al remitente respondiendo al presente correo 
y eliminar el correo original incluyendo sus archivos, así como 
cualesquiera copia del mismo. Mediante la recepción del presente correo 
usted reconoce y acepta que en caso de incumplimiento de su parte y/o de 
sus representantes a los términos antes mencionados, LinuxCabal tendrá 
derecho a los daños y perjuicios que esto le cause.




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Cloud Storage Alternatives to AWS

[Chris Wilkinson]

I got 'rclone mount..’ working to mount GDrive as a local mount. A 1GB test 
backup took 2h:41m (109kb/s), so not a great result. The server running 
SD/FD/DIR is on a 1Gbe connection to a 300/50 FTTP line so Google seems to be 
the bandwidth limiter here. 

However I did not find a Bacula directive ‘MaximumConcurrentUploads’.

Best
-Chris-




> On 28 Dec 2021, at 22:56, Heitor Faria  wrote:
> 
> Hello Chris,
> I've seen several users have implemented AWS for backup storage. Whilst 
> looking at other options, I came across Expandrive 
> (https://www.expandrive.com/server/ ). 
> This appears to be a wrapper around multiple cloud storage suppliers such as 
> Dropbox, Google Drive and others that can't be used directly as mounted 
> drives.
> 
> I wanted to ask the list if anyone has implemented this and what their 
> experience has been.
> 
> On the face of it, it seems attractive at approx $15/m for 5Tb backend 
> storage plus the Expandrive $25/y single user subscription and allowing to 
> retire a bank of local drives. Granted this would not work for someone on 
> standard broadband but fibre should be fine.
> 
> Regards
> Chris Wilkinson
> This is not a new technique. The Linux fuse library has been able to mount S3 
> buckets for a long time right now. Rclone can also do the same stuff you are 
> proposing (GDrive, Dropbox) for free.
> They all should work with Bacula, but I don't think they are an optimal 
> solution for an array of reasons.
> I deployed a few environments with the Bacula S3 Cloud Driver 
> (https://www.bacula.lat/enterprise-bacula-s3-swift-ceph-and-cloud-storage-driver-quick-guide/?lang=en)
>  and Wasabi, which does not charge per egress data and charges only 5.99 USD 
> per TB/m. The driver is available with the www.bacula.org 
>  installation packages.
> For some reason, however, I could only achieve about 2 MB/s maximum upload 
> transfer rate per part. Then I had to use a greater number of 
> MaximumConcurrentUploads (and Downloads) - e.g. 20. 
> Eventually I was able to reach speeds close to 40 MB/s, that were suitable 
> for the workload.
> 
> Rgds.
> -- 
> 
> MSc Heitor Faria (Miami/USA)
> Bacula LATAM CIO
> mobile1: + 1 909 655-8971
> mobile2: + 55 61 98268-4220
>  
>  
> América Latina
> bacula.lat  | bacula.com.br 
> 

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula for QNAP?

[Phil Stracchino]

On 1/2/22 15:03, Phil Stracchino wrote:

I'm going directly to the heart right now.  I'm cross-compiling an
entire statically-linked gcc/binutils toolchain for it on another
machine.  THEN I can locally compile Bacula (and probably a few
additional library dependencies) and have no further problems.


(I note that the ENTIRE REASON this problem arises in the first place is 
because QNAP sees fit to ship the device with a fully ...  well, MOSTLY 
functional Linux OS *with no system compiler installed*.)



--
  Phil Stracchino
  Babylon Communications
  ph...@caerllewys.net
  p...@co.ordinate.org
  Landline: +1.603.293.8485
  Mobile:   +1.603.998.6958


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula for QNAP?

[Phil Stracchino]

On 1/2/22 13:52, Heitor Faria wrote:

Hello Phil,

Extra workload on the NAS isn't an issue.  It has 32GB RAM and eight
Xeon D-1622 cores.


But then, even you you manage to build the SD you will probably be stuck with 
the same Bacula version forever.
I guess you haven't disclosed this specific NAS model, but you might consider using a VM in the 
QuTS Hero "Virtual Machine Sation" solution. Ref.: 

Then the OS is not a problem anymore.


That is EXACTLY what I'm using.  :)

I'm going directly to the heart right now.  I'm cross-compiling an 
entire statically-linked gcc/binutils toolchain for it on another 
machine.  THEN I can locally compile Bacula (and probably a few 
additional library dependencies) and have no further problems.




--
  Phil Stracchino
  Babylon Communications
  ph...@caerllewys.net
  p...@co.ordinate.org
  Landline: +1.603.293.8485
  Mobile:   +1.603.998.6958


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula for QNAP?

[Heitor Faria]

Hello Phil,

>>> (a) trying to figure out how to get a Bacula sd and fd installed on it
>> 
>> The happiest days of my life were after I got dedicated equipment for home
>> network modem, routing, and wireless mesh accessing points.
>> That said, I never understood this very common user fetish of installing 
>> Bacula
>> components in the NAS. OK: you avoid one more network node but the hardware 
>> is
>> not designed to handle the extra workload.
> 
> 
> Because when the backup scheme is disk to disk to removable disk, the
> transfer rate going directly across the backplane is much higher than I
> can get across a gigabit network.
> 
> Also, I don't want to burn the power to run another node that
> functionally does nothing but run a storage daemon.
> 
> Extra workload on the NAS isn't an issue.  It has 32GB RAM and eight
> Xeon D-1622 cores.

But then, even you you manage to build the SD you will probably be stuck with 
the same Bacula version forever.
I guess you haven't disclosed this specific NAS model, but you might consider 
using a VM in the QuTS Hero "Virtual Machine Sation" solution. Ref.: 

Then the OS is not a problem anymore.
 
> --
>   Phil Stracchino
>   Babylon Communications
>   ph...@caerllewys.net
>   p...@co.ordinate.org
>   Landline: +1.603.293.8485
>Mobile:   +1.603.998.6958

Rgds.
-- 
MSc Heitor Faria (Miami/USA) 
Bacula LATAM CIO 

mobile1: + 1 909 655-8971 
mobile2: + 55 61 98268-4220 
[ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] 
[ http://www.bacula.com.br/ ] 

América Latina 
[ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | 
bacula.com.br ]


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula for QNAP?

[Phil Stracchino]

On 1/2/22 06:59, Josip Deanovic wrote:

The problem is with the openssl support.
File daemon would probably statically compile without openssl support.
Last time I did that was with the 7.x version of bacula.


I just tried disabling openssl support but that did not solve the problem.

I'm building a static gcc/binutils toolchain to install on the NAS and I 
will build sd and fd with that.




--
  Phil Stracchino
  Babylon Communications
  ph...@caerllewys.net
  p...@co.ordinate.org
  Landline: +1.603.293.8485
  Mobile:   +1.603.998.6958


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula for QNAP?

[Phil Stracchino]

On 1/2/22 10:08, Heitor Faria wrote:

Hello Phil,


(a) trying to figure out how to get a Bacula sd and fd installed on it


The happiest days of my life were after I got dedicated equipment for home 
network modem, routing, and wireless mesh accessing points.
That said, I never understood this very common user fetish of installing Bacula 
components in the NAS. OK: you avoid one more network node but the hardware is 
not designed to handle the extra workload.



Because when the backup scheme is disk to disk to removable disk, the 
transfer rate going directly across the backplane is much higher than I 
can get across a gigabit network.


Also, I don't want to burn the power to run another node that 
functionally does nothing but run a storage daemon.


Extra workload on the NAS isn't an issue.  It has 32GB RAM and eight 
Xeon D-1622 cores.





--
  Phil Stracchino
  Babylon Communications
  ph...@caerllewys.net
  p...@co.ordinate.org
  Landline: +1.603.293.8485
  Mobile:   +1.603.998.6958


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula for QNAP?

[Andrea Venturoli]

On 1/2/22 16:08, Heitor Faria wrote:


That said, I never understood this very common user fetish of installing Bacula 
components in the NAS.


Efficiency, reliability, less points of failure, etc...



 OK: you avoid one more network node but the hardware is not designed to handle 
the extra workload.


At least for the SD the extra workload is negligible.
Didn't try the FD.





If you want to write backups to the NAS, NFS or iSCSI if supported.


Been there, done that, never again (unless there's no way to use the SD 
on the NAS, of course).



 bye
av.


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula for QNAP?

[Heitor Faria]

Hello Phil,

> (a) trying to figure out how to get a Bacula sd and fd installed on it

The happiest days of my life were after I got dedicated equipment for home 
network modem, routing, and wireless mesh accessing points.
That said, I never understood this very common user fetish of installing Bacula 
components in the NAS. OK: you avoid one more network node but the hardware is 
not designed to handle the extra workload. 
Just backup the exported disk volumes with regular bacula-fds where they are 
mounted, preferrably with the ACL support.
If you want to write backups to the NAS, NFS or iSCSI if supported. 

> --
>   Phil Stracchino
>   Babylon Communications
>   ph...@caerllewys.net
>   p...@co.ordinate.org
>   Landline: +1.603.293.8485
>   Mobile:   +1.603.998.6958

Rgds,
-- 
MSc Heitor Faria (Miami/USA) 
Bacula LATAM CIO 

mobile1: + 1 909 655-8971 
mobile2: + 55 61 98268-4220 
[ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] 
[ http://www.bacula.com.br/ ] 

América Latina 
[ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | 
bacula.com.br ]


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula for QNAP?

[Dmitri Maziuk]

On 1/2/2022 7:18 AM, Jose Alberto wrote:

I have a NAS with HP StoreOnce.

I have 4 network ports.

Take one of them and connect it point to point with the Bacula.

In Bacula I do a mount NFS readonly

In this way backup (backup) everything that exists in the NFS at 
transfer rates between 100 and 180 MB / s on average.


I don't know if this can help you.


Setting up zfs on the other host, doing incremental snapshot transfers 
and baking up those would be more efficient. I don't think that's what 
Phil's trying to achieve though


Dima


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula for QNAP?

[Jose Alberto]

I have a NAS with HP StoreOnce.

I have 4 network ports.

Take one of them and connect it point to point with the Bacula.

In Bacula I do a mount NFS readonly

In this way backup (backup) everything that exists in the NFS at transfer
rates between 100 and 180 MB / s on average.

I don't know if this can help you.

Greetings.

On Fri, Dec 31, 2021 at 5:24 PM Phil Stracchino 
wrote:

> I replaced my failed NAS with a QNAP NAS that is advertised as having a
> Linux OS and ZFS filesystem.  Both of these are technically true, but
> ... well, here is not the place to rant about what a mess they made of it.
>
> Does anyone have any experience with, or useful tips for, using Bacula
> to back up a QNAP NAS with the QuTS "Hero" OS?
>
>
> --
>Phil Stracchino
>Babylon Communications
>ph...@caerllewys.net
>p...@co.ordinate.org
>Landline: +1.603.293.8485
>Mobile:   +1.603.998.6958
>
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>


-- 
#
#   Sistema Operativo: Debian  #
#Caracas, Venezuela  #
#
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula for QNAP?

[Josip Deanovic]

On 2022-01-02 12:46, Radosław Korzeniewski wrote:

Hello,

sob., 1 sty 2022 o 23:52 Phil Stracchino  
napisał(a):



(...)
/usr/lib/gcc/x86_64-pc-linux-gnu/11.2.0/../../../../x86_64-pc-linux-gnu/bin/ld:

../lib/libbac.a(plugins.o): in function `load_plugins(void*, void*, 
char

const*, char const*, bool (*)(Plugin*))':
/netstore/src/bacula-11.0.5/src/lib/plugins.c:150: warning: Using
'dlopen' in statically linked applications requires at runtime the
shared libraries from the glibc version used for linking



As I understand this issue is that glibc does not support dlopen with
static linking as the code which implements dlopen is dynamically 
linked

only.
I could be very wrong about my understanding.



/usr/lib/gcc/x86_64-pc-linux-gnu/11.2.0/../../../../x86_64-pc-linux-gnu/bin/ld:

cannot find -lssl
/usr/lib/gcc/x86_64-pc-linux-gnu/11.2.0/../../../../x86_64-pc-linux-gnu/bin/ld:

cannot find -lcrypto
/usr/lib/gcc/x86_64-pc-linux-gnu/11.2.0/../../../../x86_64-pc-linux-gnu/bin/ld:

cannot find -lcap
/usr/lib/gcc/x86_64-pc-linux-gnu/11.2.0/../../../../x86_64-pc-linux-gnu/bin/ld:

cannot find -llzo2
collect2: error: ld returned 1 exit status
make[1]: *** [Makefile:240: static-bacula-fd] Error 1


Do we actually still support static builds?



I think it is not very well maintained as very few users require and 
use it.
The solution to it would be to disable a plugin support. I'm not sure 
if

such an option is currently available.


The problem is with the openssl support.
File daemon would probably statically compile without openssl support.
Last time I did that was with the 7.x version of bacula.

I would certainly like to be able to statically compile file daemon.
It would make preparations for bare metal restore using Bacula much
simpler.

Right now, if encryption is used for transport between bacula
components, one would need to copy all the libraries file daemon
depends on and all their dependencies including openssl libraries
which are loaded using dlopen(3) and of course, all their dependencies
and so on...


Regards!

--
Josip Deanovic


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula for QNAP?

[Radosław Korzeniewski]

Hello,

sob., 1 sty 2022 o 23:52 Phil Stracchino  napisał(a):

> (...)
> /usr/lib/gcc/x86_64-pc-linux-gnu/11.2.0/../../../../x86_64-pc-linux-gnu/bin/ld:
>
> ../lib/libbac.a(plugins.o): in function `load_plugins(void*, void*, char
> const*, char const*, bool (*)(Plugin*))':
> /netstore/src/bacula-11.0.5/src/lib/plugins.c:150: warning: Using
> 'dlopen' in statically linked applications requires at runtime the
> shared libraries from the glibc version used for linking
>

As I understand this issue is that glibc does not support dlopen with
static linking as the code which implements dlopen is dynamically linked
only.
I could be very wrong about my understanding.


> /usr/lib/gcc/x86_64-pc-linux-gnu/11.2.0/../../../../x86_64-pc-linux-gnu/bin/ld:
>
> cannot find -lssl
> /usr/lib/gcc/x86_64-pc-linux-gnu/11.2.0/../../../../x86_64-pc-linux-gnu/bin/ld:
>
> cannot find -lcrypto
> /usr/lib/gcc/x86_64-pc-linux-gnu/11.2.0/../../../../x86_64-pc-linux-gnu/bin/ld:
>
> cannot find -lcap
> /usr/lib/gcc/x86_64-pc-linux-gnu/11.2.0/../../../../x86_64-pc-linux-gnu/bin/ld:
>
> cannot find -llzo2
> collect2: error: ld returned 1 exit status
> make[1]: *** [Makefile:240: static-bacula-fd] Error 1
>
>
> Do we actually still support static builds?
>

I think it is not very well maintained as very few users require and use it.
The solution to it would be to disable a plugin support. I'm not sure if
such an option is currently available.

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users