Re: [Bacula-users] wilddir not working for exclusion but is for inclusion
I actually need that inclusion match, each subdirectory of CUSTOMER_DATA
(starting with a, starting with b, etc) gets its own job due to the massive
size of each.
From: Eduardo Antonio Adami
Sent: Monday, October 3, 2022 2:07 PM
To: Dave
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] wilddir not working for exclusion but is for
inclusion
Yeah, you need delete the line /mnt/CUSTOMER_DATA/i*
I did a test inside my test machine, please see the my example:
FileSet {
Name = "CD-i"
Include {
Options {
signature = MD5
Exclude = yes
WildDir = "*/\.cache"
WildDir = "/home/adami/CUSTOMER_DATA/i*/temp"
Wildfile = "/home/adami/*.rar"
Wildfile = "/home/adami/*.zip"
}
File = /home/adami/CUSTOMER_DATA
}
$ ls -l
-rw-r--r-- 1 adami adami6 out 3 15:34 arq1.rar
-rw-r--r-- 1 adami adami6 out 3 15:35 arq1.zip
-rw-r--r-- 1 adami adami6 out 3 15:34 arq2.rar
-rw-r--r-- 1 adami adami6 out 3 15:35 arq2.zip
drwxr-xr-x 3 adami adami 4096 out 3 15:44 inside1
-rw-r--r-- 1 adami adami6 out 3 15:35 test01.txt
-rw-r--r-- 1 adami adami6 out 3 15:35 test02.txt
$ ls -l inside/
-rw-r--r-- 1 adami adami6 out 3 15:37 arq1.rar
-rw-r--r-- 1 adami adami6 out 3 15:37 arq1.zip
-rw-r--r-- 1 adami adami6 out 3 15:37 arq2.rar
-rw-r--r-- 1 adami adami6 out 3 15:37 arq2.zip
drwxr-xr-x 2 adami adami 4096 out 3 15:45 temp
-rw-r--r-- 1 adami adami6 out 3 15:37 test01.txt
-rw-r--r-- 1 adami adami6 out 3 15:37 test02.txt
$ls -l inside/temp/
-rw-r--r-- 1 adami adami 6 out 3 15:45 temp1.txt
-rw-r--r-- 1 adami adami 6 out 3 15:45 temp2.txt
Bacula backup results
Atributo
Arquivo
File Id
Status
-rw-r--r--
1000 1000
03-Oct-22 15:35:34
6.00 bytes
/home/adami/CUSTOMER_DATA/test02.txt
584
OK
-rw-r--r--
1000 1000
03-Oct-22 15:35:31
6.00 bytes
/home/adami/CUSTOMER_DATA/test01.txt
586
OK
-rw-r--r--
1000 1000
03-Oct-22 15:37:26
6.00 bytes
/home/adami/CUSTOMER_DATA/inside1/test02.txt
583
OK
-rw-r--r--
1000 1000
03-Oct-22 15:37:26
6.00 bytes
/home/adami/CUSTOMER_DATA/inside1/test01.txt
585
OK
drwxr-xr-x
1000 1000
03-Oct-22 15:44:25
4.00 KB
/home/adami/CUSTOMER_DATA/inside1/
582
OK
drwxr-xr-x
1000 1000
03-Oct-22 15:45:35
4.00 KB
/home/adami/CUSTOMER_DATA/
581
OK
Note didn´t copy the directory /temp
Eduardo A Adami
Em seg., 3 de out. de 2022 às 15:13, Dave mailto:du...@onetouchemr.com> > escreveu:
Thanks for the response, but I want to include the /mnt/CUSTOMER_DATA/i* and
exclude the /mnt/CUSTOMER_DATA/*/temp. Wouldn’t your exclude both?
From: Eduardo Antonio Adami mailto:ad...@unicamp.br> >
Sent: Monday, October 3, 2022 12:35 PM
To: bacula-users@lists.sourceforge.net
<mailto:bacula-users@lists.sourceforge.net>
Subject: Re: [Bacula-users] wilddir not working for exclusion but is for
inclusion
Hi Dave, you can try to use only one option block!
FileSet {
Name = "CD-i"
Include {
Options {
signature = SHA1
Compression = GZIP9
exclude = yes
wilddir = "/mnt/CUSTOMER_DATA/i*"
wildfile = "*.rar"
wildfile = "*.zip"
wilddir = "/mnt/CUSTOMER_DATA/i*/temp"
}
File = /mnt/CUSTOMER_DATA
}
}
Best Regards
Eduardo A Adami
Em seg., 3 de out. de 2022 às 11:44, Dave mailto:du...@onetouchemr.com> > escreveu:
I’m running Bacula 9.0.6 and cannot seem to get a wilddir exclusion to work.
My fileset is:
FileSet {
Name = "CD-i"
Include {
Options {
signature = SHA1
Compression = GZIP9
wilddir = "/mnt/CUSTOMER_DATA/i*"
}
Options {
RegexDir = ".*"
wildfile = "*.rar"
wildfile = "*.zip"
wilddir = "/mnt/CUSTOMER_DATA/i*/temp"
exclude = yes
}
File = /mnt/CUSTOMER_DATA
}
}
There are a few hundred gigs of data in a few temp subdirectories and it
continues to be backed up. Is there some sort of issue with how I have this
configured? I did also try the following with the same results:
wilddir = "/mnt/CUSTOMER_DATA/*/temp"
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net <mailto:Bacula-users@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/bacula-users
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] wilddir not working for exclusion but is for inclusion
Yeah, you need delete the line /mnt/CUSTOMER_DATA/i*
I did a test inside my test machine, please see the my example:
FileSet {
Name = "CD-i"
Include {
Options {
signature = MD5
Exclude = yes
WildDir = "*/\.cache"
WildDir = "/home/adami/CUSTOMER_DATA/i*/temp"
Wildfile = "/home/adami/*.rar"
Wildfile = "/home/adami/*.zip"
}
File = /home/adami/CUSTOMER_DATA
}
$ ls -l
-rw-r--r-- 1 adami adami6 out 3 15:34 arq1.rar
-rw-r--r-- 1 adami adami6 out 3 15:35 arq1.zip
-rw-r--r-- 1 adami adami6 out 3 15:34 arq2.rar
-rw-r--r-- 1 adami adami6 out 3 15:35 arq2.zip
drwxr-xr-x 3 adami adami 4096 out 3 15:44 inside1
-rw-r--r-- 1 adami adami6 out 3 15:35 test01.txt
-rw-r--r-- 1 adami adami6 out 3 15:35 test02.txt
$ ls -l inside/
-rw-r--r-- 1 adami adami6 out 3 15:37 arq1.rar
-rw-r--r-- 1 adami adami6 out 3 15:37 arq1.zip
-rw-r--r-- 1 adami adami6 out 3 15:37 arq2.rar
-rw-r--r-- 1 adami adami6 out 3 15:37 arq2.zip
drwxr-xr-x 2 adami adami 4096 out 3 15:45 temp
-rw-r--r-- 1 adami adami6 out 3 15:37 test01.txt
-rw-r--r-- 1 adami adami6 out 3 15:37 test02.txt
$ls -l inside/temp/
-rw-r--r-- 1 adami adami 6 out 3 15:45 temp1.txt
-rw-r--r-- 1 adami adami 6 out 3 15:45 temp2.txt
Bacula backup results
Atributo Arquivo File Id Status
-rw-r--r-- 1000 1000 03-Oct-22 15:35:34 6.00 bytes
/home/adami/CUSTOMER_DATA/test02.txt 584 OK
-rw-r--r-- 1000 1000 03-Oct-22 15:35:31 6.00 bytes
/home/adami/CUSTOMER_DATA/test01.txt 586 OK
-rw-r--r-- 1000 1000 03-Oct-22 15:37:26 6.00 bytes
/home/adami/CUSTOMER_DATA/inside1/test02.txt 583 OK
-rw-r--r-- 1000 1000 03-Oct-22 15:37:26 6.00 bytes
/home/adami/CUSTOMER_DATA/inside1/test01.txt 585 OK
drwxr-xr-x 1000 1000 03-Oct-22 15:44:25 4.00 KB
/home/adami/CUSTOMER_DATA/inside1/ 582 OK
drwxr-xr-x 1000 1000 03-Oct-22 15:45:35 4.00 KB /home/adami/CUSTOMER_DATA/
581 OK
Note didn´t copy the directory /temp
Eduardo A Adami
Em seg., 3 de out. de 2022 às 15:13, Dave escreveu:
> Thanks for the response, but I want to include the /mnt/CUSTOMER_DATA/i*
> and exclude the /mnt/CUSTOMER_DATA/*/temp. Wouldn’t your exclude both?
>
>
>
>
>
> *From:* Eduardo Antonio Adami
> *Sent:* Monday, October 3, 2022 12:35 PM
> *To:* bacula-users@lists.sourceforge.net
> *Subject:* Re: [Bacula-users] wilddir not working for exclusion but is
> for inclusion
>
>
>
> Hi Dave, you can try to use only one option block!
>
>
>
>
>
> FileSet {
> Name = "CD-i"
> Include {
> Options {
> signature = SHA1
> Compression = GZIP9
>
> exclude = yes
>
> wilddir = "/mnt/CUSTOMER_DATA/i*"
>
> wildfile = "*.rar"
> wildfile = "*.zip"
> wilddir = "/mnt/CUSTOMER_DATA/i*/temp"
> }
> File = /mnt/CUSTOMER_DATA
> }
> }
>
>
>
>
>
> Best Regards
>
> Eduardo A Adami
>
>
>
>
>
>
>
> Em seg., 3 de out. de 2022 às 11:44, Dave
> escreveu:
>
> I’m running Bacula 9.0.6 and cannot seem to get a wilddir exclusion to
> work. My fileset is:
>
>
>
> FileSet {
>
> Name = "CD-i"
>
> Include {
>
> Options {
>
> signature = SHA1
>
> Compression = GZIP9
>
> wilddir = "/mnt/CUSTOMER_DATA/i*"
>
> }
>
> Options {
>
>RegexDir = ".*"
>
>wildfile = "*.rar"
>
>wildfile = "*.zip"
>
>wilddir = "/mnt/CUSTOMER_DATA/i*/temp"
>
>exclude = yes
>
> }
>
> File = /mnt/CUSTOMER_DATA
>
> }
>
> }
>
>
>
> There are a few hundred gigs of data in a few temp subdirectories and it
> continues to be backed up. Is there some sort of issue with how I have
> this configured? I did also try the following with the same results:
>
>
>
>wilddir = "/mnt/CUSTOMER_DATA/*/temp"
>
>
>
>
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] wilddir not working for exclusion but is for inclusion
Awesome, that makes a lot of sense and I'll give it a shot.
-Original Message-
From: Martin Simmons
Sent: Monday, October 3, 2022 1:52 PM
To: Dave
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] wilddir not working for exclusion but is for
inclusion
Bacula uses on the first Options clause that matches (in the order they are
written) to decide whether to include or exclude something. If no clauses
match, then the item is backed up using the options (e.g. Compression) from
the final clause.
The problem with your clauses is that directories such as
/mnt/CUSTOMER_DATA/ifoo/temp first matches /mnt/CUSTOMER_DATA/i* so will be
included.
You need something like this:
FileSet {
Name = "CD-i"
Include {
Options { # exclude rar/zip files and temp dir
wildfile = "*.rar"
wildfile = "*.zip"
wilddir = "/mnt/CUSTOMER_DATA/i*/temp"
exclude = yes
}
Options { # include some dirs
signature = SHA1
Compression = GZIP9
wilddir = "/mnt/CUSTOMER_DATA/i*"
}
Options { # exclude everything else at top level, but not top level
itself
signature = SHA1
Compression = GZIP9
Regex = "^/mnt/CUSTOMER_DATA/[^/]+$"
exclude = yes
}
# everything else is included by default using the final options
File = /mnt/CUSTOMER_DATA
}
}
__Martin
>>>>> On Mon, 3 Oct 2022 09:26:05 -0500, Dave said:
>
> I'm running Bacula 9.0.6 and cannot seem to get a wilddir exclusion to
work.
> My fileset is:
>
> FileSet {
> Name = "CD-i"
> Include {
> Options {
> signature = SHA1
> Compression = GZIP9
> wilddir = "/mnt/CUSTOMER_DATA/i*"
> }
> Options {
>RegexDir = ".*"
>wildfile = "*.rar"
>wildfile = "*.zip"
>wilddir = "/mnt/CUSTOMER_DATA/i*/temp"
>exclude = yes
> }
> File = /mnt/CUSTOMER_DATA
> }
> }
>
> There are a few hundred gigs of data in a few temp subdirectories and
> it continues to be backed up. Is there some sort of issue with how I
> have this configured? I did also try the following with the same results:
>
>wilddir = "/mnt/CUSTOMER_DATA/*/temp"
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] wilddir not working for exclusion but is for inclusion
Bacula uses on the first Options clause that matches (in the order they are
written) to decide whether to include or exclude something. If no clauses
match, then the item is backed up using the options (e.g. Compression) from
the final clause.
The problem with your clauses is that directories such as
/mnt/CUSTOMER_DATA/ifoo/temp first matches /mnt/CUSTOMER_DATA/i* so will be
included.
You need something like this:
FileSet {
Name = "CD-i"
Include {
Options { # exclude rar/zip files and temp dir
wildfile = "*.rar"
wildfile = "*.zip"
wilddir = "/mnt/CUSTOMER_DATA/i*/temp"
exclude = yes
}
Options { # include some dirs
signature = SHA1
Compression = GZIP9
wilddir = "/mnt/CUSTOMER_DATA/i*"
}
Options { # exclude everything else at top level, but not top level itself
signature = SHA1
Compression = GZIP9
Regex = "^/mnt/CUSTOMER_DATA/[^/]+$"
exclude = yes
}
# everything else is included by default using the final options
File = /mnt/CUSTOMER_DATA
}
}
__Martin
> On Mon, 3 Oct 2022 09:26:05 -0500, Dave said:
>
> I'm running Bacula 9.0.6 and cannot seem to get a wilddir exclusion to work.
> My fileset is:
>
> FileSet {
> Name = "CD-i"
> Include {
> Options {
> signature = SHA1
> Compression = GZIP9
> wilddir = "/mnt/CUSTOMER_DATA/i*"
> }
> Options {
>RegexDir = ".*"
>wildfile = "*.rar"
>wildfile = "*.zip"
>wilddir = "/mnt/CUSTOMER_DATA/i*/temp"
>exclude = yes
> }
> File = /mnt/CUSTOMER_DATA
> }
> }
>
> There are a few hundred gigs of data in a few temp subdirectories and it
> continues to be backed up. Is there some sort of issue with how I have this
> configured? I did also try the following with the same results:
>
>wilddir = "/mnt/CUSTOMER_DATA/*/temp"
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] wilddir not working for exclusion but is for inclusion
Thanks for the response, but I want to include the /mnt/CUSTOMER_DATA/i* and
exclude the /mnt/CUSTOMER_DATA/*/temp. Wouldn’t your exclude both?
From: Eduardo Antonio Adami
Sent: Monday, October 3, 2022 12:35 PM
To: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] wilddir not working for exclusion but is for
inclusion
Hi Dave, you can try to use only one option block!
FileSet {
Name = "CD-i"
Include {
Options {
signature = SHA1
Compression = GZIP9
exclude = yes
wilddir = "/mnt/CUSTOMER_DATA/i*"
wildfile = "*.rar"
wildfile = "*.zip"
wilddir = "/mnt/CUSTOMER_DATA/i*/temp"
}
File = /mnt/CUSTOMER_DATA
}
}
Best Regards
Eduardo A Adami
Em seg., 3 de out. de 2022 às 11:44, Dave mailto:du...@onetouchemr.com> > escreveu:
I’m running Bacula 9.0.6 and cannot seem to get a wilddir exclusion to work.
My fileset is:
FileSet {
Name = "CD-i"
Include {
Options {
signature = SHA1
Compression = GZIP9
wilddir = "/mnt/CUSTOMER_DATA/i*"
}
Options {
RegexDir = ".*"
wildfile = "*.rar"
wildfile = "*.zip"
wilddir = "/mnt/CUSTOMER_DATA/i*/temp"
exclude = yes
}
File = /mnt/CUSTOMER_DATA
}
}
There are a few hundred gigs of data in a few temp subdirectories and it
continues to be backed up. Is there some sort of issue with how I have this
configured? I did also try the following with the same results:
wilddir = "/mnt/CUSTOMER_DATA/*/temp"
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net <mailto:Bacula-users@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/bacula-users
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] wilddir not working for exclusion but is for inclusion
Hi Dave, you can try to use only one option block!
FileSet {
Name = "CD-i"
Include {
Options {
signature = SHA1
Compression = GZIP9
exclude = yes
wilddir = "/mnt/CUSTOMER_DATA/i*"
wildfile = "*.rar"
wildfile = "*.zip"
wilddir = "/mnt/CUSTOMER_DATA/i*/temp"
}
File = /mnt/CUSTOMER_DATA
}
}
Best Regards
Eduardo A Adami
Em seg., 3 de out. de 2022 às 11:44, Dave escreveu:
> I’m running Bacula 9.0.6 and cannot seem to get a wilddir exclusion to
> work. My fileset is:
>
>
>
> FileSet {
>
> Name = "CD-i"
>
> Include {
>
> Options {
>
> signature = SHA1
>
> Compression = GZIP9
>
> wilddir = "/mnt/CUSTOMER_DATA/i*"
>
> }
>
> Options {
>
>RegexDir = ".*"
>
>wildfile = "*.rar"
>
>wildfile = "*.zip"
>
>wilddir = "/mnt/CUSTOMER_DATA/i*/temp"
>
>exclude = yes
>
> }
>
> File = /mnt/CUSTOMER_DATA
>
> }
>
> }
>
>
>
> There are a few hundred gigs of data in a few temp subdirectories and it
> continues to be backed up. Is there some sort of issue with how I have
> this configured? I did also try the following with the same results:
>
>
>
>wilddir = "/mnt/CUSTOMER_DATA/*/temp"
>
>
>
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
