Re: [Bacula-users] regexdir stops bacula backup...
Ok,
I've read a bit quickly your answer, and tonight Bacula backup 33Go of data
(compressed) LOL...
I'm gonna change my way of doing... instead of a complex bacula
configuration, I'll move logs to another single location (for every website)
instead of a logs directory per website.
This server will soon be re installed and the way I manage website will
change totally, that's why I don't want to spend much time on this (I've
also a lot of other things to do and it's not my full time job)
Thanks Martin for your help !
Thomas.
On Tue, Mar 3, 2009 at 16:43, Martin Simmons mar...@lispworks.com wrote:
On Tue, 3 Mar 2009 15:20:46 +0100, Thomas Manson said:
Hi Martin,
So I should do this :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
*regexdir= /home/.*/web/public_html*
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
*File = /home*
}
}
Yes, that's a start.
you need to exclude everything that doesn't match the regex and include
all of the directories above /home/user1/web.
Well, I've nothing to backup between / and /home/*/web
What's the point of using regexdir if I have to exclude everything else ?
That's just how it works. Bacula doesn't scan the whole world looking for
something that matches the regexdir.
Instead, it searches down the tree starting from the 'File =' lines looking
for files to back up. To prevent something from being backed up, you must
exclude it by using an Exclude section or by using options with 'exclude =
yes'. See the *.gz example here:
http://www.bacula.org/en/rel-manual/Configuring_Director.html#SECTION00148
When you exclude a directory, it doesn't look any further. Therefore, to
back
up selected subdirectories of /home/*, you need to make Bacula select all
directories leading up to those you want to back up, without selecting any
of
ther contents. Something like this (not tested):
Include {
Options {
signature = SHA1
compression = GZIP
# include the dirs in /home
regexdir = ^/home/[^/]+$
# and include the web dirs of them
wilddir = /home/*/web
# and the public_html dirs within the web dirs
wilddir = /home/*/web/public_html
# and the contents of the public_html
wild = /home/*/web/public_html/*
}
Options {
# exclude everything else
Exclude = yes
wild = /home/*
}
File = /home
}
__Martin
For the fact that bacula FD stops with the regexp, I'll recheck, but I
don't
think their is something in the director's logs...
Thomas.
On Thu, Feb 26, 2009 at 21:44, Martin Simmons mar...@lispworks.com
wrote:
On Thu, 26 Feb 2009 10:00:26 +0100, Thomas Manson said:
Nobody has an idea?
Bacula uses the File lines as the roots when it looks for files and
none
of
yours are going to find files in /home/user1 etc. Also, you can't do
what
you
want directly with a single Options clause -- you need to exclude
everything
that doesn't match the regex and include all of the directories above
/home/user1/web.
Crashing is unexpected though. What does the Bacula log say? Can you
repeat
it on a local machine without the ssh tunnel?
__Martin
On Tue, Feb 24, 2009 at 22:19, Thomas Manson
dev.mansontho...@gmail.com
wrote:
I forgot to mention the bacula version :
server :
2.4.2-1ubuntu6
client : Redhat ES4 with version :
bacula-client-2.4.2-1.el4.i386.rpm
Thomas
On Tue, Feb 24, 2009 at 22:16, Thomas Manson
dev.mansontho...@gmail.comwrote:
Hi,
I want to backup this kind of directories :
/home/user1/web/public_html
/home/user2/web/public_html
/home/user3/web/public_html
/home/user4/web/public_html
and subdirectories.
I've run a find to list all dir of the home directory and test the
following regexp on it with success :
/home/.*/web/public_html (with quote in the configuration file).
When I run the backup, the job crashes :
My SSH tunnel is stopped and when I run another backup, it tells me
that
the last volume do not have the correct number of byte (can't
remember
the
exact message).
If I comment the regexdir, it works normally.
here is the fileSet :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
#regexdir= /home/.*/web/public_html
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
}
}
Any idea of how I can see what's going wrong?
Thx,
Re: [Bacula-users] regexdir stops bacula backup...
Well finally I think I'll need the regexdir to exclude some cache directory
inside website that are huge ;)
You didn't work for nothgin Martin ;)
Thanks,
Thomas.
On Wed, Mar 4, 2009 at 11:19, Thomas Manson dev.mansontho...@gmail.comwrote:
Ok,
I've read a bit quickly your answer, and tonight Bacula backup 33Go of data
(compressed) LOL...
I'm gonna change my way of doing... instead of a complex bacula
configuration, I'll move logs to another single location (for every website)
instead of a logs directory per website.
This server will soon be re installed and the way I manage website will
change totally, that's why I don't want to spend much time on this (I've
also a lot of other things to do and it's not my full time job)
Thanks Martin for your help !
Thomas.
On Tue, Mar 3, 2009 at 16:43, Martin Simmons mar...@lispworks.com wrote:
On Tue, 3 Mar 2009 15:20:46 +0100, Thomas Manson said:
Hi Martin,
So I should do this :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
*regexdir= /home/.*/web/public_html*
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
*File = /home*
}
}
Yes, that's a start.
you need to exclude everything that doesn't match the regex and
include
all of the directories above /home/user1/web.
Well, I've nothing to backup between / and /home/*/web
What's the point of using regexdir if I have to exclude everything else
?
That's just how it works. Bacula doesn't scan the whole world looking for
something that matches the regexdir.
Instead, it searches down the tree starting from the 'File =' lines
looking
for files to back up. To prevent something from being backed up, you must
exclude it by using an Exclude section or by using options with 'exclude =
yes'. See the *.gz example here:
http://www.bacula.org/en/rel-manual/Configuring_Director.html#SECTION00148
When you exclude a directory, it doesn't look any further. Therefore, to
back
up selected subdirectories of /home/*, you need to make Bacula select all
directories leading up to those you want to back up, without selecting any
of
ther contents. Something like this (not tested):
Include {
Options {
signature = SHA1
compression = GZIP
# include the dirs in /home
regexdir = ^/home/[^/]+$
# and include the web dirs of them
wilddir = /home/*/web
# and the public_html dirs within the web dirs
wilddir = /home/*/web/public_html
# and the contents of the public_html
wild = /home/*/web/public_html/*
}
Options {
# exclude everything else
Exclude = yes
wild = /home/*
}
File = /home
}
__Martin
For the fact that bacula FD stops with the regexp, I'll recheck, but I
don't
think their is something in the director's logs...
Thomas.
On Thu, Feb 26, 2009 at 21:44, Martin Simmons mar...@lispworks.com
wrote:
On Thu, 26 Feb 2009 10:00:26 +0100, Thomas Manson said:
Nobody has an idea?
Bacula uses the File lines as the roots when it looks for files and
none
of
yours are going to find files in /home/user1 etc. Also, you can't do
what
you
want directly with a single Options clause -- you need to exclude
everything
that doesn't match the regex and include all of the directories above
/home/user1/web.
Crashing is unexpected though. What does the Bacula log say? Can you
repeat
it on a local machine without the ssh tunnel?
__Martin
On Tue, Feb 24, 2009 at 22:19, Thomas Manson
dev.mansontho...@gmail.com
wrote:
I forgot to mention the bacula version :
server :
2.4.2-1ubuntu6
client : Redhat ES4 with version :
bacula-client-2.4.2-1.el4.i386.rpm
Thomas
On Tue, Feb 24, 2009 at 22:16, Thomas Manson
dev.mansontho...@gmail.comwrote:
Hi,
I want to backup this kind of directories :
/home/user1/web/public_html
/home/user2/web/public_html
/home/user3/web/public_html
/home/user4/web/public_html
and subdirectories.
I've run a find to list all dir of the home directory and test the
following regexp on it with success :
/home/.*/web/public_html (with quote in the configuration
file).
When I run the backup, the job crashes :
My SSH tunnel is stopped and when I run another backup, it tells
me
that
the last volume do not have the correct number of byte (can't
remember
the
exact message).
If I comment the regexdir, it works normally.
here is the fileSet :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
#regexdir=
Re: [Bacula-users] regexdir stops bacula backup...
Hi Martin,
So I should do this :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
*regexdir= /home/.*/web/public_html*
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
*File = /home*
}
}
you need to exclude everything that doesn't match the regex and include
all of the directories above /home/user1/web.
Well, I've nothing to backup between / and /home/*/web
What's the point of using regexdir if I have to exclude everything else ?
For the fact that bacula FD stops with the regexp, I'll recheck, but I don't
think their is something in the director's logs...
Thomas.
On Thu, Feb 26, 2009 at 21:44, Martin Simmons mar...@lispworks.com
wrote:
On Thu, 26 Feb 2009 10:00:26 +0100, Thomas Manson said:
Nobody has an idea?
Bacula uses the File lines as the roots when it looks for files and none
of
yours are going to find files in /home/user1 etc. Also, you can't do what
you
want directly with a single Options clause -- you need to exclude
everything
that doesn't match the regex and include all of the directories above
/home/user1/web.
Crashing is unexpected though. What does the Bacula log say? Can you
repeat
it on a local machine without the ssh tunnel?
__Martin
On Tue, Feb 24, 2009 at 22:19, Thomas Manson dev.mansontho...@gmail.com
wrote:
I forgot to mention the bacula version :
server :
2.4.2-1ubuntu6
client : Redhat ES4 with version : bacula-client-2.4.2-1.el4.i386.rpm
Thomas
On Tue, Feb 24, 2009 at 22:16, Thomas Manson
dev.mansontho...@gmail.comwrote:
Hi,
I want to backup this kind of directories :
/home/user1/web/public_html
/home/user2/web/public_html
/home/user3/web/public_html
/home/user4/web/public_html
and subdirectories.
I've run a find to list all dir of the home directory and test the
following regexp on it with success :
/home/.*/web/public_html (with quote in the configuration file).
When I run the backup, the job crashes :
My SSH tunnel is stopped and when I run another backup, it tells me
that
the last volume do not have the correct number of byte (can't remember
the
exact message).
If I comment the regexdir, it works normally.
here is the fileSet :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
#regexdir= /home/.*/web/public_html
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
}
}
Any idea of how I can see what's going wrong?
Thx,
Thomas.
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] regexdir stops bacula backup...
On Tue, 3 Mar 2009 15:20:46 +0100, Thomas Manson said:
Hi Martin,
So I should do this :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
*regexdir= /home/.*/web/public_html*
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
*File = /home*
}
}
Yes, that's a start.
you need to exclude everything that doesn't match the regex and include
all of the directories above /home/user1/web.
Well, I've nothing to backup between / and /home/*/web
What's the point of using regexdir if I have to exclude everything else ?
That's just how it works. Bacula doesn't scan the whole world looking for
something that matches the regexdir.
Instead, it searches down the tree starting from the 'File =' lines looking
for files to back up. To prevent something from being backed up, you must
exclude it by using an Exclude section or by using options with 'exclude =
yes'. See the *.gz example here:
http://www.bacula.org/en/rel-manual/Configuring_Director.html#SECTION00148
When you exclude a directory, it doesn't look any further. Therefore, to back
up selected subdirectories of /home/*, you need to make Bacula select all
directories leading up to those you want to back up, without selecting any of
ther contents. Something like this (not tested):
Include {
Options {
signature = SHA1
compression = GZIP
# include the dirs in /home
regexdir = ^/home/[^/]+$
# and include the web dirs of them
wilddir = /home/*/web
# and the public_html dirs within the web dirs
wilddir = /home/*/web/public_html
# and the contents of the public_html
wild = /home/*/web/public_html/*
}
Options {
# exclude everything else
Exclude = yes
wild = /home/*
}
File = /home
}
__Martin
For the fact that bacula FD stops with the regexp, I'll recheck, but I don't
think their is something in the director's logs...
Thomas.
On Thu, Feb 26, 2009 at 21:44, Martin Simmons mar...@lispworks.com
wrote:
On Thu, 26 Feb 2009 10:00:26 +0100, Thomas Manson said:
Nobody has an idea?
Bacula uses the File lines as the roots when it looks for files and none
of
yours are going to find files in /home/user1 etc. Also, you can't do what
you
want directly with a single Options clause -- you need to exclude
everything
that doesn't match the regex and include all of the directories above
/home/user1/web.
Crashing is unexpected though. What does the Bacula log say? Can you
repeat
it on a local machine without the ssh tunnel?
__Martin
On Tue, Feb 24, 2009 at 22:19, Thomas Manson dev.mansontho...@gmail.com
wrote:
I forgot to mention the bacula version :
server :
2.4.2-1ubuntu6
client : Redhat ES4 with version : bacula-client-2.4.2-1.el4.i386.rpm
Thomas
On Tue, Feb 24, 2009 at 22:16, Thomas Manson
dev.mansontho...@gmail.comwrote:
Hi,
I want to backup this kind of directories :
/home/user1/web/public_html
/home/user2/web/public_html
/home/user3/web/public_html
/home/user4/web/public_html
and subdirectories.
I've run a find to list all dir of the home directory and test the
following regexp on it with success :
/home/.*/web/public_html (with quote in the configuration file).
When I run the backup, the job crashes :
My SSH tunnel is stopped and when I run another backup, it tells me
that
the last volume do not have the correct number of byte (can't remember
the
exact message).
If I comment the regexdir, it works normally.
here is the fileSet :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
#regexdir= /home/.*/web/public_html
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
}
}
Any idea of how I can see what's going wrong?
Thx,
Thomas.
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] regexdir stops bacula backup...
Nobody has an idea?
On Tue, Feb 24, 2009 at 22:19, Thomas Manson dev.mansontho...@gmail.comwrote:
I forgot to mention the bacula version :
server :
2.4.2-1ubuntu6
client : Redhat ES4 with version : bacula-client-2.4.2-1.el4.i386.rpm
Thomas
On Tue, Feb 24, 2009 at 22:16, Thomas Manson
dev.mansontho...@gmail.comwrote:
Hi,
I want to backup this kind of directories :
/home/user1/web/public_html
/home/user2/web/public_html
/home/user3/web/public_html
/home/user4/web/public_html
and subdirectories.
I've run a find to list all dir of the home directory and test the
following regexp on it with success :
/home/.*/web/public_html (with quote in the configuration file).
When I run the backup, the job crashes :
My SSH tunnel is stopped and when I run another backup, it tells me that
the last volume do not have the correct number of byte (can't remember the
exact message).
If I comment the regexdir, it works normally.
here is the fileSet :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
#regexdir= /home/.*/web/public_html
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
}
}
Any idea of how I can see what's going wrong?
Thx,
Thomas.
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] regexdir stops bacula backup...
On Thu, 26 Feb 2009 10:00:26 +0100, Thomas Manson said:
Nobody has an idea?
Bacula uses the File lines as the roots when it looks for files and none of
yours are going to find files in /home/user1 etc. Also, you can't do what you
want directly with a single Options clause -- you need to exclude everything
that doesn't match the regex and include all of the directories above
/home/user1/web.
Crashing is unexpected though. What does the Bacula log say? Can you repeat
it on a local machine without the ssh tunnel?
__Martin
On Tue, Feb 24, 2009 at 22:19, Thomas Manson
dev.mansontho...@gmail.comwrote:
I forgot to mention the bacula version :
server :
2.4.2-1ubuntu6
client : Redhat ES4 with version : bacula-client-2.4.2-1.el4.i386.rpm
Thomas
On Tue, Feb 24, 2009 at 22:16, Thomas Manson
dev.mansontho...@gmail.comwrote:
Hi,
I want to backup this kind of directories :
/home/user1/web/public_html
/home/user2/web/public_html
/home/user3/web/public_html
/home/user4/web/public_html
and subdirectories.
I've run a find to list all dir of the home directory and test the
following regexp on it with success :
/home/.*/web/public_html (with quote in the configuration file).
When I run the backup, the job crashes :
My SSH tunnel is stopped and when I run another backup, it tells me that
the last volume do not have the correct number of byte (can't remember the
exact message).
If I comment the regexdir, it works normally.
here is the fileSet :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
#regexdir= /home/.*/web/public_html
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
}
}
Any idea of how I can see what's going wrong?
Thx,
Thomas.
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] regexdir stops bacula backup...
Hi,
I want to backup this kind of directories :
/home/user1/web/public_html
/home/user2/web/public_html
/home/user3/web/public_html
/home/user4/web/public_html
and subdirectories.
I've run a find to list all dir of the home directory and test the following
regexp on it with success :
/home/.*/web/public_html (with quote in the configuration file).
When I run the backup, the job crashes :
My SSH tunnel is stopped and when I run another backup, it tells me that the
last volume do not have the correct number of byte (can't remember the exact
message).
If I comment the regexdir, it works normally.
here is the fileSet :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
#regexdir= /home/.*/web/public_html
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
}
}
Any idea of how I can see what's going wrong?
Thx,
Thomas.
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] regexdir stops bacula backup...
I forgot to mention the bacula version :
server :
2.4.2-1ubuntu6
client : Redhat ES4 with version : bacula-client-2.4.2-1.el4.i386.rpm
Thomas
On Tue, Feb 24, 2009 at 22:16, Thomas Manson dev.mansontho...@gmail.comwrote:
Hi,
I want to backup this kind of directories :
/home/user1/web/public_html
/home/user2/web/public_html
/home/user3/web/public_html
/home/user4/web/public_html
and subdirectories.
I've run a find to list all dir of the home directory and test the
following regexp on it with success :
/home/.*/web/public_html (with quote in the configuration file).
When I run the backup, the job crashes :
My SSH tunnel is stopped and when I run another backup, it tells me that
the last volume do not have the correct number of byte (can't remember the
exact message).
If I comment the regexdir, it works normally.
here is the fileSet :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
#regexdir= /home/.*/web/public_html
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
}
}
Any idea of how I can see what's going wrong?
Thx,
Thomas.
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
