[Bacula-users] Same file, same job, backed up two or three times
I have been troubleshooting how the backup for a system with total disk usage
of 9GB could produce a 24 GB backup.
What I found is that apparently, bacula backs up the same file two or sometimes
three times within a job. On this system, all data is contained in a single
file system. The file set contains root, as well as several subdirectories.
Apparently, the problem occurs for directories that are named explicitly, and
also included through a parent. For instance, /var/log/messages got backed up
three times with the file set listed below - probably because it is included
through /, /var and /var/log.
Bacula-fd: Bacula 2.4.2 (on CentOS 5.4)
Bacula-dir (and bacula-sd): Bacula 3.0.3 (on OpenSUSE 11.2)
Is that because of an incompatibility between 2.4 and 3.0, or am I doing
something else wrong?
FileSet {
Name = Linux Full Set
Include {
Options {
signature = MD5
}
File = /
File = /boot
File = /home
File = /srv
File = /usr
File = /var
File = /var/log
File = /var/lib/bacula
}
Exclude {
File = /proc
File = /dev
File = /sys
File = /tmp
File = /.journal
File = /.fsck
File = /srv/installimage
File = /var/lock
File = /var/run
File = /var/tmp
File = /var/cache
File = /var/spool/postfix/public
File = /var/spool/amavis/virusmails
File = /var/spool/postfix/private
File = /var/lib/mysql
File = /var/lib/dhcp/dev/log
File = /var/lib/php5
File = /var/lib/named/dev/log
File = /var/lib/samba/winbindd_privileged/pipe
File = /var/lib/zypp/cache
File = /var/lib/zmd
File = /var/lib/ntp
File = /var/lib/logrotate.status
File = /var/spool/cron/lastrun
File = /var/log/zmd-*
File = /var/log/ntp
File = /var/log/httpd/error.*
File = /virtual
}
}
Kevin Keane
Owner
The NetTech
Find the Uncommon: Expert Solutions for a Network You Never Have to Think About
Direct: 760-721-8339
Office: 866-642-7116
http://www.4nettech.com
This e-mail and attachments, if any, may contain confidential and/or
proprietary information. Please be advised that the unauthorized use or
disclosure of the information is strictly prohibited. The information herein is
intended only for use by the intended recipient(s) named above. If you have
received this transmission in error, please notify the sender immediately and
permanently delete the e-mail and any copies, printouts or attachments thereof.
--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Same file, same job, backed up two or three times
Hi Kevin,
The directories should be backed up recursively, so you do not need to
specify each directory (/boot, /var, ...) inside it. You would need to
specify the directories only when you have more than one filesystems
mounted and have specified the onefs=yes inside Options{}.
So in your case the /var/log/messages is backed up three times because of
these rules:
File = /
File = /var
File = /var/log
The first one would be enough for your whole system.
Regards,
Gabor
Ps. sorry for the duplicate e-mail, I have not cc-ed the list before.
On Fri, 2 Apr 2010 02:34:46 -0700, Kevin Keane subscript...@kkeane.com
wrote:
I have been troubleshooting how the backup for a system with total disk
usage of 9GB could produce a 24 GB backup.
What I found is that apparently, bacula backs up the same file two or
sometimes three times within a job. On this system, all data is contained
in a single file system. The file set contains root, as well as several
subdirectories. Apparently, the problem occurs for directories that are
named explicitly, and also included through a parent. For instance,
/var/log/messages got backed up three times with the file set listed
below
- probably because it is included through /, /var and /var/log.
Bacula-fd: Bacula 2.4.2 (on CentOS 5.4)
Bacula-dir (and bacula-sd): Bacula 3.0.3 (on OpenSUSE 11.2)
Is that because of an incompatibility between 2.4 and 3.0, or am I doing
something else wrong?
FileSet {
Name = Linux Full Set
Include {
Options {
signature = MD5
}
File = /
File = /boot
File = /home
File = /srv
File = /usr
File = /var
File = /var/log
File = /var/lib/bacula
}
Exclude {
File = /proc
File = /dev
File = /sys
File = /tmp
File = /.journal
File = /.fsck
File = /srv/installimage
File = /var/lock
File = /var/run
File = /var/tmp
File = /var/cache
File = /var/spool/postfix/public
File = /var/spool/amavis/virusmails
File = /var/spool/postfix/private
File = /var/lib/mysql
File = /var/lib/dhcp/dev/log
File = /var/lib/php5
File = /var/lib/named/dev/log
File = /var/lib/samba/winbindd_privileged/pipe
File = /var/lib/zypp/cache
File = /var/lib/zmd
File = /var/lib/ntp
File = /var/lib/logrotate.status
File = /var/spool/cron/lastrun
File = /var/log/zmd-*
File = /var/log/ntp
File = /var/log/httpd/error.*
File = /virtual
}
}
Kevin Keane
Owner
The NetTech
Find the Uncommon: Expert Solutions for a Network You Never Have to Think
About
Direct: 760-721-8339
Office: 866-642-7116
http://www.4nettech.com
This e-mail and attachments, if any, may contain confidential and/or
proprietary information. Please be advised that the unauthorized use or
disclosure of the information is strictly prohibited. The information
herein is intended only for use by the intended recipient(s) named above.
If you have received this transmission in error, please notify the sender
immediately and permanently delete the e-mail and any copies, printouts
or
attachments thereof.
--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Same file, same job, backed up two or three times
Hi Gabor,
Thanks - yes, I know. The reason these directories are listed multiple times is
that on *some* of my servers, they are actually separate file systems; I had
hoped to use a single file set to cover everything, and that bacula would be
smart enough to detect and ignore the duplicates.
Thanks for the answer, though!
Regards,
Kevin
-Original Message-
From: Gabor Heja [mailto:kakaopor2...@stdio.hu]
Sent: Friday, April 02, 2010 3:06 AM
To: Kevin Keane
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Same file, same job, backed up two or three
times
Hi Kevin,
The directories should be backed up recursively, so you do not need to
specify each directory (/boot, /var, ...) inside it. You would need to
specify the directories only when you have more than one filesystems
mounted and have specified the onefs=yes inside Options{}.
So in your case the /var/log/messages is backed up three times because
of
these rules:
File = /
File = /var
File = /var/log
The first one would be enough for your whole system.
Regards,
Gabor
Ps. sorry for the duplicate e-mail, I have not cc-ed the list before.
On Fri, 2 Apr 2010 02:34:46 -0700, Kevin Keane
subscript...@kkeane.com
wrote:
I have been troubleshooting how the backup for a system with total
disk
usage of 9GB could produce a 24 GB backup.
What I found is that apparently, bacula backs up the same file two or
sometimes three times within a job. On this system, all data is
contained
in a single file system. The file set contains root, as well as
several
subdirectories. Apparently, the problem occurs for directories that
are
named explicitly, and also included through a parent. For instance,
/var/log/messages got backed up three times with the file set listed
below
- probably because it is included through /, /var and /var/log.
Bacula-fd: Bacula 2.4.2 (on CentOS 5.4)
Bacula-dir (and bacula-sd): Bacula 3.0.3 (on OpenSUSE 11.2)
Is that because of an incompatibility between 2.4 and 3.0, or am I
doing
something else wrong?
FileSet {
Name = Linux Full Set
Include {
Options {
signature = MD5
}
File = /
File = /boot
File = /home
File = /srv
File = /usr
File = /var
File = /var/log
File = /var/lib/bacula
}
Exclude {
File = /proc
File = /dev
File = /sys
File = /tmp
File = /.journal
File = /.fsck
File = /srv/installimage
File = /var/lock
File = /var/run
File = /var/tmp
File = /var/cache
File = /var/spool/postfix/public
File = /var/spool/amavis/virusmails
File = /var/spool/postfix/private
File = /var/lib/mysql
File = /var/lib/dhcp/dev/log
File = /var/lib/php5
File = /var/lib/named/dev/log
File = /var/lib/samba/winbindd_privileged/pipe
File = /var/lib/zypp/cache
File = /var/lib/zmd
File = /var/lib/ntp
File = /var/lib/logrotate.status
File = /var/spool/cron/lastrun
File = /var/log/zmd-*
File = /var/log/ntp
File = /var/log/httpd/error.*
File = /virtual
}
}
Kevin Keane
Owner
The NetTech
Find the Uncommon: Expert Solutions for a Network You Never Have to
Think
About
Direct: 760-721-8339
Office: 866-642-7116
http://www.4nettech.com
This e-mail and attachments, if any, may contain confidential and/or
proprietary information. Please be advised that the unauthorized use
or
disclosure of the information is strictly prohibited. The information
herein is intended only for use by the intended recipient(s) named
above.
If you have received this transmission in error, please notify the
sender
immediately and permanently delete the e-mail and any copies,
printouts
or
attachments thereof.
--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
