Re: [Bacula-users] Same file, same job, backed up two or three times
Hi Gabor,
Thanks - yes, I know. The reason these directories are listed multiple times is
that on *some* of my servers, they are actually separate file systems; I had
hoped to use a single file set to cover everything, and that bacula would be
smart enough to detect and ignore the duplicates.
Thanks for the answer, though!
Regards,
Kevin
> -Original Message-
> From: Gabor Heja [mailto:kakaopor2...@stdio.hu]
> Sent: Friday, April 02, 2010 3:06 AM
> To: Kevin Keane
> Cc: bacula-users@lists.sourceforge.net
> Subject: Re: [Bacula-users] Same file, same job, backed up two or three
> times
>
>
> Hi Kevin,
>
> The directories should be backed up recursively, so you do not need to
> specify each directory (/boot, /var, ...) inside it. You would need to
> specify the directories only when you have more than one filesystems
> mounted and have specified the "onefs=yes" inside "Options{}".
>
> So in your case the /var/log/messages is backed up three times because
> of
> these rules:
> File = /
> File = /var
> File = /var/log
>
> The first one would be enough for your whole system.
>
> Regards,
> Gabor
>
> Ps. sorry for the duplicate e-mail, I have not cc-ed the list before.
>
>
> On Fri, 2 Apr 2010 02:34:46 -0700, Kevin Keane
>
> wrote:
> > I have been troubleshooting how the backup for a system with total
> disk
> > usage of 9GB could produce a 24 GB backup.
> >
> > What I found is that apparently, bacula backs up the same file two or
> > sometimes three times within a job. On this system, all data is
> contained
> > in a single file system. The file set contains root, as well as
> several
> > subdirectories. Apparently, the problem occurs for directories that
> are
> > named explicitly, and also included through a parent. For instance,
> > /var/log/messages got backed up three times with the file set listed
> below
> > - probably because it is included through /, /var and /var/log.
> >
> > Bacula-fd: Bacula 2.4.2 (on CentOS 5.4)
> > Bacula-dir (and bacula-sd): Bacula 3.0.3 (on OpenSUSE 11.2)
> >
> > Is that because of an incompatibility between 2.4 and 3.0, or am I
> doing
> > something else wrong?
> >
> >
> > FileSet {
> > Name = "Linux Full Set"
> > Include {
> > Options {
> > signature = MD5
> > }
> > File = /
> > File = /boot
> > File = /home
> > File = /srv
> > File = /usr
> > File = /var
> > File = /var/log
> > File = /var/lib/bacula
> > }
> > Exclude {
> > File = /proc
> > File = /dev
> > File = /sys
> > File = /tmp
> > File = /.journal
> > File = /.fsck
> > File = /srv/installimage
> > File = /var/lock
> > File = /var/run
> > File = /var/tmp
> > File = /var/cache
> > File = /var/spool/postfix/public
> > File = /var/spool/amavis/virusmails
> > File = /var/spool/postfix/private
> > File = /var/lib/mysql
> > File = /var/lib/dhcp/dev/log
> > File = /var/lib/php5
> > File = /var/lib/named/dev/log
> > File = /var/lib/samba/winbindd_privileged/pipe
> > File = /var/lib/zypp/cache
> > File = /var/lib/zmd
> > File = /var/lib/ntp
> > File = /var/lib/logrotate.status
> > File = /var/spool/cron/lastrun
> > File = /var/log/zmd-*
> > File = /var/log/ntp
> > File = /var/log/httpd/error.*
> > File = /virtual
> > }
> > }
> >
> > Kevin Keane
> > Owner
> > The NetTech
> > Find the Uncommon: Expert Solutions for a Network You Never Have to
> Think
> > About
> >
> > Direct: 760-721-8339
> > Office: 866-642-7116
> >
> > http://www.4nettech.com
> >
> > This e-mail and attachments, if any, may contain confidential and/or
> > proprietary information. Please be advised that the unauthorized use
> or
> > disclosure of the information is strictly prohibited. The information
> > herein is intended only for use by the intended recipient(s) named
> above.
> > If you have received this transmission in error, please notify the
> sender
> > immediately and permanently delete the e-mail and any copies,
> printouts
> or
> > attachments thereof.
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Same file, same job, backed up two or three times
Hi Kevin,
The directories should be backed up recursively, so you do not need to
specify each directory (/boot, /var, ...) inside it. You would need to
specify the directories only when you have more than one filesystems
mounted and have specified the "onefs=yes" inside "Options{}".
So in your case the /var/log/messages is backed up three times because of
these rules:
File = /
File = /var
File = /var/log
The first one would be enough for your whole system.
Regards,
Gabor
Ps. sorry for the duplicate e-mail, I have not cc-ed the list before.
On Fri, 2 Apr 2010 02:34:46 -0700, Kevin Keane
wrote:
> I have been troubleshooting how the backup for a system with total disk
> usage of 9GB could produce a 24 GB backup.
>
> What I found is that apparently, bacula backs up the same file two or
> sometimes three times within a job. On this system, all data is contained
> in a single file system. The file set contains root, as well as several
> subdirectories. Apparently, the problem occurs for directories that are
> named explicitly, and also included through a parent. For instance,
> /var/log/messages got backed up three times with the file set listed
below
> - probably because it is included through /, /var and /var/log.
>
> Bacula-fd: Bacula 2.4.2 (on CentOS 5.4)
> Bacula-dir (and bacula-sd): Bacula 3.0.3 (on OpenSUSE 11.2)
>
> Is that because of an incompatibility between 2.4 and 3.0, or am I doing
> something else wrong?
>
>
> FileSet {
> Name = "Linux Full Set"
> Include {
> Options {
> signature = MD5
> }
> File = /
> File = /boot
> File = /home
> File = /srv
> File = /usr
> File = /var
> File = /var/log
> File = /var/lib/bacula
> }
> Exclude {
> File = /proc
> File = /dev
> File = /sys
> File = /tmp
> File = /.journal
> File = /.fsck
> File = /srv/installimage
> File = /var/lock
> File = /var/run
> File = /var/tmp
> File = /var/cache
> File = /var/spool/postfix/public
> File = /var/spool/amavis/virusmails
> File = /var/spool/postfix/private
> File = /var/lib/mysql
> File = /var/lib/dhcp/dev/log
> File = /var/lib/php5
> File = /var/lib/named/dev/log
> File = /var/lib/samba/winbindd_privileged/pipe
> File = /var/lib/zypp/cache
> File = /var/lib/zmd
> File = /var/lib/ntp
> File = /var/lib/logrotate.status
> File = /var/spool/cron/lastrun
> File = /var/log/zmd-*
> File = /var/log/ntp
> File = /var/log/httpd/error.*
> File = /virtual
> }
> }
>
> Kevin Keane
> Owner
> The NetTech
> Find the Uncommon: Expert Solutions for a Network You Never Have to Think
> About
>
> Direct: 760-721-8339
> Office: 866-642-7116
>
> http://www.4nettech.com
>
> This e-mail and attachments, if any, may contain confidential and/or
> proprietary information. Please be advised that the unauthorized use or
> disclosure of the information is strictly prohibited. The information
> herein is intended only for use by the intended recipient(s) named above.
> If you have received this transmission in error, please notify the sender
> immediately and permanently delete the e-mail and any copies, printouts
or
> attachments thereof.
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Same file, same job, backed up two or three times
I have been troubleshooting how the backup for a system with total disk usage
of 9GB could produce a 24 GB backup.
What I found is that apparently, bacula backs up the same file two or sometimes
three times within a job. On this system, all data is contained in a single
file system. The file set contains root, as well as several subdirectories.
Apparently, the problem occurs for directories that are named explicitly, and
also included through a parent. For instance, /var/log/messages got backed up
three times with the file set listed below - probably because it is included
through /, /var and /var/log.
Bacula-fd: Bacula 2.4.2 (on CentOS 5.4)
Bacula-dir (and bacula-sd): Bacula 3.0.3 (on OpenSUSE 11.2)
Is that because of an incompatibility between 2.4 and 3.0, or am I doing
something else wrong?
FileSet {
Name = "Linux Full Set"
Include {
Options {
signature = MD5
}
File = /
File = /boot
File = /home
File = /srv
File = /usr
File = /var
File = /var/log
File = /var/lib/bacula
}
Exclude {
File = /proc
File = /dev
File = /sys
File = /tmp
File = /.journal
File = /.fsck
File = /srv/installimage
File = /var/lock
File = /var/run
File = /var/tmp
File = /var/cache
File = /var/spool/postfix/public
File = /var/spool/amavis/virusmails
File = /var/spool/postfix/private
File = /var/lib/mysql
File = /var/lib/dhcp/dev/log
File = /var/lib/php5
File = /var/lib/named/dev/log
File = /var/lib/samba/winbindd_privileged/pipe
File = /var/lib/zypp/cache
File = /var/lib/zmd
File = /var/lib/ntp
File = /var/lib/logrotate.status
File = /var/spool/cron/lastrun
File = /var/log/zmd-*
File = /var/log/ntp
File = /var/log/httpd/error.*
File = /virtual
}
}
Kevin Keane
Owner
The NetTech
Find the Uncommon: Expert Solutions for a Network You Never Have to Think About
Direct: 760-721-8339
Office: 866-642-7116
http://www.4nettech.com
This e-mail and attachments, if any, may contain confidential and/or
proprietary information. Please be advised that the unauthorized use or
disclosure of the information is strictly prohibited. The information herein is
intended only for use by the intended recipient(s) named above. If you have
received this transmission in error, please notify the sender immediately and
permanently delete the e-mail and any copies, printouts or attachments thereof.
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
