Re: [Bacula-users] HP msl5030 misfunctions ...
Hi Michael and thanks for fast answer... Hi all I hope you're right. But these are results of my tests: # lsscsi [0:0:0:0]mediumx COMPAQ MSL5000 Series 0423 - [0:0:0:1]tapeHP Ultrium 1-SCSI E38W /dev/st0 [0:0:0:2]storage HP NS E1200-160 530b - # mtx -f /dev/sg0 status Storage Changer /dev/sg0:2 Drives, 30 Slots ( 1 Import/Export ) Data Transfer Element 0:Full (Storage Element 4 Loaded):VolumeTag = TFW546L2 Data Transfer Element 1:Full (Storage Element 3 Loaded):VolumeTag = TFW559L2 Storage Element 1:Empty Storage Element 2:Full :VolumeTag=TFW539L2 Storage Element 3:Empty Storage Element 4:Empty Storage Element 5:Full :VolumeTag=TFW605L2 Storage Element 6:Full :VolumeTag=TFW537L2 Storage Element 7:Full :VolumeTag=TFW550L2 Storage Element 8:Full :VolumeTag=TFW564L2 Storage Element 9:Full :VolumeTag=TFW552L2 Storage Element 10:Full :VolumeTag=TFW560L2 Storage Element 11:Full :VolumeTag=TFW565L2 Storage Element 12:Full :VolumeTag=TFW536L2 Storage Element 13:Full :VolumeTag=TFW549L2 Storage Element 14:Full :VolumeTag=TFW562L2 Storage Element 15:Full :VolumeTag=TFW563L2 Storage Element 16:Full :VolumeTag=TFW547L2 Storage Element 17:Full :VolumeTag=TFW540L2 Storage Element 18:Full :VolumeTag=TFW554L2 Storage Element 19:Full :VolumeTag=TFW561L2 Storage Element 20:Full :VolumeTag=TFW555L2 Storage Element 21:Full :VolumeTag=TFW558L2 Storage Element 22:Full :VolumeTag=TFW566L2 Storage Element 23:Full :VolumeTag=TFW556L2 Storage Element 24:Full :VolumeTag=TFW567L2 Storage Element 25:Full :VolumeTag=TFW568L2 Storage Element 26:Full :VolumeTag=TFW557L2 Storage Element 27:Full :VolumeTag=TFW551L2 Storage Element 28:Full :VolumeTag=TFW553L2 Storage Element 29:Full :VolumeTag=EPP993L1 Storage Element 30 IMPORT/EXPORT:Full :VolumeTag=CLNU01L1 # mtx -f /dev/sg1 status mtx: Request Sense: Long Report=yes mtx: Request Sense: Valid Residual=no mtx: Request Sense: Error Code=70 (Current) mtx: Request Sense: Sense Key=Illegal Request mtx: Request Sense: FileMark=no mtx: Request Sense: EOM=no mtx: Request Sense: ILI=no mtx: Request Sense: Additional Sense Code = 24 mtx: Request Sense: Additional Sense Qualifier = 00 mtx: Request Sense: Field in Error = 05 mtx: Request Sense: BPV=yes mtx: Request Sense: Error in CDB=yes mtx: Request Sense: SKSV=yes mtx: Request Sense: Field Pointer = 00 02 Mode sense (0x1A) for Page 0x1D failed mtx: Request Sense: Long Report=yes mtx: Request Sense: Valid Residual=no mtx: Request Sense: Error Code=70 (Current) mtx: Request Sense: Sense Key=Illegal Request mtx: Request Sense: FileMark=no mtx: Request Sense: EOM=no mtx: Request Sense: ILI=no mtx: Request Sense: Additional Sense Code = 20 mtx: Request Sense: Additional Sense Qualifier = 00 mtx: Request Sense: BPV=no mtx: Request Sense: Error in CDB=no mtx: Request Sense: SKSV=no READ ELEMENT STATUS Command Failed # mtx -f /dev/sg2 status mtx: Request Sense: Long Report=yes mtx: Request Sense: Valid Residual=no mtx: Request Sense: Error Code=70 (Current) mtx: Request Sense: Sense Key=Illegal Request mtx: Request Sense: FileMark=no mtx: Request Sense: EOM=no mtx: Request Sense: ILI=no mtx: Request Sense: Additional Sense Code = 24 mtx: Request Sense: Additional Sense Qualifier = 00 mtx: Request Sense: BPV=no mtx: Request Sense: Error in CDB=no mtx: Request Sense: SKSV=no Mode sense (0x1A) for Page 0x1D failed mtx: Request Sense: Long Report=yes mtx: Request Sense: Valid Residual=no mtx: Request Sense: Error Code=70 (Current) mtx: Request Sense: Sense Key=Illegal Request mtx: Request Sense: FileMark=no mtx: Request Sense: EOM=no mtx: Request Sense: ILI=no mtx: Request Sense: Additional Sense Code = 20 mtx: Request Sense: Additional Sense Qualifier = 00 mtx: Request Sense: BPV=no mtx: Request Sense: Error in CDB=no mtx: Request Sense: SKSV=no READ ELEMENT STATUS Command Failed Some other suggestions ? Thanks a lot anyway... Date: Tue, 3 Mar 2009 20:32:56 -0500 From: m...@ornl.gov Subject: Re: [Bacula-users] HP msl5030 misfunctions ... To: mum_la...@hotmail.com CC: bacula-users@lists.sourceforge.net On Tue, Mar 03,
[Bacula-users] performance problems backing up ocfs2 clusters
Hello folks, we're experiencing massive problems backing up an ocfs2 cluster filesystem mounted on SLES 10 SP2 machines located on a shared SAN storage). The cluster has 8 members, and we've already tried certain mount options (noatime et al.) in an attempt to improve performance, however bacula's transfer speeds drop down into the double kb / sec digits when it encounters directories which contain many small files (say about 20,000 per dir or so). The backup server in question is a Compaq dl360 (CentOS 5.2 on x86_64) which provides usually excellent performance when backing up other non-ocfs2 fileystems, so I was wondering if anyone has developed a successful strategy for backing up ocfs2 clusters (we're talking 160gb here, no it's not really a huge amount of data). Bacula Version used is 2.2.8 compiled from source, the file daemon on the target machine claims it's version Version: 2.4.3 (10 October 2008) x86_64-unknown-linux-gnu suse 10 Thanks in advance for any ideas or suggestions on this matter. All the best, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91- 4740 fax:-9722 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] restore file from old tape
Hi All, I have a very old volume and the records in not the the mysql database and no bsr file. How can I restore a directory from that tape. Any one has a solution to that please :( Regards, Prashant -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] regexdir stops bacula backup...
Ok,
I've read a bit quickly your answer, and tonight Bacula backup 33Go of data
(compressed) LOL...
I'm gonna change my way of doing... instead of a complex bacula
configuration, I'll move logs to another single location (for every website)
instead of a logs directory per website.
This server will soon be re installed and the way I manage website will
change totally, that's why I don't want to spend much time on this (I've
also a lot of other things to do and it's not my full time job)
Thanks Martin for your help !
Thomas.
On Tue, Mar 3, 2009 at 16:43, Martin Simmons mar...@lispworks.com wrote:
On Tue, 3 Mar 2009 15:20:46 +0100, Thomas Manson said:
Hi Martin,
So I should do this :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
*regexdir= /home/.*/web/public_html*
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
*File = /home*
}
}
Yes, that's a start.
you need to exclude everything that doesn't match the regex and include
all of the directories above /home/user1/web.
Well, I've nothing to backup between / and /home/*/web
What's the point of using regexdir if I have to exclude everything else ?
That's just how it works. Bacula doesn't scan the whole world looking for
something that matches the regexdir.
Instead, it searches down the tree starting from the 'File =' lines looking
for files to back up. To prevent something from being backed up, you must
exclude it by using an Exclude section or by using options with 'exclude =
yes'. See the *.gz example here:
http://www.bacula.org/en/rel-manual/Configuring_Director.html#SECTION00148
When you exclude a directory, it doesn't look any further. Therefore, to
back
up selected subdirectories of /home/*, you need to make Bacula select all
directories leading up to those you want to back up, without selecting any
of
ther contents. Something like this (not tested):
Include {
Options {
signature = SHA1
compression = GZIP
# include the dirs in /home
regexdir = ^/home/[^/]+$
# and include the web dirs of them
wilddir = /home/*/web
# and the public_html dirs within the web dirs
wilddir = /home/*/web/public_html
# and the contents of the public_html
wild = /home/*/web/public_html/*
}
Options {
# exclude everything else
Exclude = yes
wild = /home/*
}
File = /home
}
__Martin
For the fact that bacula FD stops with the regexp, I'll recheck, but I
don't
think their is something in the director's logs...
Thomas.
On Thu, Feb 26, 2009 at 21:44, Martin Simmons mar...@lispworks.com
wrote:
On Thu, 26 Feb 2009 10:00:26 +0100, Thomas Manson said:
Nobody has an idea?
Bacula uses the File lines as the roots when it looks for files and
none
of
yours are going to find files in /home/user1 etc. Also, you can't do
what
you
want directly with a single Options clause -- you need to exclude
everything
that doesn't match the regex and include all of the directories above
/home/user1/web.
Crashing is unexpected though. What does the Bacula log say? Can you
repeat
it on a local machine without the ssh tunnel?
__Martin
On Tue, Feb 24, 2009 at 22:19, Thomas Manson
dev.mansontho...@gmail.com
wrote:
I forgot to mention the bacula version :
server :
2.4.2-1ubuntu6
client : Redhat ES4 with version :
bacula-client-2.4.2-1.el4.i386.rpm
Thomas
On Tue, Feb 24, 2009 at 22:16, Thomas Manson
dev.mansontho...@gmail.comwrote:
Hi,
I want to backup this kind of directories :
/home/user1/web/public_html
/home/user2/web/public_html
/home/user3/web/public_html
/home/user4/web/public_html
and subdirectories.
I've run a find to list all dir of the home directory and test the
following regexp on it with success :
/home/.*/web/public_html (with quote in the configuration file).
When I run the backup, the job crashes :
My SSH tunnel is stopped and when I run another backup, it tells me
that
the last volume do not have the correct number of byte (can't
remember
the
exact message).
If I comment the regexdir, it works normally.
here is the fileSet :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
#regexdir= /home/.*/web/public_html
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
}
}
Any idea of how I can see what's going wrong?
Thx,
Re: [Bacula-users] cloning tapes for offsite storage
Brian McDonald schrieb: On Tuesday 03 March 2009 8:34:00 am Thomas wrote: so, last week i wrote a small perl script that uses bcopy to clone every volume from the FULL pool, that was written within the last 3 days, to offsite tapes. [snip] all bcopy's finished successful. but my restore tests failed. [snip] 1.) the bextract from the bcopied tapes shows errors on domino/notes datafiles : bextract JobId 0: -rw-r--r-- 1 2110 21103117678592 2009-02-27 22:38:34 /stage/backup/notes/data/mail/horst.nsf 02-Mär 19:47 bextract JobId 0: Error: attribs.c:421 File size of restored file /stage/backup/notes/data/mail/horst.nsf not correct. Original 3117678592, restored 10722668181. bextract JobId 0: -rw-r--r-- 1 2110 21101298399232 2009-02-27 22:50:32 /stage/backup/notes/data/mail/heinz.nsf 02-Mär 19:55 bextract JobId 0: Error: attribs.c:421 File size of restored file /stage/backup/notes/data/mail/heinz.nsf not correct. Original 1298399232, restored 7057145936. This smells like a sparse file (*) issue - it's possible the .nsf files allocate more than is actually in there, which can cause problems for backup/restore utilities. When you back these files up originally, is sparse=yes specified in the FileSet resource? sparse=yes is not in the config. a restore from the original tape shows no failures and notes is able to work with the restored .nsf. the File size errors appear only when restoring from the clone tape. something must go wrong while bcopy is copying the data from one tape to another. (*) - Sparse files are those where there is only data written to a portion of the file which is allocated in the file system. The O/S will return 0's for the empty sections even though those sections are not physically on the disk. When restoring a file that is sparse, if the program isn't aware of it, it'll write out the sparse areas as 0's, greatly increasing the real size of the file. http://www.bacula.org/en/rel-manual/Configuring_Director.html#SECTION00147 nearly 50% of the restored .nsf shows this error. and no: the files does not change their size while the backup runs. if i restore with bextract from the original tape and the unchanged booststrap all files are restored without errors. is there something special with these nsf files? i also saw this problem with directly backuped vmware disk images (.vmdk). VMWare disk images are sparse as well. Brian -- [:O]###[O:] -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] restore file from old tape
I have a very old volume and the records in not the the mysql database and no bsr file. How can I restore a directory from that tape. look out for bls, bextract and the bscan tool in http://www.bacula.org/en/ rel-manual/Volume_Utility_Tools.html - Thomas -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] regexdir stops bacula backup...
Well finally I think I'll need the regexdir to exclude some cache directory
inside website that are huge ;)
You didn't work for nothgin Martin ;)
Thanks,
Thomas.
On Wed, Mar 4, 2009 at 11:19, Thomas Manson dev.mansontho...@gmail.comwrote:
Ok,
I've read a bit quickly your answer, and tonight Bacula backup 33Go of data
(compressed) LOL...
I'm gonna change my way of doing... instead of a complex bacula
configuration, I'll move logs to another single location (for every website)
instead of a logs directory per website.
This server will soon be re installed and the way I manage website will
change totally, that's why I don't want to spend much time on this (I've
also a lot of other things to do and it's not my full time job)
Thanks Martin for your help !
Thomas.
On Tue, Mar 3, 2009 at 16:43, Martin Simmons mar...@lispworks.com wrote:
On Tue, 3 Mar 2009 15:20:46 +0100, Thomas Manson said:
Hi Martin,
So I should do this :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
*regexdir= /home/.*/web/public_html*
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
*File = /home*
}
}
Yes, that's a start.
you need to exclude everything that doesn't match the regex and
include
all of the directories above /home/user1/web.
Well, I've nothing to backup between / and /home/*/web
What's the point of using regexdir if I have to exclude everything else
?
That's just how it works. Bacula doesn't scan the whole world looking for
something that matches the regexdir.
Instead, it searches down the tree starting from the 'File =' lines
looking
for files to back up. To prevent something from being backed up, you must
exclude it by using an Exclude section or by using options with 'exclude =
yes'. See the *.gz example here:
http://www.bacula.org/en/rel-manual/Configuring_Director.html#SECTION00148
When you exclude a directory, it doesn't look any further. Therefore, to
back
up selected subdirectories of /home/*, you need to make Bacula select all
directories leading up to those you want to back up, without selecting any
of
ther contents. Something like this (not tested):
Include {
Options {
signature = SHA1
compression = GZIP
# include the dirs in /home
regexdir = ^/home/[^/]+$
# and include the web dirs of them
wilddir = /home/*/web
# and the public_html dirs within the web dirs
wilddir = /home/*/web/public_html
# and the contents of the public_html
wild = /home/*/web/public_html/*
}
Options {
# exclude everything else
Exclude = yes
wild = /home/*
}
File = /home
}
__Martin
For the fact that bacula FD stops with the regexp, I'll recheck, but I
don't
think their is something in the director's logs...
Thomas.
On Thu, Feb 26, 2009 at 21:44, Martin Simmons mar...@lispworks.com
wrote:
On Thu, 26 Feb 2009 10:00:26 +0100, Thomas Manson said:
Nobody has an idea?
Bacula uses the File lines as the roots when it looks for files and
none
of
yours are going to find files in /home/user1 etc. Also, you can't do
what
you
want directly with a single Options clause -- you need to exclude
everything
that doesn't match the regex and include all of the directories above
/home/user1/web.
Crashing is unexpected though. What does the Bacula log say? Can you
repeat
it on a local machine without the ssh tunnel?
__Martin
On Tue, Feb 24, 2009 at 22:19, Thomas Manson
dev.mansontho...@gmail.com
wrote:
I forgot to mention the bacula version :
server :
2.4.2-1ubuntu6
client : Redhat ES4 with version :
bacula-client-2.4.2-1.el4.i386.rpm
Thomas
On Tue, Feb 24, 2009 at 22:16, Thomas Manson
dev.mansontho...@gmail.comwrote:
Hi,
I want to backup this kind of directories :
/home/user1/web/public_html
/home/user2/web/public_html
/home/user3/web/public_html
/home/user4/web/public_html
and subdirectories.
I've run a find to list all dir of the home directory and test the
following regexp on it with success :
/home/.*/web/public_html (with quote in the configuration
file).
When I run the backup, the job crashes :
My SSH tunnel is stopped and when I run another backup, it tells
me
that
the last volume do not have the correct number of byte (can't
remember
the
exact message).
If I comment the regexdir, it works normally.
here is the fileSet :
FileSet {
Name = computer.domain.com.FileSet
Include {
Options {
signature = SHA1
compression = GZIP
#regexdir=
Re: [Bacula-users] performance problems backing up ocfs2 clusters
On Wed, 04 Mar 2009 11:24:22 +0100, Uwe Schuerkamp wrote: Hello folks, we're experiencing massive problems backing up an ocfs2 cluster filesystem mounted on SLES 10 SP2 machines located on a shared SAN storage). The cluster has 8 members, and we've already tried certain mount options (noatime et al.) in an attempt to improve performance, however bacula's transfer speeds drop down into the double kb / sec digits when it encounters directories which contain many small files (say about 20,000 per dir or so). look at Spool Attributes = yes (or even Spool data http:// www.bacula.org/en/rel-manual/Configuring_Director.html). you can also try to make little test how long it takes to tar the same files. something like tar -cf /dev/null path (ok i'm not an advanced tar user ...) . maybe ocfs2 is the bottleneck as it (maybe) has to communicate the reads with the other nodes? - Thomas -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HP msl5030 misfunctions ...
On Wed, Mar 04, 2009 at 08:29:37AM +, mimmo lariccia wrote: Hi Michael and thanks for fast answer... Hi all I hope you're right. But these are results of my tests: # lsscsi [0:0:0:0]mediumx COMPAQ MSL5000 Series 0423 - [0:0:0:1]tapeHP Ultrium 1-SCSI E38W /dev/st0 [0:0:0:2]storage HP NS E1200-160 530b - you indicated that there are two drives in your library. do both drives show up in the scsi bios when you boot the system? it would seem that the os is not seeing the first drive for some reason. -- michael -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HP msl5030 misfunctions ...
On Wed, Mar 4, 2009 at 3:29 AM, mimmo lariccia mum_la...@hotmail.com wrote: Hi Michael and thanks for fast answer... Hi all I hope you're right. But these are results of my tests: # lsscsi [0:0:0:0] mediumx COMPAQ MSL5000 Series 0423 - [0:0:0:1] tape HP Ultrium 1-SCSI E38W /dev/st0 [0:0:0:2] storage HP NS E1200-160 530b - # mtx -f /dev/sg0 status Storage Changer /dev/sg0:2 Drives, 30 Slots ( 1 Import/Export ) Use the tapeinfo command instead tapeinfo -f /dev/sg0 This works on any sg device # tapeinfo -f /dev/sg0 Product Type: CD-ROM Vendor ID: 'LITE-ON ' Product ID: 'DVDRW LDW-851S ' Revision: 'GS0C' Attached Changer: No SCSI ID: 0 SCSI LUN: 0 Ready: no # tapeinfo -f /dev/sg1 Product Type: Disk Drive Vendor ID: 'ATA ' Product ID: 'ST3750330AS ' Revision: 'SD04' Attached Changer: No SerialNumber: '3QK02QVL' SCSI ID: 0 SCSI LUN: 0 Ready: yes I don't have a tape drive connected here at home so I can not show you tape or changer results but I know this works at work. John -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] mark a directory to be excluded from backup
Thomas Manson schrieb:
Hi,
I wonder if it is possible to mark a directory to be exclude from the
backup by another mean that the bacula-dir.conf.
Here we have a centralized configuration for what is to be backup,
while I think a distributed configuration would be more efficient and
easy to handle (Ok, not in every case, but in my case I don't get why
the director should know every thing about it's clients file system)
For example, if a directory would contain an empty file
.bacula_exclude_dir own by a specific user, the file daemon would not
backup this dir even if inside a directory mention with a File=
this can be easily done by something like:
find /home/thomas/test/ -name .exclude | sed 's/.exclude//'
/home/thomas/test/excludelist
and then specify
Exclude {
File = \\/home/thomas/test/excludelist
}
in the Fileset.
you can configure the includelist in the same way on the client.
Or a file like the robot.txt that one left for search engines so they
know what to index and what not.
If the filedaemon find a file like .bacula_directives, it would follow
that list of directives for all subdir of the current dir.
Or even a configuration file for the file daemon. It's easier to
modifiy (with scripts) a conf file on the client, that to automatically
update the director conf file from the client (quite impossible in fact).
Ok, it's a bit intrusive, but as far as I know bacula, if the only way
to exclude a directory is to write some complex config in
bacula-dir.conf, it's very cumbersome !
In my case, on the machine I add very often new websites, each one
with specific structure with some files to be backup some not.
this would lead to huge config file or huge amount of data backuped
for nothing...
What do you think about that?
Thomas.
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
[:O]###[O:]
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] mark a directory to be excluded from backup
Hi Thomas,
Thanks for the tip,
even If I need to update the director conf file each time I add a website,
it's easy enough to be usable.
Thanks again,
Thomas.
On Wed, Mar 4, 2009 at 14:45, Thomas tho...@ic3s.de wrote:
Thomas Manson schrieb:
Hi,
I wonder if it is possible to mark a directory to be exclude from the
backup by another mean that the bacula-dir.conf.
Here we have a centralized configuration for what is to be backup,
while I think a distributed configuration would be more efficient and
easy to handle (Ok, not in every case, but in my case I don't get why
the director should know every thing about it's clients file system)
For example, if a directory would contain an empty file
.bacula_exclude_dir own by a specific user, the file daemon would not
backup this dir even if inside a directory mention with a File=
this can be easily done by something like:
find /home/thomas/test/ -name .exclude | sed 's/.exclude//'
/home/thomas/test/excludelist
and then specify
Exclude {
File = \\/home/thomas/test/excludelist
}
in the Fileset.
you can configure the includelist in the same way on the client.
Or a file like the robot.txt that one left for search engines so they
know what to index and what not.
If the filedaemon find a file like .bacula_directives, it would follow
that list of directives for all subdir of the current dir.
Or even a configuration file for the file daemon. It's easier to
modifiy (with scripts) a conf file on the client, that to automatically
update the director conf file from the client (quite impossible in fact).
Ok, it's a bit intrusive, but as far as I know bacula, if the only way
to exclude a directory is to write some complex config in
bacula-dir.conf, it's very cumbersome !
In my case, on the machine I add very often new websites, each one
with specific structure with some files to be backup some not.
this would lead to huge config file or huge amount of data backuped
for nothing...
What do you think about that?
Thomas.
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
CA
-OSBC tackles the biggest issue in open source: Open Sourcing the
Enterprise
-Strategies to boost innovation and cut costs with open source
participation
-Receive a $600 discount off the registration fee with the source code:
SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
[:O]###[O:]
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
CA
-OSBC tackles the biggest issue in open source: Open Sourcing the
Enterprise
-Strategies to boost innovation and cut costs with open source
participation
-Receive a $600 discount off the registration fee with the source code:
SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows restore: Can not browse files
On Tue, 17 Feb 2009 01:34:24 +0100, Thomas Lindgaard
tho...@it-snedkeren.dk wrote:
cwd is: /
$ ls
C:/
$ cd C:/
cwd is: C:/
$ ls
/
$
I can not change directories for some reason... I have tried doing the
same using the Webmin Bacula Module and the bwx-console with similar
results.
I thought this was answered a couple of days ago, looks like you
capitalized the drive letter, try something like this:
FileSet {
Name = your fileset name
Include {
Options {
signature = MD5
Exclude = yes
# 1. don't use slash at the end or the directory will be ignored
# 2. explicit paths can be excluded here or in the Exclude section,
WildDir/File (i.e. regexp) only here
# 3. only lower case drive letters and forward slashes work properly, e.g.
File = C:\\Documents and Settings\\Administrator only allows restore of
single files
WildDir = c:/Documents and Settings/*/Local Settings/Temporary
Internet Files
WildDir = c:/Documents and Settings/*/Local Settings/History
WildDir = c:/Documents and Settings/*/Local Settings/Temp
WildDir = c:/Documents and Settings/*/NetHood
WildDir = c:/Documents and Settings/*/PrintHood
}
File = c:/
# if you have .net 2.0, explicitly include this, it is otherwise not
backed up (regardless, you will keep seeing an error because of the
previous include)
File =
c:/WINDOWS/assembly/GAC_32/System.EnterpriseServices/2.0.0.0__b03f5f7f11d50a3a
}
Exclude {
File = c:/pagefile.sys
File = c:/Documents and Settings/All Users/Application
Data/Bacula/Spool
File = c:/Documents and Settings/All Users/Application
Data/Bacula/Work
File = c:/RECYCLER
File = c:/WINDOWS/Temp
# File = c:/System Volume Information
}
}
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] mark a directory to be excluded from backup
Yes, that sounds good ;) I'll set a cron job that get the exclude file list on each client with scp before the backup job. Thomas. On Wed, Mar 4, 2009 at 15:40, John Drescher dresche...@gmail.com wrote: Hi Thomas, Thanks for the tip, even If I need to update the director conf file each time I add a website, it's easy enough to be usable. Thanks again, Thomas. In this method you should just update the external file. Unless the new website is not in the path of the include fileset already. John -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] mark a directory to be excluded from backup
Thomas Manson wrote: Hi, I wonder if it is possible to mark a directory to be exclude from the backup by another mean that the bacula-dir.conf. Here we have a centralized configuration for what is to be backup, while I think a distributed configuration would be more efficient and easy to handle (Ok, not in every case, but in my case I don't get why the director should know every thing about it's clients file system) For example, if a directory would contain an empty file .bacula_exclude_dir own by a specific user, the file daemon would not backup this dir even if inside a directory mention with a File= Well, FWIW, this is implemented, but not released. See http://www.bacula.org/manuals/en/concepts/concepts/New_Features.html Look for Exclude Dirs Containing Now in the SVN version, coming soon to a release near you. Is this what you're looking for? -- Dan Langille BSDCan - The Technical BSD Conference : http://www.bsdcan.org/ PGCon - The PostgreSQL Conference: http://www.pgcon.org/ -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula hang issue. was: bacula sometimes, gets stuck when volume wanted is already in a different drive
Pasi Karkkainen wrote: On Mon, Mar 02, 2009 at 10:56:41AM +0200, Silver Salonen wrote: Thanks a lot for the notice, dude! I configured my Bacula to use 30+ devices again on saturday and it has been OK for 2 days now (I don't think it would have been previously). If I'll have any problems, I'll let the list know :) 2.4.4-sd-deadlock.patch also fixed my problems with Bacula 2.4.4 SD getting stuck! To all: If the patch worked for you, it would be good if you mentioned that in the bug: http://bugs.bacula.org/view.php?id=1213 Feedback is beneficial. -- Pasi -- Silver On Friday 27 February 2009 23:35:31 Bob Hetzel wrote: Silver, I recently obtained a patch for the bug I was running into which may be similar to your bug. Do you compile your own bacula? If so, the bug is # 1213 The direct link to the case is at... http://bugs.bacula.org/view.php?id=1213 The patch attached to the case is 2.4.4-sd-deadlock.patch Bob From: Silver Salonen sil...@ultrasoft.ee Subject: Re: [Bacula-users] bacula hang issue. was: bacula sometimes getsstuck when volume wanted is already in a different drive To: bacula-users@lists.sourceforge.net Message-ID: 200902051319.44057.sil...@ultrasoft.ee Content-Type: text/plain; charset=utf-8 OK, so.. it seems I'm on my own again.. anyone else experiencing this problem? The problem (once again): all the jobs that are not waiting for execution (or for any other resource), are waiting on storage. And I still can't understand how can this be a support request and why it can't be considered a bug :S Could anyone else check the current information and see why it's not a bug? PS. I'm sorry I can't let it go.. but my backups are hung every night :( -- Silver -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Dan Langille BSDCan - The Technical BSD Conference : http://www.bsdcan.org/ PGCon - The PostgreSQL Conference: http://www.pgcon.org/ -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HP msl5030 misfunctions ...
Date: Wed, 4 Mar 2009 08:19:42 -0500 From: m...@ornl.gov Subject: Re: [Bacula-users] HP msl5030 misfunctions ... To: mum_la...@hotmail.com CC: gallowa...@ornl.gov; bacula-users@lists.sourceforge.net On Wed, Mar 04, 2009 at 08:29:37AM +, mimmo lariccia wrote: Hi Michael and thanks for fast answer... Hi all I hope you're right. But these are results of my tests: # lsscsi [0:0:0:0]mediumx COMPAQ MSL5000 Series 0423 - [0:0:0:1]tapeHP Ultrium 1-SCSI E38W /dev/st0 [0:0:0:2]storage HP NS E1200-160 530b - you indicated that there are two drives in your library. do both drives show up in the scsi bios when you boot the system? it would seem that the os is not seeing the first drive for some reason. -- michael Hi Michael. My O.S. indicates during boot the same devices You see in the lsscsi... This may be due to a configuration of Storage_Router, inside the Tape Library, that bridges FC connection with SCSI ones on Tapes. But I think hardware problem may not exclude in this way communications between bacula and its items... There's something that I'm missing... Thanks anyway!!! :) Cheers. _ News, entertainment and everything you care about at Live.com. Get it now! http://www.live.com/getstarted.aspx-- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HP msl5030 misfunctions ...
Date: Wed, 4 Mar 2009 08:34:09 -0500 Subject: Re: [Bacula-users] HP msl5030 misfunctions ... From: dresche...@gmail.com To: mum_la...@hotmail.com; Bacula-users@lists.sourceforge.net On Wed, Mar 4, 2009 at 3:29 AM, mimmo lariccia mum_la...@hotmail.com wrote: Hi Michael and thanks for fast answer... Hi all I hope you're right. But these are results of my tests: # lsscsi [0:0:0:0]mediumx COMPAQ MSL5000 Series 0423 - [0:0:0:1]tapeHP Ultrium 1-SCSI E38W /dev/st0 [0:0:0:2]storage HP NS E1200-160 530b - # mtx -f /dev/sg0 status Storage Changer /dev/sg0:2 Drives, 30 Slots ( 1 Import/Export ) Use the tapeinfo command instead tapeinfo -f /dev/sg0 This works on any sg device # tapeinfo -f /dev/sg0 Product Type: CD-ROM Vendor ID: 'LITE-ON ' Product ID: 'DVDRW LDW-851S ' Revision: 'GS0C' Attached Changer: No SCSI ID: 0 SCSI LUN: 0 Ready: no # tapeinfo -f /dev/sg1 Product Type: Disk Drive Vendor ID: 'ATA ' Product ID: 'ST3750330AS ' Revision: 'SD04' Attached Changer: No SerialNumber: '3QK02QVL' SCSI ID: 0 SCSI LUN: 0 Ready: yes I don't have a tape drive connected here at home so I can not show you tape or changer results but I know this works at work. John Hi John. It works correctly on /dev/sg0. Shows me the model HP MSL5030, the revision and so on, as in Your example... On /dev/sg1 I see the TAPEDRIVE data... On /dev/sg2 I see the Storage_Router data... I agree with You: there's something wrong in the Storage_Router configuration. But I'm thinking if this condition may confuse bacula or not, because I've excluded 2.nd drive from Storage-daemon configuration. Thanks anyway. :) Cheers. _ Invite your mail contacts to join your friends list with Windows Live Spaces. It's easy! http://spaces.live.com/spacesapi.aspx?wx_action=createwx_url=/friends.aspxmkt=en-us-- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] mark a directory to be excluded from backup
Yes exactly ! But I'll keep to the version of bacula shipped in ubuntu repo (safer). Thanks for the info. Thomas. On Wed, Mar 4, 2009 at 16:02, Dan Langille d...@langille.org wrote: Thomas Manson wrote: Hi, I wonder if it is possible to mark a directory to be exclude from the backup by another mean that the bacula-dir.conf. Here we have a centralized configuration for what is to be backup, while I think a distributed configuration would be more efficient and easy to handle (Ok, not in every case, but in my case I don't get why the director should know every thing about it's clients file system) For example, if a directory would contain an empty file .bacula_exclude_dir own by a specific user, the file daemon would not backup this dir even if inside a directory mention with a File= Well, FWIW, this is implemented, but not released. See http://www.bacula.org/manuals/en/concepts/concepts/New_Features.html Look for Exclude Dirs Containing Now in the SVN version, coming soon to a release near you. Is this what you're looking for? -- Dan Langille BSDCan - The Technical BSD Conference : http://www.bsdcan.org/ PGCon - The PostgreSQL Conference: http://www.pgcon.org/ -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Job Migration on setup with lots of file storages
Hi,
I have a setup with 1 storage device for each client I backup.
If I got the documentation right I need to have different Media Types
for concurent backups to work.
Device {
Name = Storage_1-dev
Media Type = Storage_1-file
Archive Device = /mount/device_1
Device Type = File;
LabelMedia = yes;
Random Access = Yes;
AutomaticMount = yes;
RemovableMedia = no;
}
Device {
Name Storage_2-dev
Media Type = Storage_2-file
Archive Device = /mount/device_2
#all other options just like first device
}
Device {
Name Migrate_Storage_1-dev
Media Type = Storage_1-file
#all other options just like first device
}
Now when I try to do a migration job from Storage_1-dev to
Migrate_Storage_1-dev it fails with the following error:
04-Mar 16:09 backup-sd JobID 219: acquire.c:116 Changing read device.
Want Media Type=File have=Storage_1-file
When I set Media Type = File for Storage_1-dev and Migrate_Storage_1-dev
the Migration works.
So right now concurent backups to lots of different disks over a couple
of network interfaces is bottlenecked by having to set all Media Types =
File if I want to use Migration. Did I get it right?
Another question that arises is:
How can I setup a system with concurent backups for all clients that
migrates jobs that need to be archived for a long time (2+ years) on one
tape-changer device?
Versions used: debian lenny with bacula 2.4.4 (28 December 2008)
x86_64-pc-linux-gnu debian lenny/sid
cheers
Andreas Bogacki
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] recover partial readable tape (was: I/O error with quantum lto-4)
hi i've found out, that the error on tape is between file 4 and 20. i can successfull forward space to file 20 (mt -f /dev/nst0 20). reading from file 0 with dd if=/dev/nst0 of=/dev/null bs=64512 works until file 4 and 235MB. Is there a way to reassemble the two parts of the file and reread them with bacula? i've not found any option like skip file 4 to 20 with the bextract,bscan,bls tools i've allready read the first part of the tape to a file and tried to read it from there. No luck so far: bls: match.c:249-0 add_fname_to_include prefix=0 gzip=0 fname=/ bls: butil.c:282 Using device: /srv/backup/vtl for reading. 04-Mar 16:50 bls JobId 0: Ready to read from volume ARCHIVE- on device FileStorage (/srv/backup/vtl). 04-Mar 16:50 bls JobId 0: Error: block.c:275 Volume data error at 0:64511! Wanted ID: BB02, got . Buffer discarded. 0 files found. bls: acquire.c:436-0 dir_update_vol_info. label=64 Vol=ARCHIVE- seems that not all data is in correct order. if i do a strings ARCHIVE-: BB02 Bacula 1.0 immortal ARCHIVE- Archive Backup LTO-4 backuphost backuphost-sd Ver. 2.2.8 26 January 2008 Build Mar 28 2008 17:04:06 ... so BB02 seems to be there. anybody allready did such a tape reassembling? or if any programmer is out there: is it a big task to implement a skip file(s) option to the volume utilities? - Thomas -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] HP msl5030 misfunctions ... Part 1 / 2
I did it!!! (And of course solution was in this mailing list - archives!). All my troubles was in rights assigned to /usr/sbin/b_files of bacula-mysql' rpm (everyone root:root). Perhaps, changing nologin to bacula user in a real shell, I've verified that btape _ test , working perfectly by root, but wasn't operative if executed by bacula. Now all /usr/sbin/b_files from rpm bacula-mysql has owner root:disk, and library works perfectly... --- Now I've to work to Part 2 / 2 that need revision of Storage_Router configuration of my Tape Library, but I can do it with less pression! Thanks to all for Your help! Cheers... _ Invite your mail contacts to join your friends list with Windows Live Spaces. It's easy! http://spaces.live.com/spacesapi.aspx?wx_action=createwx_url=/friends.aspxmkt=en-us-- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] recover partial readable tape
Hi, 04.03.2009 17:01, Thomas Mueller wrote: hi i've found out, that the error on tape is between file 4 and 20. i can successfull forward space to file 20 (mt -f /dev/nst0 20). Good start. reading from file 0 with dd if=/dev/nst0 of=/dev/null bs=64512 works until file 4 and 235MB. Is there a way to reassemble the two parts of the file and reread them with bacula? i've not found any option like skip file 4 to 20 with the bextract,bscan,bls tools You should use a bootstrap file to that purpose. The easiest way would be to initiate a restore from the console, and when all is done, instead of starting the job, copy the created bootstrap file and cancel the restore. Then, in the bootstrap file, remove all records pointing to tape files 5 to 19. Alternatively, it's not too big a task to manually write a minimal bootstrap file, omitting the files in question. When restoring, I guess you can expect problems with the files that have data partly in the affected tape files, but that might still be better than getting back nothing at all. i've allready read the first part of the tape to a file and tried to read it from there. No luck so far: bls: match.c:249-0 add_fname_to_include prefix=0 gzip=0 fname=/ bls: butil.c:282 Using device: /srv/backup/vtl for reading. 04-Mar 16:50 bls JobId 0: Ready to read from volume ARCHIVE- on device FileStorage (/srv/backup/vtl). 04-Mar 16:50 bls JobId 0: Error: block.c:275 Volume data error at 0:64511! Wanted ID: BB02, got . Buffer discarded. 0 files found. bls: acquire.c:436-0 dir_update_vol_info. label=64 Vol=ARCHIVE- seems that not all data is in correct order. if i do a strings ARCHIVE-: I'd use bls with j, k, L, p and v options to get a better idea of what actually is in the resulting volume file. BB02 Bacula 1.0 immortal ARCHIVE- Archive Backup LTO-4 backuphost backuphost-sd Ver. 2.2.8 26 January 2008 Build Mar 28 2008 17:04:06 ... so BB02 seems to be there. But we don't know if it'S in the right place, i.e. where Bacula expects the header data... anybody allready did such a tape reassembling? Well... kind of. Not with tape files unreadable, but with extra or missing EOF marks. It's not exactly fun, but better than losing data in most cases :-) or if any programmer is out there: is it a big task to implement a skip file(s) option to the volume utilities? I guess you'll get a response similar to manually edit the bootstrap file; the feature doesn't seem to be critical to most users, so we won't invest much there as long as more pressing projects are pending. Arno - Thomas -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Arno Lehmann IT-Service Lehmann Sandstr. 6, 49080 Osnabrück www.its-lehmann.de -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Restoring from volumes on multiple storages
On Thu, Feb 26, 2009 at 02:23:04PM +, Graham Keeling wrote: One kludgy solution that I may have a go at trying is to make the director write out a separate .bsr file containing the correct set of volumes that it needs for each Storage, and then doing multiple run job= commands. This will set off multiple restores and you'd end up with multiple confirmation messages. It might all go horribly wrong if you're using plugins, mind. After trying to make the above work and not liking it very much, I realised that there might be a better way. The way that a restore job works is that the director... a) opens a connection to the storage daemon b) opens a connection to the file daemon c) sends the storage daemon address to the file daemon and waits for a response (file daemon contacts the storage daemon) d) sends the bootstrap file to the file daemon e) sends the restore commands to the file daemon (file daemon sends the bootstrap file to the storage daemon and starts receiving data) f) waits for the file daemon to finish g) waits for the storage daemon to finish I think it's possible to change the process so that the director and file daemons open connections to a series of storage daemons during one job, and the file daemon sends each storage daemon the relevant segment of .bsr file. The director could insert 'Storage =' lines into the .bsr file and the file daemon could parse the individual chunks out to the storage daemons. I may have a go at making it do this. -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] recover partial readable tape
Is there a way to reassemble the two parts of the file and reread them with bacula? i've not found any option like skip file 4 to 20 with the bextract,bscan,bls tools You should use a bootstrap file to that purpose. The easiest way would be to initiate a restore from the console, and when all is done, instead of starting the job, copy the created bootstrap file and cancel the restore. Then, in the bootstrap file, remove all records pointing to tape files 5 to 19. Alternatively, it's not too big a task to manually write a minimal bootstrap file, omitting the files in question. the problem is, that the data isn't in the catalog anymore. it got pruned after 6 months. the client limit was accidentially set to this value... also see my bls comment below. but just thought about it, and there has to be a backup from the catalog. where the ARCHIVE- volume is still available with file entries. When restoring, I guess you can expect problems with the files that have data partly in the affected tape files, but that might still be better than getting back nothing at all. yeah, better loose 16GB than 1,3TB. :) i've allready read the first part of the tape to a file and tried to read it from there. No luck so far: bls: match.c:249-0 add_fname_to_include prefix=0 gzip=0 fname=/ bls: butil.c:282 Using device: /srv/backup/vtl for reading. 04-Mar 16:50 bls JobId 0: Ready to read from volume ARCHIVE- on device FileStorage (/srv/backup/vtl). 04-Mar 16:50 bls JobId 0: Error: block.c:275 Volume data error at 0:64511! Wanted ID: BB02, got . Buffer discarded. 0 files found. bls: acquire.c:436-0 dir_update_vol_info. label=64 Vol=ARCHIVE- seems that not all data is in correct order. if i do a strings ARCHIVE-: I'd use bls with j, k, L, p and v options to get a better idea of what actually is in the resulting volume file. problem: the tape drive doesn't go over file 4, it's running in circles telling me that it skipped a block but next message telling me again that the same block is beeing skipped (and so on). if i do an mt fsf 5 i need to rewind the tape to get access again, else it will print i/o error. so the bacula utilities won't give me a file list and restoring the whole job doesn't work because of the defective area. sort of henn/egg problem. or if any programmer is out there: is it a big task to implement a skip file(s) option to the volume utilities? I guess you'll get a response similar to manually edit the bootstrap file; the feature doesn't seem to be critical to most users, so we won't invest much there as long as more pressing projects are pending. think the feature is cirtical for users whose catalog entries got pruned, no (maybe a really old one is needed) catalog backup is available and the tape is not in a good state. Thanks - Thomas -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] use of multiple tape drives
Thanks, François I don't think I had specified it at the Client resource. Jobs was unnecessary, since I am looking to run multiple jobs simultaneously, rather than two instances of the same job at the same time. The others I had specified. We'll give it another try and see what we can make happen. On Feb 26, 2009 10:45am, François Mehault francois.meha...@netplus.fr wrote: Have you precised the directives Max concurrent jobs in the Director, Job, Client, and Storage resources. ? http://www.bacula.org/en/dev-manual/Tips_Suggestions.html#SECTION003817 De : rjustinwilli...@gmail.com [mailto:rjustinwilli...@gmail.com] Envoyé : jeudi 26 février 2009 16:34 À : Bacula-users@lists.sourceforge.net Objet : [Bacula-users] use of multiple tape drives Hi all I have a tape library w/ 2 drives. I have max jobs set to 3 in bacula-dir.conf I have autoselect set to yes in bacula-sd.conf For some reason, when I am trying to run 2 concurrent jobs of the same of different priority, Bacula is only using 1 tape drive. Obviously, I am missing something, but, kinda stumped as to what that might be. Anybody have some pointers on a direction I need to be checking? Thanks! -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula on Solaris 10 or SXCE
No problem Von: mehma sarja [mailto:mehmasa...@gmail.com] Gesendet: Donnerstag, 5. März 2009 01:34 An: Fahrer, Julian Betreff: Re: [Bacula-users] Bacula on Solaris 10 or SXCE Got it compiled ... THANKS! Yudhvir === On Wed, Mar 4, 2009 at 12:44 AM, Fahrer, Julian jul...@fahrer.net wrote: I usually compile bacula out of the box on a fresh solaris 10 installation. I'm using the gcc that ships with solaris (/usr/sfw/bin). Maybe you just need to set your environment to the correct parameters. Set yout path to: /usr/local/bin /usr/sfw/bin /usr/bin /sbin /usr/sbin /bin /usr/dt/bin /usr/ccs/bin /usr/ucb /usr/openwin/bin /etc runtime linking environment: crle -c /var/ld/ld.config -l /usr/local/lib:/usr/sfw/lib:/usr/lib:/lib compile: ./configure --prefix=/usr/local/bacula --with-scriptdir=/usr/local/bacula/scripts --sysconfdir=/etc/bacula --localstatedir=/var/bacula \ --with-working-dir=/var/bacula/working --with-fd-user=root --with-fd-group=root --enable-client-only make make install Von: mehma sarja [mailto:mehmasa...@gmail.com] Gesendet: Mittwoch, 4. März 2009 01:21 An: Fahrer, Julian Betreff: Re: [Bacula-users] Bacula on Solaris 10 or SXCE Thanks Julian! It seems that I just pawned off the task to you. I have been trying to get the thing compiled and found out that I need a bunch of packages installed. Our scratch machine went off-line and I am trying to get it back. If you need anything, let me know. Yudhvir === On Tue, Mar 3, 2009 at 10:55 AM, Fahrer, Julian jul...@fahrer.net wrote: Hi, I don't have a sparc version running. But I got some old sparc boxes here. I will try to compile a client for you when I have the time (maybe on the weekend). Regards Julian Von: mehma sarja [mailto:mehmasa...@gmail.com] Gesendet: Dienstag, 3. März 2009 00:56 An: Fahrer, Julian Betreff: Re: [Bacula-users] Bacula on Solaris 10 or SXCE I am looking for a bacula-fd binary for a sparc Solaris 10. If you have a compiled version, and don't mind parting with a copy... Yudhvir === On Wed, Feb 4, 2009 at 8:37 AM, Fahrer, Julian jul...@fahrer.net wrote: Hi, I am running bacula dir, sd and fd on solaris 10 u5, pretty stable so far. I'm also running a fd on a solaris 10 u6 box without any problems. Kind regards julian -Ursprüngliche Nachricht- Von: Brian Debelius [mailto:bdebel...@intelesyscorp.com] Gesendet: Mittwoch, 4. Februar 2009 17:27 An: bacula-users Betreff: [Bacula-users] Bacula on Solaris 10 or SXCE Hi, I have watched a few threads go by about compiling Bacula on Solaris, and I have not come to the conclusion as to whether anyone has gotten it to run and be stable. So.. Does Bacula compile? Does Bacula run reliably once compiled? -- Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) software. With Adobe AIR, Ajax developers can use existing skills and code to build responsive, highly engaging applications that combine the power of local resources and data with the reach of the web. Download the Adobe AIR SDK and Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) software. With Adobe AIR, Ajax developers can use existing skills and code to build responsive, highly engaging applications that combine the power of local resources and data with the reach of the web. Download the Adobe AIR SDK and Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source
