Re: [Bacula-users] Job not appearing in console
In response to Luke Taylor [EMAIL PROTECTED]:
Thanks for replying, FYI the jobs don't have the same name but below is the
directors configuration file excluding passwords.
FYI I have since addded another job resource which also doesn't appear on
the list.the jobs in question are hignlighted in boldbut just incase
it doesn't get displayed I have put the job resource just below.
Please don't rely on HTML to communicate for you. The bold doesn't
display on my MUA, and I had to do a good bit of fscking around to
figure out which jobs you were having trouble with. Do I have the
correct two?
Job {
Name = Twiki Server
JobDefs = Twiki
Type = Backup
Level = Full
Client = twiki-fd
FileSet = Twiki Set
Schedule = twiki-fd
Write Bootstrap = /usr/local/bacula/bin/working/twiki.bsr
}
Job {
Name = Autonet Server
JobDefs = Autonet
Type = Backup
Level = Full
Client = jspautonet-fd
FileSet = Webserver Set
Schedule = jspautonet-fd
Write Bootstrap = /usr/local/bacula/bin/working/jspautonet.bsr
}
I looked at this yesterday and couldn't find anything wrong, then looked
at it again this morning and still can see anything obviously wrong.
So I'm guessing. I don't believe that spaces in job names would cause
any problems, but it's the only thing I can see that stands out. Trying
removing the spaces from your various names (JobDefs, Job, FileSet) and
see if the problem persists. Hope this isn't a wild goose chase for
you, but I don't have any other ideas.
Another good idea would be to start the director in the foreground with
debugging turned on and see if it reports anything helpful. See the
docs for the details on how to do this.
--
Bill Moran
Collaborative Fusion Inc.
IMPORTANT: This message contains confidential information and is intended only
for the individual named. If the reader of this message is not an intended
recipient (or the individual responsible for the delivery of this message to an
intended recipient), please be advised that any re-use, dissemination,
distribution or copying of this message is prohibited. Please notify the
sender immediately by e-mail if you have received this e-mail by mistake and
delete this e-mail from your system.
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Job not appearing in console
Hi there, the jobs I was referring to are:
Job {
Name = Autonet Server
JobDefs = Autonet
Type = Backup
Level = Full
Client = jspautonet-fd
FileSet = Webserver Set
Schedule = jspautonet-fd
Write Bootstrap = /usr/local/bacula/bin/working/jspautonet.bsr
}
Job {
Name = Backupmxdev
JobDefs = MXdev
Type = Backup
Level = Full
Client = mxdev-fd
FileSet = Mxdev Set
Schedule = mxdev-fd
Write Bootstrap = /usr/local/bacula/bin/working/mxdev.bsr
}
One of which has no spaces in the name. This is really baffling me as I have
had it working on another server, if it wasn't such a low spec machine I
would just leave it on there. I really appreciate your help in this matter.
I will have a try at taking all the spaces out of names although as the
above 2 jobs are different in that respect I can't see it working but like I
said I will give it a go.
Regards
Luke
-Original Message-
From: Bill Moran [mailto:[EMAIL PROTECTED]
Sent: 15 November 2006 14:38
To: [EMAIL PROTECTED]
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Job not appearing in console
In response to Luke Taylor [EMAIL PROTECTED]:
Thanks for replying, FYI the jobs don't have the same name but below
is the directors configuration file excluding passwords.
FYI I have since addded another job resource which also doesn't appear
on the list.the jobs in question are hignlighted in boldbut
just incase it doesn't get displayed I have put the job resource just
below.
Please don't rely on HTML to communicate for you. The bold doesn't display
on my MUA, and I had to do a good bit of fscking around to figure out which
jobs you were having trouble with. Do I have the correct two?
Job {
Name = Twiki Server
JobDefs = Twiki
Type = Backup
Level = Full
Client = twiki-fd
FileSet = Twiki Set
Schedule = twiki-fd
Write Bootstrap = /usr/local/bacula/bin/working/twiki.bsr
}
Job {
Name = Autonet Server
JobDefs = Autonet
Type = Backup
Level = Full
Client = jspautonet-fd
FileSet = Webserver Set
Schedule = jspautonet-fd
Write Bootstrap = /usr/local/bacula/bin/working/jspautonet.bsr
}
I looked at this yesterday and couldn't find anything wrong, then looked at
it again this morning and still can see anything obviously wrong.
So I'm guessing. I don't believe that spaces in job names would cause any
problems, but it's the only thing I can see that stands out. Trying
removing the spaces from your various names (JobDefs, Job, FileSet) and see
if the problem persists. Hope this isn't a wild goose chase for you, but I
don't have any other ideas.
Another good idea would be to start the director in the foreground with
debugging turned on and see if it reports anything helpful. See the docs
for the details on how to do this.
--
Bill Moran
Collaborative Fusion Inc.
IMPORTANT: This message contains confidential information and is intended
only for the individual named. If the reader of this message is not an
intended recipient (or the individual responsible for the delivery of this
message to an intended recipient), please be advised that any re-use,
dissemination, distribution or copying of this message is prohibited.
Please notify the sender immediately by e-mail if you have received this
e-mail by mistake and delete this e-mail from your system.
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Performance problems
Hello, i want restore a simple file from a FULL job which is not that big. and it took 10 hours to build the directory-tree. job informations: Type | Level | JobFiles | JobBytes| JobStatus | B| F | 913,065 | 17,818,106,395 | T -- i have already checked if there are all recomented indexes in the databases. but they are all there. database: mysql bacula-director and bacula-sd are not on the same server - are there any hints to improve this situation? thanks for any suggestions and ideas! greetings from Grenzach in Germany manuel staechele - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Performance problems
On 11/15/06, Manuel Staechele [EMAIL PROTECTED] wrote: Hello,i want restore a simple file from a FULL job which is not that big.and it took 10 hours to build the directory-tree.job informations:Type | Level | JobFiles | JobBytes| JobStatus | B| F |913,065 |17,818,106,395 | T--i have already checked if there are all recomented indexes in thedatabases. but they are all there. Usually this is a problem with the database but I see that you have checked the indexes. I have a few questions. Is the pc with the database installed recent? What version of bacula are you running? Did the hard drive thrash continuously for the time it was building the tree? What was your cpu load during the tree build? database: mysqlbacula-director and bacula-sd are not on the same server This should only make a difference for the actual restore and not the build tree step.John - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Data transfer rates
Thomas Traeger wrote: Excellent point. The servers that are slowest to transfer are also the busiest, my front end web server and my mail gateways (Av and spam filtering). That is certainly something to look further into. I could try turning off compression for one cycle to prove the theory. Thanks, DAve You might also try reducing the compression level to gzip1/2/3 (default is gzip5), especially on the VLAN this might help. In my case all servers have a 1GBit connection to the backup system and software compression is useless as long as you backup on a tape drive with hardware compression. Compression was the culprit! After much testing and trying specific clients and compression levels it seems that I can transfer uncompressed data across a 1gb network faster than I can compress the data on the client. This was tested last on a very busy web server, which really is never not busy. The overhead of compression exceeded the gains of transfering data compressed. So depending on what load/cpu/ram a client has, compression should be altered. It is a trade off of speed verses storage space. I can adjust each job as required. Just one more way Bacula's complexity pays off. Thanks everyone. DAve -- Three years now I've asked Google why they don't have a logo change for Memorial Day. Why do they choose to do logos for other non-international holidays, but nothing for Veterans? Maybe they forgot who made that choice possible. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] mac os x backup problem
Run Bacula with debug turned on [ bacula start -d100 bacula-
log.txt ], then run your job specific to that client.
Stop bacula and restart w/o debug turned on or you'll end up with a
very large file to wade through.
Two choices here: 1. pico bacula-log.txt in the term session or 2.
mv bacula-log.txt /Users/*yourusername*/Desktop/bacula-log.txt and
use TextEdit to view the log file. This will give you the info you
need to find out why it isn't grabbing the Volumes/
I personally wouldn't attempt to backup anything mounted under the
Volumes directory as this is where all external file systems get
mounted on X. iDisk, external USB/FW drives, NSF, SMB/CIFS mounts
etc. This opens a Pandora's box as Bacula will attempt to backup
anything mounted under /Volumes at the time the job is run.
Better: If you have a specific device you want to backup, add that
item explicitly to the list /Volumes/MyFavoriteDeviceToBackup and
leave the rest alone.
Hope I didn't offend you with the details of what to do in the term
session - just not sure of your comfort level there.
This is just to get you pointed in the right direction. There are
others on this list far more astute than I (Hi Landof) when it comes
to the inner workings of OS X and Bacula and can give greater
guidance/expertise.
Erich
On Nov 13, 2006, at 5:58 AM, JP wrote:
Hye,
I use bacula 1.38.7.
This is an example of a FileSet I use :
FileSet {
Name = MacOsX
Include {
Options {
signature = MD5
compression = GZIP
verify = s
hfsplussupport=yes
}
File = /Users/
File = /Volumes/
}
Exclude {
File = swapfile*
File = *.mp3
File = *.cache
File = /Users/*/.Trash
File = /Volumes/Stockage
}
}
When I want to backup a mac o x client, /Volumes/ is not backed up (/
Users/ is all right)
Why ? What's the problem ?
Thanks,
Jean Pylouster
--
---
Using Tomcat but need to do more? Need to support web services,
security?
Get stuff done quickly with pre-integrated technology to make your
job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache
Geronimo
http://sel.as-us.falkag.net/sel?
cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] SUSE SLES 9 bacula client 1.38.11
Hello List, have anyone built an RPM of bacula-client 1.38.11 for SuSe SLES 9? I have a couple of systems without development software installed and no other system with that distro. Does also anyone knows how to lauch the rpmbuild command in order to make a client-only version? My attempts to modify the SPEC file never gave a good result. Thanks to people providing this software in any case. -- Ferdinando Pasqualetti G.T.Dati srl Tel. 0557310862 - 3356172731 - Fax 055720143 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Problem mounting Volume
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
OK, here's how I got into this mess:
Operations staff has a calendar for which tape goes in when -- they
wrote it out because they really don't have the knowhow to check for
themselves. Well, they messed up because I don't have a full backup
scheduled for the fifth Tuesday:
Schedule {
Name = UMD-F13T-Inc
Run = Level=Full Storage=helios_DAT72 1st,3rd tue at 21:00
Run = Level=Incremental Storage=helios_DDS 1st,3rd mon,wed-fri at 23:00
Run = Level=Incremental Storage=helios_DDS 2nd,4th-5th mon-fri at 23:00
}
Schedule {
Name = UMD-F24T-Inc
Run = Level=Full Storage=helios_DAT72 2nd,4th tue at 21:00
Run = Level=Incremental Storage=helios_DDS 2nd,4th mon,wed-fri at 23:00
Run = Level=Incremental Storage=helios_DDS 1st,3rd,5th mon-fri at 23:00
}
...however, their calendar had a fifth Tuesday and messed up the
rotation. Today, as a result, the wrong tape went into the drive. Here
is my storage config:
Device {
Name = helios_DAT72 #
Media Type = DDS-4
Archive Device = /dev/rmt/1lbn
AutomaticMount = yes; # when device opened, read it
AlwaysOpen = no;
Volume Poll Interval = 30 minutes;
Close on Poll = yes;
RemovableMedia = yes;
RandomAccess = no;
Spool Directory = /usr/local/bacula/var/spool;
}
I meant to set AlwaysOpen to yes here, but apparently did not -- so now
I'm even more confused. Anyway, what happened... it tried to run a
backup, but it looked at the tape and saw that it was used and in the
wrong pool, and rightly refused. We noticed the error and now have the
proper tape in the drive. However:
#umount
Using default Catalog name=MyCatalog DB=bacula
The defined Storage resources are:
1: File
2: helios_DDS
3: helios_DAT72
Select Storage resource (1-3): Unexpected question has been received.
3
3901 Device helios_DAT72 (/dev/rmt/1lbn) is already unmounted.
#mount
The defined Storage resources are:
1: File
2: helios_DDS
3: helios_DAT72
Select Storage resource (1-3): Unexpected question has been received.
3
3001 Mounted Volume: catalyst_BW1
3001 Device helios_DAT72 (/dev/rmt/1lbn) is already mounted with
Volume catalyst_BW1
#
...as you can see, my tape is both already unmounted and already
mounted, and claims that the tape that is in the drive is the tape that
I've taken out of the drive and replaced with the right tape. It has
requested the tape I'd expect it to, but will not be convinced that it's
in the drive:
15-Nov 10:37 helios-sd: CFMX-dev.2006-11-14_21.00.00 Warning: Director
wanted Volume combined_BW1 for device helios_DAT72 (/dev/rmt/1lbn).
Current Volume catalyst_BW1 not acceptable because:
1998 Volume catalyst_BW1 status is Used, not in Pool.
15-Nov 10:37 helios-sd: Please mount Volume combined_BW1 on Storage
Device helios_DAT72 (/dev/rmt/1lbn) for Job CFMX-dev.2006-11-14_21.00.00
I've restarted bacula already and this hasn't helped at all. This is
version 1.38.11. I've never actually had a problem before like this that
I couldn't figure out -- seems to be that the worst case scenario has
you restart and that's that. I'm totally stumped here. Can anyone point
me in the right direction?
Thanks,
=R
- --
_ _ _ _ ___ _ _ _
|Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III
|$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922)
\__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.5 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iD8DBQFFWzSqmb+gadEcsb4RAuvxAJ0XjTYoUMuBdDjQE0zr/cNl/y4rHQCeNGS1
wE3Jr6yrCmGiC/rGQk/BjJ4=
=mpzy
-END PGP SIGNATURE-
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Res: electrical cut during a job
Thanks, ask for the purchase of a UPS for our servers, at the moment the one who we have it's damaged. JeAn - Original Message - From: Kern Sibbald [EMAIL PROTECTED] To: bacula-users@lists.sourceforge.net Sent: Monday, November 13, 2006 8:52 PM Subject: Re: [Bacula-users] Res: electrical cut during a job On Monday 13 November 2006 19:51, Hristo Benev wrote: Alan Brown wrote: On Mon, 13 Nov 2006 [EMAIL PROTECTED] wrote: bacula sensible to the electrical cuts, as much as to make lose the data of a tape? If there is a power cut the job is lost. You should run mysqlcheck -A (or the postgres/sqlite equivalent) AND dbcheck before restarting Bacula, in order to ensure the database is not damaged. A UPS is relatively cheap. Why not buy one? Thanks again JeAn - Original Message - From: Georger Araujo [EMAIL PROTECTED] To: bacula-users@lists.sourceforge.net Sent: Monday, November 13, 2006 4:19 PM Subject: [Bacula-users] Res: electrical cut during a job Yup, that will do. I had the same problem and did exactly as Ryan instructed. I have a little script I put together. #Run bconsole #unmount #delete media volume=volume-name #Quit bconsole # Rewind the tape mt -f /dev/nst0 rewind # Write physical End Of File (EOF) to the tape mt -f /dev/nst0 weof #Run bconsole #label #mount Adapt the device file name to your environment. Regards, Georger - Mensagem original De: Ryan Novosielski [EMAIL PROTECTED] Para: [EMAIL PROTECTED] Cc: bacula-users@lists.sourceforge.net Enviadas: Segunda-feira, 13 de Novembro de 2006 12:10:24 Assunto: Re: [Bacula-users] electrical cut during a job -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 If all you need is to re-init the tape and don't care about what's on it, mt rewind and mt weof will do fine. Look at mt's man page for more information. [EMAIL PROTECTED] wrote: Hi List, I have a trouble with bacula Last night when backup was being executed, suddenly there was an electrical cut. Bacula stopped and I don't not know how to continue doing backup with that tape. The error when I try to run a job it's: 13-nov 12:53 doom-sd: PCD-05.2006-11-13_12.49.42 Error: Unable to position to end of data on device LTO3 (/dev/nst0): ERR=dev.c:839 ioctl MTEOM error on LTO3 (/dev/nst0). ERR=Error de entrada/salida. It's possible to format the tape? or verify the integrity Thanks jean __ LLama Gratis a cualquier PC del Mundo. Llamadas a fijos y móviles desde 1 céntimo por minuto. http://es.voice.yahoo.com - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFFWIrgmb+gadEcsb4RAjd/AJ9bObGl/N9LVP0l3zkDeC9E0CI0oQCdHQjL h238paL5Mg7XIPe4QvwrN6Q= =FJ7h -END PGP SIGNATURE- - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Yahoo! Acesso Grátis - Internet rápida e grátis. Instale o discador agora! http://br.acesso.yahoo.com - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier
Re: [Bacula-users] Problem mounting Volume
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
Here's a followup to myself. Apparently, I have two tapes called
catalyst_BW1 and have no idea how I could have gotten into this
situation. One of them is a brandy new tape:
Volume Label:
Id: Bacula 1.0 immortal
VerNo : 11
VolName : catalyst_BW1
PrevVolName :
VolFile : 0
LabelType : PRE_LABEL
LabelSize : 168
PoolName : catalyst_FULL
MediaType : DDS-4
PoolType : Backup
HostName : helios
Date label written: 31-Oct-2006 08:51
...one of them has been around for awhile, supposedly was not touched,
is empty (this is probably OK), but for some reason does not have the
right volume name anymore:
Volume Label:
Id: Bacula 1.0 immortal
VerNo : 11
VolName : catalyst_BW1
PrevVolName :
VolFile : 0
LabelType : VOL_LABEL
LabelSize : 168
PoolName : catalyst_FULL
MediaType : DDS-4
PoolType : Backup
HostName : helios
Date label written: 31-Oct-2006 08:51
I can't tell which media ID's these two tapes think they have. Is there
any way with any of the commands that work directly on the tapes (ie.
NOT the catalog) to check? It doesn't look like bls is interested in
telling me.
=R
Ryan Novosielski wrote:
OK, here's how I got into this mess:
Operations staff has a calendar for which tape goes in when -- they
wrote it out because they really don't have the knowhow to check for
themselves. Well, they messed up because I don't have a full backup
scheduled for the fifth Tuesday:
Schedule {
Name = UMD-F13T-Inc
Run = Level=Full Storage=helios_DAT72 1st,3rd tue at 21:00
Run = Level=Incremental Storage=helios_DDS 1st,3rd mon,wed-fri at 23:00
Run = Level=Incremental Storage=helios_DDS 2nd,4th-5th mon-fri at 23:00
}
Schedule {
Name = UMD-F24T-Inc
Run = Level=Full Storage=helios_DAT72 2nd,4th tue at 21:00
Run = Level=Incremental Storage=helios_DDS 2nd,4th mon,wed-fri at 23:00
Run = Level=Incremental Storage=helios_DDS 1st,3rd,5th mon-fri at 23:00
}
...however, their calendar had a fifth Tuesday and messed up the
rotation. Today, as a result, the wrong tape went into the drive. Here
is my storage config:
Device {
Name = helios_DAT72 #
Media Type = DDS-4
Archive Device = /dev/rmt/1lbn
AutomaticMount = yes; # when device opened, read it
AlwaysOpen = no;
Volume Poll Interval = 30 minutes;
Close on Poll = yes;
RemovableMedia = yes;
RandomAccess = no;
Spool Directory = /usr/local/bacula/var/spool;
}
I meant to set AlwaysOpen to yes here, but apparently did not -- so now
I'm even more confused. Anyway, what happened... it tried to run a
backup, but it looked at the tape and saw that it was used and in the
wrong pool, and rightly refused. We noticed the error and now have the
proper tape in the drive. However:
#umount
Using default Catalog name=MyCatalog DB=bacula
The defined Storage resources are:
1: File
2: helios_DDS
3: helios_DAT72
Select Storage resource (1-3): Unexpected question has been received.
3
3901 Device helios_DAT72 (/dev/rmt/1lbn) is already unmounted.
#mount
The defined Storage resources are:
1: File
2: helios_DDS
3: helios_DAT72
Select Storage resource (1-3): Unexpected question has been received.
3
3001 Mounted Volume: catalyst_BW1
3001 Device helios_DAT72 (/dev/rmt/1lbn) is already mounted with
Volume catalyst_BW1
#
...as you can see, my tape is both already unmounted and already
mounted, and claims that the tape that is in the drive is the tape that
I've taken out of the drive and replaced with the right tape. It has
requested the tape I'd expect it to, but will not be convinced that it's
in the drive:
15-Nov 10:37 helios-sd: CFMX-dev.2006-11-14_21.00.00 Warning: Director
wanted Volume combined_BW1 for device helios_DAT72 (/dev/rmt/1lbn).
Current Volume catalyst_BW1 not acceptable because:
1998 Volume catalyst_BW1 status is Used, not in Pool.
15-Nov 10:37 helios-sd: Please mount Volume combined_BW1 on Storage
Device helios_DAT72 (/dev/rmt/1lbn) for Job CFMX-dev.2006-11-14_21.00.00
I've restarted bacula already and this hasn't helped at all. This is
version 1.38.11. I've never actually had a problem before like this that
I couldn't figure out -- seems to be that the worst case scenario has
you restart and that's that. I'm totally stumped here. Can anyone point
me in the right direction?
Thanks,
=R
- -
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
[Bacula-users] Duplicate storage daemons or copy
Hello, We need to make a backup from one server to two different locations. Is it possible to use two storage daemons ans use it simulataneously? We need to make only one extraction of the data server and store it in two different locations. Thanks you, Vicente Hernandez Veloxia Network S.L. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Feature (already coded) request..
Item 1: Bacula support for a MailOnSuccess feature.
Origin: Jaime Ventura jaimeventura at ipp dot pt
Date: 15 November 2006
Status: for 1.38.11: coded(patch on attachment), compiled, tested
for 1.39.28: coded(patch on attachment), complied, NOT tested
What: be able to send a email message for a specified email address if (and
only if) a job finishes successfully.
Its similar to the MailOnError feature.
Why:The importance is about the same as MailOnError feature.
Since its not possible to do it using bacula's message types(info,
error,...)filter, this could be done using some kind of filter, right after the
mail was sent.
But since there is a MailOnError feature, why not have a
MailOnSuccess feature?
Notes:
Why its not possible to do it using bacula's message types(info, error,...)?
Imagine I want bacula to send ONLY successful job reports/messages to
[EMAIL PROTECTED]
When a job starts, bacula send the message : 10-Nov 17:37 bserver-dir: Start Backup JobId 1605, Job=Job.GSI04.2006-11-10_17.37.30
Since this is a info message (msgtype = M_INFO) the bacula's messaging system put it on the job messages (jcr-jcr_msgs) to be sent
to all dest that have the info type enabled (including [EMAIL PROTECTED]).
But when/if the job fails, that message (10-Nov 17:37 bserver-dir: Start Backup JobId 1605, Job=Job.GSI04.2006-11-10_17.37.30) has already
been queued to be sent to [EMAIL PROTECTED], even though it refers to a unsuccessful backup.
So when its time to send all messages to emails, the bacula's messaging system send that message (10-Nov 17:37 bserver-dir: Start
Backup JobId 1605, Job=Job.GSI04.2006-11-10_17.37.30) to [EMAIL PROTECTED], but using the subject bacula ERROR, because the job terminated unsuccessful.
This problem could also happen if I wanted bacula to send emails regarding unsuccessful backups, if i didnt use the MailOnError feature.
This feature is implemented so that if messages that where queued to be sent if the backup was unsuccessful, to be discarded if the backup is
successful.
--
Jaime Ventura
[Infra-estruturas e Comunicações]
Rua Dr. António Bernardino de Almeida, 431
4200 - 072 Porto
Telef: +351 22 834 05 00 (04) - ext. 1641
Fax: +351 22 832 11 59
e-mail: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED]
url: www.isep.ipp.pt http://www.isep.ipp.pt
diff -ur bacula-1.38.11/src/lib/message.c bacula-1.38.11-MailOnSuccess/src/lib/message.c
--- bacula-1.38.11/src/lib/message.c 2005-12-16 16:39:02.0 +
+++ bacula-1.38.11-MailOnSuccess/src/lib/message.c 2006-11-15 12:19:49.0 +
@@ -418,12 +418,19 @@
break;
case MD_MAIL:
case MD_MAIL_ON_ERROR:
-Dmsg0(850, Got MD_MAIL or MD_MAIL_ON_ERROR\n);
+ case MD_MAIL_ON_SUCCESS:
+Dmsg0(850, Got MD_MAIL, MD_MAIL_ON_ERROR or MD_MAIL_ON_SUCCESS\n);
if (!d-fd) {
break;
}
-if (d-dest_code == MD_MAIL_ON_ERROR jcr
-jcr-JobStatus == JS_Terminated) {
+if (
+(d-dest_code == MD_MAIL_ON_ERROR jcr
+jcr-JobStatus == JS_Terminated)
+||
+(d-dest_code == MD_MAIL_ON_SUCCESS jcr
+jcr-JobStatus == JS_ErrorTerminated)
+){
+
goto rem_temp_file;
}
@@ -656,6 +663,7 @@
break;
case MD_MAIL:
case MD_MAIL_ON_ERROR:
+ case MD_MAIL_ON_SUCCESS:
Dmsg1(850, MAIL for following msg: %s, msg);
if (!d-fd) {
POOLMEM *name = get_pool_memory(PM_MESSAGE);
diff -ur bacula-1.38.11/src/lib/message.h bacula-1.38.11-MailOnSuccess/src/lib/message.h
--- bacula-1.38.11/src/lib/message.h 2005-12-10 13:18:05.0 +
+++ bacula-1.38.11-MailOnSuccess/src/lib/message.h 2006-11-15 12:18:55.0 +
@@ -115,6 +115,7 @@
#define MD_OPERATOR 8/* email a single message to the operator */
#define MD_CONSOLE 9/* send msg to UserAgent or console */
#define MD_MAIL_ON_ERROR 10 /* email messages if job errors */
+#define MD_MAIL_ON_SUCCESS 11 /* email messages if job succeeds */
/* Queued message item */
struct MQUEUE_ITEM {
diff -ur bacula-1.38.11/src/lib/parse_conf.c bacula-1.38.11-MailOnSuccess/src/lib/parse_conf.c
--- bacula-1.38.11/src/lib/parse_conf.c 2006-06-04 13:24:40.0 +0100
+++ bacula-1.38.11-MailOnSuccess/src/lib/parse_conf.c 2006-11-15 12:18:55.0 +
@@ -91,6 +91,7 @@
{syslog, store_msgs, ITEM(res_msgs), MD_SYSLOG, 0, 0},
{mail,store_msgs, ITEM(res_msgs), MD_MAIL, 0, 0},
{mailonerror, store_msgs, ITEM(res_msgs), MD_MAIL_ON_ERROR, 0, 0},
+ {mailonsuccess, store_msgs, ITEM(res_msgs), MD_MAIL_ON_SUCCESS, 0, 0},
{file,
Re: [Bacula-users] Data transfer rates
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Did you just remove compression from the definition? I'm still looking for a way to EXPLICITLY disable compression. DAve wrote: Thomas Traeger wrote: Excellent point. The servers that are slowest to transfer are also the busiest, my front end web server and my mail gateways (Av and spam filtering). That is certainly something to look further into. I could try turning off compression for one cycle to prove the theory. Thanks, DAve You might also try reducing the compression level to gzip1/2/3 (default is gzip5), especially on the VLAN this might help. In my case all servers have a 1GBit connection to the backup system and software compression is useless as long as you backup on a tape drive with hardware compression. Compression was the culprit! After much testing and trying specific clients and compression levels it seems that I can transfer uncompressed data across a 1gb network faster than I can compress the data on the client. This was tested last on a very busy web server, which really is never not busy. The overhead of compression exceeded the gains of transfering data compressed. So depending on what load/cpu/ram a client has, compression should be altered. It is a trade off of speed verses storage space. I can adjust each job as required. Just one more way Bacula's complexity pays off. Thanks everyone. DAve - -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFFW0fsmb+gadEcsb4RAis2AKCR+ZuQTIZ2Z8Dt3Rs7JRqCKJefnwCfchWm WHsvjSflzU6WtA46T7PrNpY= =8YrC -END PGP SIGNATURE- - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Data transfer rates
Ryan Novosielski wrote:
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
Did you just remove compression from the definition?
I simply commented out the compression option in the FileSet section.
### FILESETS
FileSet {
Name = Web6
Include {
Options {
signature = MD5
#compression=GZIP
}
File = /data/data
File = /data/cgi-bin
File = /data/cgivirt
File = /data/webalizer
File = /usr/local/scripts
File = /data/movies
File = /usr/local/etc
File = /usr/local/db/mysql
File = /etc
}
Exclude {
File = /etc/dnscache/log/main
File = /tmp
File = /.snap
}
}
The next report stated no compression.
FD Files Written: 1,501
SD Files Written: 1,501
FD Bytes Written: 2,699,586,875
SD Bytes Written: 2,699,798,983
Rate: 12978.8 KB/s
Software Compression: None
Easy.
DAve
I'm still looking for a way to EXPLICITLY disable compression.
DAve wrote:
Thomas Traeger wrote:
Excellent point. The servers that are slowest to transfer are also the
busiest, my front end web server and my mail gateways (Av and spam
filtering).
That is certainly something to look further into. I could try turning
off compression for one cycle to prove the theory.
Thanks,
DAve
You might also try reducing the compression level to gzip1/2/3 (default
is gzip5), especially on the VLAN this might help. In my case all
servers have a 1GBit connection to the backup system and software
compression is useless as long as you backup on a tape drive with
hardware compression.
Compression was the culprit! After much testing and trying specific
clients and compression levels it seems that I can transfer uncompressed
data across a 1gb network faster than I can compress the data on the
client. This was tested last on a very busy web server, which really is
never not busy. The overhead of compression exceeded the gains of
transfering data compressed.
So depending on what load/cpu/ram a client has, compression should be
altered. It is a trade off of speed verses storage space. I can adjust
each job as required.
Just one more way Bacula's complexity pays off. Thanks everyone.
DAve
--
Three years now I've asked Google why they don't have a
logo change for Memorial Day. Why do they choose to do logos
for other non-international holidays, but nothing for
Veterans?
Maybe they forgot who made that choice possible.
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] mac os x backup problem
On Mon, 13 Nov 2006 12:58:16 +0100, JP said:
Hye,
I use bacula 1.38.7.
This is an example of a FileSet I use :
FileSet {
Name = MacOsX
Include {
Options {
signature = MD5
compression = GZIP
verify = s
hfsplussupport=yes
}
File = /Users/
File = /Volumes/
}
Exclude {
File = swapfile*
File = *.mp3
File = *.cache
File = /Users/*/.Trash
File = /Volumes/Stockage
}
}
When I want to backup a mac o x client, /Volumes/ is not backed up (/
Users/ is all right)
Why ? What's the problem ?
Did you see any messages from the backup about the directories in /Volumes
(something like Filesystem change prohibited. Will not descend into
/Volumes/foobar)?
If so, this is controlled by the onefs directive in the Options section. It
defaults to yes, which means that mounted filesystems are not included.
As someone else mentioned, it is better to specify the directories in /Volumes
that you want to back up, otherwise you'll get all kinds of random things.
__Martin
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Destructive Tape Label Crossing! (was: Problem mounting Volume)
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
Last update to myself:
Seems as if what happened is that the wrong tape was inserted during the
wrong week. For reasons unknown (if anyone can tell me where to look,
I'd be very grateful), the tape, when inserted the wrong week, appears
to have been written to. The volume label appears to have been changed
to match the tape that it wanted, and written despite the fact that it
was not writable at that time (it may have been just about ready to be
recycled, but still, it was in the wrong pool anyway).
bls indicates that the WRONG tape contains my last week's backups. The
new tape does not appear to contain anything. I see no place to get a
media ID for any of this stuff, but I suspect both tapes have a mediaID
that's the same at this point.
This is seriously messed up, and even if I -- or my staff -- did
something to cause it, I really need to know what to be careful not to
do again.
Please let me know what I should provide to the list or how I should
troubleshoot this. I'm leaving everything as-is for now so that I have
all the evidence.
Thanks for any assistance you can provide.
Ryan Novosielski wrote:
Here's a followup to myself. Apparently, I have two tapes called
catalyst_BW1 and have no idea how I could have gotten into this
situation. One of them is a brandy new tape:
Volume Label:
Id: Bacula 1.0 immortal
VerNo : 11
VolName : catalyst_BW1
PrevVolName :
VolFile : 0
LabelType : PRE_LABEL
LabelSize : 168
PoolName : catalyst_FULL
MediaType : DDS-4
PoolType : Backup
HostName : helios
Date label written: 31-Oct-2006 08:51
...one of them has been around for awhile, supposedly was not touched,
is empty (this is probably OK), but for some reason does not have the
right volume name anymore:
Volume Label:
Id: Bacula 1.0 immortal
VerNo : 11
VolName : catalyst_BW1
PrevVolName :
VolFile : 0
LabelType : VOL_LABEL
LabelSize : 168
PoolName : catalyst_FULL
MediaType : DDS-4
PoolType : Backup
HostName : helios
Date label written: 31-Oct-2006 08:51
I can't tell which media ID's these two tapes think they have. Is there
any way with any of the commands that work directly on the tapes (ie.
NOT the catalog) to check? It doesn't look like bls is interested in
telling me.
=R
Ryan Novosielski wrote:
OK, here's how I got into this mess:
Operations staff has a calendar for which tape goes in when -- they
wrote it out because they really don't have the knowhow to check for
themselves. Well, they messed up because I don't have a full backup
scheduled for the fifth Tuesday:
Schedule {
Name = UMD-F13T-Inc
Run = Level=Full Storage=helios_DAT72 1st,3rd tue at 21:00
Run = Level=Incremental Storage=helios_DDS 1st,3rd mon,wed-fri at 23:00
Run = Level=Incremental Storage=helios_DDS 2nd,4th-5th mon-fri at 23:00
}
Schedule {
Name = UMD-F24T-Inc
Run = Level=Full Storage=helios_DAT72 2nd,4th tue at 21:00
Run = Level=Incremental Storage=helios_DDS 2nd,4th mon,wed-fri at 23:00
Run = Level=Incremental Storage=helios_DDS 1st,3rd,5th mon-fri at 23:00
}
...however, their calendar had a fifth Tuesday and messed up the
rotation. Today, as a result, the wrong tape went into the drive. Here
is my storage config:
Device {
Name = helios_DAT72 #
Media Type = DDS-4
Archive Device = /dev/rmt/1lbn
AutomaticMount = yes; # when device opened, read it
AlwaysOpen = no;
Volume Poll Interval = 30 minutes;
Close on Poll = yes;
RemovableMedia = yes;
RandomAccess = no;
Spool Directory = /usr/local/bacula/var/spool;
}
I meant to set AlwaysOpen to yes here, but apparently did not -- so now
I'm even more confused. Anyway, what happened... it tried to run a
backup, but it looked at the tape and saw that it was used and in the
wrong pool, and rightly refused. We noticed the error and now have the
proper tape in the drive. However:
#umount
Using default Catalog name=MyCatalog DB=bacula
The defined Storage resources are:
1: File
2: helios_DDS
3: helios_DAT72
Select Storage resource (1-3): Unexpected question has been received.
3
3901 Device helios_DAT72 (/dev/rmt/1lbn) is already unmounted.
#mount
The defined Storage resources are:
1: File
2: helios_DDS
3: helios_DAT72
Select Storage resource (1-3): Unexpected question has been received.
3
3001 Mounted Volume: catalyst_BW1
3001 Device helios_DAT72 (/dev/rmt/1lbn) is already mounted with
Volume catalyst_BW1
#
...as you can see, my tape is both already unmounted and already
mounted, and claims that the tape that is in the drive is the tape that
I've taken out of the drive and replaced with the right tape. It has
requested the tape I'd
Re: [Bacula-users] Incremental backup, not accurate?
On 11/15/06, Michel [EMAIL PROTECTED] wrote: Hello all, I read in the bacula docs that incremental backups use modification times to decide if it or doesn't backup. For example and as it is said in the doc, a mv on a directory doesn't change the modification time. So, if I am not wrong, incremental backup are not accurate? If this is true, how do you come over this? (except avoiding the use of mv) Thanks you! (I just started using Bacula, so I don't know if this is actually possible!) I also looked into this same problem. I solution I was thinking about is to let Bacula run a check to compare the real data with the backup. this should produce a nice list of file and directories that are different. I then can then touch these files, so the will be backuped in the next incremental backup. Does anyone know is this is possible? I'm running Bacula on Debian Linux, use file volumes (on the Debian box) and all clients are winXP. Jaap. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem mounting Volume
On Wed, 15 Nov 2006 11:15:31 -0500, Ryan Novosielski said: Here's a followup to myself. Apparently, I have two tapes called catalyst_BW1 and have no idea how I could have gotten into this situation. One of them is a brandy new tape: Volume Label: Id: Bacula 1.0 immortal VerNo : 11 VolName : catalyst_BW1 PrevVolName : VolFile : 0 LabelType : PRE_LABEL LabelSize : 168 PoolName : catalyst_FULL MediaType : DDS-4 PoolType : Backup HostName : helios Date label written: 31-Oct-2006 08:51 ...one of them has been around for awhile, supposedly was not touched, is empty (this is probably OK), but for some reason does not have the right volume name anymore: Volume Label: Id: Bacula 1.0 immortal VerNo : 11 VolName : catalyst_BW1 PrevVolName : VolFile : 0 LabelType : VOL_LABEL LabelSize : 168 PoolName : catalyst_FULL MediaType : DDS-4 PoolType : Backup HostName : helios Date label written: 31-Oct-2006 08:51 I can't tell which media ID's these two tapes think they have. Is there any way with any of the commands that work directly on the tapes (ie. NOT the catalog) to check? It doesn't look like bls is interested in telling me. I don't think the media id is stored on the tape itself (just the volname). __Martin - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Incremental backup, not accurate?
On Wed, 15 Nov 2006 18:53:47 +0100, Michel said: I read in the bacula docs that incremental backups use modification times to decide if it or doesn't backup. For example and as it is said in the doc, a mv on a directory doesn't change the modification time. So, if I am not wrong, incremental backup are not accurate? If this is true, how do you come over this? (except avoiding the use of mv) Incremental backups use the ctime as well as the mtime by default, so it depends on whether mv changes the ctime (some file systems do, some don't). If Bacula does detect the moved file then there is also a problem with restoring from incrementals, because it will create two copies of the file, with the old and the new names. There is currently no way around this, so regular full backups are advisable. __Martin - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Duplicate storage daemons or copy
Hi, On 11/15/2006 5:22 PM, Vicente Hernandez wrote: Hello, We need to make a backup from one server to two different locations. Is it possible to use two storage daemons ans use it simulataneously? We need to make only one extraction of the data server and store it in two different locations. This is not possible at the moment. If you are interested in having it implemented, look through the bacula-devel mailing list archive, searching for David Boyes' posts discussing copy pools and - damn, how did he call it? - perhaps proxy SD or something. Another possibility might be to use job copying, which is also not implemented inside Baculas core but can be achieved using bcopy. I never tried it, though. Of course, you can try to nag Kern or some other developer to implement it, which would best be done by issuing a feature request and perhaps backing it with lots of help :-) Sorry that I don't have a more positive answer, but perhaps you find a working solution using bcopy. Arno Thanks you, Vicente Hernandez Veloxia Network S.L. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] New User: Usability questions
Hi, I am considering using bacula for my laboratory data backups. A few questions on whether it will work with my hardware, and regarding a few features: 1.Will my hardware work w/ bacula? Tape DriveCybernetics CY-8102 AIT2 8 mm tape drive, 50/150 GB, *** iSCSI *** System Linux Redhat EL4, 2.6. kernel 2. How fast can bacula find a file on a tape to restore (i.e., does it fast-forward to the right spot on the tape, or does it read through at the regular [slow] read/write speed)? Can it restore a file from the end of the tape in a few minutes, instead of hours? 3. How are files written onto tape? Like (multiple) tar files, w/ filemarks. Or some other sort of format? In other words, can a bacula-written tape be recovered w/ tar (or some other standard, simple Linux utility) if needed? I had purchased and was planning to use Cybernetics Accelerated File Access (CYAFA) software, which I had used before and had liked. Simple but fast. And, CYAFA can fast-forward to the end of a tape, if that's where the file that you want to restore is located, in one or two minutes (!), unlike tar, which would take hours. However, it turns out that CYAFA does not work with iSCSI, only direct SCSI. So, I have a choice of getting different software (bacula certainly looks very nice!), or swapping the tape drive out for a regular SCSI version (to Cybernetics credit, they'll do it for free) and then using CYAFA. Thanks for answers and advice, Dave David W. Borhani, Ph.D. Structural Biology Group Leader Chemistry Department Abbott Bioresearch Center Vox: 508-688-3944 Fax: 508-754-7784 Email: [EMAIL PROTECTED] Smail: Abbott Bioresearch Center, Inc. 100 Research Drive Worcester, MA 01605 U.S.A. http://abbott.com - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New User: Usability questions
On 15 Nov 2006 at 14:49, David W Borhani wrote: Hi, I am considering using bacula for my laboratory data backups. A few questions on whether it will work with my hardware, and regarding a few features: 1.Will my hardware work w/ bacula? Tape Drive Cybernetics CY-8102 AIT2 8 mm tape drive, 50/150 GB, *** iSCSI *** System Linux Redhat EL4, 2.6. kernel I have no idea. :) 2. How fast can bacula find a file on a tape to restore (i.e., does it fast-forward to the right spot on the tape, or does it read through at the regular [slow] read/write speed)? Can it restore a file from the end of the tape in a few minutes, instead of hours? Bacula can fast-forward, if your OS/Tape drive allow it. Adjust your bacula-dir.conf file during the tape testing stage to get this behaviour. 3. How are files written onto tape? Like (multiple) tar files, w/ filemarks. Or some other sort of format? In other words, can a bacula-written tape be recovered w/ tar (or some other standard, simple Linux utility) if needed? Yes to the last question. See bls and bextract. -- Dan Langille : Software Developer looking for work my resume: http://www.freebsddiary.org/dan_langille.php - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New User: Usability questions
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 David W Borhani wrote: Hi, I am considering using bacula for my laboratory data backups. A few questions on whether it will work with my hardware, and regarding a few features: 1.Will my hardware work w/ bacula? Tape DriveCybernetics CY-8102 AIT2 8 mm tape drive, 50/150 GB, *** iSCSI *** SystemLinux Redhat EL4, 2.6. kernel Normally, if a drive works in Linux (as SCSI drive) it also works with Bacula. See the tape testing section in the manual ( http://www.bacula.org/dev-manual/Testing_Your_Tape_Drive.html#_ChapterStart27 ) if you want to make sure. Maybe somebody else on the list has already tried it with an iSCSI drive? 2. How fast can bacula find a file on a tape to restore (i.e., does it fast-forward to the right spot on the tape, or does it read through at the regular [slow] read/write speed)? Can it restore a file from the end of the tape in a few minutes, instead of hours? If the drive supports it, Bacula puts regular filemarks onto the tape, allowing it to fast forward to the 'chunk' that contains the file. 3. How are files written onto tape? Like (multiple) tar files, w/ filemarks. Or some other sort of format? In other words, can a bacula-written tape be recovered w/ tar (or some other standard, simple Linux utility) if needed? No. Bacula does not use tar, it has its own data format. You can create a rescue CD allowing you to perform bare-metal restores of a crashed director (with that you'll be able to restore the rest). Bacula also has tools to rebuild the catalog data from the tapes (bscan) and restore data (bextract). Hope that's helpful and that I got everything together correctly. Greetings, Michel -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) - GPGrelay v0.959 iD8DBQFFW3TT2Vs+MkscAyURAk+rAKD2hIEJ1J7CUkfGMp7wNQwH44hS4QCgiri+ rydAkP91aBWoh7UcoF+U2lI= =rKrF -END PGP SIGNATURE- - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Destructive Tape Label Crossing!
Hello,
On 11/15/2006 6:22 PM, Ryan Novosielski wrote:
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
Last update to myself:
Seems as if what happened is that the wrong tape was inserted during the
wrong week. For reasons unknown (if anyone can tell me where to look,
I'd be very grateful), the tape, when inserted the wrong week, appears
to have been written to. The volume label appears to have been changed
to match the tape that it wanted, and written despite the fact that it
was not writable at that time (it may have been just about ready to be
recycled, but still, it was in the wrong pool anyway).
bls indicates that the WRONG tape contains my last week's backups. The
new tape does not appear to contain anything. I see no place to get a
media ID for any of this stuff, but I suspect both tapes have a mediaID
that's the same at this point.
As far as I know, media IDs are only stored in the catalog. You might
find something if you compare older catalog dumps, checking for changes
regarding that volume, but I wouldn't want to do that :-)
This is seriously messed up, and even if I -- or my staff -- did
something to cause it, I really need to know what to be careful not to
do again.
If Bacula accidentially overwrites a tape label I would consider that a bug.
That said, I can imagine situations where such a thing can happen (but
never investigated it):
Imagine you have a tape inserted in a drive, rewound. The SD uses
always open=yes and the polling stuff.
The tape is mounted, and thus Bacula knows for sure which tape is in the
drive.
If you can change the tape without unmounting from Bacula and the drive
doesn't inform the OS of that operation, or Bacula doesn't query that
status from the OS, and you change the tape in between Bacula acesses,
what you describe might happen.
(Keep in mind that this is mostly fiction, not science - I don't know if
such a thing might happen with any tape drive, OS, or Bacula without
indicating a bug.)
Please let me know what I should provide to the list or how I should
troubleshoot this. I'm leaving everything as-is for now so that I have
all the evidence.
What I'd do is to examine all my tapes to find the one that is missing.
If there is exactly one tape label that can't be found, you know at
least which volume got overwritten and can invalidate the jobs on it.
Also, given the fact that your operators work by a list, you can
probably determine when the wrong tape was inserted, perhaps even who
did it :-)
Once this is sorted out, you should use that example as reason why your
operators should be educated to use Bacula for tape management and not
their caledars ;-)
Thanks for any assistance you can provide.
I have seen such a thing myself, once, but that was during a beta test
phase where I more or less tried to get such results, and it happened
before the new locking mechanisms were implemented IIRC.
Arno
Ryan Novosielski wrote:
Here's a followup to myself. Apparently, I have two tapes called
catalyst_BW1 and have no idea how I could have gotten into this
situation. One of them is a brandy new tape:
Volume Label:
Id: Bacula 1.0 immortal
VerNo : 11
VolName : catalyst_BW1
PrevVolName :
VolFile : 0
LabelType : PRE_LABEL
LabelSize : 168
PoolName : catalyst_FULL
MediaType : DDS-4
PoolType : Backup
HostName : helios
Date label written: 31-Oct-2006 08:51
...one of them has been around for awhile, supposedly was not touched,
is empty (this is probably OK), but for some reason does not have the
right volume name anymore:
Volume Label:
Id: Bacula 1.0 immortal
VerNo : 11
VolName : catalyst_BW1
PrevVolName :
VolFile : 0
LabelType : VOL_LABEL
LabelSize : 168
PoolName : catalyst_FULL
MediaType : DDS-4
PoolType : Backup
HostName : helios
Date label written: 31-Oct-2006 08:51
I can't tell which media ID's these two tapes think they have. Is there
any way with any of the commands that work directly on the tapes (ie.
NOT the catalog) to check? It doesn't look like bls is interested in
telling me.
=R
Ryan Novosielski wrote:
OK, here's how I got into this mess:
Operations staff has a calendar for which tape goes in when -- they
wrote it out because they really don't have the knowhow to check for
themselves. Well, they messed up because I don't have a full backup
scheduled for the fifth Tuesday:
Schedule {
Name = UMD-F13T-Inc
Run = Level=Full Storage=helios_DAT72 1st,3rd tue at 21:00
Run = Level=Incremental Storage=helios_DDS 1st,3rd mon,wed-fri at 23:00
Run = Level=Incremental Storage=helios_DDS 2nd,4th-5th mon-fri at 23:00
}
Schedule {
Name = UMD-F24T-Inc
Run = Level=Full Storage=helios_DAT72 2nd,4th tue at 21:00
Run = Level=Incremental Storage=helios_DDS 2nd,4th mon,wed-fri at 23:00
Run =
[Bacula-users] issue restoring...cant connect to storage daemon (on localhost)
I'm having issues restoring files from a backup tape, where the director and storage daemon are both on the same machine. running on debian I get the following error output in the bconsole: OK to run? (yes/mod/no): yesJob started. JobId=65 *15-Nov 12:42 LocalDirector: Start Restore Job RestoreFiles.2006-11-15_12.42.17 15-Nov 12:42 6400r: RestoreFiles.2006-11-15_12.42.17 Warning: c:\cygwin\home\kern\bacula\k\src\win32\lib\../../lib/bnet.c:853 Could not connect to Storage daemon on localhost:9103. ERR=No error Retrying ... *now, its saying it cant connect to the storage daemon, but it had to have earlier in the restore, because i went through a directory tree marking the files i wanted to restore. when i list jobs, i get the following for the job in question: +---+---+-+--+---+--++---+ | JobId | Name | StartTime | Type | Level | JobFiles | JobBytes | JobStatus |+---+---+-+--+---+--++---+ | 65 | RestoreFiles | 2006-11-15 12:42:19 | R | F | 0 | 0 | R | +---+---+-+--+---+--++---+now, if i exit out of bconsole and issue a ./bacula status, it shows that the director, file and storage daemons, and console are all running. I'm thoroughly confused... - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New User: Usability questions
Hi, On 11/15/2006 8:58 PM, Dan Langille wrote: On 15 Nov 2006 at 14:49, David W Borhani wrote: Hi, I am considering using bacula for my laboratory data backups. A few questions on whether it will work with my hardware, and regarding a few features: 1.Will my hardware work w/ bacula? Tape Drive Cybernetics CY-8102 AIT2 8 mm tape drive, 50/150 GB, *** iSCSI *** System Linux Redhat EL4, 2.6. kernel I have no idea. :) It should work as long as you use the standard devices to access the tape drive, i.e. /dev/nst0 for the tape drive. Using the capabilities like fast seeking should work, too, but if it does I don't understand why the manufacturers own software can't do it. 2. How fast can bacula find a file on a tape to restore (i.e., does it fast-forward to the right spot on the tape, or does it read through at the regular [slow] read/write speed)? Can it restore a file from the end of the tape in a few minutes, instead of hours? Bacula can fast-forward, if your OS/Tape drive allow it. Adjust your bacula-dir.conf file during the tape testing stage to get this behaviour. Better advust the bacula-sd.conf file :-) By the way, it's not really very time consuming to download the bacula source (or rpm for your platform), install bacula, set up the SD and run the tests you'll run anyway once you decide to give it a try. Testing the tape drive does not require a full Bacula setup with catalog database, jobs, and schedules. 3. How are files written onto tape? Like (multiple) tar files, w/ filemarks. Or some other sort of format? In other words, can a bacula-written tape be recovered w/ tar (or some other standard, simple Linux utility) if needed? Yes to the last question. See bls and bextract. Of course, bls and bextract are not exactly standard unix utilities. But then, tar isn't, too, unless you use the right version with the correct options... I would even go so far to say that Bacula tape format is better portable than a tar archive. For tar, you'd need to know lots of details - which tar (gnu, posix, certain unix flavor), which options, which version. This happens, of course, once you need to read a tar archive after the last machine with insert unix flavor here died and you really need the data... Arno -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Destructive Tape Label Crossing!
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Arno Lehmann wrote: Hello, On 11/15/2006 6:22 PM, Ryan Novosielski wrote: Last update to myself: Seems as if what happened is that the wrong tape was inserted during the wrong week. For reasons unknown (if anyone can tell me where to look, I'd be very grateful), the tape, when inserted the wrong week, appears to have been written to. The volume label appears to have been changed to match the tape that it wanted, and written despite the fact that it was not writable at that time (it may have been just about ready to be recycled, but still, it was in the wrong pool anyway). bls indicates that the WRONG tape contains my last week's backups. The new tape does not appear to contain anything. I see no place to get a media ID for any of this stuff, but I suspect both tapes have a mediaID that's the same at this point. As far as I know, media IDs are only stored in the catalog. You might find something if you compare older catalog dumps, checking for changes regarding that volume, but I wouldn't want to do that :-) This is seriously messed up, and even if I -- or my staff -- did something to cause it, I really need to know what to be careful not to do again. If Bacula accidentially overwrites a tape label I would consider that a bug. I guess I should see about filing one, I just don't really have a lot of information to provide at this point. That said, I can imagine situations where such a thing can happen (but never investigated it): Imagine you have a tape inserted in a drive, rewound. The SD uses always open=yes and the polling stuff. The tape is mounted, and thus Bacula knows for sure which tape is in the drive. If you can change the tape without unmounting from Bacula and the drive doesn't inform the OS of that operation, or Bacula doesn't query that status from the OS, and you change the tape in between Bacula acesses, what you describe might happen. (Keep in mind that this is mostly fiction, not science - I don't know if such a thing might happen with any tape drive, OS, or Bacula without indicating a bug.) I'd think so too. However, in this case it appears as if AlwaysOpen is off for this drive. I've seen a case where this exact thing DID happen to someone on this mailing list. Basically the resolution was don't do that. However, here, I do not use that directive for this drive. Theoretically, there's no way for this to have happened. Please let me know what I should provide to the list or how I should troubleshoot this. I'm leaving everything as-is for now so that I have all the evidence. What I'd do is to examine all my tapes to find the one that is missing. If there is exactly one tape label that can't be found, you know at least which volume got overwritten and can invalidate the jobs on it. Also, given the fact that your operators work by a list, you can probably determine when the wrong tape was inserted, perhaps even who did it :-) I've basically done this. The result is that combined_BW1, the tape incorrectly inserted last week, is now catalyst_BW1. catalyst_BW1, consequently, is empty, and combined_BW1 no longer exists. However, I still believe that in this particular case, given the course of events, this should NOT have happened. Once this is sorted out, you should use that example as reason why your operators should be educated to use Bacula for tape management and not their caledars ;-) Is there really an easy way for the staff to determine next tape though, when the storage devices and pools are defined in the schedule? status dir does not show them in these cases (showing instead *unknown*). Thanks for any assistance you can provide. I have seen such a thing myself, once, but that was during a beta test phase where I more or less tried to get such results, and it happened before the new locking mechanisms were implemented IIRC. Arno Ryan Novosielski wrote: Here's a followup to myself. Apparently, I have two tapes called catalyst_BW1 and have no idea how I could have gotten into this situation. One of them is a brandy new tape: Volume Label: Id: Bacula 1.0 immortal VerNo : 11 VolName : catalyst_BW1 PrevVolName : VolFile : 0 LabelType : PRE_LABEL LabelSize : 168 PoolName : catalyst_FULL MediaType : DDS-4 PoolType : Backup HostName : helios Date label written: 31-Oct-2006 08:51 ...one of them has been around for awhile, supposedly was not touched, is empty (this is probably OK), but for some reason does not have the right volume name anymore: Volume Label: Id: Bacula 1.0 immortal VerNo : 11 VolName : catalyst_BW1 PrevVolName : VolFile : 0 LabelType : VOL_LABEL LabelSize : 168 PoolName : catalyst_FULL MediaType : DDS-4
Re: [Bacula-users] Destructive Tape Label Crossing!
Hi, On 11/15/2006 10:05 PM, Ryan Novosielski wrote: ... Is there really an easy way for the staff to determine next tape though, when the storage devices and pools are defined in the schedule? status dir does not show them in these cases (showing instead *unknown*). Why not use the mails Bacula sends when it requests a new tape? If your problem is getting the necessary tapes before they are requested, from off-site storage or a firesafe, then you could simply keep a small number of purged tapes from each volume available. Bacula is flexible enough to accept other tapes than the ones it requests if the tapes qualify. Other than that, a more useful schedule listing would be nice, but then we'd all want that Bacula tells us which would be the next tape it wants when the currently scheduled one fill :-) Arno -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
