Re: [Bacula-users] ../cats/libsql.a in bacula 2.2.5

2007-10-23 Thread Jean-Max Reymond
Martin Simmons a écrit :
 On Sat, 20 Oct 2007 18:06:00 +0200, Jean-Max Reymond said:
 After a configure with following options:
 ./configure --with-postgresql --enable-static-fd

 make complains about a missing ../cat/libsql.a

 what's wrong ?


 make[1]: *** Pas de règle pour fabriquer la cible « ../cats/libsql.a », 
 nécessaire pour « bscan ». Arrêt.
 make[1]: Leaving directory `/tmp/bacula-2.2.5/src/stored'


== Error in /tmp/bacula-2.2.5/src/stored ==
 
 It should build libsql.a earlier.  Are there any other lines saying Error
 in... before this?  Do it work without --enable-static-fd?

I had an old postgresql database: 7.4.3
I have installed the new 8.2.5 and now, symbols are resolved and it 
works :-)

-- 
Jean-Max Reymond
Eruption de l'Etna: http://jmreymond.free.fr/Etna2002


-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Problems with 'Automatic Volume Labeling'

2007-10-23 Thread Michael Lang
Hi everyone,

i have a question regarding 'Automatic Volume Labeling', a short 
explanation of what i'm trying to do ...

i'm responsible for a small company, the backup is done to external 
disks. There are different Pools writing
the Backup to specific disks labeling them with a syntax like:

Label Format= 
Pool-Weekly-${Year}-${Month:p/2/0/r}-${Day:p/2/0/r}-${NumVols:+1:p/4/0/r}

which if no use able media exists is labeled on the device like 
'Pool-Weekly-2007-10-23-0001'. So far so good,
but this only happens once, means the 'Maximum Volume Bytes' is set to 
204800 (2GB) to ensure, it doesn't
matter where the external Disk is attached, the files are readable.
If a Backup Job requires more than one Media, the first get's labeled 
and for every new Media required during the
Backup Job, Bacula asks the Operator to label a new Media.

My only solution for this right now is to estimate how much space the 
Backup will use, and label the Volumes
before the Job runs, but as you can imagine thats annoying ...

is there anything i'm missing that this happens ?
thanks for any hint ...

kind regards
Michael Lang

the necessary configurations are :
pool
 Pool{
Name= Pool-Weekly
Pool Type   = Backup
Maximum Volume Bytes= 204800
AutoPrune   = yes
Volume Retention= 365 days
Recycle = yes
Recycle Oldest Volume   = yes
Purge Oldest Volume = no
Label Format= 
Pool-Weekly-${Year}-${Month:p/2/0/r}-${Day:p/2/0/r}-${NumVols:+1:p/4/0/r}
Storage = Storage-Weekly
}
/pool
bacula-sd.conf
Device {
  Name  = Storage-Weekly
  Media Type= File
  Archive Device= /media/backup02
  LabelMedia= yes; 
  Random Access = Yes;
  AutomaticMount= yes; 
  RemovableMedia= no;
  AlwaysOpen= no;
} 
/bacula-sd.conf

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] File size from backup needed. Where?

2007-10-23 Thread Arno Lehmann
Hi,

22.10.2007 12:45,, [EMAIL PROTECTED] wrote::
 Hi fellow Bacula Users,
 
 We have a issue that a backup for a client suddenly has increased from 50
 GB to 200GB at one client. In order to check the file(s) who are causing
 this, I'm checking my incremental backups to see what is causing this
 problems.

Good idea.

 However, I don't seem to be able to find that in the database. If you
 restore a file, there is a filesize, so it seems logical to me that it is
 there.

Yes, it is there, but not easily readable.

As far as I know, this information is encoded in the file attribute 
field of the File table, File.LStat.

The way it's encoded is probably only documented in the code itself, 
but there are applications around that access it.

The most useful thing to do for you is probably to install bweb, which 
can give you the information you need.

Getting bweb running is not trivial, though. I haven't set it up 
myself, but others report difficulties from time to time.

There is an INSTALL file in the bweb directory, which gives a good 
overview of the installation process, but you might have to adapt it 
to your environment.

 However, I can't find it. My question:
 
 how can I select all filesizes for a certain Job/Client in the database or
 bconsole?

Should also be possible with SQL... in the bweb distribution, look at 
the SQL function base64_decode_lstat definition.

Arno

 Kind regards from Rotterdam, NL!
 
 Diederik de Vries
 
 
 -
 This SF.net email is sponsored by: Splunk Inc.
 Still grepping through log files to find problems?  Stop.
 Now Search log events and configuration files using AJAX and a browser.
 Download your FREE copy of Splunk now  http://get.splunk.com/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users
 

-- 
Arno Lehmann
IT-Service Lehmann
www.its-lehmann.de

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problems with 'Automatic Volume Labeling'

2007-10-23 Thread Arno Lehmann
Hello,

23.10.2007 09:25,, Michael Lang wrote::
 Hi everyone,
 
 i have a question regarding 'Automatic Volume Labeling', a short 
 explanation of what i'm trying to do ...
 
 i'm responsible for a small company, the backup is done to external 
 disks. There are different Pools writing
 the Backup to specific disks labeling them with a syntax like:
 
 Label Format= 
 Pool-Weekly-${Year}-${Month:p/2/0/r}-${Day:p/2/0/r}-${NumVols:+1:p/4/0/r}
 
 which if no use able media exists is labeled on the device like 
 'Pool-Weekly-2007-10-23-0001'. So far so good,
 but this only happens once, means the 'Maximum Volume Bytes' is set to 
 204800 (2GB) to ensure, it doesn't
 matter where the external Disk is attached, the files are readable.
 If a Backup Job requires more than one Media, the first get's labeled 
 and for every new Media required during the
 Backup Job, Bacula asks the Operator to label a new Media.
 
 My only solution for this right now is to estimate how much space the 
 Backup will use, and label the Volumes
 before the Job runs, but as you can imagine thats annoying ...

Yes.

 is there anything i'm missing that this happens ?
 thanks for any hint ...

I'd first suggest to drop the LabelFormat directive. It's deprecated 
and will vanish some day.

Instead, use a python event to provide names for new volumes.

This is described in the manual, for example 
http://www.bacula.org/dev-manual/Python_Scripting.html#SECTION00356

After trying this it would be time for a more detailed problem report 
(if the problem persist), preferrably including the version of Bacula 
you're running...

Arno

 kind regards
 Michael Lang
 


-- 
Arno Lehmann
IT-Service Lehmann
www.its-lehmann.de

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using a USB disk

2007-10-23 Thread Jordi Espasa Clofent
 Did you see my reply to your thread titled /SBIN and mount command?

Yes, I did. And I've done it without more problems.

 You need to ensure that the bacula user is allowed to mount the
 specified device on the specified mount point.

This is the odd point. If mount the device editing /etc/fstab all runs 
fine; if I try the mount/umount command with bacula directly, it doesn't 
work.

At present moment I'm using the ftsab solution, but I wonder to use 
mount/umount behaviour.

-- 
Thanks,
Jordi Espasa Clofent

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] spurious tracebacks

2007-10-23 Thread IEM - network operating center (IOhannes m zmoelnig)
hi all


i am currently running bacula-2.1.5 on my backup-server (and 2.1.4 on 
the clients), on debian/etch (using the debian-packages from packman)

every now and then (the last one was today; then 1 month before; then 10 
days before that,...) i get traceback emails from my backup-server, each 
for all of the 3 daemons (dir, file, storage) running there.

the emails are pretty non-descriptive, a la:

Subject: Bacula GDB traceback of bacula-sd
(no debugging symbols found)
Using host libthread_db library /lib/libthread_db.so.1.
ptrace: Operation not permitted.
/var/lib/bacula/6067: No such file or directory.

the emails usually are sent when nothing interesting is happening (my 
backups are all finished at night; the emails are sent somewhen during 
the day).

however, receiving tracebacks gives me an uneasy feeling.

any idea why they might occur? (ok, my information i give here is rather 
sparse, so i should ask: how should i investigate why they occur?)


any hints?

fgmasdr
IOhannes


-- 
IEM - network operation center
mailto:[EMAIL PROTECTED]

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] spurious tracebacks

2007-10-23 Thread IEM - network operating center (IOhannes m zmoelnig)
IEM - network operating center (IOhannes m zmoelnig) wrote:
 hi all
 
 
 i am currently running bacula-2.1.5 on my backup-server (and 2.1.4 on 
 the clients), on debian/etch (using the debian-packages from packman)

oops, this should read: 2.2.5 (and 2.2.4 resp.)

mfga.sr
IOhannes


-- 
IEM - network operation center
mailto:[EMAIL PROTECTED]

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problems with 'Automatic Volume Labeling'

2007-10-23 Thread Rich
On 2007.10.23. 11:40, Arno Lehmann wrote:
 Hello,

...
 My only solution for this right now is to estimate how much space the 
 Backup will use, and label the Volumes
 before the Job runs, but as you can imagine thats annoying ...
 
 Yes.
 
 is there anything i'm missing that this happens ?
 thanks for any hint ...
 
 I'd first suggest to drop the LabelFormat directive. It's deprecated 
 and will vanish some day.
 
 Instead, use a python event to provide names for new volumes.

umh. i must have missed this... will it really be dropped ? as i am 
using it, i don't fancy learning python just to replicate its functionality.

i am using this parameter to create single file per backup job and give 
them meaningful names - would it indeed at some point get replaced by a 
requirement to script in python ?

 This is described in the manual, for example 
 http://www.bacula.org/dev-manual/Python_Scripting.html#SECTION00356
...
-- 
  Rich

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Fileset depending on ClientRunBefore

2007-10-23 Thread Leon Bruno
 

 -Original Message-
 From: [EMAIL PROTECTED] 
 [mailto:[EMAIL PROTECTED] On Behalf 
 Of Arno Lehmann
 Sent: mercredi 10 octobre 2007 11:22
 To: bacula-users@lists.sourceforge.net
 Subject: Re: [Bacula-users] Fileset depending on ClientRunBefore
 
 Hi,
 
 10.10.2007 05:13,, Troy Daniels wrote::
  Dan Langille wrote:
  On 9 Oct 2007 at 20:05, Leon Bruno wrote:
 
  On 9 Oct 2007 at 19:54, Leon Bruno wrote:
 
  Hi all,
 
  One of my job is calling a script to do some databases backup.
  The fileset is then defined to call that same script 
 with another 
  parameter that list the backup that has just been done.
 
  From what I've tested, it seems that the fileset is estimated
  before the
  runbefore task. This is preventing my backup because at the time 
  the fileset is estimated, the backup is not yet done... Is there 
  any way to tell bacula to do the fileset estimation after the 
  runbefore task ?
  Have you considered the estimate command in bconsole?
 
  Would that output be useful for you?
  Leon wrote:
 
  Yes I did the estimate command on the fileset and the 
 result is what 
  I expected. That's why I believe at the time bacula get 
 the list of 
  files to backup, the backup is not yet done, thus the runbefore 
  command is actually executed after the fileset has been estimated.
  Please do not reply at the top of the email.
 
  I do not understand what you need.  From the subject, I think you 
  want to create a FileSet from ClientRunBefore.  But I have a hard 
  time parsing the content of your email to understand your 
 objective.
 
  I will guess again: If you are trying to dynamically create a 
  FileSet, I suggest reading this URL:
 
 http://www.bacula.org/rel-manual/Configuring_Director.html
 
  And search for this test:
 
  There are a number of special cases when specifying 
 directories and 
  files in a file-list. They are:
 
  If that is not what you need, please tell us your goal / 
 objective.  
  You are asking how to do the fileset estimation after the 
 runbefore 
  task.  I think you've already decided what the solution is but I 
  think some context will help us find a solution for you that will 
  work.
 
  
  
  I might be wrong, but I read this to mean Bruno was having problems 
  because Bacula builds the fileset/filelist it is going to back up 
  before it runs the RunBefore job.
  
  However, Bruno's script is designed to do a Database backup 
 first and 
  then provide the fileset information on where this Backup 
 is stored second.
  
  As far as I know there is no way to control this behavior, 
 I can see a 
  couple of ways to work around it:
  
  1) Have the actual Database Backup done as part of an Admin job 
  scheduled to occur just before the Bacula Backup job runs. 
 If you are 
  running multiple concurrent jobs this might be hard to implement.
  
  2) Backup the files to a location you can calculate in 
 advance - For 
  example, make every days backup get created in a subfolder 
 named after 
  the date for example. The 'fileset building script' can then easily 
  pass this folder back to Bacula.
  
  3) Have the fileset building process run the backup 
 directly first - 
  No idea whether this would even work, nor exactly how bad 
 an idea it would be.
 
 This works.
 
 Basically you create whatever files you need, and output their names.
 
 Arno
 
  Hope this helps,
  
  
  Troy.
  
  

This does work indeed, but that would still be useful to be able to
change that behavior.
However I don't know if that requires a lot of changes in bacula itself.

Thanks all for your help,
Bruno. 

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem with backing up over the internet

2007-10-23 Thread Mateus Interciso
On Mon, 22 Oct 2007 17:28:40 +, Mateus Interciso wrote:

 On Mon, 22 Oct 2007 19:19:34 +0200, Radek Hladik wrote:
 
 Mateus Interciso napsal(a):
 On Mon, 22 Oct 2007 15:44:23 +, Mateus Interciso wrote:
 
 On Mon, 22 Oct 2007 15:17:32 +, Mateus Interciso wrote:

 On Fri, 19 Oct 2007 15:51:24 +0200, Viktor Radnai wrote:

 Hi there,

 On 10/18/07, Arno Lehmann [EMAIL PROTECTED] wrote:

 You can do this even if the SD is inside your firewall, you'll
 need port forwarding or a proxy on the firewall then. With
 separate DNS zones inside and outside, resolving the SD hostname
 either as the internal or the external IP, this can be seamlessly
 integrated with your internal Bacula setup.

 Arno
 I think in this case, /etc/hosts is your friend :-)

 Configure your storage daemon with a hostname, and specify that
 hostname in /etc/hosts to be either the internal or the external
 address, as required. And you don't need to return different
 results from your internal DNS server. Dead simple and works well.

 HTH,

 Cheers,
 Vik
 --
 My other sig is hilarious




 
-
 This SF.net email is sponsored by: Splunk Inc. Still grepping
 through log files to find problems?  Stop. Now Search log events
 and configuration files using AJAX and a browser. Download your
 FREE copy of Splunk now  http://get.splunk.com/
 Ok, but how do I configure the storage daemon with a hostname?




 
-
 This SF.net email is sponsored by: Splunk Inc. Still grepping
 through log files to find problems?  Stop. Now Search log events and
 configuration files using AJAX and a browser. Download your FREE
 copy of Splunk now  http://get.splunk.com/
 Sorry, I should have sayd more...
 when I try to put the Address config on the sd, like this:

 Storage { # definition of myself
   Name = test-sd
   Address = Storage-Server
   SDPort = 9103  # Director's port WorkingDirectory =
   /var/lib/bacula
   Pid Directory = /var/run
   Maximum Concurrent Jobs = 20
 }

 I get this error when I start bacula-sd

 22-Oct 14:11 bacula-sd: ERROR TERMINATION at parse_conf.c:889 Config
 error: Keyword Address not permitted in this resource. Perhaps you
 left the trailing brace off of the previous resource.
 : line 15, col 10 of file /etc/bacula/bacula-sd.conf
   Address = Storage-Server

 :(

 Mateus




 
-
 This SF.net email is sponsored by: Splunk Inc. Still grepping through
 log files to find problems?  Stop. Now Search log events and
 configuration files using AJAX and a browser. Download your FREE copy
 of Splunk now  http://get.splunk.com/
 
 I've just managed to make the backups run across the internet. I'm
 really thankfull for all of you guys :d Fiddling a little with the
 /etc/hosts and the firewall...it worked perfectly :D Now is just
 making it secure...thanks a lot guys :D
 
 I would suggest you OpenVPN. It is easy to setup, there is a lot of
 howtos on the net and it will solve all NAT problems. OpenVPN is for
 both Windows and Linux and all it needs is one port on public IP. We
 use it for backing up remote servers and it works like a charm.
 
 Basically you need to install OpenVPN server in your office and OpenVPN
 clients on all your clients. OpenVPN will create new ethernet devices
 which are connected all together. You then setup some private IPs on
 this virtual network and use them in bacula configuration.
 
 Radek
 
 
 
-
 This SF.net email is sponsored by: Splunk Inc. Still grepping through
 log files to find problems?  Stop. Now Search log events and
 configuration files using AJAX and a browser. Download your FREE copy
 of Splunk now  http://get.splunk.com/
 
 
 Interesting...I'll take a look at it...thanks a lot once again. :D
 
 Mateus
 
 
 
-
 This SF.net email is sponsored by: Splunk Inc. Still grepping through
 log files to find problems?  Stop. Now Search log events and
 configuration files using AJAX and a browser. Download your FREE copy of
 Splunk now  http://get.splunk.com/

Hum...it seems that not everything is perfect tough...
From one server, there's no problem backing up, but from another, which 
has a lot of traffic, is basically impossible to back up, since I got 
every time a big Broken Pipe
any help is apreciated...

Thanks a lot

MAteus


-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___

[Bacula-users] Problem backing up catalog

2007-10-23 Thread Mateus Interciso
Hello, I'm having a very hard time backing up the catalog, after I've 
moved the backup server to another server...it keeps giving me this error:

23-Oct 11:26 behemot-dir JobId 225: BeforeJob: run command /usr/libexec/
bacula/make_catalog_backup bacula bacula
23-Oct 11:26 behemot-dir JobId 225: BeforeJob: mysqldump: Got error: 
1045: Access denied for user 'bacula'@'localhost' (using password: NO) 
when trying to connect
23-Oct 11:26 behemot-dir JobId 225: Error: Runscript: BeforeJob returned 
non-zero status=2. ERR=Child exited with code 2

But on the bacula-dir.conf file, I do have setted up the bacula password 
on the Catalog configuration, so why is he not even trying to use it?
The other backups run absolutly normal.

Thanks

Mateus


-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem with backing up over the internet

2007-10-23 Thread Mateus Interciso
On Tue, 23 Oct 2007 12:37:13 +, Mateus Interciso wrote:

 On Mon, 22 Oct 2007 17:28:40 +, Mateus Interciso wrote:
 
 On Mon, 22 Oct 2007 19:19:34 +0200, Radek Hladik wrote:
 
 Mateus Interciso napsal(a):
 On Mon, 22 Oct 2007 15:44:23 +, Mateus Interciso wrote:
 
 On Mon, 22 Oct 2007 15:17:32 +, Mateus Interciso wrote:

 On Fri, 19 Oct 2007 15:51:24 +0200, Viktor Radnai wrote:

 Hi there,

 On 10/18/07, Arno Lehmann [EMAIL PROTECTED] wrote:

 You can do this even if the SD is inside your firewall, you'll
 need port forwarding or a proxy on the firewall then. With
 separate DNS zones inside and outside, resolving the SD hostname
 either as the internal or the external IP, this can be seamlessly
 integrated with your internal Bacula setup.

 Arno
 I think in this case, /etc/hosts is your friend :-)

 Configure your storage daemon with a hostname, and specify that
 hostname in /etc/hosts to be either the internal or the external
 address, as required. And you don't need to return different
 results from your internal DNS server. Dead simple and works well.

 HTH,

 Cheers,
 Vik
 --
 My other sig is hilarious





 
-
 This SF.net email is sponsored by: Splunk Inc. Still grepping
 through log files to find problems?  Stop. Now Search log events
 and configuration files using AJAX and a browser. Download your
 FREE copy of Splunk now  http://get.splunk.com/
 Ok, but how do I configure the storage daemon with a hostname?





 
-
 This SF.net email is sponsored by: Splunk Inc. Still grepping
 through log files to find problems?  Stop. Now Search log events
 and configuration files using AJAX and a browser. Download your
 FREE copy of Splunk now  http://get.splunk.com/
 Sorry, I should have sayd more...
 when I try to put the Address config on the sd, like this:

 Storage { # definition of myself
   Name = test-sd
   Address = Storage-Server
   SDPort = 9103  # Director's port WorkingDirectory
   = /var/lib/bacula
   Pid Directory = /var/run
   Maximum Concurrent Jobs = 20
 }

 I get this error when I start bacula-sd

 22-Oct 14:11 bacula-sd: ERROR TERMINATION at parse_conf.c:889 Config
 error: Keyword Address not permitted in this resource. Perhaps you
 left the trailing brace off of the previous resource.
 : line 15, col 10 of file /etc/bacula/bacula-sd.conf
   Address = Storage-Server

 :(

 Mateus





 
-
 This SF.net email is sponsored by: Splunk Inc. Still grepping
 through log files to find problems?  Stop. Now Search log events and
 configuration files using AJAX and a browser. Download your FREE
 copy of Splunk now  http://get.splunk.com/
 
 I've just managed to make the backups run across the internet. I'm
 really thankfull for all of you guys :d Fiddling a little with the
 /etc/hosts and the firewall...it worked perfectly :D Now is just
 making it secure...thanks a lot guys :D
 
 I would suggest you OpenVPN. It is easy to setup, there is a lot of
 howtos on the net and it will solve all NAT problems. OpenVPN is for
 both Windows and Linux and all it needs is one port on public IP. We
 use it for backing up remote servers and it works like a charm.
 
 Basically you need to install OpenVPN server in your office and
 OpenVPN clients on all your clients. OpenVPN will create new
 ethernet devices which are connected all together. You then setup
 some private IPs on this virtual network and use them in bacula
 configuration.
 
 Radek
 
 
 
 
-
 This SF.net email is sponsored by: Splunk Inc. Still grepping through
 log files to find problems?  Stop. Now Search log events and
 configuration files using AJAX and a browser. Download your FREE copy
 of Splunk now  http://get.splunk.com/
 
 
 Interesting...I'll take a look at it...thanks a lot once again. :D
 
 Mateus
 
 
 
 
-
 This SF.net email is sponsored by: Splunk Inc. Still grepping through
 log files to find problems?  Stop. Now Search log events and
 configuration files using AJAX and a browser. Download your FREE copy
 of Splunk now  http://get.splunk.com/
 
 Hum...it seems that not everything is perfect tough...
From one server, there's no problem backing up, but from another, which
 has a lot of traffic, is basically impossible to back up, since I got
 every time a big Broken Pipe
 any help is apreciated...
 
 Thanks a lot
 
 MAteus
 
 
 
-
 This SF.net email is sponsored by: Splunk Inc. Still grepping through
 log files to find problems?  Stop. Now Search log events and
 configuration files using AJAX and a browser. Download your FREE copy of
 Splunk 

Re: [Bacula-users] Problem with backing up over the internet

2007-10-23 Thread Rob MacGregor
On 10/23/07, Mateus Interciso [EMAIL PROTECTED] wrote:
---SNIP---
 Also, is there a way to create a OpenVPN tunnel with two diferent ip
 networks?

Yes - routed mode (instead of bridged mode).

 For instance...let's say the internal network I'm working has the ip
 192.168.1.15 as my client, and the serve I wan to access has the ip
 10.0.0.7, is there a way to create a tunnel between those two? I was
 reading the OpenVPN manual...and they don't let it that clear.

Just use routed mode.  I've set this up many times and it just
works.  The HowTo's on the OpenVPN site will walk you through this.

-- 
 Please keep list traffic on the list.

Rob MacGregor
  Whoever fights monsters should see to it that in the process he
doesn't become a monster.  Friedrich Nietzsche

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem with backing up over the internet

2007-10-23 Thread Mateus Interciso
On Tue, 23 Oct 2007 14:20:28 +0100, Rob MacGregor wrote:

 On 10/23/07, Mateus Interciso [EMAIL PROTECTED] wrote: ---SNIP---
 Also, is there a way to create a OpenVPN tunnel with two diferent ip
 networks?
 
 Yes - routed mode (instead of bridged mode).
 
 For instance...let's say the internal network I'm working has the ip
 192.168.1.15 as my client, and the serve I wan to access has the ip
 10.0.0.7, is there a way to create a tunnel between those two? I was
 reading the OpenVPN manual...and they don't let it that clear.
 
 Just use routed mode.  I've set this up many times and it just works. 
 The HowTo's on the OpenVPN site will walk you through this.

I'm looking at it right now, will this help to get rid of the Broken Pipe 
as well? Or I am going completly nuts?
Thanks

mateus


-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem backing up catalog

2007-10-23 Thread Chris Howells
Mateus Interciso wrote:
 But on the bacula-dir.conf file, I do have setted up the bacula password 
 on the Catalog configuration, so why is he not even trying to use it?
 The other backups run absolutly normal.

You are running make_catalog_backup with the wrong arguments. This is 
configured via the RunBeforeJob line, not the catalog resource.

 From 'make_catalog_backup' (which is a shell script).

#  $1 is the name of the database to be backed up and the name
# of the output file (default = bacula).
#  $2 is the user name with which to access the database
# (default = bacula).
#  $3 is the password with which to access the database or  if no password
# (default )


So you need a third argument which is the db password. Modify the

RunBeforeJob = make_catalog_backup bacula bacula to read

to read

RunBeforeJob = make_catalog_backup bacula bacula dbpassword

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problems with 'Automatic Volume Labeling'

2007-10-23 Thread Chris Sarginson
Rich wrote:
 
 umh. i must have missed this... will it really be dropped ? as i am 
 using it, i don't fancy learning python just to replicate its functionality.
 

Unless I misunderstood this 
[http://www.mail-archive.com/bacula-users@lists.sourceforge.net/msg09517.html] 
(and I hope I havent) then this will not be dropped, per say, but some 
of the extra functionality will be written out.

I use this function to create volumes as IP_IP_IP_IP- - I assume that 
this basic method will still be available - you just wont be able to 
substitute in variables.

-- 
Kind regards

Chris Sarginson
Technical Support
UKFast.Net Ltd

(t) 0870 111 8866
(f) 0870 458 4545

The UK's Best Hosting Provider ISPA Awards 2007, 2006 and 2005

Dedicated Servers - Managed Hosting - Domain Names- http://www.ukfast.net

UKFast.Net Ltd, City Tower, Piccadilly Plaza, Manchester, M1 4BT
Registered in England. Number 384 5616

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem backing up catalog

2007-10-23 Thread Mateus Interciso
On Tue, 23 Oct 2007 14:44:15 +0100, Chris Howells wrote:

 Mateus Interciso wrote:
 But on the bacula-dir.conf file, I do have setted up the bacula
 password on the Catalog configuration, so why is he not even trying to
 use it? The other backups run absolutly normal.
 
 You are running make_catalog_backup with the wrong arguments. This is
 configured via the RunBeforeJob line, not the catalog resource.
 
  From 'make_catalog_backup' (which is a shell script).
 
 #  $1 is the name of the database to be backed up and the name # of
 the output file (default = bacula). #  $2 is the user name with which to
 access the database # (default = bacula).
 #  $3 is the password with which to access the database or  if no
 password # (default )
 
 
 So you need a third argument which is the db password. Modify the
 
 RunBeforeJob = make_catalog_backup bacula bacula to read
 
 to read
 
 RunBeforeJob = make_catalog_backup bacula bacula dbpassword
 
 
-
 This SF.net email is sponsored by: Splunk Inc. Still grepping through
 log files to find problems?  Stop. Now Search log events and
 configuration files using AJAX and a browser. Download your FREE copy of
 Splunk now  http://get.splunk.com/

Now it worked, thanks :D
I just wonder why it was working before, since the configuration files 
are exactly the same, and the env is the same as well


-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Disk backup recycling

2007-10-23 Thread Marek Simon
Hi,
I suggest to solve like this:
One Pool only. 8 volumes. Retention time 7 days and few hours. Use time 
1 day.

The use will be like this:
first Monday: full backup. volume 1 used and contains the full backup
Tue to Sun: diff backup using volumes 2 to 7 (automaticaly selected or 
created by bacula)
second Monday: volume 1 is not free yet, so using volume 8 for full 
backup. Now you have two full backups.
second Tuesday: volume 1 is available and bacula will recycle it for 
first differencial backup. Old full backup is discarded. Now you have 
full backup on volume 8, first diff on volume 1 and 6 volumes with 
useless data
second Wednesday: volume 2 is available etc.

You will not be able to keep the exact content of volumes in your head, 
but the bacula is designed for not needing that. You can still read 
every day's report and get your brain busy with it (and I recomand it 
for few weeks to catch the buggies).

Marek


Radek Hladik napsal(a):
 Hi,
   I am implementing simple schema for backing up our data. Data are 
 backed up to disk. Full backup is performed every Sunday. The next 6 
 days differential backups are performed.
 I want to keep only one Full backup and at maximum 6 daily differences. 
 The moment new Full backup is made, previous Full backup and its 
 differential children can be deleted. According to documentation 
 (chapter Automated disk backup) I've made two pools like this:

 Pool
 {
Name = full
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Volume Retention = 7 days
Label format = full
Maximum Volume Jobs = 1
Maximum Volumes = 2
 }

 Pool
 {
Name = diff
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Volume Retention = 7 days
Label format = diff
Maximum Volume Jobs = 1
Maximum Volumes = 8
 }

 But as I understand it, there will be two full backups as backups have 
 period 7 days and retention is 7 days too - so the last week backup will 
 not be reused as it is not old enough. But if I lower retention to i.e. 
 6 days, the volume will be deleted before performing backup and there 
 will be window without any backup.
 I am backing up a lot of clients and I do not mind having one 
 unnecessary backup during backup process itself but I would like to 
 avoid having two backups for each client for whole the time.
 And my other question - can be differential/incremental backups 
 automatically deleted as soon as their parent is reused/deleted?

 Radek



 -
 This SF.net email is sponsored by: Splunk Inc.
 Still grepping through log files to find problems?  Stop.
 Now Search log events and configuration files using AJAX and a browser.
 Download your FREE copy of Splunk now  http://get.splunk.com/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


   

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Calling client script ( Before / After jobs ) with parameters

2007-10-23 Thread David Ballester
Hi to all:

I'm currently working on the integration with bacula and rman, the
tool to make backups/restores of Oracle databases.


Reading bacula documentation, seems that some releases before, the
admin was able to define environment variables inside bacula  ( and
use them as parameters for the scripts called on before/after jobs )
but now this method seems deprecated in favor of python scripting.


My idea is to make standard scripts ( less maintenance and advantages
on adding new databases to backup ) that 'point to' the
database/catalog to backup using parameters, like this example:

/home/oracle/bin/full_backup_rman10g.sh rman catalog connection
chain ORACLE_SID_TO_BACKUP ARCHIVELOG_MODE_OF_DATABASE_TO_BACKUP

Then should be called in bacula like this:

Client Run Before Job=/home/oracle/bin/full_backup_rman.sh
sys/[EMAIL PROTECTED] ORCL NOARCHIVELOG

With this approach we could be able to deploy a set of identical
scripts ( no internal modification for each host with Oracle to be
protected and of course, no changes lost if we need to upgrade this
scripts) in the same way even if we use rman locally in the host with
the oracle database ( or databases ) to back up or if we use the same
machine where bacula-dir relays or if we use a third machine to
consolidate all rman procedures, etc...

I'm a completely python ignorant, and before spend time trying to
understand how to translate this behavior to python way of life, I
prefer ear from you.


Thanks in advance

D.

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem with backing up over the internet

2007-10-23 Thread Mateus Interciso
On Tue, 23 Oct 2007 14:20:28 +0100, Rob MacGregor wrote:

 On 10/23/07, Mateus Interciso [EMAIL PROTECTED] wrote: ---SNIP---
 Also, is there a way to create a OpenVPN tunnel with two diferent ip
 networks?
 
 Yes - routed mode (instead of bridged mode).
 
 For instance...let's say the internal network I'm working has the ip
 192.168.1.15 as my client, and the serve I wan to access has the ip
 10.0.0.7, is there a way to create a tunnel between those two? I was
 reading the OpenVPN manual...and they don't let it that clear.
 
 Just use routed mode.  I've set this up many times and it just works. 
 The HowTo's on the OpenVPN site will walk you through this.

One more thing. Once I have setted up the VPN, and everything is working
(on the vpn), all I need to do is to connect the vpn, set the vpn ip on 
the bacula-dir, and start the job and hope it'll work right?


-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] spurious tracebacks

2007-10-23 Thread Brian A Seklecki (Mobile)


On Tue, 2007-10-23 at 12:11 +0200, IEM - network operating center
(IOhannes m zmoelnig) wrote:
 hi all
 
 
 i am currently running bacula-2.1.5 on my backup-server (and 2.1.4 on 
 the clients), on debian/etch (using the debian-packages from packman)
 
 every now and then (the last one was today; then 1 month before; then 10 
 days before that,...) i get traceback emails from my backup-server, each 
 for all of the 3 daemons (dir, file, storage) running there.

*) Run the SD in foreground mode with debug level setup
*) Run the SD in ktrace/ptrace

Is something possibly sending the process a signal?  A log rotation
script etc?

~BAS


-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem with backing up over the internet

2007-10-23 Thread Rob MacGregor
On 10/23/07, Mateus Interciso [EMAIL PROTECTED] wrote:

 I'm looking at it right now, will this help to get rid of the Broken Pipe
 as well? Or I am going completly nuts?
 Thanks

I don't know.

 One more thing. Once I have setted up the VPN, and everything is working
 (on the vpn), all I need to do is to connect the vpn, set the vpn ip on
 the bacula-dir, and start the job and hope it'll work right?

Depends on how you configure it, but roughly the VPN is just a network
link.  Set the route for the remote client to be over that link (the
VPN) and let basic networking take care of the rest :)  You really
need to follow those details up on the OpenVPN mailing list (after
having read the fine manual).

-- 
 Please keep list traffic on the list.

Rob MacGregor
  Whoever fights monsters should see to it that in the process he
doesn't become a monster.  Friedrich Nietzsche

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] make_catalog_backup problem with 2.2.5

2007-10-23 Thread Rich
on a slackware 12 box, bacula is creating make_catalog_backup file with 
the following line :
${BINDIR}/mysqldump -u $2$MYSQLPASSWORD$MYSQLHOST -f --opt $1 $1.sql

obviously, this is not working.

is this a known problem ?
-- 
  Rich

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] make_catalog_backup problem with 2.2.5

2007-10-23 Thread Dan Langille
On 23 Oct 2007 at 19:04, Rich wrote:

 on a slackware 12 box, bacula is creating make_catalog_backup file with 
 the following line :
 ${BINDIR}/mysqldump -u $2$MYSQLPASSWORD$MYSQLHOST -f --opt $1 $1.sql
 
 obviously, this is not working.
 
 is this a known problem ?

What version of Bacula are you using?

-- 
Dan Langille - http://www.langille.org/
Available for hire: http://www.freebsddiary.org/dan_langille.php



-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula-SD hang using IBM Ultrium 3581 Library

2007-10-23 Thread jay
Hello,

I'm having a peculiar problem with an IBM Ultrium 3581 autochanger and the
SD daemon.  I have to restart the SD daemon after I unmount a tape, or the
next job hangs and never starts.

We currently have a single LTO2 drive in the library, and are running Bacula
2.2.5 on a Redhat Enterprise Linux 4 update 5 IBM server.  I ran all the
btape tests, including the multiple tape test for autochangers, and they all
worked flawlessly.  Not a single problem or error reported.  I am able to
use the mtx script and mt successfully as well.  Mtx reports all the proper
tapes in the library, and I can mount a tape and WEOF and REWIND it using
mt.  Things look great at this point.  Next, I ran label barcodes and it
labeled all the tapes in the library properly.  Again, no problems.  I
decided at this point to modify the Full OS Set backup for our environment
and run some tests.  I can successfully run the backup the first time.  It
pulls a tape from the proper pool inside the library, backup works.  But if
I unmount the tape in bconsole, and try and run the same backup again, it
hangs.  Nothing happens.  I have waited several hours and nothing ever times
out.  I finally have to cancel the job manually.  I discovered that by
restarting bacula-sd that I can then re-run the job immediately without any
problems.

I'm not sure what could be causing this, or how to even troubleshoot.
Things seem to work great during all tests and doing a backup, Bacula just
doesn't like it when I unmount a tape manually.

Could someone offer some advice or debugging steps I could take to figure
this out?  Below is a copy of my bacula-sd.conf file.  I can post other
config files if I need to.  Thanks

Jay


 bacula-sd.conf ---

Storage {
  Name = server1-sd
  SDPort = 9103
  WorkingDirectory = /var/lib/bacula
  Pid Directory = /var/run
  Maximum Concurrent Jobs = 20
  SDAddress = 192.168.1.20
}

Director {
  Name = server1-dir
  Password = 1234
}

Director {
  Name = server1-mon
  Password = 1234
  Monitor = yes
}

Device {
  Name = FileStorage
  Media Type = File
  Archive Device = /tmp
  LabelMedia = yes;
  Random Access = Yes;
  AutomaticMount = yes;
  RemovableMedia = no;
  AlwaysOpen = no;
}

Autochanger {
  Name = Autochanger
  Device = Drive-0
  Changer Device = /dev/sg1
  Changer Command = /etc/bacula/mtx-changer %c %o %S %a %d
}

Device {
  Name = Drive-0
  Drive Index = 0
  Media Type = LTO2
  Archive Device = /dev/nst0
  AutomaticMount = yes;
  AlwaysOpen = yes;
  RemovableMedia = yes;
  RandomAccess = no
  AutoChanger = yes
}

Messages {
  Name = Standard
  director = server1-dir = all
}
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] make_catalog_backup problem with 2.2.5

2007-10-23 Thread Dan Langille
On 23 Oct 2007 at 19:04, Rich wrote:

 on a slackware 12 box, bacula is creating make_catalog_backup file with 
 the following line :
 ${BINDIR}/mysqldump -u $2$MYSQLPASSWORD$MYSQLHOST -f --opt $1 $1.sql
 
 obviously, this is not working.
 
 is this a known problem ?

Sorry, I see you put that in the subject.  It helps to repeat such 
critical information in the body.

Yes, I can confirm that I can repeat the problem.  There has been a 
patch committed recently.

In the meantime, add spaces:

$2 $MYSQLPASSWORD $MYSQLHOST


-- 
Dan Langille - http://www.langille.org/
Available for hire: http://www.freebsddiary.org/dan_langille.php



-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] make_catalog_backup problem with 2.2.5

2007-10-23 Thread Rich
On 2007.10.23. 19:17, Dan Langille wrote:
 On 23 Oct 2007 at 19:04, Rich wrote:
 
 on a slackware 12 box, bacula is creating make_catalog_backup file with 
 the following line :
 ${BINDIR}/mysqldump -u $2$MYSQLPASSWORD$MYSQLHOST -f --opt $1 $1.sql

 obviously, this is not working.

 is this a known problem ?
 
 Sorry, I see you put that in the subject.  It helps to repeat such 
 critical information in the body.

whoops, i usually do that, somehow missed this time :)

 Yes, I can confirm that I can repeat the problem.  There has been a 
 patch committed recently.

thanks for the information

 In the meantime, add spaces:

yes, exactly what i did after looking at the line wondering how did it 
end up like that :)

 $2 $MYSQLPASSWORD $MYSQLHOST
-- 
  Rich

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-SD hang using IBM Ultrium 3581 Library

2007-10-23 Thread Blake Dunlap
If you run a status storage when this is occurring, I believe you will see 
that the drive is unmounted and offline by user. Mounting a tape, or instead 
using the release command to unmount tapes should solve your problem if this 
is the case.

From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of jay
Sent: Tuesday, October 23, 2007 11:16 AM
To: bacula-users@lists.sourceforge.net
Subject: [Bacula-users] Bacula-SD hang using IBM Ultrium 3581 Library

Hello,

I'm having a peculiar problem with an IBM Ultrium 3581 autochanger and the SD 
daemon.  I have to restart the SD daemon after I unmount a tape, or the next 
job hangs and never starts.

We currently have a single LTO2 drive in the library, and are running Bacula 
2.2.5 on a Redhat Enterprise Linux 4 update 5 IBM server.  I ran all the btape 
tests, including the multiple tape test for autochangers, and they all worked 
flawlessly.  Not a single problem or error reported.  I am able to use the mtx 
script and mt successfully as well.  Mtx reports all the proper tapes in the 
library, and I can mount a tape and WEOF and REWIND it using mt.  Things look 
great at this point.  Next, I ran label barcodes and it labeled all the tapes 
in the library properly.  Again, no problems.  I decided at this point to 
modify the Full OS Set backup for our environment and run some tests.  I can 
successfully run the backup the first time.  It pulls a tape from the proper 
pool inside the library, backup works.  But if I unmount the tape in bconsole, 
and try and run the same backup again, it hangs.  Nothing happens.  I have 
waited several hours and nothing ever times out.  I finally have to cancel the 
job manually.  I discovered that by restarting bacula-sd that I can then re-run 
the job immediately without any problems.

I'm not sure what could be causing this, or how to even troubleshoot.  Things 
seem to work great during all tests and doing a backup, Bacula just doesn't 
like it when I unmount a tape manually.

Could someone offer some advice or debugging steps I could take to figure this 
out?  Below is a copy of my bacula-sd.conf file.  I can post other config files 
if I need to.  Thanks

Jay


 bacula-sd.conf ---

Storage {
  Name = server1-sd
  SDPort = 9103
  WorkingDirectory = /var/lib/bacula
  Pid Directory = /var/run
  Maximum Concurrent Jobs = 20
  SDAddress = 192.168.1.20http://192.168.1.20
}

Director {
  Name = server1-dir
  Password = 1234
}

Director {
  Name = server1-mon
  Password = 1234
  Monitor = yes
}

Device {
  Name = FileStorage
  Media Type = File
  Archive Device = /tmp
  LabelMedia = yes;
  Random Access = Yes;
  AutomaticMount = yes;
  RemovableMedia = no;
  AlwaysOpen = no;
}

Autochanger {
  Name = Autochanger
  Device = Drive-0
  Changer Device = /dev/sg1
  Changer Command = /etc/bacula/mtx-changer %c %o %S %a %d
}

Device {
  Name = Drive-0
  Drive Index = 0
  Media Type = LTO2
  Archive Device = /dev/nst0
  AutomaticMount = yes;
  AlwaysOpen = yes;
  RemovableMedia = yes;
  RandomAccess = no
  AutoChanger = yes
}

Messages {
  Name = Standard
  director = server1-dir = all
}
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-SD hang using IBM Ultrium 3581 Library

2007-10-23 Thread jay
Thanks Blake,

You are correct, it seems when I run an unmount, the drive goes into this
state

Jobs waiting to reserve a drive:
   3604 JobId=25 device Drive-0 (/dev/nst0) is BLOCKED due to user
unmount.

Device status:
Autochanger Autochanger with devices:
   Drive-0 (/dev/nst0)
Device FileStorage (/tmp) is not open.
Device Drive-0 (/dev/nst0) is not open.
Device is BLOCKED. User unmounted.
Drive 0 status unknown.


If i restart the bacula-sd daemon, the status is now

Device status:
Autochanger Autochanger with devices:
   Drive-0 (/dev/nst0)
Device FileStorage (/tmp) is not open.
Device Drive-0 (/dev/nst0) is not open.
Drive 0 status unknown.

So that appears to be the problem.  And my next question is, release is
the proper way to unmount a tape from the drive?  It appears to work, I'm
just trying to understand the difference.  Thanks a lot

Jay


On 10/23/07, Blake Dunlap [EMAIL PROTECTED] wrote:

  If you run a status storage when this is occurring, I believe you will
 see that the drive is unmounted and offline by user. Mounting a tape, or
 instead using the release command to unmount tapes should solve your
 problem if this is the case.



 *From:* [EMAIL PROTECTED] [mailto:
 [EMAIL PROTECTED] *On Behalf Of *jay
 *Sent:* Tuesday, October 23, 2007 11:16 AM
 *To:* bacula-users@lists.sourceforge.net
 *Subject:* [Bacula-users] Bacula-SD hang using IBM Ultrium 3581 Library



 Hello,

 I'm having a peculiar problem with an IBM Ultrium 3581 autochanger and the
 SD daemon.  I have to restart the SD daemon after I unmount a tape, or the
 next job hangs and never starts.

 We currently have a single LTO2 drive in the library, and are running
 Bacula 2.2.5 on a Redhat Enterprise Linux 4 update 5 IBM server.  I ran
 all the btape tests, including the multiple tape test for autochangers, and
 they all worked flawlessly.  Not a single problem or error reported.  I am
 able to use the mtx script and mt successfully as well.  Mtx reports all the
 proper tapes in the library, and I can mount a tape and WEOF and REWIND it
 using mt.  Things look great at this point.  Next, I ran label barcodes
 and it labeled all the tapes in the library properly.  Again, no problems.
 I decided at this point to modify the Full OS Set backup for our
 environment and run some tests.  I can successfully run the backup the first
 time.  It pulls a tape from the proper pool inside the library, backup
 works.  But if I unmount the tape in bconsole, and try and run the same
 backup again, it hangs.  Nothing happens.  I have waited several hours and
 nothing ever times out.  I finally have to cancel the job manually.  I
 discovered that by restarting bacula-sd that I can then re-run the job
 immediately without any problems.

 I'm not sure what could be causing this, or how to even troubleshoot.
 Things seem to work great during all tests and doing a backup, Bacula just
 doesn't like it when I unmount a tape manually.

 Could someone offer some advice or debugging steps I could take to figure
 this out?  Below is a copy of my bacula-sd.conf file.  I can post other
 config files if I need to.  Thanks

 Jay


  bacula-sd.conf ---

 Storage {
   Name = server1-sd
   SDPort = 9103
   WorkingDirectory = /var/lib/bacula
   Pid Directory = /var/run
   Maximum Concurrent Jobs = 20
   SDAddress = 192.168.1.20
 }

 Director {
   Name = server1-dir
   Password = 1234
 }

 Director {
   Name = server1-mon
   Password = 1234
   Monitor = yes
 }

 Device {
   Name = FileStorage
   Media Type = File
   Archive Device = /tmp
   LabelMedia = yes;
   Random Access = Yes;
   AutomaticMount = yes;
   RemovableMedia = no;
   AlwaysOpen = no;
 }

 Autochanger {
   Name = Autochanger
   Device = Drive-0
   Changer Device = /dev/sg1
   Changer Command = /etc/bacula/mtx-changer %c %o %S %a %d
 }

 Device {
   Name = Drive-0
   Drive Index = 0
   Media Type = LTO2
   Archive Device = /dev/nst0
   AutomaticMount = yes;
   AlwaysOpen = yes;
   RemovableMedia = yes;
   RandomAccess = no
   AutoChanger = yes
 }

 Messages {
   Name = Standard
   director = server1-dir = all
 }

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Calling client script ( Before / After jobs ) with parameters

2007-10-23 Thread Arno Lehmann
Hello,

23.10.2007 16:03,, David Ballester wrote::
 Hi to all:
 
 I'm currently working on the integration with bacula and rman, the
 tool to make backups/restores of Oracle databases.

Good idea.

 Reading bacula documentation, seems that some releases before, the
 admin was able to define environment variables inside bacula  ( and
 use them as parameters for the scripts called on before/after jobs )

I never noticed that, but I never looked for that, too.

 but now this method seems deprecated in favor of python scripting.

Using python, it should be possible to access the environment as well. 
Again, I haven't tried it yet, so I don't know if Bacula sets up the 
environment it inherits when started.

 
 My idea is to make standard scripts ( less maintenance and advantages
 on adding new databases to backup ) that 'point to' the
 database/catalog to backup using parameters, like this example:
 
 /home/oracle/bin/full_backup_rman10g.sh rman catalog connection
 chain ORACLE_SID_TO_BACKUP ARCHIVELOG_MODE_OF_DATABASE_TO_BACKUP
 
 Then should be called in bacula like this:
 
 Client Run Before Job=/home/oracle/bin/full_backup_rman.sh
 sys/[EMAIL PROTECTED] ORCL NOARCHIVELOG
 
 With this approach we could be able to deploy a set of identical
 scripts ( no internal modification for each host with Oracle to be
 protected and of course, no changes lost if we need to upgrade this
 scripts) in the same way even if we use rman locally in the host with
 the oracle database ( or databases ) to back up or if we use the same
 machine where bacula-dir relays or if we use a third machine to
 consolidate all rman procedures, etc...
 
 I'm a completely python ignorant, and before spend time trying to
 understand how to translate this behavior to python way of life, I
 prefer ear from you.

You won't get my ear :-)

The rest of your approach seems reasonable and should be easily 
implemented. I found python was easy to learn and use, so for me it 
was definitely worth the effort.

Of course, using bash or whatever shell you prefer can be done, too. I 
think it's more or less a question of what you prefer.

If you start working on it, and expect to spend some time on this 
anyway, I'd suggest to pipe the rman output to Bacula directly, 
without the need of a dump file in between. That saves you a bit of 
disk space on the client.

The necessary parts are all available - you can backup from and 
restore to a FIFO in Bacula, and you can call scripts to set up the 
pipes and reader/writer processes. There are examples available, I'd 
start reading at wiki.bacula.org if I were you.

Of course, whatever you come up with might be worth adding to the 
wiki, too.

Arno

 Thanks in advance
 
 D.
 
 -
 This SF.net email is sponsored by: Splunk Inc.
 Still grepping through log files to find problems?  Stop.
 Now Search log events and configuration files using AJAX and a browser.
 Download your FREE copy of Splunk now  http://get.splunk.com/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users
 

-- 
Arno Lehmann
IT-Service Lehmann
www.its-lehmann.de

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-SD hang using IBM Ultrium 3581 Library

2007-10-23 Thread Arno Lehmann
Hi,

23.10.2007 20:21,, jay wrote::
 Thanks Blake,
 
 You are correct, it seems when I run an unmount, the drive goes into 
 this state
 
 Jobs waiting to reserve a drive:
3604 JobId=25 device Drive-0 (/dev/nst0) is BLOCKED due to user 
 unmount.
 
 Device status:
 Autochanger Autochanger with devices:
Drive-0 (/dev/nst0)
 Device FileStorage (/tmp) is not open.
 Device Drive-0 (/dev/nst0) is not open.
 Device is BLOCKED. User unmounted.
 Drive 0 status unknown.
 
 
 If i restart the bacula-sd daemon, the status is now
 
 Device status:
 Autochanger Autochanger with devices:
Drive-0 (/dev/nst0)
 Device FileStorage (/tmp) is not open.
 Device Drive-0 (/dev/nst0) is not open.
 Drive 0 status unknown.
 
 So that appears to be the problem.  And my next question is, release 
 is the proper way to unmount a tape from the drive?  It appears to work, 
 I'm just trying to understand the difference.  Thanks a lot

The difference is that 'umount' unloads the tape and then releases the 
drive for use by other programs. 'release' only releases the drive and 
informs the SD of the fact that it has to ensure proper tape 
positioning when it starts using the tape again.

Your original problem seems to be that you didn't notice you have to 
mount the storage after manually unmounting it. Bacula does not send a 
reminder mail in these cases, because the operator is expected to know 
if the tape was manually unmounted :-)

So, in general: If you unmount a storage device, you have to mount it 
again. The current status is, as stated, easily checked with the 'sta 
sd' command.

Arno

 Jay
 
 
 On 10/23/07, *Blake Dunlap* [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] 
 wrote:
 
 If you run a status storage when this is occurring, I believe you
 will see that the drive is unmounted and offline by user. Mounting a
 tape, or instead using the release command to unmount tapes should
 solve your problem if this is the case.
 
  
 
 *From:* [EMAIL PROTECTED]
 mailto:[EMAIL PROTECTED]
 [mailto:[EMAIL PROTECTED]
 mailto:[EMAIL PROTECTED]] *On Behalf Of *jay
 *Sent:* Tuesday, October 23, 2007 11:16 AM
 *To:* bacula-users@lists.sourceforge.net
 mailto:bacula-users@lists.sourceforge.net
 *Subject:* [Bacula-users] Bacula-SD hang using IBM Ultrium 3581 Library
 
  
 
 Hello,
 
 I'm having a peculiar problem with an IBM Ultrium 3581 autochanger
 and the SD daemon.  I have to restart the SD daemon after I unmount
 a tape, or the next job hangs and never starts.
 
 We currently have a single LTO2 drive in the library, and are
 running Bacula 2.2.5 on a Redhat Enterprise Linux 4 update 5 IBM
 server.  I ran all the btape tests, including the multiple tape test
 for autochangers, and they all worked flawlessly.  Not a single
 problem or error reported.  I am able to use the mtx script and mt
 successfully as well.  Mtx reports all the proper tapes in the
 library, and I can mount a tape and WEOF and REWIND it using mt. 
 Things look great at this point.  Next, I ran label barcodes and
 it labeled all the tapes in the library properly.  Again, no
 problems.  I decided at this point to modify the Full OS Set
 backup for our environment and run some tests.  I can successfully
 run the backup the first time.  It pulls a tape from the proper pool
 inside the library, backup works.  But if I unmount the tape in
 bconsole, and try and run the same backup again, it hangs.  Nothing
 happens.  I have waited several hours and nothing ever times out.  I
 finally have to cancel the job manually.  I discovered that by
 restarting bacula-sd that I can then re-run the job immediately
 without any problems.
 
 I'm not sure what could be causing this, or how to even
 troubleshoot.  Things seem to work great during all tests and doing
 a backup, Bacula just doesn't like it when I unmount a tape manually.
 
 Could someone offer some advice or debugging steps I could take to
 figure this out?  Below is a copy of my bacula-sd.conf file.  I can
 post other config files if I need to.  Thanks
 
 Jay
 
 
  bacula-sd.conf ---
 
 Storage {
   Name = server1-sd
   SDPort = 9103 
   WorkingDirectory = /var/lib/bacula
   Pid Directory = /var/run
   Maximum Concurrent Jobs = 20
   SDAddress = 192.168.1.20 http://192.168.1.20
 }
 
 Director {
   Name = server1-dir
   Password = 1234
 }
 
 Director {
   Name = server1-mon
   Password = 1234
   Monitor = yes
 }
 
 Device {
   Name = FileStorage
   Media Type = File
   Archive Device = /tmp
   LabelMedia = yes;  
   Random Access = Yes;
   AutomaticMount = yes;  
   RemovableMedia = no;
   AlwaysOpen = no;
 }
 
 Autochanger {
   Name 

Re: [Bacula-users] FD - SD problem

2007-10-23 Thread Arno Lehmann
Hi,

22.10.2007 21:26,, GDS.Marshall wrote::
 version 2.2.4 patched from sourceforge
 Linux kernel 2.6.x
 
 I am running 10+ FD's, one SD, and one Director.  I am having problems
 with one of my FD's, the others are fine.  Not sure if it makes any
 difference, but the FD is on the same machine as the Director.

 I have no issues with the network, I see no errors on either the interface
 of the FD or the SD.  All FD's are plugged into the same netgear switch. 
 The SD is plugged into a different netgear switch which is then plugged
 into the FD's switch.

Are the FD and SD running on the same host (your description says that 
DIR and problem FD are on the same machine, but not if the DIR and SD 
are on that same machine, too)?

 I run a backup job (or via schedule) and the amount/size/volume of data is
 transfered each time, and then everything stops/hangs/does nothing.
 
 ls -l
 /var/data/bacula/spool/backupserver-sd.data.472.fileserver-backup.2007-10-22_18.54.33.DLT-V4.spool
 -rw-r- 1 root bacula 2193816 Oct 22 18:56
 
 A short while later, I will get a console message
 22-Oct 18:56 backupserver-sd: 3301 Issuing autochanger loaded? drive 0
 command.
 22-Oct 18:56 backupserver-sd: 3302 Autochanger loaded? drive 0, result
 is Slot 3.
 22-Oct 18:56 backupserver-sd: Volume CNI906 previously written, moving
 to end of data.
 22-Oct 18:56 backupserver-sd: Ready to append to end of Volume CNI906 at
 file=1.
 22-Oct 18:56 backupserver-sd: Spooling data ...
 22-Oct 18:56 fileserver-fd: fileserver-backup.2007-10-22_18.54.33 Fatal
 error: backup.c:892 Network send error to SD. ERR=Success

So the connection breaks shortly after data starts being transferred, 
right?

It's a little bit surprising to see an error text of Success here... I 
always thought that sort of things only happened on windows ;-)


 I know it says Network send error, however, I have checked the network,
 and can not find a problem with any of the equipment.

Do you have a firewall running on that host?

 I have run the fd and sd with debug options to provide additional output,
 I hope this helps.
 
 If any other information would help in diagnosis, please just ask for it.
 
 
 /usr/local/sbin/bacula-fd -f -s -d 200 -u root -g bacula -c
 /etc/bacula/bacula-fd.conf
 
 /home/spencer/bacula-sd -f -d 200 -s -u root -g bacula -c
 /etc/bacula/bacula-sd.conf
 
 cat /root/bacula-fd.log
 bacula-fd: filed_conf.c:438 Inserting director res: fileserver-mon
 fileserver-fd: jcr.c:132 read_last_jobs seek to 188
 fileserver-fd: jcr.c:139 Read num_items=10
 fileserver-fd: pythonlib.c:113 No script dir. prog=FDStartUp
 fileserver-fd: filed.c:225 filed: listening on port 9102
 fileserver-fd: bnet_server.c:96 Addresses host[ipv4:0.0.0.0:9102]
 fileserver-fd: bnet.c:666 who=client host=192.168.1.30 port=36387
 fileserver-fd: jcr.c:602 OnEntry JobStatus=fileserver-fd: jcr.c:622 OnExit
 JobStatus=C set=C
 fileserver-fd: find.c:81 init_find_files ff=8094e60
 fileserver-fd: job.c:233 dird: Hello Director fileserver-dir calling
 fileserver-fd: job.c:249 Executing Hello command.
 fileserver-fd: job.c:353 Calling Authenticate
 fileserver-fd: cram-md5.c:71 send: auth cram-md5
 [EMAIL PROTECTED] ssl=0
 fileserver-fd: cram-md5.c:131 cram-get: auth cram-md5
 [EMAIL PROTECTED] ssl=0
 fileserver-fd: cram-md5.c:150 sending resp to challenge:
 6U+ZK4lCcB/uXh+k+X/qdB
 fileserver-fd: job.c:357 OK Authenticate
 fileserver-fd: job.c:233 dird: JobId=0 Job=-Console-.2007-10-22_18.53.31
 SDid=0 SDtime=0 Authorization=dummy
 fileserver-fd: job.c:249 Executing JobId= command.
 fileserver-fd: job.c:451 JobId=0 Auth=dummy
 fileserver-fd: job.c:233 dird: statusfileserver-fd: job.c:249 Executing
 status command.
 fileserver-fd: runscript.c:102 runscript: running all RUNSCRIPT object
 (ClientAfterJob) JobStatus=C
 fileserver-fd: pythonlib.c:237 No startup module.
 fileserver-fd: job.c:337 Calling term_find_files
 fileserver-fd: job.c:340 Done with term_find_files
 fileserver-fd: mem_pool.c:377 garbage collect memory pool
 fileserver-fd: job.c:342 Done with free_jcr
 fileserver-fd: bnet.c:666 who=client host=192.168.1.30 port=36387
 fileserver-fd: jcr.c:602 OnEntry JobStatus=fileserver-fd: jcr.c:622 OnExit
 JobStatus=C set=C
 fileserver-fd: find.c:81 init_find_files ff=8094e60
 fileserver-fd: job.c:233 dird: Hello Director fileserver-dir calling
 fileserver-fd: job.c:249 Executing Hello command.
 fileserver-fd: job.c:353 Calling Authenticate
 fileserver-fd: cram-md5.c:71 send: auth cram-md5
 [EMAIL PROTECTED] ssl=0
 fileserver-fd: cram-md5.c:131 cram-get: auth cram-md5
 [EMAIL PROTECTED] ssl=0
 fileserver-fd: cram-md5.c:150 sending resp to challenge:
 /2gP/C+Fx+ZhT98YS4+hzD
 fileserver-fd: job.c:357 OK Authenticate
 fileserver-fd: job.c:233 dird: JobId=472
 Job=fileserver-backup.2007-10-22_18.54.33 SDid=1 SDtime=1193079020
 Authorization=JMKD-GKGP-LMNP-ODNP-EDME-NJBC-LEMK-BPGJ
 fileserver-fd: job.c:249 Executing JobId= command.
 fileserver-fd: job.c:451 JobId=472
 

Re: [Bacula-users] Problems with 'Automatic Volume Labeling'

2007-10-23 Thread Arno Lehmann
Hi,

23.10.2007 12:14,, Rich wrote::
 On 2007.10.23. 11:40, Arno Lehmann wrote:
 Hello,
 
 ...
 My only solution for this right now is to estimate how much space the 
 Backup will use, and label the Volumes
 before the Job runs, but as you can imagine thats annoying ...
 Yes.

 is there anything i'm missing that this happens ?
 thanks for any hint ...
 I'd first suggest to drop the LabelFormat directive. It's deprecated 
 and will vanish some day.

 Instead, use a python event to provide names for new volumes.
 
 umh. i must have missed this... will it really be dropped ? as i am 
 using it, i don't fancy learning python just to replicate its functionality.

Well... it won't be dropped anytime soon, but I recall Kern stating 
that he won't touch that code anymore, so once he needs to rework the 
code related to automatic volume labeling, it might be gone.

I couldn't say how likely that is, though - might be tomorrow, or in 
ten years.

 i am using this parameter to create single file per backup job and give 
 them meaningful names - would it indeed at some point get replaced by a 
 requirement to script in python ?

That requirement, by the way, is not very problematic. The sample 
given in the manual should almost work out of the box, and python is 
easier to learn than Baculas variable substitution language :-)

 This is described in the manual, for example 
 http://www.bacula.org/dev-manual/Python_Scripting.html#SECTION00356
 ...

Anyway - I'm operating Bacula installations using the LabelFormat 
option as well, and those work correctly. But then, these 
installations haven't labeled a volume for more than a year now, as 
their pools have reached their maximum number of volumes by now. It 
might be that there is a bug somewhere, which noone noticed yet.

You could try to set up a test pool and job, where you limit the 
volumes to, say, 10MB, use the most simple form of LabelFormat, i.e. 
Label- or something, and assign a newly created storage device to it.

Then, run a job, preferrably with debug output enabled, and see what 
happens.

That should eliminate the chance that some misconfiguration crept into 
your catalog, and it should give a good set of debug files to analyze 
quickly.

Arno

-- 
Arno Lehmann
IT-Service Lehmann
www.its-lehmann.de

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula-SD hang using IBM Ultrium 3581 Library

2007-10-23 Thread jay
I was using unmount from bconsole to unmount the tape.  It was not releasing
it.  That is what is confusing me.  But your saying it should.  So its even
more perplexing now.  Release seems to do what I want.  It unmounts the
tape, and releases the drive.  But the word unmount seems more intuitive
to me than release.

Jay

On 10/23/07, Arno Lehmann [EMAIL PROTECTED] wrote:

 Hi,

 23.10.2007 20:21,, jay wrote::
  Thanks Blake,
 
  You are correct, it seems when I run an unmount, the drive goes into
  this state
 
  Jobs waiting to reserve a drive:
 3604 JobId=25 device Drive-0 (/dev/nst0) is BLOCKED due to user
  unmount.
 
  Device status:
  Autochanger Autochanger with devices:
 Drive-0 (/dev/nst0)
  Device FileStorage (/tmp) is not open.
  Device Drive-0 (/dev/nst0) is not open.
  Device is BLOCKED. User unmounted.
  Drive 0 status unknown.
 
 
  If i restart the bacula-sd daemon, the status is now
 
  Device status:
  Autochanger Autochanger with devices:
 Drive-0 (/dev/nst0)
  Device FileStorage (/tmp) is not open.
  Device Drive-0 (/dev/nst0) is not open.
  Drive 0 status unknown.
 
  So that appears to be the problem.  And my next question is, release
  is the proper way to unmount a tape from the drive?  It appears to work,
  I'm just trying to understand the difference.  Thanks a lot

 The difference is that 'umount' unloads the tape and then releases the
 drive for use by other programs. 'release' only releases the drive and
 informs the SD of the fact that it has to ensure proper tape
 positioning when it starts using the tape again.

 Your original problem seems to be that you didn't notice you have to
 mount the storage after manually unmounting it. Bacula does not send a
 reminder mail in these cases, because the operator is expected to know
 if the tape was manually unmounted :-)

 So, in general: If you unmount a storage device, you have to mount it
 again. The current status is, as stated, easily checked with the 'sta
 sd' command.

 Arno

  Jay
 
 
  On 10/23/07, *Blake Dunlap* [EMAIL PROTECTED] mailto:[EMAIL PROTECTED]
 wrote:
 
  If you run a status storage when this is occurring, I believe you
  will see that the drive is unmounted and offline by user. Mounting a
  tape, or instead using the release command to unmount tapes should
  solve your problem if this is the case.
 
 
 
  *From:* [EMAIL PROTECTED]
  mailto:[EMAIL PROTECTED]
  [mailto:[EMAIL PROTECTED]
  mailto:[EMAIL PROTECTED]] *On Behalf Of
 *jay
  *Sent:* Tuesday, October 23, 2007 11:16 AM
  *To:* bacula-users@lists.sourceforge.net
  mailto:bacula-users@lists.sourceforge.net
  *Subject:* [Bacula-users] Bacula-SD hang using IBM Ultrium 3581
 Library
 
 
 
  Hello,
 
  I'm having a peculiar problem with an IBM Ultrium 3581 autochanger
  and the SD daemon.  I have to restart the SD daemon after I unmount
  a tape, or the next job hangs and never starts.
 
  We currently have a single LTO2 drive in the library, and are
  running Bacula 2.2.5 on a Redhat Enterprise Linux 4 update 5 IBM
  server.  I ran all the btape tests, including the multiple tape test
  for autochangers, and they all worked flawlessly.  Not a single
  problem or error reported.  I am able to use the mtx script and mt
  successfully as well.  Mtx reports all the proper tapes in the
  library, and I can mount a tape and WEOF and REWIND it using mt.
  Things look great at this point.  Next, I ran label barcodes and
  it labeled all the tapes in the library properly.  Again, no
  problems.  I decided at this point to modify the Full OS Set
  backup for our environment and run some tests.  I can successfully
  run the backup the first time.  It pulls a tape from the proper pool
  inside the library, backup works.  But if I unmount the tape in
  bconsole, and try and run the same backup again, it hangs.  Nothing
  happens.  I have waited several hours and nothing ever times out.  I
  finally have to cancel the job manually.  I discovered that by
  restarting bacula-sd that I can then re-run the job immediately
  without any problems.
 
  I'm not sure what could be causing this, or how to even
  troubleshoot.  Things seem to work great during all tests and doing
  a backup, Bacula just doesn't like it when I unmount a tape
 manually.
 
  Could someone offer some advice or debugging steps I could take to
  figure this out?  Below is a copy of my bacula-sd.conf file.  I can
  post other config files if I need to.  Thanks
 
  Jay
 
 
   bacula-sd.conf ---
 
  Storage {
Name = server1-sd
SDPort = 9103
WorkingDirectory = /var/lib/bacula
Pid Directory = /var/run
Maximum Concurrent Jobs = 20
SDAddress = 192.168.1.20 http://192.168.1.20
  }
 
  Director {
Name = server1-dir
Password = 1234
  }
 

[Bacula-users] Job started twice

2007-10-23 Thread Michael Short
Hello,

In my bacula configuration, I have a single client configuration (and
job) for every one of my ~30 clients. However, recently, one of the
jobs has started to act differently. When the backup starts, it starts
again, only to cause the job to fail.

21-Oct 18:00 secnet-def: Start Backup JobId 4376, Job=sv27.2007-10-21_18.00.07
21-Oct 18:00 secnet-def: Start Backup JobId 4376, Job=sv27.2007-10-21_18.00.07
21-Oct 17:42 sv27: DIR and FD clocks differ by -1078 seconds, FD
automatically adjusting.
21-Oct 18:00 secnet-def: Labeled new Volume sv270095 on device
sv27 (/home/bacula/storage/d1).
21-Oct 18:00 secnet-def: Wrote label to prelabeled Volume sv270095
on device sv27 (/home/bacula/storage/d1)
21-Oct 18:00 secnet-def: Volume used once. Marking Volume sv270095 as Used.
21-Oct 17:42 sv27: Generate VSS snapshots. Driver=VSS Win 2003, Drive(s)=CD
21-Oct 18:00 secnet-def: Start Backup JobId 4376, Job=sv27.2007-10-21_18.00.07
21-Oct 17:42 sv27: DIR and FD clocks differ by -1078 seconds, FD
automatically adjusting.
21-Oct 18:00 secnet-def: Labeled new Volume sv270095 on device
sv27 (/home/bacula/storage/d1).
21-Oct 18:00 secnet-def: Wrote label to prelabeled Volume sv270095
on device sv27 (/home/bacula/storage/d1)
21-Oct 18:00 secnet-def: Volume used once. Marking Volume sv270095 as Used.
21-Oct 17:42 sv27: Generate VSS snapshots. Driver=VSS Win 2003, Drive(s)=CD
21-Oct 18:00 secnet-def: Start Backup JobId 4376, Job=sv27.2007-10-21_18.00.07
21-Oct 17:42 sv27: DIR and FD clocks differ by -1078 seconds, FD
automatically adjusting.
21-Oct 18:00 secnet-def: Labeled new Volume sv270095 on device
sv27 (/home/bacula/storage/d1).
21-Oct 18:00 secnet-def: Wrote label to prelabeled Volume sv270095
on device sv27 (/home/bacula/storage/d1)

 this volume labeling sherade continues to happen about 10 more times 

  JobId:  4376
  Job:sv27.2007-10-21_18.00.07
  Backup Level:   Incremental, since=2007-10-08 18:00:21
  Client: sv27 2.0.0 (04Jan07) Linux,Cross-compile,Win32
  FileSet:sv27 2007-07-10 09:43:58
  Pool:   sv27 (From Job resource)
  Storage:sv27 (From Job resource)
  Scheduled time: 21-Oct-2007 18:00:06
  Start time: 21-Oct-2007 18:00:21
  End time:   22-Oct-2007 18:01:02
  Elapsed time:   1 day 41 secs
  Priority:   10
  FD Files Written:   0
  SD Files Written:   0
  FD Bytes Written:   0 (0 B)
  SD Bytes Written:   0 (0 B)
  Rate:   0.0 KB/s
  Software Compression:   None
  VSS:no
  Encryption: no
  Volume name(s): sv270095
  Volume Session Id:  51
  Volume Session Time:1192828139
  Last Volume Bytes:  2,999,807,971 (2.999 GB)
  Non-fatal FD errors:0
  SD Errors:  0
  FD termination status:  Error
  SD termination status:  Error
  Termination:*** Backup Error ***

However, I will then get a second error for the same job (but not the
same JobId!).

22-Oct 18:01 secnet-def: Start Backup JobId 4397, Job=sv27.2007-10-22_18.00.07
22-Oct 18:01 secnet-def: Start Backup JobId 4397, Job=sv27.2007-10-22_18.00.07
22-Oct 18:01 secnet-def: Created new Volume sv270096 in catalog.
22-Oct 17:43 sv27: DIR and FD clocks differ by -1083 seconds, FD
automatically adjusting.
22-Oct 18:01 secnet-def: sv27.2007-10-22_18.00.07 Fatal error:
acquire.c:355 Wanted to append to Volume sv270096, but device sv27
(/home/bacula/storage/d1) is busy writing on sv270095 .
22-Oct 17:43 sv27: sv27.2007-10-22_18.00.07 Fatal error:
../../filed/job.c:1751 Bad response to Append Data command. Wanted
3000 OK data
, got 3903 Error append data

22-Oct 18:01 secnet-def: sv27.2007-10-22_18.00.07 Error: Bacula 2.0.3
(06Mar07): 22-Oct-2007 18:01:16
  JobId:  4397
  Job:sv27.2007-10-22_18.00.07
  Backup Level:   Incremental, since=2007-10-08 18:00:21
  Client: sv27 2.0.0 (04Jan07) Linux,Cross-compile,Win32
  FileSet:sv27 2007-07-10 09:43:58
  Pool:   sv27 (From Job resource)
  Storage:sv27 (From Job resource)
  Scheduled time: 22-Oct-2007 18:00:06
  Start time: 22-Oct-2007 18:01:14
  End time:   22-Oct-2007 18:01:16
  Elapsed time:   2 secs
  Priority:   10
  FD Files Written:   0
  SD Files Written:   0
  FD Bytes Written:   0 (0 B)
  SD Bytes Written:   0 (0 B)
  Rate:   0.0 KB/s
  Software Compression:   None
  VSS:yes
  Encryption: no
  Volume name(s):
  Volume Session Id:  78
  Volume Session Time:1192828139
  Last Volume Bytes:  0 (0 B)
  Non-fatal FD errors:0
  SD Errors:  0
  FD termination status:  Error
  SD termination status:  Error
  Termination:*** Backup Error ***

Whats the dilio? Could this be a bug?


Re: [Bacula-users] Job started twice

2007-10-23 Thread Arno Lehmann
Hi,

23.10.2007 22:11,, Michael Short wrote::
 Hello,
 
 In my bacula configuration, I have a single client configuration (and
 job) for every one of my ~30 clients. However, recently, one of the
 jobs has started to act differently. When the backup starts, it starts
 again, only to cause the job to fail.

I assume it's always the same job that behaves like this?

 21-Oct 18:00 secnet-def: Start Backup JobId 4376, Job=sv27.2007-10-21_18.00.07
 21-Oct 18:00 secnet-def: Start Backup JobId 4376, Job=sv27.2007-10-21_18.00.07
 21-Oct 17:42 sv27: DIR and FD clocks differ by -1078 seconds, FD
 automatically adjusting.

It might be started twice because the DIR clock jumps.

 21-Oct 18:00 secnet-def: Labeled new Volume sv270095 on device
 sv27 (/home/bacula/storage/d1).
 21-Oct 18:00 secnet-def: Wrote label to prelabeled Volume sv270095
 on device sv27 (/home/bacula/storage/d1)
 21-Oct 18:00 secnet-def: Volume used once. Marking Volume sv270095 as Used.
 21-Oct 17:42 sv27: Generate VSS snapshots. Driver=VSS Win 2003, 
 Drive(s)=CD
 21-Oct 18:00 secnet-def: Start Backup JobId 4376, Job=sv27.2007-10-21_18.00.07
 21-Oct 17:42 sv27: DIR and FD clocks differ by -1078 seconds, FD
 automatically adjusting.
 21-Oct 18:00 secnet-def: Labeled new Volume sv270095 on device
 sv27 (/home/bacula/storage/d1).
 21-Oct 18:00 secnet-def: Wrote label to prelabeled Volume sv270095
 on device sv27 (/home/bacula/storage/d1)
 21-Oct 18:00 secnet-def: Volume used once. Marking Volume sv270095 as Used.
 21-Oct 17:42 sv27: Generate VSS snapshots. Driver=VSS Win 2003, 
 Drive(s)=CD
 21-Oct 18:00 secnet-def: Start Backup JobId 4376, Job=sv27.2007-10-21_18.00.07
 21-Oct 17:42 sv27: DIR and FD clocks differ by -1078 seconds, FD
 automatically adjusting.
 21-Oct 18:00 secnet-def: Labeled new Volume sv270095 on device
 sv27 (/home/bacula/storage/d1).
 21-Oct 18:00 secnet-def: Wrote label to prelabeled Volume sv270095
 on device sv27 (/home/bacula/storage/d1)

Definitely something funny going on here...

 
  this volume labeling sherade continues to happen about 10 more times 
 
   JobId:  4376
   Job:sv27.2007-10-21_18.00.07
   Backup Level:   Incremental, since=2007-10-08 18:00:21
   Client: sv27 2.0.0 (04Jan07) Linux,Cross-compile,Win32
   FileSet:sv27 2007-07-10 09:43:58
   Pool:   sv27 (From Job resource)
   Storage:sv27 (From Job resource)
   Scheduled time: 21-Oct-2007 18:00:06
   Start time: 21-Oct-2007 18:00:21
   End time:   22-Oct-2007 18:01:02
   Elapsed time:   1 day 41 secs
   Priority:   10
   FD Files Written:   0
   SD Files Written:   0
   FD Bytes Written:   0 (0 B)
   SD Bytes Written:   0 (0 B)
   Rate:   0.0 KB/s
   Software Compression:   None
   VSS:no
   Encryption: no
   Volume name(s): sv270095
   Volume Session Id:  51
   Volume Session Time:1192828139
   Last Volume Bytes:  2,999,807,971 (2.999 GB)
   Non-fatal FD errors:0
   SD Errors:  0
   FD termination status:  Error
   SD termination status:  Error
   Termination:*** Backup Error ***
 
 However, I will then get a second error for the same job (but not the
 same JobId!).

So that would be for the second job started.

 22-Oct 18:01 secnet-def: Start Backup JobId 4397, Job=sv27.2007-10-22_18.00.07
 22-Oct 18:01 secnet-def: Start Backup JobId 4397, Job=sv27.2007-10-22_18.00.07
 22-Oct 18:01 secnet-def: Created new Volume sv270096 in catalog.
 22-Oct 17:43 sv27: DIR and FD clocks differ by -1083 seconds, FD
 automatically adjusting.
 22-Oct 18:01 secnet-def: sv27.2007-10-22_18.00.07 Fatal error:
 acquire.c:355 Wanted to append to Volume sv270096, but device sv27
 (/home/bacula/storage/d1) is busy writing on sv270095 .
 22-Oct 17:43 sv27: sv27.2007-10-22_18.00.07 Fatal error:
 ../../filed/job.c:1751 Bad response to Append Data command. Wanted
 3000 OK data
 , got 3903 Error append data
 
 22-Oct 18:01 secnet-def: sv27.2007-10-22_18.00.07 Error: Bacula 2.0.3
 (06Mar07): 22-Oct-2007 18:01:16
   JobId:  4397
   Job:sv27.2007-10-22_18.00.07
   Backup Level:   Incremental, since=2007-10-08 18:00:21
   Client: sv27 2.0.0 (04Jan07) Linux,Cross-compile,Win32
   FileSet:sv27 2007-07-10 09:43:58
   Pool:   sv27 (From Job resource)
   Storage:sv27 (From Job resource)
   Scheduled time: 22-Oct-2007 18:00:06
   Start time: 22-Oct-2007 18:01:14
   End time:   22-Oct-2007 18:01:16
   Elapsed time:   2 secs
   Priority:   10
   FD Files Written:   0
   SD Files Written:   0
   FD Bytes Written:   0 (0 B)
   SD Bytes Written:   0 (0 B)
   Rate:   0.0 KB/s
   Software Compression:   None
   VSS:yes
   

Re: [Bacula-users] Job started twice

2007-10-23 Thread Michael Short
 I assume it's always the same job that behaves like this?

Yeah.

 It might be started twice because the DIR clock jumps.

That could very well be the problem, seems theres some 30 minutes
difference between the clocks.

 So that would be for the second job started.

Yeah thats what I'm thinking.

 Have you checked what happens when you run this job manually, when no
 other jobs are active?

I plan to try this once I figure out how to get the schedules updated.

 Before you report this as a bug it would be good to supply some more
 information - the versions of Bacula, for example :-)

Running bacula-dir and bacula-sd 2.0.3, and bacula-fd 2.0.0. I know
there are some serious bugs that have been fixed and I am working on
upgrading (not an easy task).

 What I'd do in your situation is first making sure the problem happens
 also when only this one job is active, i.e. disable all your other
 jobs, or schedule this problem job differently.

 Then, run the DIR with debug tracing enabled and see if that tells you
 something.

 All this is worth the effort only with a reasonably recent version of
 Bacula as I suppose Kern would not spend much time on 1.38 bugs anymore...

I ran the backup manually with run and there seemed to be no problems.
Also, when I set a delay in the run time there aren't any problems.
However, I'm not sure how to update the scheduled jobs list after it
has already been generated... I updated the configuration but it
doesn't seem to care. Also tried deleting bacula's state file but that
didn't work either. Any tips?

Sincerely,
-Michael

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Job started twice

2007-10-23 Thread Arno Lehmann
Hello,

23.10.2007 23:42,, Michael Short wrote::
 I assume it's always the same job that behaves like this?
 
 Yeah.
 
 It might be started twice because the DIR clock jumps.
 
 That could very well be the problem, seems theres some 30 minutes
 difference between the clocks.
 
 So that would be for the second job started.
 
 Yeah thats what I'm thinking.
 
 Have you checked what happens when you run this job manually, when no
 other jobs are active?
 
 I plan to try this once I figure out how to get the schedules updated.
 
 Before you report this as a bug it would be good to supply some more
 information - the versions of Bacula, for example :-)
 
 Running bacula-dir and bacula-sd 2.0.3, and bacula-fd 2.0.0. I know
 there are some serious bugs that have been fixed and I am working on
 upgrading (not an easy task).

Ok... 2.0.3 doesn't have any scheduling problems I know of.

 What I'd do in your situation is first making sure the problem happens
 also when only this one job is active, i.e. disable all your other
 jobs, or schedule this problem job differently.

 Then, run the DIR with debug tracing enabled and see if that tells you
 something.

 All this is worth the effort only with a reasonably recent version of
 Bacula as I suppose Kern would not spend much time on 1.38 bugs anymore...
 
 I ran the backup manually with run and there seemed to be no problems.

Ok, so for now we'll concentrate on the schedules.

Can you post the schedules referenced in your job definition?

 Also, when I set a delay in the run time there aren't any problems.
 However, I'm not sure how to update the scheduled jobs list after it
 has already been generated... I updated the configuration but it
 doesn't seem to care. Also tried deleting bacula's state file but that
 didn't work either. Any tips?

The state file doesn't matter here... did you do a reload after the 
configuration change? That should lead to the jobs being freshly 
scheduled.

Arno

 
 Sincerely,
 -Michael
 

-- 
Arno Lehmann
IT-Service Lehmann
www.its-lehmann.de

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] need help defining client files for backup...

2007-10-23 Thread David Gardner

Hey gang,

I've read through all the docs I can find on the subject but just
 cannot decipher the correct method of describing in a fileset which
 directories on which client machine should be backed up.

Here's the Linux Server:/directories I want backed up where the
 connections have all been made and I successfully backed up the local files:

{localhost:}/home/*
RptEngine1:/usr/local/reports/A*.pdf
DB2:/var/lib/mysql/*
WEB1:/web/sites/*

Any help would be appreciated. 
/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\
David Gardner
email: djgardner(at)yahoo.com
Yahoo! IM: djgardner
AIM: dgardner09 
Everything is a learning experience, even a mistake.




__
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com 

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] need help defining client files for backup...

2007-10-23 Thread Arno Lehmann
Hi,

23.10.2007 23:57,, David Gardner wrote::
 Hey gang,
 
 I've read through all the docs I can find on the subject but just
  cannot decipher the correct method of describing in a fileset which
  directories on which client machine should be backed up.
 
 Here's the Linux Server:/directories I want backed up where the
  connections have all been made and I successfully backed up the local files:
 
 {localhost:}/home/*
 RptEngine1:/usr/local/reports/A*.pdf
 DB2:/var/lib/mysql/*
 WEB1:/web/sites/*
 
 Any help would be appreciated. 

You define the necessary clients first.

Then you create the filesets you need - there will be at least four of 
them.

/home/, /var/lib/mysql/, and /web/sites/ are easy.

/usr/local/reports/A*.pdf will need wildcards or regexes in an options 
clause.

Nte that backing up the mysql database files while the database server 
is running is useless - you need to shut down the database server, or 
dump the databases you're interested in to a file and back up that (or 
these) files.

Hope that gets you started,

Arno

 /\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\
 David Gardner
 email: djgardner(at)yahoo.com
 Yahoo! IM: djgardner
 AIM: dgardner09 
 Everything is a learning experience, even a mistake.
 
 
 
 
 __
 Do You Yahoo!?
 Tired of spam?  Yahoo! Mail has the best spam protection around 
 http://mail.yahoo.com 
 
 -
 This SF.net email is sponsored by: Splunk Inc.
 Still grepping through log files to find problems?  Stop.
 Now Search log events and configuration files using AJAX and a browser.
 Download your FREE copy of Splunk now  http://get.splunk.com/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users
 

-- 
Arno Lehmann
IT-Service Lehmann
www.its-lehmann.de

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem with backing up over the internet

2007-10-23 Thread Radek Hladik
Mateus Interciso napsal(a):
 On Tue, 23 Oct 2007 12:37:13 +, Mateus Interciso wrote:
 
 On Mon, 22 Oct 2007 17:28:40 +, Mateus Interciso wrote:

 On Mon, 22 Oct 2007 19:19:34 +0200, Radek Hladik wrote:

 Mateus Interciso napsal(a):
 On Mon, 22 Oct 2007 15:44:23 +, Mateus Interciso wrote:

 On Mon, 22 Oct 2007 15:17:32 +, Mateus Interciso wrote:

 On Fri, 19 Oct 2007 15:51:24 +0200, Viktor Radnai wrote:

 Hi there,

 On 10/18/07, Arno Lehmann [EMAIL PROTECTED] wrote:

 You can do this even if the SD is inside your firewall, you'll
 need port forwarding or a proxy on the firewall then. With
 separate DNS zones inside and outside, resolving the SD hostname
 either as the internal or the external IP, this can be seamlessly
 integrated with your internal Bacula setup.

 Arno
 I think in this case, /etc/hosts is your friend :-)

 Configure your storage daemon with a hostname, and specify that
 hostname in /etc/hosts to be either the internal or the external
 address, as required. And you don't need to return different
 results from your internal DNS server. Dead simple and works well.

 HTH,

 Cheers,
 Vik
 --
 My other sig is hilarious





 -
 This SF.net email is sponsored by: Splunk Inc. Still grepping
 through log files to find problems?  Stop. Now Search log events
 and configuration files using AJAX and a browser. Download your
 FREE copy of Splunk now  http://get.splunk.com/
 Ok, but how do I configure the storage daemon with a hostname?





 -
 This SF.net email is sponsored by: Splunk Inc. Still grepping
 through log files to find problems?  Stop. Now Search log events
 and configuration files using AJAX and a browser. Download your
 FREE copy of Splunk now  http://get.splunk.com/
 Sorry, I should have sayd more...
 when I try to put the Address config on the sd, like this:

 Storage { # definition of myself
   Name = test-sd
   Address = Storage-Server
   SDPort = 9103  # Director's port WorkingDirectory
   = /var/lib/bacula
   Pid Directory = /var/run
   Maximum Concurrent Jobs = 20
 }

 I get this error when I start bacula-sd

 22-Oct 14:11 bacula-sd: ERROR TERMINATION at parse_conf.c:889 Config
 error: Keyword Address not permitted in this resource. Perhaps you
 left the trailing brace off of the previous resource.
 : line 15, col 10 of file /etc/bacula/bacula-sd.conf
   Address = Storage-Server

 :(

 Mateus





 -
 This SF.net email is sponsored by: Splunk Inc. Still grepping
 through log files to find problems?  Stop. Now Search log events and
 configuration files using AJAX and a browser. Download your FREE
 copy of Splunk now  http://get.splunk.com/
 I've just managed to make the backups run across the internet. I'm
 really thankfull for all of you guys :d Fiddling a little with the
 /etc/hosts and the firewall...it worked perfectly :D Now is just
 making it secure...thanks a lot guys :D

 I would suggest you OpenVPN. It is easy to setup, there is a lot of
 howtos on the net and it will solve all NAT problems. OpenVPN is for
 both Windows and Linux and all it needs is one port on public IP. We
 use it for backing up remote servers and it works like a charm.

 Basically you need to install OpenVPN server in your office and
 OpenVPN clients on all your clients. OpenVPN will create new
 ethernet devices which are connected all together. You then setup
 some private IPs on this virtual network and use them in bacula
 configuration.

 Radek



 -
 This SF.net email is sponsored by: Splunk Inc. Still grepping through
 log files to find problems?  Stop. Now Search log events and
 configuration files using AJAX and a browser. Download your FREE copy
 of Splunk now  http://get.splunk.com/

 Interesting...I'll take a look at it...thanks a lot once again. :D

 Mateus



 -
 This SF.net email is sponsored by: Splunk Inc. Still grepping through
 log files to find problems?  Stop. Now Search log events and
 configuration files using AJAX and a browser. Download your FREE copy
 of Splunk now  http://get.splunk.com/
 Hum...it seems that not everything is perfect tough...
 From one server, there's no problem backing up, but from another, which
 has a lot of traffic, is basically impossible to back up, since I got
 every time a big Broken Pipe
 any help is apreciated...

 Thanks a lot

 MAteus



 -
 This SF.net email is sponsored by: Splunk Inc. Still grepping through
 log files to find problems?  Stop. Now Search log events and
 configuration files using AJAX and a browser. Download your FREE copy of
 Splunk 

Re: [Bacula-users] need help defining client files for backup...

2007-10-23 Thread David Gardner
Arno,

Are you suggesting I create multiple fileset (directives) within  
bacula-dir.conf?  If so, how do I identify the fileset with the client?

That is the root of my confusion, I cannot figure out how to correlate a group 
of files/directories with hosts.
 
/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\
David Gardner
email: djgardner(at)yahoo.com
Yahoo! IM: djgardner
AIM: dgardner09 
Everything is a learning experience, even a mistake.

- Original Message 
From: Arno Lehmann [EMAIL PROTECTED]
To: bacula-users@lists.sourceforge.net
Sent: Tuesday, October 23, 2007 3:01:24 PM
Subject: Re: [Bacula-users] need help defining client files for backup...


Hi,

23.10.2007 23:57,, David Gardner wrote::
 Hey gang,
 
 I've read through all the docs I can find on the subject but just
  cannot decipher the correct method of describing in a fileset which
  directories on which client machine should be backed up.
 
 Here's the Linux Server:/directories I want backed up where the
  connections have all been made and I successfully backed up the
 local files:
 
 {localhost:}/home/*
 RptEngine1:/usr/local/reports/A*.pdf
 DB2:/var/lib/mysql/*
 WEB1:/web/sites/*
 
 Any help would be appreciated. 

You define the necessary clients first.

Then you create the filesets you need - there will be at least four of 
them.

/home/, /var/lib/mysql/, and /web/sites/ are easy.

/usr/local/reports/A*.pdf will need wildcards or regexes in an options 
clause.

Nte that backing up the mysql database files while the database server 
is running is useless - you need to shut down the database server, or 
dump the databases you're interested in to a file and back up that (or 
these) files.

Hope that gets you started,

Arno

 /\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\
 David Gardner
 email: djgardner(at)yahoo.com
 Yahoo! IM: djgardner
 AIM: dgardner09 
 Everything is a learning experience, even a mistake.
 
 
 
 
 __
 Do You Yahoo!?
 Tired of spam?  Yahoo! Mail has the best spam protection around 
 http://mail.yahoo.com 
 

 -
 This SF.net email is sponsored by: Splunk Inc.
 Still grepping through log files to find problems?  Stop.
 Now Search log events and configuration files using AJAX and a
 browser.
 Download your FREE copy of Splunk now  http://get.splunk.com/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users
 

-- 
Arno Lehmann
IT-Service Lehmann
www.its-lehmann.de

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users





__
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com 

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] [Fwd: Re: need help defining client files for backup...]

2007-10-23 Thread James P. Kinney III
 Forwarded Message 
 From: James P. Kinney III [EMAIL PROTECTED]
 To: David Gardner [EMAIL PROTECTED]
 Subject: Re: [Bacula-users] need help defining client files for
 backup...
 Date: Tue, 23 Oct 2007 21:33:11 -0400
 
 On Tue, 2007-10-23 at 15:50 -0700, David Gardner wrote:
  Arno,
  
  Are you suggesting I create multiple fileset (directives) within  
  bacula-dir.conf?  If so, how do I identify the fileset with the client?
 
 also in bacula-dir.conf:
 
 JobDefs {
   Name = WebHost
   Type = Backup
   Level = Incremental
   Client = WebHost
   FileSet = Full Set
   Schedule = WeeklyCycle
   Storage = PacketLoader
   Messages = Standard
   Pool = Default
   Priority = 10
 }
 
 The machine is called WebHost and I am backing up a set of directories
 called Full Set.
 
 There is also a job called:
 
 Job {
   Name = WebHost
   JobDefs = WebHost
   Write Bootstrap = /var/bacula/WebHost.bsr
 }
 
 
 and an associated fileset called Full Set:
 
 # List of files to be backed up
 FileSet {
   Name = Full Set
   Include {
 Options {
   signature = MD5
 }
 #
 #  Put your list of files here, preceded by 'File =', one per line
 #or include an external list with:
 #
 #File = file-name
 #
 #  Note: / backs up everything on the root partition.
 #if you have other partitons such as /usr or /home
 #you will probably want to add them too.
 #
 #  By default this is defined to point to the Bacula build
 #directory to give a reasonable FileSet to backup to
 #disk storage during initial testing.
 #
 #File = /usr/src/redhat/BUILD/bacula-1.38.3
  File = /home
  File = /
  File = /boot
  File = /var
   }
 
 #
 # If you backup the root directory, the following two excluded
 #   files can be useful
 #
   Exclude {
 File = /proc
 File = /tmp
 File = /.journal
 File = /.fsck
 File = /var/mail
 File = /sys
   }
 }
 
 
 And all of this is in bacula-dir.conf.
 
 Note: There is a specific listing for each _PARTITION_ in the fileset.
 Otherwise, the backup process will not cross partition boundaries.
 
 An example for a windows machine fileset (with many exclusions!) is
 below:
 beware of line wrapping
 
 #This is my Windows 2000 fileset:
 FileSet {
  Name = win2k
  Include {
   Options {
signature = SHA1
Exclude = yes
IgnoreCase = yes
# Exclude Mozilla-based programs' file caches
WildDir = [A-Z]:/Documents and Settings/*/Application
 Data/*/Profiles/*/*/Cache
WildDir = [A-Z]:/Documents and Settings/*/Application
 Data/*/Profiles/*/*/Cache.Trash
WildDir = [A-Z]:/Documents and Settings/*/Application
 Data/*/Profiles/*/*/ImapMail
# Exclude user's registry files - they're always in use anyway.
WildFile = [A-Z]:/Documents and Settings/*/Local
 Settings/Application Data/Microsoft/Windows/usrclass.*
WildFile = [A-Z]:/Documents and Settings/*/ntuser.*
# Exclude directories full of lots and lots of useless little files
WildDir = [A-Z]:/Documents and Settings/*/Cookies
WildDir = [A-Z]:/Documents and Settings/*/Recent
WildDir = [A-Z]:/Documents and Settings/*/Local Settings/History
WildDir = [A-Z]:/Documents and Settings/*/Local Settings/Temp
WildDir = [A-Z]:/Documents and Settings/*/Local Settings/Temporary
 Internet Files
# These are always open and unable to be backed up
WildFile = [A-Z]:/Documents and Settings/All Users/Application
 Data/Microsoft/Network/Downloader/qmgr[01].dat
# Some random bits of Windows we want to ignore
WildFile = [A-Z]:/WIN*/security/logs/scepol.log
WildDir = [A-Z]:/WIN*/system32/config
WildDir = [A-Z]:/WIN*/msdownld.tmp
WildDir = [A-Z]:/WIN*/Internet Logs
WildDir = [A-Z]:/WIN*/$Nt*Uninstall*
WildDir = [A-Z]:/WIN*/sysvol
WildFile = [A-Z]:/WIN*/cluster/CLUSDB
WildFile = [A-Z]:/WIN*/cluster/CLUSDB.LOG
WildFile = [A-Z]:/WIN*/NTDS/edb.log
WildFile = [A-Z]:/WIN*/NTDS/ntds.dit
WildFile = [A-Z]:/WIN*/NTDS/temp.edb
WildFile = [A-Z]:/WIN*/ntfrs/jet/log/edb.log
WildFile = [A-Z]:/WIN*/ntfrs/jet/ntfrs.jdb
WildFile = [A-Z]:/WIN*/ntfrs/jet/temp/tmp.edb
WildFile = [A-Z]:/WIN*/system32/CPL.CFG
WildFile = [A-Z]:/WIN*/system32/dhcp/dhcp.mdb
WildFile = [A-Z]:/WIN*/system32/dhcp/j50.log
WildFile = [A-Z]:/WIN*/system32/dhcp/tmp.edb
WildFile = [A-Z]:/WIN*/system32/LServer/edb.log
WildFile = [A-Z]:/WIN*/system32/LServer/TLSLic.edb
WildFile = [A-Z]:/WIN*/system32/LServer/tmp.edb
WildFile = [A-Z]:/WIN*/system32/wins/j50.log
WildFile = [A-Z]:/WIN*/system32/wins/wins.mdb
WildFile = [A-Z]:/WIN*/system32/wins/winstmp.mdb
WildDir = [A-Z]:/WIN*/SoftwareDistribution/EventCache/*
WildFile = [A-Z]:/hiberfil.sys
# Temporary directories  files
WildDir = [A-Z]:/WIN*/Temp
WildDir = [A-Z]:/temp
WildFile = *.tmp
WildDir = [A-Z]:/tmp
WildDir = [A-Z]:/var/tmp
# Recycle bins
WildDir = [A-Z]:/RECYCLER
# Swap files
WildFile = [A-Z]:/pagefile.sys
# 

Re: [Bacula-users] need help defining client files for backup...

2007-10-23 Thread David Gardner
Guys,

If I understand you correctly, the following should be a_piece_ of the 
bacula-dir.conf. I want to understand this but the problem still remains, how 
do I tie the files on WEB1, DB2 and RptEngine into the default job?

JobDefs {
  Name = DefaultJob
  Type = Backup
  Level = Incremental
  Client = DURANGO-fd
  FileSet = Full Set
  Schedule = WeeklyCycle
  Storage = DAT72
  Messages = ConsOnly# no email during testing
  Pool = Default
  Priority = 10
}



# Localhost to backup
Client {
  Name = DURANGO-fd
  Address = DURANGO
  FDPort = 9102
  Catalog = MyCatalog
  Password = l4...y# password for FileDaemon
  File Retention = 30 days# 30 days
  Job Retention = 6 months# six months
  AutoPrune = yes# Prune expired Jobs/Files
}

# Local files
FileSet {
  Name = Full Set
  Include {
Options { signature = MD5 }
File = /home/dgardner
  }

}


#
# Database Client to backup
#
Client {
  Name = DB2-fd
  Address = DB2
  FDPort = 9102
  Catalog = MyCatalog
  Password = l4...2# password for FileDaemon
  File Retention = 30 days# 30 days
  Job Retention = 6 months# six months
  AutoPrune = yes# Prune expired Jobs/Files
}

# Database files
FileSet {
  Name = Full Set
  Include {
Options { Compression=GZIP }
File = /var/lib/mysql/airadvice-backup/c*
  }

}



#
# Web Server Client to backup
#
Client {
  Name = WEB1-fd
  Address = WEB1
  FDPort = 9102
  Catalog = MyCatalog
  Password = l4...2# password for FileDaemon
  File Retention = 30 days# 30 days
  Job Retention = 6 months# six months
  AutoPrune = yes# Prune expired Jobs/Files
}

# Webserver files
FileSet {
  Name = Full Set
  Include {
Options { Compression=GZIP }
File = /web/sites/*
  }

}


#
# Report Engine Client to backup
#
Client {
  Name = RptEngine1-fd
  Address = RptEngine1
  FDPort = 9102
  Catalog = MyCatalog
  Password = l4...2# password for FileDaemon
  File Retention = 30 days# 30 days
  Job Retention = 6 months# six months
  AutoPrune = yes# Prune expired Jobs/Files
}

# RptEngine files
FileSet {
  Name = Full Set
  Include {
Options { Compression=GZIP }
File = /usr/local/reports/A*
  }

}
/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\
David Gardner
email: djgardner(at)yahoo.com
Yahoo! IM: djgardner
AIM: dgardner09 
Everything is a learning experience, even a mistake.

- Original Message 
From: Arno Lehmann [EMAIL PROTECTED]
To: bacula-users@lists.sourceforge.net
Sent: Tuesday, October 23, 2007 3:01:24 PM
Subject: Re: [Bacula-users] need help defining client files for backup...


Hi,

23.10.2007 23:57,, David Gardner wrote::
 Hey gang,
 
 I've read through all the docs I can find on the subject but just
  cannot decipher the correct method of describing in a fileset which
  directories on which client machine should be backed up.
 
 Here's the Linux Server:/directories I want backed up where the
  connections have all been made and I successfully backed up the
 local files:
 
 {localhost:}/home/*
 RptEngine1:/usr/local/reports/A*.pdf
 DB2:/var/lib/mysql/*
 WEB1:/web/sites/*
 
 Any help would be appreciated. 

You define the necessary clients first.

Then you create the filesets you need - there will be at least four of 
them.

/home/, /var/lib/mysql/, and /web/sites/ are easy.

/usr/local/reports/A*.pdf will need wildcards or regexes in an options 
clause.

Nte that backing up the mysql database files while the database server 
is running is useless - you need to shut down the database server, or 
dump the databases you're interested in to a file and back up that (or 
these) files.

Hope that gets you started,

Arno






__
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com 

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now  http://get.splunk.com/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users