date:20100311

2010/3/11 mario parreño mapar...@hotmail.com:
 Hi Greg, first, thanks for reading the question.

 I execute netstat -tanp
 debian-bacula:/etc/bacula# netstat -tanp
 Active Internet connections (servers and established)
 Proto Recv-Q Send-Q Local Address   Foreign Address
 State   PID/Program name
 tcp    0  0 127.0.0.1:3306  0.0.0.0:*
 LISTEN  2427/mysqld
 tcp    0  0 0.0.0.0:9102    0.0.0.0:*
 LISTEN  25815/bacula-fd
 tcp    0  0 0.0.0.0:9103    0.0.0.0:*
 LISTEN  25794/bacula-sd
 tcp    0  0 0.0.0.0:111 0.0.0.0:*
 LISTEN  1961/portmap
 tcp    0  0 127.0.0.1:631   0.0.0.0:*
 LISTEN  2537/cupsd
 tcp    0  0 0.0.0.0:36023   0.0.0.0:*
 LISTEN  1978/rpc.statd
 tcp    0  0 127.0.0.1:25    0.0.0.0:*
 LISTEN  2835/exim4
 tcp    0  0 192.168.47.129:46738    92.122.207.136:80
 ESTABLISHED 3299/firefox-bin
 tcp    0  0 192.168.47.129:54912    65.55.149.123:80
 ESTABLISHED 3299/firefox-bin
 tcp6   0  0 ::1:631 :::*
 LISTEN  2537/cupsd

 I view the ports 9102 y 9103 listen, but no 9101.

 My files conf are:

 DIRECTOR:
 Director {    # define myself
   Name = debian-bacula-dir
   DIRport = 9101    # where we listen for UA connections
   QueryFile = /etc/bacula/query.sql
   WorkingDirectory = /var/bacula/working
   PidDirectory = /var/run
   Maximum Concurrent Jobs = 1
   Password = 0rHjNtqeYu3kOIIrGl+WW0MlO7zoDq+Cxo7sb1tvFKLR #
 Console password
   Messages = Daemon
 }
 .
 .
 Client {
   Name = debian-bacula-fd
   Address = 127.0.0.1
   FDPort = 9102
   Catalog = MyCatalog
   Password = yyjjEFvz/Jf3YknWe10jibTL9S3oI02Zv2QOsLznX5vd  #
 password for FileDaemon
   File Retention = 30 days    # 30 days
   Job Retention = 6 months    # six months
   AutoPrune = yes # Prune expired Jobs/Files
 }
 .
 .
 Storage {
   Name = File
 # Do not use localhost here
   Address = 127.0.0.1    # N.B. Use a fully qualified name here
   SDPort = 9103
   Password = zV6DkSAOLoXSL96779RE75yFyrS1r2wYKFAtaydwbdFs
   Device = FileStorage
   Media Type = File
 }

 STORAGE

 Storage { # definition of myself
   Name = debian-bacula-sd
   SDPort = 9103  # Director's port
   WorkingDirectory = /var/bacula/working
   Pid Directory = /var/run
   Maximum Concurrent Jobs = 20
 }
 
 Director {
   Name = debian-bacula-dir
   Password = zV6DkSAOLoXSL96779RE75yFyrS1r2wYKFAtaydwbdFs
 }


 CLIENT

 Director {
   Name = debian-bacula-mon
   Password = mM1qkD9zXeGCRiscDEpSHW6I60v2IZZb8Qo/zVdlRfse
   Monitor = yes
 }
 ..

 FileDaemon {  # this is me
   Name = debian-bacula-fd
   FDport = 9102  # where we listen for the director
   WorkingDirectory = /var/bacula/working
   Pid Directory = /var/run
   Maximum Concurrent Jobs = 20
 }

 NOTE: when I installed Bacula 2.4.4 bconsole no connected with director, and
 the solution was
   stop director
   execute   bacula-dir -d 100 -c /etc/bacula-dir.conf



 You can help me?

First off remove 127.0.0.1 and local host from all bacula
configuration files. Using either of these will prevent bacula from
being a network backup program. Secondly start the director from the
console

bacula-dir -c /etc/bacula/bacula-dir.conf -d 100

and email the error you get. I am going to guess that the database is
either not configured or not running.

John

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Can someone help me to solve my logical problem... ?


Hello,

I have a problem with my personnal cycle tape. Let's see how it works :

I have 20 tapes who are changed everyday. Everytime the 20s tape comes, I
put it in a box during 365 days.

It's like that :

1-
2-
3-
4-
5-
.
.
.
20-- In the box during 1 year

And so on...

1- (New tape)
2- (Ex 1st tape)
3- (Ex 2nd tape)
.
.
.
20-- In the box during 1 year


You see my problem ? I haven't the same retention times for the tapes who
are rewritted every 20 days, and those who are keeped during one year. 

The problem is that I put the catalog name in the client... and as I know, I
can't have two same client right ?

I can't find any solution, excepted keeping files, jobs and volumes during
only 20 days and save the catalog in each tape, and rebuilt the catalog to
recover datas... But that's not easy to use..

Can someone has an idea ?

Thanks !
-- 
View this message in context: 
http://old.nabble.com/Can-someone-help-me-to-solve-my-logical-problem...---tp27864557p27864557.html
Sent from the Bacula - Users mailing list archive at Nabble.com.


--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Can someone help me to solve my logical problem... ?

On Thu, Mar 11, 2010 at 10:01 AM, gnowar g.no...@gmail.com wrote:

 Hello,

 I have a problem with my personnal cycle tape. Let's see how it works :

 I have 20 tapes who are changed everyday. Everytime the 20s tape comes, I
 put it in a box during 365 days.

 It's like that :

 1-
 2-
 3-
 4-
 5-
 .
 .
 .
 20-- In the box during 1 year

 And so on...

 1- (New tape)
 2- (Ex 1st tape)
 3- (Ex 2nd tape)
 .
 .
 .
 20-- In the box during 1 year


 You see my problem ? I haven't the same retention times for the tapes who
 are rewritted every 20 days, and those who are keeped during one year.

 The problem is that I put the catalog name, the file and job retention in
 the client definition... and as I know, I can't have two same client right ?

 I can't find any solution, excepted keeping files, jobs and volumes during
 only 20 days and save the catalog in each tape, and rebuilt the catalog to
 recover datas... But that's not easy to use..

 Can someone has an idea ?


Use 1 pool for the tapes you keep for 1 year and 1 pool for the tapes
that you rotate. Adjust your schedule to make a full backup to  the
Year Pool every 20 days.

John

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Can someone help me to solve my logical problem... ?

Well, it looks like I can create 2 same client with a different name.. THAT'S
GREAT !

gnowar wrote:

Hello,

I have a problem with my personnal cycle tape. Let's see how it works :

I have 20 tapes who are changed everyday. Everytime the 20s tape comes, I
put it in a box during 365 days.

It's like that :

1-
2-
3-
4-
5-
.
.
.
20-- In the box during 1 year

And so on...

1- (New tape)
2- (Ex 1st tape)
3- (Ex 2nd tape)
.
.
.
20-- In the box during 1 year

You see my problem ? I haven't the same retention times for the tapes who
are rewritted every 20 days, and those who are keeped during one year.

The problem is that I put the catalog name, the file and job retention in
the client definition... and as I know, I can't have two same client right
?

I can't find any solution, excepted keeping files, jobs and volumes during
only 20 days and save the catalog in each tape, and rebuilt the catalog to
recover datas... But that's not easy to use..

Can someone has an idea ?

Thanks !

--
View this message in context:
http://old.nabble.com/Can-someone-help-me-to-solve-my-logical-problem...---tp27864557p27864957.html
Sent from the Bacula - Users mailing list archive at Nabble.com.

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Can someone help me to solve my logical problem... ?

I don't know if it's normal, but I can't reuse a tape if files and jobs are
not pruned, even if the volume is. Files retention and Jobs retention ar
definited in the client section.

Plus, how can I say to bacula, use this pool every twentieth backup ?

John M. Drescher wrote:

On Thu, Mar 11, 2010 at 10:01 AM, gnowar g.no...@gmail.com wrote:

Hello,

I have a problem with my personnal cycle tape. Let's see how it works :

I have 20 tapes who are changed everyday. Everytime the 20s tape comes, I
put it in a box during 365 days.

It's like that :

1-
2-
3-
4-
5-
.
.
.
20-- In the box during 1 year

And so on...

1- (New tape)
2- (Ex 1st tape)
3- (Ex 2nd tape)
.
.
.
20-- In the box during 1 year

You see my problem ? I haven't the same retention times for the tapes who
are rewritted every 20 days, and those who are keeped during one year.

The problem is that I put the catalog name, the file and job retention in
the client definition... and as I know, I can't have two same client
right ?

I can't find any solution, excepted keeping files, jobs and volumes
during
only 20 days and save the catalog in each tape, and rebuilt the catalog
to
recover datas... But that's not easy to use..

Can someone has an idea ?

Use 1 pool for the tapes you keep for 1 year and 1 pool for the tapes
that you rotate. Adjust your schedule to make a full backup to the
Year Pool every 20 days.

John

--
View this message in context:
http://old.nabble.com/Can-someone-help-me-to-solve-my-logical-problem...---tp27864557p27865142.html
Sent from the Bacula - Users mailing list archive at Nabble.com.

Re: [Bacula-users] Automatic labelling with different pools is not sequential anymore?

WOW! You must not have upgraded in some time. I believe this change
came in 2008 or earlier..

 I have several pools in one filestorage directory.
 Bacula automatically labels new media as needed with the LabelMedia = yes
 parameter.

 Count Bacula usually labelled each pools media sequentially from 1 going
 upwards in steps of one.

 Now with my new setup version 5.0.1 he mixes up the pools, so that the next
 number in any pool get to be the highest number of all the pools + 1.

 Is this intended?

Yes. This was a bug fix to prevent duplicate ids being assigned in the
case that the user deleted some volumes.

 Are there any ways to turn this back to 'normal'?

Not that I know of.

John

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Can someone help me to solve my logical problem... ?

 I don't know if it's normal, but I can't reuse a tape if files and jobs are
 not pruned, even if the volume is. Files retention and Jobs retention ar
 definited in the client section.

If the volume is pruned then the jobs and files on that volume have to
be pruned. If bacula is not operating this way this is a bug.


 Plus, how can I say to bacula, use this pool every twentieth backup ?


You need to modify your schedule how I explained in my first post.

See the examples in the documentation here:
http://www.bacula.org/en/dev-manual/Configuring_Director.html#SECTION00145

John

John

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Can someone help me to solve my logical problem... ?

If the volume is pruned then the jobs and files on that volume have to
be pruned. If bacula is not operating this way this is a bug.

I think it is. I understood that should works this way when I read the spec
but that doesn't work on my system..

You need to modify your schedule how I explained in my first post.

As you saw, I don't speak english so well, I didn't find anything relevent
in the spec you gave me. I understand how to use one pool for the twentieth
day of a month, but not for every 20 days. It's different cause it's
completly random comared to the day, of a month (I don't know if I'm clear,
that should work like a counter ?)

I don't know if it's possible, and if it is, that's the key of my problem.

Hope you understand me.

Thx for your help

--
View this message in context:
http://old.nabble.com/Can-someone-help-me-to-solve-my-logical-problem...---tp27864557p27865765.html
Sent from the Bacula - Users mailing list archive at Nabble.com.

Re: [Bacula-users] Can someone help me to solve my logical problem... ?

On Thu, Mar 11, 2010 at 11:22 AM, gnowar g.no...@gmail.com wrote:

If the volume is pruned then the jobs and files on that volume have to
be pruned. If bacula is not operating this way this is a bug.

 I think it is. I understood that should works this way when I read the spec
 but that doesn't work on my system..


What is the status of that volume?

Use the console list media command:

list media


You need to modify your schedule how I explained in my first post.

 As you saw, I don't speak english so well,

Yes. I guarantee that your English is better than the only other
language I know somewhat..

  I didn't find anything relevent
 in the spec you gave me. I understand how to use one pool for the twentieth
 day of a month, but not for every 20 days. It's different cause it's
 completly random comared to the day, of a month (I don't know if I'm clear,
 that should work like a counter ?)


I think you are correct. There does not appear to be an easy way to
schedule this.


 I don't know if it's possible, and if it is, that's the key of my problem.


You could use a bash script that feeds commands to bconsole to force
bacula to run jobs on the 20th day.

 Hope you understand me.

I'm trying..

John

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Windows XP File Daemon - Service Stops With Unknown Error

2010-03-11 Thread Drew Bentley

On Wed, Mar 10, 2010 at 11:46 AM, Josh Fisher jfis...@pvct.com wrote:

 On 3/9/2010 10:02 AM, Bob Hetzel wrote:
 3 things that have given me grief due to the windows FD stopping or being
 unresponsive (but still mysteriously running)...
 a) buggy network driver--in one case I was able to update the driver to fix.


 I'll second that one. I have had several occasions of a buggy NIC driver
 causing the TCP connection to be dropped. In all cases it was fixed by
 an updated driver, or by turning off the NIC driver's power management
 features. Particularly for laptops, it seems unfortunately common for
 the driver to turn off the NIC to save power, even though there is an
 active TCP connection. Web browsers and such simply re-connect, so the
 dropped connection isn't noticed. But TCP connections for Bacula may be
 open for quite some time, so Bacula is more sensitive to network problems.


The only reason I'm ruling this out is that the bacula-fd service dies
when it's just sitting idle, usually dying well before the director
makes contact to initiate a backup request. All other network seems
okay and the person that uses Quickbooks never has issues connecting,
etc.

I'll check further but at this time, I've installed the bacula-fd
client on several other machine of same OS and architecture/hardware
and those are not dying. It's starting to point to some service or
process I'm overlooking perhaps killing it or maybe just a bad
install. I might start by reinstalling bacula and see what happens
then.

Thanks,

-Drew

 b) bad network switch or network port
 c) infection with a virus/malware that was using up the max tcp
 connections.  Check the event log for that error.
 d) regex in the fileset had a bug but that's been fixed around bacula
 version 2.5 or so.  Along the way I learned that regex was slower to
 process than wilddir and wildfile so I stopped using it for windows
 filesets anyway.

 In all cases these issues caused the windows FD to stop during a backup, so
 I hope this helps but if not, you may have to turn on debugging in the FD
 and cross your fingers that it happens and logs what went wrong.

      Bob


 From: Drew Bentleybacula.u...@gmail.com

 I can't seem to figure out what's going on because I've never
 encountered this issue when backing up a Windows XP client with the
 latest version of Bacula.

 I have no problems backing up the client but the file daemon
 unexpectedly dies randomly, usually before a backup is even scheduled.

 The error I'm seeing in the event log goes something like this:

 Bacula Error: /home/kern/bacula/k/bacula/src/lib/bsock.c:518
 Read error from Director daemon:hostname of my director:9101:
 ERR=Unknown error

 Above that it complains about local computer and registry info or
 message DLL files to display messages from a remote computer, use
 /AUXSOURCE=flag to retrieve this description, see Help and Support for
 more details.

 Anyone encounter this? Is this machine missing something? I'm not a
 Windows guy, more of a Unix guy. Everything seems to work okay when I
 restart the FD service and backups run without issues. I have backups
 kick off at like 7pm and it always seems to die before 3 or 4pm. No
 one really remotes into this machine, it's a Quickbooks machine and
 only shares out the Intuit QB stuff to the HR persons machine.

 Any other info I can provide if necessary. I couldn't seem to locate
 this type of issue in the mailing list archives.

 -Drew


 No ideas from anyone?  Now it seems to die without any reports in the
 event viewer or logs.

 -Drew


 --
 Download Intel#174; Parallel Studio Eval
 Try the new software tools for yourself. Speed compiling, find bugs
 proactively, and fine-tune applications for parallel performance.
 See why Intel Parallel Studio got high marks during beta.
 http://p.sf.net/sfu/intel-sw-dev
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


 --
 Download Intel#174; Parallel Studio Eval
 Try the new software tools for yourself. Speed compiling, find bugs
 proactively, and fine-tune applications for parallel performance.
 See why Intel Parallel Studio got high marks during beta.
 http://p.sf.net/sfu/intel-sw-dev
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev

Re: [Bacula-users] Automatic labelling with different pools is not sequential anymore?

2010-03-11 Thread Steen Meyer

Torsdag den 11. Marts 2010 15:50:36 skrev John Drescher:
 WOW! You must not have upgraded in some time. I believe this change
 came in 2008 or earlier..

  I have several pools in one filestorage directory.
  Bacula automatically labels new media as needed with the LabelMedia =
  yes parameter.
 
  Count Bacula usually labelled each pools media sequentially from 1 going
  upwards in steps of one.
 
  Now with my new setup version 5.0.1 he mixes up the pools, so that the
  next number in any pool get to be the highest number of all the pools +
  1.
 
  Is this intended?

 Yes. This was a bug fix to prevent duplicate ids being assigned in the
 case that the user deleted some volumes.

I understand that in terms of each pool, but I do not see that it would be 
necessary to make that span the different pools with different label 
templates?


-- 
Steen

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Fwd: Can someone help me to solve my logical problem... ?

2010-03-11 Thread Marcos Leão

ok, there does not appear to be an easy way to schedule for every 20 days.
But for every 21 days it can by easy:

w01, w04, w07, w10, w13, ... w5x Mon at 22:00

will do the trick!

-- Forwarded message --
From: John Drescher dresche...@gmail.com
Date: Thu, Mar 11, 2010 at 1:43 PM
Subject: Re: [Bacula-users] Can someone help me to solve my logical
problem... ?
To: gnowar g.no...@gmail.com
Cc: bacula-users@lists.sourceforge.net

On Thu, Mar 11, 2010 at 11:22 AM, gnowar g.no...@gmail.com wrote:

If the volume is pruned then the jobs and files on that volume have to
be pruned. If bacula is not operating this way this is a bug.

 I think it is. I understood that should works this way when I read the
spec
 but that doesn't work on my system..

What is the status of that volume?

Use the console list media command:

list media

You need to modify your schedule how I explained in my first post.

 As you saw, I don't speak english so well,

Yes. I guarantee that your English is better than the only other
language I know somewhat..

  I didn't find anything relevent
 in the spec you gave me. I understand how to use one pool for the
twentieth
 day of a month, but not for every 20 days. It's different cause it's
 completly random comared to the day, of a month (I don't know if I'm
clear,
 that should work like a counter ?)

I think you are correct. There does not appear to be an easy way to
schedule this.

 I don't know if it's possible, and if it is, that's the key of my problem.

You could use a bash script that feeds commands to bconsole to force
bacula to run jobs on the 20th day.

 Hope you understand me.

I'm trying..

John

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

-- 
Marcos de Oliveira Leão
Consultor Linux/Unix
LPIC/1 - Linux Professional Institute Certification
(55 61) 8556-9956
leao.mar...@gmail.com
marcos_l...@hotmail.com
--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Automatic labelling with different pools is not sequential anymore?

On Thu, Mar 11, 2010 at 2:14 PM, Steen Meyer bl...@beckmeyer.dk wrote:
 Torsdag den 11. Marts 2010 15:50:36 skrev John Drescher:
 WOW! You must not have upgraded in some time. I believe this change
 came in 2008 or earlier..

  I have several pools in one filestorage directory.
  Bacula automatically labels new media as needed with the LabelMedia =
  yes parameter.
 
  Count Bacula usually labelled each pools media sequentially from 1 going
  upwards in steps of one.
 
  Now with my new setup version 5.0.1 he mixes up the pools, so that the
  next number in any pool get to be the highest number of all the pools +
  1.
 
  Is this intended?

 Yes. This was a bug fix to prevent duplicate ids being assigned in the
 case that the user deleted some volumes.

 I understand that in terms of each pool, but I do not see that it would be
 necessary to make that span the different pools with different label
 templates?


A volume can be moved from 1 pool to the other. Also different pools
do not have to have different label templates.

John

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula to the Cloud

2010-03-11 Thread Peter Zenge

Following up on my own post, I had a little free time the other day and decided 
to investigate whether this was feasible.  Setting up the necessary services on 
Amazon was trivial, including access control and block storage.  I tried s3fs 
first, and it worked, but it felt like there was way too much i/o going on for 
that kind of data (which is pretty much what I expected).  Then I tried putting 
my bacula-sd on an EC2 node, writing to files on EBS, and it worked great 
(spooling first to the local drive on EC2).  Throughput however was somewhat 
less than I was hoping for, approx. 25% of what I get locally to spool and then 
to tape.  However, I found that there was NO performance penalty for running 
two jobs concurrently.  I didn't try larger numbers, but my guess is you can 
run a large number of concurrent jobs to get a pretty good effective 
throughput, assuming you have lots of clients with similar data sizes.

Our problem is that 80% of our data is on one client, and it would take 130 
hours to do a full backup, and our backup window simply isn't that long.  Then 
I thought I could break the FileSets into smaller pieces and run multiple 
backup jobs in parallel (and I'm assuming that my client is not the 
bottleneck).  However, it wouldn't run more than one job on that client 
concurrently.  Since I can run multiple clients concurrently, I'm pretty sure 
my bacula-dir.conf and bacula-sd.conf settings are correct, and my 
bacula-fd.conf specifies Maximum Concurrent Jobs = 20... Any other reason why 
I couldn't run say 5 parallel jobs with different filesets off the same client?

From: Peter Zenge [mailto:pze...@ilinc.com]
Sent: Tuesday, March 02, 2010 2:57 PM
To: bacula-users@lists.sourceforge.net
Subject: [Bacula-users] Bacula to the Cloud

Hello, 2 year Bacula user but first-time poster.  I'm currently dumping about 
1.6TB to LTO2 tapes every week and I'm looking to migrate to a new storage 
medium.

The obvious answer, I think, is a direct-attached disk array (which I would be 
able to put in a remote gigabit-attached datacenter before too long).  However, 
I'm wondering if anyone is currently doing large (or what seem to me to be 
large) backups to the cloud in some way?  Assuming I have a gigabit connection 
to the Internet from my datacenter, I'm wondering how feasible it would be to 
either use something like Amazon S3 with s3fs (I'm guessing way too much 
overhead to be efficient), or a bacula-SD implementation on an EC2 node, using 
Elastic Block Store (EBS) as local disk, and VPN (Amazon VPC) between my 
datacenter and the SD.

Substitute your favorite cloud provider for Amazon above; I don't use any right 
now so not tied to any particular provider.  It just seems like Amazon has all 
the necessary pieces today.

To do this, and keep customers comfortable with the idea of data in the cloud, 
we would need to encrypt, so I'm also wondering if it would be possible for the 
SD to encrypt the backup volume, rather than the FD encrypt the data before 
sending it to SD (which is what we do now)?  Easier to manage if we just 
handled encryption in one place for all clients.

I would love to hear what other people are either doing with Bacula and the 
cloud, or why you have decided not to.

Thanks

Peter Zenge
Pzenge .at. ilinc .dot. com


--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Ubuntu 9.04 Easy Install Bacula + Postgresql

2010-03-11 Thread mehma sarja

I have been a Bacula user off and on for the last year. Implemented a couple
of instances and always had a confusing time installing it - on Ubuntu.
Recently I happened upon an easy sequence which I am sharing in case someone
else needs an easy on-ramp:

a.  Install postgresql while loading the OS, you could install it using sudo
apt-get - Don't have the commands handy
b.  sudo apt-get upgrade
c.  sudo apt-get update
d.  sudo apt-get install g++
e.  sudo apt-get install libpq-dev
f.  sudo apt-get install make
g.  compile bacula without bat

That's it.

Mehma
--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Problems with storage device not being seen

2010-03-11 Thread Jerry Lowry

I am setting up a new installation and I am having difficulty with the 
tape drive not being seen. Here is the error message:

Job=TapeBackup.2010-03-11_14.34.23_05
11-Mar 14:34 distress-dir JobId 20: Fatal error: 
 Storage daemon didn't accept Device Drive-2 command.
11-Mar 14:34 distress-dir JobId 20: Error: Bacula distress-dir 5.0.1 (24Feb10): 
11-Mar-2010 14:34:26
  Build OS:   x86_64-unknown-linux-gnu redhat 
  JobId:  20
  Job:TapeBackup.2010-03-11_14.34.23_05
  Backup Level:   Full (upgraded from Incremental)
  Client: distress-fd 5.0.1 (24Feb10) 
x86_64-unknown-linux-gnu,redhat,
  FileSet:Tape Set 2010-03-10 23:05:00
  Pool:   Default (From Job resource)
  Catalog:MyCatalog (From Client resource)
  Storage:Tape-Left (From Job resource)
  Scheduled time: 11-Mar-2010 14:34:14

-
I have check both the dir-conf and the sd-conf and either I am blind due 
to the length of time I've spent on it or I am just missing it.
Probably an easy fix.

Here are the snapshots of the config files.
DIR.conf
# Definition of DLT tape storage device
Storage {
Name = Tape-Right # Do not use localhost here
Address = distress # N.B. Use a fully qualified name here
SDPort = 9103
Password =  # password for Storage daemon
Device = Drive-1 # must be same as Device in Storage daemon
Media Type = DLT-V4 # must be same as MediaType in Storage daemon
# Autochanger = yes # enable for autochanger device
}

# Definition of DLT tape storage device
Storage {
Name = Tape-Left # Do not use localhost here
Address = distress # N.B. Use a fully qualified name here
SDPort = 9103
Password =  # password for Storage daemon
Device = Drive-2 # must be same as Device in Storage daemon
Media Type = DLT-V4 # must be same as MediaType in Storage daemon
# Autochanger = yes # enable for autochanger device
}
SD.conf
Device {
Name = Drive-1 #
Drive Index = 0
Media Type = DLT-V4
Archive Device = /dev/nst0
AutomaticMount = no; # when device opened, read it
AlwaysOpen = yes;
RemovableMedia = yes;
RandomAccess = no;
AutoChanger = yes
}
Device {
Name = Drive-2 #
Drive Index = 1
Media Type = DLT-V4
Archive Device = /dev/nst1
AutomaticMount = no; # when device opened, read it
AlwaysOpen = yes;
RemovableMedia = yes;
RandomAccess = no;
AutoChanger = yes
}

also get a GDB traceback each time the job errors:

[?1034h[Thread debugging using libthread_db enabled]
[New Thread 0x7fbb1e655710 (LWP 22578)]
[New Thread 0x7fbb1f056710 (LWP 22530)]
0x003666cd6ca3 in select () from /lib64/libc.so.6
$1 = '\000' repeats 29 times
$2 = 0xa16058 bacula-sd
$3 = 0xa16098 /usr/bacula/bin/bacula-sd
$4 = 0x0
$5 = 0x7fbb258cbd9e 5.0.1 (24 February 2010)
$6 = 0x7fbb258cbdb7 x86_64-unknown-linux-gnu
$7 = 0x7fbb258cbdd0 redhat
$8 = 0x7fbb258cba7c 
$9 = distress, '\000' repeats 41 times
#0  0x003666cd6ca3 in select () from /lib64/libc.so.6
#1  0x7fbb258a0ad4 in bnet_thread_server (addrs=value optimized out, 
max_clients=value optimized out, client_wq=value optimized out, 
handle_client_request=value optimized out) at bnet_server.c:161
#2  0x0040763e in main (argc=value optimized out, 
argv=value optimized out) at stored.c:312

Thread 3 (Thread 0x7fbb1f056710 (LWP 22530)):
#0  0x00366740b3b9 in pthread_cond_timedwait@@GLIBC_2.3.2 ()
   from /lib64/libpthread.so.0
#1  0x7fbb258c402c in watchdog_thread (arg=value optimized out)
at watchdog.c:308
#2  0x003667406a3a in start_thread () from /lib64/libpthread.so.0
#3  0x003666cddf3d in clone () from /lib64/libc.so.6
#4  0x in ?? ()

Thread 2 (Thread 0x7fbb1e655710 (LWP 22578)):
#0  0x00366740eb3d in waitpid () from /lib64/libpthread.so.0
#1  0x7fbb258bb7ad in signal_handler (sig=11) at signal.c:229
#2  signal handler called
#3  0x00431bb3 in is_vol_in_autochanger (vol=value optimized out, 
rctx=value optimized out) at reserve.c:389
#4  find_suitable_device_for_job (vol=value optimized out, 
rctx=value optimized out) at reserve.c:456
#5  0x0043269a in use_storage_cmd (jcr=value optimized out)
at reserve.c:317
#6  use_cmd (jcr=value optimized out) at reserve.c:71
#7  0x0041e80f in handle_connection_request (arg=0xa1aad8)
at dircmd.c:233
#8  0x7fbb258c44a9 in workq_server (arg=0x651e20) at workq.c:346
#9  0x003667406a3a in start_thread () from /lib64/libpthread.so.0
#10 0x003666cddf3d in clone () from /lib64/libc.so.6
#11 0x in ?? ()

Thread 1 (Thread 0x7fbb25889720 (LWP 22522)):
#0  0x003666cd6ca3 in select () from /lib64/libc.so.6
#1  0x7fbb258a0ad4 in bnet_thread_server (addrs=value optimized out, 
max_clients=value optimized out, client_wq=value optimized out, 
handle_client_request=value optimized out) at bnet_server.c:161
#2  0x0040763e in main (argc=value optimized out, 
argv=value optimized out) at

Re: [Bacula-users] Bacula to the Cloud

2010-03-11 Thread Dan Langille

On 3/11/2010 4:31 PM, Peter Zenge wrote:
 Following up on my own post, I had a little free time the other day and
 decided to investigate whether this was feasible. Setting up the
 necessary services on Amazon was trivial, including access control and
 block storage. I tried s3fs first, and it worked, but it felt like there
 was way too much i/o going on for that kind of data (which is pretty
 much what I expected). Then I tried putting my bacula-sd on an EC2 node,
 writing to files on EBS, and it worked great (spooling first to the
 “local” drive on EC2). Throughput however was somewhat less than I was
 hoping for, approx. 25% of what I get locally to spool and then to tape.
 However, I found that there was NO performance penalty for running two
 jobs concurrently. I didn’t try larger numbers, but my guess is you can
 run a large number of concurrent jobs to get a pretty good effective
 throughput, assuming you have lots of clients with similar data sizes.

Would you care to add the steps to the wiki?  Then post the URL here please?

-- 
Dan Langille - http://langille.org/

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Maximum Concurrent Jobs in job definition

Anyone?

btw, it is 5.0 , on Centos 5.4 64bit
_
{Beto|Norberto|Numard} Meijome

The only people that never change are the stupid and the dead
 Jorge Luis Borges.

I speak for myself, not my employer. Contents may be hot. Slippery when wet.
Reading disclaimers makes you go blind. Writing them is worse. You have been
Warned.


On 11 March 2010 13:40, Norberto Meijome numard...@gmail.com wrote:

 Hi everyone,
 I have a job that runs very frequently, and successive runs take different
 sets of data (as determined by a pre-job script). To avoid problems, my
 pre-job script sets a lock file and the post-clears it.

 When I configure my director for concurrent jobs = 2, i sometimes get 2 of
 these jobs trying to run in parallel (which is understandable, many times a
 run has more data than the average and is still running while the next one
 is due). My pre-script will then cancel the execution of the 2nd script
 (because it finds the lock file). Great.

 Of course, this is generating a bunch of (expected) errored jobs . I read
 in the documentaiton [1]  that I can use Maximum Concurrent Jobs in the
 Job def, to determine how many of this jobs can start in parallel. So I set
 this to 1 [2]

 But it has no effect . I get 2 jobs running in parallel (for a short while,
 until the pre-script kills it). If I change the director's Max Concurrent
 Jobs to 1, then it's forced to 1 (but i need more than one, as I as have
 spooling enabled and other jobs writing to the tape too..)

 What is going on ?

 TIA!
 B
 _
 {Beto|Norberto|Numard} Meijome

 The only people that never change are the stupid and the dead
  Jorge Luis Borges.

 I speak for myself, not my employer. Contents may be hot. Slippery when
 wet.
 Reading disclaimers makes you go blind. Writing them is worse. You have
 been
 Warned.

 [1]
 http://bacula.org/5.0.x-manuals/en/main/main/Configuring_Director.html#SECTION00173,
  way down...

 [2]
 [...]
 Job {
   Name = assetBackups
   JobDefs = DefaultJob
   Level = Full
   FileSet=publishedAssetsSet
   Messages = Standard
   Pool = productionPool
   Storage = berthaTape
   Schedule = PublishedAssetsSchedule
   Write Bootstrap = /var/lib/bacula/%n.bsr
   Priority = 10
   Accurate = yes
   Spool Data = yes
   # We only want one instance of this job running @ the same time.
   # enforced (errors out) in the apb_run.sh
   Maximum Concurrent Jobs = 1
   # This the list of asset versions to be backed up. The parameter passed
 is the number of versions to include in this run
   RunBeforeJob = /etc/bacula/backupFilelist/apb_run.sh 400
   # This moves the current list out of the way and updates the offset
   # parameters passed are the jobId and the jobStatus
   RunAfterJob  = /etc/bacula/backupFilelist/apb_post.sh %i %e
 }
 [...]

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Automatic labelling from barcodes ?

Hi everyone,

We have a tape library, 7 slots, 1 drive, barcode reader. All our tapes are
barcoded.

I've been using 'label barcodes' with some success [1]. I would like to be
able to just insert new tapes and let bacula automatically label them using
the barcode read from the tape.

Is this possible, and if so, how ?

Running
 Version: 5.0.0 (26 January 2010) x86_64-redhat-linux-gnu redhat

thanks!!

[1] sometimes it throws some errors, tape i/o,etc, not sure it is related to
bacula, even though it crashed bacula-sd once or twice
_
{Beto|Norberto|Numard} Meijome

The only people that never change are the stupid and the dead
 Jorge Luis Borges.

I speak for myself, not my employer. Contents may be hot. Slippery when wet.
Reading disclaimers makes you go blind. Writing them is worse. You have been
Warned.
--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Automatic labelling from barcodes ?

 We have a tape library, 7 slots, 1 drive, barcode reader. All our tapes are
 barcoded.

 I've been using 'label barcodes' with some success [1].

This should work 100% of the time. It has for me for the 80 tapes I
have had it label. When I add new tapes, I wait 5 minutes for my 24
slot changer to stop doing inventory then after that I issue update
slots since I changed tapes. After that I run label barcodes and put
all new tapes in the Scratch pool.

 I would like to be
 able to just insert new tapes and let bacula automatically label them using
 the barcode read from the tape.

 Is this possible, and if so, how ?


I am not sure of that. Some users have done this but I do not know the details.

 Running
  Version: 5.0.0 (26 January 2010) x86_64-redhat-linux-gnu redhat

 thanks!!

 [1] sometimes it throws some errors, tape i/o,etc, not sure it is related to
 bacula, even though it crashed bacula-sd once or twice

The I/O read error on unused tapes is not an error. This is actually
normal behavior. As for crashing bacula-sd, I have never had that
happen on a label barcodes.

John

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Automatic labelling from barcodes ?

On 12 March 2010 12:44, John Drescher dresche...@gmail.com wrote:

  We have a tape library, 7 slots, 1 drive, barcode reader. All our tapes
 are
  barcoded.
 
  I've been using 'label barcodes' with some success [1].

 This should work 100% of the time. It has for me for the 80 tapes I
 have had it label. When I add new tapes, I wait 5 minutes for my 24
 slot changer to stop doing inventory then after that I issue update
 slots since I changed tapes. After that I run label barcodes and put
 all new tapes in the Scratch pool.


yeah, maybe it is a timing issue , (the changer isn't the newest) the msgs
didnt seem to be related to the job that was waiting, but i could be wrong.
The issue is that , say, slot 1 is labelled correctly, 2 and 3 not,  4
through 7 Ok. Sometimes it's one failed, sometimes 2, not the same all the
time. Not earth shattering, but non-automatic.


  I would like to be
  able to just insert new tapes and let bacula automatically label them
 using
  the barcode read from the tape.
 
  Is this possible, and if so, how ?
 

 I am not sure of that. Some users have done this but I do not know the
 details.


do you have any pointers?



  Running
   Version: 5.0.0 (26 January 2010) x86_64-redhat-linux-gnu redhat
 
  thanks!!
 
  [1] sometimes it throws some errors, tape i/o,etc, not sure it is related
 to
  bacula, even though it crashed bacula-sd once or twice
 
 The I/O read error on unused tapes is not an error. This is actually
 normal behavior.




 As for crashing bacula-sd, I have never had that
 happen on a label barcodes.


+1 . hasn't happened that much, just once or twice (once definitely related
to this, the other i dont recall)

thx!!
_
{Beto|Norberto|Numard} Meijome

The only people that never change are the stupid and the dead
 Jorge Luis Borges.

I speak for myself, not my employer. Contents may be hot. Slippery when wet.
Reading disclaimers makes you go blind. Writing them is worse. You have been
Warned.
--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Automatic labelling from barcodes ?

 yeah, maybe it is a timing issue , (the changer isn't the newest) the msgs
 didnt seem to be related to the job that was waiting, but i could be wrong.
 The issue is that , say, slot 1 is labelled correctly, 2 and 3 not,  4
 through 7 Ok. Sometimes it's one failed, sometimes 2, not the same all the
 time. Not earth shattering, but non-automatic.


If it is a timing issue then you need to fix your mtx-changer script
(to work with your changer) because your backups will have the same
problem as label barcodes.

Did you run the autochanger tests that are described in the manual?

John

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Automatic labelling from barcodes ?