[Bacula-users] possible to to the compression on the sd side?

2009-05-29 Thread Zhengquan Zhang
Hello bacula list,

I have got a full backup on and old and busy web and mail server
(Intel(R) Pentium(R) 4 CPU 2.40GHz) and after 3 days it has not yet
finished. I chose gzip compression in the config files. default
compression level is gzip 6.

Now the problem is it is significantly affecting other jobs on the old
server and other sheduled backup jobs. 

The old server is busy(lots of scripts eating up cpu cycles) and
overloaded. I wonder if I can do the compression on the storage daemon
side because the backup server is new and has 4 cores. and I do need to
do the compression because I only have 1T raid1 on the backup serve.


Thanks a lot,

-- 
Zhengquan


--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT 
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp as they present alongside digital heavyweights like Barbarian 
Group, R/GA,  Big Spaceship. http://p.sf.net/sfu/creativitycat-com 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] start jobs waiting for execution after modifying maximum concurrent jobs?

2009-05-29 Thread Zhengquan Zhang
Hi, bacula list,

I modified the maximum concurrent jobs from default 1 to 20. (I have
different deviced for different clients)

and I did a reload in bconsole.

But the jobs waiting for execution don't start automatically.

Is there a way to start them all. One slow job has affected other jobs
on my backup server.

Thanks a lot,

-- 
Zhengquan


--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT 
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp as they present alongside digital heavyweights like Barbarian 
Group, R/GA,  Big Spaceship. http://p.sf.net/sfu/creativitycat-com 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] run full backup in bconsole but it runs incremental after one full?

2009-05-27 Thread Zhengquan Zhang
On Wed, May 27, 2009 at 10:46:44AM -0400, John Lockard wrote:
 On Sat, May 23, 2009 at 12:11:28PM -0500, Zhengquan Zhang wrote:
  On Fri, May 22, 2009 at 02:12:13PM -0400, John Lockard wrote:
   When you run a job by hand the schedule isn't involved.
   Either way, for your Schedule entry you need Level=
   before the work Full.
   
Schedule {
  Name = test   
  Run = Level=Full at 11:50   
}
  
  Thank John for pointing out this, I searched the documentation and it
  should be like what you said. But I wonder why bacula does not give me
  an error or warning when I did not get the config correct.
  
   
   
   But, your problem is that your Job doesn't have a Default
   Level defined.  You'll need something like this:
   
Job {
  Name = job_backup1
  Type = Backup
  Level = Full
  .
  .
}
  
  I don't understand the point of a default backup level. Since after all
  I will set the levels explicitly in the schedule resources. Is there
  some exceptional case when a default bacckup level is useful?
 
 The point of the default backup level is for when you need to
 run a job by hand from the console.
 
 If you don't run anything other than Fulls (for example), you
 can just define the backup level in one place.  If you run
 multiple levels, you set those in the schedule, but you set
 the default level in the Job, so that on the occasion you need
 to run a job manually, it will select a certain level of job.
 
 In your case, it sounds like you are most interested in
 running incremental jobs by hand, so setting the default
 level to Incremental makes the most sense.  In my case,
 I'm generally not as worried about Incremental jobs as I am
 about the failure of a Full, so my default level is Full.

Thanks John, it makes sense to me.

Regards,

-- 
Zhengquan


--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT 
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp as they present alongside digital heavyweights like Barbarian 
Group, R/GA,  Big Spaceship. http://p.sf.net/sfu/creativitycat-com 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Is it a good idea to use bacula if Irarely havenetwork connection?

2009-05-27 Thread Zhengquan Zhang
On Wed, May 27, 2009 at 10:57:31AM -0400, John Lockard wrote:
 For backing up a laptop locally, bacula seems to be HUGE
 overkill.  How long will you be keeping these backups?  How many
 backups will you be keeping?  My guess is that you'd be better
 served by a little scripting, rsync and cron.
 
 Each day, establish a new directory by date, then hourly run rsync
 to that location.
 Or, Each day establish a new directory by date, create
 a watcher file, then hourly run a 'find [dir] -newer
 /path/to/watcher' to establish a list of files which have
 changed, then 'touch /path/to/watcher'.  From the list of
 files which changed, tar them to backup location.
 
 Depending on how you want to keep files, you'll either have
 a date directory (/backups/20090527) with all of the days
 changed files in it, or you'll have a date directory with hourly
 subdirs with the hourly changes (/backups/20090527/01, etc.).
 
 Then, when you're back at the office, where the bacula server
 is, you kick off a backup manually which will backup your
 /backups directory.

Thanks for your kind suggestions, anyway I have already managed to get
bacula working on my laptop to do backup hourly for my documents.
I save them to another home directory on the harddrive. Aside from
installing a postfix mysql server on my laptop, it works ok..

Regards,

 
 -John
 
 On Sun, May 24, 2009 at 06:29:28PM -0500, Zhengquan Zhang wrote:
  On Sun, May 24, 2009 at 06:50:52PM -0400, Dan Langille wrote:
   -BEGIN PGP SIGNED MESSAGE-
   Hash: SHA1
   
   John Drescher wrote:
So, if you run backups locally to an external disk, you could back up 
the
catalog by taking an ascii dump of the database, and copying the dump 
file
to the same disk used for actual backup data.
So Can I just back the directory where the database is?
   
That is not a good way to backup a database. You need to run mysqldupm
instead and backup the text file it generates.
   
   What John said.
   
   Not only does this ensure that your backup contains a valid MySQL dump,
   it also exercises the database.  That is, the act of running mysqldump
   reads every part of the databases and dumps it out.  If there is any
   'hidden' problem with the databases, chances are, you'll find out about
   it during the dump process itself.
   
   Said explanation applies to all databases IMHO.
  
  Thanks John and Dan for pointing out this for me. I will definetely do
  that.
  
  Zhengquan
  
   
   - --
   Dan Langille
   
   BSDCan - The Technical BSD Conference : http://www.bsdcan.org/
   PGCon  - The PostgreSQL Conference: http://www.pgcon.org/
   -BEGIN PGP SIGNATURE-
   Version: GnuPG v2.0.11 (FreeBSD)
   Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
   
   iEYEARECAAYFAkoZz0wACgkQCgsXFM/7nTxhwACffVigKxm386DGzYhGlxBkqIhv
   0usAoJnpJxahzI+T8sppKdJtG9g7J4fm
   =lzRI
   -END PGP SIGNATURE-
  
  -- 
  Zhengquan
  
  
  --
  Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
  is a gathering of tech-side developers  brand creativity professionals. 
  Meet
  the minds behind Google Creative Lab, Visual Complexity, Processing,  
  iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian
  Group, R/GA,  Big Spaceship. http://www.creativitycat.com 
  ___
  Bacula-users mailing list
  Bacula-users@lists.sourceforge.net
  https://lists.sourceforge.net/lists/listinfo/bacula-users
  
  
 
 -- 
 Yes, evil comes in many forms, whether it be a man-eating cow or Joseph
  Stalin, but you can't let the package hide the pudding! Evil is just
  plain bad! You don't cotton to it. You gotta smack it in the nose with
  the rolled-up newspaper of goodness!  Bad dog! Bad dog! - The Tick
 ---
  John M. Lockard |  U of Michigan - School of Information
  Unix and Security Admin |  1214 SI North - 1075 Beal Ave.
   jlock...@umich.edu |Ann Arbor, MI  48109-2112
  www.umich.edu/~jlockard | 734-615-8776 | 734-647-8045 FAX
 ---
 
 --
 Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT 
 is a gathering of tech-side developers  brand creativity professionals. Meet
 the minds behind Google Creative Lab, Visual Complexity, Processing,  
 iPhoneDevCamp as they present alongside digital heavyweights like Barbarian 
 Group, R/GA,  Big Spaceship. http://p.sf.net/sfu/creativitycat-com 
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

-- 
Zhengquan


--
Register

Re: [Bacula-users] run full backup in bconsole butitruns incremental after one full?

2009-05-24 Thread Zhengquan Zhang
On Sun, May 24, 2009 at 02:59:31PM +0300, Timo Neuvonen wrote:
 From Bacula manual (concerning level in job definition):
 
 The Level directive specifies the default Job level to
 be run. Each different Job Type (Backup, Restore, ...) has a different
 set of Levels that can be specified. The Level is normally overridden
 by a different value that is specified in the Schedule resource.
 This directive is not required, but must be specified either by a Level
 directive or as an override specified in the Schedule resource.
 
 
 So, you have to specify level *somewhere*, either in the job definition, or 
 in the shedule, and nothing technically prevents you specifying it in the 
 both places as well.
 
 The one specified in the job definition is a default that may be overridden 
 elsewhere: in the schedule, or on command line when running a job manually. 
 If you want to control the default that is offered to you when running jobs 
 manually from the command line, then you have to define the level (at least) 
 in the job definition.
 
 Specifying it in the job definition allows you not to repeat it every time 
 if you had several lines (to be run on the same level) in your schedule. The 
 decision where to do it, is up to you. Just choose the way you feel most 
 comfortable with.

Thanks Timo, Now I figured that the default run level for a job is
incremental, so if I don't specify the run level in job resources and
when I manually run a job, it will be incremental. the run level
specified in schedule does not matter in this manually run case.

Regards,
Zhengquan


--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian
Group, R/GA,  Big Spaceship. http://www.creativitycat.com 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Is it a good idea to use bacula if I rarely havenetwork connection?

2009-05-24 Thread Zhengquan Zhang
On Sun, May 24, 2009 at 03:23:19PM +0300, Timo Neuvonen wrote:
  Hello,
  I have already deployed bacula to back up a few servers in a lab
  environment. Now I wonder if I can do it on my laptop.
 
  Most of the time I use the laptop at home where I have not network
  connection. But occasionally I will bring it to the campus where I can
  access the university wireless.
 
  I plan to install bacula-dir, sd, and fd all on my laptop and make my
  backup job run hourly.
 
 Running backup hourly, without network connection? To what media? Sounds a 
 little bit paranoid to me.

I edit documents at home even when I don't have network connection, that
is why I want to run it hourly. Last time I wrongly edited a document
and found the latest backup I manually made was 3 days ago..

 
 
   and if I had the chance to connect to wireless
  network. I will manually run a job which connects to the storage daemon
  on a server in the lab.
 
 
 If you plan to install dir and sd to your laptop too, do you really plan to 
 run backups when not connected to university's network? For example, do you 
 use some external hard disk as a storage media when not in the network?

Yes, I plan to run backups even when I don't have network connectioin
for my laptop. I plan to backup the data to another home directory named
bacula. backing up to an external hard drive would be a good option too.

 
 If you plan to backup only to the storage daemon in the campus network, you 
 actually have no use of the local storage daemon. And if you still use a 

The problem is most of the time my laptop is disconnected so I need to
backup locally first.

 local director, you'll have a problem where to keep the catalog -technically 
 you can keep it on your laptop, but if your laptop crashes, you'll have 
 trouble with restores if you haven't set up a system to have at least the 
 catalog available back *before* being able to run bacula restore job.

Thanks for reminding me this. So as I understand the catlog thing is
written by the storate daemon not the director?

 
 Maybe just the file daemon is enough, and run the job manually when you know 
 you'll have the network connection available for a long enough time?

This opens me another problem, my laptop ip will be dynamic so It will
be hard for the director on a server to find my laptop. I searched the
archive and did not find a definitive answer as to dynamically register
hostname. But Definetely I will try.

So I guess my backup for laptop would be two fold.

1 backup locally no matter I have network or not. on laptop harddrive or
an external harddrive.

2 manually backup to server once I get the chance to connect to
network.(first I need to solve the dynamic ip problem)

Thanks for your help, Timo, I appreciate it a lot.

 
 
  My question is is it a good idea to do so, or if there is better
  solutions for my situation?
 
  Thanks for any insights and ideas.
 
  -- 
  Zhengquan
 
 
 
 
 --
 Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
 is a gathering of tech-side developers  brand creativity professionals. Meet
 the minds behind Google Creative Lab, Visual Complexity, Processing,  
 iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian
 Group, R/GA,  Big Spaceship. http://www.creativitycat.com 
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

-- 
Zhengquan


--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian
Group, R/GA,  Big Spaceship. http://www.creativitycat.com 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Is it a good idea to use bacula if Irarely havenetwork connection?

2009-05-24 Thread Zhengquan Zhang
On Sun, May 24, 2009 at 10:35:00PM +0300, Timo Neuvonen wrote:
 Catalog is written by the Director, using some supported database engine 
 (like MySQL). In principle, it don't have to reside on the same computer 
 with the director, but in this case it obviously has to, since you obviously 
 don't have another database server at home?

I have already installed mysql on my laptop( it is running debian
sid).

 
 So, if you run backups locally to an external disk, you could back up the 
 catalog by taking an ascii dump of the database, and copying the dump file 
 to the same disk used for actual backup data.

So Can I just back the directory where the database is?

 
 And remember to back up your Bacula conf files to that disk, too. I mean, 
 simply copy them though bacula might also back them up for you, so you'll 
 don't have to start from the scratch guessing how was your configuration in 
 case you computer some day crashes.

Thanks for this point, I will copy them to a safe place.

 
 By the way, you never mentioned what OS you have in your laptop. If it's 
 Linux, no problem. If it's Windows, AFAIK dir and sd are available but 
 currently unsupported in that environment. So running something else but the 
 fd on Windows could be a little bit more challenging.

I am running debian linux, so I guess that should not be a problem.

 
 
  Maybe just the file daemon is enough, and run the job manually when you 
  know
  you'll have the network connection available for a long enough time?
 
  This opens me another problem, my laptop ip will be dynamic so It will
  be hard for the director on a server to find my laptop. I searched the
  archive and did not find a definitive answer as to dynamically register
  hostname. But Definetely I will try.
 
 
 This shouldn't be a problem for Bacula, if the dynamic ip is registered to 
 the DNS. Then you'll just use the FQDN of your laptop in the confs, not the 
 ip address. Without knowing the local network there, I've no idea if this is 
 possible or not.

I am not very familiar with the dns stuff, So I may sound a little dumb
here. Each time I ssh to another machine, it would say 

Last login: Sun May 24 15:38:30 2009 from
wireless-165-124-115-104.nuwlan.northwestern.edu

so I guess temporarily my hostname(or the FQDN) is
wireless-165-124-115-104.nuwlan.northwestern.edu.

But this name is always changing because each time I connect to the
university network, it assigned me a new ip. So I guess if I can have my
hostname(FQDN) fixed, the server can find my laptop using FQDN. 

I am using dhcp3-client. So I wonder If I can register my desired dns
through my client side so each time I connect the dhcp network, my
hostname can be registered in the dns server.

Thanks for all the helpful advice!

-- 
Zhengquan


--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian
Group, R/GA,  Big Spaceship. http://www.creativitycat.com 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Is it a good idea to use bacula if Irarely havenetwork connection?

2009-05-24 Thread Zhengquan Zhang
On Sun, May 24, 2009 at 06:50:52PM -0400, Dan Langille wrote:
 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1
 
 John Drescher wrote:
  So, if you run backups locally to an external disk, you could back up the
  catalog by taking an ascii dump of the database, and copying the dump file
  to the same disk used for actual backup data.
  So Can I just back the directory where the database is?
 
  That is not a good way to backup a database. You need to run mysqldupm
  instead and backup the text file it generates.
 
 What John said.
 
 Not only does this ensure that your backup contains a valid MySQL dump,
 it also exercises the database.  That is, the act of running mysqldump
 reads every part of the databases and dumps it out.  If there is any
 'hidden' problem with the databases, chances are, you'll find out about
 it during the dump process itself.
 
 Said explanation applies to all databases IMHO.

Thanks John and Dan for pointing out this for me. I will definetely do
that.

Zhengquan

 
 - --
 Dan Langille
 
 BSDCan - The Technical BSD Conference : http://www.bsdcan.org/
 PGCon  - The PostgreSQL Conference: http://www.pgcon.org/
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v2.0.11 (FreeBSD)
 Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
 
 iEYEARECAAYFAkoZz0wACgkQCgsXFM/7nTxhwACffVigKxm386DGzYhGlxBkqIhv
 0usAoJnpJxahzI+T8sppKdJtG9g7J4fm
 =lzRI
 -END PGP SIGNATURE-

-- 
Zhengquan


--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian
Group, R/GA,  Big Spaceship. http://www.creativitycat.com 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] run full backup in bconsole but it runs incremental after one full?

2009-05-23 Thread Zhengquan Zhang
On Fri, May 22, 2009 at 02:12:13PM -0400, John Lockard wrote:
 When you run a job by hand the schedule isn't involved.
 Either way, for your Schedule entry you need Level=
 before the work Full.
 
  Schedule {
Name = test   
Run = Level=Full at 11:50   
  }

Thank John for pointing out this, I searched the documentation and it
should be like what you said. But I wonder why bacula does not give me
an error or warning when I did not get the config correct.

 
 
 But, your problem is that your Job doesn't have a Default
 Level defined.  You'll need something like this:
 
  Job {
Name = job_backup1
Type = Backup
Level = Full
.
.
  }

I don't understand the point of a default backup level. Since after all
I will set the levels explicitly in the schedule resources. Is there
some exceptional case when a default bacckup level is useful?


 
 On Fri, May 22, 2009 at 11:48:07AM -0500, Zhengquan Zhang wrote:
  Hello, 
  
  The first time I run the job it runs full well, but I tried to run it
  more times, it will run incremental automatically. Could anyone help me
  understand this? I am learning bacula and please forgive me for this easy
  question.
  
  *run
  A job name must be specified.
  Automatically selected Job: job_backup1
  Run Backup job
  JobName:  job_backup1
  Level:Incremental
  Client:   client_backup1
  FileSet:  fileset_backup1
  Pool: Default (From Job resource)
  Storage:  storage_backup1 (From Job resource)
  When: 2009-05-22 11:49:34
  Priority: 10
  OK to run? (yes/mod/no):
  
  the schedule section is listed below;
  
  Schedule {
Name = test   
Run = Full at 11:50   
  }
  
  attached is bacula-dir.conf
  
  #
  # Default Bacula Director Configuration file
  #
  #  The only thing that MUST be changed is to add one or more
  #   file or directory names in the Include directive of the
  #   FileSet resource.
  #
  #  For Bacula release 2.4.4 (28 December 2008) -- debian lenny/sid
  #
  #  You might also want to change the default email address
  #   from root to your address.  See the mail and operator
  #   directives in the Messages resource.
  #
  
  Director {# define myself
Name = director_backup1
DIRport = 9101# where we listen for UA connections
QueryFile = /etc/bacula/scripts/query.sql
WorkingDirectory = /var/lib/bacula
PidDirectory = /var/run/bacula
Maximum Concurrent Jobs = 1
Password = CLEANED # Console password
Messages = Daemon
DirAddress = 127.0.0.1
  }
  
  Job {
Name = job_backup1
Type = Backup
Client = client_backup1
FileSet = fileset_backup1
Pool = Default
Schedule = test
Full Backup Pool = pool_backup1_full
Differential Backup Pool = pool_backup1_diff
Incremental Backup Pool = pool_backup1_inc
Messages = Standard
Storage = storage_backup1
Write Bootstrap = /var/lib/bacula/job_backup1.bsr
Priority = 10
  }
  
  
  # List of files to be backed up
  FileSet {
Name = fileset_backup1
Include {
  Options {
signature = MD5
  }
  File = /etc
  File = /home/zhengquan
  File = /var
}
Exclude {
  File = /proc
  File = /tmp
  File = /.journal
  File = /.fsck
}
  }
  
  #test schedule
  Schedule {
Name = test 
Run = Full at 11:50
  }
  
  # backup1, the backup server itself
  Client {
Name = client_backup1
Address = backup1
FDPort = 9102
Catalog = MyCatalog
Password = CLEANED  # password for FileDaemon
File Retention = 60 days# 60 days
Job Retention = 6 months# six months
AutoPrune = yes # Prune expired Jobs/Files
  }
  
  
  # Definition of file storage device
  Storage {
Name = storage_backup1
Address = backup1# N.B. Use a fully qualified name here
SDPort = 9103
Password = CLEANED
Device = device_backup1
Media Type = File
  }
  
  
  
  # Generic catalog service
  Catalog {
Name = MyCatalog
dbname = CLEANED; dbuser = CLEANED; dbpassword = CLEANED
  }
  
  # Reasonable message delivery -- send most everything to email address
  #  and to the console
  Messages {
Name = Standard
mailcommand = /usr/lib/bacula/bsmtp -h localhost -f \\(Bacula\) 
  \%r\\ -s \Bacula: %t %e of %c %l\ %r
operatorcommand = /usr/lib/bacula/bsmtp -h localhost -f \\(Bacula\) 
  \%r\\ -s \Bacula: Intervention needed for %j\ %r
mail = zhang.zhengq...@gmail.com = all, !skipped
operator = zhang.zhengq...@gmail.com = mount
console = all, !skipped, !saved
  #
  # WARNING! the following will create a file that you must cycle from
  #  time to time as it will grow indefinitely. However, it will
  #  also keep all your messages if they scroll off the console.
  #
append = /var/lib/bacula/log = all, !skipped
  }
  
  
  #
  # Message delivery for daemon

Re: [Bacula-users] run full backup in bconsole but itruns incremental after one full?

2009-05-23 Thread Zhengquan Zhang
On Sat, May 23, 2009 at 07:09:51PM +0300, Timo Neuvonen wrote:
 (Sorry John, I first accidentally sent this to you instead of the list)
 
 Subject: Re: run full backup in bconsole but itruns incremental after one
 full?
 
 
  When you run a job by hand the schedule isn't involved.
  Either way, for your Schedule entry you need Level=
  before the work Full.
 
  Schedule {
Name = test
Run = Level=Full at 11:50
  }
 
 
  But, your problem is that your Job doesn't have a Default
  Level defined.  You'll need something like this:
 
  Job {
Name = job_backup1
Type = Backup
Level = Full
.
.
  }
 
  On Fri, May 22, 2009 at 11:48:07AM -0500, Zhengquan Zhang wrote:
  Hello,
 
  The first time I run the job it runs full well, but I tried to run it
  more times, it will run incremental automatically. Could anyone help me
  understand this? I am learning bacula and please forgive me for this easy
  question.
 
  *run
  A job name must be specified.
  Automatically selected Job: job_backup1
  Run Backup job
  JobName:  job_backup1
  Level:Incremental
  Client:   client_backup1
  FileSet:  fileset_backup1
  Pool: Default (From Job resource)
  Storage:  storage_backup1 (From Job resource)
  When: 2009-05-22 11:49:34
  Priority: 10
  OK to run? (yes/mod/no):
 
 
 One further note, that may be very obvious, but since this was a learning
 phase (well, it always is a learning phase, after a few years we just have
 proceeded to a little higher level in the studies...)

Thank you, Timo for your patience to a learner.

 
 When running jobs manually, any of the job parameters (level, pool, etc) may
 be changed manually from the command line by answering mod to the prompt
 above. These changes do not modify the original confs, but affect just to
 this spesific run.
 
 So, if it were intentional that job is normally run as incremental by
 default, for a single manual run it still could be promoted to full by
 answering mod. Or vice versa (if there is no reason like a modified
 fileset why the system automatically promotes it anyway)
 
 
 But obviously there was a need to add level spec to job definition, wheter
 it should be full or whichever. IMO, it's a kind of important setting that
 it's not a good idea to only trust on internal defaults, explicitly

Thanks for pointing this out. But if I do set the runlevel for each
backup task in the schedule section of the configuration file. Do I
still need a level=** in a job definition? I remember for a few
config files I saw on the web, the level of the backup are always
explicitly stated in the schedule section. So I don't truly understand
why we neede a default backup level in the job definition. Could you
help me understand this?

 mentioning the level in the conf file makes it easier to read and understand
 the configuration. However, to keep the conf more clear, I think it's a good
 idea to specify in the job definition a level that will be used most often,
 and only specify a minimal amount of changes in the schedule. So, I would
 usually prefer incremental in the job definition, unless it's really
 desirable to run the job as full every time. In this sense, in the
 original conf the full setting only in the schedule seemed reasonable.
 
 Btw, if there is a need to add more job definitions to the conf in the
 future, have a look at job defaults section. This way there is no need to
 repeat all the settings for every job definition. It's a kind of named
 macro that is referred to in the job definition.

Thanks for this suggestion. I will definetely use this feature once I
get the backup running correctly.

Regards,

-- 
Zhengquan


--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian
Group, R/GA,  Big Spaceship. http://www.creativitycat.com 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] run full backup in bconsole but it runs incremental after one full?

2009-05-23 Thread Zhengquan Zhang
On Fri, May 22, 2009 at 02:21:26PM -0400, John Lockard wrote:
 Also, when you post your configs, it would be a really good idea
 to remove password and account information.

Thanks John, Can anyone use the passwords to connect to my bacula right?
Because I already specified the clients in the bacula-dir.conf file.

-- 
Zhengquan


--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian
Group, R/GA,  Big Spaceship. http://www.creativitycat.com 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Is it a good idea to use bacula if I rarely have network connection?

2009-05-23 Thread Zhengquan Zhang
Hello, 
I have already deployed bacula to back up a few servers in a lab
environment. Now I wonder if I can do it on my laptop.

Most of the time I use the laptop at home where I have not network
connection. But occasionally I will bring it to the campus where I can
access the university wireless.

I plan to install bacula-dir, sd, and fd all on my laptop and make my
backup job run hourly. and if I had the chance to connect to wireless
network. I will manually run a job which connects to the storage daemon
on a server in the lab. 

My question is is it a good idea to do so, or if there is better
solutions for my situation? 

Thanks for any insights and ideas.

-- 
Zhengquan


--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian
Group, R/GA,  Big Spaceship. http://www.creativitycat.com 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] run full backup in bconsole but it runs incremental after one full?

2009-05-22 Thread Zhengquan Zhang
Hello, 

The first time I run the job it runs full well, but I tried to run it
more times, it will run incremental automatically. Could anyone help me
understand this? I am learning bacula and please forgive me for this easy
question.

*run
A job name must be specified.
Automatically selected Job: job_backup1
Run Backup job
JobName:  job_backup1
Level:Incremental
Client:   client_backup1
FileSet:  fileset_backup1
Pool: Default (From Job resource)
Storage:  storage_backup1 (From Job resource)
When: 2009-05-22 11:49:34
Priority: 10
OK to run? (yes/mod/no):

the schedule section is listed below;

Schedule {
  Name = test   
  Run = Full at 11:50   
}

attached is bacula-dir.conf

#
# Default Bacula Director Configuration file
#
#  The only thing that MUST be changed is to add one or more
#   file or directory names in the Include directive of the
#   FileSet resource.
#
#  For Bacula release 2.4.4 (28 December 2008) -- debian lenny/sid
#
#  You might also want to change the default email address
#   from root to your address.  See the mail and operator
#   directives in the Messages resource.
#

Director {# define myself
  Name = director_backup1
  DIRport = 9101# where we listen for UA connections
  QueryFile = /etc/bacula/scripts/query.sql
  WorkingDirectory = /var/lib/bacula
  PidDirectory = /var/run/bacula
  Maximum Concurrent Jobs = 1
  Password = rF62q2AmEh16ecBbeV3lTs74t3u0AYx33 # Console password
  Messages = Daemon
  DirAddress = 127.0.0.1
}

Job {
  Name = job_backup1
  Type = Backup
  Client = client_backup1
  FileSet = fileset_backup1
  Pool = Default
  Schedule = test
  Full Backup Pool = pool_backup1_full
  Differential Backup Pool = pool_backup1_diff
  Incremental Backup Pool = pool_backup1_inc
  Messages = Standard
  Storage = storage_backup1
  Write Bootstrap = /var/lib/bacula/job_backup1.bsr
  Priority = 10
}


# List of files to be backed up
FileSet {
  Name = fileset_backup1
  Include {
Options {
  signature = MD5
}
File = /etc
File = /home/zhengquan
File = /var
  }
  Exclude {
File = /proc
File = /tmp
File = /.journal
File = /.fsck
  }
}

#test schedule
Schedule {
  Name = test 
  Run = Full at 11:50
}

# backup1, the backup server itself
Client {
  Name = client_backup1
  Address = backup1
  FDPort = 9102
  Catalog = MyCatalog
  Password = eGZTerS3s5Wdye3uO0k3ejoKALchE2QXCQ5  # password for 
FileDaemon
  File Retention = 60 days# 60 days
  Job Retention = 6 months# six months
  AutoPrune = yes # Prune expired Jobs/Files
}


# Definition of file storage device
Storage {
  Name = storage_backup1
  Address = backup1# N.B. Use a fully qualified name here
  SDPort = 9103
  Password = 8GGBGvyuXppCgc3YxoPe5nDiX5yYhKIO22gmITaKg
  Device = device_backup1
  Media Type = File
}



# Generic catalog service
Catalog {
  Name = MyCatalog
  dbname = bacula; dbuser = bacula; dbpassword = bacula
}

# Reasonable message delivery -- send most everything to email address
#  and to the console
Messages {
  Name = Standard
  mailcommand = /usr/lib/bacula/bsmtp -h localhost -f \\(Bacula\) \%r\\ -s 
\Bacula: %t %e of %c %l\ %r
  operatorcommand = /usr/lib/bacula/bsmtp -h localhost -f \\(Bacula\) 
\%r\\ -s \Bacula: Intervention needed for %j\ %r
  mail = zhang.zhengq...@gmail.com = all, !skipped
  operator = zhang.zhengq...@gmail.com = mount
  console = all, !skipped, !saved
#
# WARNING! the following will create a file that you must cycle from
#  time to time as it will grow indefinitely. However, it will
#  also keep all your messages if they scroll off the console.
#
  append = /var/lib/bacula/log = all, !skipped
}


#
# Message delivery for daemon messages (no job).
Messages {
  Name = Daemon
  mailcommand = /usr/lib/bacula/bsmtp -h localhost -f \\(Bacula\) \%r\\ -s 
\Bacula daemon message\ %r
  mail = zhang.zhengq...@gmail.com = all, !skipped
  console = all, !skipped, !saved
  append = /var/lib/bacula/log = all, !skipped
}

Pool {
   Name = pool_backup1_full
   Pool Type = Backup
   Recycle = yes
   AutoPrune = yes
   Volume Retention = 6 months
   Label Format = backup1_full_
   Maximum Volume Bytes = 500M
}


Pool {
   Name = pool_backup1_diff
   Pool Type = Backup
   Recycle = yes
   AutoPrune = yes
   # default 1 year
   Volume Retention = 30d
   Label Format = backup1_diff_
   Maximum Volume Bytes = 500M
}


Pool {
   Name = pool_backup1_inc
   Pool Type = Backup
   Recycle = yes
   AutoPrune = yes
   # default 1 year
   Volume Retention = 7d
   Maximum Volumes = 7
   Label Format = backup1_inc_
   Maximum Volume Bytes = 100M
}

# Default pool definition
Pool {
  Name = Default
  Pool Type = Backup
  Recycle = yes   # Bacula can automatically recycle Volumes
  AutoPrune = yes # Prune expired volumes
  Volume Retention = 365 days  

[Bacula-users] recommend a setup guide for debian uses with mysql?

2009-05-15 Thread Zhengquan Zhang
Hello, bacula users,
I am newbie to bacula and was trying to setup bacula to do backup for
several servers. the official doc is really daunting. and I searched web
but there seems to be no detailed guide for step-for-step setup with
mysql. I wonder if anyone has the same experience before and can point
to a debian bacula mysql setup guide?

Thanks,

-- 
Zhengquan


--
Crystal Reports - New Free Runtime and 30 Day Trial
Check out the new simplified licensing option that enables 
unlimited royalty-free distribution of the report engine 
for externally facing server and web deployment. 
http://p.sf.net/sfu/businessobjects
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] backup plan for critique

2009-05-07 Thread Zhengquan Zhang
On Thu, May 07, 2009 at 09:14:19AM +0200, Maarten Hoogveld wrote:
 2009/5/4 Zhengquan Zhang zhang.zhengq...@gmail.com
 
  Hello bacula community,
 
  I am a newbie to bacula and backup but I have decided to use it for our
  backup scheme:) we will backup two servers to a backup server.
 
  I have got a few questions that I have not figured out the answer.
 
  1.why does bacula use db as backend? why add additional this level of
  complexity to the backup?
 
 This is not something you have to know about to be able to use Bacula. The
 database is used to store all information about the backups which have been
 made including all files and their metadata. A database is the most
 efficient way to store that data.
 For small installations a sqlite database is sufficient which hardly needs
 any setup. Read the documentation about it.

Thanks a lot Maarten, your reply definetely helped me a lot.

Regards,

-- 
Zhengquan


--
The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your
production scanning environment may not be a perfect world - but thanks to
Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700
Series Scanner you'll get full speed at 300 dpi even with all image 
processing features enabled. http://p.sf.net/sfu/kodak-com
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] backup plan for critique

2009-05-04 Thread Zhengquan Zhang
Hello bacula community,

I am a newbie to bacula and backup but I have decided to use it for our
backup scheme:) we will backup two servers to a backup server.

I have got a few questions that I have not figured out the answer.

1.why does bacula use db as backend? why add additional this level of
complexity to the backup?

2. the folders I would like to backup are

monk
 
/home 79G   
 
/etc
 
/srv/bitten 2G  
 
/srv/www 23G
 
/srv/pub 32G
 
/srv/svnrepos 2G
 
/srv/trac 1.5G  
 
/var 2G 
 
total 160G

 
ccl 
 
/home 19G // everyone's public_html and .maildir directory  
 
/home/httpd 43G 
 
/etc
 
/usr1 83G //including mailman and postgresql database   
 
/var 8G 
 
/Public 115G
 
/usr/local/cvsroot 3G   
total  200G

I have got two 1T drive for raid1. so I have 1T space.

 considering the size of my drive, what would be a reasonable back
scheme? How frequently should I do the full backup and how frequently
should I do the incremental backup?

3. How large would the db grow if for example I do a full backup of the
above contents? Does bacula compress the contents?

Thanks for any suggestions and I am open to reading documents.

-- 
Zhengquan


--
Register Now  Save for Velocity, the Web Performance  Operations 
Conference from O'Reilly Media. Velocity features a full day of 
expert-led, hands-on workshops and two days of sessions from industry 
leaders in dedicated Performance  Operations tracks. Use code vel09scf 
and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users