Re: [Bacula-users] disk full, need to reset and upgrade

2009-08-06 Thread Thomas Manson
Hi Richard,


  I would make a move instead of a delete so I keep the data, and dump the
mysql schema.

  To reset bacula, I just need to drop the database and recreate  the
schema  ? (and change the data location to my NAS)

  Thanks for the advice, I'll try this this weekend... I've my file system
filled up to 96% but still have 33GB left... ;)

  I'll even try to truly restore the backup, to test the restore ;)


Regards,
Thomas.



On Thu, Aug 6, 2009 at 18:11, Richard Mortimer ri...@oldelvet.org.ukwrote:



 Thomas Manson wrote:

 Hi Richard,

  My current backup have loads of un necessary data...

  That's why I'd like to reset my bacula.

 That makes sense. I suggested that you might copy the backup data as an
 interim precaution to ensure that you were not without a backup of your
 data whilst making the changes. If you are comfortable just deleting the
 data (and removing it from the database too) then I will not argue against
 it.


  Also to re-work the exclude list I've setup and that doesn't work, I need
 to know what file was backup during the last job.

 How I do that ?

 I see that no-one has jumped in with ideas yet and I must claim the my
 bacula setup has been fairly static for a while (why break something that
 works!) but my suggestion would be to use bconsole to setup a restore job.
 Once in the restore job you can move around the directory tree and look at
 what is in there. You don't need to complete the restore operation but you
 can look around.

 If you have the jobId of the last backup handy (look in the email that
 bacula sends when a backup completes) the select option 3 (Enter list of
 comma separated JobIds to select) from the restore command and enter the
 jobId.

 One you have selected the job bacula will drop you into the file selection
 mode where you can use the cd command to move around and ls to list things.
 If you use the mark command to mark a specific directory then you can use
 the estimate command to show you the total data selected in that directory.
 If you unmark those file then you can estimate other directories. It can be
 slow going if you have lots of folders to look at but it does work. Others
 may have better suggestions.

 Below is an example from one of my incremental backups for a small host.

 Regards

 Richard

 *restore

 First you select one or more JobIds that contain files
 to be restored. You will be presented several methods
 of specifying the JobIds. Then you will be allowed to
 select which files from those JobIds are to be restored.

 To select the JobIds, you have the following choices:
 1: List last 20 Jobs run
 2: List Jobs where a given File is saved
 3: Enter list of comma separated JobIds to select
 4: Enter SQL list command
 5: Select the most recent backup for a client
 6: Select backup for a client before a specified time
 7: Enter a list of files to restore
 8: Enter a list of files to restore before a specified time
 9: Find the JobIds of the most recent backup for a client
10: Find the JobIds for a backup for a client before a specified time
11: Enter a list of directories to restore for found JobIds
12: Cancel
 Select item:  (1-12): 3
 Enter JobId(s), comma separated, to restore: 3791
 You have selected the following JobId: 3791

 Building directory tree for JobId 3791 ...
 1 Job, 17 files inserted into the tree.

 You are now entering file selection mode where you add (mark) and
 remove (unmark) files to be restored. No files are initially added, unless
 you used the all keyword on the command line.
 Enter done to leave this mode.

 cwd is: /
 $ ls
 var/
 $ cd var
 cwd is: /var/
 $ ls
 spool/
 $ mark spool
 17 files marked.
 $ estimate
 17 total files; 17 marked to be restored; 185,790,882 bytes.
 $ unmark spool
 17 files unmarked.
 $ estimate
 17 total files; 0 marked to be restored; 0 bytes.
 $







 I've tryed to browse the mysql database, but filename are in blob which is
 not handy for browesing.

 Thomas.

 On Tue, Aug 4, 2009 at 10:47, Richard Mortimer ri...@oldelvet.org.ukmailto:
 ri...@oldelvet.org.uk wrote:

Hi Thomas,

It isn't clear from your message what you are asking for help with.
That said I have made some comments inline below.

Thomas Manson wrote:

One other thing :

 I've set to 40 volumes.
   When all volume were filled up, I was expecting bacula to
recycle the first volume... but it didn't, I had to increase the
number of volume...

Thomas.

On Tue, Aug 4, 2009 at 09:58, Thomas Manson
dev.mansontho...@gmail.com mailto:dev.mansontho...@gmail.com
mailto:dev.mansontho...@gmail.com
mailto:dev.mansontho...@gmail.com wrote:

   Hi,

 I've been using bacula to backup remote hosts through ssh
connection.

 It works well except that :

   * a lot of data is backed up on remote host uselessly (as
 log

Re: [Bacula-users] disk full, need to reset and upgrade

2009-08-05 Thread Thomas Manson
Hi Richard,
  My current backup have loads of un necessary data...

  That's why I'd like to reset my bacula.

  Also to re-work the exclude list I've setup and that doesn't work, I need
to know what file was backup during the last job.

How I do that ?

I've tryed to browse the mysql database, but filename are in blob which is
not handy for browesing.

Thomas.

On Tue, Aug 4, 2009 at 10:47, Richard Mortimer ri...@oldelvet.org.ukwrote:

 Hi Thomas,

 It isn't clear from your message what you are asking for help with. That
 said I have made some comments inline below.

 Thomas Manson wrote:

 One other thing :

  I've set to 40 volumes.
When all volume were filled up, I was expecting bacula to recycle the
 first volume... but it didn't, I had to increase the number of volume...

 Thomas.

 On Tue, Aug 4, 2009 at 09:58, Thomas Manson 
 dev.mansontho...@gmail.commailto:
 dev.mansontho...@gmail.com wrote:

Hi,

  I've been using bacula to backup remote hosts through ssh connection.

  It works well except that :

* a lot of data is backed up on remote host uselessly (as log
  file ...)
* I need to upgrade to bacula 3.x to have the exclude feature...
  but I'm running on ubuntu and would like to keep the apt-get
  update feature working for bacula
* My hardrives are full. While I didn't have a NAS ready, I set
  the backup directory to /backup on my primary disks (raid1).
  I now have 2.7TB in Raid5 on a nas mounted in /mnt/backup


What I would like is :

* upgrade to v3 and backup only what is needed (with the exclude
  feature)

 It isn't clear if Exclude is the only reason why you want to upgrade to v3
 but the Exclude directive in FileSet has been there for a long time and it
 certainly exists in the 2.x series. There is no need to upgrade to get that
 functionality.

 * delete all existing backup in /backup (150GB)
* start backing up on /mnt/backup

 Why not just copy/move the data from /backup into /mnt/backup and then
 change your -sd configuration to point to /mnt/backup. That way you can keep
 all of your existing backups and get your setup correctly configured without
 too much disruption.

 Before you copy the data you should ensure that no backups are currently
 running and stop the -sd before moving the files. Once you have moved the
 files edit you bacula-sd.conf to point to the new location and restart the
 sd daemon.

 Regards

 Richard



my filesystem is almost full (96%) ...

Thanks for any help ;)
Thomas.


--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] disk full, need to reset and upgrade

2009-08-04 Thread Thomas Manson
Hi,

  I've been using bacula to backup remote hosts through ssh connection.

  It works well except that :


   - a lot of data is backed up on remote host uselessly (as log file ...)
   - I need to upgrade to bacula 3.x to have the exclude feature... but I'm
   running on ubuntu and would like to keep the apt-get update feature working
   for bacula
   - My hardrives are full. While I didn't have a NAS ready, I set the
   backup directory to /backup on my primary disks (raid1).
   I now have 2.7TB in Raid5 on a nas mounted in /mnt/backup


What I would like is :


   - upgrade to v3 and backup only what is needed (with the exclude feature)
   - delete all existing backup in /backup (150GB)
   - start backing up on /mnt/backup

my filesystem is almost full (96%) ...

Thanks for any help ;)
Thomas.
--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] disk full, need to reset and upgrade

2009-08-04 Thread Thomas Manson
One other thing :

  I've set to 40 volumes.

  When all volume were filled up, I was expecting bacula to recycle the
first volume... but it didn't, I had to increase the number of volume...

Thomas.

On Tue, Aug 4, 2009 at 09:58, Thomas Manson dev.mansontho...@gmail.comwrote:

 Hi,

   I've been using bacula to backup remote hosts through ssh connection.

   It works well except that :


- a lot of data is backed up on remote host uselessly (as log file ...)
- I need to upgrade to bacula 3.x to have the exclude feature... but
I'm running on ubuntu and would like to keep the apt-get update feature
working for bacula
- My hardrives are full. While I didn't have a NAS ready, I set the
backup directory to /backup on my primary disks (raid1).
I now have 2.7TB in Raid5 on a nas mounted in /mnt/backup


 What I would like is :


- upgrade to v3 and backup only what is needed (with the exclude
feature)
- delete all existing backup in /backup (150GB)
- start backing up on /mnt/backup

 my filesystem is almost full (96%) ...

 Thanks for any help ;)
 Thomas.

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] disk full, need to reset and upgrade

2009-08-04 Thread Thomas Manson
Hi Marc,
I've already tried something similar.

As the backup filesystem is remote (through ssh), before the execution of
the backup, I execute a remote script that list all directory to exclude,
then scp to the Director machine and do the job. (tech detail may be
inaccurate as it's off the top of my head)

but after a check it didn't work (all data were backup, excluded directory
too), and I didn't have time to work on it...

I'll try again tonight as it become urgent... ;o)

But I really need to reset bacula storage, set the save path to the NAS and
enable the recycling feature on the volume.


Thomas.

On Tue, Aug 4, 2009 at 11:02, Marc Schiffbauer m...@schiffbauer.net wrote:


 Hi Thomas,

 there is an exclude feature in previous bacula versions as well. And
 if you are talking about the new Exclude Dir Containing feature:

 You can achieve the same behavior in 2.x versions of bacula with an
 Exclude setting like this:

 FileSet {
  Name = MyFileSet
  Include {
Options {
  ...
}
File = ...
  }
  Exclude {
File = \\|sh -c 'for D in / /var /home; do find $D -xdev -name
 .BACULA_NO_BACKUP -type f -printf \%h\\n\; done | tee
 /root/bacula_excluded_dirs.log'
  }
 }

 You have to put the relevant filesystems into the list of the for-loop. In
 this case all dirs containing a file .BACULA_NO_BACKUP within
 the /, /var or /home filesystem will not be backed up. And you will find a
 list of directories that have been excluded this way in
 /root/bacula_excluded_dirs.log

 I am using this mechanism since years and it works very well.

 -Marc

 * Thomas Manson schrieb am 04.08.09 um 09:58 Uhr:
  Hi,
 
I've been using bacula to backup remote hosts through ssh connection.
 
It works well except that :
 
 
 - a lot of data is backed up on remote host uselessly (as log file
 ...)
 - I need to upgrade to bacula 3.x to have the exclude feature... but
 I'm
 running on ubuntu and would like to keep the apt-get update feature
 working
 for bacula
 - My hardrives are full. While I didn't have a NAS ready, I set the
 backup directory to /backup on my primary disks (raid1).
 I now have 2.7TB in Raid5 on a nas mounted in /mnt/backup
 
 
  What I would like is :
 
 
 - upgrade to v3 and backup only what is needed (with the exclude
 feature)
 - delete all existing backup in /backup (150GB)
 - start backing up on /mnt/backup
 
  my filesystem is almost full (96%) ...
 
  Thanks for any help ;)
  Thomas.

 --
 8AAC 5F46 83B4 DB70 8317  3723 296C 6CCA 35A6 4134


 --
 Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
 trial. Simplify your report design, integration and deployment - and focus
 on
 what you do best, core application coding. Discover what's new with
 Crystal Reports now.  http://p.sf.net/sfu/bobj-july
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Ubuntu repository for bacula 3 ?

2009-08-03 Thread Thomas Manson
Hi,

 Is there a repository for bacula 3, so that I can update to this version
now  as it's not in the official ubuntu repo  ?

  I've done this for some other software, which allow to switch to official
repo when they are up to date...

Thomas.
--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Folder Exclusion... didn't work

2009-04-09 Thread Thomas Manson
the file has lines like these :


/home/geocroissance/web/public_html/cache/
/home/aurelieetgeoffroy/web/public_html/cache/
/home/deco-factory/web/public_html/oscss_data/
/home/deco-factory/web/public_html/images/imagecache/

it should be change to

/home/geocroissance/web/public_html/cache
/home/aurelieetgeoffroy/web/public_html/cache
/home/deco-factory/web/public_html/oscss_data
/home/deco-factory/web/public_html/images/imagecache


?
Thomas
On Tue, Apr 7, 2009 at 20:58, Martin Simmons mar...@lispworks.com wrote:
 On Mon, 6 Apr 2009 23:58:29 +0200, Thomas Manson said:

 /usr/local/bin/scripts/bacula/excludeFolderList/machine.domain_excludeFolderList.txt

 is generated with the following script

 find /home -name .bacula_exclude | sed 's/.bacula_exclude//' 
 /root/scripts/bacula/excludeFolderList
 (and then copied from the client to the directory machine via a scp)

 which is executed as a Run Before Job.

 Do you see anything wrong ?

 I think you need to strip the trailing slash on each directory name (assuming
 .bacula_exclude is a file).

 __Martin

 --
 This SF.net email is sponsored by:
 High Quality Requirements in a Collaborative Environment.
 Download a free trial of Rational Requirements Composer Now!
 http://p.sf.net/sfu/www-ibm-com
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Folder Exclusion... didn't work

2009-04-09 Thread Thomas Manson
I know that a feature is planned in the version3, but I need full backup now ;)


I would rather execute the command to generate the exclude list on the
client with the \| syntax. That at least ensures the list is always
up to date.

The exclude file is updated with some ssh command before the backup
starts so the file is up to date.
And like this i've a centralized view of the exclude file of each
machine on my bacula director server.

 File = \\|bash -c \df -klF ufs | tail +2 | awk '{print \$6}'\

there's also this variant for a client execution :

File = \\ /path/to/fileList



Also, sorry for the response time, I've tryed to upgrade my PC from
kubuntu 8.10 to 9.04 and it fails... (seems that the raid1 setup has
been lost at boot time)

Thomas.
On Tue, Apr 7, 2009 at 21:31, Arno Lehmann a...@its-lehmann.de wrote:
 Hi,

 06.04.2009 23:58, Thomas Manson wrote:
 Hi,


 I'm trying to exclude a list of folder from the backup, but it didn't
 work (my backup is still huge as before)


 The fileset is defined like this :

 FileSet {
   Name = machine.domain.fr.FileSet
   Include {
     Options {
       signature   = SHA1
       compression = GZIP
     }
     File = /etc
     File = /home
     File = /usr/src/makeHttpd
     File = /root
     File = /backup/lastbackup
   }
   Exclude {
     File = 
 /usr/local/bin/scripts/bacula/excludeFolderList/machine.domain_excludeFolderList.txt
   }
 }

 Something that perhaps doesn't help you now, but might later: Consider
 upgrading to 3.0 when released. It's got that feature built in.


 the local file (from the director point of view)

 /usr/local/bin/scripts/bacula/excludeFolderList/machine.domain_excludeFolderList.txt

 is generated with the following script

 find /home -name .bacula_exclude | sed 's/.bacula_exclude//' 
 /root/scripts/bacula/excludeFolderList
 (and then copied from the client to the directory machine via a scp)

 which is executed as a Run Before Job.

 Do you see anything wrong ?

 Not necessarily wrong, though I admit I don't use excludes very often :-)

 I would rather execute the command to generate the exclude list on the
 client with the \| syntax. That at least ensures the list is always
 up to date. From the manual:

 If the vertical bar (|) in front of my_partitions is preceded by a
   backslash as in \|, the program will be executed on the Client's
   machine instead of on the Director's machine. Please note that if
   the filename is given within quotes, you will need to use two
 slashes. An example, provided by John Donagher, that backs up all
 the local UFS partitions on a remote system is:

 FileSet {
   Name = All local partitions
   Include {
     Options { signature=SHA1; onefs=yes; }
     File = \\|bash -c \df -klF ufs | tail +2 | awk '{print \$6}'\
   }
 }

 Obviously, you'd exchange the df with your find | sed combination.

 Arno

 Thomas.

 --
 Arno Lehmann
 IT-Service Lehmann
 Sandstr. 6, 49080 Osnabrück
 www.its-lehmann.de

 --
 This SF.net email is sponsored by:
 High Quality Requirements in a Collaborative Environment.
 Download a free trial of Rational Requirements Composer Now!
 http://p.sf.net/sfu/www-ibm-com
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Folder Exclusion... didn't work

2009-04-09 Thread Thomas Manson
;)

I think some time will ellapse until it's in ubuntu repository ?

On Fri, Apr 10, 2009 at 01:26, John Drescher dresche...@gmail.com wrote:
 On Thu, Apr 9, 2009 at 7:07 PM, Thomas Manson
 dev.mansontho...@gmail.com wrote:
 I know that a feature is planned in the version3, but I need full backup now 
 ;)

 bacula-3.0.0 has been released today. :)

 I'll be testing ebuilds on gentoo in 2 hours...

 John


--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Folder Exclusion... didn't work

2009-04-06 Thread Thomas Manson
Hi,


I'm trying to exclude a list of folder from the backup, but it didn't
work (my backup is still huge as before)


The fileset is defined like this :

FileSet {
  Name = machine.domain.fr.FileSet
  Include {
Options {
  signature   = SHA1
  compression = GZIP
}
File = /etc
File = /home
File = /usr/src/makeHttpd
File = /root
File = /backup/lastbackup
  }
  Exclude {
File = 
/usr/local/bin/scripts/bacula/excludeFolderList/machine.domain_excludeFolderList.txt
  }
}


the local file (from the director point of view)

/usr/local/bin/scripts/bacula/excludeFolderList/machine.domain_excludeFolderList.txt

is generated with the following script

find /home -name .bacula_exclude | sed 's/.bacula_exclude//' 
/root/scripts/bacula/excludeFolderList
(and then copied from the client to the directory machine via a scp)

which is executed as a Run Before Job.

Do you see anything wrong ?

Thomas.

--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] regexdir stops bacula backup...

2009-03-04 Thread Thomas Manson
Ok,
I've read a bit quickly your answer, and tonight Bacula backup 33Go of data
(compressed)  LOL...

I'm gonna change my way of doing... instead of a complex bacula
configuration, I'll move logs to another single location (for every website)
instead of a logs directory per website.

This server will soon be re installed and the way I manage website will
change totally, that's why I don't want to spend much time on this (I've
also a lot of other things to do and it's not my full time job)

Thanks Martin for your help !

Thomas.

On Tue, Mar 3, 2009 at 16:43, Martin Simmons mar...@lispworks.com wrote:

  On Tue, 3 Mar 2009 15:20:46 +0100, Thomas Manson said:
 
  Hi Martin,
 
  So I should do this :
   FileSet {
  Name = computer.domain.com.FileSet
  Include {
Options {
  signature   = SHA1
  compression = GZIP
  *regexdir= /home/.*/web/public_html*
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
*File = /home*
  }
  }

 Yes, that's a start.


 
 
   you need to exclude everything that doesn't match the regex and include
   all of the directories above /home/user1/web.
  
 
  Well, I've nothing to backup between / and /home/*/web
  What's the point of using regexdir if I have to exclude everything else ?

 That's just how it works.  Bacula doesn't scan the whole world looking for
 something that matches the regexdir.

 Instead, it searches down the tree starting from the 'File =' lines looking
 for files to back up.  To prevent something from being backed up, you must
 exclude it by using an Exclude section or by using options with 'exclude =
 yes'.  See the *.gz example here:

 http://www.bacula.org/en/rel-manual/Configuring_Director.html#SECTION00148

 When you exclude a directory, it doesn't look any further.  Therefore, to
 back
 up selected subdirectories of /home/*, you need to make Bacula select all
 directories leading up to those you want to back up, without selecting any
 of
 ther contents.  Something like this (not tested):

  Include {
 Options {
signature   = SHA1
compression = GZIP
 # include the dirs in /home
regexdir = ^/home/[^/]+$
# and include the web dirs of them
wilddir   = /home/*/web
# and the public_html dirs within the web dirs
wilddir   = /home/*/web/public_html
# and the contents of the public_html
wild  = /home/*/web/public_html/*
 }
 Options {
# exclude everything else
Exclude = yes
wild = /home/*
 }
 File = /home
   }

 __Martin


 
  For the fact that bacula FD stops with the regexp, I'll recheck, but I
 don't
  think their is something in the director's logs...
 
  Thomas.
 
On Thu, Feb 26, 2009 at 21:44, Martin Simmons mar...@lispworks.com
  wrote:
   On Thu, 26 Feb 2009 10:00:26 +0100, Thomas Manson said:
  
   Nobody has an idea?
  
   Bacula uses the File lines as the roots when it looks for files and
 none
  of
   yours are going to find files in /home/user1 etc.  Also, you can't do
 what
  you
   want directly with a single Options clause -- you need to exclude
  everything
   that doesn't match the regex and include all of the directories above
   /home/user1/web.
  
   Crashing is unexpected though.  What does the Bacula log say?  Can you
  repeat
   it on a local machine without the ssh tunnel?
  
   __Martin
  
  
   On Tue, Feb 24, 2009 at 22:19, Thomas Manson 
 dev.mansontho...@gmail.com
  wrote:
  
I forgot to mention the bacula version :
server :
2.4.2-1ubuntu6
client : Redhat ES4 with version :
 bacula-client-2.4.2-1.el4.i386.rpm
   
Thomas
   
On Tue, Feb 24, 2009 at 22:16, Thomas Manson 
  dev.mansontho...@gmail.comwrote:
   
Hi,
   
I want to backup this kind of directories :
   
/home/user1/web/public_html
/home/user2/web/public_html
/home/user3/web/public_html
/home/user4/web/public_html
   
and subdirectories.
   
I've run a find to list all dir of the home directory and test the
following regexp on it with success :
   
/home/.*/web/public_html  (with quote in the configuration file).
   
When I run the backup, the job crashes :
   
My SSH tunnel is stopped and when I run another backup, it tells me
  that
the last volume do not have the correct number of byte (can't
 remember
  the
exact message).
   
If I comment the regexdir, it works normally.
   
   
here is the fileSet :
   
FileSet {
 Name = computer.domain.com.FileSet
  Include {
   Options {
  signature   = SHA1
 compression = GZIP
  #regexdir= /home/.*/web/public_html
   }
File = /etc
   File = /home/special/master
File = /usr/src/makeHttpd
   File = /root
File = /backup/databases/lastbackup
 }
}
   
Any idea of how I can see what's going wrong?
   
Thx

Re: [Bacula-users] regexdir stops bacula backup...

2009-03-04 Thread Thomas Manson
Well finally I think I'll need the regexdir to exclude some cache directory
inside website that are huge ;)
You didn't work for nothgin Martin ;)

Thanks,
Thomas.

On Wed, Mar 4, 2009 at 11:19, Thomas Manson dev.mansontho...@gmail.comwrote:

 Ok,
 I've read a bit quickly your answer, and tonight Bacula backup 33Go of data
 (compressed)  LOL...

 I'm gonna change my way of doing... instead of a complex bacula
 configuration, I'll move logs to another single location (for every website)
 instead of a logs directory per website.

 This server will soon be re installed and the way I manage website will
 change totally, that's why I don't want to spend much time on this (I've
 also a lot of other things to do and it's not my full time job)

 Thanks Martin for your help !

 Thomas.

 On Tue, Mar 3, 2009 at 16:43, Martin Simmons mar...@lispworks.com wrote:

  On Tue, 3 Mar 2009 15:20:46 +0100, Thomas Manson said:
 
  Hi Martin,
 
  So I should do this :
   FileSet {
  Name = computer.domain.com.FileSet
  Include {
Options {
  signature   = SHA1
  compression = GZIP
  *regexdir= /home/.*/web/public_html*
}
File = /etc
File = /home/special/master
File = /usr/src/makeHttpd
File = /root
File = /backup/databases/lastbackup
*File = /home*
  }
  }

 Yes, that's a start.


 
 
   you need to exclude everything that doesn't match the regex and
 include
   all of the directories above /home/user1/web.
  
 
  Well, I've nothing to backup between / and /home/*/web
  What's the point of using regexdir if I have to exclude everything else
 ?

 That's just how it works.  Bacula doesn't scan the whole world looking for
 something that matches the regexdir.

 Instead, it searches down the tree starting from the 'File =' lines
 looking
 for files to back up.  To prevent something from being backed up, you must
 exclude it by using an Exclude section or by using options with 'exclude =
 yes'.  See the *.gz example here:

 http://www.bacula.org/en/rel-manual/Configuring_Director.html#SECTION00148

 When you exclude a directory, it doesn't look any further.  Therefore, to
 back
 up selected subdirectories of /home/*, you need to make Bacula select all
 directories leading up to those you want to back up, without selecting any
 of
 ther contents.  Something like this (not tested):

  Include {
 Options {
signature   = SHA1
compression = GZIP
 # include the dirs in /home
regexdir = ^/home/[^/]+$
# and include the web dirs of them
wilddir   = /home/*/web
# and the public_html dirs within the web dirs
wilddir   = /home/*/web/public_html
# and the contents of the public_html
wild  = /home/*/web/public_html/*
 }
 Options {
# exclude everything else
Exclude = yes
wild = /home/*
 }
 File = /home
   }

 __Martin


 
  For the fact that bacula FD stops with the regexp, I'll recheck, but I
 don't
  think their is something in the director's logs...
 
  Thomas.
 
On Thu, Feb 26, 2009 at 21:44, Martin Simmons mar...@lispworks.com
  wrote:
   On Thu, 26 Feb 2009 10:00:26 +0100, Thomas Manson said:
  
   Nobody has an idea?
  
   Bacula uses the File lines as the roots when it looks for files and
 none
  of
   yours are going to find files in /home/user1 etc.  Also, you can't do
 what
  you
   want directly with a single Options clause -- you need to exclude
  everything
   that doesn't match the regex and include all of the directories above
   /home/user1/web.
  
   Crashing is unexpected though.  What does the Bacula log say?  Can you
  repeat
   it on a local machine without the ssh tunnel?
  
   __Martin
  
  
   On Tue, Feb 24, 2009 at 22:19, Thomas Manson 
 dev.mansontho...@gmail.com
  wrote:
  
I forgot to mention the bacula version :
server :
2.4.2-1ubuntu6
client : Redhat ES4 with version :
 bacula-client-2.4.2-1.el4.i386.rpm
   
Thomas
   
On Tue, Feb 24, 2009 at 22:16, Thomas Manson 
  dev.mansontho...@gmail.comwrote:
   
Hi,
   
I want to backup this kind of directories :
   
/home/user1/web/public_html
/home/user2/web/public_html
/home/user3/web/public_html
/home/user4/web/public_html
   
and subdirectories.
   
I've run a find to list all dir of the home directory and test the
following regexp on it with success :
   
/home/.*/web/public_html  (with quote in the configuration
 file).
   
When I run the backup, the job crashes :
   
My SSH tunnel is stopped and when I run another backup, it tells
 me
  that
the last volume do not have the correct number of byte (can't
 remember
  the
exact message).
   
If I comment the regexdir, it works normally.
   
   
here is the fileSet :
   
FileSet {
 Name = computer.domain.com.FileSet
  Include {
   Options {
  signature   = SHA1
 compression = GZIP
  #regexdir= /home

Re: [Bacula-users] mark a directory to be excluded from backup

2009-03-04 Thread Thomas Manson
Hi Thomas,
 Thanks for the tip,
  even If I need to update the director conf file each time I add a website,
it's easy enough to be usable.

Thanks again,
Thomas.



On Wed, Mar 4, 2009 at 14:45, Thomas tho...@ic3s.de wrote:



 Thomas Manson schrieb:
  Hi,
 
I wonder if it is possible to mark a directory to be exclude from the
  backup by another mean that the bacula-dir.conf.
 
Here we have a centralized configuration for what is to be backup,
  while I think a distributed configuration would be more efficient and
  easy to handle (Ok, not in every case, but in my case I don't get why
  the director should know every thing about it's clients file system)
 
For example, if a directory would contain an empty file
  .bacula_exclude_dir own by a specific user, the file daemon would not
  backup this dir even if inside a directory mention with a File=

 this can be easily done by something like:

 find /home/thomas/test/ -name .exclude | sed 's/.exclude//' 
 /home/thomas/test/excludelist

 and then specify

  Exclude   {
  File = \\/home/thomas/test/excludelist
}

 in the Fileset.
 you can configure the includelist in the same way on the client.

 
Or a file like the robot.txt that one left for search engines so they
  know what to index and what not.
If the filedaemon find a file like .bacula_directives, it would follow
  that list of directives for all subdir of the current dir.
 
Or even a configuration file for the file daemon. It's easier to
  modifiy (with scripts) a conf file on the client, that to automatically
  update the director conf file from the client (quite impossible in fact).
 
Ok, it's a bit intrusive, but as far as I know bacula, if the only way
  to exclude a directory is to write some complex config in
  bacula-dir.conf, it's very cumbersome !
 
In my case, on the machine I add very often new websites, each one
  with specific structure with some files to be backup some not.
 
this would lead to huge config file or huge amount of data backuped
  for nothing...
 
   What do you think about that?
 
  Thomas.
 
 
 
  
 
 
 --
  Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
 CA
  -OSBC tackles the biggest issue in open source: Open Sourcing the
 Enterprise
  -Strategies to boost innovation and cut costs with open source
 participation
  -Receive a $600 discount off the registration fee with the source code:
 SFAD
  http://p.sf.net/sfu/XcvMzF8H
 
 
  
 
  ___
  Bacula-users mailing list
  Bacula-users@lists.sourceforge.net
  https://lists.sourceforge.net/lists/listinfo/bacula-users

 --
 [:O]###[O:]


 --
 Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
 CA
 -OSBC tackles the biggest issue in open source: Open Sourcing the
 Enterprise
 -Strategies to boost innovation and cut costs with open source
 participation
 -Receive a $600 discount off the registration fee with the source code:
 SFAD
 http://p.sf.net/sfu/XcvMzF8H
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] mark a directory to be excluded from backup

2009-03-04 Thread Thomas Manson
Yes, that sounds good ;)
I'll set a cron job that get the exclude file list on each client with scp
before the backup job.

Thomas.

On Wed, Mar 4, 2009 at 15:40, John Drescher dresche...@gmail.com wrote:

  Hi Thomas,
   Thanks for the tip,
even If I need to update the director conf file each time I add a
 website,
  it's easy enough to be usable.
  Thanks again,
  Thomas.
 
 In this method you should just update the external file. Unless the
 new website is not in the path of the include fileset already.

 John

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] mark a directory to be excluded from backup

2009-03-04 Thread Thomas Manson
Yes exactly !
But I'll keep to the version of bacula shipped in ubuntu repo (safer).

Thanks for the info.

Thomas.

On Wed, Mar 4, 2009 at 16:02, Dan Langille d...@langille.org wrote:

 Thomas Manson wrote:

 Hi,

  I wonder if it is possible to mark a directory to be exclude from the
 backup by another mean that the bacula-dir.conf.

  Here we have a centralized configuration for what is to be backup, while
 I think a distributed configuration would be more efficient and easy to
 handle (Ok, not in every case, but in my case I don't get why the director
 should know every thing about it's clients file system)

  For example, if a directory would contain an empty file
 .bacula_exclude_dir own by a specific user, the file daemon would not backup
 this dir even if inside a directory mention with a File=


 Well, FWIW, this is implemented, but not released.

 See http://www.bacula.org/manuals/en/concepts/concepts/New_Features.html

 Look for Exclude Dirs Containing

 Now in the SVN version, coming soon to a release near you.

 Is this what you're looking for?

 --
 Dan Langille

 BSDCan - The Technical BSD Conference : http://www.bsdcan.org/
 PGCon  - The PostgreSQL Conference: http://www.pgcon.org/

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] regexdir stops bacula backup...

2009-03-03 Thread Thomas Manson
Hi Martin,

So I should do this :
 FileSet {
Name = computer.domain.com.FileSet
Include {
  Options {
signature   = SHA1
compression = GZIP
*regexdir= /home/.*/web/public_html*
  }
  File = /etc
  File = /home/special/master
  File = /usr/src/makeHttpd
  File = /root
  File = /backup/databases/lastbackup
  *File = /home*
}
}


 you need to exclude everything that doesn't match the regex and include
 all of the directories above /home/user1/web.


Well, I've nothing to backup between / and /home/*/web
What's the point of using regexdir if I have to exclude everything else ?

For the fact that bacula FD stops with the regexp, I'll recheck, but I don't
think their is something in the director's logs...

Thomas.

  On Thu, Feb 26, 2009 at 21:44, Martin Simmons mar...@lispworks.com
wrote:
 On Thu, 26 Feb 2009 10:00:26 +0100, Thomas Manson said:

 Nobody has an idea?

 Bacula uses the File lines as the roots when it looks for files and none
of
 yours are going to find files in /home/user1 etc.  Also, you can't do what
you
 want directly with a single Options clause -- you need to exclude
everything
 that doesn't match the regex and include all of the directories above
 /home/user1/web.

 Crashing is unexpected though.  What does the Bacula log say?  Can you
repeat
 it on a local machine without the ssh tunnel?

 __Martin


 On Tue, Feb 24, 2009 at 22:19, Thomas Manson dev.mansontho...@gmail.com
wrote:

  I forgot to mention the bacula version :
  server :
  2.4.2-1ubuntu6
  client : Redhat ES4 with version : bacula-client-2.4.2-1.el4.i386.rpm
 
  Thomas
 
  On Tue, Feb 24, 2009 at 22:16, Thomas Manson 
dev.mansontho...@gmail.comwrote:
 
  Hi,
 
  I want to backup this kind of directories :
 
  /home/user1/web/public_html
  /home/user2/web/public_html
  /home/user3/web/public_html
  /home/user4/web/public_html
 
  and subdirectories.
 
  I've run a find to list all dir of the home directory and test the
  following regexp on it with success :
 
  /home/.*/web/public_html  (with quote in the configuration file).
 
  When I run the backup, the job crashes :
 
  My SSH tunnel is stopped and when I run another backup, it tells me
that
  the last volume do not have the correct number of byte (can't remember
the
  exact message).
 
  If I comment the regexdir, it works normally.
 
 
  here is the fileSet :
 
  FileSet {
   Name = computer.domain.com.FileSet
Include {
 Options {
signature   = SHA1
   compression = GZIP
#regexdir= /home/.*/web/public_html
 }
  File = /etc
 File = /home/special/master
  File = /usr/src/makeHttpd
 File = /root
  File = /backup/databases/lastbackup
   }
  }
 
  Any idea of how I can see what's going wrong?
 
  Thx,
  Thomas.
 
 
 

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] regexdir stops bacula backup...

2009-02-26 Thread Thomas Manson
Nobody has an idea?

On Tue, Feb 24, 2009 at 22:19, Thomas Manson dev.mansontho...@gmail.comwrote:

 I forgot to mention the bacula version :
 server :
 2.4.2-1ubuntu6
 client : Redhat ES4 with version : bacula-client-2.4.2-1.el4.i386.rpm

 Thomas

 On Tue, Feb 24, 2009 at 22:16, Thomas Manson 
 dev.mansontho...@gmail.comwrote:

 Hi,

 I want to backup this kind of directories :

 /home/user1/web/public_html
 /home/user2/web/public_html
 /home/user3/web/public_html
 /home/user4/web/public_html

 and subdirectories.

 I've run a find to list all dir of the home directory and test the
 following regexp on it with success :

 /home/.*/web/public_html  (with quote in the configuration file).

 When I run the backup, the job crashes :

 My SSH tunnel is stopped and when I run another backup, it tells me that
 the last volume do not have the correct number of byte (can't remember the
 exact message).

 If I comment the regexdir, it works normally.


 here is the fileSet :

 FileSet {
  Name = computer.domain.com.FileSet
   Include {
Options {
   signature   = SHA1
  compression = GZIP
   #regexdir= /home/.*/web/public_html
}
 File = /etc
File = /home/special/master
 File = /usr/src/makeHttpd
File = /root
 File = /backup/databases/lastbackup
  }
 }

 Any idea of how I can see what's going wrong?

 Thx,
 Thomas.



--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] regexdir stops bacula backup...

2009-02-24 Thread Thomas Manson
Hi,

I want to backup this kind of directories :

/home/user1/web/public_html
/home/user2/web/public_html
/home/user3/web/public_html
/home/user4/web/public_html

and subdirectories.

I've run a find to list all dir of the home directory and test the following
regexp on it with success :

/home/.*/web/public_html  (with quote in the configuration file).

When I run the backup, the job crashes :

My SSH tunnel is stopped and when I run another backup, it tells me that the
last volume do not have the correct number of byte (can't remember the exact
message).

If I comment the regexdir, it works normally.


here is the fileSet :

FileSet {
 Name = computer.domain.com.FileSet
 Include {
   Options {
 signature   = SHA1
 compression = GZIP
 #regexdir= /home/.*/web/public_html
   }
   File = /etc
   File = /home/special/master
   File = /usr/src/makeHttpd
   File = /root
   File = /backup/databases/lastbackup
 }
}

Any idea of how I can see what's going wrong?

Thx,
Thomas.
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] regexdir stops bacula backup...

2009-02-24 Thread Thomas Manson
I forgot to mention the bacula version :
server :
2.4.2-1ubuntu6
client : Redhat ES4 with version : bacula-client-2.4.2-1.el4.i386.rpm

Thomas
On Tue, Feb 24, 2009 at 22:16, Thomas Manson dev.mansontho...@gmail.comwrote:

 Hi,

 I want to backup this kind of directories :

 /home/user1/web/public_html
 /home/user2/web/public_html
 /home/user3/web/public_html
 /home/user4/web/public_html

 and subdirectories.

 I've run a find to list all dir of the home directory and test the
 following regexp on it with success :

 /home/.*/web/public_html  (with quote in the configuration file).

 When I run the backup, the job crashes :

 My SSH tunnel is stopped and when I run another backup, it tells me that
 the last volume do not have the correct number of byte (can't remember the
 exact message).

 If I comment the regexdir, it works normally.


 here is the fileSet :

 FileSet {
  Name = computer.domain.com.FileSet
   Include {
Options {
   signature   = SHA1
  compression = GZIP
   #regexdir= /home/.*/web/public_html
}
 File = /etc
File = /home/special/master
 File = /usr/src/makeHttpd
File = /root
 File = /backup/databases/lastbackup
  }
 }

 Any idea of how I can see what's going wrong?

 Thx,
 Thomas.

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula-fd starts and then crash (leaving an empty file in /var/lock/subsys/bacula-fd)

2009-02-18 Thread Thomas Manson
Hi John

 This machine is backuped up by a SSH tunnul.

  When Director backup this client, it creates a ssh tunnel, with the needed
port tunneling.
  This configuration works on another machine prefectly.

See this howto : http://wiki.bacula.org/doku.php?id=sshtunnel
 Just to give a try, I did set the public IP of the client, and it gives the
same results :

[r...@dell1 ~]# service bacula-fd start
Starting Bacula File services: [  OK  ]
[r...@dell1 ~]# service bacula-fd status
bacula-fd dead but subsys locked

Thomas.
On Wed, Feb 18, 2009 at 04:58, John Drescher dresche...@gmail.com wrote:

  On Tue, Feb 17, 2009 at 10:54 PM, John Drescher dresche...@gmail.com
 wrote:
  FileDaemon {  # this is me
Name= client.bacula.com-fd
FDport  = 9102  # where we listen for
 the
  director
WorkingDirectory= /var/lib/bacula
Pid Directory   = /var/run/bacula
Maximum Concurrent Jobs = 20
FDAddress   = 127.0.0.1
  }
 
 
  With 127.0.0.1 you will not be able to the fd. I mean this will only
  work if this is also the machine with the director and SD.
 
 That did not come out right. Use the external IP address network
 communication between the fd and sd and the fd and director will not
 work with 127.0.0.1 unless the director and SD run on the same
 machine.

 John

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula-fd starts and then crash (leaving an empty file in /var/lock/subsys/bacula-fd)

2009-02-18 Thread Thomas Manson
Hi John,


I've extracted the command executed by the init.d/bacula-fd script
which is (without daemon) and  it ouputs nothing :

[r...@dell1 temp]# /usr/sbin/bacula-fd   -u root -g bacula -c
/etc/bacula/bacula-fd.conf
[r...@dell1 temp]# echo $?
0
[r...@dell1 temp]#


It doesn't seem to have verbose option on the bacula-fd exec.

Thomas.

On Wed, Feb 18, 2009 at 14:40, John Drescher dresche...@gmail.com wrote:
 On Wed, Feb 18, 2009 at 5:20 AM, Thomas Manson
 dev.mansontho...@gmail.com wrote:
 Hi John

  This machine is backuped up by a SSH tunnul.

 Sorry then ignore my comment.

 Can you run the fd from the shell? It should tell you if it has a problem.

 John


--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula-fd starts and then crash (leaving an empty file in /var/lock/subsys/bacula-fd)

2009-02-18 Thread Thomas Manson
bacula-fd: filed_conf.c:438-0 Inserting director res: machine.FQDN-mon
18-Feb 15:10 machine.FQDN-fd: ERROR TERMINATION at bsys.c:508
Could not open pid file. /var/run/bacula/bacula-fd.9102.pid ERR=No
such file or directory

:o)))

the rpm did not create that directory.

I've created it and now it works :

[r...@dell1 temp]# service bacula-fd start
Starting Bacula File services: [  OK  ]
[r...@dell1 temp]# service bacula-fd status
bacula-fd (pid 21203) is running...


Thanks John !

Thomas.



On Wed, Feb 18, 2009 at 14:57, John Drescher dresche...@gmail.com wrote:
 On Wed, Feb 18, 2009 at 8:48 AM, Thomas Manson
 dev.mansontho...@gmail.com wrote:
 Hi John,


 I've extracted the command executed by the init.d/bacula-fd script
 which is (without daemon) and  it ouputs nothing :

 [r...@dell1 temp]# /usr/sbin/bacula-fd   -u root -g bacula -c
 /etc/bacula/bacula-fd.conf
 [r...@dell1 temp]# echo $?
 0
 [r...@dell1 temp]#


 It doesn't seem to have verbose option on the bacula-fd exec.


 Add:

 -d 100

 this will dump debug info.

 John


--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] bacula-fd starts and then crash (leaving an empty file in /var/lock/subsys/bacula-fd)

2009-02-17 Thread Thomas Manson
Hi,

  I try to install a client on a Redhat ES 4.

  I've installed this rpm : bacula-client-2.4.2-1.el4.i386.rpm

 I've udpated the configuration file for the client to this :


Director {
  Name = home.bacula.com-dir
  Password = thepwd
}

#
# Restricted Director, used by tray-monitor to get the
#   status of the file daemon
#
Director {
  Name = home.bacula.com-mon
  Password = thepwd
  Monitor  = yes
}

#
# Global File daemon configuration specifications
#
FileDaemon {  # this is me
  Name= client.bacula.com-fd
  FDport  = 9102  # where we listen for the
director
  WorkingDirectory= /var/lib/bacula
  Pid Directory   = /var/run/bacula
  Maximum Concurrent Jobs = 20
  FDAddress   = 127.0.0.1
}

Messages {
  Name = Standard
  director = home.bacula.com-dir = all, !skipped, !restored
}
(name  password changed)

When I start bacula-fd (service bacula-fd start)
It says OK, but crahses just after

service bacula-fd status gives :


[r...@cllient bacula]# service bacula-fd status
bacula-fd dead but subsys locked


I can't see no log in /var/log/messages...


Any Idea ?

Thomas.


PS :  My Server version is 2.4.2-1ubuntu6 on ubuntu 8.10
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Ubuntu 8.10 Bacula out of the box is not working...

2009-02-10 Thread Thomas Manson
Hi,

I've setup a vmware instance with ubuntu 8.10 installed, and then installed
bacual (2.4.2) with mysql as DBMS.

The 3 services are running (dir, fd, sd) and I can connect to bconsole with
no error.

But in bconsole, if I try


*status all

I get a timeout error.

I've checked the configuraition files and passwords (generated by ubunutu
installer) seems to match between files.

Any idea of what's going wrong ?

Thomas
--
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Ubuntu 8.10 Bacula out of the box is not working...

2009-02-10 Thread Thomas Manson
Thanks John,

I'm  checking that.

I've replaced 127.0.0.1 by the ip address 192.168.0.14 and added in my
/etc/hosts a line that makes the machine name points to 192.168.0.1.

status all is now working ;o) I can start to play with
job/device/pool/schedule !

I've a question regarding the IP.

My server on which Director will be running has a private address
(192.168.0.1) (behind a router).
I've a fixed public IP, and doing nat  for many application protocol.

I  plan to use ssh tunnel to backup remote client (which are on other
physical site with only ssh accissible)


What IP should I then put for the director ?


Thomas.













On Tue, Feb 10, 2009 at 21:58, John Drescher dresche...@gmail.com wrote:

 n the configuration
 files and replace this with the real ip address. If there were any
 restart the services.

--
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Ubuntu 8.10 Bacula out of the box is not working...

2009-02-10 Thread Thomas Manson
Thx Kevin, I'll look at your doc.

THomas

On Tue, Feb 10, 2009 at 22:23, Kevin Keane subscript...@kkeane.com wrote:

 Funny that you mention that. I just put an article about setting up
 bacula through an SSH tunnel yesterday in the bacula Wiki.

 http://wiki.bacula.org/doku.php?id=sshtunnel

 It sounds like your setup is very similar to what I am using, so this
 solution is likely going to work quite well for you.

 Thomas Manson wrote:
  Thanks John,
 
  I'm  checking that.
 
  I've replaced 127.0.0.1 by the ip address 192.168.0.14 and added in my
  /etc/hosts a line that makes the machine name points to 192.168.0.1.
 
  status all is now working ;o) I can start to play with
  job/device/pool/schedule !
 
  I've a question regarding the IP.
 
  My server on which Director will be running has a private address
  (192.168.0.1) (behind a router).
  I've a fixed public IP, and doing nat  for many application protocol.
 
  I  plan to use ssh tunnel to backup remote client (which are on other
  physical site with only ssh accissible)
 
 
  What IP should I then put for the director ?


 --
 Kevin Keane
 Owner
 The NetTech
 Find the Uncommon: Expert Solutions for a Network You Never Have to Think
 About

 Office: 866-642-7116
 http://www.4nettech.com

 This e-mail and attachments, if any, may contain confidential and/or
 proprietary information. Please be advised that the unauthorized use or
 disclosure of the information is strictly prohibited. The information herein
 is intended only for use by the intended recipient(s) named above. If you
 have received this transmission in error, please notify the sender
 immediately and permanently delete the e-mail and any copies, printouts or
 attachments thereof.



 --
 Create and Deploy Rich Internet Apps outside the browser with
 Adobe(R)AIR(TM)
 software. With Adobe AIR, Ajax developers can use existing skills and code
 to
 build responsive, highly engaging applications that combine the power of
 local
 resources and data with the reach of the web. Download the Adobe AIR SDK
 and
 Ajax docs to start building applications today-
 http://p.sf.net/sfu/adobe-com
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

--
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Setup advices for some heterogenous set of server

2009-02-09 Thread Thomas Manson
Hi Arno,

  Thanks for your answers, and sorry for the delay to answer back.

  To answer your questions :

  I've control (directly or indirectly) of the firewall, but I'd rather use
a ssh tunnels. My homeServer has access to other servers with certificate
authentication.
  I can set explicit  rule to the firewall to allow acces to the needed
port, but ssh is better on security concern.

  Btw, when compression is done ? by the client or by the storage?  because,
in this last case, ssh built in compression could be a nice help.

  Each blue 'backbone' on the schema represents a /24 network and all
servers are in this subnet. All server has public IP address and an FQDN.


  Over the servers, the amount of data should not be that uge (only website,
configuration script, no logfile or mail inbox).
  In case of machine crash, each machine setup is documented, so that to
resume the service, I've to reinstall the system (less than an hour for the
secondary DNS server) and restore data.
  Each machine have or will have a mirror server on another physical site.

   It's probably not the best solution, but given my mean, I can only afford
that solution.

  I also wanted to set this kind of backup :

  1 mounthly full backup of the file system.
  1 daily incremental backup of the filesystem.
  1 daily full backup of databases.

  because, in my case, the filesystem isn't modifyed heavily, most of the
udpates are done in the databases. I think it's suitable for my specific
case, but there are maybe some convients I didn't see


About the setup itself :  The more I read, the more I get confused... the
doc is not easy to get a simple and working configuration.
I've read more than 150 pages, and still have no concrete material to
configure a simple setup...

I'm quite found of learning by example, which you usually find for every
software, but here... not that much indeed...

the only tuto I've found :

  http://www.debianhelp.co.uk/bacula1.htm

doesn't explain really much things.



What I'd like, is to

1/ enable a working backup on the homeServer (director hosting)

test it, play with it  with some simple test case like :

   make a backup of a directory,
   delete (or move outside the dir) one file in the directory,
   restore the file.

   make a backup of a directory
   modify a file
   make a incremental backup
   modify the same file

   make a incremental backup
   modify the same file

walk though the different 'version' of this file.

It would be nice, if bacula team could setup a vmware using a linux distro
like ubuntu with several test case pre-setup to speed up the learning curve.

2/ Once I've setup the backup for the server, add a remote client (through
ssh) (and next add all others)

I find it better to have on directory per client (can't explain why, but
sounds safer),

I've read the basic volume managment chapter which tell I should add a
device per client with a Type per Device so that everything isn't mixed up.

Well I'll explore this later..

I'll try now to get something working on the homeServer itself.

tomorrow, I'll probably setup a ubuntu on vmware to practice some test case
and may publish it on my blog (well the size of the vmware could be an issue
;o)


Thomas.





On Wed, Feb 4, 2009 at 11:30, Arno Lehmann a...@its-lehmann.de wrote:

 Hello,

 03.02.2009 13:44, Thomas Manson wrote:
  Hi,
 
I've read quite some stuff about bacula, but I'm still not sure of the
  best way to implement it.
 
I've attached a simple diagram that represent the network as it will
  soon be. (DNS Server 1 and WebServer 2 are not yet setup).
 
On each server of the left side, the host provider gives 160GB of disk
  on FTP.
The Home Server is the server that will run the Backup Director.
 
Over internet, servers can communicate via SSH. Additionnal port can
  be opened, but I'd rather not.

 You can tunnel any connection where you can specify the host and port
 to use through ssh. In Bacula, you could set up the tunnels using a
 run before job script.

 A regular VPN might be easier to maintain, though harder to set up.

HomeServer and Office Server has an 1MByte/s download and 100KByte/s
  upload capabilities.

 That's a bit limited for backup purposes of large data sets.

Other Servers have more the 50MByte/s upload capabilities
 
For WebServer1  3, and Office Server, I've no other solution that get
  backup to HomeServer.
For other servers, I've the 160GB disks available, but I'm not sure of
  their reliabality (Probably not raid 1 or 5 device, who can access).
 
Any thought, advice?

 Well, it's quite important to know where you want your backups to end
 up. Assuming you want them all consolidated on the HomeServer, you'd
 need some VPN/ssh tunnels to all the servers you want to back up.

 Once those exist, it's a rather standard situation to set up Bacula
 accordingly.

 If you need to keep backup data on te different sites because of the
 traffic limitations