Re: [Bacula-users] disk full, need to reset and upgrade
Hi Richard, I would make a move instead of a delete so I keep the data, and dump the mysql schema. To reset bacula, I just need to drop the database and recreate the schema ? (and change the data location to my NAS) Thanks for the advice, I'll try this this weekend... I've my file system filled up to 96% but still have 33GB left... ;) I'll even try to truly restore the backup, to test the restore ;) Regards, Thomas. On Thu, Aug 6, 2009 at 18:11, Richard Mortimer ri...@oldelvet.org.ukwrote: Thomas Manson wrote: Hi Richard, My current backup have loads of un necessary data... That's why I'd like to reset my bacula. That makes sense. I suggested that you might copy the backup data as an interim precaution to ensure that you were not without a backup of your data whilst making the changes. If you are comfortable just deleting the data (and removing it from the database too) then I will not argue against it. Also to re-work the exclude list I've setup and that doesn't work, I need to know what file was backup during the last job. How I do that ? I see that no-one has jumped in with ideas yet and I must claim the my bacula setup has been fairly static for a while (why break something that works!) but my suggestion would be to use bconsole to setup a restore job. Once in the restore job you can move around the directory tree and look at what is in there. You don't need to complete the restore operation but you can look around. If you have the jobId of the last backup handy (look in the email that bacula sends when a backup completes) the select option 3 (Enter list of comma separated JobIds to select) from the restore command and enter the jobId. One you have selected the job bacula will drop you into the file selection mode where you can use the cd command to move around and ls to list things. If you use the mark command to mark a specific directory then you can use the estimate command to show you the total data selected in that directory. If you unmark those file then you can estimate other directories. It can be slow going if you have lots of folders to look at but it does work. Others may have better suggestions. Below is an example from one of my incremental backups for a small host. Regards Richard *restore First you select one or more JobIds that contain files to be restored. You will be presented several methods of specifying the JobIds. Then you will be allowed to select which files from those JobIds are to be restored. To select the JobIds, you have the following choices: 1: List last 20 Jobs run 2: List Jobs where a given File is saved 3: Enter list of comma separated JobIds to select 4: Enter SQL list command 5: Select the most recent backup for a client 6: Select backup for a client before a specified time 7: Enter a list of files to restore 8: Enter a list of files to restore before a specified time 9: Find the JobIds of the most recent backup for a client 10: Find the JobIds for a backup for a client before a specified time 11: Enter a list of directories to restore for found JobIds 12: Cancel Select item: (1-12): 3 Enter JobId(s), comma separated, to restore: 3791 You have selected the following JobId: 3791 Building directory tree for JobId 3791 ... 1 Job, 17 files inserted into the tree. You are now entering file selection mode where you add (mark) and remove (unmark) files to be restored. No files are initially added, unless you used the all keyword on the command line. Enter done to leave this mode. cwd is: / $ ls var/ $ cd var cwd is: /var/ $ ls spool/ $ mark spool 17 files marked. $ estimate 17 total files; 17 marked to be restored; 185,790,882 bytes. $ unmark spool 17 files unmarked. $ estimate 17 total files; 0 marked to be restored; 0 bytes. $ I've tryed to browse the mysql database, but filename are in blob which is not handy for browesing. Thomas. On Tue, Aug 4, 2009 at 10:47, Richard Mortimer ri...@oldelvet.org.ukmailto: ri...@oldelvet.org.uk wrote: Hi Thomas, It isn't clear from your message what you are asking for help with. That said I have made some comments inline below. Thomas Manson wrote: One other thing : I've set to 40 volumes. When all volume were filled up, I was expecting bacula to recycle the first volume... but it didn't, I had to increase the number of volume... Thomas. On Tue, Aug 4, 2009 at 09:58, Thomas Manson dev.mansontho...@gmail.com mailto:dev.mansontho...@gmail.com mailto:dev.mansontho...@gmail.com mailto:dev.mansontho...@gmail.com wrote: Hi, I've been using bacula to backup remote hosts through ssh connection. It works well except that : * a lot of data is backed up on remote host uselessly (as log
Re: [Bacula-users] disk full, need to reset and upgrade
Hi Richard, My current backup have loads of un necessary data... That's why I'd like to reset my bacula. Also to re-work the exclude list I've setup and that doesn't work, I need to know what file was backup during the last job. How I do that ? I've tryed to browse the mysql database, but filename are in blob which is not handy for browesing. Thomas. On Tue, Aug 4, 2009 at 10:47, Richard Mortimer ri...@oldelvet.org.ukwrote: Hi Thomas, It isn't clear from your message what you are asking for help with. That said I have made some comments inline below. Thomas Manson wrote: One other thing : I've set to 40 volumes. When all volume were filled up, I was expecting bacula to recycle the first volume... but it didn't, I had to increase the number of volume... Thomas. On Tue, Aug 4, 2009 at 09:58, Thomas Manson dev.mansontho...@gmail.commailto: dev.mansontho...@gmail.com wrote: Hi, I've been using bacula to backup remote hosts through ssh connection. It works well except that : * a lot of data is backed up on remote host uselessly (as log file ...) * I need to upgrade to bacula 3.x to have the exclude feature... but I'm running on ubuntu and would like to keep the apt-get update feature working for bacula * My hardrives are full. While I didn't have a NAS ready, I set the backup directory to /backup on my primary disks (raid1). I now have 2.7TB in Raid5 on a nas mounted in /mnt/backup What I would like is : * upgrade to v3 and backup only what is needed (with the exclude feature) It isn't clear if Exclude is the only reason why you want to upgrade to v3 but the Exclude directive in FileSet has been there for a long time and it certainly exists in the 2.x series. There is no need to upgrade to get that functionality. * delete all existing backup in /backup (150GB) * start backing up on /mnt/backup Why not just copy/move the data from /backup into /mnt/backup and then change your -sd configuration to point to /mnt/backup. That way you can keep all of your existing backups and get your setup correctly configured without too much disruption. Before you copy the data you should ensure that no backups are currently running and stop the -sd before moving the files. Once you have moved the files edit you bacula-sd.conf to point to the new location and restart the sd daemon. Regards Richard my filesystem is almost full (96%) ... Thanks for any help ;) Thomas. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] disk full, need to reset and upgrade
Hi, I've been using bacula to backup remote hosts through ssh connection. It works well except that : - a lot of data is backed up on remote host uselessly (as log file ...) - I need to upgrade to bacula 3.x to have the exclude feature... but I'm running on ubuntu and would like to keep the apt-get update feature working for bacula - My hardrives are full. While I didn't have a NAS ready, I set the backup directory to /backup on my primary disks (raid1). I now have 2.7TB in Raid5 on a nas mounted in /mnt/backup What I would like is : - upgrade to v3 and backup only what is needed (with the exclude feature) - delete all existing backup in /backup (150GB) - start backing up on /mnt/backup my filesystem is almost full (96%) ... Thanks for any help ;) Thomas. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] disk full, need to reset and upgrade
One other thing : I've set to 40 volumes. When all volume were filled up, I was expecting bacula to recycle the first volume... but it didn't, I had to increase the number of volume... Thomas. On Tue, Aug 4, 2009 at 09:58, Thomas Manson dev.mansontho...@gmail.comwrote: Hi, I've been using bacula to backup remote hosts through ssh connection. It works well except that : - a lot of data is backed up on remote host uselessly (as log file ...) - I need to upgrade to bacula 3.x to have the exclude feature... but I'm running on ubuntu and would like to keep the apt-get update feature working for bacula - My hardrives are full. While I didn't have a NAS ready, I set the backup directory to /backup on my primary disks (raid1). I now have 2.7TB in Raid5 on a nas mounted in /mnt/backup What I would like is : - upgrade to v3 and backup only what is needed (with the exclude feature) - delete all existing backup in /backup (150GB) - start backing up on /mnt/backup my filesystem is almost full (96%) ... Thanks for any help ;) Thomas. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] disk full, need to reset and upgrade
Hi Marc, I've already tried something similar. As the backup filesystem is remote (through ssh), before the execution of the backup, I execute a remote script that list all directory to exclude, then scp to the Director machine and do the job. (tech detail may be inaccurate as it's off the top of my head) but after a check it didn't work (all data were backup, excluded directory too), and I didn't have time to work on it... I'll try again tonight as it become urgent... ;o) But I really need to reset bacula storage, set the save path to the NAS and enable the recycling feature on the volume. Thomas. On Tue, Aug 4, 2009 at 11:02, Marc Schiffbauer m...@schiffbauer.net wrote: Hi Thomas, there is an exclude feature in previous bacula versions as well. And if you are talking about the new Exclude Dir Containing feature: You can achieve the same behavior in 2.x versions of bacula with an Exclude setting like this: FileSet { Name = MyFileSet Include { Options { ... } File = ... } Exclude { File = \\|sh -c 'for D in / /var /home; do find $D -xdev -name .BACULA_NO_BACKUP -type f -printf \%h\\n\; done | tee /root/bacula_excluded_dirs.log' } } You have to put the relevant filesystems into the list of the for-loop. In this case all dirs containing a file .BACULA_NO_BACKUP within the /, /var or /home filesystem will not be backed up. And you will find a list of directories that have been excluded this way in /root/bacula_excluded_dirs.log I am using this mechanism since years and it works very well. -Marc * Thomas Manson schrieb am 04.08.09 um 09:58 Uhr: Hi, I've been using bacula to backup remote hosts through ssh connection. It works well except that : - a lot of data is backed up on remote host uselessly (as log file ...) - I need to upgrade to bacula 3.x to have the exclude feature... but I'm running on ubuntu and would like to keep the apt-get update feature working for bacula - My hardrives are full. While I didn't have a NAS ready, I set the backup directory to /backup on my primary disks (raid1). I now have 2.7TB in Raid5 on a nas mounted in /mnt/backup What I would like is : - upgrade to v3 and backup only what is needed (with the exclude feature) - delete all existing backup in /backup (150GB) - start backing up on /mnt/backup my filesystem is almost full (96%) ... Thanks for any help ;) Thomas. -- 8AAC 5F46 83B4 DB70 8317 3723 296C 6CCA 35A6 4134 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Ubuntu repository for bacula 3 ?
Hi, Is there a repository for bacula 3, so that I can update to this version now as it's not in the official ubuntu repo ? I've done this for some other software, which allow to switch to official repo when they are up to date... Thomas. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Folder Exclusion... didn't work
the file has lines like these : /home/geocroissance/web/public_html/cache/ /home/aurelieetgeoffroy/web/public_html/cache/ /home/deco-factory/web/public_html/oscss_data/ /home/deco-factory/web/public_html/images/imagecache/ it should be change to /home/geocroissance/web/public_html/cache /home/aurelieetgeoffroy/web/public_html/cache /home/deco-factory/web/public_html/oscss_data /home/deco-factory/web/public_html/images/imagecache ? Thomas On Tue, Apr 7, 2009 at 20:58, Martin Simmons mar...@lispworks.com wrote: On Mon, 6 Apr 2009 23:58:29 +0200, Thomas Manson said: /usr/local/bin/scripts/bacula/excludeFolderList/machine.domain_excludeFolderList.txt is generated with the following script find /home -name .bacula_exclude | sed 's/.bacula_exclude//' /root/scripts/bacula/excludeFolderList (and then copied from the client to the directory machine via a scp) which is executed as a Run Before Job. Do you see anything wrong ? I think you need to strip the trailing slash on each directory name (assuming .bacula_exclude is a file). __Martin -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Folder Exclusion... didn't work
I know that a feature is planned in the version3, but I need full backup now ;) I would rather execute the command to generate the exclude list on the client with the \| syntax. That at least ensures the list is always up to date. The exclude file is updated with some ssh command before the backup starts so the file is up to date. And like this i've a centralized view of the exclude file of each machine on my bacula director server. File = \\|bash -c \df -klF ufs | tail +2 | awk '{print \$6}'\ there's also this variant for a client execution : File = \\ /path/to/fileList Also, sorry for the response time, I've tryed to upgrade my PC from kubuntu 8.10 to 9.04 and it fails... (seems that the raid1 setup has been lost at boot time) Thomas. On Tue, Apr 7, 2009 at 21:31, Arno Lehmann a...@its-lehmann.de wrote: Hi, 06.04.2009 23:58, Thomas Manson wrote: Hi, I'm trying to exclude a list of folder from the backup, but it didn't work (my backup is still huge as before) The fileset is defined like this : FileSet { Name = machine.domain.fr.FileSet Include { Options { signature = SHA1 compression = GZIP } File = /etc File = /home File = /usr/src/makeHttpd File = /root File = /backup/lastbackup } Exclude { File = /usr/local/bin/scripts/bacula/excludeFolderList/machine.domain_excludeFolderList.txt } } Something that perhaps doesn't help you now, but might later: Consider upgrading to 3.0 when released. It's got that feature built in. the local file (from the director point of view) /usr/local/bin/scripts/bacula/excludeFolderList/machine.domain_excludeFolderList.txt is generated with the following script find /home -name .bacula_exclude | sed 's/.bacula_exclude//' /root/scripts/bacula/excludeFolderList (and then copied from the client to the directory machine via a scp) which is executed as a Run Before Job. Do you see anything wrong ? Not necessarily wrong, though I admit I don't use excludes very often :-) I would rather execute the command to generate the exclude list on the client with the \| syntax. That at least ensures the list is always up to date. From the manual: If the vertical bar (|) in front of my_partitions is preceded by a backslash as in \|, the program will be executed on the Client's machine instead of on the Director's machine. Please note that if the filename is given within quotes, you will need to use two slashes. An example, provided by John Donagher, that backs up all the local UFS partitions on a remote system is: FileSet { Name = All local partitions Include { Options { signature=SHA1; onefs=yes; } File = \\|bash -c \df -klF ufs | tail +2 | awk '{print \$6}'\ } } Obviously, you'd exchange the df with your find | sed combination. Arno Thomas. -- Arno Lehmann IT-Service Lehmann Sandstr. 6, 49080 Osnabrück www.its-lehmann.de -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Folder Exclusion... didn't work
;) I think some time will ellapse until it's in ubuntu repository ? On Fri, Apr 10, 2009 at 01:26, John Drescher dresche...@gmail.com wrote: On Thu, Apr 9, 2009 at 7:07 PM, Thomas Manson dev.mansontho...@gmail.com wrote: I know that a feature is planned in the version3, but I need full backup now ;) bacula-3.0.0 has been released today. :) I'll be testing ebuilds on gentoo in 2 hours... John -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Folder Exclusion... didn't work
Hi, I'm trying to exclude a list of folder from the backup, but it didn't work (my backup is still huge as before) The fileset is defined like this : FileSet { Name = machine.domain.fr.FileSet Include { Options { signature = SHA1 compression = GZIP } File = /etc File = /home File = /usr/src/makeHttpd File = /root File = /backup/lastbackup } Exclude { File = /usr/local/bin/scripts/bacula/excludeFolderList/machine.domain_excludeFolderList.txt } } the local file (from the director point of view) /usr/local/bin/scripts/bacula/excludeFolderList/machine.domain_excludeFolderList.txt is generated with the following script find /home -name .bacula_exclude | sed 's/.bacula_exclude//' /root/scripts/bacula/excludeFolderList (and then copied from the client to the directory machine via a scp) which is executed as a Run Before Job. Do you see anything wrong ? Thomas. -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] regexdir stops bacula backup...
Ok, I've read a bit quickly your answer, and tonight Bacula backup 33Go of data (compressed) LOL... I'm gonna change my way of doing... instead of a complex bacula configuration, I'll move logs to another single location (for every website) instead of a logs directory per website. This server will soon be re installed and the way I manage website will change totally, that's why I don't want to spend much time on this (I've also a lot of other things to do and it's not my full time job) Thanks Martin for your help ! Thomas. On Tue, Mar 3, 2009 at 16:43, Martin Simmons mar...@lispworks.com wrote: On Tue, 3 Mar 2009 15:20:46 +0100, Thomas Manson said: Hi Martin, So I should do this : FileSet { Name = computer.domain.com.FileSet Include { Options { signature = SHA1 compression = GZIP *regexdir= /home/.*/web/public_html* } File = /etc File = /home/special/master File = /usr/src/makeHttpd File = /root File = /backup/databases/lastbackup *File = /home* } } Yes, that's a start. you need to exclude everything that doesn't match the regex and include all of the directories above /home/user1/web. Well, I've nothing to backup between / and /home/*/web What's the point of using regexdir if I have to exclude everything else ? That's just how it works. Bacula doesn't scan the whole world looking for something that matches the regexdir. Instead, it searches down the tree starting from the 'File =' lines looking for files to back up. To prevent something from being backed up, you must exclude it by using an Exclude section or by using options with 'exclude = yes'. See the *.gz example here: http://www.bacula.org/en/rel-manual/Configuring_Director.html#SECTION00148 When you exclude a directory, it doesn't look any further. Therefore, to back up selected subdirectories of /home/*, you need to make Bacula select all directories leading up to those you want to back up, without selecting any of ther contents. Something like this (not tested): Include { Options { signature = SHA1 compression = GZIP # include the dirs in /home regexdir = ^/home/[^/]+$ # and include the web dirs of them wilddir = /home/*/web # and the public_html dirs within the web dirs wilddir = /home/*/web/public_html # and the contents of the public_html wild = /home/*/web/public_html/* } Options { # exclude everything else Exclude = yes wild = /home/* } File = /home } __Martin For the fact that bacula FD stops with the regexp, I'll recheck, but I don't think their is something in the director's logs... Thomas. On Thu, Feb 26, 2009 at 21:44, Martin Simmons mar...@lispworks.com wrote: On Thu, 26 Feb 2009 10:00:26 +0100, Thomas Manson said: Nobody has an idea? Bacula uses the File lines as the roots when it looks for files and none of yours are going to find files in /home/user1 etc. Also, you can't do what you want directly with a single Options clause -- you need to exclude everything that doesn't match the regex and include all of the directories above /home/user1/web. Crashing is unexpected though. What does the Bacula log say? Can you repeat it on a local machine without the ssh tunnel? __Martin On Tue, Feb 24, 2009 at 22:19, Thomas Manson dev.mansontho...@gmail.com wrote: I forgot to mention the bacula version : server : 2.4.2-1ubuntu6 client : Redhat ES4 with version : bacula-client-2.4.2-1.el4.i386.rpm Thomas On Tue, Feb 24, 2009 at 22:16, Thomas Manson dev.mansontho...@gmail.comwrote: Hi, I want to backup this kind of directories : /home/user1/web/public_html /home/user2/web/public_html /home/user3/web/public_html /home/user4/web/public_html and subdirectories. I've run a find to list all dir of the home directory and test the following regexp on it with success : /home/.*/web/public_html (with quote in the configuration file). When I run the backup, the job crashes : My SSH tunnel is stopped and when I run another backup, it tells me that the last volume do not have the correct number of byte (can't remember the exact message). If I comment the regexdir, it works normally. here is the fileSet : FileSet { Name = computer.domain.com.FileSet Include { Options { signature = SHA1 compression = GZIP #regexdir= /home/.*/web/public_html } File = /etc File = /home/special/master File = /usr/src/makeHttpd File = /root File = /backup/databases/lastbackup } } Any idea of how I can see what's going wrong? Thx
Re: [Bacula-users] regexdir stops bacula backup...
Well finally I think I'll need the regexdir to exclude some cache directory inside website that are huge ;) You didn't work for nothgin Martin ;) Thanks, Thomas. On Wed, Mar 4, 2009 at 11:19, Thomas Manson dev.mansontho...@gmail.comwrote: Ok, I've read a bit quickly your answer, and tonight Bacula backup 33Go of data (compressed) LOL... I'm gonna change my way of doing... instead of a complex bacula configuration, I'll move logs to another single location (for every website) instead of a logs directory per website. This server will soon be re installed and the way I manage website will change totally, that's why I don't want to spend much time on this (I've also a lot of other things to do and it's not my full time job) Thanks Martin for your help ! Thomas. On Tue, Mar 3, 2009 at 16:43, Martin Simmons mar...@lispworks.com wrote: On Tue, 3 Mar 2009 15:20:46 +0100, Thomas Manson said: Hi Martin, So I should do this : FileSet { Name = computer.domain.com.FileSet Include { Options { signature = SHA1 compression = GZIP *regexdir= /home/.*/web/public_html* } File = /etc File = /home/special/master File = /usr/src/makeHttpd File = /root File = /backup/databases/lastbackup *File = /home* } } Yes, that's a start. you need to exclude everything that doesn't match the regex and include all of the directories above /home/user1/web. Well, I've nothing to backup between / and /home/*/web What's the point of using regexdir if I have to exclude everything else ? That's just how it works. Bacula doesn't scan the whole world looking for something that matches the regexdir. Instead, it searches down the tree starting from the 'File =' lines looking for files to back up. To prevent something from being backed up, you must exclude it by using an Exclude section or by using options with 'exclude = yes'. See the *.gz example here: http://www.bacula.org/en/rel-manual/Configuring_Director.html#SECTION00148 When you exclude a directory, it doesn't look any further. Therefore, to back up selected subdirectories of /home/*, you need to make Bacula select all directories leading up to those you want to back up, without selecting any of ther contents. Something like this (not tested): Include { Options { signature = SHA1 compression = GZIP # include the dirs in /home regexdir = ^/home/[^/]+$ # and include the web dirs of them wilddir = /home/*/web # and the public_html dirs within the web dirs wilddir = /home/*/web/public_html # and the contents of the public_html wild = /home/*/web/public_html/* } Options { # exclude everything else Exclude = yes wild = /home/* } File = /home } __Martin For the fact that bacula FD stops with the regexp, I'll recheck, but I don't think their is something in the director's logs... Thomas. On Thu, Feb 26, 2009 at 21:44, Martin Simmons mar...@lispworks.com wrote: On Thu, 26 Feb 2009 10:00:26 +0100, Thomas Manson said: Nobody has an idea? Bacula uses the File lines as the roots when it looks for files and none of yours are going to find files in /home/user1 etc. Also, you can't do what you want directly with a single Options clause -- you need to exclude everything that doesn't match the regex and include all of the directories above /home/user1/web. Crashing is unexpected though. What does the Bacula log say? Can you repeat it on a local machine without the ssh tunnel? __Martin On Tue, Feb 24, 2009 at 22:19, Thomas Manson dev.mansontho...@gmail.com wrote: I forgot to mention the bacula version : server : 2.4.2-1ubuntu6 client : Redhat ES4 with version : bacula-client-2.4.2-1.el4.i386.rpm Thomas On Tue, Feb 24, 2009 at 22:16, Thomas Manson dev.mansontho...@gmail.comwrote: Hi, I want to backup this kind of directories : /home/user1/web/public_html /home/user2/web/public_html /home/user3/web/public_html /home/user4/web/public_html and subdirectories. I've run a find to list all dir of the home directory and test the following regexp on it with success : /home/.*/web/public_html (with quote in the configuration file). When I run the backup, the job crashes : My SSH tunnel is stopped and when I run another backup, it tells me that the last volume do not have the correct number of byte (can't remember the exact message). If I comment the regexdir, it works normally. here is the fileSet : FileSet { Name = computer.domain.com.FileSet Include { Options { signature = SHA1 compression = GZIP #regexdir= /home
Re: [Bacula-users] mark a directory to be excluded from backup
Hi Thomas, Thanks for the tip, even If I need to update the director conf file each time I add a website, it's easy enough to be usable. Thanks again, Thomas. On Wed, Mar 4, 2009 at 14:45, Thomas tho...@ic3s.de wrote: Thomas Manson schrieb: Hi, I wonder if it is possible to mark a directory to be exclude from the backup by another mean that the bacula-dir.conf. Here we have a centralized configuration for what is to be backup, while I think a distributed configuration would be more efficient and easy to handle (Ok, not in every case, but in my case I don't get why the director should know every thing about it's clients file system) For example, if a directory would contain an empty file .bacula_exclude_dir own by a specific user, the file daemon would not backup this dir even if inside a directory mention with a File= this can be easily done by something like: find /home/thomas/test/ -name .exclude | sed 's/.exclude//' /home/thomas/test/excludelist and then specify Exclude { File = \\/home/thomas/test/excludelist } in the Fileset. you can configure the includelist in the same way on the client. Or a file like the robot.txt that one left for search engines so they know what to index and what not. If the filedaemon find a file like .bacula_directives, it would follow that list of directives for all subdir of the current dir. Or even a configuration file for the file daemon. It's easier to modifiy (with scripts) a conf file on the client, that to automatically update the director conf file from the client (quite impossible in fact). Ok, it's a bit intrusive, but as far as I know bacula, if the only way to exclude a directory is to write some complex config in bacula-dir.conf, it's very cumbersome ! In my case, on the machine I add very often new websites, each one with specific structure with some files to be backup some not. this would lead to huge config file or huge amount of data backuped for nothing... What do you think about that? Thomas. -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- [:O]###[O:] -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] mark a directory to be excluded from backup
Yes, that sounds good ;) I'll set a cron job that get the exclude file list on each client with scp before the backup job. Thomas. On Wed, Mar 4, 2009 at 15:40, John Drescher dresche...@gmail.com wrote: Hi Thomas, Thanks for the tip, even If I need to update the director conf file each time I add a website, it's easy enough to be usable. Thanks again, Thomas. In this method you should just update the external file. Unless the new website is not in the path of the include fileset already. John -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] mark a directory to be excluded from backup
Yes exactly ! But I'll keep to the version of bacula shipped in ubuntu repo (safer). Thanks for the info. Thomas. On Wed, Mar 4, 2009 at 16:02, Dan Langille d...@langille.org wrote: Thomas Manson wrote: Hi, I wonder if it is possible to mark a directory to be exclude from the backup by another mean that the bacula-dir.conf. Here we have a centralized configuration for what is to be backup, while I think a distributed configuration would be more efficient and easy to handle (Ok, not in every case, but in my case I don't get why the director should know every thing about it's clients file system) For example, if a directory would contain an empty file .bacula_exclude_dir own by a specific user, the file daemon would not backup this dir even if inside a directory mention with a File= Well, FWIW, this is implemented, but not released. See http://www.bacula.org/manuals/en/concepts/concepts/New_Features.html Look for Exclude Dirs Containing Now in the SVN version, coming soon to a release near you. Is this what you're looking for? -- Dan Langille BSDCan - The Technical BSD Conference : http://www.bsdcan.org/ PGCon - The PostgreSQL Conference: http://www.pgcon.org/ -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] regexdir stops bacula backup...
Hi Martin, So I should do this : FileSet { Name = computer.domain.com.FileSet Include { Options { signature = SHA1 compression = GZIP *regexdir= /home/.*/web/public_html* } File = /etc File = /home/special/master File = /usr/src/makeHttpd File = /root File = /backup/databases/lastbackup *File = /home* } } you need to exclude everything that doesn't match the regex and include all of the directories above /home/user1/web. Well, I've nothing to backup between / and /home/*/web What's the point of using regexdir if I have to exclude everything else ? For the fact that bacula FD stops with the regexp, I'll recheck, but I don't think their is something in the director's logs... Thomas. On Thu, Feb 26, 2009 at 21:44, Martin Simmons mar...@lispworks.com wrote: On Thu, 26 Feb 2009 10:00:26 +0100, Thomas Manson said: Nobody has an idea? Bacula uses the File lines as the roots when it looks for files and none of yours are going to find files in /home/user1 etc. Also, you can't do what you want directly with a single Options clause -- you need to exclude everything that doesn't match the regex and include all of the directories above /home/user1/web. Crashing is unexpected though. What does the Bacula log say? Can you repeat it on a local machine without the ssh tunnel? __Martin On Tue, Feb 24, 2009 at 22:19, Thomas Manson dev.mansontho...@gmail.com wrote: I forgot to mention the bacula version : server : 2.4.2-1ubuntu6 client : Redhat ES4 with version : bacula-client-2.4.2-1.el4.i386.rpm Thomas On Tue, Feb 24, 2009 at 22:16, Thomas Manson dev.mansontho...@gmail.comwrote: Hi, I want to backup this kind of directories : /home/user1/web/public_html /home/user2/web/public_html /home/user3/web/public_html /home/user4/web/public_html and subdirectories. I've run a find to list all dir of the home directory and test the following regexp on it with success : /home/.*/web/public_html (with quote in the configuration file). When I run the backup, the job crashes : My SSH tunnel is stopped and when I run another backup, it tells me that the last volume do not have the correct number of byte (can't remember the exact message). If I comment the regexdir, it works normally. here is the fileSet : FileSet { Name = computer.domain.com.FileSet Include { Options { signature = SHA1 compression = GZIP #regexdir= /home/.*/web/public_html } File = /etc File = /home/special/master File = /usr/src/makeHttpd File = /root File = /backup/databases/lastbackup } } Any idea of how I can see what's going wrong? Thx, Thomas. -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] regexdir stops bacula backup...
Nobody has an idea? On Tue, Feb 24, 2009 at 22:19, Thomas Manson dev.mansontho...@gmail.comwrote: I forgot to mention the bacula version : server : 2.4.2-1ubuntu6 client : Redhat ES4 with version : bacula-client-2.4.2-1.el4.i386.rpm Thomas On Tue, Feb 24, 2009 at 22:16, Thomas Manson dev.mansontho...@gmail.comwrote: Hi, I want to backup this kind of directories : /home/user1/web/public_html /home/user2/web/public_html /home/user3/web/public_html /home/user4/web/public_html and subdirectories. I've run a find to list all dir of the home directory and test the following regexp on it with success : /home/.*/web/public_html (with quote in the configuration file). When I run the backup, the job crashes : My SSH tunnel is stopped and when I run another backup, it tells me that the last volume do not have the correct number of byte (can't remember the exact message). If I comment the regexdir, it works normally. here is the fileSet : FileSet { Name = computer.domain.com.FileSet Include { Options { signature = SHA1 compression = GZIP #regexdir= /home/.*/web/public_html } File = /etc File = /home/special/master File = /usr/src/makeHttpd File = /root File = /backup/databases/lastbackup } } Any idea of how I can see what's going wrong? Thx, Thomas. -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] regexdir stops bacula backup...
Hi, I want to backup this kind of directories : /home/user1/web/public_html /home/user2/web/public_html /home/user3/web/public_html /home/user4/web/public_html and subdirectories. I've run a find to list all dir of the home directory and test the following regexp on it with success : /home/.*/web/public_html (with quote in the configuration file). When I run the backup, the job crashes : My SSH tunnel is stopped and when I run another backup, it tells me that the last volume do not have the correct number of byte (can't remember the exact message). If I comment the regexdir, it works normally. here is the fileSet : FileSet { Name = computer.domain.com.FileSet Include { Options { signature = SHA1 compression = GZIP #regexdir= /home/.*/web/public_html } File = /etc File = /home/special/master File = /usr/src/makeHttpd File = /root File = /backup/databases/lastbackup } } Any idea of how I can see what's going wrong? Thx, Thomas. -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] regexdir stops bacula backup...
I forgot to mention the bacula version : server : 2.4.2-1ubuntu6 client : Redhat ES4 with version : bacula-client-2.4.2-1.el4.i386.rpm Thomas On Tue, Feb 24, 2009 at 22:16, Thomas Manson dev.mansontho...@gmail.comwrote: Hi, I want to backup this kind of directories : /home/user1/web/public_html /home/user2/web/public_html /home/user3/web/public_html /home/user4/web/public_html and subdirectories. I've run a find to list all dir of the home directory and test the following regexp on it with success : /home/.*/web/public_html (with quote in the configuration file). When I run the backup, the job crashes : My SSH tunnel is stopped and when I run another backup, it tells me that the last volume do not have the correct number of byte (can't remember the exact message). If I comment the regexdir, it works normally. here is the fileSet : FileSet { Name = computer.domain.com.FileSet Include { Options { signature = SHA1 compression = GZIP #regexdir= /home/.*/web/public_html } File = /etc File = /home/special/master File = /usr/src/makeHttpd File = /root File = /backup/databases/lastbackup } } Any idea of how I can see what's going wrong? Thx, Thomas. -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-fd starts and then crash (leaving an empty file in /var/lock/subsys/bacula-fd)
Hi John This machine is backuped up by a SSH tunnul. When Director backup this client, it creates a ssh tunnel, with the needed port tunneling. This configuration works on another machine prefectly. See this howto : http://wiki.bacula.org/doku.php?id=sshtunnel Just to give a try, I did set the public IP of the client, and it gives the same results : [r...@dell1 ~]# service bacula-fd start Starting Bacula File services: [ OK ] [r...@dell1 ~]# service bacula-fd status bacula-fd dead but subsys locked Thomas. On Wed, Feb 18, 2009 at 04:58, John Drescher dresche...@gmail.com wrote: On Tue, Feb 17, 2009 at 10:54 PM, John Drescher dresche...@gmail.com wrote: FileDaemon { # this is me Name= client.bacula.com-fd FDport = 9102 # where we listen for the director WorkingDirectory= /var/lib/bacula Pid Directory = /var/run/bacula Maximum Concurrent Jobs = 20 FDAddress = 127.0.0.1 } With 127.0.0.1 you will not be able to the fd. I mean this will only work if this is also the machine with the director and SD. That did not come out right. Use the external IP address network communication between the fd and sd and the fd and director will not work with 127.0.0.1 unless the director and SD run on the same machine. John -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-fd starts and then crash (leaving an empty file in /var/lock/subsys/bacula-fd)
Hi John, I've extracted the command executed by the init.d/bacula-fd script which is (without daemon) and it ouputs nothing : [r...@dell1 temp]# /usr/sbin/bacula-fd -u root -g bacula -c /etc/bacula/bacula-fd.conf [r...@dell1 temp]# echo $? 0 [r...@dell1 temp]# It doesn't seem to have verbose option on the bacula-fd exec. Thomas. On Wed, Feb 18, 2009 at 14:40, John Drescher dresche...@gmail.com wrote: On Wed, Feb 18, 2009 at 5:20 AM, Thomas Manson dev.mansontho...@gmail.com wrote: Hi John This machine is backuped up by a SSH tunnul. Sorry then ignore my comment. Can you run the fd from the shell? It should tell you if it has a problem. John -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-fd starts and then crash (leaving an empty file in /var/lock/subsys/bacula-fd)
bacula-fd: filed_conf.c:438-0 Inserting director res: machine.FQDN-mon 18-Feb 15:10 machine.FQDN-fd: ERROR TERMINATION at bsys.c:508 Could not open pid file. /var/run/bacula/bacula-fd.9102.pid ERR=No such file or directory :o))) the rpm did not create that directory. I've created it and now it works : [r...@dell1 temp]# service bacula-fd start Starting Bacula File services: [ OK ] [r...@dell1 temp]# service bacula-fd status bacula-fd (pid 21203) is running... Thanks John ! Thomas. On Wed, Feb 18, 2009 at 14:57, John Drescher dresche...@gmail.com wrote: On Wed, Feb 18, 2009 at 8:48 AM, Thomas Manson dev.mansontho...@gmail.com wrote: Hi John, I've extracted the command executed by the init.d/bacula-fd script which is (without daemon) and it ouputs nothing : [r...@dell1 temp]# /usr/sbin/bacula-fd -u root -g bacula -c /etc/bacula/bacula-fd.conf [r...@dell1 temp]# echo $? 0 [r...@dell1 temp]# It doesn't seem to have verbose option on the bacula-fd exec. Add: -d 100 this will dump debug info. John -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula-fd starts and then crash (leaving an empty file in /var/lock/subsys/bacula-fd)
Hi, I try to install a client on a Redhat ES 4. I've installed this rpm : bacula-client-2.4.2-1.el4.i386.rpm I've udpated the configuration file for the client to this : Director { Name = home.bacula.com-dir Password = thepwd } # # Restricted Director, used by tray-monitor to get the # status of the file daemon # Director { Name = home.bacula.com-mon Password = thepwd Monitor = yes } # # Global File daemon configuration specifications # FileDaemon { # this is me Name= client.bacula.com-fd FDport = 9102 # where we listen for the director WorkingDirectory= /var/lib/bacula Pid Directory = /var/run/bacula Maximum Concurrent Jobs = 20 FDAddress = 127.0.0.1 } Messages { Name = Standard director = home.bacula.com-dir = all, !skipped, !restored } (name password changed) When I start bacula-fd (service bacula-fd start) It says OK, but crahses just after service bacula-fd status gives : [r...@cllient bacula]# service bacula-fd status bacula-fd dead but subsys locked I can't see no log in /var/log/messages... Any Idea ? Thomas. PS : My Server version is 2.4.2-1ubuntu6 on ubuntu 8.10 -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Ubuntu 8.10 Bacula out of the box is not working...
Hi, I've setup a vmware instance with ubuntu 8.10 installed, and then installed bacual (2.4.2) with mysql as DBMS. The 3 services are running (dir, fd, sd) and I can connect to bconsole with no error. But in bconsole, if I try *status all I get a timeout error. I've checked the configuraition files and passwords (generated by ubunutu installer) seems to match between files. Any idea of what's going wrong ? Thomas -- Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) software. With Adobe AIR, Ajax developers can use existing skills and code to build responsive, highly engaging applications that combine the power of local resources and data with the reach of the web. Download the Adobe AIR SDK and Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Ubuntu 8.10 Bacula out of the box is not working...
Thanks John, I'm checking that. I've replaced 127.0.0.1 by the ip address 192.168.0.14 and added in my /etc/hosts a line that makes the machine name points to 192.168.0.1. status all is now working ;o) I can start to play with job/device/pool/schedule ! I've a question regarding the IP. My server on which Director will be running has a private address (192.168.0.1) (behind a router). I've a fixed public IP, and doing nat for many application protocol. I plan to use ssh tunnel to backup remote client (which are on other physical site with only ssh accissible) What IP should I then put for the director ? Thomas. On Tue, Feb 10, 2009 at 21:58, John Drescher dresche...@gmail.com wrote: n the configuration files and replace this with the real ip address. If there were any restart the services. -- Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) software. With Adobe AIR, Ajax developers can use existing skills and code to build responsive, highly engaging applications that combine the power of local resources and data with the reach of the web. Download the Adobe AIR SDK and Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Ubuntu 8.10 Bacula out of the box is not working...
Thx Kevin, I'll look at your doc. THomas On Tue, Feb 10, 2009 at 22:23, Kevin Keane subscript...@kkeane.com wrote: Funny that you mention that. I just put an article about setting up bacula through an SSH tunnel yesterday in the bacula Wiki. http://wiki.bacula.org/doku.php?id=sshtunnel It sounds like your setup is very similar to what I am using, so this solution is likely going to work quite well for you. Thomas Manson wrote: Thanks John, I'm checking that. I've replaced 127.0.0.1 by the ip address 192.168.0.14 and added in my /etc/hosts a line that makes the machine name points to 192.168.0.1. status all is now working ;o) I can start to play with job/device/pool/schedule ! I've a question regarding the IP. My server on which Director will be running has a private address (192.168.0.1) (behind a router). I've a fixed public IP, and doing nat for many application protocol. I plan to use ssh tunnel to backup remote client (which are on other physical site with only ssh accissible) What IP should I then put for the director ? -- Kevin Keane Owner The NetTech Find the Uncommon: Expert Solutions for a Network You Never Have to Think About Office: 866-642-7116 http://www.4nettech.com This e-mail and attachments, if any, may contain confidential and/or proprietary information. Please be advised that the unauthorized use or disclosure of the information is strictly prohibited. The information herein is intended only for use by the intended recipient(s) named above. If you have received this transmission in error, please notify the sender immediately and permanently delete the e-mail and any copies, printouts or attachments thereof. -- Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) software. With Adobe AIR, Ajax developers can use existing skills and code to build responsive, highly engaging applications that combine the power of local resources and data with the reach of the web. Download the Adobe AIR SDK and Ajax docs to start building applications today- http://p.sf.net/sfu/adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) software. With Adobe AIR, Ajax developers can use existing skills and code to build responsive, highly engaging applications that combine the power of local resources and data with the reach of the web. Download the Adobe AIR SDK and Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Setup advices for some heterogenous set of server
Hi Arno, Thanks for your answers, and sorry for the delay to answer back. To answer your questions : I've control (directly or indirectly) of the firewall, but I'd rather use a ssh tunnels. My homeServer has access to other servers with certificate authentication. I can set explicit rule to the firewall to allow acces to the needed port, but ssh is better on security concern. Btw, when compression is done ? by the client or by the storage? because, in this last case, ssh built in compression could be a nice help. Each blue 'backbone' on the schema represents a /24 network and all servers are in this subnet. All server has public IP address and an FQDN. Over the servers, the amount of data should not be that uge (only website, configuration script, no logfile or mail inbox). In case of machine crash, each machine setup is documented, so that to resume the service, I've to reinstall the system (less than an hour for the secondary DNS server) and restore data. Each machine have or will have a mirror server on another physical site. It's probably not the best solution, but given my mean, I can only afford that solution. I also wanted to set this kind of backup : 1 mounthly full backup of the file system. 1 daily incremental backup of the filesystem. 1 daily full backup of databases. because, in my case, the filesystem isn't modifyed heavily, most of the udpates are done in the databases. I think it's suitable for my specific case, but there are maybe some convients I didn't see About the setup itself : The more I read, the more I get confused... the doc is not easy to get a simple and working configuration. I've read more than 150 pages, and still have no concrete material to configure a simple setup... I'm quite found of learning by example, which you usually find for every software, but here... not that much indeed... the only tuto I've found : http://www.debianhelp.co.uk/bacula1.htm doesn't explain really much things. What I'd like, is to 1/ enable a working backup on the homeServer (director hosting) test it, play with it with some simple test case like : make a backup of a directory, delete (or move outside the dir) one file in the directory, restore the file. make a backup of a directory modify a file make a incremental backup modify the same file make a incremental backup modify the same file walk though the different 'version' of this file. It would be nice, if bacula team could setup a vmware using a linux distro like ubuntu with several test case pre-setup to speed up the learning curve. 2/ Once I've setup the backup for the server, add a remote client (through ssh) (and next add all others) I find it better to have on directory per client (can't explain why, but sounds safer), I've read the basic volume managment chapter which tell I should add a device per client with a Type per Device so that everything isn't mixed up. Well I'll explore this later.. I'll try now to get something working on the homeServer itself. tomorrow, I'll probably setup a ubuntu on vmware to practice some test case and may publish it on my blog (well the size of the vmware could be an issue ;o) Thomas. On Wed, Feb 4, 2009 at 11:30, Arno Lehmann a...@its-lehmann.de wrote: Hello, 03.02.2009 13:44, Thomas Manson wrote: Hi, I've read quite some stuff about bacula, but I'm still not sure of the best way to implement it. I've attached a simple diagram that represent the network as it will soon be. (DNS Server 1 and WebServer 2 are not yet setup). On each server of the left side, the host provider gives 160GB of disk on FTP. The Home Server is the server that will run the Backup Director. Over internet, servers can communicate via SSH. Additionnal port can be opened, but I'd rather not. You can tunnel any connection where you can specify the host and port to use through ssh. In Bacula, you could set up the tunnels using a run before job script. A regular VPN might be easier to maintain, though harder to set up. HomeServer and Office Server has an 1MByte/s download and 100KByte/s upload capabilities. That's a bit limited for backup purposes of large data sets. Other Servers have more the 50MByte/s upload capabilities For WebServer1 3, and Office Server, I've no other solution that get backup to HomeServer. For other servers, I've the 160GB disks available, but I'm not sure of their reliabality (Probably not raid 1 or 5 device, who can access). Any thought, advice? Well, it's quite important to know where you want your backups to end up. Assuming you want them all consolidated on the HomeServer, you'd need some VPN/ssh tunnels to all the servers you want to back up. Once those exist, it's a rather standard situation to set up Bacula accordingly. If you need to keep backup data on te different sites because of the traffic limitations