Re: [Bacula-users] Multiple external HDDs as backup media
Tony Whitmore wrote: Hi, I've been working on using Bacula on our site (~500 PCs) for the last week or so, and have made great progress on test systems. I'll be backing up about 7 or 8 servers once it's all up and running. On the proper backup system I will be using 200GB USB2 external HDDs as the stoarge medium. (We already have these as part of our existing backup system.) These will be plugged into the Bacula server (which is running the director, database and storage daemons). I want to be able to use the HDDs one at a time - i.e. have one HDD out and the others locked in the safe. What I'm not too sure on is how to configure Bacula to live with the scenario, as potentially each HDD could occupy the same device node and mount point. From what I can see, it could get confused about the absence of certain volumes, as there would be no apparent difference between the drives once they are mounted - apart from their contents, of course. I read in the manual section referring to multiple tape drives about creating a series of symlinks in a directory to point to a number of different volumes - would this be appropriate here? Would Bacula be able to cope with the absence of a drive and prompt for its connection? Or is there a better approach of managing this scenario? I am running Bacula on Debian Sarge, using the stock Debian version of the software. Thanks in advance, Tony Whitmore Hi Tony, I had the same problem you have some 1,5 years ago. Here are the scripts I used to work around it (made to work on a Mandrake/Mandriva system): We make full backups every time. If you want to work with incremental backups, you should make two pools. One for the full backups and one for the incrementals. You can write the incrementals of the previous week on the USB-disk of the full backup of the next week. Each disk will then contain two volume files. In our case each disk contains only one volume file which is what we recognize it by. #!/bin/bash # # shell script to finalize USB backup volumename=$1 echoCreating mount points, if they don't exist if ! [ -d /mnt/usbdrv ] ; then mkdir /mnt/usbdrv fi if ! [ -d /mnt/usbdrv/bacula ] ; then mkdir /mnt/usbdrv/bacula fi if ! [ -d /mnt/usbdrv/misc ] ; then mkdir /mnt/usbdrv/misc fi #unmount all mount points related to USB echoMaking sure no USB devices are mounted umount /mnt/usbdrv umount /mnt/usbdrv/bacula umount /mnt/usbdrv/misc umount /mnt/removable umount /mnt/removable2 umount /mnt/removable3 #determine which /dev/sd? contains the right USBVolume for this backup echoDetermining whether the right USB device containing our USBVolume is present physically found=nothing for i in sda sdb sdc sdd sde; do sd=$i1 echoTrying with $sd mount /dev/$sd /mnt/usbdrv/bacula -t ext2 ls -al /mnt/usbdrv/bacula if [ -f /mnt/usbdrv/bacula/$volumename ] ; then found=/dev/$i fi umount /mnt/usbdrv/bacula done echo echo Found: $found containing $volumename echo if [ $found != nothing ] ; then # mount /mnt/usbdrv/bacula and /mnt/usbdrv/misc on /dev/sd?1 and /dev/sd?5 respectively mount $found1 /mnt/usbdrv/bacula -t ext2 mount $found5 /mnt/usbdrv/misc -t vfat # copy Ghost images of Windows system drives, the contents of /etc/bacula/* # and a text file with restore instructions to /mnt/usbdrv/misc echoCopying Ghost image of TOSFEB31 to /mnt/usbdrv/misc cp -v /mnt/Ghost/PROD/TOSFEB31/SYSTEM.GHO /mnt/usbdrv/misc echoCopying Ghost image of TOSFEB32 to /mnt/usbdrv/misc cp -v /mnt/Ghost/PROD/TOSFEB32/COFTF32.GHO /mnt/usbdrv/misc echoCopying /etc/bacula to /mnt/usbdrv/misc cp -Rfv /etc/bacula/ /mnt/usbdrv/misc echoCopying Restore instructions to /mnt/usbdrv/misc cp -v /etc/bacula/How_To_Restore.txt /mnt/usbdrv/misc # copy the current USBVolume to /mnt/usbdrv/bacula overwriting the previous volume file echo echoCopying Bacula USB-volume to /mnt/usbdrv/bacula cp -fv /mnt/spool/$volumename /mnt/usbdrv/bacula # give some feedback about what was done echo echoDirectory contents of /mnt/usbdrv/bacula ls -al /mnt/usbdrv/bacula echo echoDirectory contents of /mnt/usbdrv/misc ls -al /mnt/usbdrv/misc # unmount /mnt/usbdrv/bacula and /mnt/usbdrv/misc echo echoDirectory contents of /mnt/usbdrv/misc ls -al /mnt/usbdrv/misc # unmount /mnt/usbdrv/bacula and /mnt/usbdrv/misc echo echoUnmounting /mnt/usbdrv/... mount points umount /mnt/usbdrv/bacula umount /mnt/usbdrv/misc else # send emails if correct medium is not present # /usr/sbin/smtp echo hello fi # This is run as a RunAfterJob of the catalog backup. It already had a RunAfterJob, so we execute that here /etc/bacula/delete_catalog_backup This one I use as an admin job on Friday, before our weekly backup gets written: #!/bin/bash # # shell script to check which USB volume is connected. volumename=$1 echoCreating mount points, if they don't exist if ! [ -d /mnt/usbdrv ] ;
Re: [Bacula-users] Re: Backup of directory structures
On Monday 27 June 2005 22:24, Martin Simmons wrote: On Mon, 20 Jun 2005 10:20:49 +0200, Arno Lehmann [EMAIL PROTECTED] said: Arno Hello, Arno Siju George wrote: On 6/20/05, Siju George [EMAIL PROTECTED] wrote: Hi, I am looking at Bacula but the line # Files deleted after a Full save will be included in a restoration. in http://www.bacula.org/rel-manual/Current_State_Bacula.html under Current Implementation Restrictions makes me a little apprhensive. Is Bacula actually not able to backup Directory structures?? i.e If in a Directory dir1 I have file1, file2 file3 and I take a full backup backup1 on Day1 the I delete file2 from dir1 and take a differential backup backup2. Now I should be able to restore dir1 from backup2 with only file1 and file2 Sorry :-( this should read as file1 file3 Arno You _can_ restore file1 file2 and file3 in dir1. However, when you use Arno bacula to manage a restore and tell it to make a complete restore it Arno will restore all three files. Arno If you tell bacula to only use the differential backup then, of course, Arno file2 will not be restored. Usually you will not do this because it's Arno baculas job to keep track which jobs and volumes it needs to restore :-) Arno So, of course bacula saves and retrieves directory structure, but it Arno does not keep track of deletions. Arno The latter would require a complete compare of all directory entries to Arno be backed up with what bacula has in its catalog and thus would be very Arno resource intensive. One day in the near future, I will do exactly this. I've now finally figured out a simple way to do this -- but darn, I forgot to write it down. Oh well, it will come to me again :-) Done correctly, it should be possible to do all the work in restore for filesystems that work properly. Backup just has to record the inode number for each changed file. The problem is that inode is a machine specific concept. Though it can be simulated, it doesn't exist on Win32 or Mac (well perhaps on OS X). Though this would work nicely as you say, I always like to do things in machine independent ways. __Martin --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Best regards, Kern ( /\ V_V --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Help with SD error
On Monday 27 June 2005 10:19, Stephan Heine - [Genetic Interactive] wrote: Hi, First off. Thank you for a fantastic backup solution. Secondly, sorry for the long post. The bacula configuration runs perfectly at his client's site, backing up about 15 clients. Flawlessly. Yesterday I included a new client into the backup that is a AMD system that runs NVidia based gigabit NIC. This system has no trouble receiving DHCP, drops no packets and communicates to the rest of the network perfectly. What OS is the client PC running? Have you looked through the systems logs for any clues? You could try setting the debuglevel on the fd to a high value, 500 is the one I see on the lists most frequently. Here is my problem. The backup fails (mostly early into the backup) everytime with the errors below. I have thought that it must be that onboard NIC because if I install a Realtek based NIC it works perfectly. The board was swopped but the problem persists. Error status is received: *messages 27-Jun-2005 10:04 backer-dir: No prior Full backup Job record found. 27-Jun-2005 10:04 backer-dir: No prior or suitable Full backup found. Doing FULL backup. 27-Jun-2005 10:04 backer-dir: Start Backup JobId 4932, Job=OctaneDocs.2005-06-27_10.04.47 27-Jun-2005 10:04 backer-sd: Volume octanedocsfull_0001 previously written, moving to end of data. 27-Jun-2005 10:05 octane-fd: OctaneDocs.2005-06-27_10.04.47 Fatal error: ..\filed\../../filed/backup.c:498 Network send error to SD. ERR=An existing connection was forcibly closed by the remote host. 27-Jun-2005 10:05 backer-dir: OctaneDocs.2005-06-27_10.04.47 Error: Bacula 1.36.0 (20Oct04): 27-Jun-2005 10:05 SNIP And another time: *messages 27-Jun-2005 11:11 backer-dir: Start Backup JobId 4933, Job=OctaneDocs.2005-06-27_11.11.41 27-Jun-2005 11:12 octane-fd: OctaneDocs.2005-06-27_11.11.41 Fatal error: ..\filed\../../filed/backup.c:472 Network send error 77 to SD. ERR=An existing connection was forcibly closed by the remote host. 27-Jun-2005 11:12 backer-dir: OctaneDocs.2005-06-27_11.11.41 Error: Bacula 1.36.0 (20Oct04): 27-Jun-2005 11:12 SNIP What I have also noticed is that the status on the SD reports that it is still busy and occupies the attention of the SD. This makes subsequent backups to this device fail. If the SD is restarted and a different job is run it is perfect. backer-sd Version: 1.36.0 (20 October 2004) i686-redhat-linux-gnu redhat (Tettnang) Daemon started 27-Jun-05 11:13, 0 Jobs run since started. Running Jobs: Full Backup job OctaneDocs JobId=4934 Volume=octanedocsfull_0001 device=/arch/backup/full/docs Files=4 Bytes=835 Bytes/sec=15 FDReadSeqNo=31 in_msg=22 out_msg=5 fd=6 Device status: Device /arch/backup/full/docs is mounted with Volume octanedocsfull_0001 Total Bytes=1 Blocks=0 Bytes/block=1 Positioned at File=0 Block=0 Device /arch/backup/full/mail is not open. Please point me in the right direction. Yours sincerely Stephan Heine Support Engineer Genetic Interactive Tel: +27 861 99 88 99 Fax: +27 861 99 77 99 Cell: +27 82 467 1164 EMail: [EMAIL PROTECTED] --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Dominic GoodforBusiness.co.uk I.T. Services for SMEs in the UK. --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Re: hesitation between incremental and differential backup
Thanks for your answer. That depends on the amount of data changed between backup runs, how much time you want to spend during backup, and how much you want to strain the SD and DIR during a restore - The amount of data changed is quite reasonable. Furthermore the backup is made via a gigabit lan on hard disks (no tape). with differentials, you always only need the last full and the desired differential backup, while with incrementals up to 10 volumes could be necessary. I don't understand the difference of bacula management between incr and diff. Arno Regards, Romain --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Tr : hello, I send you my Email, because I cant' acces (why?) to bacula-users@lists.sourceforge.net
***
SUBJECT : autoprune before running backup
job
BODY :
Hi,
first of all, all french, so my english
is like it is, sorry.
I've installed bacula, which is running
fine ;-)... but I'have a parameter problem. I want to make a daily full
backup one daily tape (the monday backup on the monday tape, the tuesday
backup on the tuesday tape, etc...) BUT I want if I forgot to change the
tape, it takes the tape which is in the computer : the day Before tape
!
So, I configure the storage like this
:
Pool {
Name=toto
Use
Volume >
Pool
Type = Backup
Recycle
= yes
AutoPrune
= yes
Volume
retention = 12h
Accept
Any Volume = yes
}
But bacula try the autoprune AFTER the
backup, so the tapes are never automatically recycle. If, when I put a
new tape I send a prune command, bacula work fine, but if I don't
send this command the backup job fails saying there is no avalaible tape.
thank you for your help.
Bruno DARMET
Re: [Bacula-users] Tr : hello, I send you my Email, because I cant' acces (why?) to bacula-users@lists.sourceforge.net
Hello,
well, first of all, your English is good enough - meilleur que mon
francais :-)
If you have problems subscribing to the mailing list, I suggest you
first retry after a day or so, second carefully check your spam filters
(if you have some), to make sure that the confirmation request was not
automatically classified as spam and you never saw it, and then ask Kern.
Comments to your question below...
[EMAIL PROTECTED] wrote:
***
SUBJECT : autoprune before running backup job
BODY :
Hi,
first of all, all french, so my english is like it is, sorry.
I've installed bacula, which is running fine ;-)... but I'have a
parameter problem. I want to make a daily full backup one daily tape
(the monday backup on the monday tape, the tuesday backup on the tuesday
tape, etc...) BUT I want if I forgot to change the tape, it takes the
tape which is in the computer : the day Before tape !
My usual disclaimer: don't do that!
So, I configure the storage like this :
Pool {
Name=toto
Use Volume Once = Yes
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Volume retention = 12h
Accept Any Volume = yes
}
But bacula try the autoprune AFTER the backup, so the tapes are never
automatically recycle. If, when I put a new tape I send a prune
command, bacula work fine, but if I don't send this command the backup
job fails saying there is no avalaible tape.
I'd do the following:
Either set Use Volume Once to off and have the new backup appended -
then you have an older set when you need it (unless, of course, the tape
is damaged).
Or use a Run Before Script to trigger pruning, or use an admin job with
the same start time but lower priority value than your regular backup.
Let this job prune the volumes.
thank you for your help.
I'll send this to the list, too, so perhaps you get more suggestions.
Arno
Bruno DARMET
--
IT-Service Lehmann[EMAIL PROTECTED]
Arno Lehmann http://www.its-lehmann.de
---
SF.Net email is sponsored by: Discover Easy Linux Migration Strategies
from IBM. Find simple to follow Roadmaps, straightforward articles,
informative Webcasts and more! Get everything you need to get up to
speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: hesitation between incremental and differential backup
Hello, Romain wrote: Thanks for your answer. That depends on the amount of data changed between backup runs, how much time you want to spend during backup, and how much you want to strain the SD and DIR during a restore - The amount of data changed is quite reasonable. Furthermore the backup is made via a gigabit lan on hard disks (no tape). with differentials, you always only need the last full and the desired differential backup, while with incrementals up to 10 volumes could be necessary. I don't understand the difference of bacula management between incr and diff. A differentail backup is always based on the last full one. incremental ones are based on the last backup available - be it full, differential, or another incremental. More is in the manual. Arno Arno Regards, Romain --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Re: [Bacula-devel] backup of remote client randomly errors
On 28 Jun 2005 at 9:45, Matthias F. Brandstetter wrote: Now it seems my firewall caused the problems ... do you guys have any experiences with Linux based firewalls and bacula? Are there any special iptables commands I should be aware of or something similar? It should just work. I have remote clients outside my firewall and I back them up every night. I have created tunnels to and from those clients using stunnel. My gateway NATs all traffic. -- Dan Langille : http://www.langille.org/ BSDCan - The Technical BSD Conference - http://www.bsdcan.org/ --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: Backup of directory structures
On Tue, 28 Jun 2005 09:39:51 +0530, Siju George [EMAIL PROTECTED] said: Siju DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; Siju On 6/28/05, Martin Simmons [EMAIL PROTECTED] wrote: On Mon, 20 Jun 2005 10:20:49 +0200, Arno Lehmann [EMAIL PROTECTED] said: Arno Hello, Arno Siju George wrote: On 6/20/05, Siju George [EMAIL PROTECTED] wrote: Hi, I am looking at Bacula but the line # Files deleted after a Full save will be included in a restoration. in http://www.bacula.org/rel-manual/Current_State_Bacula.html under Current Implementation Restrictions makes me a little apprhensive. Is Bacula actually not able to backup Directory structures?? i.e If in a Directory dir1 I have file1, file2 file3 and I take a full backup backup1 on Day1 the I delete file2 from dir1 and take a differential backup backup2. Now I should be able to restore dir1 from backup2 with only file1 and file2 Sorry :-( this should read as file1 file3 Arno You _can_ restore file1 file2 and file3 in dir1. However, when you use Arno bacula to manage a restore and tell it to make a complete restore it Arno will restore all three files. Arno If you tell bacula to only use the differential backup then, of course, Arno file2 will not be restored. Usually you will not do this because it's Arno baculas job to keep track which jobs and volumes it needs to restore :-) Arno So, of course bacula saves and retrieves directory structure, but it Arno does not keep track of deletions. Arno The latter would require a complete compare of all directory entries to Arno be backed up with what bacula has in its catalog and thus would be very Arno resource intensive. Done correctly, it should be possible to do all the work in restore for filesystems that work properly. Backup just has to record the inode number for each changed file. Siju Could you please explain how??? For each file saved in the backup, you record its full path and some unique id that remains unchanged during renaming (e.g. the inode number on UNIX). For each dir saved, you also record the names of the all files/dirs in that dir. You do both of these things for the initial full backup and subsequent incr/diff backups. During the restore of the full backup, you create a table mapping the unique ids to the full paths. Then during the restores of the incr/diff backups, you can search the table for each unique id being restored and decide if the file is new or renamed (or newly hard-linked). For directories you can check the list of names in that directory to detect deleted or renamed files. This only works on filesystems where renaming a file will change its ctime (or some other property) and where deleting a file will change the mtime (or some other property) of its directory. This is how ufsdump and star work. __Martin --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: Backup of directory structures
On Tue, 28 Jun 2005 09:24:14 +0200, Kern Sibbald [EMAIL PROTECTED] said: Kern On Monday 27 June 2005 22:24, Martin Simmons wrote: On Mon, 20 Jun 2005 10:20:49 +0200, Arno Lehmann [EMAIL PROTECTED] said: Arno Hello, Arno Siju George wrote: On 6/20/05, Siju George [EMAIL PROTECTED] wrote: Hi, I am looking at Bacula but the line # Files deleted after a Full save will be included in a restoration. in http://www.bacula.org/rel-manual/Current_State_Bacula.html under Current Implementation Restrictions makes me a little apprhensive. Is Bacula actually not able to backup Directory structures?? i.e If in a Directory dir1 I have file1, file2 file3 and I take a full backup backup1 on Day1 the I delete file2 from dir1 and take a differential backup backup2. Now I should be able to restore dir1 from backup2 with only file1 and file2 Sorry :-( this should read as file1 file3 Arno You _can_ restore file1 file2 and file3 in dir1. However, when you use Arno bacula to manage a restore and tell it to make a complete restore it Arno will restore all three files. Arno If you tell bacula to only use the differential backup then, of course, Arno file2 will not be restored. Usually you will not do this because it's Arno baculas job to keep track which jobs and volumes it needs to restore :-) Arno So, of course bacula saves and retrieves directory structure, but it Arno does not keep track of deletions. Arno The latter would require a complete compare of all directory entries to Arno be backed up with what bacula has in its catalog and thus would be very Arno resource intensive. Kern One day in the near future, I will do exactly this. I've now finally figured Kern out a simple way to do this -- but darn, I forgot to write it down. Oh well, Kern it will come to me again :-) Done correctly, it should be possible to do all the work in restore for filesystems that work properly. Backup just has to record the inode number for each changed file. Kern The problem is that inode is a machine specific concept. Though it can be Kern simulated, it doesn't exist on Win32 or Mac (well perhaps on OS X). Though Kern this would work nicely as you say, I always like to do things in machine Kern independent ways. Good luck remembering it -- I don't see how you can do it without the inode number to detect which files are the same! __Martin --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: Backup of directory structures
On 6/28/05, Martin Simmons [EMAIL PROTECTED] wrote: Siju Could you please explain how??? For each file saved in the backup, you record its full path and some unique id that remains unchanged during renaming (e.g. the inode number on UNIX). For each dir saved, you also record the names of the all files/dirs in that dir. You do both of these things for the initial full backup and subsequent incr/diff backups. During the restore of the full backup, you create a table mapping the unique ids to the full paths. Then during the restores of the incr/diff backups, you can search the table for each unique id being restored and decide if the file is new or renamed (or newly hard-linked). For directories you can check the list of names in that directory to detect deleted or renamed files. This only works on filesystems where renaming a file will change its ctime (or some other property) and where deleting a file will change the mtime (or some other property) of its directory. This is how ufsdump and star work. Thanks a million Martin for the explanation but it seems a little complicating for me at present. The only backup utility I ever used is the windows one. There you can take a normal backup first ( full backup) and then take differential backup every time and if you restore a differential backup you will get exactly the same contents that was there at the time the differential backup was taken. Is there no utility in Linux that will simply do this??? Thanks a lot again kind regards Siju --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77alloc_id492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] FW: Help with SD error
Hi, On Tuesday 28 June 2005 10:49 Arno Lehmann wrote: Now, unfortunately the debug output has no timestamps, but the only thing I can imagine is that the SD needs some time in between and the FD or some router in between then times out the connection. Have you tried the Heratbeat interval setting? Arno I have tried it now (Heartbeat Interval = 5 seconds as well as Heartbeat Interval = 5 minutes), it unfortunately it did not make a difference. I also had a look at the status of the client FD while the backup is running, and the following was peculiar: 1. Although it is a 100MB FullDuplex auto negotiating NIC the speed is only +/-100k/sec and then the bytes/sec bleeds off until the job dies. On a standard NIC (built into the same system) it moves like a rocket. Should I send another trace with the Heartbeat Interval Setting enabled ? Yours Sincerely Stephan Heine Support Engineer Genetic Interactive Tel: +27 861 99 88 99 Fax: +27 861 99 77 99 Cell: +27 82 467 1164 EMail: [EMAIL PROTECTED] --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: Backup of directory structures
On Tue, 28 Jun 2005 17:11:12 +0530, Siju George [EMAIL PROTECTED] said: Siju DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; Siju On 6/28/05, Martin Simmons [EMAIL PROTECTED] wrote: Siju Could you please explain how??? For each file saved in the backup, you record its full path and some unique id that remains unchanged during renaming (e.g. the inode number on UNIX). For each dir saved, you also record the names of the all files/dirs in that dir. You do both of these things for the initial full backup and subsequent incr/diff backups. During the restore of the full backup, you create a table mapping the unique ids to the full paths. Then during the restores of the incr/diff backups, you can search the table for each unique id being restored and decide if the file is new or renamed (or newly hard-linked). For directories you can check the list of names in that directory to detect deleted or renamed files. This only works on filesystems where renaming a file will change its ctime (or some other property) and where deleting a file will change the mtime (or some other property) of its directory. This is how ufsdump and star work. Siju Thanks a million Martin for the explanation but it seems a little Siju complicating for me at present. The only backup utility I ever used is Siju the windows one. Siju There you can take a normal backup first ( full backup) and then take Siju differential backup every time and if you restore a differential Siju backup you will get exactly the same contents that was there at the Siju time the differential backup was taken. Siju Is there no utility in Linux that will simply do this??? Yes, AFAIK ufsdump and star (http://freshmeat.net/projects/star/) can both do it. They don't have any volume management facilities like Bacula does though. __Martin --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] FW: Help with SD error
Hi, Stephan Heine - [Genetic Interactive] wrote: Hi, On Tuesday 28 June 2005 10:49 Arno Lehmann wrote: Now, unfortunately the debug output has no timestamps, but the only thing I can imagine is that the SD needs some time in between and the FD or some router in between then times out the connection. Have you tried the Heratbeat interval setting? Arno I have tried it now (Heartbeat Interval = 5 seconds as well as Heartbeat Interval = 5 minutes), it unfortunately it did not make a difference. I also had a look at the status of the client FD while the backup is running, and the following was peculiar: 1. Although it is a 100MB FullDuplex auto negotiating NIC the speed is only +/-100k/sec and then the bytes/sec bleeds off until the job dies. On a standard NIC (built into the same system) it moves like a rocket. Should I send another trace with the Heartbeat Interval Setting enabled ? not for me at least... I'd say this is a good indication that the problem is not baculas and therefore the bacula debug output will not help. More helpful might be to search support for the nvidia network drivers or hardware, I guess... Arno Yours Sincerely Stephan Heine Support Engineer Genetic Interactive Tel: +27 861 99 88 99 Fax: +27 861 99 77 99 Cell: +27 82 467 1164 EMail: [EMAIL PROTECTED] --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: Backup of directory structures
On Tuesday 28 June 2005 12:57, Martin Simmons wrote: ... it Arno does not keep track of deletions. Arno The latter would require a complete compare of all directory entries to Arno be backed up with what bacula has in its catalog and thus would be very Arno resource intensive. Kern One day in the near future, I will do exactly this. I've now finally figured Kern out a simple way to do this -- but darn, I forgot to write it down. Oh well, Kern it will come to me again :-) Done correctly, it should be possible to do all the work in restore for filesystems that work properly. Backup just has to record the inode number for each changed file. Kern The problem is that inode is a machine specific concept. Though it can be Kern simulated, it doesn't exist on Win32 or Mac (well perhaps on OS X). Though Kern this would work nicely as you say, I always like to do things in machine Kern independent ways. Good luck remembering it -- I don't see how you can do it without the inode number to detect which files are the same! To track deletions, you don't need the inode, just the full path and filename. If it is no longer there, it is no longer there. If it is there and has been re-created with a different inode, it will be backed up because of the time change, so there is no problem. My trick for keeping track of deletions is the following. Assuming the user turns on this option, after all the files have been backed up, but before the job has terminated, the FD will make a pass through all the files and send their names to the DIR (*exactly* the same as what a Verify job currently does). This will probably be done at the same time the files are being sent to the SD avoiding a second pass. The DIR will then compare that to what is stored in the catalog. Any files in the catalog but not in what the FD sent will receive a catalog File entry that indicates that at that point in time the file was deleted. During a restore, any file initially picked up by some backup (Full, ...) then subsequently having a File entry marked delete will be removed from the tree, so will not be restored. If a file with the same name is later OK it will be inserted in the tree -- this already happens. All will be consistent except for possible changes during the running of the FD. Since I'm on the subject, some of you may be wondering what the utility of the in memory tree is if you are going to restore everything (at least it comes up from time to time on the list). Well, it is still *very* useful because it allows only the last item found for a particular filename (full path) to be entered into the tree, and thus if a file is backed up 10 times, only the last copy will be restored. I recently (last Friday) restored a complete directory, and the Full and all the Differential and Incremental backups spanned 3 Volumes. The first Volume was not even mounted because all the files had been updated and hence backed up since the Full backup was made. In this case, the tree saved me a *lot* of time. However, if you have a quadrillion files and building the tree takes 24 hours, you could certainly question the utility of building the tree. One more little item: over the weekend, a user complained that bscan didn't rebuild his catalog correctly. My answer is: not true. It worked with what it had. However, if you feed it only one tape per bscan and your backup(s) span two Volumes, bscan will hiccup as it did at some point and your catalog will not be correct (Bacula's records span volumes and bscan hiccups then ignores partial records). Moral of the story: 1. Back up your catalog in a separate job each night. 2. Make a bootstrap file for your catalog and write it to another computer, then you won't need to use bscan to get your catalog back. 3. If you *really* need to use bscan, be sure to feed it *all* the appropriate volumes in a *single* bscan execution (not one for each tape) with the volumes specified in the right order. This was clearly and correctly documented, IMO, but I've added more to this effect ... -- Best regards, Kern ( /\ V_V --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
RE: [Bacula-users] Problems getting off the ground on FreeBSD
That did it! Thanks! -Original Message- From: Dominic Marks [mailto:[EMAIL PROTECTED] Sent: Tuesday, June 28, 2005 10:45 To: bacula-users@lists.sourceforge.net Cc: McCann, Brian Subject: Re: [Bacula-users] Problems getting off the ground on FreeBSD On Tuesday 28 June 2005 15:35, McCann, Brian wrote: Hi all. I'm hoping someone here can help me out. I've installed and made my first test config for Bacula, the daemons start, but bconsole isn't on my system anywhere! When I built Bacula, I did it from the ports collection (Bacula v1.36.3) using make -DWITH_POSTGRESQL install. I can see the console program in the work path (/usr/ports/sysutils/bacula-server/work/bacula-1.36.3/src/console), but when I try to make it, I get You need sysutils/bacula-client installed too. c++ -c -I/usr/local/include -I. -I.. -O -pipe console.c console.c:503:22: readline.h: No such file or directory console.c:504:21: history.h: No such file or directory console.c: In function `int get_cmd(FILE*, const char*, BSOCK*, int)': console.c:513: error: `readline' undeclared (first use this function) console.c:513: error: (Each undeclared identifier is reported only once for each function it appears in.) console.c:521: error: `add_history' undeclared (first use this function) *** Error code 1 Stop in /usr/ports/sysutils/bacula-server/work/bacula-1.36.3/src/console. I followed the walkthrough from the FreeBSD Diary, as well as checked through most of the Bacula manual for help. I would be grateful for any help anyone can offer...I'm looking forward to using Bacula...and this seams like a stupid place to be hung up. Thanks! --Brian HTH, -- Dominic GoodforBusiness.co.uk I.T. Services for SMEs in the UK. --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77alloc_id492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Restore Errors, STILL
On Tue, Jun 28, 2005 at 10:45:19AM +0200, Kern Sibbald wrote: On Monday 27 June 2005 23:44, Michael Reith wrote: Why am i getting all these errors, and how do i fix it.. my filesystem is not full, i run it as root so its not perms, and none of the other obvious stuff.. Im runnign OpenBSD -3.6 GENERIC. ' This appears to be some OpenBSD extension to or incomptibility with Unix nodes. To start to have a better idea of what is going on, I'll need to see a stat of the original file. I will also need the output from man 2 mknod. As soon as I find my tapes and get Bacula back in operation again here, I'll be able to test this myself and see if I can reproduce it on my OpenBSD-3.6 box. -- Phil Stracchino [EMAIL PROTECTED] Renaissance Man, Unix generalist, Perl hacker Mobile: 603-216-7037 Landline: 603-886-3518 --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] NetWare, anyone?
Is there anyone on this list who uses Bacula to back up NetWare servers? If so, is there any acquired wisdom you could share? Tks n rgds, Richard White CNE6 Network Engineer Mason County, Washington 360-427-5501 [EMAIL PROTECTED] --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77alloc_id492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] NetWare, anyone?
On Tue, Jun 28, 2005 at 11:51:13AM -0700, Richard White wrote: Is there anyone on this list who uses Bacula to back up NetWare servers? If so, is there any acquired wisdom you could share? Tks n rgds, Richard White CNE6 Network Engineer Mason County, Washington Richard, There is not at this time any Netware client for Bacula. if I had to do it, I'd probably mount the Netware volumes on a Linux machine using ncpfs and the nwtools package. -- Phil Stracchino [EMAIL PROTECTED] Renaissance Man, Unix generalist, Perl hacker Mobile: 603-216-7037 Landline: 603-886-3518 --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] NetWare, anyone?
Hi, Richard White wrote: Is there anyone on this list who uses Bacula to back up NetWare servers? If so, is there any acquired wisdom you could share? Apart from Phils suggestion, which is what I would do too, you could also see if what Novell calls Netware is already available with an underlying linux... that's what they want to achieve finally, but I don't know if they are there already. Once they are, I guess they will offer means to migrate from Netware/proprietary to Netware on SuSE linux, I assume. Arno Tks n rgds, Richard White CNE6 Network Engineer Mason County, Washington 360-427-5501 [EMAIL PROTECTED] --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77alloc_id492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] messages : how to suppress new?
Arno Lehmann wrote: Dan, Dan Langille wrote: I also want to get rid of it from the console... that's a lot of messages! ... write a small daemon that checks the messages file and... no, only joking. Ok, after some test verify today I stop joking. I had messages running through the console for about 20 minutes. Arno -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Autochanger: How is a cleaning tape supposed to appear in the catalog?
Hi fellow Bacula users and enthusiasts... I have a question regarding the handling of cleaning tapes in an autochanger. I am running Bacula 1.36.3 with a HP SureStore DAT 40x6 autochanger, and it has been working quite well for some time. I am now in the process of replacing an old set of tapes with new ones. This issue came to light while I was labelling the new tapes. Here's some background... When I initially set this system up, I adapted the mtx-changer script to simulate barcodes as documented in http://www.bacula.org/rel-manual/Autochangers_Support.html (see: Simulating Barcodes in your Autochanger). I also have the line: Cleaning Prefix = CLN in the Pool section of my bacula-dir.conf file. My cleaning tape is in slot 6, and the name CLN is listed by slot 6 in the /etc/bacula/changer.volumes file that mtx-changer uses to simulate barcode labels with. And here's what happened today when I labelled the tapes... When I issued the command label barcodes in bconsole, it looks like it handled the loading, labelling and unloading of the regular tapes properly, and it appears to have skipped loading and labelling of the cleaning tape as it is supposed to do. When it came to the cleaning tape, it reported Catalog record for cleaning tape CLN successfully created. After that was finished, I issued an update slots command, and then list volumes to see whether everything looked ok. The curious thing is that when I issue the list volumes command, the cleaning tape looks a lot like a normal tape in the catalog. Here's what it's showing (NOTE: some column names are shortened for readability, some columns omitted): *list volumes Pool: Default +-+-+-+--+--+-+--+-- -+---+ | MediaId | VolName | VolStat | VolBytes | VolFiles | Recycle | Slot | InChanger | MediaType | +-+-+-+--+--+-+--+-- -+---+ | 32 | CoLo4A | Append |1 |0 | 1 |1 | 1 | DDS-4 | | 33 | CoLo4B | Append |1 |0 | 1 |2 | 1 | DDS-4 | | 34 | CoLo4C | Append |1 |0 | 1 |3 | 1 | DDS-4 | | 35 | CoLo4D | Append |1 |0 | 1 |4 | 1 | DDS-4 | | 36 | CoLo4E | Append |1 |0 | 1 |5 | 1 | DDS-4 | | 37 | CLN | Append |0 |0 | 1 |6 | 1 | | +-+-+-+--+--+-+--+-- -+---+ * (All VolRetention values were reported as 2,322,800 and all LastWritten values are -00-00 00:00:00 - including the cleaning tape.) The word Append and the value of 1 under the Recycle column concerns me. I also notice that it doesn't have a MediaType value. I just want to make sure Bacula doesn't attempt to mount the backup tape as a regular volume. Perhaps the handling of cleaning tapes in the catalog could be better documented in the Bacula Users Guide. So my questions are: Is this how a cleaning tape is supposed to appear in the catalog (with an Append status, Recycle=1 and no MediaType)? When doing a backup job, does Bacula use any part of the cleaning tape's catalog record (besides VolumeName) to determine that the tape is in fact a cleaning tape? Curious, -Ryan --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77alloc_id492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] NetWare, anyone?
Apart from Phils suggestion, which is what I would do too, you could also see if what Novell calls Netware is already available with an underlying linux... that's what they want to achieve finally, but I don't know if they are there already. Most of the features, functions and services which have run on NetWare will now run on Linux. Of course, Novell gives most support to SuSE, but they also claim to support RH. We are presently migrating some of our NetWare servers to Linux. We have already migrated a W2K server that way. I suppose my boss wanted me to post this question so that, in the event we are totally satisfied and awed by Bacula, we may move to it as our only backup solution. This whole exercise came about because our Backup Exec for NetWare would see this ex-W2K-now-SuSE Linux server, except for the directories we particularly wanted to back up. These directories are distinguished only in that they are shared out with Samba. Our support period with Veritas has expired, and I got no solutions to this problem by googling, so we decided to try Bacula. The bad news is that I am rather new to Linux. I have learned a great deal in the last year or so, but I have a lot more to learn before I hang out my shingle. The good news is that Bacula is now backing up those directories and I understand a good deal more about Bacula than I did at first. As I said in another post, much of my floundering around has been due to the differences in concepts and philosiphies between Bacula and BE. I supported ArcServe for a while a few years ago * an experience I would like to forget * and I installed Arkeia on this SuSE box before trying Bacula. So far, so good. Today we are working on getting wxWidgets working so we can have a graphical front end. I am (so far) happy with bconsole, but my boss wants a gui so that if I bite the big one, someone else can quickly take over managing backups. Tks n rgds, Richard White CNE6 Network Engineer Mason County, Washington 360-427-5501 [EMAIL PROTECTED] --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77alloc_id492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] messages : how to suppress new?
Hi, Dan Langille wrote: With a verify job, you set a base line against which future verifies are compared. With log files, you are constantly getting new files, especially if you include the date in the log file name. I think I may want a different verify job: one that compares the volume against the catalog (e.g. reads the tape, computes the md5, compares that to the catalog value). Part of that is Verify VolumeToCatalog. I think. Or I misunderstand you. Actually reading the tape would require Kern's work, I think. Arno -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Labelling again -- Counter Incrementing
If I have a monthly, weekly, and daily pool, and the monthly and weekly pool each have a counter that they increment, and I have 3 clients using all these pools, will each client be incrementing the counters as it runs, or only the first client. I really want only the first client doing it. If that is the case, then it is not difficult -- that first client gets its own pools. But I need to find it out first. Thanks, Misty --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
RE: [Bacula-users] Autochanger: How is a cleaning tape supposed to appear in the catalog?
Here is the result of llist volume=CLN... *llist volume=CLN MediaId: 37 VolumeName: CLN Slot: 6 PoolId: 1 MediaType: FirstWritten: -00-00 00:00:00 LastWritten: -00-00 00:00:00 LabelDate: -00-00 00:00:00 VolJobs: 0 VolFiles: 0 VolBlocks: 0 VolMounts: 0 VolBytes: 0 VolErrors: 0 VolWrites: 0 VolCapacityBytes: 0 VolStatus: Append Recycle: 1 VolRetention: 2,332,800 VolUseDuration: 0 MaxVolJobs: 0 MaxVolFiles: 0 MaxVolBytes: 0 InChanger: 1 EndFile: 0 EndBlock: 0 Thanks, -Ryan -Original Message- From: Kern Sibbald [mailto:[EMAIL PROTECTED] Sent: Tuesday, June 28, 2005 4:40 PM To: bacula-users@lists.sourceforge.net Cc: Ryan Colp Subject: Re: [Bacula-users] Autochanger: How is a cleaning tape supposed to appear in the catalog? On Tuesday 28 June 2005 22:10, Ryan Colp wrote: Hi fellow Bacula users and enthusiasts... I have a question regarding the handling of cleaning tapes in an autochanger. I am running Bacula 1.36.3 with a HP SureStore DAT 40x6 autochanger, and it has been working quite well for some time. I am now in the process of replacing an old set of tapes with new ones. This issue came to light while I was labelling the new tapes. Here's some background... When I initially set this system up, I adapted the mtx-changer script to simulate barcodes as documented in http://www.bacula.org/rel-manual/Autochangers_Support.html (see: Simulating Barcodes in your Autochanger). I also have the line: Cleaning Prefix = CLN in the Pool section of my bacula-dir.conf file. My cleaning tape is in slot 6, and the name CLN is listed by slot 6 in the /etc/bacula/changer.volumes file that mtx-changer uses to simulate barcode labels with. And here's what happened today when I labelled the tapes... When I issued the command label barcodes in bconsole, it looks like it handled the loading, labelling and unloading of the regular tapes properly, and it appears to have skipped loading and labelling of the cleaning tape as it is supposed to do. When it came to the cleaning tape, it reported Catalog record for cleaning tape CLN successfully created. After that was finished, I issued an update slots command, and then list volumes to see whether everything looked ok. The curious thing is that when I issue the list volumes command, the cleaning tape looks a lot like a normal tape in the catalog. Here's what it's showing (NOTE: some column names are shortened for readability, some columns omitted): *list volumes Pool: Default +-+-+-+--+--+-+--+-- -+---+ | MediaId | VolName | VolStat | VolBytes | VolFiles | Recycle | Slot | InChanger | MediaType | +-+-+-+--+--+-+--+-- -+---+ | 32 | CoLo4A | Append |1 |0 | 1 |1 | 1 | DDS-4 | | 33 | CoLo4B | Append |1 |0 | 1 |2 | 1 | DDS-4 | | 34 | CoLo4C | Append |1 |0 | 1 |3 | 1 | DDS-4 | | 35 | CoLo4D | Append |1 |0 | 1 |4 | 1 | DDS-4 | | 36 | CoLo4E | Append |1 |0 | 1 |5 | 1 | DDS-4 | | 37 | CLN | Append |0 |0 | 1 |6 | 1 | | +-+-+-+--+--+-+--+-- -+---+ * (All VolRetention values were reported as 2,322,800 and all LastWritten values are -00-00 00:00:00 - including the cleaning tape.) The word Append and the value of 1 under the Recycle column concerns me. I also notice that it doesn't have a MediaType value. I just want to make sure Bacula doesn't attempt to mount the backup tape as a regular volume. Perhaps the handling of cleaning tapes in the catalog could be better documented in the Bacula Users Guide. So my questions are: Is this how a cleaning tape is supposed to appear in the catalog (with an Append status, Recycle=1 and no MediaType)? When doing a backup job, does Bacula use any part of the cleaning tape's catalog record (besides VolumeName) to determine that the tape is in fact a cleaning tape? Please do a: llist volume=CLN let's see what it says. Curious, -Ryan --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77alloc_id492opÌk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net
[Bacula-users] Black hole lists
Hello, I've been having quite a lot of problems with email lately. One of them is because spamcop.net has blackholed Source Forge's machine the sends our lists' email. I have reported this to Spam Cop, but I for one will no longer use spamcop.net for blackholing. This spam thing has gotten a bit out of hand ... -- Best regards, Kern ( /\ V_V --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Autochanger: How is a cleaning tape supposed to appear in the catalog?
On Tuesday 28 June 2005 22:10, Ryan Colp wrote: Hi fellow Bacula users and enthusiasts... I have a question regarding the handling of cleaning tapes in an autochanger. I am running Bacula 1.36.3 with a HP SureStore DAT 40x6 autochanger, and it has been working quite well for some time. I am now in the process of replacing an old set of tapes with new ones. This issue came to light while I was labelling the new tapes. Here's some background... When I initially set this system up, I adapted the mtx-changer script to simulate barcodes as documented in http://www.bacula.org/rel-manual/Autochangers_Support.html (see: Simulating Barcodes in your Autochanger). I also have the line: Cleaning Prefix = CLN in the Pool section of my bacula-dir.conf file. My cleaning tape is in slot 6, and the name CLN is listed by slot 6 in the /etc/bacula/changer.volumes file that mtx-changer uses to simulate barcode labels with. And here's what happened today when I labelled the tapes... When I issued the command label barcodes in bconsole, it looks like it handled the loading, labelling and unloading of the regular tapes properly, and it appears to have skipped loading and labelling of the cleaning tape as it is supposed to do. When it came to the cleaning tape, it reported Catalog record for cleaning tape CLN successfully created. After that was finished, I issued an update slots command, and then list volumes to see whether everything looked ok. The curious thing is that when I issue the list volumes command, the cleaning tape looks a lot like a normal tape in the catalog. Here's what it's showing (NOTE: some column names are shortened for readability, some columns omitted): *list volumes Pool: Default +-+-+-+--+--+-+--+-- -+---+ | MediaId | VolName | VolStat | VolBytes | VolFiles | Recycle | Slot | InChanger | MediaType | +-+-+-+--+--+-+--+-- -+---+ | 32 | CoLo4A | Append |1 |0 | 1 |1 | 1 | DDS-4 | | 33 | CoLo4B | Append |1 |0 | 1 |2 | 1 | DDS-4 | | 34 | CoLo4C | Append |1 |0 | 1 |3 | 1 | DDS-4 | | 35 | CoLo4D | Append |1 |0 | 1 |4 | 1 | DDS-4 | | 36 | CoLo4E | Append |1 |0 | 1 |5 | 1 | DDS-4 | | 37 | CLN | Append |0 |0 | 1 |6 | 1 | | +-+-+-+--+--+-+--+-- -+---+ * (All VolRetention values were reported as 2,322,800 and all LastWritten values are -00-00 00:00:00 - including the cleaning tape.) The word Append and the value of 1 under the Recycle column concerns me. I also notice that it doesn't have a MediaType value. I just want to make sure Bacula doesn't attempt to mount the backup tape as a regular volume. Perhaps the handling of cleaning tapes in the catalog could be better documented in the Bacula Users Guide. So my questions are: Is this how a cleaning tape is supposed to appear in the catalog (with an Append status, Recycle=1 and no MediaType)? When doing a backup job, does Bacula use any part of the cleaning tape's catalog record (besides VolumeName) to determine that the tape is in fact a cleaning tape? Please do a: llist volume=CLN let's see what it says. Curious, -Ryan --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77alloc_id492opÌk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Best regards, Kern ( /\ V_V --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77alloc_id492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] NetWare, anyone?
On Tuesday 28 June 2005 22:34, Richard White wrote: Apart from Phils suggestion, which is what I would do too, you could also see if what Novell calls Netware is already available with an underlying linux... that's what they want to achieve finally, but I don't know if they are there already. Most of the features, functions and services which have run on NetWare will now run on Linux. Of course, Novell gives most support to SuSE, but they also claim to support RH. We are presently migrating some of our NetWare servers to Linux. We have already migrated a W2K server that way. I suppose my boss wanted me to post this question so that, in the event we are totally satisfied and awed by Bacula, we may move to it as our only backup solution. This whole exercise came about because our Backup Exec for NetWare would see this ex-W2K-now-SuSE Linux server, except for the directories we particularly wanted to back up. These directories are distinguished only in that they are shared out with Samba. Our support period with Veritas has expired, and I got no solutions to this problem by googling, so we decided to try Bacula. The bad news is that I am rather new to Linux. I have learned a great deal in the last year or so, but I have a lot more to learn before I hang out my shingle. The good news is that Bacula is now backing up those directories and I understand a good deal more about Bacula than I did at first. As I said in another post, much of my floundering around has been due to the differences in concepts and philosiphies between Bacula and BE. I supported ArcServe for a while a few years ago * an experience I would like to forget * and I installed Arkeia on this SuSE box before trying Bacula. I would be interested to hear a bit of detail about the differences in concepts and philosphies between Bacula and BE if you have the time. The details of what BE does are not important, but if you find that they do something better, I would like to know what it is and why you think they do it better. The idea is to help us improve Bacula. So far, so good. Today we are working on getting wxWidgets working so we can have a graphical front end. I am (so far) happy with bconsole, but my boss wants a gui so that if I bite the big one, someone else can quickly take over managing backups. Tks n rgds, Richard White CNE6 Network Engineer Mason County, Washington 360-427-5501 [EMAIL PROTECTED] --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77alloc_id492opÌk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Best regards, Kern ( /\ V_V --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77alloc_id492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] NetWare, anyone?
Hi, Richard White wrote: Most of the features, functions and services which have run on NetWare will now run on Linux. Of course, Novell gives most support to SuSE, but they also claim to support RH. Nice to hear. Although it's quite some time that I last saw Netware in production. ... Our support period with Veritas has expired, and I got no solutions to this problem by googling, so we decided to try Bacula. Seems reasonable to me... The bad news is that I am rather new to Linux. I have learned a great deal in the last year or so, but I have a lot more to learn before I hang out my shingle. The good news is that Bacula is now backing up those directories and I understand a good deal more about Bacula than I did at first. As I said in another post, much of my floundering around has been due to the differences in concepts and philosiphies between Bacula and BE. I supported ArcServe for a while a few years ago * an experience I would like to forget * and I installed Arkeia on this SuSE box before trying Bacula. Nice selection of backup tools... I remember a discussion in some forum about what was more unstable - Veritas or Networker. I don't know Arcserve, but I did try Arkeia not long ago, and I read the arkeia user mailing list. Arkeia is, in my opinion, unusable. No wonder I'm stuck with bacula, I think. So far, so good. Today we are working on getting wxWidgets working so we can have a graphical front end. I am (so far) happy with bconsole, but my boss wants a gui so that if I bite the big one, someone else can quickly take over managing backups. Actually, I don't know if wxconsole is what your boss likes... basically a bconsole on a GUI desktop. I never understood the restore feature, I'm afraid :-( Tks n rgds, Richard White CNE6 CNE... could have noticed that before - sure you know about Netware on linux, then. Arno Network Engineer Mason County, Washington 360-427-5501 [EMAIL PROTECTED] --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77alloc_id492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] NetWare, anyone?
On Wed, Jun 29, 2005 at 12:33:30AM +0200, Arno Lehmann wrote: Nice selection of backup tools... I remember a discussion in some forum about what was more unstable - Veritas or Networker. I don't know Arcserve, but I did try Arkeia not long ago, and I read the arkeia user mailing list. Arkeia is, in my opinion, unusable. I won't argue with you on that. (Nor will I repeat, again, my rant on the architectural shortcomings of Arkeia and Knox Software's refusal to address them.) -- Phil Stracchino [EMAIL PROTECTED] Renaissance Man, Unix generalist, Perl hacker Mobile: 603-216-7037 Landline: 603-886-3518 --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Supported autochangers
I've been running bacula with an ADIC 1200G (12x DDS-3) library for a few months now without any issues on the changer end. It took a little tweaking of the mtx-changer script in the beginning but it's been rock solid since then. Details: OS - Linux 2.4.x Bacula - 1.34.4 and 1.36.3 Changer - ADIC 1200G Drive - Sony SDT-9000 Regarding the tweaking, ejecting the tape needs 'mt -f /dev/nstX offline' and sleep commands should be uncommented/added between any mt and mtx commands, also after the access door has been closed and a magazine loaded the changer will report no Data Transfer Element reported on the first mtx command but it's fine after that, so I advise running 'mtx -f /dev/sgX status' after any procedure that involves opening the access door and in the system's local startup script in the case of a power failure or some such. Thanks, Chris --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477alloc_id=16492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: Backup of directory structures
On 6/28/05, Kern Sibbald [EMAIL PROTECTED] wrote: On Tuesday 28 June 2005 12:57, Martin Simmons wrote: ... it Arno does not keep track of deletions. Arno The latter would require a complete compare of all directory entries to Arno be backed up with what bacula has in its catalog and thus would be very Arno resource intensive. Kern One day in the near future, I will do exactly this. I've now finally figured Kern out a simple way to do this -- but darn, I forgot to write it down. Oh well, Kern it will come to me again :-) Done correctly, it should be possible to do all the work in restore for filesystems that work properly. Backup just has to record the inode number for each changed file. Kern The problem is that inode is a machine specific concept. Though it can be Kern simulated, it doesn't exist on Win32 or Mac (well perhaps on OS X). Though Kern this would work nicely as you say, I always like to do things in machine Kern independent ways. Good luck remembering it -- I don't see how you can do it without the inode number to detect which files are the same! To track deletions, you don't need the inode, just the full path and filename. If it is no longer there, it is no longer there. If it is there and has been re-created with a different inode, it will be backed up because of the time change, so there is no problem. My trick for keeping track of deletions is the following. Assuming the user turns on this option, after all the files have been backed up, but before the job has terminated, the FD will make a pass through all the files and send their names to the DIR (*exactly* the same as what a Verify job currently does). This will probably be done at the same time the files are being sent to the SD avoiding a second pass. The DIR will then compare that to what is stored in the catalog. Any files in the catalog but not in what the FD sent will receive a catalog File entry that indicates that at that point in time the file was deleted. During a restore, any file initially picked up by some backup (Full, ...) then subsequently having a File entry marked delete will be removed from the tree, so will not be restored. If a file with the same name is later OK it will be inserted in the tree -- this already happens. All will be consistent except for possible changes during the running of the FD. Since I'm on the subject, some of you may be wondering what the utility of the in memory tree is if you are going to restore everything (at least it comes up from time to time on the list). Well, it is still *very* useful because it allows only the last item found for a particular filename (full path) to be entered into the tree, and thus if a file is backed up 10 times, only the last copy will be restored. I recently (last Friday) restored a complete directory, and the Full and all the Differential and Incremental backups spanned 3 Volumes. The first Volume was not even mounted because all the files had been updated and hence backed up since the Full backup was made. In this case, the tree saved me a *lot* of time. Thanks a million Kern for the wonderful details :-) I really appreciate it :-) Good luck on implementation and hope Debian people will soon make a Package as soon as it is released :-) Till then I need to find a temporary solution! thanks a lot again kind regards Siju However, if you have a quadrillion files and building the tree takes 24 hours, you could certainly question the utility of building the tree. One more little item: over the weekend, a user complained that bscan didn't rebuild his catalog correctly. My answer is: not true. It worked with what it had. However, if you feed it only one tape per bscan and your backup(s) span two Volumes, bscan will hiccup as it did at some point and your catalog will not be correct (Bacula's records span volumes and bscan hiccups then ignores partial records). Moral of the story: 1. Back up your catalog in a separate job each night. 2. Make a bootstrap file for your catalog and write it to another computer, then you won't need to use bscan to get your catalog back. 3. If you *really* need to use bscan, be sure to feed it *all* the appropriate volumes in a *single* bscan execution (not one for each tape) with the volumes specified in the right order. This was clearly and correctly documented, IMO, but I've added more to this effect ... -- Best regards, Kern ( /\ V_V --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77alloc_id492op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net
