[Bacula-users] force backup of unchanged file in incremental backup
The last modified datestamp on MSSQL database files doesn't get changed unless the actual file dimensions change (eg it 'grows') or when the file is closed. This means that an incremental backup won't necessarily back up the database files unless they have changed. Accurate won't catch this either as the metadata it uses will be identical. Is there a way to force the backup of specific unchanged files during an incremental or differential backup? Eg: Option { File = C:/database/mydb.mdf Always Back Up = Yes } Thanks James -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Connection error from remote client
On Wed, 13 Apr 2011 18:45:51 -0400, Kenney, William P. (Information Technology Services) kenn...@easternct.edu wrote: -Original Message- From: Jérôme Blion [mailto:jerome.bl...@free.fr] Sent: Friday, April 08, 2011 9:55 AM To: Kenney, William P. (Information Technology Services) Cc: bacula-users@lists.sourceforge.net Subject: RE: [Bacula-users] Connection error from remote client clip I have tried this address, ecsu-bk3.easternct.edu and the IP address in the address field and get the same error. I have removed the internal FW's during testing and it made no difference. The database contains a bacula user for all hostname addresses that I have used, so that should not be a problem. Bill Hello, From the client, are the following commands working? nslookup ecsu-bk3 telnet ecsu-bk3 9103 Can you confirm me the Storage Daemon and the Director are on the same machine? (I read ecsu-bk3-dir in your message) HTH. Jerome Blion. Hi Jerome, I cleaned up the DNS server annow get only one correct response from nslookup. The Storage daemon and Director are on the same machine. I opened up my.cnf to allow remote access to the database. I added the FQDN and alias to the IP address in the /etc/hosts file. The local client runs just fine but I still get the error message from the second remote client. Below is a listing of the error message and the configuration files I'm using: * This is the error message I received from the Director: You have messages. *messages 13-Apr 18:11 ecsu-bk3-dir JobId 55: Fatal error: No Job status returned from FD. 13-Apr 18:08 ecsu-bk3-dir JobId 55: Warning: bsock.c:129 Could not connect to Client: beast-fd on beast.easternct.edu:9102. ERR=Connection refused Retrying ... 13-Apr 18:11 ecsu-bk3-dir JobId 55: Fatal error: bsock.c:135 Unable to connect to Client: beast-fd on beast.easternct.edu:9102. ERR=Connection refused 13-Apr 18:11 ecsu-bk3-dir JobId 55: Error: Bacula ecsu-bk3-dir 5.0.2 (28Apr10): 13-Apr-2011 18:11:00 Build OS: x86_64-pc-linux-gnu ubuntu 10.10 JobId: 55 Job:BackupClient2.2011-04-13_18.07.58_12 Backup Level: Full (upgraded from Incremental) Client: beast-fd 5.0.0 (26Jan10) x86_64-redhat-linux-gnu,redhat,Enterprise release FileSet:Full Set 2011-04-01 11:44:48 Pool: File (From Job resource) Catalog:MyCatalog (From Client resource) Storage:File (From Job resource) Scheduled time: 13-Apr-2011 18:07:51 Start time: 13-Apr-2011 18:08:00 End time: 13-Apr-2011 18:11:00 Elapsed time: 3 mins Priority: 10 FD Files Written: 0 SD Files Written: 0 FD Bytes Written: 0 (0 B) SD Bytes Written: 0 (0 B) Rate: 0.0 KB/s Software Compression: None VSS:no Encryption: no Accurate: no Volume name(s): Volume Session Id: 3 Volume Session Time:1302731375 Last Volume Bytes: 1,774 (1.774 KB) Non-fatal FD errors:0 SD Errors: 0 FD termination status: Error SD termination status: Waiting on FD Termination:*** Backup Error *** [...] This is the bacula-sd.conf on the backup server # # Default Bacula Storage Daemon Configuration file # # For Bacula release 5.0.2 (28 April 2010) -- ubuntu 10.10 # # You may need to change the name of your tape drive # on the Archive Device directive in the Device # resource. If you change the Name and/or the # Media Type in the Device resource, please ensure # that dird.conf has corresponding changes. # Storage { # definition of myself Name = ecsu-bk3-sd SDPort = 9103 # Director's port WorkingDirectory = /var/lib/bacula Pid Directory = /var/run/bacula Maximum Concurrent Jobs = 20 #SDAddress = 127.0.0.1 SDAddress = ecsu-bk3.easternct.edu } It seems to be OK. ecsu-bk3.easternct.edu will have to be resolved on the client. This is the bacula-dir.conf: # # Default Bacula Director Configuration file # # The only thing that MUST be changed is to add one or more # file or directory names in the Include directive of the # FileSet resource. # # For Bacula release 5.0.2 (28 April 2010) -- ubuntu 10.10 # # You might also want to change the default email address # from root to your address. See the mail and operator # directives in the Messages resource. # Director {# define myself Name = ecsu-bk3-dir DIRport = 9101# where we listen for UA connections QueryFile =
[Bacula-users] incremental backup
Hello I'm new in bacula world so have a question: If i do incremental backup. For example veri big file change only few bytes i it, what bacula do send all file, or only changed part of file? -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] incremental backup
Hi, On Thu, 14 Apr 2011, ruslan usifov wrote: I'm new in bacula world so have a question: If i do incremental backup. For example veri big file change only few bytes i it, what bacula do send all file, or only changed part of file? It backs up the whole file each time a single byte or more changes. Gavin -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] incremental backup
On Thu, Apr 14, 2011 at 11:33:27AM +0400, ruslan usifov wrote: Hello I'm new in bacula world so have a question: If i do incremental backup. For example veri big file change only few bytes i it, what bacula do send all file, or only changed part of file? Bacula will send the whole file. -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] force backup of unchanged file in incremental backup
Am 14.04.2011 08:33, schrieb James Harper: The last modified datestamp on MSSQL database files doesn't get changed unless the actual file dimensions change (eg it 'grows') or when the file is closed. This means that an incremental backup won't necessarily back up the database files unless they have changed. Accurate won't catch this either as the metadata it uses will be identical. Is there a way to force the backup of specific unchanged files during an incremental or differential backup? Eg: Option { File = C:/database/mydb.mdf Always Back Up = Yes } Thanks James Hi, does the file change at all? If so, you can just adjust the metadata that Accurate uses to compare checksums. That is done in the fileset: http://bacula.org/5.0.x-manuals/en/main/main/Configuring_Director.html#8553 Regards, Christian Manal -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] incremental backup
On Thu, Apr 14, 2011 at 08:48:37AM +0100, Gavin McCullagh wrote: Hi, On Thu, 14 Apr 2011, ruslan usifov wrote: I'm new in bacula world so have a question: If i do incremental backup. For example veri big file change only few bytes i it, what bacula do send all file, or only changed part of file? It backs up the whole file each time a single byte or more changes. To be more accurate: It backs up the whole file when its timestamp changes, though I don't recall whether it is the mtime or the ctime. It might be configurable. -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] force backup of unchanged file in incremental backup
On Thu, 14 Apr 2011 09:54:09 +0200, Christian Manal moen...@informatik.uni-bremen.de wrote: Am 14.04.2011 08:33, schrieb James Harper: The last modified datestamp on MSSQL database files doesn't get changed unless the actual file dimensions change (eg it 'grows') or when the file is closed. This means that an incremental backup won't necessarily back up the database files unless they have changed. Accurate won't catch this either as the metadata it uses will be identical. Is there a way to force the backup of specific unchanged files during an incremental or differential backup? Eg: Option { File = C:/database/mydb.mdf Always Back Up = Yes } Thanks James Hi, does the file change at all? If so, you can just adjust the metadata that Accurate uses to compare checksums. That is done in the fileset: http://bacula.org/5.0.x-manuals/en/main/main/Configuring_Director.html#8553 Regards, Christian Manal Hello, AFAIK, you should never backup MSSQL databases when they are running. If you do so, the database will try to recover from a crash and you can loose data pieces. Files do not reflect the status of the database. You should back it up correctly, using a database agent (eg: Litespeed) or SQL scripts to dump it then archive it. If you do so, you will be able to backup transaction log too and will be able to perform PIT restores. You could start from the catalog backup job to adapt it to your needs. For Mysql, there is one interesting way : flush tables with read lock + LVM snapshot. Files are coherent, and backed up at the exact same time. Perhaps you could use a similar way to backup database's files. HTH. Jerome Blion. -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] force backup of unchanged file in incremental backup
If this is a Linux system just use touch to update the timestamps on the file ---Guy (via iPhone) On 14 Apr 2011, at 08:54, Christian Manal moen...@informatik.uni-bremen.de wrote: Am 14.04.2011 08:33, schrieb James Harper: The last modified datestamp on MSSQL database files doesn't get changed unless the actual file dimensions change (eg it 'grows') or when the file is closed. This means that an incremental backup won't necessarily back up the database files unless they have changed. Accurate won't catch this either as the metadata it uses will be identical. Is there a way to force the backup of specific unchanged files during an incremental or differential backup? Eg: Option { File = C:/database/mydb.mdf Always Back Up = Yes } Thanks James Hi, does the file change at all? If so, you can just adjust the metadata that Accurate uses to compare checksums. That is done in the fileset: http://bacula.org/5.0.x-manuals/en/main/main/Configuring_Director.html#8553 Regards, Christian Manal -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] incremental backup
Op 14/04/2011 9:55, Graham Keeling schreef: On Thu, Apr 14, 2011 at 08:48:37AM +0100, Gavin McCullagh wrote: Hi, On Thu, 14 Apr 2011, ruslan usifov wrote: I'm new in bacula world so have a question: If i do incremental backup. For example veri big file change only few bytes i it, what bacula do send all file, or only changed part of file? It backs up the whole file each time a single byte or more changes. To be more accurate: It backs up the whole file when its timestamp changes, though I don't recall whether it is the mtime or the ctime. It might be configurable. During normal operation bacula will check for changes to BOTH mtime and ctime. You can force it to only check mtime with the mtimeonly = yes option but that isn't recommended. DISCLAIMER http://www.schaubroeck.be/maildisclaimer.htm -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] force backup of unchanged file in incremental backup
Am 14.04.2011 08:33, schrieb James Harper: The last modified datestamp on MSSQL database files doesn't get changed unless the actual file dimensions change (eg it 'grows') or when the file is closed. This means that an incremental backup won't necessarily back up the database files unless they have changed. Accurate won't catch this either as the metadata it uses will be identical. Is there a way to force the backup of specific unchanged files during an incremental or differential backup? Eg: Option { File = C:/database/mydb.mdf Always Back Up = Yes } Thanks James Hi, does the file change at all? If so, you can just adjust the metadata that Accurate uses to compare checksums. That is done in the fileset: http://bacula.org/5.0.x-manuals/en/main/main/Configuring_Director.html#8 553 Yes the file changes, so an md5 hash will be sufficient. The databases are only a few hundred MB so the cost of calculating the hash shouldn't be an issue. Unless bacula can use the archive bit, which does get set correctly, this might be the only way. The file _always_ changes between backups, so a fast way to do what I want would be to add a flag to accurate that says assume this file has always changed. I'll post that request on the dev list. Thanks James -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] force backup of unchanged file inincremental backup
Hello, AFAIK, you should never backup MSSQL databases when they are running. If you do so, the database will try to recover from a crash and you can loose data pieces. Files do not reflect the status of the database. VSS by itself assures 'crash consistent' backups, eg the file is in the same state it would be in if the system crashed or if the power was pulled. In addition, the MSSQL VSS writer assures that all databases in the VSS snapshot are in a consistent state, so there are no risks of corruption. You should back it up correctly, using a database agent (eg: Litespeed) or SQL scripts to dump it then archive it. If you do so, you will be able to backup transaction log too and will be able to perform PIT restores. You could start from the catalog backup job to adapt it to your needs. Yes that is better if you need that level of recovery. For Mysql, there is one interesting way : flush tables with read lock + LVM snapshot. Files are coherent, and backed up at the exact same time. Perhaps you could use a similar way to backup database's files. That's more or less what VSS does, except the concept is consistent across the whole platform. James -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] force backup of unchanged file in incrementalbackup
If this is a Linux system just use touch to update the timestamps on the file It's not. MSSQL is MicroSoft SQL, so guess which platforms it runs on :) I'm not sure if a Windows equivalent of 'touch' could work while the database files are open, and even if it did, I'd be reluctant to tinker with it. Thanks James -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] force backup of unchanged file in incremental backup
Am Thu, 14 Apr 2011 16:33:14 +1000 schrieb James Harper: The last modified datestamp on MSSQL database files doesn't get changed unless the actual file dimensions change (eg it 'grows') or when the file is closed. This means that an incremental backup won't necessarily back up the database files unless they have changed. Accurate won't catch this either as the metadata it uses will be identical. Is there a way to force the backup of specific unchanged files during an incremental or differential backup? Eg: Option { File = C:/database/mydb.mdf Always Back Up = Yes } you could create a backup job with just that file in it and run it always as full. - Thomas -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Problem with acl
Hello, We are using bacula for system and datas backup for all our modules here and we have problems for restoring acls. Even with these stanzas in the configuration file, no acls are restored. We have this in our config file: Include { Options { aclsupport = yes xattrsupport = yes @/etc/bacula/include-options.conf } We are using bacula version 5.0.1 in ubuntu. Are we missing something ? Thanks in advance for any clue about this problem. Cordially Laurent Flori EOLE Team http://eole.orion.education.fr/ -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] force backup of unchanged file in incremental backup
On Thu, 14 Apr 2011 12:37:35 + (UTC), Thomas Mueller tho...@chaschperli.ch wrote: Am Thu, 14 Apr 2011 16:33:14 +1000 schrieb James Harper: The last modified datestamp on MSSQL database files doesn't get changed unless the actual file dimensions change (eg it 'grows') or when the file is closed. This means that an incremental backup won't necessarily back up the database files unless they have changed. Accurate won't catch this either as the metadata it uses will be identical. Is there a way to force the backup of specific unchanged files during an incremental or differential backup? Eg: Option { File = C:/database/mydb.mdf Always Back Up = Yes } you could create a backup job with just that file in it and run it always as full. - Thomas I think his goal is to recreate some differential backups for MSSQL (RMAN provides it for Oracle). To do that, he needs to know which datafiles moved... If you perform a touch on each of them, it's not a differential backup but a full one. Are we sure that all data pieces have been flushed to disk before the VSS snapshot occurred ? HTH. Jerome Blion. -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] force backup of unchanged file in incremental backup
Is there a way to force the backup of specific unchanged files during an incremental or differential backup? Eg: Option { File = C:/database/mydb.mdf Always Back Up = Yes } you could create a backup job with just that file in it and run it always as full. - Thomas I think his goal is to recreate some differential backups for MSSQL (RMAN provides it for Oracle). you can't do a Differential or Incremental backup of MSSQL data files. this would require a FD plugin or another tool. To do that, he needs to know which datafiles moved... If you perform a touch on each of them, it's not a differential backup but a full one. Are we sure that all data pieces have been flushed to disk before the VSS snapshot occurred ? yes, MSSQL provides a VSS Plugin. so MSSQL knows when it has to flush to disk. - Thomas -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Admin Job and RunScript
Hello list I've been trying to create an Admin Job to execute a script on the director itself, but the Admin Job simply ignore the RunScript section. I know that Admin Jobs can only run Director Script, not remote Client Script, but my Client is the Director, so, what am I doing wrong? Here's the config: Client { Name = client.ptibacula-dir Address = ptibacula-dir.pti # This is the FQDN of the Director Catalog = cat.default Password = XXX File Retention = 6 months Job Retention = 6 months } Job { Name = job.admin Client = client.ptibacula-dir JobDefs = jobdef.default Type = Admin RunScript { RunsWhen = Before FailJobOnError = Yes Command = /bin/myscript.sh } } JobDefs { Name = jobdef.default Type = Backup Write Bootstrap = /var/lib/bacula/jobs/bootstrap.%c.%n.bsr FileSet = fs.default Messages = msg.default Pool = pool.default Schedule = sch.default Max Start Delay = 48h Spool Data = yes Allow Duplicate Jobs = no Cancel Lower Level Duplicates = yes } P.S.: Documentation on Admin Jobs are really poor... -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Feature idea : Advanced status of a current job;
2011/4/11 Gavin McCullagh gavin.mccull...@gcd.ie: Hi, On Mon, 11 Apr 2011, Hugo Letemplier wrote: I imagine a command like status job jobid= I presume you've looked at status client= It does much of what you want (current job duration, data transferred, rate, num files, current file), but without the predictive information you're looking for (time/data remaining). In principal, if you or bacula ran an estimate beforehand, you could probably work out an estimated time remaining but I don't think that feature is present. Estimates are only available for full backups. *estimate job=CeartgoleorBackups-Job Using Catalog MyCatalog Connecting to Client ceartgoleor-fd at ceartgoleor.:9102 2000 OK estimate files=223,128 bytes=9,724,976,371 Gavin Ok thanks, I will use that for the moment. But this information might be best placed on the director status in my opinion Hugo -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem with acl
On 04/14/2011 02:57 PM, laurent flori wrote: Hello, We are using bacula for system and datas backup for all our modules here and we have problems for restoring acls. Even with these stanzas in the configuration file, no acls are restored. We have this in our config file: Include { Options { aclsupport = yes xattrsupport = yes @/etc/bacula/include-options.conf } We are using bacula version 5.0.1 in ubuntu. Are we missing something ? Thanks in advance for any clue about this problem. Cordially Laurent Flori EOLE Team http://eole.orion.education.fr/ Just be sure where you restore is mounted by a filesystem with acl enable a mount command should show for ext3/4 fs a acl,user_xattr option xfs is native, and also latest btrfs build. -- Bruno Friedmann Ioda-Net Sàrl www.ioda-net.ch openSUSE Member Ambassador GPG KEY : D5C9B751C4653227 irc: tigerfoot -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] A few of questions
When backing up to a disk/RAID system, how do you guys mirror your raid array? If you were to mirror in real-time and something got corrupted it could cause problems on your mirror. Do you mirror once a day? What software do you use to mirror your array? is rsync good enough? When testing bacula I notice restores always expect the client machine to be up so you can restore directly to it. What would you do if the client machine was dead or just not alive on the network? Is there a way to specify a restore point other than the machine itself that the data was originally on? If using vchanger and a jbod setup, if a disk was to fail, how does this failure impact bacula? How would you figure out what was on that drive so you can re-run backups and how would you cleanup the bacula database? thank you all for any information you can provide, mike -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Connection error from remote client
-Original Message- From: Jérôme Blion [mailto:jerome.bl...@free.fr] Sent: Thursday, April 14, 2011 2:41 AM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Connection error from remote client On Wed, 13 Apr 2011 18:45:51 -0400, Kenney, William P. (Information Technology Services) kenn...@easternct.edu wrote: -Original Message- From: Jérôme Blion [mailto:jerome.bl...@free.fr] Sent: Friday, April 08, 2011 9:55 AM To: Kenney, William P. (Information Technology Services) Cc: bacula-users@lists.sourceforge.net Subject: RE: [Bacula-users] Connection error from remote client clip I have tried this address, ecsu-bk3.easternct.edu and the IP address in the address field and get the same error. I have removed the internal FW's during testing and it made no difference. The database contains a bacula user for all hostname addresses that I have used, so that should not be a problem. Bill Hello, From the client, are the following commands working? nslookup ecsu-bk3 telnet ecsu-bk3 9103 Can you confirm me the Storage Daemon and the Director are on the same machine? (I read ecsu-bk3-dir in your message) HTH. Jerome Blion. Hi Jerome, I cleaned up the DNS server annow get only one correct response from nslookup. The Storage daemon and Director are on the same machine. I opened up my.cnf to allow remote access to the database. I added the FQDN and alias to the IP address in the /etc/hosts file. The local client runs just fine but I still get the error message from the second remote client. Below is a listing of the error message and the configuration files I'm using: *** ** This is the error message I received from the Director: You have messages. *messages 13-Apr 18:11 ecsu-bk3-dir JobId 55: Fatal error: No Job status returned from FD. 13-Apr 18:08 ecsu-bk3-dir JobId 55: Warning: bsock.c:129 Could not connect to Client: beast-fd on beast.easternct.edu:9102. ERR=Connection refused Retrying ... 13-Apr 18:11 ecsu-bk3-dir JobId 55: Fatal error: bsock.c:135 Unable to connect to Client: beast-fd on beast.easternct.edu:9102. ERR=Connection refused 13-Apr 18:11 ecsu-bk3-dir JobId 55: Error: Bacula ecsu-bk3-dir 5.0.2 (28Apr10): 13-Apr-2011 18:11:00 Build OS: x86_64-pc-linux-gnu ubuntu 10.10 JobId: 55 Job:BackupClient2.2011-04-13_18.07.58_12 Backup Level: Full (upgraded from Incremental) Client: beast-fd 5.0.0 (26Jan10) x86_64-redhat-linux-gnu,redhat,Enterprise release FileSet:Full Set 2011-04-01 11:44:48 Pool: File (From Job resource) Catalog:MyCatalog (From Client resource) Storage:File (From Job resource) Scheduled time: 13-Apr-2011 18:07:51 Start time: 13-Apr-2011 18:08:00 End time: 13-Apr-2011 18:11:00 Elapsed time: 3 mins Priority: 10 FD Files Written: 0 SD Files Written: 0 FD Bytes Written: 0 (0 B) SD Bytes Written: 0 (0 B) Rate: 0.0 KB/s Software Compression: None VSS:no Encryption: no Accurate: no Volume name(s): Volume Session Id: 3 Volume Session Time:1302731375 Last Volume Bytes: 1,774 (1.774 KB) Non-fatal FD errors:0 SD Errors: 0 FD termination status: Error SD termination status: Waiting on FD Termination:*** Backup Error *** [...] This is the bacula-sd.conf on the backup server # # Default Bacula Storage Daemon Configuration file # # For Bacula release 5.0.2 (28 April 2010) -- ubuntu 10.10 # # You may need to change the name of your tape drive # on the Archive Device directive in the Device # resource. If you change the Name and/or the # Media Type in the Device resource, please ensure # that dird.conf has corresponding changes. # Storage { # definition of myself Name = ecsu-bk3-sd SDPort = 9103 # Director's port WorkingDirectory = /var/lib/bacula Pid Directory = /var/run/bacula Maximum Concurrent Jobs = 20 #SDAddress = 127.0.0.1 SDAddress = ecsu-bk3.easternct.edu } It seems to be OK. ecsu-bk3.easternct.edu will have to be resolved on the client. This is the bacula-dir.conf: # # Default Bacula Director Configuration file # # The only thing that MUST be changed is to add one or more # file or directory names in the Include directive of the # FileSet resource. # # For Bacula release 5.0.2 (28 April 2010) -- ubuntu 10.10
Re: [Bacula-users] A few of questions
When testing bacula I notice restores always expect the client machine to be up so you can restore directly to it. What would you do if the client machine was dead or just not alive on the network? Is there a way to specify a restore point other than the machine itself that the data was originally on? Yes you can restore to any machine. And any location on that machine. When doing a restore in bconsole after you select the job. Type mod then change the client and location. I am not sure what you do in bat since I rarely use that. John -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] A few of questions
On 04/14/2011 03:10 PM, John Drescher wrote: Yes you can restore to any machine. And any location on that machine. When doing a restore in bconsole after you select the job. Type mod then change the client and location. I am not sure what you do in bat since I rarely use that. Works great! Thank you! -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] A few of questions
On 4/14/2011 2:56 PM, Mike Hobbs wrote: ... If using vchanger and a jbod setup, if a disk was to fail, how does this failure impact bacula? How would you figure out what was on that drive so you can re-run backups and how would you cleanup the bacula database? That's not much different than when a tape fails when backing up to tape. If an i/o error occurs, Bacula will fail the job and mark the volume in error. You can query from within bconsole what jobs were on a volume. The difference from tape is that the tape is only one volume, whereas a failed hard drive could contain several volumes. So you would have to re-run jobs that used any of the volumes on that failed drive. With vchanger, a unique magazine number is assigned to every drive, and that magazine number is part of the volume file name, (and barcode label), so it is easy to see which volumes are on which drive. This is a good example of why one should always have at least two backups at all times, whether using tape or disk. -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula-dir.conf - the DirAddress variable
Hi, folks. That's my first message to the bacula-users mailing list. I searched in all the Bacula's documentation and didn't find the answer: In the bacula-dir.conf file there is a variable named DirAddress (the default is 127.0.0.1). I think I should to change to my server's IP, but I'm not sure. --- Director {# define myself Name = server-dir DIRport = 9101# where we listen for UA connections QueryFile = /etc/bacula/scripts/query.sql WorkingDirectory = /var/lib/bacula PidDirectory = /var/run/bacula Maximum Concurrent Jobs = 10 Password = Cv70F6pf1t6pBopT4vQOnigDrR0v3L # Console password Messages = Daemon DirAddress = 127.0.0.1 } --- Thanks in advance. Att, -- Wagner Pereira PoP-SP/RNP - Ponto de Presença da RNP em São Paulo CCE/USP - Centro de Computação Eletrônica da Universidade de São Paulo http://www.pop-sp.rnp.br Tel. +55 11 3091-8901 fone@RNP: 10158902 -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Fwd: Bacula-dir.conf - the DirAddress variable
-- Forwarded message -- From: John Drescher dresche...@gmail.com Date: Thu, Apr 14, 2011 at 5:37 PM Subject: Re: [Bacula-users] Bacula-dir.conf - the DirAddress variable To: Wagner Pereira wpere...@pop-sp.rnp.br That's my first message to the bacula-users mailing list. I searched in all the Bacula's documentation and didn't find the answer: In the bacula-dir.conf file there is a variable named DirAddress (the default is 127.0.0.1). I think I should to change to my server's IP, but I'm not sure. Yes. Change this and ALL instances of 127.0.0.1 or localhost to limit bacula to only the machine that the director runs on. John -- John M. Drescher -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula-dir.conf - the DirAddress variable
On Thu, Apr 14, 2011 at 5:37 PM, John Drescher dresche...@gmail.com wrote: That's my first message to the bacula-users mailing list. I searched in all the Bacula's documentation and didn't find the answer: In the bacula-dir.conf file there is a variable named DirAddress (the default is 127.0.0.1). I think I should to change to my server's IP, but I'm not sure. Yes. Change this and ALL instances of 127.0.0.1 or localhost to limit bacula to only the machine that the director runs on. Sorry my browser locked up because of an addon and I did not send what I intended.. I meant change all instances of 127.0.0.1 and localhost to the external ip address unless you want to limit bacula to only the machine that the director is on. Some over secure distributions supply bacula with default configuration files that cause bacula to be a single machine backup server that can only backup itself and you can only connect to it on the server itself.. John -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] force backup of unchanged file in incrementalbackup
On 14. apr. 2011, at 13.57, James Harper wrote: It's not. MSSQL is MicroSoft SQL, so guess which platforms it runs on :) I'm not sure if a Windows equivalent of 'touch' could work while the database files are open, and even if it did, I'd be reluctant to tinker with it. I have a large, dedicated MS SQL server with a couple dozen databases ranging from a few MBs to several GBs. I dump them with ClientRunBeforeJob scripts and back up the dumps. It's really no different than dumping mysql dbs on the fly. I also have management tasks running which dumps transaction logs at regular intervals throughout the day and back them up at night. Check out the SQLCMD.EXE program installed with SQL Server. If you want I could post some example scripts? Or did I misunderstand something? Tor Willy Austerslått -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Question regarding migrate job failing
Hi List, I have a migrate job setup that will move job id's to an offsite disk based on pool time. This has been working on some of the job id's but on some I have gotten a couple of errors: Volume data Block checksum mismatch and Volume data error at 13:2932697021! wanted id: BB02 got INIT. This happened on a number of the job id's but not all of them. These errors happened on only two of the volumes that it used in the migrate job. Volume hardware-003 and hardware-007. The big question I have is: If these two volumes were copied from one disk to another disk and then back to the original disk would this create a problem with bacula? From a hardware point, none of the disks are showing any errors. I just had a problem with the raid volume that I setup up. They are running in a raid 0 setting, which uses two 1T disks. Thanks for your input. Config definitions: # File Pool definition Pool { Name = HomePool Pool Type = Backup Next Pool = OffsiteMid Recycle = yes # Bacula can automatically recycle Volumes AutoPrune = yes # Prune expired volumes Volume Retention = 7 days # one week Maximum Volume Bytes = 200G# Limit Volume size to something reasonable Migration Time = 5 days# Migrate data older than period of time Maximum Volumes = 5 # Limit number of Volumes in Pool Label Format = home- } # File Pool definition Pool { Name = OffsiteMid Pool Type = Migrate Next Pool = OffsiteMid Storage = midswap Recycle = yes # Bacula can automatically recycle Volumes AutoPrune = yes # Prune expired volumes Volume Retention = 6 months # one week Maximum Volume Bytes = 1800G # Limit Volume size to something reasonable Maximum Volumes = 10 # Limit number of Volumes in Pool } Job { Name = CopyHMDiskToDisk Type = Migrate Level = Full FileSet = Mid Set Client = distress-sd-fd Messages = Standard Storage = home Pool = HomePool Maximum Concurrent Jobs = 4 Selection Type = Pool Time Selection Pattern = homeMS-* } -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] force backup of unchanged file inincrementalbackup
On 14. apr. 2011, at 13.57, James Harper wrote: It's not. MSSQL is MicroSoft SQL, so guess which platforms it runs on :) I'm not sure if a Windows equivalent of 'touch' could work while the database files are open, and even if it did, I'd be reluctant to tinker with it. I have a large, dedicated MS SQL server with a couple dozen databases ranging from a few MBs to several GBs. I dump them with ClientRunBeforeJob scripts and back up the dumps. It's really no different than dumping mysql dbs on the fly. I also have management tasks running which dumps transaction logs at regular intervals throughout the day and back them up at night. Check out the SQLCMD.EXE program installed with SQL Server. If you want I could post some example scripts? Or did I misunderstand something? I don't have space on this particular server to dump out 40GB of database (the database itself is about 80MB but there are lots of FILESTREAM images that would be included in the backup stream). I have found that all I need to do is run a 'CHECKPOINT' to ensure all data is written out to the database. Can you post an example Job with a ClientRunBeforeJob? I just get errors every time I try to do it. Thanks James -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users