Re: [Bacula-users] [Bacula-devel] FYI An annoying GPL catch-22 concerning Bacula
On Friday 08 June 2007 03:29, Ryan Novosielski wrote: Kern Sibbald wrote: On Thursday 07 June 2007 22:27, John Stoffel wrote: Kern As you probably know, Bacula is released with a modified GNU GPL Kern licence. The Bacula license modifies the GPL to permit Bacula Kern to link to OpenSSL. This was necessary because using MySQL Kern libraries requires OpenSSL. This modification was suggested by Kern Debian to bring Bacula in compliance with their procedures. Sounds good so far. Kern The problem comes from including pure GNU GPL code, which is not Kern compatible with the OpenSSL license, inside Bacula itself (there Kern are something like 8 such files). This works in the same way Kern that Debian would not allow Bacula as pure GNU GPL to link with Kern OpenSSL. If Bacula uses any pure GNU GPL code then that code Kern cannot be subject to the GNU GPL modifications, and that code Kern technically cannot linked and distributed with Bacula because of Kern OpenSSL. So which 8 files are these and can they be re-written? Maybe I'm misunderstanding what you mean by Pure GPL code? By pure GPL code, I meant code that has a non-modified GPL license (and is copyrighted by other people). Are these files from software released by the GNU organization? Kern I suspect that a lot of GPL projects are in a similar situation, Kern but they do not explicitly point out the exception as Bacula Kern does. The real bummer here is that this issue was flagged by Kern someone involved in the Fedora packaging process. From what I Kern understand (I may be wrong here), Fedora and hence Red Hat will Kern not use Bacula because it uses some pure GPL code and OpenSSL Kern together raising potential license problems -- after the Kern problems with SCO and threats from Microsoft, their license Kern concerns are quite understandable. Sure, I can understand this. Kern This is not a show-stopping issue because at least for the Kern moment, no author of pure GNU GPL code is lodging a complaint. Kern In addition as I mentioned in a previous email, this issue could Kern potentially be resolved by GPL v3 (due at the end of the month, Kern if I remember right) because it is compatible with the Apache Kern license, which is apparently what OpenSSL uses. Yup, Openssl uses the Apache license. Kern In the mean time, until this problem is resolved, I've freezed Kern all inclusion of new GPL code (copyrighted by others) in Bacula. So basically, you're saying that people who contribute code to bacula under the GPL license (which is what they need to do to get it distributed) can't contribute anymore? Kern The really complicated aspect of the above is that if you build Kern a program such as Bacula using all your own code, and you use Kern OpenSSL then in linking it, you just happen to drag some GPL'ed Kern code from some library directly into your binary (most Kern libararies are shared objects so do not become part of your Kern binary), as is the case with the statically linked Bacula used Kern in the rescue package, you are in violation of the GPL if you Kern distribute such a binary. Ah... now I see, it's the static linking part which causes the problems. Kern It seems that the only solution is that if you use GPL code, you Kern must use *all* GPL compatible code (not so easy), and if you Kern don't use it, you shouldn't even use the system libraries if Kern there is any chance they could be accidentally linked into your Kern program. It's an interesting point for sure. In this case, it all hinges on the OpenSSL people and their use of the Apache license. Which I would assume would actually be a bigger issue since Apache uses that license and I'm SURE that there are alot more Apache setups out there than Bacula. So how does Debian/Fedora work around Apache using the MySQL libraries with the openssl stuff? Or do they just punt because Apache (as they distribute it) only does dynamic linking? Honestly, I think you're over-reacting here to closing down submissions from people. I never said that I was closing down submissions from people. I said that I was not accepting any GPL'ed code. Submissions come from people who have transferred their copyright. Would this only, the, apply to programmers who had written something previously that was applicable to backups and then inserted into Bacula, or perhaps situations in which people wrote code that was intended for Bacula, but then instead of just making it part of the Bacula project, they independently copyrighted it? There is no problem with code written by a Bacula developer who submits it because he has filled out a FLA (i.e. transferred the copyright to FSFE). The problem is in taking code developped by other people that is copyrighted by them and using that code in Bacula without having a copyright
Re: [Bacula-users] Problems using smartmontools as Tape Alert Command
Ryan Novosielski schrieb: Could someone tell me where I'm going wrong here? Here is my line that I've added to the config files, stolen directly from those who know what they're doing: Alert Command = sh -c '/opt/csw/sbin/smartctl -H -l error %c' Try something like this: Alert Command = sh -c 'smartctl -H -d scsi -l error %c' Ralf - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Getting read errors on restore to Windows XP.
Torsdag 07 juni 2007 18:53 skrev Erik P. Olsen: I have 20 tapes full of back-ups of a Linux, a Windows 2000 and a Windows XP system. The Linux system is the back-up server. Bacula version is 1.38.5. The files I want to restore are quite old, so they can be found on several back-ups, however, I get the same read error on each and every back-up I restore from, only the file:blk is different. The error messages can be found below. I have no problem restoring Linux files, From the same volume? so I assume the error message is fake and tells something quite different. Can someone please help me through this problem - if at all possible? It is a major disaster if I can't restore the files. Thanks in advance. 07-Jun 18:34 epo-dir: Start Restore Job RestoreFiles.2007-06-07_18.34.22 07-Jun 18:35 epohost-sd: Please mount Volume EPOL005 on Storage Device DDS-4 (/dev/nst0) for Job RestoreFiles.2007-06-07_18.34.22 07-Jun 18:37 epohost-sd: Ready to read from volume EPOL005 on device DDS-4 (/dev/nst0). 07-Jun 18:37 epohost-sd: Forward spacing to file:block 10:0. 07-Jun 18:37 epohost-sd: RestoreFiles.2007-06-07_18.34.22 Error: block.c:940 Read error at file:blk 10:0 on device DDS-4 (/dev/nst0). ERR=Input/output error. 07-Jun 18:37 epohost-sd: End of Volume at file 10 on device DDS-4 (/dev/nst0), Volume EPOL005 07-Jun 18:37 epohost-sd: End of all volumes. 07-Jun 18:38 epo-dir: Bacula 1.38.5 (18Jan06): 07-Jun-2007 18:38:14 JobId: 1538 Job:RestoreFiles.2007-06-07_18.34.22 Client: epoxp-fd Start time: 07-Jun-2007 18:34:24 End time: 07-Jun-2007 18:38:14 Files Expected: 124 Files Restored: 0 Doesn't look too good Bytes Restored: 0 Rate: 0.0 KB/s FD Errors: 0 FD termination status: OK SD termination status: OK Termination:Restore OK -- warning file count mismatch Are you able to read/restore other jobs/files from the same volume(s) -- regards Steen - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems using smartmontools as Tape Alert Command
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Ralf Gross wrote: Ryan Novosielski schrieb: Could someone tell me where I'm going wrong here? Here is my line that I've added to the config files, stolen directly from those who know what they're doing: Alert Command = sh -c '/opt/csw/sbin/smartctl -H -l error %c' Try something like this: Alert Command = sh -c 'smartctl -H -d scsi -l error %c' I'll certainly give it a shot, but doesn't it look like the %c is never getting expanded to anything? Does anyone know where in the manual these % variables are discussed? - -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGaQWimb+gadEcsb4RAksyAJwMYQ6GmqtgTbB+GJoHbuTMH63VVgCdGBXN vOA8F4nqoRsC4ZGWt63+oRc= =g10u -END PGP SIGNATURE- begin:vcard fn:Ryan Novosielski n:Novosielski;Ryan org:UMDNJ;IST/AST adr;dom:MSB C630;;185 South Orange Avenue;Newark;NJ;07103 email;internet:[EMAIL PROTECTED] title:Systems Programmer III tel;work:(973) 972-0922 tel;fax:(973) 972-7412 tel;pager:(866) 20-UMDNJ x-mozilla-html:FALSE version:2.1 end:vcard - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] volume retention period not working?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Chantal Rosmuller wrote: On Friday 08 June 2007 03:10, Ryan Novosielski wrote: snip I would disagree with that. As far as I know, Use Volume Once has been removed for some time. No I could still set it to yes in this version. Doesn't mean it was doing anything! :) What version is this, by the way - -- you never said. Chantal, I'd want to see at a minimum an llist on the volume in question, just to verify that at the very least the parameters have made it to the volume in the first place. here it is: MediaId: 31 VolumeName: DefaultVolume-0014 Slot: 0 PoolId: 1 MediaType: DDS FirstWritten: 2007-06-08 07:26:01 LastWritten: 2007-06-08 07:26:01 LabelDate: 2007-06-08 07:26:01 VolJobs: 0 VolFiles: 0 VolBlocks: 0 VolMounts: 7 VolBytes: 1 VolErrors: 0 VolWrites: 156,381 VolCapacityBytes: 0 VolStatus: Append Recycle: 1 VolRetention: 7,200 VolUseDuration: 0 MaxVolJobs: 1 MaxVolFiles: 0 MaxVolBytes: 0 InChanger: 1 EndFile: 4 EndBlock: 2,170 VolParts: 0 LabelType: 0 StorageId: 2 status is append at the moment because a backup is running Other than your volume retention being 2 hours, not the 1 hour you had set in the pool (7200 seconds), this looks like what you'd expect. In addition: keep in mind that the volume may very well not show recycled right after the retention time is up. There are some actions that will cause the volume recycling algorithm to be run through -- one would be attempting a backup against the volume, and I believe 'status dir' might be another. Not sure of specifics. Bacula does not, however, throw away the contents of the volume right away on its own -- it attempts to keep the data as long as possible. Any idea how long this takes? Approximately? It will not happen until it is necessary, ie. the next backup begins, or someone uses 'status dir' possibly (which needs to know for reasons I do not recall). Bacula always avoids removing data. In fact, if you have another volume in the pool that is appendable, AFAIK Bacula will never recycle. I am testing Arno's suggestion now, to use Maximum Volume Jobs = 1. I'll let you know what happens. That appears to already be set, but you may have made this change prior to this current run. This morning I noticed another problem, the backup was running for an hour and then I got this message: 08-Jun 02:05 Server-sd: BackupAll.2007-06-08_01.00.00 Error: block.c:538 Write error at 4:2171 on device tape (/dev/nst0). ERR=Input/output error. 08-Jun 02:06 Server-sd: BackupAll.2007-06-08_01.00.00 Error: Error writing final EOF to tape. This Volume may not be readable. dev.c:1542 ioctl MTWEOF error on tape (/dev/nst0). ERR=Input/output error. 08-Jun 02:06 Server-sd: End of medium on Volume DefaultVolume-0014 Bytes=4,139,734,897 Blocks=64,170 at 08-Jun-2007 02:06. then bacula requested another tape, what does this mean? Something wrong with the tape? it is impossible that the tape is full because it's 12G and I backup 4G, and it was definitely not appending the data. Did you ever conduct the btape tests? Generally if this is a nuance of your hardware, the btape tests will turn that up. As far as whether it's the media -- it's often difficult to tell. Changing out for another tape is a way to find out. You might even consider erasing that tape. But I'd only recommend that if you know that the btape tests worked correctly. - -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGaQUumb+gadEcsb4RAkqlAKCVbVGT+lNatbenuhUjUI0ZjGUvjQCfTz+/ XLz5QbceFDxaIjgn2GH6Iqc= =Ebnp -END PGP SIGNATURE- begin:vcard fn:Ryan Novosielski n:Novosielski;Ryan org:UMDNJ;IST/AST adr;dom:MSB C630;;185 South Orange Avenue;Newark;NJ;07103 email;internet:[EMAIL PROTECTED] title:Systems Programmer III tel;work:(973) 972-0922 tel;fax:(973) 972-7412 tel;pager:(866) 20-UMDNJ x-mozilla-html:FALSE version:2.1 end:vcard - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula memory usage
Date: Thu, 07 Jun 2007 21:33:57 -0400 From: Ryan Novosielski [EMAIL PROTECTED] Subject: Re: [Bacula-users] Hardware recommendations To: bacula-users@lists.sourceforge.net Message-ID: [EMAIL PROTECTED] Content-Type: text/plain; charset=iso-8859-1 Message was signed with unknown key 0xD11CB1BE. The validity of the signature cannot be verified. I'm using a Sun UE450 with 3x296MHz and 896MB of RAM. However, the maximum simultaneous number of backups I'm doing is 8, and probably my total aggregate amount of data is less than 100GB for all of the systems together. There was some information on the list relatively recently about optimizing MySQL memory usage, or perhaps making it act somewhat differently to running out of memory. AFAIK, as well, newer versions of bacula are slated to handle this problem better as well. I personally would be somewhat surprised if 2G of RAM on a dedicated machine were too little. I've never tried watching my machine while backups were running, but it seems to me Bacula is fairly lightweight most of the time. Yes, Bacula is rather light weight in memory usage, and in addition, does pretty much minimal copying of data within a daemon. E.g. in the FD, then data is read into a buffer then transmitted to the SD in the same buffer. In the SD, the data comes into a buffer then is copied into a block which is written directly to the tape (unless spooling is enabled). Typical memory usage for the Director is about 100-120K per Job for a backup regardless of the number of files or size of the data involved. However, there was a bug in the MySQL driver that could cause Bacula to lose memory after running a lot of jobs. Even with the memory leak, I had no problem running 80 simultaneous jobs. The MySQL driver memory leak is fixed in the current BETA version. MySQL/PostgreSQL server memory usage is another story typically controlled by their respective conf/ini files. Joseph Wright wrote: I'd like to find out what kind of hardware configurations people are using for their director. I plan to be backing up 50 or more clients with ~250G of data each on a dedicated director with 2G RAM and a 120G SATA drive. I had an issue one night where the director shut down with an out of memory error after the backup jobs started, with only 20 clients. I've since backed off the number of clients and am adding them back in more slowly, as well as distributing the startup times so they don't all start at once. But I'd like to find out if people think my hardware is adequate for the task and it would be interesting to know what others are using. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems using smartmontools as Tape Alert Command
Ryan Novosielski schrieb: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Ralf Gross wrote: Ryan Novosielski schrieb: Could someone tell me where I'm going wrong here? Here is my line that I've added to the config files, stolen directly from those who know what they're doing: Alert Command = sh -c '/opt/csw/sbin/smartctl -H -l error %c' Try something like this: Alert Command = sh -c 'smartctl -H -d scsi -l error %c' I'll certainly give it a shot, but doesn't it look like the %c is never getting expanded to anything? Does anyone know where in the manual these % variables are discussed? It's in 'CHAPTER 28. AUTOCHANGER SUPPORT' ... %c = changer device name ... Of course you can use the device path instead of %c. Ralf - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems using smartmontools as Tape Alert Command
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Ralf Gross wrote: Ryan Novosielski schrieb: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Ralf Gross wrote: Ryan Novosielski schrieb: Could someone tell me where I'm going wrong here? Here is my line that I've added to the config files, stolen directly from those who know what they're doing: Alert Command = sh -c '/opt/csw/sbin/smartctl -H -l error %c' Try something like this: Alert Command = sh -c 'smartctl -H -d scsi -l error %c' I'll certainly give it a shot, but doesn't it look like the %c is never getting expanded to anything? Does anyone know where in the manual these % variables are discussed? It's in 'CHAPTER 28. AUTOCHANGER SUPPORT' ... %c = changer device name ... Of course you can use the device path instead of %c. I don't have an autochanger. Would that mean I'd have to type the path in manually, or use a different variable? - -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGaQi6mb+gadEcsb4RAgQzAKCbs3ODQYi0x8PrnZyKtGZqOVPZSQCdHyxx G3zhWtoKmdrVOVtX0C4zC3E= =CbWF -END PGP SIGNATURE- begin:vcard fn:Ryan Novosielski n:Novosielski;Ryan org:UMDNJ;IST/AST adr;dom:MSB C630;;185 South Orange Avenue;Newark;NJ;07103 email;internet:[EMAIL PROTECTED] title:Systems Programmer III tel;work:(973) 972-0922 tel;fax:(973) 972-7412 tel;pager:(866) 20-UMDNJ x-mozilla-html:FALSE version:2.1 end:vcard - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] volume retention period not working?
snip then bacula requested another tape, what does this mean? Something wrong with the tape? it is impossible that the tape is full because it's 12G and I backup 4G, and it was definitely not appending the data. Did you ever conduct the btape tests? Generally if this is a nuance of your hardware, the btape tests will turn that up. As far as whether it's the media -- it's often difficult to tell. Changing out for another tape is a way to find out. You might even consider erasing that tape. But I'd only recommend that if you know that the btape tests worked correctly. Yes I did, the test showed no problems. I am succesfully making backups so there can't be anything wrong with the hardware. But it has to start working without user interference. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems using smartmontools as Tape Alert Command
Ryan Novosielski novosirj at umdnj.edu writes: Ralf Gross wrote: Ryan Novosielski schrieb: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Ralf Gross wrote: Ryan Novosielski schrieb: Could someone tell me where I'm going wrong here? Here is my line that I've added to the config files, stolen directly from those who know what they're doing: Alert Command = sh -c '/opt/csw/sbin/smartctl -H -l error %c' Try something like this: Alert Command = sh -c 'smartctl -H -d scsi -l error %c' I'll certainly give it a shot, but doesn't it look like the %c is never getting expanded to anything? Does anyone know where in the manual these % variables are discussed? It's in 'CHAPTER 28. AUTOCHANGER SUPPORT' ... %c = changer device name ... Of course you can use the device path instead of %c. I don't have an autochanger. Would that mean I'd have to type the path in manually, or use a different variable? You've got to solutions: 1/ The answer is in the manual too: 'Chapter 14: Alert Command' (bottom of page 228 of bacula.pdf v2.0.3): you will need to specify a Changer Device directive in your Device resource (...) so that the generic SCSI device name can be edited into the command (with the %c). 2/ The second one, more elegant, as you do not have to define a ChangerDevice= directive for a device that is not an autochanger, is to modify the AlertCommand= and replace the '%c' with '%a' that is the subtitution for the archive device name (as stated in the manual (chapter 28.5 bottom of page 409 and other places as well). This way Bacula will substitute '%a' with the actual value of the ArchiveDevice= directive in your SD.conf file before it is sent to the OS for execution. -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |novosirj at umdnj.edu - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 Attachment (novosirj.vcf): text/x-vcard, 306 bytes - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users at lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems using smartmontools as Tape Alert Command
Ryan Novosielski schrieb: Alert Command = sh -c '/opt/csw/sbin/smartctl -H -l error %c' Try something like this: Alert Command = sh -c 'smartctl -H -d scsi -l error %c' I'll certainly give it a shot, but doesn't it look like the %c is never getting expanded to anything? Does anyone know where in the manual these % variables are discussed? It's in 'CHAPTER 28. AUTOCHANGER SUPPORT' ... %c = changer device name ... Of course you can use the device path instead of %c. I don't have an autochanger. Would that mean I'd have to type the path in manually, or use a different variable? First I would try the command on the command line. I think you can use %a for the archive device. 14.3. DEVICE RESOURCE Alert Command ... Note, it is not necessary to have an autochanger to use this command. The example below uses the tapeinfo program that comes with the mtx package, but it can be used on any tape drive. However, you will need to specify a Changer Device directive in your Device resource (see above) so that the generic SCSI device name can be edited into the command (with the %c). Ralf - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] store data on two storages at one time
Ryan Novosielski schrieb: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 For what reason? Load balancing? What are these two storages, tape drives? I don't know how to answer this question with the small amount of information you have provided. hello Ryan, thank for your answer. I the 2 Storages are 2 Servers which stores the data on harddisks. Just i need an solution to store the same data on more than one storage. And i don't want run 2 job for this. Because the filedaemon then read the data twice for the same Backup. Any Idears for an nice solution? regards Maik Maik Derstappen wrote: hello, is there an solution to storage the data which we will backup on more then one storage? for example: when the job is running: == storage A bacula-fd == == storage B thans for any answer :-) regards Maik -- DerstappenI T Consulting Tel: +49 ( 180 ) 1 777 555 74 26 Zope/E-Mail/Backup/Monitoring Mobil: +49 ( 178 ) 861 2833 M a i k D e r s t a p p e n Fax: +49 ( 180 ) 5 021 121 90 56 H e r l o ß s o h n s t r 12 Email: [EMAIL PROTECTED] 0 4 1 5 5 L e i p z i g Internet:http://www.derstappen-it.de - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] volume retention period not working?
Hi, On 6/8/2007 3:10 AM, Ryan Novosielski wrote: ... recycling volumes... You've got Use Volume Once = yes|no This directive if set to yes specifies that each volume is to be used only once. This is most useful when the Media is a file and you want a new file for each backup that is done. The default is no (i.e. use volume any number of times). This directive will most likely be phased out (deprecated), so you are recommended to use Maximum Volume Jobs = 1 instead. Set which effectively disables volume recycling. Remove that directive, reload the configuration, update the existing volumes from the pool resource, , and see what happens... I would disagree with that. As far as I know, Use Volume Once has been removed for some time. However, the replacement (Maximum Volume Jobs = 1) I use on my system to cause volumes to be marked used after one use. However, this does not affect recycling in my situation. I somehow had the impression that the deprecated directive also prvented recycling, but admittedly, I never tried it. The recommended options clearly separate number of jobs and recycling settings, THAT I know because I use it :-) I would suggest the original poster may have forgotten to update volumes (having created the volume before the current pool directives were in place). Quite possible... Chantal, I'd want to see at a minimum an llist on the volume in question, just to verify that at the very least the parameters have made it to the volume in the first place. In addition: keep in mind that the volume may very well not show recycled right after the retention time is up. There are some actions that will cause the volume recycling algorithm to be run through -- one would be attempting a backup against the volume, and I believe 'status dir' might be another. Not sure of specifics. Bacula does not, however, throw away the contents of the volume right away on its own -- it attempts to keep the data as long as possible. Arno -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] volume retention period not working?
snip I would suggest the original poster may have forgotten to update volumes (having created the volume before the current pool directives were in place). Quite possible... snip No sorry guys, I didn't forget :). I posted the last records of list media remember? I don't have time to test now but tomorrow I will, I changed use volume once into no maximum volume jobs into 1 and I manually set all appendable volumes to Used Chantal - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bug when launching subscribe/unsubscribe URL.
Hi, On 6/8/2007 10:57 AM, Erik P. Olsen wrote: When I launch https://lists.sourceforge.net/lists/listinfo/bacula-users in order to change my preferences I run into a Mailman 2.1.8 bug. To whome should I report this bug? Might be best reported to the sourfeforge folks. I just verified the problem and filed a report. Arno -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] volume retention period not working?
Hi, On 6/8/2007 12:06 PM, Chantal Rosmuller wrote: On Friday 08 June 2007 09:28, Ryan Novosielski wrote: snip It will not happen until it is necessary, ie. the next backup begins, or someone uses 'status dir' possibly (which needs to know for reasons I do not recall). To determine which volumes will be used. Bacula always avoids removing data. In fact, if you have another volume in the pool that is appendable, AFAIK Bacula will never recycle. wait a minute are you serious? I have lots of appendable volumes! i just relabeled a bunch of tapes: list media: | 23 | DefaultVolume-0006 | Append| 1 |0 | 7,200 | 1 |0 | 1 | DDS | -00-00 00:00:00 | | 24 | DefaultVolume-0007 | Append| 1 |0 | 7,200 | 1 |0 | 1 | DDS | -00-00 00:00:00 | | 25 | DefaultVolume-0008 | Append| 1 |0 | 7,200 | 1 |0 | 1 | DDS | -00-00 00:00:00 | | 26 | DefaultVolume-0009 | Append| 1 |0 | 7,200 | 1 |0 | 1 | DDS | -00-00 00:00:00 | | 27 | DefaultVolume-0010 | Append| 1 |0 | 7,200 | 1 |0 | 1 | DDS | -00-00 00:00:00 | | 28 | DefaultVolume-0011 | Append| 1 |0 | 7,200 | 1 |0 | 1 | DDS | -00-00 00:00:00 | | 29 | DefaultVolume-0012 | Purged| 2,644,475,759 |3 | 7,200 | 1 |0 | 1 | DDS | 2007-06-07 12:44:55 | | 30 | DefaultVolume-0013 | Used | 1,971,864,651 |2 | 7,200 | 1 |0 | 1 | DDS | 2007-06-05 17:06:45 | | 31 | DefaultVolume-0014 | Used | 4,764,121,146 |5 | 7,200 | 1 |0 | 1 | DDS | 2007-06-08 08:37:45 | | 32 | DefaultVolume-0015 | Used | 4,755,372,018 |5 | 7,200 | 1 |0 | 1 | DDS | 2007-06-07 16:05:15 | +-++---++--+--+-+--+---+---+-+ So what to do, should I change their status to Used? No. These volumes are not usd yet, and then Append is the correct state for them. In fact, I don't quite understand your problem now... it seems that, even if you've got lots of usable (i.e. Append) volumes available you want to recycle other volumes. That's not how Bacula prefers to work. If you want to make sure that Bacula tries using whatever is loaded in the tape drive, Recycle current volume might help you, but should be used with care. Arno Chantal - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] volume retention period not working?
On Friday 08 June 2007 13:03, Arno Lehmann wrote: Hi, On 6/8/2007 12:06 PM, Chantal Rosmuller wrote: On Friday 08 June 2007 09:28, Ryan Novosielski wrote: snip It will not happen until it is necessary, ie. the next backup begins, or someone uses 'status dir' possibly (which needs to know for reasons I do not recall). To determine which volumes will be used. Bacula always avoids removing data. In fact, if you have another volume in the pool that is appendable, AFAIK Bacula will never recycle. wait a minute are you serious? I have lots of appendable volumes! i just relabeled a bunch of tapes: list media: | 23 | DefaultVolume-0006 | Append| 1 |0 | 7,200 | 1 |0 | 1 | DDS | -00-00 00:00:00 | | 24 | DefaultVolume-0007 | Append| 1 |0 | 7,200 | 1 |0 | 1 | DDS | -00-00 00:00:00 | | 25 | DefaultVolume-0008 | Append| 1 |0 | 7,200 | 1 |0 | 1 | DDS | -00-00 00:00:00 | | 26 | DefaultVolume-0009 | Append| 1 |0 | 7,200 | 1 |0 | 1 | DDS | -00-00 00:00:00 | | 27 | DefaultVolume-0010 | Append| 1 |0 | 7,200 | 1 |0 | 1 | DDS | -00-00 00:00:00 | | 28 | DefaultVolume-0011 | Append| 1 |0 | 7,200 | 1 |0 | 1 | DDS | -00-00 00:00:00 | | 29 | DefaultVolume-0012 | Purged| 2,644,475,759 |3 | 7,200 | 1 |0 | 1 | DDS | 2007-06-07 12:44:55 | | 30 | DefaultVolume-0013 | Used | 1,971,864,651 |2 | 7,200 | 1 |0 | 1 | DDS | 2007-06-05 17:06:45 | | 31 | DefaultVolume-0014 | Used | 4,764,121,146 |5 | 7,200 | 1 |0 | 1 | DDS | 2007-06-08 08:37:45 | | 32 | DefaultVolume-0015 | Used | 4,755,372,018 |5 | 7,200 | 1 |0 | 1 | DDS | 2007-06-07 16:05:15 | +-++---++--+- -+-+--+---+---+--- --+ So what to do, should I change their status to Used? No. These volumes are not usd yet, and then Append is the correct state for them. In fact, I don't quite understand your problem now... it seems that, even if you've got lots of usable (i.e. Append) volumes available you want to recycle other volumes. That's not how Bacula prefers to work. If you want to make sure that Bacula tries using whatever is loaded in the tape drive, Recycle current volume might help you, but should be used with care. Arno Hi Arno, Yes it is absolutely necessary that bacula uses the tape that is in the drive, That is what the customer wants. They want to switch the tapes every day themselves but when they forget they still want a new backup to be made. I noticed that that's not exactly the bacula logic, but it should be possible I think. Chantal - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] RunBeforeJob / RunRightBeforeWrite question
I've been following the thread about waiting 40 minutes, and the suggestion to perform a RunBeforeJob seems to be the current solution. I have been running Mondo as a disaster recovery solution. It has a function that comes in handy here whereas it will perform a task just before writing it's ISO images. I am guessing that the RunBeforeJob in Bacula runs before even deciding what files it will back up. As I write to a Samba mount which need awaken before writing to it, and if Bacula takes a little bit of time to decide on and transfer files, is there a way to nudge the mount just before any writes to it? I realize this is not the same situation, but I could buffer the writes to disk before writing to the mount. (I seem to recall there is this buffering option in Bacula). Thanks for any advice. Blackbeard - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula memory usage
It seems that the resources used by the database should be taken into account when looking at Bacula's memory usage, because even though the two are separate, the director is the one putting the records there. Maybe I should re-ask the question as: How heavily does Bacula tax the database with 50 or more clients being backed up concurrently, and what kind of hardware is recommended for such a situation? (\_/) (o,o) ()_() Joseph Wright On Jun 8, 2007, at 12:35 AM, Kern Sibbald wrote: Date: Thu, 07 Jun 2007 21:33:57 -0400 From: Ryan Novosielski [EMAIL PROTECTED] Subject: Re: [Bacula-users] Hardware recommendations To: bacula-users@lists.sourceforge.net Message-ID: [EMAIL PROTECTED] Content-Type: text/plain; charset=iso-8859-1 Message was signed with unknown key 0xD11CB1BE. The validity of the signature cannot be verified. I'm using a Sun UE450 with 3x296MHz and 896MB of RAM. However, the maximum simultaneous number of backups I'm doing is 8, and probably my total aggregate amount of data is less than 100GB for all of the systems together. There was some information on the list relatively recently about optimizing MySQL memory usage, or perhaps making it act somewhat differently to running out of memory. AFAIK, as well, newer versions of bacula are slated to handle this problem better as well. I personally would be somewhat surprised if 2G of RAM on a dedicated machine were too little. I've never tried watching my machine while backups were running, but it seems to me Bacula is fairly lightweight most of the time. Yes, Bacula is rather light weight in memory usage, and in addition, does pretty much minimal copying of data within a daemon. E.g. in the FD, then data is read into a buffer then transmitted to the SD in the same buffer. In the SD, the data comes into a buffer then is copied into a block which is written directly to the tape (unless spooling is enabled). Typical memory usage for the Director is about 100-120K per Job for a backup regardless of the number of files or size of the data involved. However, there was a bug in the MySQL driver that could cause Bacula to lose memory after running a lot of jobs. Even with the memory leak, I had no problem running 80 simultaneous jobs. The MySQL driver memory leak is fixed in the current BETA version. MySQL/PostgreSQL server memory usage is another story typically controlled by their respective conf/ini files. Joseph Wright wrote: I'd like to find out what kind of hardware configurations people are using for their director. I plan to be backing up 50 or more clients with ~250G of data each on a dedicated director with 2G RAM and a 120G SATA drive. I had an issue one night where the director shut down with an out of memory error after the backup jobs started, with only 20 clients. I've since backed off the number of clients and am adding them back in more slowly, as well as distributing the startup times so they don't all start at once. But I'd like to find out if people think my hardware is adequate for the task and it would be interesting to know what others are using. -- --- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Problems using smartmontools as Tape Alert
Hello, Date: Fri, 08 Jun 2007 03:30:43 -0400 From: Ryan Novosielski [EMAIL PROTECTED] Subject: Re: [Bacula-users] Problems using smartmontools as Tape Alert Command To: bacula-users@lists.sourceforge.net Message-ID: [EMAIL PROTECTED] Content-Type: text/plain; charset=iso-8859-1 Message was signed with unknown key 0xD11CB1BE. The validity of the signature cannot be verified. Ralf Gross wrote: Ryan Novosielski schrieb: Could someone tell me where I'm going wrong here? Here is my line that I've added to the config files, stolen directly from those who know what they're doing: Alert Command = sh -c '/opt/csw/sbin/smartctl -H -l error %c' The original command given just above is probably correct, but I imagine the user is not using an Autochanger and hence forgot to add the Changer Device directive (the name is not totally appropriate in this particular case) that tells Bacula where to find the control device (%c). Try something like this: Alert Command = sh -c 'smartctl -H -d scsi -l error %c' I'll certainly give it a shot, but doesn't it look like the %c is never getting expanded to anything? Does anyone know where in the manual these % variables are discussed? -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems using smartmontools as Tape Alert Command
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Marc Levy wrote: Ryan Novosielski novosirj at umdnj.edu writes: Ralf Gross wrote: Ryan Novosielski schrieb: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Ralf Gross wrote: Ryan Novosielski schrieb: Could someone tell me where I'm going wrong here? Here is my line that I've added to the config files, stolen directly from those who know what they're doing: Alert Command = sh -c '/opt/csw/sbin/smartctl -H -l error %c' Try something like this: Alert Command = sh -c 'smartctl -H -d scsi -l error %c' I'll certainly give it a shot, but doesn't it look like the %c is never getting expanded to anything? Does anyone know where in the manual these % variables are discussed? It's in 'CHAPTER 28. AUTOCHANGER SUPPORT' ... %c = changer device name ... Of course you can use the device path instead of %c. I don't have an autochanger. Would that mean I'd have to type the path in manually, or use a different variable? You've got to solutions: 1/ The answer is in the manual too: 'Chapter 14: Alert Command' (bottom of page 228 of bacula.pdf v2.0.3): you will need to specify a Changer Device directive in your Device resource (...) so that the generic SCSI device name can be edited into the command (with the %c). 2/ The second one, more elegant, as you do not have to define a ChangerDevice= directive for a device that is not an autochanger, is to modify the AlertCommand= and replace the '%c' with '%a' that is the subtitution for the archive device name (as stated in the manual (chapter 28.5 bottom of page 409 and other places as well). This way Bacula will substitute '%a' with the actual value of the ArchiveDevice= directive in your SD.conf file before it is sent to the OS for execution. Thanks for the ideas -- I should have looked there in the manual, but I didn't expect the Alert Command to have such an elaborate description in the manual -- I suppose that will teach me to underestimate it. ;) Thanks to all of those that responded -- hopefully this will make things a little easier, too, for those that search the list archives for an answer. - -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGaWWcmb+gadEcsb4RAh17AJ46rXYHiB5oNelgeFDtp1FYKXMKTQCgoW7G LpL5CrsqbhwD7BC75GGD86E= =Lr0a -END PGP SIGNATURE- begin:vcard fn:Ryan Novosielski n:Novosielski;Ryan org:UMDNJ;IST/AST adr;dom:MSB C630;;185 South Orange Avenue;Newark;NJ;07103 email;internet:[EMAIL PROTECTED] title:Systems Programmer III tel;work:(973) 972-0922 tel;fax:(973) 972-7412 tel;pager:(866) 20-UMDNJ x-mozilla-html:FALSE version:2.1 end:vcard - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] authentication problems
Provide us with the output of the following (URL not attachment -
pastebin or something)
$ bacula-sd -vsf -d9
Paste only the parts just before, and as you type status storage on
the dir..
~BAS
On Mon, 2007-04-09 at 19:46 -0700, RYAN M. vAN GINNEKEN wrote:
Ok folks i am at my wits end here have been struggliing with this for
a couple of days now it used to work but i made a few minor changes to
the conf files and now bacula is broken.
Please help It must be a minor typo or something but i cannot for the
life of me see it. HELP
Here is the relevant bits of my bacula-sd.conf
Storage { # definition of myself
Name = hendrick-sd
SDPort = 9103 # Director's port
WorkingDirectory = /var/db/bacula
Pid Directory = /var/run
Maximum Concurrent Jobs = 20
}
#
# List Directors who are permitted to contact Storage daemon
#
Director {
Name = hendrick-dir
Password = c0mputerking-st0rage
# Password = c0mputerking-m0nit0r
}
#
# Restricted Director, used by tray-monitor to get the
# status of the storage daemon
#
Director {
Name = hendrick-mon
Password = c0mputerking-m0nit0r
Monitor = yes
}
#
# Devices supported by this Storage daemon
# To connect, the Director's bacula-dir.conf must have the
# same Name and MediaType.
#
Device {
Name = FileStorage
Media Type = File
Archive Device = /space/bacula
LabelMedia = yes; # lets Bacula label unlabeled
media
Random Access = Yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = no;
AlwaysOpen = no;
}
here are the good bits of my bacula-dir.conf
---
as you can see i have tried several address none seem to work
Storage {
Name = hendrick-sd
# Address = 127.0.0.1# N.B. Use a fully qualified
name here
# Address = 192.168.0.24 # be very careful here
# Address = 209.115.169.135
Address = webmail.hendrick.ca
SDPort = 9103
Password = c0mputerking-st0rage
Device = FileStorage
Media Type = File
}
I always get this when trying to connect
Connecting to Storage daemon hendrick-sd at webmail.hendrick.ca:9103
Failed to connect to Storage daemon hendrick-sd.
You have messages.
*au on
09-Apr 20:58 hendrick-dir: *Console*.2007-04-09_20.58.17 Fatal error:
authenticate.c:92 Unable to authenticate with Storage daemon. Possible
causes:
Passwords or names not the same or
Maximum Concurrent Jobs exceeded on the SD or
SD networking messed up (restart daemon).
Please see
http://www.bacula.org/html-manual/faq.html#AuthorizationErrors for
help.
I can ping the host, and everything is local so iptables should not be
a problem
webmail:/etc/bacula# ping webmail.hendrick.ca
PING webmail.hendrick.ca (209.115.169.132): 56 data bytes
64 bytes from 209.115.169.132: icmp_seq=0 ttl=64 time=0.0 ms
ps here are the version #'s it is old but it is what i get when i do
an apt-get install bacula. This box is Debian something i did not set
it up or know alot about debian but this all a uname -a gives me
webmail:/etc/bacula# uname -a
Linux webmail 2.6.20 #3 SMP Fri Mar 30 16:15:10 MST 2007 i686
GNU/Linux
Bacula
*version
hendrick-dir Version: 1.36.2 (28 February 2005)
ps i get the comparable errors when it try to stat fd too..
*au on
09-Apr 21:05 hendrick-dir: *Console*.2007-04-09_21.04.29 Fatal error:
Unable to authenticate with File daemon. Possible causes:
Passwords or names not the same or
Maximum Concurrent Jobs exceeded on the FD or
FD networking messed up (restart daemon).
Please see
http://www.bacula.org/html-manual/faq.html#AuthorizationErrors for
help.
--
Computer King CaN Mail - Sales Service Hosting Backup
http://www.computerking.ca http://www.canmail.org
NEW!!! Custom Service Packages
Secure IMAP Email - Automated Remote Backups - Photo Blogs - Online
Accounting Packages
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___ Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Brian A. Seklecki [EMAIL PROTECTED]
Collaborative Fusion, Inc.
IMPORTANT: This message contains confidential information and is intended only
for the individual named. If the reader of this message is not an intended
recipient (or the individual responsible for the delivery of this message to an
intended recipient), please be advised that any re-use, dissemination,
distribution or copying of this message is prohibited. Please
Re: [Bacula-users] define a variable in a conf file
If not, perhaps you can seperate your filesets{} into a filesets.conf
that you include from bacula-dir.conf and pre-processes them using
something like M4 or even just sed+make(1)
~BAS
On Tue, 2007-04-10 at 12:24 -0400, Brian Debelius wrote:
Can I? How?
I am really getting tired of handling strings like C:\Documents and
Settings\All Users\Bacula\whatever in windows. Is that a way to set a
variable in a conf file like path=C:\Documents and Settings\All
Users\Bacula\whatever
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Brian A. Seklecki [EMAIL PROTECTED]
Collaborative Fusion, Inc.
IMPORTANT: This message contains confidential information and is intended only
for the individual named. If the reader of this message is not an intended
recipient (or the individual responsible for the delivery of this message to an
intended recipient), please be advised that any re-use, dissemination,
distribution or copying of this message is prohibited. Please notify the
sender immediately by e-mail if you have received this e-mail by mistake and
delete this e-mail from your system.
-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula memory usage
In response to Joseph Wright [EMAIL PROTECTED]: It seems that the resources used by the database should be taken into account when looking at Bacula's memory usage, because even though the two are separate, the director is the one putting the records there. Maybe I should re-ask the question as: How heavily does Bacula tax the database with 50 or more clients being backed up concurrently, and what kind of hardware is recommended for such a situation? If you've got 50 jobs running simultaneously, you're liable to need a massive DB server. Unfortunately, however, that's not enough information to be sure. The real load on the DB server is (mostly) determined by two factors. 1) The number of files being backed up. 2) The amount of duplication in pathnames and filenames. If each backup job is 1000s of tiny files, you're going to be working the database pretty hard, as each of those files will require that a record be written to the database. If filenames and pathnames change often, that will require that additional database records be written for each file saved. For a file that has a name never used before in a directory never backed up before, you have 3 database records created. On the flip side, if you're filesets consist largely of the same files that are constantly being edited, and your average filesize is large, you'll find that the speed of your storage media will slow you down and the database will have no trouble keeping up. I suspect that's part of the reason that there are no published hardware requirements for Bacula. The hardware requirements aren't really for Bacula, their for your specific workload. Regardless of all that, if you really mean to run 50 jobs in parallel (i.e. at the same time, not just 50 jobs in series) I would recommend that you get a dedicated DB server with about 12 disks arranged in a RAID 10 and a battery-backed cache. If you can run the jobs in series, then just about any reasonably powered server hardware should suffice. -- Bill Moran http://www.potentialtech.com - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't connect to director (Windows)
On Tue, 2007-04-10 at 12:08 -0300, Facundo Casco wrote: can't connect to the director. Where is this error from? The File Daemon? What components are you trying to run on Windows? More details please. -- Brian A. Seklecki [EMAIL PROTECTED] Collaborative Fusion, Inc. IMPORTANT: This message contains confidential information and is intended only for the individual named. If the reader of this message is not an intended recipient (or the individual responsible for the delivery of this message to an intended recipient), please be advised that any re-use, dissemination, distribution or copying of this message is prohibited. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Newbie problem
Did you ever get this resolved? I just saw this error. Restarting my SD worked. We're on 1.3.xx Foo (/mnt/bacula/BACULA/) is busy (already reading/writing). Rght. No other jobs are running. Gotta love it. I'll grawk through the code later. On Wed, 2007-04-11 at 10:49 +0200, MasterBrian wrote: Restore Job MC_LAN_FS1_-_Full_-_Restore.2007-04-11_10.27.12 waiting for Client connection. -- Brian A. Seklecki [EMAIL PROTECTED] Collaborative Fusion, Inc. IMPORTANT: This message contains confidential information and is intended only for the individual named. If the reader of this message is not an intended recipient (or the individual responsible for the delivery of this message to an intended recipient), please be advised that any re-use, dissemination, distribution or copying of this message is prohibited. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Mysteriously failing jobs
Arno Lehmann wrote: Or, alternatively, using tcpdump to find if the sequence numbers get out of sync somewhere, which would cause a RST on both ends. Okay, I got a tcpdump and logfile of -d1000 on the fd. I'm a little rusty debugging TCP issues by hand, but I couldn't find anything that looked too out of the ordinary. In the logfile, the only thing that looked strange to me were these messages (extra linebreaks added for readability): ivanova-fd: backup.c:876 Send data to SD len=65536 ivanova-fd: message.c:606 Enter dispatch_msg type=4 msg=ivanova-fd: ERROR in openssl.c:74 TLS read/write failure.: ERR=error:140943FC:SSL routines:SSL3_READ_BYTES:sslv3 alert bad record mac ivanova-fd: message.c:768 DIRECTOR for following msg: ivanova-fd: ERROR in openssl.c:74 TLS read/write failure.: ERR=error:140943FC:SSL routines:SSL3_READ_BYTES:sslv3 alert bad record mac ivanova-fd: heartbeat.c:90 Got BNET_SIG 0 from SD ivanova-fd: heartbeat.c:95 wait_intr=1 stop=1 ivanova-fd: backup.c:876 Send data to SD len=65536 The tcpdump and log files are at http://erwin.wpi.edu/~fs/bacula-crash/ if anyone wants to take a closer look and see if I've missed anything. They're about 14M total. Anyone have any other ideas, or do I need to file a bug report on this one? -- Frank Sweetser fs at wpi.edu | For every problem, there is a solution that WPI Senior Network Engineer | is simple, elegant, and wrong. - HL Mencken GPG fingerprint = 6174 1257 129E 0D21 D8D4 E8A3 8E39 29E3 E2E8 8CEC - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] mystery about Recycling
I perceived an interesting problem of the Bacula here in my server. I receive a message that it needs intervention of the user to recycle a volume to continue backup. As soon as I enter in the console, bacula carry through the routine of pruned and recycling. Somebody knows how to solve this problem? -- View this message in context: http://www.nabble.com/mystery-about-Recycling-tf3889865.html#a11026614 Sent from the Bacula - Users mailing list archive at Nabble.com. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems using smartmontools as Tape Alert Command
On 08.06.2007 16:20, Ryan Novosielski wrote: Marc Levy wrote: Ryan Novosielski novosirj at umdnj.edu writes: Ralf Gross wrote: Ryan Novosielski schrieb: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Ralf Gross wrote: Ryan Novosielski schrieb: Could someone tell me where I'm going wrong here? Here is my line that I've added to the config files, stolen directly from those who know what they're doing: Alert Command = sh -c '/opt/csw/sbin/smartctl -H -l error %c' Try something like this: Alert Command = sh -c 'smartctl -H -d scsi -l error %c' I'll certainly give it a shot, but doesn't it look like the %c is never getting expanded to anything? Does anyone know where in the manual these % variables are discussed? It's in 'CHAPTER 28. AUTOCHANGER SUPPORT' ... %c = changer device name ... Of course you can use the device path instead of %c. I don't have an autochanger. Would that mean I'd have to type the path in manually, or use a different variable? You've got to solutions: 1/ The answer is in the manual too: 'Chapter 14: Alert Command' (bottom of page 228 of bacula.pdf v2.0.3): you will need to specify a Changer Device directive in your Device resource (...) so that the generic SCSI device name can be edited into the command (with the %c). 2/ The second one, more elegant, as you do not have to define a ChangerDevice= directive for a device that is not an autochanger, is to modify the AlertCommand= and replace the '%c' with '%a' that is the subtitution for the archive device name (as stated in the manual (chapter 28.5 bottom of page 409 and other places as well). This way Bacula will substitute '%a' with the actual value of the ArchiveDevice= directive in your SD.conf file before it is sent to the OS for execution. I dare say - without having checked this version, but fought with Alert Command for a while - that this wont work. When bacula is executing the Alert Command the storage daemon is using the tape and thus preventing the smartcl to access the tape device. So you are either back to solution number 1 (having to add a changer device when not having an autochanger) or you have to replace the %c with the name of the generic scsi-device of the tape drive (using linux the name is something like /dev/sg4) By the way: I would recommend to use this form *especially* when using multidrive autochangers or you will only ask the changer for its status while asking the tape gives more and more useful information. Thanks for the ideas -- I should have looked there in the manual, but I didn't expect the Alert Command to have such an elaborate description in the manual -- I suppose that will teach me to underestimate it. ;) Thanks to all of those that responded -- hopefully this will make things a little easier, too, for those that search the list archives for an answer. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems using smartmontools as Tape Alert Command
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Andreas Helmcke wrote: On 08.06.2007 16:20, Ryan Novosielski wrote: Marc Levy wrote: Ryan Novosielski novosirj at umdnj.edu writes: Ralf Gross wrote: Ryan Novosielski schrieb: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Ralf Gross wrote: Ryan Novosielski schrieb: Could someone tell me where I'm going wrong here? Here is my line that I've added to the config files, stolen directly from those who know what they're doing: Alert Command = sh -c '/opt/csw/sbin/smartctl -H -l error %c' Try something like this: Alert Command = sh -c 'smartctl -H -d scsi -l error %c' I'll certainly give it a shot, but doesn't it look like the %c is never getting expanded to anything? Does anyone know where in the manual these % variables are discussed? It's in 'CHAPTER 28. AUTOCHANGER SUPPORT' ... %c = changer device name ... Of course you can use the device path instead of %c. I don't have an autochanger. Would that mean I'd have to type the path in manually, or use a different variable? You've got to solutions: 1/ The answer is in the manual too: 'Chapter 14: Alert Command' (bottom of page 228 of bacula.pdf v2.0.3): you will need to specify a Changer Device directive in your Device resource (...) so that the generic SCSI device name can be edited into the command (with the %c). 2/ The second one, more elegant, as you do not have to define a ChangerDevice= directive for a device that is not an autochanger, is to modify the AlertCommand= and replace the '%c' with '%a' that is the subtitution for the archive device name (as stated in the manual (chapter 28.5 bottom of page 409 and other places as well). This way Bacula will substitute '%a' with the actual value of the ArchiveDevice= directive in your SD.conf file before it is sent to the OS for execution. I dare say - without having checked this version, but fought with Alert Command for a while - that this wont work. When bacula is executing the Alert Command the storage daemon is using the tape and thus preventing the smartcl to access the tape device. So you are either back to solution number 1 (having to add a changer device when not having an autochanger) or you have to replace the %c with the name of the generic scsi-device of the tape drive (using linux the name is something like /dev/sg4) I'm not 100% sure on this, but I do not believe Solaris uses companion generic device names in addition to the standard tape drive names. If it does, I've never come across them (unless we're talking about those crazy [EMAIL PROTECTED],4, etc. device names that hang out under /dev someplace). I suppose I will find out soon enough whether Solaris' handling of drives allows for this sort of thing or not. By the way: I would recommend to use this form *especially* when using multidrive autochangers or you will only ask the changer for its status while asking the tape gives more and more useful information. Not 100% sure what you mean in this case. I don't have an autochanger, so this doesn't much matter to me, but I'm curious how this alleviates the problem you were talking about, as it seems to me you can only specify one Changer Device, so you'd still only be able to ask about one drive (or the changer itself). Thanks for the ideas -- I should have looked there in the manual, but I didn't expect the Alert Command to have such an elaborate description in the manual -- I suppose that will teach me to underestimate it. ;) Thanks to all of those that responded -- hopefully this will make things a little easier, too, for those that search the list archives for an answer. - -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGaXvkmb+gadEcsb4RAt+TAJ0ZTRKEa/arvVNdiFM9VAaXyuNLRwCaAu2f gyw/DSAubNrUCZg9fdPfdsI= =2QhR -END PGP SIGNATURE- begin:vcard fn:Ryan Novosielski n:Novosielski;Ryan org:UMDNJ;IST/AST adr;dom:MSB C630;;185 South Orange Avenue;Newark;NJ;07103 email;internet:[EMAIL PROTECTED] title:Systems Programmer III tel;work:(973) 972-0922 tel;fax:(973) 972-7412 tel;pager:(866) 20-UMDNJ x-mozilla-html:FALSE version:2.1 end:vcard - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Multiple Clients Using Disk Example
For some reason this didn't post the first time, so here it is again. In the Bacula manual there is a wonderful example of how to set up pools for backups to disk using the default three level schedule. However, the example configuration file only uses one client. I was wondering if the same configuration works for multiple clients, or if there is something else to consider. For example, the sample file has one job per volume for each of 6 volumes in the differential pool, one for each week in a month (with some slack). If I were to try to run 10 clients on this would it fill that pool on the first week after 6 had backed up? What would happen to the other four; would baucla die horribly, or overwrite the volumes it just created, or create more volumes? Similarly, I seem to need a new client entry and a new job entry for every machine I want to back up. Many of the machines to be backed up will change every 4 months or so, and they all will have the same configuration, so is there any way to condense the amount of configuration that needs to change? i know about JobDefs, but is there any BatchJob, say, or a similar ClientDefs? Thanks, Kyle Marsh - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Using sd on Windows - possible to use UNC path or mapped drive as the Archive Location?
Hi all -- I am trying to use the Windows servers which I know aren't completely supported but I have had decent successes with tem thus far. My problem now is I am trying to use a network attached storage device which I have mapped as a persistent drive on the Windows 2003 box as my Archive Location. I have tried every combination of UNC paths, to shared folders, to the mappeded network drive itself and no matter what I do I get the following on doing a status storage: Device status: Device NASFileStorage is not open or does not exist. and when trying to mount: ../../stored/dev.c:126 Unable to stat device Z:\Backups\Bacula: ERR=The system cannot find the path specified. Device NASFileStorage requested by DIR could not be opened or does not exist. 3999 Device NASFileStorage not found or could not be opened. My initial though was to do a junction/linkd/mountvol/subst to map the share to a local folder but no luck, doing that is not supported in Windows for network\shared drives. Is using a network drive just not supported by Bacula or is there some creative way to mount one that I am just not thinking of? Thanks, Mike _ Explore the seven wonders of the world http://search.msn.com/results.aspx?q=7+wonders+worldmkt=en-USform=QBRE- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] mystery about Recycling
Hi, On 6/8/2007 3:36 PM, Diogo S Jorge wrote: I perceived an interesting problem of the Bacula here in my server. I receive a message that it needs intervention of the user to recycle a volume to continue backup. As soon as I enter in the console, bacula carry through the routine of pruned and recycling. Somebody knows how to solve this problem? When you present the necessary information, perhaps... Bacula version, relevant config parts, messages and console output would be helpful. Arno -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multiple Clients Using Disk Example
Hi,
On 6/8/2007 7:27 PM, Kyle Marsh wrote:
For some reason this didn't post the first time, so here it is again.
ah, here we go :-)
In the Bacula manual there is a wonderful example of how to set up
pools for backups to disk using the default three level schedule.
However, the example configuration file only uses one client. I was
wondering if the same configuration works for multiple clients, or if
there is something else to consider.
It's too late and too warm here for me to go over the example now :-)
but I will resent a more abstract solution...
For example, the sample file has
one job per volume for each of 6 volumes in the differential pool, one
for each week in a month (with some slack). If I were to try to run
10 clients on this would it fill that pool on the first week after 6
had backed up? What would happen to the other four; would baucla die
horribly, or overwrite the volumes it just created, or create more
volumes?
When I deploy a disk-based backup scenario, I usually don't bother with
volumes for a certain weekday, or anything like this. Rather, I estimate
the amount of space needed (per pool, obviously), and set up the pool to
take that amount of data (using limits on the volume size, volume
number, plus enabling automatic labeling).
Bacula will create, fill and recycle volumes as necessary and as set up.
It usually doesn't die horribly, and it overwrites volumes only once
they are out of their retention time. The worst that can (and does,
sooner or later) hapen is that Bacula asks for a new volme, which simply
shows that my estimate wasn't good enough or that the data grew faster
than could be expected. Then it's either time to create more volumes (as
available space permits) or to shorten the retention times (as policy
permits).
Similarly, I seem to need a new client entry and a new job entry for
every machine I want to back up.
Yes.
Many of the machines to be backed up
will change every 4 months or so, and they all will have the same
configuration, so is there any way to condense the amount of
configuration that needs to change? i know about JobDefs, but is
there any BatchJob, say, or a similar ClientDefs?
No, unfortunately not. But you can rather easily create a template which
is semi-automatically populated with the individual information. An
example I invented recently could look like this:
Put this into an executable text file:
#!/bin/bash
SED=/usr/bin/sed
SUBST=-e s/TEMPLATE/$1/g -e s/PASS/$2/g
catEOF | $SED $SUBST -
Client{
Name=TEMPLATE-fd
Password=PASS
# all the usual stuff that never changes
}
I called this unix-templ and execute:
[EMAIL PROTECTED]:~/some-config ./unix-templ test pass
Client{
Name=test-fd
Password=pass
# all the usual stuff that never changes
}
which you could paste into your configuration or redirect into an
included file.
Similar scripts for other configuration sections are equally simple...
Also, IIRC the upcoming version 2.2 (now in beta testing) allows to use
script output as the configuration file, so you could use a main script
that dynamically generates all the necessary information, taking if, for
example, from a database. Adding a client could be done using a simple
front-end to your database, and then reloading the DIR.
Arno
Thanks,
Kyle Marsh
-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
IT-Service Lehmann[EMAIL PROTECTED]
Arno Lehmann http://www.its-lehmann.de
-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
