Re: [Bacula-users] disk volume issues: seek - too large volumes - truncate - fragmentation
On Tuesday 20 March 2007 22:23, Hans Manz wrote: Kern Sibbald schrieb: When Bacula is scanning, listing, or restoring (depending on the exact options) from a volume, it will read to the end of the volume, so with your scheme, such operations will fail. I don't mind if these operations would fail just during the moment when bacula is about to recycle a volume since the old data is invalidated in right that moment anyway. The problem is that with your scheme, those operations will continue to fail on disk volumes after the volume has been recycled. Because when a file is overwritten and not truncated, it ends at the original size of the file, when a tape is overwritten, it ends at the end of the new data. Am I missing any arguments here? Yes, your understanding of how tapes work is incorrect. When I write 20MB on a 4GB tape, the size of the tape will remain 4GB. No, the tape is now 20MB has a *clearly* defined end of data mark, and some garbage after the end of the data mark. When I write 20MB on a 10MB file, the size of the file will become 20MB. Correct, but the above is not the issue. If you re-write 20MB on a 4GB disk file, the disk file is still 4GB and there is no end of data mark at 20MB as is the case on a tape. No, good systems such as Linux do not fragment the disk nor do programs such as Bacula fragment the disk. The disk becomes fragmented only if there are multiple processes writing the disk at the same time, or some files are deleted. The administrator (I used the word user in the last email) can control this behavior if it is important. Yes, this is a point. To let programs avoid backdraws instead of leaving this to administrators is another. I'm not interested in turning Bacula into an operating system. Well, the world out there will not miss very much, wether bacula truncates anything or not. But what I am really fed up with are arrogant open source developers who think their users were too stupid. You seem to be attributing a difference of opinion we have as being arrogance on my part then projecting that on open source developers and finally drawing a conclusion about what those open source developers think about their users. You are entitled to your opinion, but your logic is as faulty, and your opinion and conclusions are certainly not mine. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unable to Truncate Error Solved!
On Wednesday 21 March 2007 05:36, Eric Bambach wrote: Hello List, I saw that another user was grappling with the problem below. 20-Mar 20:49 moe-sd: Junior.2007-03-20_20.49.31 Fatal error: ../../stored/label.c:448 Truncate error on device FileStorage (E: \Bacula-Storage): ERR=../../stored/dev.c:1943 Unable to truncate device FileStorage (E:\Bacula-Storage). ERR=Invalid argument Your suggestion was to disable any antivirus software. However, that did not apply in my case. I looked through the source and saw you were using ftruncate and the mingw compatibility library. I am still testing bacula so I was able to recreate the problem easily with 5 100mb volumes using disk storage. To fix my problem I replaced your mingwm10.dll with the latest version from the mingw installation from their site and the problem has not returned. I think there was a compatibility problem with chsize/ftruncate with windows 2000 server and mingw. What version of mingw do you use/link against? Perhaps you need to update your Mingw installation for the native win32 ports? Hope that helps! Let me know if there is any test cases I can help with. Hello Robert, This is an interesting discovery. Is it possible that I have build the Win32 FD with an old version of mingw? Kern - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restore duration
Hi, I'm trying to restore a full directory which contains more than 700 files. The estimate command returns this : 326099 total files; 711 marked to be restored; 130,595,005 bytes. Does anyone knows what would be approximately the duration of such a job ? On each side, we do have Intel Xeon Bi-pro and a 10-100 Mbits Network but I guess it doesn't depends only on hardware specs. The server is running Backup Version: 1.38.5. I'm asking you this because I've launched the job yesterday and still nothing has been backuped... Is there a way to look at what's happening in real time ? Best regards. -- Arnaud Mombrial T : +33 141 123 041 F : +33 141 123 001 [EMAIL PROTECTED] - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore duration
On 3/21/07, Arnaud Mombrial [EMAIL PROTECTED] wrote: Hi, I'm trying to restore a full directory which contains more than 700 files. The estimate command returns this : 326099 total files; 711 marked to be restored; 130,595,005 bytes. Does anyone knows what would be approximately the duration of such a job ? On each side, we do have Intel Xeon Bi-pro and a 10-100 Mbits Network but I guess it doesn't depends only on hardware specs. The server is running Backup Version: 1.38.5. I'm asking you this because I've launched the job yesterday and still nothing has been backuped... Is there a way to look at what's happening in real time ? Did you try the status commands? status director? status storage? status client? John - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Removable disk HOWTO?
Josh Fisher wrote: The latest version is 0.7.4 and was posted to the bacula-users list 2006-12-12. It currently isn't hosted anywhere that I know of, and I don't think attachments are kept in the archives, so here it is again. Perhaps I should find somewhere to host it. I don't know if anyone else is using this method for USB drives, but I can say that I have been using it with bacula 2.0.x for several months without any problems. --- Josh Fisher Hristo Benev wrote: Hi, what is latest version of removable disk howto and where it could be accessed? Thanks Hristo Benev - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users I can host it on my site http://hbcom.info And I could give you access too. I have forum also. So if necessary I can create a new forum for this tool. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore duration
Thank you John for your advice. The status director gives numerous job in waiting execution state. How can I know what bacula is waiting for ? I've received this message yesterday : 20-Mar 10:45 Storage: Please mount Volume INC-server-prod.35 on Storage Device server-prod (/home/bacula/server-prod) for Job server-prod.2007-03-13_01.00.01 from bacula and I suppose this is why nothing happens since... Unfortunately, this volume appears to be empty : -rw-r- 1 bacula-sd bacula0 Mar 20 10:45 INC-server-prod.35 The problem is that this server is nearly full... Do you know if there is a way to force the execution a job ? Best regards. Le Wednesday 21 March 2007 13:53:34, vous avez écrit : On 3/21/07, Arnaud Mombrial [EMAIL PROTECTED] wrote: Hi, I'm trying to restore a full directory which contains more than 700 files. The estimate command returns this : 326099 total files; 711 marked to be restored; 130,595,005 bytes. Does anyone knows what would be approximately the duration of such a job ? On each side, we do have Intel Xeon Bi-pro and a 10-100 Mbits Network but I guess it doesn't depends only on hardware specs. The server is running Backup Version: 1.38.5. I'm asking you this because I've launched the job yesterday and still nothing has been backuped... Is there a way to look at what's happening in real time ? Did you try the status commands? status director? status storage? status client? John -- Arnaud Mombrial T : +33 141 123 041 F : +33 141 123 001 [EMAIL PROTECTED] - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore duration
The status director gives numerous job in waiting execution state. How can I know what bacula is waiting for ? I've received this message yesterday : 20-Mar 10:45 Storage: Please mount Volume INC-server-prod.35 on Storage Device server-prod (/home/bacula/server-prod) for Job server-prod.2007-03-13_01.00.01 This is probably what it is waiting for. A status storage should reveal that it is BLOCKED. from bacula and I suppose this is why nothing happens since... Unfortunately, this volume appears to be empty : -rw-r- 1 bacula-sd bacula0 Mar 20 10:45 INC-server-prod.35 The problem is that this server is nearly full... I gather that you are using file based volumes. Do you mean that there is no space left to create a new volume? I have only used file based volumes for a backup of the catalog so I am not sure what to do. Possibly a mount command will fix this. Also if you have no space to put the volume can you remove older volumes? If so the purge volume command should help. You may need to actually delete the volume file after the purge. Do you know if there is a way to force the execution a job ? You can restart the director throwing out everything in the current job queue. Otherwise you need to solve the blocked problem. John - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] disk volume issues: seek - too large volumes - truncate - fragmentation
Hello! Kern Sibbald schrieb: The problem is that with your scheme, those operations will continue to fail on disk volumes after the volume has been recycled. [...] Yes, your understanding of how tapes work is incorrect. When I write 20MB on a 4GB tape, the size of the tape will remain 4GB. No, the tape is now 20MB has a *clearly* defined end of data mark, and some garbage after the end of the data mark. If you re-write 20MB on a 4GB disk file, the disk file is still 4GB and there is no end of data mark at 20MB as is the case on a tape. Ah, I think now I understand your point. But this is not a k.o. argument since you could just explicitely write an end of data mark to the file. This would prevent the failing of operations you mentioned above, if I understand you properly now. I'm not interested in turning Bacula into an operating system. Absolutely, but maybe you are interested in creating software that is aware of outbound limitations and in creating software that moves away discrepancies from users -- if possible; just like all professional software should do. Well, the world out there will not miss very much, wether bacula truncates anything or not. But what I am really fed up with are arrogant open source developers who think their users were too stupid. You seem to be attributing a difference of opinion we have as being arrogance on my part then projecting that on open source developers and finally drawing a conclusion about what those open source developers think about their users. No, I like discussions and criticism. Differences of opinions are perfectly fine. Your intonation of your first replies were arrogant, e.g. answering to ideas of users (two cents) with words like never is not a good idea. You needed several mails to come up with substantial statements. Your behaviour is just typical for many -- not all -- OSS developers. This is not a generalisation of your posts, it's a general obversation that is validated by your posts. You are entitled to your opinion, but your logic is as faulty, and your opinion and conclusions are certainly not mine. Dissence accepted, except of faulty logic. I would like to stop this flame war, since the objective (truncation) is not worth of it. I hope both of us learned some lessons? /hm p.s.: yes, i am also arrogant. :-) - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] wishlist: ldap
Hello! You replied to me only, I assume by accident. Therefore I quote your mail to the list. This is ok, hopefully. Dimitri Puzin schrieb: If not already requested anywhere, LDAP support would be a sexy feature (configuration, job definitions, etc.). Hmm, to me, it would seem more meaningful to have the configuration of bacula-dir purely in an SQL database, not relying on the definitions in the config file. I've been already kind of thinking about that. If I have enough free time i'd probably attempt to implement it... I am sure, this would also ease the configuration of bacula with other frontends currently under development. I don't see a clear advantage of using LDAP for configuration of daemons over files/DB. IMHO the advantages are the following two: 1.) The L in LDAP stands for lighweight. Well, intentionally in contrast to DAP not SQL. But I think that compared to SQL it is lightweight enough so that you could restrict all configure options of all entities (fd, dir, sd, console, monitor, ...) to the credentials necessary to connect to the directory service and put everything else into the directory. Of course you could do all that with SQL, but LDAP is optimized for just this purpose. I could elaborate this point, if you wish. 2.) There are currently many attempts of distributors that aim to put as much as configuration data into LDAP and create management interfaces to LDAP. Collax and Univention heavily create and rely on on this infrastructure; but also RHEL and SLES partly do so and there are other solution providers like GONICUS' GOsa. I am also working on business solutions[tm] that use LDAP. My point is: LDAP is mainstream concerning distributed configuration. I am not a C hacker, I am more a java kiddie; I can't tell you how ldap libs for C look like. But I guess that fetching a hash table with all configuration data for the client can easily be written in two lines of code exluding exception handling given that you know your credentials that must reside in config file, of course. Naturally there might be environments where an SQL backend is more appropriate. What's about dividing the configuration retrieval to an API and an SPI? One SPI-provider for files, one for SQL, one for LDAP, ... :-) As stated above I am not a C hacker, but I have some knowlegde in LDAP and could provide LDAP schemes when needed. (Creating schemes for LDAP is the most nasty work on this, I think.) Another thing I am currently thinking about is Kerberos/GSSAPI authentication for daemons/users. That could possibly also solve the problem with the current SSL implementation, which has been discussed recently on bacula-devel. A world with all apps kerberized is one dream of admins, at least mine. :-) Just my few ¢, as usual YMMV etc :) I vote for LDAP. :) Regards, Dimitri Puzin aka Tristan-777 /HM - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Releasing the new batch DB insert code
1. With the batch insert code turned on there are a number of regression tests that fail. They must all pass without errors prior to production release. Responsible: Eric Deadline: Roughly the end of March Makes sense. - First, have a default limit of the number of records that will be inserted in any one batch request. This should guarantee that an out of memory problem will not normally occur. Can we calculate this based on available memory at execution time? General tuning wisdom for the commercial databases (DB/2, Oracle, etc) target about 60% of real memory as the goal for this kind of segmentation. That allows some query optimization overhead, and a little wiggle room if the optimizer guesses wrong. - Second, add a new directive to the Catalog resource that allows the user to change the default batch size (by setting the value to 0 or very large, you can effectively allow the batch to be arbitrarily large). Makes sense. - Third (this is optional, but very desirable), implement a new directive that allows the user to enable/disable the batch insert mechanism. This would require a bit of change in the subroutine names in the cats directory so that we can enable the new code and the old code at the same time, but select which is used at runtime for each DB based on the directive value. If the first and second items are implemented, the batch insert would be enabled by default, otherwise it will be turned off. Responsiblity for above 3 (4) points: Eric (and possibly Marc) Deadline: rougly the end of March OK. If the new algorithm really works better, it seems like extra work that might not be needed, but c'est la vie. 3. Documentation Before putting this into production, I would like to see a bit more documentation about the new algorithms -- this is documentation that would be placed in the code. Marc has offerred to answer questions and write some documentation, I offer to integrate it into the code, and continue to ask questions until it is clear. This item should be no problem to resolve. Responsible: Kern + Marc (with help from Eric if he wants) Deadline: Kern understands the algorthm by mid April. Works for me. Analyzing this for race conditions will be really interesting, I think. In fact, I think it'll be a really good final exam question for my informatics students...*evil grin* Thanks, guys! - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore duration
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 John Drescher wrote: The status director gives numerous job in waiting execution state. How can I know what bacula is waiting for ? I've received this message yesterday : 20-Mar 10:45 Storage: Please mount Volume INC-server-prod.35 on Storage Device server-prod (/home/bacula/server-prod) for Job server-prod.2007-03-13_01.00.01 This is probably what it is waiting for. A status storage should reveal that it is BLOCKED. from bacula and I suppose this is why nothing happens since... Unfortunately, this volume appears to be empty : -rw-r- 1 bacula-sd bacula0 Mar 20 10:45 INC-server-prod.35 The problem is that this server is nearly full... I gather that you are using file based volumes. Do you mean that there is no space left to create a new volume? I have only used file based volumes for a backup of the catalog so I am not sure what to do. Possibly a mount command will fix this. Also if you have no space to put the volume can you remove older volumes? If so the purge volume command should help. You may need to actually delete the volume file after the purge. He's doing a restore and it's asking him to mount a volume that contains no files. I say go ahead and mount it and see what happens. It may then move on, or it may error out. I'd be curious why you have an empty volume there, though. I believe even on a recycle, files are not zero length, but I could be wrong. - -- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III |$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGAT2Xmb+gadEcsb4RAnAkAJ4nfyCkfGm2qU0N8xuLaLPe5wHMAwCgyHwB CJQVGRpWd4Dw1QhxXWh5Tq0= =gUqn -END PGP SIGNATURE- - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Need help with Bacula project - $60/hour
Hi everyone. I am about to start a project using Bacula to backup several remote computers over the internet. This is something that will eventually turn into a very large project where we will keep backed up data to an Enterprise Virtual Array with roughly 40 terabytes of space. To start off, we are going to implement on a much smaller server with about 5 terabytes of space. We will be backing up Linux servers and desktops, Windows servers and desktops, and Mac servers and desktops. We will only be backing up portions of each and the pieces we back I would like to have controlled by the main Bacula server rather than at the client end. We do have access to very large tape array systems that may be used for longer term storage. All backups will occur over both a private WAN as well as several public internet connections. I am looking for someone very experienced with Bacula who can help get this project started. I will pay $60 per hour for your help. This could also lead into a nice job for someone that works well with my organization and clients. Right now I can see this role with a salary of around $60,000 to $90,000 depending on capabilities, experience, ability to handle clients, etc. Right now I believe this work can be done on a telecommuting basis, but I cannot be certain of that until the project rolls forward. If there is anyone interested, please let me know. We can discuss various aspects of the project in detail. A direct email will probably be best unless you believe it contributes to the Bacula- users list. I can also be contacted at the following IM accounts, but I would prefer initial contact by email if possible. MSN: [EMAIL PROTECTED] AIM: securesentry GTalk: [EMAIL PROTECTED] ICQ: 10229594 Yahoo: [EMAIL PROTECTED] Thanks! -- Billy Dunn Dallas Metro: (972) 601-9700 Fort Worth Metro: (817) 265-5000 PGP.sig Description: This is a digitally signed message part - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] wishlist: ldap
I am just starting down the LDAP path for our network and already I can see how it can supplant and tie together at least 6 disparate databases we use into a unified whole, while simultaneously being more flexible and providing more useable functionality. It has the potential to be extremely powerful, but it does take a lot of understanding at first - far more so than simple SQL - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Releasing the new batch DB insert code
On Wed, 21 Mar 2007, David Boyes wrote: - First, have a default limit of the number of records that will be inserted in any one batch request. This should guarantee that an out of memory problem will not normally occur. Can we calculate this based on available memory at execution time? General tuning wisdom for the commercial databases (DB/2, Oracle, etc) target about 60% of real memory as the goal for this kind of segmentation. That allows some query optimization overhead, and a little wiggle room if the optimizer guesses wrong. In MySQL: /etc/my.cnf # If your system supports the memlock() function call, you might want to # enable this option while running MySQL to keep it locked in memory and # to avoid potential swapping out in case of high memory pressure. Good # for performance. memlock Comment this out. If MySQL runs out of RAM it will hit swap and slow down, but it will not crash. I did send Kern some updated query forms some time back for dbcheck which reduced the load and sped things up a LOT, but I can't find them now. (Basically, SELECT COUNT(*) instead of SELECT, etc) No need to bring out the rows and count them when the SQL database can do it for you. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore duration
He's doing a restore and it's asking him to mount a volume that contains no files. I say go ahead and mount it and see what happens. It may then move on, or it may error out. I'd be curious why you have an empty volume there, though. I believe even on a recycle, files are not zero length, but I could be wrong. I assumed that message was for a previous job blocking the storage so that the restore would be blocked as well. John - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] wishlist: ldap
Hans Manz schrieb: Hello! Hi, You replied to me only, I assume by accident. Therefore I quote your mail to the list. This is ok, hopefully. Oops, that wasn't my intention. Thanks. Dimitri Puzin schrieb: If not already requested anywhere, LDAP support would be a sexy feature (configuration, job definitions, etc.). Hmm, to me, it would seem more meaningful to have the configuration of bacula-dir purely in an SQL database, not relying on the definitions in the config file. I've been already kind of thinking about that. If I have enough free time i'd probably attempt to implement it... I am sure, this would also ease the configuration of bacula with other frontends currently under development. I don't see a clear advantage of using LDAP for configuration of daemons over files/DB. IMHO the advantages are the following two: 1.) The L in LDAP stands for lighweight. Well, intentionally in contrast to DAP not SQL. But I think that compared to SQL it is lightweight enough so that you could restrict all configure options of all entities (fd, dir, sd, console, monitor, ...) to the credentials necessary to connect to the directory service and put everything else into the directory. Of course you could do all that with SQL, but LDAP is optimized for just this purpose. I could elaborate this point, if you wish. Please. 2.) There are currently many attempts of distributors that aim to put as much as configuration data into LDAP and create management interfaces to LDAP. Collax and Univention heavily create and rely on on this infrastructure; but also RHEL and SLES partly do so and there are other solution providers like GONICUS' GOsa. I am also working on business solutions[tm] that use LDAP. My point is: LDAP is mainstream concerning distributed configuration. I think we shouldn't do something just because others do it. It might be not the right choice. Yes, I've seen GOsa :) IMHO is the configuration not as much distributed as LDAP was designed for/to pull real benefit from it. The most important configuration is the one from bacula-dir and there is usually only one instance of it running on the network. Another moreless single thing is the sd config. The console and fd isn't that complex and most of my fd instances are running just with a single copy of the same file. I am not a C hacker, I am more a java kiddie; I can't tell you how ldap libs for C look like. But I guess that fetching a hash table with all configuration data for the client can easily be written in two lines of code exluding exception handling given that you know your credentials that must reside in config file, of course. Not too complex, but let's talk about that later. Naturally there might be environments where an SQL backend is more appropriate. What's about dividing the configuration retrieval to an API and an SPI? One SPI-provider for files, one for SQL, one for LDAP, ... :-) That sounds like quite good idea to me. I'd prefer SQL backend, especially small to medium sized installs could benefit from it (and I maintain a lot of them ;) Another advantage is, the admin doesn't need to maintain another service like LDAP just for the backup system. Further, bacula already keeps a part of the config in SQL database (if you edit dir conf, you might need to update some ressources from bconsole, to reflect changes, some other times have to issue reload). As stated above I am not a C hacker, but I have some knowlegde in LDAP and could provide LDAP schemes when needed. (Creating schemes for LDAP is the most nasty work on this, I think.) Another thing I am currently thinking about is Kerberos/GSSAPI authentication for daemons/users. That could possibly also solve the problem with the current SSL implementation, which has been discussed recently on bacula-devel. A world with all apps kerberized is one dream of admins, at least mine. :-) Yeah :D [...] I vote for LDAP. :) For the environments I am concerned of is SQL probably the better choice. OTOH LDAP could also be nice. It could be deployed easily when the environment is new (fresh new install etc in a smaller network), but in larger environments it's quite complicated if not impossible to integrate (not only technically, but also concerning the policy of customer, for example). Regards, Dimitri Puzin aka Tristan-777 signature.asc Description: OpenPGP digital signature - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] disk volume issues: seek - too large volumes - truncate - fragmentation
On Wednesday 21 March 2007 14:47, Hans Manz wrote: Hello! Kern Sibbald schrieb: The problem is that with your scheme, those operations will continue to fail on disk volumes after the volume has been recycled. [...] Yes, your understanding of how tapes work is incorrect. When I write 20MB on a 4GB tape, the size of the tape will remain 4GB. No, the tape is now 20MB has a *clearly* defined end of data mark, and some garbage after the end of the data mark. If you re-write 20MB on a 4GB disk file, the disk file is still 4GB and there is no end of data mark at 20MB as is the case on a tape. Ah, I think now I understand your point. But this is not a k.o. argument since you could just explicitely write an end of data mark to the file. This would prevent the failing of operations you mentioned above, if I understand you properly now. I'm sorry, but the only end of data mark for a file is the end of file (i.e. truncate it). I'm not interested in turning Bacula into an operating system. Absolutely, but maybe you are interested in creating software that is aware of outbound limitations and in creating software that moves away discrepancies from users -- if possible; just like all professional software should do. Well, the world out there will not miss very much, wether bacula truncates anything or not. But what I am really fed up with are arrogant open source developers who think their users were too stupid. You seem to be attributing a difference of opinion we have as being arrogance on my part then projecting that on open source developers and finally drawing a conclusion about what those open source developers think about their users. No, I like discussions and criticism. Differences of opinions are perfectly fine. Your intonation of your first replies were arrogant, e.g. answering to ideas of users (two cents) with words like never is not a good idea. You needed several mails to come up with substantial statements. Your behaviour is just typical for many -- not all -- OSS developers. This is not a generalisation of your posts, it's a general obversation that is validated by your posts. You are entitled to your opinion, but your logic is as faulty, and your opinion and conclusions are certainly not mine. Dissence accepted, except of faulty logic. I would like to stop this flame war, since the objective (truncation) is not worth of it. I hope both of us learned some lessons? /hm p.s.: yes, i am also arrogant. :-) - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows Authentication Errors
On Tue, Mar 20, 2007 at 09:08:50PM -0600, Lonny Selinger wrote: I'm sure this has been tapped before but I can't seem to figure out what else could be causing my issue. I have set up a Windows machine as a client to test a backup and keep getting authentication errors. After reading the page on auth issues as well as following the intuitive return from bconsole I still have no idea what I'm doing wrong. WHat I'm getting is: 20-Mar 20:49 amanda-dir: Mine.2007-03-20_20.48.51 Fatal error: Unable to authenticate with File daemon on 192.168.69.18:9102. Possible causes: Passwords or names not the same or Maximum Concurrent Jobs exceeded on the FD or FD networking messed up (restart daemon). Please see http://www.bacula.org/rel-manual/faq.html#AuthorizationErrors for help. So I verified a couple of things for sure ... first, right now I'm not using passwords just to simplify things. Second the names are pretty simple and are It sounds like you mean you're not using *Windows* passwords, correct? Bacula doesn't use system account passwords for authentication. Instead, the password that error message is referring to is the one set in bacula configs, which must match on the client and director config. Read the FAQ entry the error message pointed to - it should help. Ok a little background ... I have bacula working with about 8 Linux hosts right now and wanted to add a Windows machine to test. For my director, I have all the passwords set to Password = including the password definition on the Windows machine for the client config. On the WIndows machine there is no local firewall (as it's already behind a firewall) and no local rules or AV that might thwart my attempt to connect. What I will try now is hunting through some archives as suggested to see how to better troubleshoot the Windows stuff. Currently with no passwords anywhere I figured it would respond the same as all my linux clients and just connect but sadly something isn't meshing up :-) Thanks for all the responses guys, I'll post what I find ... if I find anything lol -- Regards, Lonny -- To mess up a Linux box, you need to work at it; to mess up your Windows box, you just need to work ON it. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Write error sending len to Storage daemon
I getting an error on one of my backup jobs: 21-Mar 00:38 dctn-fd: dctn.2007-03-20_23.36.05 Fatal error: ../../filed/backup.c:873 Network send error to SD. ERR=Input/output error 21-Mar 00:38 dctn-fd: dctn.2007-03-20_23.36.05 Error: ../../lib/bnet.c:406 Write error sending len to Storage daemon:dctn.informs.com:9103: ERR=Input/output error The meat of the error seems to be the Write error sending len to Storage daemon error. I'm not sure what it means though. The setup is like this: Bacula director server running in cityA with a server in cityB running the FD and SD. bacula-dir tells FD in cityB to backup data to SD in cityB. The backup starts and gets about 4.9Gigs written to the tape (about 50%) after which the job get this fatal error and stops. I have setup the Heartbeat Interval option to keep the remote connections alive but I'm still not sure what is causing this error. Any assistance would be greatly appreciated. Jason King - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Releasing the new batch DB insert code
I think I haven't explained the memory issue correctly : The example Kern gave is : SELECT JobMedia.JobMediaId,Job.JobId FROM JobMedia LEFT OUTER JOIN Job ON (JobMedia.JobId=Job.JobId) WHERE Job.JobId IS NULL LIMIT 30; and it only fails if I remove the LIMIT 300. The problem you mention is that you select 300,000 records from the database. What happens then is that your SQL CLIENT process will allocate all these records in memory (except if you use a cursor, but that's not the question). As a consequence, if you remove the LIMIT code, the client will have to store millions of records in memory (for you to use them). The server process won't have to. There is no such code in the batch inserts : In the batch DB insert code, there is no SELECT statement (at least no SELECT statement retrieving rows). It means no data is sent from the SQL server process to the SQL client process. The only memory allocated will be by the SQL backend. This memory is already limited by administrative limits put by the DBA. Even if the DBA hasn't put these limits, they are in place, as there are default (small) values put there by the installer... The memory allocated by the SQL server process is used for sorting, hashing, small buffers to send data to the SQL client process. These resources are controlled (and better be, or a single query could easily kill a database, using a cross join for instance). Bigger sorts go to disk, in chunks, in temp files... On Wednesday 21 March 2007 15:25, Alan Brown wrote: On Wed, 21 Mar 2007, David Boyes wrote: - First, have a default limit of the number of records that will be inserted in any one batch request. This should guarantee that an out of memory problem will not normally occur. Can we calculate this based on available memory at execution time? General tuning wisdom for the commercial databases (DB/2, Oracle, etc) target about 60% of real memory as the goal for this kind of segmentation. That allows some query optimization overhead, and a little wiggle room if the optimizer guesses wrong. In MySQL: /etc/my.cnf # If your system supports the memlock() function call, you might want to # enable this option while running MySQL to keep it locked in memory and # to avoid potential swapping out in case of high memory pressure. Good # for performance. memlock Comment this out. If MySQL runs out of RAM it will hit swap and slow down, but it will not crash. I did send Kern some updated query forms some time back for dbcheck which reduced the load and sped things up a LOT, but I can't find them now. (Basically, SELECT COUNT(*) instead of SELECT, etc) No need to bring out the rows and count them when the SQL database can do it for you. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] wishlist: ldap
Alan Brown schrieb: I am just starting down the LDAP path for our network and already I can see how it can supplant and tie together at least 6 disparate databases we use into a unified whole, while simultaneously being more flexible and providing more useable functionality. It has the potential to be extremely powerful, but it does take a lot of understanding at first - far more so than simple SQL Yes, the learning curve speaks against LDAP. IMHO most learn effort is related to schemes. But after all it is very easy in fact -- I think even simpler than SQL -- given that you made the first steps and you take LDAP for its intended purposes only. Some weeks ago I've been consulting a small web apps company. They wanted to map rights attributes of individual entities from their RDBMS to LDAP. That doesn't scale well. :-) /HM - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows Authentication Errors
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Lonny Selinger wrote: On Tue, Mar 20, 2007 at 09:08:50PM -0600, Lonny Selinger wrote: Ok a little background ... I have bacula working with about 8 Linux hosts right now and wanted to add a Windows machine to test. For my director, I have all the passwords set to Password = including the password definition on the Windows machine for the client config. On the WIndows machine there is no local firewall (as it's already behind a firewall) and no local rules or AV that might thwart my attempt to connect. What I will try now is hunting through some archives as suggested to see how to better troubleshoot the Windows stuff. Currently with no passwords anywhere I figured it would respond the same as all my linux clients and just connect but sadly something isn't meshing up :-) Thanks for all the responses guys, I'll post what I find ... if I find anything lol When you say you checked/updated the Windows machine client config, exactly what file(s) did you look at? Reason I ask is I just completed an upgrade from v1.36 to v2.0.3 on about 80 clients (5 of them being Windows) and noticed that the config is now in a different place on my Windows boxes. It used to be in C:\bacula, now its in C:\Documents and Settings\All Users\Application Data\Bacula. I just tried setting my director to no password, and used a blank password in C:\Documents and Settings\All Users\Application Data\Bacula\bacula-fd.conf and everything seems to be working fine here. - -Proto - -- Michael Proto| SecureWorks Unix Administrator | PGP ID: 5D575BBE | [EMAIL PROTECTED] *** -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQFGAU+zOLq/wl1XW74RAvjDAJ9wW+Xkg98j8VNQ4XpojuCPn/Me5wCfbEOs zH+ZhVKq4hHJ85/lPtaWG2c= =XXwg -END PGP SIGNATURE- - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Releasing the new batch DB insert code
On Wed, 21 Mar 2007, Marc Cousin wrote: I think I haven't explained the memory issue correctly : I realise it's an issue for large selects, but in the case given: The example Kern gave is : SELECT JobMedia.JobMediaId,Job.JobId FROM JobMedia LEFT OUTER JOIN Job ON (JobMedia.JobId=Job.JobId) WHERE Job.JobId IS NULL LIMIT 30; and it only fails if I remove the LIMIT 300. Would be better solved with: SELECT COUNT(*) FROM JobMedia LEFT OUTER JOIN Job ON (JobMedia.JobId=Job.JobId) WHERE Job.JobId IS NULL ; Because the very next lines in dbcheck simply count the resulting lines of output. Similarly the deletion routine can be altered from the Kern's example, plus a loop using DELETE statements, to: DELETE FROM Job LEFT OUTER JOIN Job ON (JobMedia.JobId=Job.JobId) WHERE Job.JobId IS NULL ; The problem you mention is that you select 300,000 records from the database. What happens then is that your SQL CLIENT process will allocate all these records in memory (except if you use a cursor, but that's not the question). As a consequence, if you remove the LIMIT code, the client will have to store millions of records in memory (for you to use them). The server process won't have to. This is exactly what I was seeing with dbcheck. Why have a dog and then do all the barking yourself? In this case the dog is the SQL database and the barking is the needless extraction and [counting|deleting] of individual NULL JobIds The comments about SQL crashes are because I have seen this happen as databases grow HUGE. Mine is somewhat in excess of 250 million entries. AB - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Releasing the new batch DB insert code
This is exactly what I was seeing with dbcheck. Why have a dog and then do all the barking yourself? In this case the dog is the SQL database and the barking is the needless extraction and [counting|deleting] of individual NULL JobIds The comments about SQL crashes are because I have seen this happen as databases grow HUGE. Mine is somewhat in excess of 250 million entries. AB That wasn't the point... I wasn't really interested in how the dbcheck example should be improved, I just explained why the problem occured. And why it won't occur with the batch inserts... - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bare metal rescue disk on Fedora Core 4
I have problems creating a bare metal rescue disk for my Fedora system. I'm running the 2.0.3 and 2.0.2 bacula-client installed from the rpm. As I read in the manual I did run 'make all' from the /etc/bacula/rescue/linux/cdrom directory. I get an iso file in the end I can boot from. The problem is that all my hardware / the hard disk are unknown by this cd. Also the bacula-fd.conf file is just a standard one and not my special one from /etc/bacula. I also tried many different things but without success. What is the right procedure to create such a cd or are there general problems with that? Thank you for your help in advance. Ingo - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Test bare metal restore problem!
I'm having the same problem. Is there a solution yet? Ingo The CDROM created by bacula-rescue-2.0.0 is unable to see the drives on a server running FC4. It is a Dell PowerEdge 2400 with the MegaRAID card. I was under the impression that the CDROM would recognize all raid setup/cards if it was made with them. Was I way off? The manual says nothing of the kind that I do admit. Any ideas? TIA, ZK - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Test bare metal restore problem!
On Wednesday 21 March 2007 17:49, Ingo Jochim wrote: I'm having the same problem. Is there a solution yet? Ingo The CDROM created by bacula-rescue-2.0.0 is unable to see the drives on a server running FC4. It is a Dell PowerEdge 2400 with the MegaRAID card. I was under the impression that the CDROM would recognize all raid setup/cards if it was made with them. Was I way off? The manual says nothing of the kind that I do admit. Any ideas? You must explicitly mount your disks. The Rescue chapter explains that (at least briefly). I don't have raid here, so I cannot answer your question other to say that a user submitted code that should allow raid disks to be properly setup. Due to the complexities of writing a Rescue system, I have essentially left any problems other than those occurring on SuSE 10.2 as an exercise for the user -- sorry. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] wishlist: ldap
Dimitri Puzin schrieb: Of course you could do all that with SQL, but LDAP is optimized for just this purpose. I could elaborate this point, if you wish. Please. If you don't mind I would postpone this. *ehem* :-) Basically it boils down to simplicity and performance for specific purposes (configuration management perfectly fits here). 2.) There are currently many attempts of distributors that aim to put as much as configuration data into LDAP and create management interfaces to LDAP. Collax and Univention heavily create and rely on on this infrastructure; but also RHEL and SLES partly do so and there are other solution providers like GONICUS' GOsa. I am also working on business solutions[tm] that use LDAP. My point is: LDAP is mainstream concerning distributed configuration. I think we shouldn't do something just because others do it. It might be not the right choice. Yes, I've seen GOsa :) I am pretty sure it would be the right choice. :) GOsa and other are interesting only because there are so many applications that implement an LDAP interface. So this is a network effect that becomes better when many people implement it. After all, that others do it actually is a good reason. At least it were not a false choice to do so. IMHO is the configuration not as much distributed as LDAP was designed for/to pull real benefit from it. The most important configuration is the one from bacula-dir and there is usually only one instance of it running on the network. Another moreless single thing is the sd config. The console and fd isn't that complex and most of my fd instances are running just with a single copy of the same file. OK, bacula is a distributed app, but already concentrates its config in dir's config file. But there is still the inferface argument (for both LDAP/SQL): if there is a standardized(LDAP) networked(SQL/LDAP) interface, it is easily possible to create fancy admin tools (bat co. could also benefit) or to integrate into general purpose admin tools like GOsa and others. For the distribution argument: If you are a user of GOsa or Univention Corporate Server (or others) you might have more than one physical location and thus more than one bacula installation. Here the hierachical structur and distributability of LDAP is very useful. Have a look for departments in GOsa. Naturally there might be environments where an SQL backend is more appropriate. What's about dividing the configuration retrieval to an API and an SPI? One SPI-provider for files, one for SQL, one for LDAP, ... :-) That sounds like quite good idea to me. I'd prefer SQL backend, especially small to medium sized installs could benefit from it (and I maintain a lot of them ;) Another advantage is, the admin doesn't need to maintain another service like LDAP just for the backup system. LDAP for just one app is overkill. But admins in big sites who use LDAP consolidate many apps in this one backend and they would argument the other way around. What I've learned from experience is that RDBMS is for huge amounts of variable data and payload data (persitence of business objects[tm]) and that LDAP is for static infrastructure / environment data. To implement SPI providers is very easy, given that the infrastructure (API, SPI and the handling between both) is available. You could even easily abuse DNS for providing config information (I do not recommend). (*) I have no idea of how hard it would be to APIfy bacula's configuration management. BTW: didn't some Novell developers appear in this list who wanted to APIfy bacula? I vote for LDAP. :) For the environments I am concerned of is SQL probably the better choice. OTOH LDAP could also be nice. It could be deployed easily when the environment is new (fresh new install etc in a smaller network), but in larger environments it's quite complicated if not impossible to integrate (not only technically, but also concerning the policy of customer, for example). Larger environments I know of either have LDAP or wish they had. But obviously it's a matter of details, evolution, taste, know how and others. After all this thread is a strong vote for APIs in general. Bacula's docs state that it were easy to configure. This is true compared to other open source network backup systems. But absolutely spoken it is far not easy, at least not for beginners, i.e. the learn curve is suboptimal. There is not much to do about it directly due to the complex nature of network backup. What I'd like to do is to implement or to see implemented a good, simple and more or less automated configuration and management application. IMHO the existent apps lack many features and maturity and these deficiencies correlate to the lack of APIs and to SQL beeing the only elegant way to visualize and manipulate bacula's operation. As stated some posts ago I am not a C hacker. My world is (java based) enterprise application stuff. If a customer asked me if I'd like to integrate bacula
Re: [Bacula-users] disk volume issues: seek - too large volumes - truncate - fragmentation
Kern Sibbald schrieb: I'm sorry, but the only end of data mark for a file is the end of file (i.e. truncate it). You refuse to get the point. I would like to stop this flame war, since the objective (truncation) is not worth of it. I hope both of us learned some lessons? /hm p.s.: yes, i am also arrogant. :-) - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Removable disk HOWTO?
Erich Prinz wrote: Any chance of a Wintel version becoming available? In Windows, drives are mounted by drive letter. It is possible to mount a particular USB drive at a particular drive letter and make that mapping permanent. However, as far as I know, it is not possible to force multiple USB drives to be assigned the same drive letter. If I am wrong, and it is possible to permanently assign the same drive letter to more than one drive, then a win32 version would not be too hard. Another way might be to assign drives to virtual changers by drive letter, where each drive letter would map to a particular magazine and the drive letters are reserved for those drives. That seems feasible, and I will investigate it. On Mar 20, 2007, at 2:04 PM, Josh Fisher wrote: The latest version is 0.7.4 and was posted to the bacula-users list 2006-12-12. It currently isn't hosted anywhere that I know of, and I don't think attachments are kept in the archives, so here it is again. Perhaps I should find somewhere to host it. I don't know if anyone else is using this method for USB drives, but I can say that I have been using it with bacula 2.0.x for several months without any problems. --- Josh Fisher Hristo Benev wrote: Hi, what is latest version of removable disk howto and where it could be accessed? Thanks Hristo Benev - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php? page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users BaculaRemovableDiskHowto-0.7.4.tgz -- --- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php? page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unable to Truncate Error Solved!
On Wednesday 21 March 2007 03:45, Kern Sibbald wrote: On Wednesday 21 March 2007 05:36, Eric Bambach wrote: Hello List, I saw that another user was grappling with the problem below. 20-Mar 20:49 moe-sd: Junior.2007-03-20_20.49.31 Fatal error: ../../stored/label.c:448 Truncate error on device FileStorage (E: \Bacula-Storage): ERR=../../stored/dev.c:1943 Unable to truncate device FileStorage (E:\Bacula-Storage). ERR=Invalid argument Your suggestion was to disable any antivirus software. However, that did not apply in my case. I looked through the source and saw you were using ftruncate and the mingw compatibility library. I am still testing bacula so I was able to recreate the problem easily with 5 100mb volumes using disk storage. To fix my problem I replaced your mingwm10.dll with the latest version from the mingw installation from their site and the problem has not returned. I think there was a compatibility problem with chsize/ftruncate with windows 2000 server and mingw. What version of mingw do you use/link against? Perhaps you need to update your Mingw installation for the native win32 ports? Hope that helps! Let me know if there is any test cases I can help with. Hello Robert, This is an interesting discovery. Is it possible that I have build the Win32 FD with an old version of mingw? I used the precompiled win32 version. Kern Hopefully this was the problem. I later found a process was holding one (and only 1) of the tape files open (but not the one with the error as a few had errors). Bacula had several files marked for recycle but couldn't recycle any of them. Can you truncate a file if another process is reading from it? Presumably not since that is what an AV program might do and why you recommended to exclude bacula. I haven't run into the problem since and I can't recreate it so it seems it was a library incompatibility. If you aren't running a production install I would download MinGW from their homepage http://prdownloads.sf.net/mingw/MinGW-3.1.0-1.exe?download and see if that fixes your problem. I wouldnt dare replace the library on a production server though since that could cause tons of other unforseen problems. It's worked for me so far though. I will try a few more tests later tonight going back to the old library and switching in between them and let you know what happens. -- Thanks, Eric Bambach Systems Manager Northern Star Suite 130 Campus Life Bldg. Northern Illinois University, DeKalb IL - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] disk volume issues: seek - too large volumes - truncate - fragmentation
On Wednesday 21 March 2007 12:50, Hans Manz wrote: Kern Sibbald schrieb: I'm sorry, but the only end of data mark for a file is the end of file (i.e. truncate it). You refuse to get the point. You're comments are inconsiderate, impolite incorrect. Perhaps if put less effort into criticizing and more effort into explaining your point people would understand it. You can't force understanding you only can lead people to understand. I would like to stop this flame war, since the objective (truncation) is not worth of it. I hope both of us learned some lessons? /hm p.s.: yes, i am also arrogant. :-) Yes you are! And I, for one, am going to pay no more attention to your posts. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Debian 'Etch' - Registered Linux User #241964 More laws, less justice. -- Marcus Tullius Ciceroca, 42 BC - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Removable disk HOWTO?
True, drives are assigned the next available drive letter. In many of the simple deployments I have, it is a simple two disk rotation. The USB drives always get the same drive mapping - which can easily get thrown out of whack with the introduction of another device by an end user. Hence why servers run headless and locked away in closets. Just thinking out loud, but Is it possible to use UNC versus drive mappings? Erich On Mar 21, 2007, at 2:10 PM, Josh Fisher wrote: Erich Prinz wrote: Any chance of a Wintel version becoming available? In Windows, drives are mounted by drive letter. It is possible to mount a particular USB drive at a particular drive letter and make that mapping permanent. However, as far as I know, it is not possible to force multiple USB drives to be assigned the same drive letter. If I am wrong, and it is possible to permanently assign the same drive letter to more than one drive, then a win32 version would not be too hard. Another way might be to assign drives to virtual changers by drive letter, where each drive letter would map to a particular magazine and the drive letters are reserved for those drives. That seems feasible, and I will investigate it. On Mar 20, 2007, at 2:04 PM, Josh Fisher wrote: The latest version is 0.7.4 and was posted to the bacula-users list 2006-12-12. It currently isn't hosted anywhere that I know of, and I don't think attachments are kept in the archives, so here it is again. Perhaps I should find somewhere to host it. I don't know if anyone else is using this method for USB drives, but I can say that I have been using it with bacula 2.0.x for several months without any problems. --- Josh Fisher Hristo Benev wrote: Hi, what is latest version of removable disk howto and where it could be accessed? Thanks Hristo Benev --- -- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php? page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users BaculaRemovableDiskHowto-0.7.4.tgz -- --- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php? page=join.phpp=sourceforgeCID=DEVDEV__ __ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php? page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- --- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php? page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unable to Truncate Error Solved!
On Wednesday 21 March 2007 20:29, Eric Bambach wrote: On Wednesday 21 March 2007 03:45, Kern Sibbald wrote: On Wednesday 21 March 2007 05:36, Eric Bambach wrote: Hello List, I saw that another user was grappling with the problem below. 20-Mar 20:49 moe-sd: Junior.2007-03-20_20.49.31 Fatal error: ../../stored/label.c:448 Truncate error on device FileStorage (E: \Bacula-Storage): ERR=../../stored/dev.c:1943 Unable to truncate device FileStorage (E:\Bacula-Storage). ERR=Invalid argument Your suggestion was to disable any antivirus software. However, that did not apply in my case. I looked through the source and saw you were using ftruncate and the mingw compatibility library. I am still testing bacula so I was able to recreate the problem easily with 5 100mb volumes using disk storage. To fix my problem I replaced your mingwm10.dll with the latest version from the mingw installation from their site and the problem has not returned. I think there was a compatibility problem with chsize/ftruncate with windows 2000 server and mingw. What version of mingw do you use/link against? Perhaps you need to update your Mingw installation for the native win32 ports? Hope that helps! Let me know if there is any test cases I can help with. Hello Robert, This is an interesting discovery. Is it possible that I have build the Win32 FD with an old version of mingw? I used the precompiled win32 version. Yes, that is what I assumed, and it was me who built it. Kern Hopefully this was the problem. I later found a process was holding one (and only 1) of the tape files open (but not the one with the error as a few had errors). Bacula had several files marked for recycle but couldn't recycle any of them. Can you truncate a file if another process is reading from it? Presumably not since that is what an AV program might do and why you recommended to exclude bacula. On Linux, I am almost positive that Bacula can truncate a file while it is being read, but I am not sure. I don't know how it works on Win32. I haven't run into the problem since and I can't recreate it so it seems it was a library incompatibility. If you aren't running a production install I would download MinGW from their homepage http://prdownloads.sf.net/mingw/MinGW-3.1.0-1.exe?download and see if that fixes your problem. It sounds like at some point, they fixed a bug. I wouldnt dare replace the library on a production server though since that could cause tons of other unforseen problems. It's worked for me so far though. Well, after looking at what packages we are using, I would say that it is not a question that they fixed a bug, but something else. We are currently using mingw-runtime-3.9, which is the latest version. I will try a few more tests later tonight going back to the old library and switching in between them and let you know what happens. -- Thanks, Eric Bambach Systems Manager Northern Star Suite 130 Campus Life Bldg. Northern Illinois University, DeKalb IL - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Unable to switch to tapes in different pools
We're running bacula 1.36.3-1 utilizing a mysql database on Redhat 9 (yes, I know its old, we're stuck due to certain compatibilities) with a AIT tape loader. The backups are split into two pools, data and config, and normally, when running a job that requires a specific pool, bacula has no problem unloading a tape from one pool and loading the required tape from another. Recently we had the backup server crash in the middle of a backup cycle. After which every time the server needs to load a tape from our config pool it stops, posts a warning, and asks to have the tape loaded manually. If I manually load the tape, the job runs fine. If it needs to run a data pool job, it will switch to that tape, but not back to a config tape next time a job requiring the config pool. Here is an example of the error messages from the log: 21-Mar 12:11 chetroketl-sd: atlantis_config_week_2.2007-03-21_12.11.25 Warning: Director wanted Volume Backup2Set2Tape15. Current Volume Backup2Set2Tape12 not acceptable because: 1998 Volume Backup2Set2Tape12 status is Full, not in Pool. 21-Mar 12:11 chetroketl-sd: Please mount Volume Backup2Set2Tape15 on Storage Device AIT3 Autoloader for Job atlantis_config_week_2.2007-03-21_12.11.25 Also, status sd reports: Device status: Archive AIT3 Autoloader is not open or does not exist. Device is BLOCKED waiting for append able media What happened and how do I fix it? Thanks, Charles - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows Authentication Errors
Can you telnet to the fd port on the windows machine from the director? Is there a firewall between the director and the windows machine? double check everything! ZK --- Lonny Selinger [EMAIL PROTECTED] wrote: On Tue, Mar 20, 2007 at 09:08:50PM -0600, Lonny Selinger wrote: I'm sure this has been tapped before but I can't seem to figure out what else could be causing my issue. I have set up a Windows machine as a client to test a backup and keep getting authentication errors. After reading the page on auth issues as well as following the intuitive return from bconsole I still have no idea what I'm doing wrong. WHat I'm getting is: 20-Mar 20:49 amanda-dir: Mine.2007-03-20_20.48.51 Fatal error: Unable to authenticate with File daemon on 192.168.69.18:9102. Possible causes: Passwords or names not the same or Maximum Concurrent Jobs exceeded on the FD or FD networking messed up (restart daemon). Please see http://www.bacula.org/rel-manual/faq.html#AuthorizationErrors for help. So I verified a couple of things for sure ... first, right now I'm not using passwords just to simplify things. Second the names are pretty simple and are It sounds like you mean you're not using *Windows* passwords, correct? Bacula doesn't use system account passwords for authentication. Instead, the password that error message is referring to is the one set in bacula configs, which must match on the client and director config. Read the FAQ entry the error message pointed to - it should help. Ok a little background ... I have bacula working with about 8 Linux hosts right now and wanted to add a Windows machine to test. For my director, I have all the passwords set to Password = including the password definition on the Windows machine for the client config. On the WIndows machine there is no local firewall (as it's already behind a firewall) and no local rules or AV that might thwart my attempt to connect. What I will try now is hunting through some archives as suggested to see how to better troubleshoot the Windows stuff. Currently with no passwords anywhere I figured it would respond the same as all my linux clients and just connect but sadly something isn't meshing up :-) Thanks for all the responses guys, I'll post what I find ... if I find anything lol -- Regards, Lonny -- To mess up a Linux box, you need to work at it; to mess up your Windows box, you just need to work ON it. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users We won't tell. Get more on shows you hate to love (and love to hate): Yahoo! TV's Guilty Pleasures list. http://tv.yahoo.com/collections/265 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
