Re: [Bacula-users] Still Unable To Truncate Files
I'm looking into this. I need to fix some other issues first. -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Doug Rintoul Sent: Monday, April 23, 2007 10:29 AM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Still Unable To Truncate Files On Tue, 2007-04-03 at 01:45 -0700, Robert Nelson wrote: Well I've done some testing. No matter what I did I was not able to trigger this using files 2GB. I set the maximum volume size at 2GB so the files were all about 1.9ish GB. I let it run for many days backing up over 200GB of data and it did not trigger the truncate problem. I purged large jobs which marked dozens of files to be recycled and it had no problem re-using those files. I would guess it created 160 files and recycled at least 100 of them - some more than once- I then used the label command to create 2 test volumes just over 2gb. I was able to get the error easily in a day. It did recycle them a few times, but eventually it tripped up. I would guess I recycled these two volumes only 5-6 times before it couldnt truncate them. This is bizarre. any more ideas? Im hoping I have it pegged this time and its not another false alarm. In light of this do you still want the debugging output from those specially compiled daemons? If you have the debugging out available for the case when it failed that would be useful. If not, hold off and I'll put in some more debug code to try and narrow it further with this new information. Has any more been discovered about this issue? I am seeing this regularly on my systems as well. No problem when volumes are less than 2GB. However volumes larger than 2GB trigger this bug. I really do not want to set the maximum volume size to be 2GB and have to deal with 30+ volumes for one backup. I am currently resorting to deleting the volume from the file system and creating a zero length file of the same name. Anything I can do to help debug? Doug Rintoul CanIL. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Goodbye and thanks for all the fish
I have been involved in the Bacula project for a year now. The first 9 months I spent working 6-7 days a week, 8+ hours a day: porting Storage and the Director to Windows rewriting the installer redesigning the Windows build process and contributed improvements to the Unix build fixing numerous Windows-specific as well as general bugs redesigning, simplifying and improving both the Windows and the core code porting the regression tests to Windows migrating the Source Management from CVS to Subversion I followed all the coding conventions, reviewed every significant change with Kern, and did everything possible to comply with all rules (both those outlined in the Developer's Guide as well as those inferred from reading between the lines in Kern's emails). I spent thousands of dollars putting together a test lab for all the tape loader, tape drive and CD changer technologies. During the last eight weeks I've been working on reproducing and fixing a tape drive on Windows bug and writing a new monitor application for Windows. I've watched the email lists for bugs that are specific to the new components I've added as well as helping users with Windows specific install problems. I also worked on a couple of other open source projects with which I'm involved. Oh, and I caught up on some of my work that actually produces income. The one thing I didn't do was update the manual. As a result, my admin privileges for the Bacula project were removed and I must submit all my changes as patches for review. I've done my best to work with Kern and I thought everything was great until the last week when he started threatening me with removing all the software (Windows Server version) I'd just devoted the better part of the last year working on. I'm not sure what I've done to upset him, but I'm not prepared to work in this environment. One of the nice things about Open Source is that if you don't like the rules you can not only take your marbles and go home, you can also take the other guy's marbles too. I'll be looking into providing a supported and compatible version of the software for Windows. Over time as the core code improves and diverges I'll probably also release versions for the other platforms too. I will also make sure that I pick up bug fixes from the Bacula project. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Goodbye and thanks for all thefish
Quotes below from Kern contradicting his response below -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Saturday, April 28, 2007 7:23 AM To: [EMAIL PROTECTED] Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] [Bacula-devel] Goodbye and thanks for all thefish Normally, I don't consider it my place to comment on a developer's parting words, and I don't disagree with most of what Robert has said, and there is no question that techically he is extremely brilliant, and that he has made a big contribution to Bacula, particularly in the Windows area. However, there are a few items where I feel he may have presented an incorrect interpretation that I would like to clarify. See below. On Saturday 28 April 2007 09:14, Robert Nelson wrote: I have been involved in the Bacula project for a year now. The first 9 months I spent working 6-7 days a week, 8+ hours a day: porting Storage and the Director to Windows rewriting the installer redesigning the Windows build process and contributed improvements to the Unix build fixing numerous Windows-specific as well as general bugs redesigning, simplifying and improving both the Windows and the core code porting the regression tests to Windows migrating the Source Management from CVS to Subversion I followed all the coding conventions, reviewed every significant change with Kern, and did everything possible to comply with all rules (both those outlined in the Developer's Guide as well as those inferred from reading between the lines in Kern's emails). I spent thousands of dollars putting together a test lab for all the tape loader, tape drive and CD changer technologies. During the last eight weeks I've been working on reproducing and fixing a tape drive on Windows bug and writing a new monitor application for Windows. I've watched the email lists for bugs that are specific to the new components I've added as well as helping users with Windows specific install problems. I also worked on a couple of other open source projects with which I'm involved. Oh, and I caught up on some of my work that actually produces income. The one thing I didn't do was update the manual. As a result, my admin privileges for the Bacula project were removed and I must submit all my changes as patches for review. Two points here: first, we are talking about a Source Forge project manager status. Recently so that Robert could complete the CVS - SVN conversion project, I gave Robert project manager status for Bacula on Source Forge. I did the for a specific task, not as something permanent since there are already three people serving as project manager for Bacula. As I promised the Free Software Foundation Europe to do before June, I recently (as I mentioned on recent email) removed all developers who have not signed the FSFE FLA (with a few exceptions). While doing this, I put Robert back to standard developer status, which seemed to me totally unworthy of any special mention. As of this moment, Robert has full write access to the SVN as do all other developers. I have never asked Robert to submit all his changes as patches for review. I did explicitly ask him to sumit a patch to me so that we could review it for possible inclusion into 2.2.0. This is *exactly* the same status that all other developers have at this stage. I have asked them all to submit to me any new features, but they can continue to work on fixing bugs. This is completely normal, I have been doing the same thing for five years now. Just this morning, Robert committed one or two bug fixes without notifying me (which is perfectly fine with me), so I have a hard time understanding this complaint. Just so there is no confusion, I have said that I will be moving to a mode where I do review all patches in more detail, and I have said that certain developers already use such a system, and that it works well, at least for me. This is something I am currently considering and I have not imposed it on Robert or anyone else. 3c. A minority of the developers (there are thank God some), take full responsibility for writing the code, posting as patches so that I can review it as time permits, integrating it at an appropriate time, responding to my requests for tweaking it (name changes, ...), document it in the code, document it in the manual (even though their mother tongue is not English), test it, develop and commit regression scripts, and answer in a timely fashion all bug reports -- even occassionally accepting additional bugs :-) Item 3.c is a sustainable way of going forward with Bacula
Re: [Bacula-users] Bacula was reseting the SCSI controller when jobfinished / solved
Does this occur if you run tapeinfo manually? -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Andreas Helmcke Sent: Monday, April 23, 2007 12:39 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Bacula was reseting the SCSI controller when jobfinished / solved running bacula 2.0.3 with mysql 4.1.13 on SuSE 10.0; mtx 1.3.10; smartctl 5.36 ADIC scalar-100 with 4 LTO-1 drives Hello, I had some strange problems with bacula. Main effect: I am running 3 concurrent jobs every day which use 3 drives. Because of the suboptimal method of picking a drive for a job (as recently reported) bacula keeps changing the drives for the jobs so it has to unload / load the tapes. Somtimes the tapes could not be appended to after they where moved from one drive to another. After several days of testing and searching (in fact using 3 different scsi-controlers) i finally got the culprit. It was the Alert Command = line calling tapeinfo which seems to reset the scsi controller. So the first job which finishes called tapeinfo which reseted the scsi-bus and so confusing the still running jobs on the other drives. After disabling the Alert Command i got no more reset messages in the message-log and no more problems with the tapes. As far as i can tell by now (just tested once) the problem does not concern smartctl. Andreas - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Bacula Status -- change of direction formyparticipation in the project
-Original Message- From: [EMAIL PROTECTED] [mailto:bacula-devel- [EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Friday, April 20, 2007 2:37 AM To: [EMAIL PROTECTED] Cc: Robert Nelson; 'Shane Coughlan'; 'bacula-users' Subject: Re: [Bacula-devel] Bacula Status -- change of direction formyparticipation in the project On Thursday 19 April 2007 23:26, Robert Nelson wrote: Comments inline below -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-devel- [EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Thursday, April 19, 2007 3:10 AM To: bacula-devel; bacula-users Cc: Shane Coughlan Subject: [Bacula-devel] Bacula Status -- change of direction for myparticipation in the project Hello, Open Source is a fantastic success story, and shows every sign of becoming a gigantic snow ball over the next few years. Usage of Bacula is increasing significantly, which is very pleasing. However, the development side of Bacula, with one or two exceptions, I consider a total failure. Bacula has received quite a number of submissions other than my contributions over the years. However, in general, these submissions have been made without documentation (leaving it to me to document) and the developer after a short time has for various reasons moved on to other things (change of job, change of life status, other interests, ...). All this is normal, but what I find very disappointing is that with only a couple of exceptions that come to mind there are no permanent Bacula developers other than myself. (Just so that there is no confusion or ill feelings, Scott, Dan, and Eric have been around for quite a while and have and are making significant contributions -- there are certainly others who don't come to mind immediately, so, please accept my appologies -- also, I think the users list is working quite well. What I am talking about is the lack of highly qualified, committed, and permanent Bacula developers). I hope I'm not one of the developers that you feel isn't qualified or committed. I'm not sure what you mean by permanent. I think you took my statements from the wrong angle. I wasn't complaining about any of the existing developers, but indicating that the Bacula project does not have sufficient qualified, committed, and permanent (long term) developers. I gave an idication somewhat above by what I mean by permanent. In your case, you are certainly qualified, probably the most technically qualified of all the people who have worked on Bacula. You have not been around long enough for me to consider you permanent. Only time will tell. However your participation, which is very much appreciated seems to come in bursts rather than consistently day after day. This is fine, as I will accept all the help I can get in any form. Example, your last email was on 6 March. My last emails on the list were Apr 6th not Mar 6th. For the last two weeks I've been working on the new monitor program which is why I haven't been posting to the list. I answer the questions on the mailing list that are specific to the Windows version. I usually ignore those that are general Bacula questions, even if they are running Windows, unless there is some Windows specific aspect. That's fine. My point here, is that today, I am essentially the only developer doing documentation, the only developer fixing bugs, the only developer doing testing on the different platforms. After 7+ years of doing it 12-14 hours a day for 6 and sometimes 7 days a week, I am more than a bit disappointed that there isn't more help. The fault may possibly be my own, but what ever the case may be that is where we are. I have also been fixing bugs. Yes, you have fixed bugs, and I appreciate that. However, I don't consider you as an active developer that is doing bug fixing. I will give you a few examples, and they aren't at all intended to criticize you, but to indicate the level of committment that I see in your participation (which is of course for you to define) and thus indicate to you more clearly why I made the Win32 decision. The last time you made a commit was 15 March over a month ago, and before that it was 7 Feb. This is fine, and I am happy to get those commits/fixes. I'm not aware of other bugs in the Windows specific code. As an example of what I am lamenting here is that there is a Win 2003 bug open since 20 March where restore of encrypted (and compressed if I remember right) data fails. Another example is that despite my repeated requests over something like a six month period, no one (at this moment) has signed up to do Win32, Solaris, or FreeBSD regression testing. As far as this specific bug is concerned, I just realized it is assigned to me
Re: [Bacula-users] [Bacula-devel] Bacula Status -- change of direction for myparticipation in the project
Comments inline below -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-devel- [EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Thursday, April 19, 2007 3:10 AM To: bacula-devel; bacula-users Cc: Shane Coughlan Subject: [Bacula-devel] Bacula Status -- change of direction for myparticipation in the project Hello, Open Source is a fantastic success story, and shows every sign of becoming a gigantic snow ball over the next few years. Usage of Bacula is increasing significantly, which is very pleasing. However, the development side of Bacula, with one or two exceptions, I consider a total failure. Bacula has received quite a number of submissions other than my contributions over the years. However, in general, these submissions have been made without documentation (leaving it to me to document) and the developer after a short time has for various reasons moved on to other things (change of job, change of life status, other interests, ...). All this is normal, but what I find very disappointing is that with only a couple of exceptions that come to mind there are no permanent Bacula developers other than myself. (Just so that there is no confusion or ill feelings, Scott, Dan, and Eric have been around for quite a while and have and are making significant contributions -- there are certainly others who don't come to mind immediately, so, please accept my appologies -- also, I think the users list is working quite well. What I am talking about is the lack of highly qualified, committed, and permanent Bacula developers). I hope I'm not one of the developers that you feel isn't qualified or committed. I'm not sure what you mean by permanent. I answer the questions on the mailing list that are specific to the Windows version. I usually ignore those that are general Bacula questions, even if they are running Windows, unless there is some Windows specific aspect. My point here, is that today, I am essentially the only developer doing documentation, the only developer fixing bugs, the only developer doing testing on the different platforms. After 7+ years of doing it 12-14 hours a day for 6 and sometimes 7 days a week, I am more than a bit disappointed that there isn't more help. The fault may possibly be my own, but what ever the case may be that is where we are. I have also been fixing bugs. As an example of what I am lamenting here is that there is a Win 2003 bug open since 20 March where restore of encrypted (and compressed if I remember right) data fails. Another example is that despite my repeated requests over something like a six month period, no one (at this moment) has signed up to do Win32, Solaris, or FreeBSD regression testing. As far as this specific bug is concerned, I just realized it is assigned to me. However I thought there was someone else working on the Encryption code. Even though this problem is reported on Windows the problem is more likely to be a generic problem with encryption support. My solution to this problem is several fold: 1. As of release 2.2.0, Win32, Solaris, and FreeBSD will no longer be officially supported platforms. So that there is no misunderstanding, I definitely would like to see them supported, but I am no longer going to do it alone, which means that I will accept patches for them, I will not accept bug reports that are specific to those platforms, they will be documented as use if it works for you but don't complain if it doesn't, and the project will no longer supply binaries for the Director and Storage daemon for Win32. Users can build it themselves if they want to use it. I don't understand why you are taking this position in regards to the Windows version. We've talked a number of times about the support and documentation issues. I agreed to provide support for any Windows specific problems which I have been doing. As far as documentation is concerned, you said you would make the changes if I provided a description of the differences. In fact, in the last email you seemed quite happy when I mentioned that there aren't any real configuration differences other than the device names. The README file included with the installation documents all the differences of which I'm aware. I periodically run the Windows regression tests (which I ported). You've also asked for help running the regression tests which I agreed to do. But each time you've indicated it would be at some point in the future but you've never got back to me that you were ready. I also offered to do the Windows releases for you and you agreed it would help. However, whenever you are making a release you've said that you were taking care of the Windows release. Currently I'm working on the new Bacula Tray application. This will replace the built-in tray code. It will eliminate the need to run using the SYSTEM account. It also allows remote systems to be monitored. Encryption
Re: [Bacula-users] DVD autoloader?
You can use the Sony VAIO XL1B2; it's a 200 disc changer that retails for 400 US$. It is supported by the current release of mtx (version 1.39.11) which you can download from http://sourceforge.net/projects/mtx. -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Lucio Crusca Sent: Friday, April 06, 2007 5:03 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] DVD autoloader? Hello *, I plan to install Bacula on a fileserver which currently lacks a backup solution and I wonder if there are any DVD autoloaders around that I can use with bacula. I've googled around but i've manged to find only boxed solutions that include backup software also, nothing like a bare dvd autoloader. The search dvd autoloader bacula yelds no results... moreover http://www.bacula.org/rel-manual/Autochanger_Support.html says that Bacula provides autochanger support for reading and writing *tapes* Am I the only one in the world willing to use Bacula with a DVD library? Lucio. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encoding problems on restore
Which version of Windows is this? -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Christoph Litauer Sent: Thursday, April 05, 2007 7:38 AM To: bacula-users Subject: [Bacula-users] Encoding problems on restore Hi, I have problems restoring a german windows system backup'd with bacula. German windows installations contain german umlauts in some path names (e.g. c:/../Startmenü/...). The files are all created but as bacula tries to cahnge the file permissions I got lots of errors like: 05-Apr 16:12 hisservld-fd: RestoreFiles.2007-04-05_16.10.57 Warning: Cannot change permissions of C:/temp/bacula/C/Dokumente und Einstellungen/Administrator/StartmenÃŒ/Programme/Autostart: ERR=No such file or directory As you can see, the german umlaut ü has been changed to a UTF8 representation. Any hints how to avoid this? Thanks a lot in advance. -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows restore to different location problem
Which version of Bacula are you using? It seems to me that this was already fixed. -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Yuri T Sent: Wednesday, March 28, 2007 7:40 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Windows restore to different location problem Trying to restore to a windows 2000 server, marked this directory. d:/Public/Databases Changed restore 'where' with mod to d:/Public/restored I get this error as if bacula is trying to create the win root directory in the subdirectory. Error: Cannot create directory d:: ERR=Invalid argument And also, Error: ../../findlib/create_file.c:208 Could not create d:/Public/restored/$ Any clues as to how to fix or get around this? Yuri - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Still Unable To Truncate Files
Well I've done some testing. No matter what I did I was not able to trigger this using files 2GB. I set the maximum volume size at 2GB so the files were all about 1.9ish GB. I let it run for many days backing up over 200GB of data and it did not trigger the truncate problem. I purged large jobs which marked dozens of files to be recycled and it had no problem re-using those files. I would guess it created 160 files and recycled at least 100 of them - some more than once- I then used the label command to create 2 test volumes just over 2gb. I was able to get the error easily in a day. It did recycle them a few times, but eventually it tripped up. I would guess I recycled these two volumes only 5-6 times before it couldnt truncate them. This is bizarre. any more ideas? Im hoping I have it pegged this time and its not another false alarm. In light of this do you still want the debugging output from those specially compiled daemons? If you have the debugging out available for the case when it failed that would be useful. If not, hold off and I'll put in some more debug code to try and narrow it further with this new information. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Invalid switch - comp01-sd*.spool
I put a fixed 2.0.3 version of bacula-sd.exe on my anonymous ftp site. The URL is: ftp://ftp.the-nelsons.org/pub/brian_debelius/bacula-sd.exe Please let me know if this fixes the problem and I'll check in the fix for the next 2.0.x release. Thanks, -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Robert Nelson Sent: Tuesday, April 03, 2007 5:45 PM To: 'Brian Debelius'; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Invalid switch - comp01-sd*.spool This is a bug in the Windows port of the SD. I'll fix it. -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Brian Debelius Sent: Tuesday, April 03, 2007 11:17 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Invalid switch - comp01-sd*.spool Windows 2003r2 dir, sd, fd; Bacula v2.0.3; Exabyte VXA-172, LSI scsi While playing around with debugging, I discovered this error at the command line; Invalid switch - comp01-sd*.spool This surprised me, since the sd has been working fine as far as I know. The only reference I can find in the trace file is this comp01-sd: ../compat/compat.cpp:1797 Calling CreateProcess(C:\WINDOWS\system32\cmd.exe, C:\WINDOWS\system32\cmd.exe /c del /q C:\Documents and Settings\All Users\Application Data\Bacula\Work/comp01-sd*.spool, ...) and the only thing that seems odd in this, is that a backslash is a forward slash. Any ideas? - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Trying to workaround the MTWEOF error
-Original Message- From: Brian Debelius [mailto:[EMAIL PROTECTED] Sent: Friday, March 30, 2007 11:11 AM To: Robert Nelson Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Trying to workaround the MTWEOF error Well, I know tha Nawfel had this problem with his Ultrium. I have an Exabyte VXA-172, which is a firmware crippled VXA-320, and I have this problem also. Yes this is a Windows installation. Director, sd, and fd on one box. Hopefully the VXA-172 has the same problem and I'll be able to solve both with one device. My hardware acquisition budget is already strained :-). Ahh, so you are saying that Maximum Volume Bytes, is the count of bytes sent to the tape drive, not the count of bytes written to the tape. Yes unfortunately Bacula has no way of knowing what the count was after compression, at least not in a device independent manner. brian- Robert Nelson wrote: Brian, Are you also seeing this on Windows? If so it is quite possible that I have a bug in the Windows emulation of the UNIX tape IOCTLs. I've ordered an Ultrium 232 drive to do further testing on both Windows and Linux. If there is anything we can do to fix this in Bacula I should have a fix next week. In the meantime you can use the Maximum Volume Bytes to work around the problem. That isn't a good long term solution though; since it doesn't account for the tape saved through compression. You could be wasting as much as half the tape. -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Brian Debelius Sent: Friday, March 30, 2007 6:21 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Trying to workaround the MTWEOF error Is there a way I can work around the end of tape MTWEOF error by telling bacula to limit the amount of data written to the tape? Lets say I have an 80GB tape. Is there a way to tell bacula to only write 75 or 70GB and then start a new tape? My next thought is, Can logic be added to bacula such that when it realizes that it has written off the end of the tape, to have it rewind some amount of blocks, write an eof, and then continue onto the next tape, starting with and duplicating the blocks it backspaced over on the first tape? brian --- -- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows Client, VSS Issues, 2.0.3?
Okay great, I think this should give me something to work with. I'll try and repro it here. -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Michael Gerszewski Sent: Friday, March 30, 2007 12:48 PM To: bacula-users@lists.sourceforge.net Cc: Robert Nelson Subject: Re: [Bacula-users] Windows Client, VSS Issues, 2.0.3? Bacula backup sitting at 0 bytes. Floppy drive and hard drive did a seek like a normal VSS startup. vssadmin list shadows: vssadmin 1.0 - Volume Shadow Copy Service administrative command-line tool (C) Copyright 2001 Microsoft Corp. No shadow copies present in the system. --- When I try to run the vssadmin list writers, it waits for a response. Like VSS is just hung up. I never do get a response from the vssadmin list writers unless I kill the FD and the VSS process. It is difficult for me to reproduce the hung at end scenario. But I'll certainly get you the output the next time I see it. With the failed VSS components...When I check and Bacula hasn't been run yet on the system, both are listed as stable. I did see another as failed, and sometimes they return a status: 7, failed. I do run some MS backups on this system as well. Hopefully those aren't causing any conflicts. Thanks again. A great community here. Mike Robert Nelson wrote: -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Michael Gerszewski Sent: Friday, March 30, 2007 12:07 PM To: bacula-users@lists.sourceforge.net Cc: Robert Nelson Subject: Re: [Bacula-users] Windows Client, VSS Issues, 2.0.3? Thanks for the quick response. vssadmin list writers: vssadmin 1.0 - Volume Shadow Copy Service administrative command-line tool (C) Copyright 2001 Microsoft Corp. Writer name: 'MSDEWriter' Writer Id: {f8544ac1-0611-4fa5-b04b-f7ee00b03277} Writer Instance Id: {b9048c82-c0b6-42e8-b885-3ddc806474bd} State: [1] Stable Writer name: 'WMI Writer' Writer Id: {a6ad56c2-b509-4e6c-bb19-49d8f43532f0} Writer Instance Id: {a4358c3f-d8b3-4e32-971a-a1aa47f7b0fb} State: [9] Failed Writer name: 'IIS Metabase Writer' Writer Id: {59b1f0cf-90ef-465f-9609-6ca8b2938366} Writer Instance Id: {38ebb2dd-0122-48e1-915e-23ce2aed2e95} State: [9] Failed Interesting the above two seemed to have failed their initialization. Writer name: 'Microsoft Writer (Bootable State)' Writer Id: {f2436e37-09f5-41af-9b2a-4ca2435dbfd5} Writer Instance Id: {9470d858-515e-47d9-bf71-ba1a26782a69} State: [1] Stable Writer name: 'Microsoft Writer (Service State)' Writer Id: {e38c2e3c-d4fb-4f4d-9550-fcafda8aae9a} Writer Instance Id: {1a9ca255-4ad6-4172-9d04-d433e9958d33} State: [1] Stable -- vssadmin list shadows (while backup is running): vssadmin 1.0 - Volume Shadow Copy Service administrative command-line tool (C) Copyright 2001 Microsoft Corp. Contents of shadow copy set {26035bf3-a48b-4993-afcb-6f48affefd4c} (The shadow copy set contained 1 shadow copies at creation time, 1 shadow copie s exist now) 'MS Software Shadow Copy provider 1.0' shadow copy {d6dc446b-5cae-46bb-a555-d344 c70d65e5} on volume \\?\Volume{d27e6118-47d1-11d9-aa59-806d6172696f}\ -- That looks good. vssadmin list shadows (after backup completes): vssadmin 1.0 - Volume Shadow Copy Service administrative command-line tool (C) Copyright 2001 Microsoft Corp. No shadow copies present in the system. - That looks very good, doesn't seem we have any leftover crud. A couple more notes that may or may not make a difference. I am running SQL Server Express 2005 on this system, and the event logs show the databases freezing and unfreezing during the bacula backups. The log is telling me the database was successfully backed up, but I am not backing up anything from my SQL databases (to my knowledge). That's expected, the system doesn't know what we'll be backing up at the time we initiate the shadow. Thanks Mike Can you also post the output from vssadmin list shadows when the backup is hung? Meanwhile, I'll check and make sure we release all our interface pointers. Robert Nelson wrote: What is the output from the command vssadmin list writers? Also what is the output from the command vssadmin list shadows after the successful backup but prior to the next backup? -Original Message- From: [EMAIL PROTECTED] [mailto:bacula- users- [EMAIL PROTECTED] On Behalf Of Michael Gerszewski Sent: Friday, March 30, 2007 11:27 AM To: bacula-users Subject: [Bacula-users] Windows Client, VSS Issues, 2.0.3? Greetings, I have been evaluating Bacula for the School District I work for as a backup option for our Windows 2003 Servers. I like many of the features Bacula has compared to other solutions
Re: [Bacula-users] Re : Re : ioctl MTWEOF error (was :Windows::Permission denied)
-Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Arno Lehmann Sent: Thursday, March 29, 2007 5:03 PM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Re : Re : ioctl MTWEOF error (was :Windows::Permission denied) Hi, On 3/29/2007 6:20 PM, [EMAIL PROTECTED] wrote: Sorry brian, the boss asked me to install it under OpenSUSE 10.2 ! Probably a good choice because under linux, Bacula runs without serious problems. Usually :-) Yes that would be true, if any of his problems were Windows specific. However issue that he's had has been configuration problems of his own making. He's put resource types in the wrong files or keywords in the wrong resources, etc. The closest he's come to a Windows specific issue is this last one with MTWEOF. I've ordered one the Ulrium 232 tape drives to see if I can repro it. So I'm going back from zero !! not cool ! You will probably notice that, in the same time you spend with Bacula on Windows, you have a company-wide reliable and proven backup setup :-) Since all the time so far has been writing configuration files and they are pretty much identical between Linux and Windows I disagree. Of course you won't help making the windows version better, and if you're a windows admin you'll have difficulties getting used to the nix/linux taste of things. The only benefit he's likely to get from moving to Linux is that there are more people here with Linux experience that can assist him. Thanks a lot.. PS: do anybody have a tip for the OpenSuse Bacula installation (I speak about something not listed in the doc ;-) ) Start with the manual, and try to keep your configuration short and well documented for a start. From then on, you'll probably only add clients for a while, and any problems you encounter can be discussed on this list. If he'd read the manual on the three types of configuration files and their respective resources and values he wouldn't have had any problems in the first place. Arno - Message d'origine De : Brian Debelius [EMAIL PROTECTED] À : [EMAIL PROTECTED] Cc : bacula-users@lists.sourceforge.net Envoyé le : Jeudi, 29 Mars 2007, 11h22mn 24s Objet : Re: [Bacula-users] Re : ioctl MTWEOF error (was :Windows::Permission denied) I clear all my tapes prior to labeling. use mtx-changer to load a tape then mt -f Tape0 rewind mt -f Tape0 weof mt -f Tape0 rewind [EMAIL PROTECTED] wrote: This is what I got in the bacula console : Connecting to Director ILEMMA009:9101 1000 OK: ilemma009-dir Version: 2.0.3 (06 March 2007) Enter a period to cancel a command. *messages 29-Mar 09:11 ilemma009-dir: Start Backup JobId 31, Job=Client1.2007-03-29_09.11. 00 29-Mar 09:11 ilemma009-sd: Job Client1.2007-03-29_09.11.00 waiting. Cannot find any appendable volumes. Please use the label command to create a new Volume for: Storage: HPStorageTape0 (Tape0) Media type: HPUltriumTape Pool: Default 29-Mar 09:11 ilemma009-dir: Client1.2007-03-29_09.11.00 Error: ../../lib/message .c:713 Operator mail program terminated in error. CMD=C:\Program Files\Bacula\bin\bsmtp -h @smtp_host@ -f (Bacula) Administrato r -s Bacula: Intervention needed for Client1.2007-03-29_09.11.00 Administrato r ERR=Unknown error *label Automatically selected Catalog: MyCatalog Using Catalog MyCatalog Automatically selected Storage: HPTape Connecting to Storage daemon HPTape at ILEMMA009:9103 ... Enter autochanger drive[0]: Enter new Volume name: A Enter slot (0 or Enter for none): 0 Automatically selected Pool: Default Connecting to Storage daemon HPTape at ILEMMA009:9103 ... Sending label command for Volume A Slot 0 ... Invalid slot=0 defined, cannot autoload Volume. 3301 Issuing autochanger loaded? drive 0 command. 3302 Autochanger loaded? drive 0, result: nothing loaded. 3301 Issuing autochanger loaded? drive 0 command. 3302 Autochanger loaded? drive 0, result: nothing loaded. 3912 Failed to label Volume: ERR=../../stored/dev.c:764 Rewind error on HPStora geTape0 (Tape0). ERR=Unknown error. Label command failed for Volume A. Do not forget to mount the drive!!! *mount Automatically selected Storage: HPTape Enter autochanger drive[0]: 1 Enter autochanger slot: 1 3301 Issuing autochanger loaded? drive 1 command. 3302 Autochanger loaded? drive 1, result: nothing loaded. 3304 Issuing autochanger load slot 1, drive 1 command. 3305 Autochanger load slot 1, drive 1, status is OK. 3301 Issuing autochanger loaded? drive 1 command. 3302 Autochanger loaded? drive 1, result: nothing loaded. 3901 open device failed: ERR=../../stored/dev.c:425 Unable to open device HPSto rageTape1 (Tape1):
Re: [Bacula-users] Scheduled eject under windows?
-Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Gordon McLellan Sent: Wednesday, March 28, 2007 7:39 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Scheduled eject under windows? Greetings List! I've recently adopted bacula as a network backup solution for a small number of servers. After working with it for a few hours, I stand impressed. The flexibility and configuration options are awesome. One thing I need help with is ejecting the tape, before it is full. I would like to do a 5 week rotation on my tapes. The tapes are 400gb LTO3, but right now I'm only writing about 200gb to them. I run a full backup Monday night and differential backups Tuesday-Friday. I would like the tape to eject on Monday morning so I can swap it for the next week's tape. My storage server is a Windows 2003 machine, which I understand comes with risks. The drive lives on this machine because it is the one with the bulk of the storage (~150g), so it made sense to have the drive local to the biggest backup target. From google, I've pieced together a few scraps for how I might schedule the tape to eject, but so far I've had no luck. I've set OfflineOnUnmount=yes in the storage daemon configuration, and when I issue the unmount command in the wx-console, the tape eventually ejects. So I've setup an admin job on the director, which has a RunScript directive in it, commanding bconsole with the unmount command. However, it's not working. I also don't receive any errors, just that the job completed without error. here's a snippet of my bacula-sd.conf Device { Name = LTO3 # Drive Index = 0 Media Type = LTO3 Device Type = Tape Archive Device = Tape0 AutomaticMount = yes # when device opened, read it Offline On Unmount = Yes AlwaysOpen = yes RemovableMedia = yes RandomAccess = no Changer Device = Tape0 Alert Command = tapeinfo -f %c | findstr TapeAlert } and here's the job in bacula-dir.conf Job { Name = EjectTape Type = Admin RunScript { Runs When = Before AbortJobOnError = No Command = bconsole c:\\eject } Schedule = EjectTape Client = third-fd Messages = Standard Pool = Tape Storage = LTO3 Fileset = Windows Full Set } the file c:\\eject is a plain text file with the contents: unmount quit I have C:\Program Files\Bacula\bin in the system path, and if I run that script command on the command line, the tape ejects. Any suggestions??? Admin Jobs only run on the director, there is no client associated with them. You haven't specified RunsOnClient=no so the script is scheduled to run on the client which is never going to happen. Since the director is running on a different machine from the tape drive running the script on the director isn't going to help either. What you really want is a RunScript command that runs on a Storage Daemon but that facility isn't available. Since in your case you know the storage daemon is on a specific client machine you could run a fake backup job with the RunScript specifying AbortJobOnError=yes and then put exit 1 at the end of the batch script. Oh, on a side note, I'm having trouble with the tapealert feature: State: 0x1 (VSS_WS_STABLE) 27-Mar 21:00 third-sd: 3997 Bad alert command: tapeinfo -f Tape0 | findstr TapeAlert: ERR=Unknown error. when I run the command tapeinfo -f Tape0 | findstr TapeAlert on the command line, I get no output, which is to be expected. tapeinfo -f Tape0 by itself gives me all sorts of data on the drive and tape. Any thoughts about what it means bad alert command? There is a problem with tapealert and Windows. Bacula calls that command while it still has the device open so tapeinfo can't open it. This is a known problem which will be fixed in a future release. Thanks a bunch! Gordon - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net
Re: [Bacula-users] linux-dir and windows-sd
Does the directory E:\backup exist? _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Raymond Luong Sent: Wednesday, March 28, 2007 4:43 PM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] linux-dir and windows-sd Hi I am using bacula 2.0.3 I got my linuxFC6-dir and windowsXP-sd machine to talk to each other. When I try to run a backup it gives me the following error. If anyone know how to resolve this problem, please feel free to pass it along. As you can see the linux-dir does not know the SD is a windows machines therefore is using the wrong /. Anyone know how to tell DIR SD is a windows machines so it will use the \ instead? Error: Job queued. JobId=117 28-Mar 15:46 backupdir-dir: Start Backup JobId 117, Job=Client1.2007-03-28_15.45.58 28-Mar 15:46 backupdir-dir: Created new Volume Client1-2007-3-28-15.46.1 in catalog. 28-Mar 15:45 backupsd-sd: Labeled new Volume Client1-2007-3-28-15.46.1 on device FileStorage (E:\backup). 28-Mar 15:45 backupsd-sd: Client1.2007-03-28_15.45.58 Error: Could not open device FileStorage (E:\backup): ERR=../../stored/dev.c:483 Could not open: E:\backup/Client1-2007-3-28-15.46.1, ERR=Permission denied 28-Mar 15:45 backupsd-sd: Client1.2007-03-28_15.45.58 Fatal error: Could not ready device FileStorage (E:\backup) for append. 28-Mar 15:46 backupdir-fd: Client1.2007-03-28_15.45.58 Fatal error: job.c:1758 Bad response to Append Data command. Wanted 3000 OK data , got 3903 Error append data 28-Mar 15:46 backupdir-dir: Client1.2007-03-28_15.45.58 Error: Bacula 2.0.3 (06Mar07): 28-Mar-2007 15:46:04 JobId: 117 Job:Client1.2007-03-28_15.45.58 Backup Level: Incremental, since=2007-03-28 01:05:04 Client: backupdir-fd 2.0.3 (06Mar07) i686-pc-linux-gnu,redhat,(Zod) FileSet:backupSet 2007-03-16 17:05:59 Pool: Default (From Job resource) Storage:File (From Job resource) Scheduled time: 28-Mar-2007 15:45:57 Start time: 28-Mar-2007 15:46:03 End time: 28-Mar-2007 15:46:04 Elapsed time: 1 sec Priority: 10 FD Files Written: 0 SD Files Written: 0 FD Bytes Written: 0 (0 B) SD Bytes Written: 0 (0 B) Rate: 0.0 KB/s Software Compression: None VSS:no Encryption: no Volume name(s): Volume Session Id: 1 Volume Session Time:1175121634 Last Volume Bytes: 0 (0 B) Non-fatal FD errors:0 SD Errors: 0 FD termination status: Error SD termination status: Error Termination:*** Backup Error *** Raymond Luong IT Department Mocana Corporation - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Should tapes drives on windows work?
Can you post your Bacula-sd.conf (Without the passwords)? -Original Message- From: Rex Wheeler [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 27, 2007 12:23 AM To: Robert Nelson; bacula-users@lists.sourceforge.net Subject: RE: [Bacula-users] Should tapes drives on windows work? Here are some btape commands and the output: C:\Program Files\Bacula\binbtape -v -d 100 DLT-7000 Tape block granularity is 1024 bytes. btape: ../compat/compat.cpp:378 Leave wchar_win32_path=\ btape: ../compat/compat.cpp:107 Enter convert_unix_to_win32_path btape: ../compat/compat.cpp:158 path=\\?\bacula-sd.conf btape: ../compat/compat.cpp:167 Leave cvt_u_to_win32_path path=\\?\bacula-sd.conf btape: ../compat/compat.cpp:194 Enter wchar_win32_path btape: ../compat/compat.cpp:208 Leave wchar_win32_path no change btape: ../compat/compat.cpp:729 GetFileAttributes(\\?\bacula-sd.conf): The system cannot find the file specified. btape: ../../stored/stored_conf.c:675 Inserting director res: buster-mon btape: ../../stored/butil.c:286 Using device: DLT-7000 for writing. btape: ../../stored/dev.c:254 init_dev: tape=1 dev_name=Tape0 btape: ../../stored/dev.c:295 open dev: type=2 dev_name=DLT-7000 (Tape0) vol= mode=OPEN_READ_ONLY btape: ../../stored/dev.c:345 Open dev: device is tape btape: ../../stored/dev.c:360 Try open DLT-7000 (Tape0) mode=OPEN_READ_ONLY btape: ../../stored/dev.c:434 open dev: tape 3 opened btape: ../../stored/dev.c:309 preserve=0x0 fd=3 btape: ../../stored/dev.c:286 Close fd for mode change. btape: ../../stored/dev.c:295 open dev: type=2 dev_name=DLT-7000 (Tape0) vol= mode=OPEN_READ_WRITE btape: ../../stored/dev.c:345 Open dev: device is tape btape: ../../stored/dev.c:360 Try open DLT-7000 (Tape0) mode=OPEN_READ_WRITE btape: ../../stored/dev.c:434 open dev: tape 3 opened btape: ../../stored/dev.c:309 preserve=0x0 fd=3 btape: ../../stored/btape.c:368 open device DLT-7000 (Tape0): OK *rewind btape: ../../stored/btape.c:469 Rewound DLT-7000 (Tape0) *weof btape: ../../stored/btape.c:499 Wrote 1 EOF to DLT-7000 (Tape0) *test === Write, rewind, and re-read test === I'm going to write 1000 records and an EOF then write 1000 records and an EOF, then rewind, and re-read the data to verify that it is correct. This is an *essential* feature ... 27-Mar 00:17 btape: btape Error: ../../stored/block.c:569 Write error at 0:0 on device DLT-7000 (Tape0). ERR=Input/out put error. btape: ../../stored/block.c:581 === Write error. fd=3 size=64512 rtn=-1 dev_blk=0 blk_blk=0 errno=5: ERR=Input/output er ror btape: ../../stored/block.c:748 dir_update_volume_info terminate writing -- OK btape: ../../stored/block.c:771 Leave terminate_writing_volume -- OK btape: ../../stored/dev.c:1433 bsf btape: ../../stored/dev.c:1534 bsr_dev 27-Mar 00:17 btape: btape Error: Backspace record at EOT failed. ERR=Input/output error btape: ../../stored/btape.c:821 Error writing block to device. *rewind btape: ../../stored/btape.c:469 Rewound DLT-7000 (Tape0) *label Enter Volume Name: test 27-Mar 00:18 btape: Fatal Error at ../../stored/dev.c:1670 because: ../../stored/dev.c:1669 Attempt to WEOF on non-appendable Volume btape: ../../stored/label.c:311 write_volume_label() btape: ../../stored/label.c:588 Start create_volume_label() btape: ../../stored/reserve.c:213 free_volume: no vol on dev DLT-7000 (Tape0) Volume Label: Id: Bacula 1.0 immortal VerNo : 11 VolName : test PrevVolName : VolFile : 0 LabelType : PRE_LABEL LabelSize : 0 PoolName : Default MediaType : DLT PoolType : Backup HostName : Date label written: 27-Mar-2007 00:18 btape: ../../stored/label.c:369 Wrote label of 141 bytes to DLT-7000 (Tape0) btape: ../../stored/label.c:372 Call write_block_to_dev() 27-Mar 00:18 btape: btape Error: ../../stored/block.c:569 Write error at 0:0 on device DLT-7000 (Tape0). ERR=Input/out put error. btape: ../../stored/block.c:581 === Write error. fd=3 size=64512 rtn=-1 dev_blk=0 blk_blk=0 errno=5: ERR=Input/output er ror btape: ../../stored/block.c:748 dir_update_volume_info terminate writing -- OK btape: ../../stored/block.c:771 Leave terminate_writing_volume -- OK btape: ../../stored/dev.c:1433 bsf btape: ../../stored/dev.c:1534 bsr_dev 27-Mar 00:19 btape: btape Error: Backspace record at EOT failed. ERR=Input/output error btape: ../../stored/label.c:374 Bad Label write on DLT-7000 (Tape0): ERR=../../stored/dev.c:1545 ioctl MTBSR error on DLT-7000 (Tape0). ERR=Input/output error. Wrote Volume label for volume test. *readlabel btape: ../../stored/label.c:81 Enter read_volume_label res=0 device=DLT-7000 (Tape0) vol= dev_Vol=*NULL* btape: ../../stored/label.c:104 Leave read_volume_label() VOL_OK btape: ../../stored/btape.c:419 Volume label read correctly. Volume Label: Id: VerNo : 0 VolName
Re: [Bacula-users] Should tapes drives on windows work?
There is one typo in your configuration; in the messages resource it should be molerat-dir not molerat-sd. I doubt this has anything to do with the problem though. Are there any messages logged in the Windows Event log at the time of the error? -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Rex Wheeler Sent: Tuesday, March 27, 2007 12:56 AM To: Robert Nelson; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Should tapes drives on windows work? Storage { Name = buster-sd SDPort = 9103 WorkingDirectory = C:\\Documents and Settings\\All Users\\Application Data\\Bacula\\Work Pid Directory = C:\\Documents and Settings\\All Users\\Application Data\\Bacula\\Work Maximum Concurrent Jobs = 10 } Director { Name = molerat-dir Password = xxx } Director { Name = buster-mon Password = xxx Monitor = yes } Device { Name = DLT-7000 Media Type = DLT Device Type = Tape Archive Device = Tape0 AutomaticMount = yes AlwaysOpen = yes RemovableMedia = yes RandomAccess = no } Messages { Name = Standard director = molerat-sd = all } -Original Message- From: Robert Nelson [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 27, 2007 12:49 AM To: Rex Wheeler; bacula-users@lists.sourceforge.net Subject: RE: [Bacula-users] Should tapes drives on windows work? Can you post your Bacula-sd.conf (Without the passwords)? - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Still Unable To Truncate Files
-Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Eric Bambach Sent: Sunday, March 25, 2007 8:17 PM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Still Unable To Truncate Files Hello again list. Original thread is: [Bacula-users] Unable to Truncate Error Solved! I have some additional information about my problem. I am still getting error truncating files. It has to be some weird incompatibility with windows 2000 server and Bacula. -The file permissions say everyone full control. -SysInternals Process explorer at the time of the error show that only bacula-sd.exe has an open handle for Vol0071 (Or any of the volumes for that matter). -SysInternals Filemon shows no access besides bacula-sd.exe to that volume at the time of the error. -I tried both the packged mingw.dll and a different version from the MinGW website. -I have no antivirus software installed. -Winver shows Windows 2000 Version 5.0 (Build 2195: Service Pack 4) -I have cygwin installed. Maybe a .dll conflict there? There shouldn't be any possibility of a cygwin conflict. -Using 2xInitio inic1620 S-ATA Controller to power a dynamic disk Raid-5 array of 4xWDC WD3200JD-00KLB0 SCSI Disk Device -I DO have Legato Networker installed which backs up those files. (Off-site). But legato did not have filehandles for Vol0071 (or any other in the pool) open at the time. Any ideas anyone? This will put a complete halt to using bacula in our environment. I am not opposed to debugging/tracing the problem for the developers because bacula seems like such an awesome product but I need some pointers as I am out of ideas for the moment. I built a new version of bacula-sd.exe and bacula.dll with additional debugging output. Please copy these to your system, reproduce the problem and then send me the job log. ftp://ftp.the-nelsons.org/pub/bacula-sd.exe ftp://ftp.the-nelsons.org/pub/bacula.dll Perhaps the source needs an #IFDEF WIN32 chsize(...) #ELSE truncate(...) #ENDIF? If you look at the mingw source you will see that all ftruncate does is call chsize. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Should tapes drives on windows work?
Make sure the storage daemon isn't running when you run btape. net stop bacula-sd Once you are finished you can start the storage daemon with Net start bacula-sd -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Rex Wheeler Sent: Monday, March 26, 2007 8:18 PM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Should tapes drives on windows work? I tried to get a tape drive working with the storage daemon on Windows without success. Before I bang my head against the wall too much, I wanted to ask if in general this works or not. I realize that the Windows side of stuff is still experimental. I am running Windows 2003 Server that is up to date patch-wise. I am trying to use a DLT-7000 tape drive. The tape drive seems to work correctly with Windows backup and Veritas Backup Exec. The tape drive passed both the Quantum and HP DLT diagnostics. I installed the 2.0.3 binaries on the server and set up the configuration files. My director on another machine can communicate with it. My problem is that there seems to be some basic issue talking to the tape drive. When I fire up btape and try something simple like asking for capabilities I get: *cap Configured device capabilities: EOF BSR BSF FSR FSF FASTFSF !BSFATEOM EOM REM !RACCESS AUTOMOUNT !LABEL !ANONVOLS ALWAYSOPEN MTIOCGET Device status: OPENED TAPE LABEL !MALLOC !APPEND !READ !EOT !WEOT !EOF !NEXTVOL !SHORT Device parameters: Device name: Tape0 File=0 block=0 Min block=0 Max block=0 Status: Bacula status: file=0 block=0 Device status: BOT ONLINE IM_REP_EN file=0 block=0 btape: ../../stored/btape.c:1799 Device status: 645. ERR=../../stored/dev.c:1545 ioctl MTBSR error on DLT-7000 (Tape0) . ERR=Input/output error. If I run the btape test command I don't even get past the first step. Is there something basic about setting up tape drives under Windows I am missing? Rex - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Should tapes drives on windows work?
The cap command just prints out the last error message encountered. It isn't actually hitting an error itself. To provide useful information you need to supply the error messages in the context in which they occur. I recommend starting btape with the -v and -d 100 options and then post the output. Are you using a blank tape? Have you tried rewinding the tape and writing an EOF mark to clear any existing data? -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Robert Nelson Sent: Monday, March 26, 2007 9:05 PM To: 'Rex Wheeler'; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Should tapes drives on windows work? Make sure the storage daemon isn't running when you run btape. net stop bacula-sd Once you are finished you can start the storage daemon with Net start bacula-sd -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Rex Wheeler Sent: Monday, March 26, 2007 8:18 PM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Should tapes drives on windows work? I tried to get a tape drive working with the storage daemon on Windows without success. Before I bang my head against the wall too much, I wanted to ask if in general this works or not. I realize that the Windows side of stuff is still experimental. I am running Windows 2003 Server that is up to date patch-wise. I am trying to use a DLT-7000 tape drive. The tape drive seems to work correctly with Windows backup and Veritas Backup Exec. The tape drive passed both the Quantum and HP DLT diagnostics. I installed the 2.0.3 binaries on the server and set up the configuration files. My director on another machine can communicate with it. My problem is that there seems to be some basic issue talking to the tape drive. When I fire up btape and try something simple like asking for capabilities I get: *cap Configured device capabilities: EOF BSR BSF FSR FSF FASTFSF !BSFATEOM EOM REM !RACCESS AUTOMOUNT !LABEL !ANONVOLS ALWAYSOPEN MTIOCGET Device status: OPENED TAPE LABEL !MALLOC !APPEND !READ !EOT !WEOT !EOF !NEXTVOL !SHORT Device parameters: Device name: Tape0 File=0 block=0 Min block=0 Max block=0 Status: Bacula status: file=0 block=0 Device status: BOT ONLINE IM_REP_EN file=0 block=0 btape: ../../stored/btape.c:1799 Device status: 645. ERR=../../stored/dev.c:1545 ioctl MTBSR error on DLT-7000 (Tape0) . ERR=Input/output error. If I run the btape test command I don't even get past the first step. Is there something basic about setting up tape drives under Windows I am missing? Rex - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Removable disk HOWTO?
-Original Message- From: Erich Prinz [mailto:[EMAIL PROTECTED] Sent: Thursday, March 22, 2007 10:15 AM To: Josh Fisher Cc: bacula-users@lists.sourceforge.net (E-mail); Robert Nelson Subject: Re: [Bacula-users] Removable disk HOWTO? On Mar 22, 2007, at 11:55 AM, Josh Fisher wrote: Erich Prinz wrote: True, drives are assigned the next available drive letter. In many of the simple deployments I have, it is a simple two disk rotation. The USB drives always get the same drive mapping - which can easily get thrown out of whack with the introduction of another device by an end user. Hence why servers run headless and locked away in closets. Just thinking out loud, but Is it possible to use UNC versus drive mappings? The win32 Bacula SD probably uses fopen() and so would support UNC paths. But I don't know if it is possible to symlink to a UNC path, so I don't know if UNC paths would work using the approach vchanger takes. Also, that would not affect how USB drives are handled. Hmmm isn't this the mechanism drive mapping uses essentially a symlink? UNC Paths are a network concept and don't apply to local disks unless they have been shared and are accessed through the redirector. Unless you are referring to names like \\??\C:\filename.ext, which look sort of like UNC paths but aren't. They still require a drive letter. Drive letters are just NT object manager symlinks (not the same as NTFS filesystem symlinks) to the device objects exposed by the disk device drivers. Similarly all WIN32 devices are just NT object manager symlinks to various device objects exposed by NT drivers. It should be possible to create a link between the USB disk device object and a name that is accessible to WIN32 applications using a path such as \\.\DriveName\filename.exe. I haven't tried this and I'm not sure that the c runtime apis such as fopen() and open() wouldn't get confused. Perhaps the best approach would be to force the use of a Windows 2k or greater NTFS filesystem on the USB drives to be used. Then it would be possible to mount the USB drive partition at a reparse point on the directory tree of a fixed disk NTFS volume, rather than assigning it a drive letter at all. A NTFS reparse point is essentially what the rest of the world calls a mountpoint. The difference is that in *nix any drive partition can be mounted at a given mountpoint, so we can have all of the drives associated with a virtual changer always be mounted at the same mountpoint and they don't even have to use the same filesystem. I'm not so sure how Windows determines which USB drive partitions get mounted at a particular reparse point, so I'm not sure if it is possible to have one reparse point at which all associated USB drives will get mounted. I don't know either. Reparse points are more than mount points. They are also used to implement symlinks, Distributed File System, Remote Storage Server, and numerous other things where you need a file system object to contain meta data which represents something else. In theory it shouldn't matter what fs is the target of a reparse point, although the NTFS filesystem might enforce that it is NTFS so that applications aren't confused by the filesystem characteristics changing in the middle of the file tree. But I don't think this is case. The only restriction I know of is that the filesystem that contains the reparse point must support them (kind of obvious :-) The trick is preventing the mount manager from assigning a drive letter. It uses information in the registry to specify which volume devices are allocated drive letters and which ones should be mounted on a mount point. I'm not sure if it is valid to have multiple volumes map to the same mount point. It should be possible to create a utility that creates the appropriate information so that the mount manager will mount the device automatically on the mount point. But you would have to connect the USB device and then run the utility. I'll see if I can whip something up tomorrow. I am certain that the FAT32 filesystem could not be used without drive letters. I'm not so sure about that. Most USB drives ship with FAT32, however, it carries a 2GB limit on file size and that fact can cause issues. IMO on the WIN side of the world, NTFS would be the only format to use for more reasons than just the above. However, reparse points would eliminate the drive letter assignment problems and at least allow defining one reparse point per drive. Robert Nelson would be an excellent resource on this question. I've cc'd him too. Erich On Mar 21, 2007, at 2:10 PM, Josh Fisher wrote: Erich Prinz wrote: Any chance of a Wintel version becoming available? In Windows, drives are mounted by drive letter. It is possible
Re: [Bacula-users] Removable disk HOWTO?
-Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Josh Fisher Sent: Tuesday, March 20, 2007 12:05 PM To: Hristo Benev Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Removable disk HOWTO? The latest version is 0.7.4 and was posted to the bacula-users list 2006-12-12. It currently isn't hosted anywhere that I know of, and I don't think attachments are kept in the archives, so here it is again. Perhaps I should find somewhere to host it. I took the liberty of enabling the docman feature of SourceForge for Bacula and posted the HowTo files to it. Here is a link: http://sourceforge.net/docman/index.php?group_id=50727 I don't know if anyone else is using this method for USB drives, but I can say that I have been using it with bacula 2.0.x for several months without any problems. --- Josh Fisher Hristo Benev wrote: Hi, what is latest version of removable disk howto and where it could be accessed? Thanks Hristo Benev - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Path length
You can use v2.0 Windows Clients with v1.38 Servers. In general we always try to make sure clients and servers within 1 major release of each other work. This allows staged upgrades. The only thing you need to do is make sure you don't use any new features. However it is best to upgrade the down rev machines as soon as possible so you can take advantage of new features and to simplify management. -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Kel Raywood Sent: Friday, March 16, 2007 10:55 PM To: Bacula-Users Subject: Re: [Bacula-users] Path length Hi Rui, you wrote: ... ERR=The system cannot find the path specified. The error is caused by the PATH length ? ... Bacula 1.38.2 OS Linux Redhat In bacula-dir.conf the FileSet is configured as File = D:/ You didn't mention the version of the the windows client. However, there _was_ a 260 character limit on path length for windows clients before version 2.0 . If possible, the best route would be to upgrade director, storage-daemon and all clients. The path limit is now 64kB ! I think that you can use windows client v2.0 with director and storage-daemon v1.38 but I'm not certain. You could try searching the list archives to see if Kern or another developer made a definitive statement about that. Hope this helps. Kel - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] ***************URGENT************Need Help!***************
First of all start with the configuration files installed by the installer. They have examples that you should be able to use by just uncommenting the proper definitions and changing a few entries. I dont know now you created these configurations but they are all messed up. You have entries from the Autochanger resource in your Device resource and you are missing the Autochanger resource. You need to pay particular attention to how the various resource structures from the configuration files reference each other. For example the Device in the Storage resource in the Director configuration file must match the Name in the Device resource in the Storage configuration file. In your case it should be HP_Ultrium not the physical address. Device Names such as changer0, tape0 and 4:0:5:1 are only specified in the Storage configuration. Spend some time looking at the example configs and read the documentation and youll probably have much better luck. _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Thursday, March 15, 2007 3:03 AM To: Robert Nelson Cc: bacula-users@lists.sourceforge.net Subject: Re : [Bacula-users] ***URGENTNeed Help!*** Hi all ! this is my file def conf of the storage deamon Storage { # definition of myself Name = ilemma009-sd SDPort = 9103 # Director's port WorkingDirectory = C:\\Documents and Settings\\All Users\\Application Data\\Bacula\\Work Pid Directory = C:\\Documents and Settings\\All Users\\Application Data\\Bacula\\Work Maximum Concurrent Jobs = 20 } # # List Directors who are permitted to contact Storage daemon # Director { Name = ilemma009-dir Password = xxx } # # Restricted Director, used by tray-monitor to get the # status of the storage daemon # Director { Name = ilemma009-mon Password = xx Monitor = yes } Device { Name = HP_Ultrium# Media Type = DDS-4 Archive Device = Tape0 #Tape0 AutomaticMount = yes; # when device opened, read it AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; RequiresMount = yes Changer Command = mtx-changer %c %o %S %a %d Changer Device = 4:0:5:1 #Changer0 #4:0:5:1 #4:0:5:1 doesn't work !! AutoChanger = yes Alert Command = tapeinfo -f %c | findstr TapeAlert } Messages { Name = Standard director = ilemma009-dir = all } My director.conf file : Director {# define myself Name = ilemma009-dir DIRport = 9101# where we listen for UA connections QueryFile = C:\\Program Files\\Bacula\\bin\\query.sql WorkingDirectory = C:\\Documents and Settings\\All Users\\Application Data\\Bacula\\Work PidDirectory = C:\\Documents and Settings\\All Users\\Application Data\\Bacula\\Work Maximum Concurrent Jobs = 11 Password = xxx # Console password Messages = Daemon } # Definition of DDS tape storage device Storage { Name = DDS-4 # Do not use localhost here Address = ILEMMA009# N.B. Use a fully qualified name here SDPort = 9103 Password = # password for Storage daemon Device = 4:0:5:1 # must be same as Device in Storage daemon Media Type = DDS-4 # must be same as MediaType in Storage daemon Autochanger = yes # enable for autochanger device } what bacula say every day : ilemma009-sd Version: 2.0.3 (06 March 2007) Linux Cross-compile Win32 Daemon started 15-Mar-07 10:01, 0 Jobs run since started. Heap: bytes=13,542 max_bytes=13,687 bufs=57 max_bufs=58 Running Jobs: No Jobs running. Jobs waiting to reserve a drive: Terminated Jobs: JobId LevelFiles Bytes Status FinishedName === 5 Full 0 0 Error09-Mar-07 23:10 BackupCatalog 6 Full 0 0 Error10-Mar-07 23:05 ilemma12 7 Full 0 0 Error10-Mar-07 23:05 ilemma122 8 Full 0 0 Error10-Mar-07 23:10 BackupCatalog 12 Full 0 0 Error12-Mar-07 23:05 ilemma12 13 Full 0 0 Error12-Mar-07 23:05 ilemma122 14 Full 0 0 Error12-Mar-07 23:10 BackupCatalog 15 Full 0 0 Error13-Mar-07 23:05 ilemma12 16 Full 0 0 Error13-Mar-07 23:05 ilemma122 17 Full 0 0 Error13-Mar-07 23:10 BackupCatalog Device status: Device HP_Ultrium is not open or does not exist. In Use Volume status: - Message d'origine De : Robert Nelson [EMAIL PROTECTED] À : [EMAIL PROTECTED]; bacula-users@lists.sourceforge.net Envoyé le : Jeudi, 15 Mars 2007, 1h53mn 19s Objet : RE: [Bacula-users] ***URGENTNeed Help!*** Which part
Re: [Bacula-users] running DIR on windows 2000
-Original Message- From: Silver Salonen [mailto:[EMAIL PROTECTED] Sent: Thursday, March 15, 2007 12:25 AM To: Robert Nelson Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] running DIR on windows 2000 OK, thanks. I guess, it's the database that's missing. But the command you specified doesn't give me anything. Absolutely nothing. Should it? If there is an error in the configuration then you would have seen error messages printed. If there isn't an error in the configuration then nothing is displayed. In order to see what other problems there might be you can use the command: C:\Program Files\Bacula\bin\bacula-dir.exe /run -d 100 -c C:\Documents and Settings\All Users\Application Data\Bacula\bacula-dir.conf This should produce a Bacula-dir.trace file in the current directory. Silver - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup failure - Bad job command
Run version 2.0.3 on all the machines. _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of [EMAIL PROTECTED] Sent: Thursday, March 15, 2007 2:28 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] backup failure - Bad job command I have the following setup: Bacula Director running on an Ubuntu 6.06 server and is version 1.36.3 The File Director is run on a Windows Small Business Server 2003 The Storage Director is run on a Windows 2000 system using an HP DAT72 device. I have resolved a previous problem I had with an incorrect mail address but I am not able to run a backup and get the following message: Job started. JobId=73 15-Mar 11:15 Ubuntuccc-dir: No prior Full backup Job record found. 15-Mar 11:15 Ubuntuccc-dir: No prior or suitable Full backup found. Doing FULL backup. 15-Mar 11:15 Ubuntuccc-dir: Start Backup JobId 73, Job=Client1.2007-03-15_11.15.41 15-Mar 11:15 Ubuntuccc-dir: Client1.2007-03-15_11.15.41 Fatal error: Storage daemon rejected Job command: 3915 Bad Job command. stat=-1 CMD: JobId=73 job=Client1.2007-03-15_11.15.41 job_name=Client1 client_name=sbserverpdc-fd type=66 level=70 FileSet=FullSet NoAttr=0 SpoolAttr=0 FileSetMD5=b4YDE8Nh9mlUoD1SWCQojD SpoolData=0 I thank you for your assistance. KG Meyer - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re : ****URGENT****Need Help!***
Well at least you read the part about starting with the configs that were installed. However you havent adjusted them to match your configuration. Instead of wasting everyones time posting without thinking. READ THE DOCUMENTATION AND ADJUST THE CONFIGURATIONS TO SUIT YOUR ENVIRONMENT. _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of [EMAIL PROTECTED] Sent: Thursday, March 15, 2007 8:10 AM To: Don MacArthur Cc: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Re : URGENTNeed Help!*** Thank you all for your help, I modified my files to get this config : Autochanger { Name = Autochanger Device = Drive-1 Device = Drive-2 Changer Command = mtx-changer %c %o %S %a %d Changer Device = 4:0:5:1 #Changer0 } Device { Name = Drive-1 # Drive Index = 0 Media Type = DLT-8000 Device Type = Tape Archive Device = Tape0 AutomaticMount = yes # when device opened, read it AlwaysOpen = yes RemovableMedia = yes RandomAccess = no AutoChanger = yes Alert Command = tapeinfo -f %c | findstr TapeAlert } Device { Name = Drive-2 # Drive Index = 1 Media Type = DLT-8000 Device Type = Tape Archive Device = Tape1 AutomaticMount = yes # when device opened, read it AlwaysOpen = yes RemovableMedia = yes RandomAccess = no AutoChanger = yes Alert Command = tapeinfo -f %c | findstr TapeAlert } I want to test with only 2 tapes but I get this log : Running Jobs: No Jobs running. Jobs waiting to reserve a drive: Terminated Jobs: JobId LevelFiles Bytes Status FinishedName === 18 Full 0 0 Error15-Mar-07 23:50 ilemma009 19 Full 0 0 Error15-Mar-07 23:53 Client1 Device status: Autochanger Autochanger with devices: Drive-1 (Tape0) Drive-2 (Tape1) Device Drive-1 (Tape0) is not open. Drive 0 status unknown. Device Drive-2 (Tape1) is not open. Drive 1 status unknown. In Use Volume status: I think the DLT-8000 is not the best Media Type to put there ! am I right ? (;-)) please, if you know which media type I have to specify for my HP StorageWorks 1/8 Ultrium 232 Tape Autoloader ? I feel like stuck there ! please help me ! Sincerly yours Nawfel - Message d'origine De : Don MacArthur [EMAIL PROTECTED] À : Robert Nelson [EMAIL PROTECTED] Cc : bacula-users@lists.sourceforge.net Envoyé le : Jeudi, 15 Mars 2007, 14h27mn 05s Objet : Re: [Bacula-users] ***URGENTNeed Help!*** Hi Robert, This comment is in reference to the conversation about using HP Windows Drivers. In my conversations with HP and other vendors about drivers and tape drives on Windows, the consensus seemed to be that using Windows drivers created more problems that they solved. Their advice was to address the scsi devices directly. The benefits are increased throughput and fewer problems communicating with the devices. I do not have experience running the Bacula sd on Windows, but I have run other enterprise backup systems on Windows and this was the advice I was given by the vendors. IIRC, the issue is with scsi device command communication, and the applications handled it better directly with the devices than through the Windows drivers. The earlier advice about determining the device id's using scsilist.exe would facilitate this, I think. FWIW. On Thu, 2007-03-15 at 03:30 -0700, Robert Nelson wrote: First of all start with the configuration files installed by the installer. They have examples that you should be able to use by just uncommenting the proper definitions and changing a few entries. I dont know now you created these configurations but they are all messed up. You have entries from the Autochanger resource in your Device resource and you are missing the Autochanger resource. You need to pay particular attention to how the various resource structures from the configuration files reference each other. For example the Device in the Storage resource in the Director configuration file must match the Name in the Device resource in the Storage configuration file. In your case it should be HP_Ultrium not the physical address. Device Names such as changer0, tape0 and 4:0:5:1 are only specified in the Storage configuration. Spend some time looking at the example configs and read the documentation and youll probably have much better luck. __ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Thursday, March 15, 2007 3:03 AM To: Robert Nelson Cc: bacula-users@lists.sourceforge.net Subject: Re : [Bacula-users] ***URGENTNeed Help!*** Hi all ! this is my
[Bacula-users] OEM Drivers vs Direct SCSI commands on Windows
-Original Message- From: Don MacArthur [mailto:[EMAIL PROTECTED] Sent: Thursday, March 15, 2007 7:27 AM To: Robert Nelson Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] ***URGENTNeedHelp!*** Hi Robert, This comment is in reference to the conversation about using HP Windows Drivers. In my conversations with HP and other vendors about drivers and tape drives on Windows, the consensus seemed to be that using Windows drivers created more problems that they solved. Their advice was to address the scsi devices directly. The benefits are increased throughput and fewer problems communicating with the devices. I think this may be more a reflection of their driver writing ability then anything inherent in accessing a device using the Windows driver. :-) As far as throughput is concerned, for changer devices it really isn't relevant since the time taken by the robotics far exceeds any overhead from the drivers. Not to mention that in the case of Bacula, and most UNIX derived Backup software, an external program is executed to perform the actual changer operations; so performance isn't really an issue. For tape devices, the only area where performance can be adjusted is in the time required to setup the next write / read after the completion of the current one. If you are using overlapped I/O and submitting multiple requests concurrently to the driver then it can initiate the next request without transitioning back to user mode and incurring a context switch. So it would definitely perform much better than a user-mode application issuing the SCSI commands. The driver also has access to constructs, like tagged command queuing, that aren't available to the application. I do not have experience running the Bacula sd on Windows, but I have run other enterprise backup systems on Windows and this was the advice I was given by the vendors. IIRC, the issue is with scsi device command communication, and the applications handled it better directly with the devices than through the Windows drivers. I suspect that the other Enterprise Backup vendors are basing their comments on experience with Windows 9X as well as their experience with some Windows NT drivers that may not have been written correctly. Also developers tend to stick to what they know and the software was probably originally written to send the commands directly. The only advantage with bypassing a well written Windows driver is access to some SCSI facilities that may not be abstracted through the driver model such as device and tape diagnostic information. The earlier advice about determining the device id's using scsilist.exe would facilitate this, I think. The one thing you need to be careful of is that if there is a class driver loaded, such as the tape class driver then you must send the SCSI commands to it rather than to the physical address. FWIW. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Failed Windows backup
Change the -f (Bacula) [EMAIL PROTECTED] to -f [EMAIL PROTECTED]. _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Administrator Sent: Tuesday, March 13, 2007 3:25 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Failed Windows backup I have just recently set up Bacula to backup a Windows 2003 server. The setup is a bit unusual - Bacula Director is run on an Ubuntu 6.06 server and is version 1.36.3 The File Director is run on a Windows Small Business Server 2003 The Storage Director is run on a Windows 2000 system using an HP DAT72 device. I have run the test on this system and it works without error. Using the documentation and various tutorial notes, I have tried to set up the .conf file correctly. From the message I received it appears this is not the case:- 01-Mar 18:30 Ubuntuccc-dir: message.c:462 Mail prog: bsmtp: bsmtp.c:88 Fatal malformed reply from localhost: 504 [EMAIL PROTECTED]: Sender address rejected: need fully-qualified address 01-Mar 18:30 Ubuntuccc-dir: Client1.2007-03-01_18.30.00 Error: message.c:473 Mail program terminated in error. CMD=/usr/lib/bacula/bsmtp -h localhost -f (Bacula) [EMAIL PROTECTED] -s Bacula: Backup Fatal Error of sbserverpdc-fd Full [EMAIL PROTECTED] ERR=Child exited with code 1 01-Mar 23:50 Ubuntuccc-dir: Start Backup JobId 45, Job=BackupCatalog.2007-03-01_23.50.00 01-Mar 23:50 Ubuntuccc-dir: BackupCatalog.2007-03-01_23.50.00 Fatal error: Storage daemon rejected Job command: 3915 Bad Job command. stat=-1 CMD: JobId=45 job=BackupCatalog.2007-03-01_23.50.00 job_name=BackupCatalog client_name=sbserverpdc-fd type=66 level=70 FileSet=Catalog NoAttr=0 SpoolAttr=0 FileSetMD5=b84+V6+tB/+hy4+qT8tJDD SpoolData=0 Your assistance will be appreciated. Thank you, KG Meyer [EMAIL PROTECTED] - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] running DIR on windows 2000
This usually means that either you have a problem in your configuration file or the database hasn't been initialized properly. In either case you should be able to figure it out using the following command: C:\Program Files\Bacula\bin\bacula-dir.exe /run -d 100 -t -c C:\Documents and Settings\All Users\Application Data\Bacula\bacula-dir.conf -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Silver Salonen Sent: Wednesday, March 14, 2007 8:11 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] running DIR on windows 2000 Hi. I'm trying to get all the Bacula 2.0.3 (with SQLite) components running on a single windows 2000. I've configured them (slightly modified default configurations) and successfully started FD's and SD's services, but DIR's service says me: Could not start the Bacula Director service on Local Computer. Error 1067: The process terminated unexpectedly. Is there a way to test/debug DIR's configuration on windows? I've tried executing several commands from cmd, but they give me nothing. These commands include: C:\Program Files\Bacula\bin\bacula-dir.exe -t -c C:\Documents and Settings\All Users\Application Data\Bacula\bacula-dir.conf and C:\Program Files\Bacula\bin\bacula-dir.exe /debug What else should I try? Silver - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] ***************URGENT************Need Help!***************
Which part of this information from the Readme.txt file did you not understand? Storage Device Names There is a utility installed called scsilist.exe which displays the installed devices, their physical address and their device name. A link to it is created in the Bacula menu when the Storage service is installed. Changer and Tape device names in Windows are Changer0, Changer1, etc and Tape0, Tape1, etc. If there isn't a device driver loaded for the Changer then you need to use the address Port:Bus:Target:Lun. Port is the SCSI Adapter Number, Bus is the Bus Number on the adapter (usually 0 since most adapters only have one bus), Target is the device's Target Device ID, Lun is the Logical Unit Number. You must specify DeviceType = tape in the Device resource in bacula-sd.conf since auto detection of device type doesn't work at the present time. _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of [EMAIL PROTECTED] Sent: Monday, March 12, 2007 2:37 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] ***URGENTNeed Help!*** Hi all, In my Bacula Server I have this list of devices given by bacula's device list DeviceType Physical Name == HL-DT-ST DVD+-RW GSA-H21L CDRom0:0:0:0 CdRom0 HP Ultrium 1-SCSI P53W Tape 4:0:5:0 Tape0 HP 1x8 autoloader 1.50 Changer 4:0:5:1 DY5402J FCM024K 1.0CDRom5:0:0:0 Press any key to continue I need to specify my Archive Device = and my Changer Device = in the bacula's configuration file bacula-sd .conf !! The problem is : under windows I have no idea about how the system names the HP Ultrium nor the HP autoloader. is there any one who tried the experience under windows and can help me ?? http://us.i1.yimg.com/us.yimg.com/i/mesg/tsmileys2/16.gif Nawfel _ Découvrez une nouvelle façon d'obtenir des réponses à toutes vos questions ! Profitez des connaissances, des opinions et des expériences des internautes sur Yahoo! http://fr.rd.yahoo.com/evt=42054/*http:/fr.answers.yahoo.com Questions/Réponses. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re : ***************URGENT************Need Help !***************
It isn't absolutely necessary to install the HP Windows driver you can use the physical address as a device name, in this case 4:0:5:1. -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Brian Debelius Sent: Monday, March 12, 2007 6:52 AM To: [EMAIL PROTECTED] Cc: Bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Re : ***URGENTNeed Help !*** Hi, According to your scsilist, the Ultrium name is Tape0 so for the tape you would use 'Archive Device = Tape0'. For the changer you need to install the HP windows driver for you changer. It will then appear as Changer0, and you would use 'Changer Device = Changer0'. brian- [EMAIL PROTECTED] wrote: thanks for the remark Florian, but the problem is : without a backup server we can not make backups nor restore ! so it's realy urgent given that the production has started in a new country ! the version already running is under openSUSE 10, so in the new country we need to use it under Windows, but I have no idea about how to specify the changer device for this OS. as you can see in the bacula's scsilist.exe log, the device has no name attributed, that's what confused me regards, Nawfel - Message d'origine De : Florian Heigl [EMAIL PROTECTED] À : [EMAIL PROTECTED] [EMAIL PROTECTED] Envoyé le : Lundi, 12 Mars 2007, 11h38mn 33s Objet : Re: [Bacula-users] ***URGENTNeed Help !*** Hey sorry, but answer me one question: What topic are You going to use if you ever have a really urgent problem? Please chose more wisely, you make people think you have a production breakdown and backups lost or something and all there is is that you don't know how to specify the changer device on windows? It should show up in device manager - logical storage where there is a list of devices with their respective \\PhysicalDrive names Florian 2007/3/12, [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] [EMAIL PROTECTED] mailto:[EMAIL PROTECTED]: Hi all, In my Bacula Server I have this list of devices given by bacula's device list DeviceType Physical Name == HL-DT-ST DVD+-RW GSA-H21L CDRom0:0:0:0 CdRom0 HP Ultrium 1-SCSI P53W Tape 4:0:5:0 Tape0 HP 1x8 autoloader 1.50 Changer 4:0:5:1 DY5402J FCM024K 1.0CDRom5:0:0:0 Press any key to continue I need to specify my Archive Device = and my Changer Device = in the bacula's configuration file bacula-sd .conf !! The problem is : under windows I have no idea about how the system names the HP Ultrium nor the HP autoloader. is there any one who tried the experience under windows and can help me ?? Nawfel Découvrez une nouvelle façon d'obtenir des réponses à toutes vos questions ! Profitez des connaissances, des opinions et des expériences des internautes sur Yahoo! Questions/Réponses http://fr.rd.yahoo.com/evt=42054/*http://fr.answers.yahoo.com. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net mailto:Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users https://lists.sourceforge.net/lists/listinfo/bacula-users -- 'Sie brauchen sich um Ihre Zukunft keine Gedanken zu machen' Découvrez une nouvelle façon d'obtenir des réponses à toutes vos questions ! Profitez des connaissances, des opinions et des expériences des internautes sur Yahoo! Questions/Réponses http://fr.rd.yahoo.com/evt=42054/*http://fr.answers.yahoo.com. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash
Re: [Bacula-users] Unable to truncate volume
The only time ftruncate returns EINVAL is if the file size is negative which is not the case here. So that error means that some system call that ftruncate made failed with an error that the C runtime didn't expect, unknown error codes are mapped to EINVAL. So the most likely guilty party is antivirus software. Do you have an anti-virus package running? If so which one? Are you using its autoprotect feature? Can you try disabling autoprotect for the directory where the backups are stored? -Original Message- From: Kern Sibbald [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 06, 2007 1:54 AM To: bacula-users@lists.sourceforge.net Cc: Silver Salonen; Robert Nelson Subject: Re: [Bacula-users] Unable to truncate volume On Tuesday 06 March 2007 10:19, Silver Salonen wrote: On Tuesday 13 February 2007 18:45, Brian Debelius wrote: Windows. Ok I have 5 volumes. full- through full-0004. They all were migrated last night. When I run the backups today, and 0001 were recylced ok. 0002 and 0003 were recycled but could not be truncated. 0004 was recycled ok one comment: it would be nice if a volume fails to be recycled, that a new volume is created and the backup automatically continues instead of failing without a backup as long as there are no other options in the conf that would prevent this. here is the log of 0002 and 0003 3-Feb 10:19 comp0-dir: No prior Full backup Job record found. 13-Feb 10:19 comp0-dir: No prior or suitable Full backup found in catalog. Doing FULL backup. 13-Feb 11:03 comp0-dir: Start Backup JobId 21, Job=comp1.2007-02-13_10.19.25 13-Feb 11:03 comp0-dir: Recycled volume full-0002 13-Feb 11:03 comp1-fd: ClientRunBeforeJob: run command ntbackup backup systemstate /F c:\comp1_systemstate.bkf 13-Feb 11:08 comp0-sd: comp1.2007-02-13_10.19.25 Fatal error: ../../stored/label.c:448 Truncate error on device FileStorage0 (d: \bacula\): ERR=../../stored/dev.c:1942 Unable to truncate device FileStorage0 (d:\bacula\). ERR=Invalid argument 13-Feb 11:08 comp0-sd: Marking Volume full-0002 in Error in Catalog. 13-Feb 11:08 comp0-sd: comp1.2007-02-13_10.19.25 Fatal error: Job 21 canceled. 13-Feb 11:08 comp1-fd: comp1.2007-02-13_10.19.25 Fatal error: ../../filed/job.c:1752 Bad response to Append Data command. Wanted 3000 OK data , got 3903 Error append data 13-Feb 10:19 comp0-dir: No prior Full backup Job record found. 13-Feb 10:19 comp0-dir: No prior or suitable Full backup found in catalog. Doing FULL backup. 13-Feb 11:08 comp0-dir: Start Backup JobId 22, Job=comp2.2007-02-13_10.19.30 13-Feb 11:08 comp0-dir: Recycled volume full-0003 13-Feb 11:08 comp2-fd: ClientRunBeforeJob: run command ntbackup backup systemstate /F c:\comp2_systemstate.bkf 13-Feb 11:14 comp0-sd: comp2.2007-02-13_10.19.30 Fatal error: ../../stored/label.c:448 Truncate error on device FileStorage0 (d: \bacula\): ERR=../../stored/dev.c:1942 Unable to truncate device FileStorage0 (d:\bacula\). ERR=Invalid argument 13-Feb 11:14 comp0-sd: Marking Volume full-0003 in Error in Catalog. 13-Feb 11:14 comp0-sd: comp2.2007-02-13_10.19.30 Fatal error: Job 22 canceled. 13-Feb 11:14 comp2-fd: comp2.2007-02-13_10.19.30 Fatal error: ../../filed/job.c:1752 Bad response to Append Data command. Wanted 3000 OK data , got 3903 Error append data Hi. I've got the same problem. In my case: * DIR is running on FreeBSD-5.3 * SD is running on Windows Server 2003 SP1 * FD is running on another Windows Server 2003 SP1. I used Bacula 2.0.0 everywhere and when the problem occured, I upgraded all of them to 2.0.2, but the problem remained. Log: == 05-Mar 23:05 bsdserv-dir: No prior Full backup Job record found. 05-Mar 23:05 bsdserv-dir: No prior or suitable Full backup found in catalog. Doing FULL backup. 05-Mar 23:06 bsdserv-dir: Start Backup JobId 1371, Job=winserv1.2007-03-05_23.05.05 05-Mar 23:06 bsdserv-dir: Recycled volume winserv1-full-0003 05-Mar 23:06 winserv1-fd: ClientRunBeforeJob: run command C:/bacula/systemstate.bat 05-Mar 23:06 winserv1-fd: ClientRunBeforeJob: Could Not Find c:\documents and settings\administrator\systemstate.bkf 05-Mar 23:23 winserv2-sd: winserv1.2007-03-05_23.05.05 Fatal error: ../../stored/label.c:448 Truncate error on device device- winserv1 (F:\Bacula\winserv1): ERR=../../stored/dev.c:1942 Unable to truncate device device-winserv1 (F:\Bacula\winserv1). ERR=Invalid argument 05-Mar 23:23 winserv2-sd: Marking Volume winserv1-full-0003 in Error in Catalog. 05-Mar 23:23 winserv2-sd: ekk.2007-03-05_23.05.05 Fatal error: Job 1371 canceled. 05-Mar 23:23 winserv1-fd: ekk.2007-03-05_23.05.05 Fatal error: ../../filed/job.c:1752 Bad response to Append Data command. Wanted 3000 OK data, got 3903 Error append
Re: [Bacula-users] Upgrade autochanger configuration?
shameless mtx plug Since Bacula pretty much works with any autochanger that mtx supports you could use the database on the mtx website at mtx.opensource-sw.net. If there is enough interest I could set up something similar for Bacula. We would just need to agree on the information we would like to gather. The automatic upload is a bit trickier. /shameless mtx plug -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Arno Lehmann Sent: Thursday, March 01, 2007 1:13 AM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Upgrade autochanger configuration? Hi, On 3/1/2007 4:32 AM, Ivan Adzhubey wrote: Thanks a lot, Arno. Your reply saved me a day of scanning through the documentation! Things looked a bit confusing because apparently, the guy who installed Bacula first tried version 1.38.x and then settled down on 1.36.1 for whatever reasons he had. That left a bit of a mess in config files. Which tells us a lot about the value of having a useful documentation about your systems :-) BTW, is there a place to submit user tested Bacula-compatible hardware setups? Just this mailing list... or the -devel or -docs one, I guess. The one included with the documentation (well, both of them) look outdated and unmaintained for years. It is rather short also, which IMHO is misleading and can discourage potential Bacula users. It is my understanding that in reality Bacula will happily work with almost any autochanger/tape drive hardware except probably most exotic models. Both your assumptions are correct... unfortunately, it seems to be hard task collecting and keeping up-to-date a compatibility list. The problem starts with the fact that many users don't report their configuration. For those of us that do, a page in the wiki might be a good starting point. The luxury version would be a database accessible through a web front end, and when starting Bacula the first time you get asked if you want your systems data uploaded automatically to the database... now we only need someone to implement this :-) Regards, Ivan Arno -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Director not connecting to MySQL / Bacula 2.0.2Win32 binaries
Did you select MySQL in the director configuration page in the installer? Can you send me a copy of the install.log file from the \Program Files\Bacula directory? -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Marc Levy Sent: Wednesday, February 14, 2007 2:51 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Director not connecting to MySQL / Bacula 2.0.2Win32 binaries Hi, I've been testing Bacula 2.0.2 for about a week now with the following config: - All deamons on various Win32 boxes (2Ksrv, XP pro), - sqlite for the catalog. Now that everyting is working quite well, i'd like to use a MySQL database for the catalog instead of the default sqlite. So I install everything from scratch on a new box. The Win32 installer correctly sees the MySQL instance precedly installed 'Found MySQL (version 5.0.27)' in the messages list, but: 1/ all the MySQL related scripts *mysql*.(sql)|(cmd) are not installed (neither mind, got them from the source tarball) 2/ the director is enable to connect to the MySQL database (I can manually connect to the bacula database with the MySQL command line Client and yes: the database is created, the tables too) When starting the Director (bacula-dir.exe) the error message is as follow: 'bacula-dir Fatal error: ../../cats/sqlite.c:154 Database FullPathTodatabase_name.db does not exist, please create it' == Seems that there is only the sqlite'support compiled into the binaries? == I played with the various items in the catalog{} ressource (DB Address, DB Port) with no luck. == By the way here is my Catalog ressource in the bacula-dir.conf: Catalog { Name = Catalog1 DBName = bacula#== matchs the MySQL database created user = bacula password = bacula #== I can manually connect to the database with this login/pwd DBAddress = localhost #== tested with 127.0.0.1 , FQN, too but no luck DBPort = 3306 #== with or without this option } Any hint or help will be greatly appreciated (as I can't find any topic in the doc and/or newsgroups) Many thanks in advance. Marc. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backing up and restoring Windows permissions
Answers below -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Ralf Ertzinger Sent: Monday, February 12, 2007 11:52 PM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Backing up and restoring Windows permissions Hi. On Mon, 12 Feb 2007 22:48:21 -0800, Robert Nelson wrote: Are you running an antivirus program? If so, does it still happen if the antivirus is disabled? There is no AV program on the Windows machine. Do you have the portable option set to yes in the FileSet resource? If so, does it occur if you remove it? To the best of my knowledge this option is not set. The configuration sections relevant to the machine in question are below. Is there a way to see (in the storage) whether the permissions were even saved? bls does not seem to tell me that, it just lists UNIX style permissions. In order to see if the correct permissions are being stored I would need to look at beginning of the backup data. If you can send me a copy of the file with the data from the storage machine, I'll take a look. Please try to make it as small as possible and compress it. Then send it directly to me, I'm sure the others on the list will appreciate not receiving the attachment. :-) [Configs deleted] - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backing up and restoring Windows permissions
Ralf and I did some testing offline. The problem is with zero length files, the error is in this code taken from save_file() in filed/backup.c /* * Open any file with data that we intend to save, then save it. * * Note, if is_win32_backup, we must open the Directory so that * the BackupRead will save its permissions and ownership streams. */ if (ff_pkt-type != FT_LNKSAVED (S_ISREG(ff_pkt-statp.st_mode) ff_pkt-statp.st_size 0) || ff_pkt-type == FT_RAW || ff_pkt-type == FT_FIFO || (!is_portable_backup(ff_pkt-bfd) ff_pkt-type == FT_DIREND)) { We never open the file or do a BackupRead if the file is zero length. Kern, can you see any problem if we just remove the ff_pkt-statp.st_size 0 portion of the test? -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Ralf Ertzinger Sent: Monday, February 12, 2007 11:52 PM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Backing up and restoring Windows permissions Hi. On Mon, 12 Feb 2007 22:48:21 -0800, Robert Nelson wrote: Are you running an antivirus program? If so, does it still happen if the antivirus is disabled? There is no AV program on the Windows machine. Do you have the portable option set to yes in the FileSet resource? If so, does it occur if you remove it? To the best of my knowledge this option is not set. The configuration sections relevant to the machine in question are below. Is there a way to see (in the storage) whether the permissions were even saved? bls does not seem to tell me that, it just lists UNIX style permissions. Director config: Director {# define myself Name = banea-dir DIRport = 9101# where we listen for UA connections QueryFile = /usr/libexec/bacula/query.sql WorkingDirectory = /var/lib/bacula PidDirectory = /var/run Maximum Concurrent Jobs = 1 Password = GVAslILAQw69HBIVsrX8egWouulz9d58q3DogOPExPnz # Console password Messages = Daemon } JobDefs { Name = DefaultJob Type = Backup Level = Incremental Client = banea-fd FileSet = Full Set Schedule = WeeklyCycle Storage = File Messages = Standard Pool = Default Priority = 10 } Job { Name = w2k client = w2k-fd jobdefs = DefaultJob FileSet = w2k-set } Job { Name = BackupCatalog JobDefs = DefaultJob Level = Full FileSet=Catalog Schedule = WeeklyCycleAfterBackup # This creates an ASCII copy of the catalog RunBeforeJob = /usr/libexec/bacula/make_catalog_backup bacula bacula # This deletes the copy of the catalog RunAfterJob = /usr/libexec/bacula/delete_catalog_backup Write Bootstrap = /var/lib/bacula/BackupCatalog.bsr Priority = 11 # run after main backup } Job { Name = RestoreFiles Type = Restore Client=banea-fd FileSet=Full Set Storage = File Pool = Default Messages = Standard } Fileset { Name = w2k-set Include { Options { signature = MD5 } File = C:/TEMP } } Schedule { Name = WeeklyCycle Run = Full 1st sun at 23:05 Run = Differential 2nd-5th sun at 23:05 Run = Incremental mon-sat at 23:05 } Schedule { Name = WeeklyCycleAfterBackup Run = Full sun-sat at 23:10 } FileSet { Name = Catalog Include { Options { signature = MD5 } File = /var/lib/bacula/bacula.sql } } Client { Name = w2k-fd Address = ADDIX-RE-W2K.addix.campus FDPort = 9102 Catalog = MyCatalog Password = 12345 # password for FileDaemon File Retention = 30 days# 30 days Job Retention = 6 months# six months AutoPrune = yes # Prune expired Jobs/Files } Storage { Name = File Address = banea.int.addix.net# N.B. Use a fully qualified name here SDPort = 9103 Password = 3mhDDbTYzDcvOmRNKLf1wOlZ5PIjeFHbz2RLqbvDnFzG Device = FileStorage Media Type = File } Catalog { Name = MyCatalog dbname = bacula; user = bacula; password = bacula } Messages { Name = Standard mailcommand = /usr/sbin/bsmtp -h localhost -f \\(Bacula\) %r\ -s \Bacula: %t %e of %c %l\ %r operatorcommand = /usr/sbin/bsmtp -h localhost -f \\(Bacula\) %r\ -s \Bacula: Intervention needed for %j\ %r mail = [EMAIL PROTECTED] = all, !skipped operator = [EMAIL PROTECTED] = mount console = all, !skipped, !saved append = /var/lib/bacula/log = all, !skipped } Messages { Name = Daemon mailcommand = /usr/sbin/bsmtp -h localhost -f \\(Bacula\) %r\ -s \Bacula daemon message\ %r mail = [EMAIL PROTECTED] = all, !skipped console = all, !skipped, !saved append = /var/lib/bacula/log = all, !skipped } Pool { Name = Default Pool Type = Backup Recycle = yes # Bacula can automatically recycle Volumes AutoPrune
Re: [Bacula-users] Migration error
Which logfile are you looking at? -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Brian Debelius Sent: Tuesday, February 13, 2007 8:37 AM To: Robert Nelson Cc: 'Kern Sibbald'; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Migration error Thanks. Ok I did that, started the service, but I do not notice any change in the amount of information I am getting. The log file doesnt seem to have anything more, and neither does the wx-console. brian- Robert Nelson wrote: Use regedit to open the following path HKEY_LOCAL_MACHINE\HARDWARE\SYSTEM\CurrentControlSet\Services\Bacula-dir Then edit the ImagePath value. You need to make sure that you add the -d11 after the /service option. -Original Message- From: Kern Sibbald [mailto:[EMAIL PROTECTED] Sent: Monday, February 12, 2007 10:43 PM To: bacula-users@lists.sourceforge.net; Robert Nelson Cc: Brian Debelius Subject: Re: [Bacula-users] Migration error On Tuesday 13 February 2007 01:21, Brian Debelius wrote: Kern Sibbald wrote: On Monday 12 February 2007 19:54, Brian Debelius wrote: Hello, What is this trying to tell me? To get an accurate answer, you need to turn on debug level equal or greater than 10. Probably -d11 will do. 12-Feb 13:38 comp1-dir: The following 11 JobIds will be migrated: 10,13,14,15,16,17,18,19,20,21,22 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. ## # Migrate Job ## Job { Name = Migrate Full Type = Migrate Pool = Full Selection Type = Volume Selection Pattern = full Messages = Standard Level = Full #ignored Client = comp1-fd #ignored FileSet = DefaultFileset#ignored } ## # Full backup pool ## Pool { Name = Full Pool Type = Backup Recycle = yes Auto Prune = yes Volume Retention = 3 months Maximum Volume Jobs = 1 Label Format = full-${NumVols:p/4/0/r} Storage = FileStorage0 Next Pool = Tape } Where/how would I do this under Windows? I don't know as I have never run the director on Windows. Perhaps Robert can help you. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backing up and restoring Windows permissions
How about something like this: bool do_read = false; if (ff_pkt-type != FT_LNKSAVED S_ISREG(ff_pkt-statp.st_mode)) { #ifdef HAVE_WIN32 do_read = !is_portable_backup(ff_pkt-bfd) || ff_pkt-statp.st_size 0; #else do_read = ff_pkt-statp.st_size 0; #endif } else if (ff_pkt-type == FT_RAW || ff_pkt-type == FT_FIFO || (!is_portable_backup(ff_pkt-bfd) ff_pkt-type == FT_DIREND)) { do_read = true; } if (do_read) { -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Tuesday, February 13, 2007 8:33 AM To: Robert Nelson Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Backing up and restoring Windows permissions On Tuesday 13 February 2007 11:29, Robert Nelson wrote: Ralf and I did some testing offline. The problem is with zero length files, the error is in this code taken from save_file() in filed/backup.c /* * Open any file with data that we intend to save, then save it. * * Note, if is_win32_backup, we must open the Directory so that * the BackupRead will save its permissions and ownership streams. */ if (ff_pkt-type != FT_LNKSAVED (S_ISREG(ff_pkt-statp.st_mode) ff_pkt-statp.st_size 0) || ff_pkt-type == FT_RAW || ff_pkt-type == FT_FIFO || (!is_portable_backup(ff_pkt-bfd) ff_pkt-type == FT_DIREND)) { We never open the file or do a BackupRead if the file is zero length. Kern, can you see any problem if we just remove the ff_pkt- statp.st_size 0 portion of the test? Yes, that might create some errors on portable Win32 and on Unix, and it will certainly cause extra overhead. On those systems, if the filesize is zero, we do not want to open it. IMO, the if needs to be re-written so that the size test is used in all cases except for !is_portable_backup(...). Probably about 10-20 minutes of hard thought could produce an if that is much more understandable (or several ifs if that is what it takes to simplify it). -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Ralf Ertzinger Sent: Monday, February 12, 2007 11:52 PM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Backing up and restoring Windows permissions Hi. On Mon, 12 Feb 2007 22:48:21 -0800, Robert Nelson wrote: Are you running an antivirus program? If so, does it still happen if the antivirus is disabled? There is no AV program on the Windows machine. Do you have the portable option set to yes in the FileSet resource? If so, does it occur if you remove it? To the best of my knowledge this option is not set. The configuration sections relevant to the machine in question are below. Is there a way to see (in the storage) whether the permissions were even saved? bls does not seem to tell me that, it just lists UNIX style permissions. Director config: Director {# define myself Name = banea-dir DIRport = 9101# where we listen for UA connections QueryFile = /usr/libexec/bacula/query.sql WorkingDirectory = /var/lib/bacula PidDirectory = /var/run Maximum Concurrent Jobs = 1 Password = GVAslILAQw69HBIVsrX8egWouulz9d58q3DogOPExPnz # Console password Messages = Daemon } JobDefs { Name = DefaultJob Type = Backup Level = Incremental Client = banea-fd FileSet = Full Set Schedule = WeeklyCycle Storage = File Messages = Standard Pool = Default Priority = 10 } Job { Name = w2k client = w2k-fd jobdefs = DefaultJob FileSet = w2k-set } Job { Name = BackupCatalog JobDefs = DefaultJob Level = Full FileSet=Catalog Schedule = WeeklyCycleAfterBackup # This creates an ASCII copy of the catalog RunBeforeJob = /usr/libexec/bacula/make_catalog_backup bacula bacula # This deletes the copy of the catalog RunAfterJob = /usr/libexec/bacula/delete_catalog_backup Write Bootstrap = /var/lib/bacula/BackupCatalog.bsr Priority = 11 # run after main backup } Job { Name = RestoreFiles Type = Restore Client=banea-fd FileSet=Full Set Storage = File Pool = Default Messages = Standard } Fileset { Name = w2k-set Include { Options { signature = MD5 } File = C:/TEMP } } Schedule { Name = WeeklyCycle Run = Full 1st sun at 23:05 Run = Differential 2nd-5th sun at 23:05 Run = Incremental mon-sat at 23:05 } Schedule { Name = WeeklyCycleAfterBackup Run = Full sun-sat at 23:10 } FileSet { Name = Catalog Include { Options { signature = MD5
Re: [Bacula-users] Backing up and restoring Windows permissions
Sorry I thought I'd already responded. Are you running an antivirus program? If so, does it still happen if the antivirus is disabled? Do you have the portable option set to yes in the FileSet resource? If so, does it occur if you remove it? -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Ralf Ertzinger Sent: Tuesday, February 06, 2007 2:34 AM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Backing up and restoring Windows permissions Hi. On Mon, 5 Feb 2007 13:17:45 -0800, Robert Nelson wrote: Can you run the following commands and post the results? Cacls c:\temp C:\cacls C:\TEMP C:\Temp Jeder:(OI)(CI)F Create the file Cacls c:\temp\file C:\cacls c:\temp\file c:\temp\file Jeder:F Add additional permissions Cacls c:\temp\file C:\cacls c:\temp\file c:\temp\file ADDIX\rertzinger:(OI)(CI)(DENY)(Beschränkter Zugriff:) FILE_WRITE_DATA FILE_APPEND_DATA FILE_WRITE_EA FILE_WRITE_ATTRIBUTES ADDIX\rertzinger:(OI)(CI)R Jeder:F Backup file. Remove file. Restore file. Cacls c:\temp\file C:\cacls c:\temp\file c:\temp\file Jeder:F - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Migration error
Use regedit to open the following path HKEY_LOCAL_MACHINE\HARDWARE\SYSTEM\CurrentControlSet\Services\Bacula-dir Then edit the ImagePath value. You need to make sure that you add the -d11 after the /service option. -Original Message- From: Kern Sibbald [mailto:[EMAIL PROTECTED] Sent: Monday, February 12, 2007 10:43 PM To: bacula-users@lists.sourceforge.net; Robert Nelson Cc: Brian Debelius Subject: Re: [Bacula-users] Migration error On Tuesday 13 February 2007 01:21, Brian Debelius wrote: Kern Sibbald wrote: On Monday 12 February 2007 19:54, Brian Debelius wrote: Hello, What is this trying to tell me? To get an accurate answer, you need to turn on debug level equal or greater than 10. Probably -d11 will do. 12-Feb 13:38 comp1-dir: The following 11 JobIds will be migrated: 10,13,14,15,16,17,18,19,20,21,22 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. 12-Feb 13:38 comp1-dir: Invalid keyword: Full 12-Feb 13:38 comp1-dir: Migrate_Full.2007-02-12_13.38.18 Error: Could not start migration job. ## # Migrate Job ## Job { Name = Migrate Full Type = Migrate Pool = Full Selection Type = Volume Selection Pattern = full Messages = Standard Level = Full #ignored Client = comp1-fd #ignored FileSet = DefaultFileset #ignored } ## # Full backup pool ## Pool { Name = Full Pool Type = Backup Recycle = yes Auto Prune = yes Volume Retention = 3 months Maximum Volume Jobs = 1 Label Format = full-${NumVols:p/4/0/r} Storage = FileStorage0 Next Pool = Tape } Where/how would I do this under Windows? I don't know as I have never run the director on Windows. Perhaps Robert can help you. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Conversion from CVS to Subversion (svn)
One minor clarification below -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-devel- [EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Wednesday, February 07, 2007 5:24 AM To: bacula-devel; bacula-users Subject: [Bacula-devel] Conversion from CVS to Subversion (svn) Hello, As you probably know Robert and I (mostly Robert) have been working on converting the CVS repository into a Subversion repository. The conversion is now complete. Bottom line: - The CVS is deactivated and can no longer be accessed (I think). The CVS tree is still accessible at the old paths, it just can't be updated because write access has been removed from all the developers. It is still possible to browse it using the original url: http://bacula.cvs.sourceforge.net/bacula This is useful if you need to refer back to one of the obsolete directories that weren't migrated to Subversion. - The Bacula page on Source Forge now has links in the Code menu item to the SVN Browser, and information about SVN, i.e. how to checkout the repository. - The repository is organized a bit differently from before, and if you checkout the the whole Bacula project, you will get the code to everything. [Rest removed] - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] BSMTP Error Win32 v2.1.1
Hey I like to bash Microsoft and their products as much as the next guy :-) I've used their products for over 20 years and worked there on the NT kernel for 12 years starting before the first release. So I certainly know all the warts and skeletons. :-O Exchange is definitely one of the packages everyone loves to hate (both inside and outside Microsoft). But I don't like to see anyone get a bad rap, so I try to correct misconceptions where I can. -Original Message- From: Erich Prinz [mailto:[EMAIL PROTECTED] Sent: Monday, February 05, 2007 8:07 AM To: Robert Nelson Cc: bacula-users Subject: Re: [Bacula-users] BSMTP Error Win32 v2.1.1 But Robert, if it's a bug in BSMTP you've taken away my love-to-bash- Exchange mantra! Say it ain't so! :-) E~ On Feb 4, 2007, at 10:46 AM, Robert Nelson wrote: Actually the problem is most definitely a bug in bsmtp. All Exchange is doing is insisting the From address be a correctly formatted email address. Bsmtp is wrapping the -f contents in '' and ''. It should probably just leave the address alone and then you could supply a full address and name like (Bacula) [EMAIL PROTECTED] or just an address like [EMAIL PROTECTED]. -Original Message- From: [EMAIL PROTECTED] [mailto:bacula- users- [EMAIL PROTECTED] On Behalf Of Erich Prinz Sent: Sunday, February 04, 2007 7:09 AM To: Kern Sibbald Cc: bacula-users Subject: Re: [Bacula-users] BSMTP Error Win32 v2.1.1 No surprise - it's an Exchange server and picky about EVERYTHING. E On Feb 3, 2007, at 3:49 AM, Kern Sibbald wrote: On Saturday 03 February 2007 00:29, Erich Prinz wrote: Wondering if it doesn't like having the (Bacula) portion added to the From section This is indicating that your SMTP server (localhost) rejected the address you supplied. Certain SMTP servers are very picky about email address and accept only certain formats. The manual explains this problem, but unfortunately does not give some real examples of the different formats. Trace output. 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: s01- ml110.culligancc.com -- helo s01-ml110.culligancc.com 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: s01- ml110.culligancc.com -- mail from:(Bacula) [EMAIL PROTECTED] 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: bsmtp: ../../tools/bsmtp.c:92 Fatal malformed reply from localhost: 501 5.5.4 Invalid Address 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: localhost -- 220 culligancc.com Microsoft ESMTP MAIL Service, Version: 6.0.3790.1830 ready at Fri, 2 Feb 2007 17:21:00 -0600 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: localhost -- 250 culligancc.com Hello [127.0.0.1] 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: localhost -- 501 5.5.4 Invalid Address 02-Feb 17:21 s01-ml110-dir: Client1.2007-02-02_17.20.37 Error: ../../ lib/message.c:483 Mail program terminated in error. CMD=C:\Program Files\Bacula\bin\bsmtp -h localhost -d10 -f (Bacula) [EMAIL PROTECTED] -s Bacula: Backup OK of s01- ml110-fd Incremental [EMAIL PROTECTED] ERR=Unknown error Config parameters: mailcommand = \C:\\Program Files\\Bacula\\bin\\bsmtp\ -h localhost -d10 -f \\(Bacula\) [EMAIL PROTECTED] \ -s \Bacula: %t %e of %c %l\ %r operatorcommand = \C:\\Program Files\\Bacula\\bin\\bsmtp\ -h localhost -d10 -f \\(Bacula\) [EMAIL PROTECTED] \ -s \Bacula: Intervention needed for %j\ %r mail = [EMAIL PROTECTED] = all, !skipped operator = [EMAIL PROTECTED] = mount console = all, !skipped, !saved On Feb 2, 2007, at 5:12 PM, Robert Nelson wrote: Can you try running the bsmtp command manually and add a -d10 to the options? That should display both sides of the conversation and then we can see what's happening. Also what does the line look like in the Bacula-dir.conf file? -Original Message- From: Erich Prinz [mailto:[EMAIL PROTECTED] Sent: Friday, February 02, 2007 2:53 PM To: bacula-users Cc: Robert Nelson Subject: BSMTP Error Win32 v2.1.1 Running Bacula Win32 Version 2.1.1 on Windows 2003 SBS R2 Not sure if this a problem with the setup or Exchange. Can you point me in the right direction here? After running a successful job: 02-Feb 16:36 s01-ml110-dir: ../../lib/message.c:472 Mail prog: bsmtp: ../../tools/bsmtp.c:92 Fatal m alformed reply from localhost: 501 5.5.4 Invalid Address 02-Feb 16:36 s01-ml110-dir: Client1.2007-02-02_16.35.23 Error: ../../ lib/message.c:483 Mail program terminated in error. CMD=C:\Program Files\Bacula\bin\bsmtp -h localhost -f (Bacula) [EMAIL PROTECTED] -s Bacula: Backup OK of s01-ml110-fd Incremental [EMAIL
Re: [Bacula-users] Some files always backed up, even without changes
Incremental backups are based solely on the modification date of the file. If the file modification date is later than the last full or differential backup then the file will be included in the incremental backup. Most likely these files have bogus modification dates sometime in the future. -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Adam Compton Sent: Monday, February 05, 2007 9:25 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Some files always backed up, even without changes Hello, I am having a strange issue with some files always being backed up during incremental runs, even if they have not changed since the last incremental backup. In particular, I have a working directory of custom installer packages for some of the educational software we run here, and two of the ~30 package roots are being backed up during each incremental job, even though they haven't been touched in the interim. It's fine with me that they be backed up during full runs, of course, but having them backed up during the daily incrementals is chewing through my backup volume like crazy. This is with the director, file daemon, and storage daemon all running on the same machine, and with the storage daemon writing to a file volume. The machine is a Gentoo Linux install (uname -a: Linux hercules 2.6.17-gentoo-r8 #2 Sat Nov 4 00:09:36 PST 2006 x86_64 AMD Athlon(tm) 64 Processor 3200+ AuthenticAMD GNU/Linux), and bacula is at version 2.0.0. I've run both the director and the file daemon at -d200, but I can't seem to figure out exactly where these files are selected to be backed up (although I can see them being backed up, of course). If anybody has any tips for troubleshooting this type of issue, I would really appreciate the help. Thanks in advance! Adam Compton Network Administrator Sierra Canyon School - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Splitting config files
Yes this is a bug, please enter it and assign it to me. Thanks, -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Brian Debelius Sent: Thursday, February 01, 2007 10:49 AM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Splitting config files Brian Debelius wrote: Michel Meyers wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Brian Debelius wrote: Darien Hager wrote: On Jan 31, 2007, at 11:07 AM, Brian Debelius wrote: ok, doing the above helps out a little. You can now see part of the path after the 'config file' line I changed it to @C:\\Documents\ and\ Settings\\All\ Users\\Application\ Data\\Bacula\\schedule.conf Maybe trying the good old DOS 8.3 notation will work? ie: c:\docume~1\alluse~1\applic~1\bacula\schedule.conf or a variation with double backslashes or single forward slashes. Just an idea. Greetings, Michel I just tried @c:/docume~1/alluse~1/applic~1/bacula/schedule.conf and this works. Thanks. SoWould this qualify as a bug? - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backing up and restoring Windows permissions
Can you run the following commands and post the results? Cacls c:\temp Create the file Cacls c:\temp\file Add additional permissions Cacls c:\temp\file Backup file. Remove file. Restore file. Cacls c:\temp\file Thanks, -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Ralf Ertzinger Sent: Monday, February 05, 2007 12:11 PM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Backing up and restoring Windows permissions Hi. I am currently evaluating bacula, especially for backing up Windows machines. My basic test setup works (director and storage on Linux (2.0.2), fd on Windows (2.0.1)) and I can backup and restore data from the Windows machine. However, I can not seem to recreate the permissions on restore. The test setup is as follows: A file is created on C:\TEMP, having the inherited permission of Everyone - Full access. The Windows machine is part of a AD domain, and additional permissions are granted on the file to a user from that domain (does not matter who), say Allow read, deny remove. The file is backed up, and deleted on the Windows machine. It is then restored from backup. The file comes back, but it just gets the inherited permissions, the additional permissions for the AD user are gone. According to what I have read there is nothing special I have to do in order to have Windows permissions backed up, but I may have missed something. The fd is running as a service, tried with both the local SYSTEM account and a Domain administrative account. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] BSMTP Error Win32 v2.1.1
Actually the problem is most definitely a bug in bsmtp. All Exchange is doing is insisting the From address be a correctly formatted email address. Bsmtp is wrapping the -f contents in '' and ''. It should probably just leave the address alone and then you could supply a full address and name like (Bacula) [EMAIL PROTECTED] or just an address like [EMAIL PROTECTED]. -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Erich Prinz Sent: Sunday, February 04, 2007 7:09 AM To: Kern Sibbald Cc: bacula-users Subject: Re: [Bacula-users] BSMTP Error Win32 v2.1.1 No surprise - it's an Exchange server and picky about EVERYTHING. E On Feb 3, 2007, at 3:49 AM, Kern Sibbald wrote: On Saturday 03 February 2007 00:29, Erich Prinz wrote: Wondering if it doesn't like having the (Bacula) portion added to the From section This is indicating that your SMTP server (localhost) rejected the address you supplied. Certain SMTP servers are very picky about email address and accept only certain formats. The manual explains this problem, but unfortunately does not give some real examples of the different formats. Trace output. 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: s01- ml110.culligancc.com -- helo s01-ml110.culligancc.com 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: s01- ml110.culligancc.com -- mail from:(Bacula) [EMAIL PROTECTED] 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: bsmtp: ../../tools/bsmtp.c:92 Fatal malformed reply from localhost: 501 5.5.4 Invalid Address 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: localhost -- 220 culligancc.com Microsoft ESMTP MAIL Service, Version: 6.0.3790.1830 ready at Fri, 2 Feb 2007 17:21:00 -0600 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: localhost -- 250 culligancc.com Hello [127.0.0.1] 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: localhost -- 501 5.5.4 Invalid Address 02-Feb 17:21 s01-ml110-dir: Client1.2007-02-02_17.20.37 Error: ../../ lib/message.c:483 Mail program terminated in error. CMD=C:\Program Files\Bacula\bin\bsmtp -h localhost -d10 -f (Bacula) [EMAIL PROTECTED] -s Bacula: Backup OK of s01- ml110-fd Incremental [EMAIL PROTECTED] ERR=Unknown error Config parameters: mailcommand = \C:\\Program Files\\Bacula\\bin\\bsmtp\ -h localhost -d10 -f \\(Bacula\) [EMAIL PROTECTED] \ -s \Bacula: %t %e of %c %l\ %r operatorcommand = \C:\\Program Files\\Bacula\\bin\\bsmtp\ -h localhost -d10 -f \\(Bacula\) [EMAIL PROTECTED] \ -s \Bacula: Intervention needed for %j\ %r mail = [EMAIL PROTECTED] = all, !skipped operator = [EMAIL PROTECTED] = mount console = all, !skipped, !saved On Feb 2, 2007, at 5:12 PM, Robert Nelson wrote: Can you try running the bsmtp command manually and add a -d10 to the options? That should display both sides of the conversation and then we can see what's happening. Also what does the line look like in the Bacula-dir.conf file? -Original Message- From: Erich Prinz [mailto:[EMAIL PROTECTED] Sent: Friday, February 02, 2007 2:53 PM To: bacula-users Cc: Robert Nelson Subject: BSMTP Error Win32 v2.1.1 Running Bacula Win32 Version 2.1.1 on Windows 2003 SBS R2 Not sure if this a problem with the setup or Exchange. Can you point me in the right direction here? After running a successful job: 02-Feb 16:36 s01-ml110-dir: ../../lib/message.c:472 Mail prog: bsmtp: ../../tools/bsmtp.c:92 Fatal m alformed reply from localhost: 501 5.5.4 Invalid Address 02-Feb 16:36 s01-ml110-dir: Client1.2007-02-02_16.35.23 Error: ../../ lib/message.c:483 Mail program terminated in error. CMD=C:\Program Files\Bacula\bin\bsmtp -h localhost -f (Bacula) [EMAIL PROTECTED] -s Bacula: Backup OK of s01-ml110-fd Incremental [EMAIL PROTECTED] ERR=Unknown error Using the AD/machine admin account here on the box for email address. Regular SMTP sends successfully BTW. Erich - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel? cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- --- Using Tomcat but need to do more? Need to support web services
[Bacula-users] MTX Announcement
I'm now the owner / maintainer of the mtx project ( http://sourceforge.net/projects/mtx ). This means that we can get any changes, that we need, integrated back into the standard releases. One of the first things I did while porting the web site from Eric's machine to SourceForge was add Bacula (with a link to our webpage) to the examples of applications that can be used with mtx. :-) Please let me know if you know of any outstanding patches or feature requests. The project has been converted from CVS to Subversion. I released a new version (1.3.10) of the development tree, the first new version in a year and only the second new version in 5 years. This new version incorporates my changes to support Windows as well as support for the Sony VGP-XL1B 200 Disc CD/DVD Changer. I've redesigned the Compatibility Database and the Web pages that are used to access and update it. It should be much easier to browse the existing entries and to report your success with various Media Changers. Please take the time to try version 1.3.10 and report the compatibility results. ( http://mtx.sourceforge.net/contrib.php ) Once the current development version has received enough testing I'll be promoting it to stable status. The current stable version is over 4 years old and quite out of date. This will make the current version available much more widely since the Linux distributions usually only pick up the stable versions. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] BSMTP Error Win32 v2.1.1
Can you try running the bsmtp command manually and add a -d10 to the options? That should display both sides of the conversation and then we can see what's happening. Also what does the line look like in the Bacula-dir.conf file? -Original Message- From: Erich Prinz [mailto:[EMAIL PROTECTED] Sent: Friday, February 02, 2007 2:53 PM To: bacula-users Cc: Robert Nelson Subject: BSMTP Error Win32 v2.1.1 Running Bacula Win32 Version 2.1.1 on Windows 2003 SBS R2 Not sure if this a problem with the setup or Exchange. Can you point me in the right direction here? After running a successful job: 02-Feb 16:36 s01-ml110-dir: ../../lib/message.c:472 Mail prog: bsmtp: ../../tools/bsmtp.c:92 Fatal m alformed reply from localhost: 501 5.5.4 Invalid Address 02-Feb 16:36 s01-ml110-dir: Client1.2007-02-02_16.35.23 Error: ../../ lib/message.c:483 Mail program terminated in error. CMD=C:\Program Files\Bacula\bin\bsmtp -h localhost -f (Bacula) [EMAIL PROTECTED] -s Bacula: Backup OK of s01-ml110-fd Incremental [EMAIL PROTECTED] ERR=Unknown error Using the AD/machine admin account here on the box for email address. Regular SMTP sends successfully BTW. Erich - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] BSMTP Error Win32 v2.1.1
Yep, whoever wrote the bsmtp program originally never expected a friendly name, just the actual address. -Original Message- From: Erich Prinz [mailto:[EMAIL PROTECTED] Sent: Friday, February 02, 2007 3:29 PM To: Robert Nelson Cc: 'bacula-users' Subject: Re: BSMTP Error Win32 v2.1.1 Wondering if it doesn't like having the (Bacula) portion added to the From section Trace output. 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: s01- ml110.culligancc.com -- helo s01-ml110.culligancc.com 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: s01- ml110.culligancc.com -- mail from:(Bacula) [EMAIL PROTECTED] 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: bsmtp: ../../tools/bsmtp.c:92 Fatal malformed reply from localhost: 501 5.5.4 Invalid Address 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: localhost -- 220 culligancc.com Microsoft ESMTP MAIL Service, Version: 6.0.3790.1830 ready at Fri, 2 Feb 2007 17:21:00 -0600 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: localhost -- 250 culligancc.com Hello [127.0.0.1] 02-Feb 17:21 s01-ml110-dir: ../../lib/message.c:472 Mail prog: localhost -- 501 5.5.4 Invalid Address 02-Feb 17:21 s01-ml110-dir: Client1.2007-02-02_17.20.37 Error: ../../ lib/message.c:483 Mail program terminated in error. CMD=C:\Program Files\Bacula\bin\bsmtp -h localhost -d10 -f (Bacula) [EMAIL PROTECTED] -s Bacula: Backup OK of s01- ml110-fd Incremental [EMAIL PROTECTED] ERR=Unknown error Config parameters: mailcommand = \C:\\Program Files\\Bacula\\bin\\bsmtp\ -h localhost -d10 -f \\(Bacula\) [EMAIL PROTECTED] \ -s \Bacula: %t %e of %c %l\ %r operatorcommand = \C:\\Program Files\\Bacula\\bin\\bsmtp\ -h localhost -d10 -f \\(Bacula\) [EMAIL PROTECTED] \ -s \Bacula: Intervention needed for %j\ %r mail = [EMAIL PROTECTED] = all, !skipped operator = [EMAIL PROTECTED] = mount console = all, !skipped, !saved On Feb 2, 2007, at 5:12 PM, Robert Nelson wrote: Can you try running the bsmtp command manually and add a -d10 to the options? That should display both sides of the conversation and then we can see what's happening. Also what does the line look like in the Bacula-dir.conf file? -Original Message- From: Erich Prinz [mailto:[EMAIL PROTECTED] Sent: Friday, February 02, 2007 2:53 PM To: bacula-users Cc: Robert Nelson Subject: BSMTP Error Win32 v2.1.1 Running Bacula Win32 Version 2.1.1 on Windows 2003 SBS R2 Not sure if this a problem with the setup or Exchange. Can you point me in the right direction here? After running a successful job: 02-Feb 16:36 s01-ml110-dir: ../../lib/message.c:472 Mail prog: bsmtp: ../../tools/bsmtp.c:92 Fatal m alformed reply from localhost: 501 5.5.4 Invalid Address 02-Feb 16:36 s01-ml110-dir: Client1.2007-02-02_16.35.23 Error: ../../ lib/message.c:483 Mail program terminated in error. CMD=C:\Program Files\Bacula\bin\bsmtp -h localhost -f (Bacula) [EMAIL PROTECTED] -s Bacula: Backup OK of s01-ml110-fd Incremental [EMAIL PROTECTED] ERR=Unknown error Using the AD/machine admin account here on the box for email address. Regular SMTP sends successfully BTW. Erich - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Solved why Windows FD 1.38 sometime is slow
It sounds like Flow Control might be disabled on one of the adapters. _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Gabriele Bulfon Sent: Tuesday, January 30, 2007 9:42 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Solved why Windows FD 1.38 sometime is slow I had headaches for a week, trying to figure out why some windows FDs were VERY slow compared to all the rest of FDs. These slow clients were all rating at around 1Mb/s. After playing a bit with many system and bacula parameters, I decided not to trust what was stated in the manual: the default Maximum Network Buffer Size = 32768. Because I tried rising this parameter to double default, both on sd and all fds, and noticed that I had a slow down of all the FDs, I put back everything to default. Then I decided to explicitly set the Maximum Network Buffer Size = 32768 to the windows machine that was still so slowand it magically started to work as the rest of fds!!! Beacuse I have another windows FD on the same installation, with the same version of bacula, and this one was going fine with the default (MNB not specified), what I believe is that the windows setup has been built with a different default (maybe 65536), and this setting may be fine only in specific situations. What I mean, is that probably 32768 is fine for almost any card, but 65536 may be fine only for cards that support this buffer size. What I know now is that explicitly setting the buffer to 32768 on the bacula fd will work. After finding this, I did the same on other 3 installations where I had similar problems, and it worked! Thanx to everyone that tried to help me. Gabriele. http://www.sonicle.com Gabriele Bulfon - Sonicle S.r.l. Tel +39 028246016 Int. 30 - Fax +39 028243880 Via Felice Cavallotti 16 - 20089, Rozzano - Milano - ITALY http://www.sonicle.com - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] GUI Interface Name Vote Results
Of course if badmin had been the winner then there would have had to be a command called ton. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Dan Langille Sent: Saturday, January 27, 2007 11:39 AM To: bacula-users@lists.sourceforge.net Cc: [EMAIL PROTECTED] Subject: Re: [Bacula-devel] [Bacula-users] GUI Interface Name Vote Results On 27 Jan 2007 at 11:25, Alan Gerber wrote: Greetings and good Saturday to everyone! The vote for the GUI interface is complete, and the results are all tallied up. We had 24 name suggestions, and 32 total votes. Here are the top 3 results for the vote: bat (Bacula Admin Tool) with 54 points badmin with 26 points bacon with 17 points It seems that bat was an overwhelmingly popular name, getting 14 first choice votes, compared to the next highest first choice votes for badmin and Frontula, which were tied for 4 first choice votes. Congratulations to Peter Buschman for picking our top-rated name! humour As someone else pointed out, it's a shame the standard method for getting more information about an application involves putting the application name second. Otherwise, everyone would be typing: bat man /humour -- Dan Langille : Software Developer looking for work my resume: http://www.freebsddiary.org/dan_langille.php PGCon - The PostgreSQL Conference - http://www.pgcon.org/ - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-devel mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/bacula-devel - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Win2k Automated Upgrade from 1.3x to 2.0
Those messages come from the 1.3x Bacula-fd.exe. The new version doesn't display them. But during an upgrade the old one is used to uninstall the existing service. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Mantas M. Sent: Friday, January 26, 2007 1:43 AM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Win2k Automated Upgrade from 1.3x to 2.0 I've been looking for a way to automate the setup on xp workstations as well. After some fifteen tries to install and uninstall bacula in various ways i've decided to go the with the merest: 1. stop the service 2. replace the binary files 3. start the service again. as far as i've tested this, it works completely fine, and you do not have to play with nullsoft installers. I would like however to add some comments on the installers. Installer (as well as uninstaller) shows way to much messages which do not require any reaction form the user. For instance, why do we need that service was successfully installed (removed) message? I believe there should only be one saying, that service install failed, in case that happens. If (un)installer wouldn't have this irritating feature, it'd be easy to push new versios using the original installers, since the /S switch takes care of pretty much all the rest. Regards, Mantas. Does anyone have any scripts to push updates to clients on Windows 2000 network? OR alternatively, does Bacula-2.0.1.exe has any command line switches to help to automate deployment? If, nothing exists, I will write batch or bash script to do it. BTW - I did see the script to update existing 1.3x installs, but since the 2.0 is quite different, it will not work. Thanks everyone - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] windows xp sp2 and powerfile c200 disc changer
No chance of that working until I issue a new update to mtx. I have a C200 and it has a rather severe bug that I have a fix for. As for not showing up with scsilist that is a separate issue. The C200 driver doesn't create a normal WIN32 device name. So you have to enter the setupapi Device Interface Name. This is a really long name that is really ugly and is not supposed to be entered manually. (The intent is a program enumerates the devices and shows the user the friendly names and then uses the ugly one internally to open the device. I'll be adding support for those in the next version of scsilist. In the meantime you can figure out the name manually, it should be in the registry at: HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\DeviceClasses\{53f56310- b6bf-11d0-94f2-00a0c91efb8b} Under that key will be another key starting with ##?#SBP2#POWERFILE-C200... If you strip off the leading ##?# and pass the rest of that keyname as the device name (in double quotes) it should work. For example on my system the command is: mtx -f SBP2#POWERFILE-C200DISC_CHANGERLUN2#003060f22832#{53f56310-b6bf-11d0- 94f2-00a0c91efb8b} status If you can build the Windows version yourself then I can send you the updated patch to mtx, otherwise let me know and I can build it for you. I have fixes to support the Sony VGP-XL1B as well. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of eric Sent: Tuesday, January 23, 2007 11:45 PM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] windows xp sp2 and powerfile c200 disc changer Does anyone have experience with configuring bacula to work with a powerfile unit on win xp? I can't even get my changer to show up when I use scsilist.exe although it is listed in the windows device manager. All I really need bacula (mtx?) to do is change out and mount/unmount discs. I can script all the copying and disc burning, etc. If you have a powerfile that you can operate with bacula or any other free/open source software on a win xp system, please let me know. Eric TV dinner still cooling? Check out Tonight's Picks on Yahoo! TV. http://tv.yahoo.com/ - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Win2k Automated Upgrade from 1.3x to 2.0
Ah I just noticed a small omission :-) (One that would cause the installed service not to work :-O. Install should be: c:\Program Files\bacula\bin\bacula-fd /install -c C:\Documents and Settings\All Users\Application Data\bacula\bacula-fd.conf -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Arno Lehmann Sent: Thursday, January 25, 2007 12:14 AM To: 'bacula-users' Subject: Re: [Bacula-users] Win2k Automated Upgrade from 1.3x to 2.0 Hello, On 1/25/2007 8:54 AM, Robert Nelson wrote: Don't use sc.exe, you won't get all the parameters right. You should be able to use winbacula-2.0.1.exe /s. If you just want to remove or install the services use the following commands: c:\bacula\bin\bacula-fd /remove c:\Program Files\bacula\bin\bacula-fd /install Ah... I wasn't aware that these switches still exist and work. During the first tries of the cross-compiled windows FD I tried them but hat difficulties to get the FD installed. Might have been because my installation was broken, though. Arno -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Vladimir Doisan Sent: Wednesday, January 24, 2007 2:53 PM To: Arno Lehmann Cc: bacula-users Subject: Re: [Bacula-users] Win2k Automated Upgrade from 1.3x to 2.0 Very cool! I am crazy enough to start working on it today unless my wify shoots me if I spend too much time working :) Since you told me the most important command sc, the script is ez. If I will not have any emergencies at work, I will have testing done tomorrow. Thanks a lot! Arno Lehmann wrote: Hello, On 1/24/2007 10:38 PM, Vladimir Doisan wrote: I think there is a bit of work needed to get the update 1.38 to 2.0 happen automatically. If I understand correctly, you stop service, copy files, start service. Which would work just perfectly for upgrades 1.38.x - 1.38.y and with slight path modifications it will work fine for 2.0.a - 2.0.b However it will not work for the upgrade from 1.38.x - 2.0.a True, I suppose. Here's some steps what I think needs to be done 1. Stop Service net stop bacula 2. Delete Old Service (pointing to c:\bacula) probably need to delete some registry keys sc bacula delete or something. 3. Move extracted files (.exe, .dll .txt ...) to correct folders (ProgFiles\Bacula and DocsSettins\AllUsers\AppData\bacula) %ProgramFiles% and %AllUsersProfile%\AppData\Bacula might work 4. Move old .conf files to new folders copy ... that one was easy! 5. Create new service (pointing to new path) need to create new registry keys sc create don't ask _me_ for details... Microsofts Web Site probably has some sort of a manual for the sc command. Or see if the output of 'sc create' helps you... 6. Start new service net start bacula-fd (note the new service name!) 7. Delete old c:\bacula directory (optional) I would keep it for a while. File movement is trivial, but how to create / delete services and modify registry from CLI via rpc? sc is the magic command. This is why I think there should be some switches in winbacula-2.0.exe to help automate this task of clicking next, next, next, finish. All of the user interaction stuff (clicking) could be automated. Let me know what you think, I had crazy week (2 months actually), maybe I am way off... If you're crazy enough you'll have something ready tomorrow :-) Arno Vladimir Michel Meyers wrote: P.S. You will also have to adapt the service name, the new installer installs the FD as 'bacula-fd', not just 'bacula'. Greetings, Michel Michel Meyers wrote: Vladimir Doisan wrote: Oh, so the install directory would still be c:\bacula (whatever the 1.3x was)? No, the new installer unfortunately uses the Program Files directory for it (but I think it's the same for all machines, unless you have multiple versions of Windows). Maybe I was looking at the different script, or mixed it up with something else... Could you give me the link? You can find it in examples/upgrade-win32-client.txt if you have the source tarball. Greetings, Michel - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp
Re: [Bacula-users] Win2k Automated Upgrade from 1.3x to 2.0
Necessary, there are two command line parsers that get run. The one in the Windows wrapper code which uses / and the one in the underlying Bacula code that uses -. The /install, /remove, /service, etc are all interpreted by the wrapper. The install command just takes whatever comes after the /install and puts it into the service command line. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Arno Lehmann Sent: Thursday, January 25, 2007 12:50 AM To: 'bacula-users' Subject: Re: [Bacula-users] Win2k Automated Upgrade from 1.3x to 2.0 Hello, On 1/25/2007 9:27 AM, Robert Nelson wrote: Ah I just noticed a small omission :-) (One that would cause the installed service not to work :-O. Install should be: c:\Program Files\bacula\bin\bacula-fd /install -c C:\Documents and Settings\All Users\Application Data\bacula\bacula-fd.conf Giving the configuration was not my problem at that time. However, I notice you use dashes and slashes for the parameters. Is that necessary, intentional, or can you use whatever you prefer? Arno -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Arno Lehmann Sent: Thursday, January 25, 2007 12:14 AM To: 'bacula-users' Subject: Re: [Bacula-users] Win2k Automated Upgrade from 1.3x to 2.0 Hello, On 1/25/2007 8:54 AM, Robert Nelson wrote: Don't use sc.exe, you won't get all the parameters right. You should be able to use winbacula-2.0.1.exe /s. If you just want to remove or install the services use the following commands: c:\bacula\bin\bacula-fd /remove c:\Program Files\bacula\bin\bacula-fd /install Ah... I wasn't aware that these switches still exist and work. During the first tries of the cross-compiled windows FD I tried them but hat difficulties to get the FD installed. Might have been because my installation was broken, though. Arno -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Vladimir Doisan Sent: Wednesday, January 24, 2007 2:53 PM To: Arno Lehmann Cc: bacula-users Subject: Re: [Bacula-users] Win2k Automated Upgrade from 1.3x to 2.0 Very cool! I am crazy enough to start working on it today unless my wify shoots me if I spend too much time working :) Since you told me the most important command sc, the script is ez. If I will not have any emergencies at work, I will have testing done tomorrow. Thanks a lot! Arno Lehmann wrote: Hello, On 1/24/2007 10:38 PM, Vladimir Doisan wrote: I think there is a bit of work needed to get the update 1.38 to 2.0 happen automatically. If I understand correctly, you stop service, copy files, start service. Which would work just perfectly for upgrades 1.38.x - 1.38.y and with slight path modifications it will work fine for 2.0.a - 2.0.b However it will not work for the upgrade from 1.38.x - 2.0.a True, I suppose. Here's some steps what I think needs to be done 1. Stop Service net stop bacula 2. Delete Old Service (pointing to c:\bacula) probably need to delete some registry keys sc bacula delete or something. 3. Move extracted files (.exe, .dll .txt ...) to correct folders (ProgFiles\Bacula and DocsSettins\AllUsers\AppData\bacula) %ProgramFiles% and %AllUsersProfile%\AppData\Bacula might work 4. Move old .conf files to new folders copy ... that one was easy! 5. Create new service (pointing to new path) need to create new registry keys sc create don't ask _me_ for details... Microsofts Web Site probably has some sort of a manual for the sc command. Or see if the output of 'sc create' helps you... 6. Start new service net start bacula-fd (note the new service name!) 7. Delete old c:\bacula directory (optional) I would keep it for a while. File movement is trivial, but how to create / delete services and modify registry from CLI via rpc? sc is the magic command. This is why I think there should be some switches in winbacula-2.0.exe to help automate this task of clicking next, next, next, finish. All of the user interaction stuff (clicking) could be automated. Let me know what you think, I had crazy week (2 months actually), maybe I am way off... If you're crazy enough you'll have something ready tomorrow :-) Arno Vladimir Michel Meyers wrote: P.S. You will also have to adapt the service name, the new installer installs the FD as 'bacula-fd', not just 'bacula'. Greetings, Michel Michel Meyers wrote: Vladimir Doisan wrote: Oh, so the install directory would still be c:\bacula (whatever the 1.3x was)? No, the new installer unfortunately uses the Program Files directory for it (but I think it's the same for all machines, unless you have multiple versions of Windows). Maybe I was looking at the different script, or mixed it up with something else... Could you give me the link? You can find it in examples/upgrade-win32-client.txt if you have the source tarball. Greetings, Michel
Re: [Bacula-users] ClientRunBeforeJob (XP Client) Crashes -- Me Too
I never saw this on the developer's alias so it took me a lot longer to see it. Anyways, the simplest way to handle paths with spaces is don't put them in. :-) If you just put the program name in then Bacula will search using the same rules that cmd.exe uses (current directory, Bacula bin directory, and PATH). It will even try the different extensions in the same order as cmd.exe. If you have slashes in the program name then Bacula figures you went to all that trouble to fully specify the name, the least you can do is append the 3 character extension. So if your script is in the Bacula\bin directory then the following lines should work fine: Client Run Before Job = systemstate Or Client Run Before Job = systemstate.bat Or Client Run Before Job = systemstate Or Client Run Before Job = systemstate.bat Or ClientRunBeforeJob = \C:/Program Files/Bacula/systemstate.bat\ The outer set of quotes is removed when the configuration file is parsed. You need to escape the inner quotes so that they are there when the code that parses the command line for execution runs so it can tell what the program name is. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Erich Prinz Sent: Thursday, January 18, 2007 6:53 AM To: Silver Salonen Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] ClientRunBeforeJob (XP Client) Crashes -- Me Too You might want to send this (the last posting) to the developers list for Robert to look over. Erich On Jan 18, 2007, at 1:15 AM, Silver Salonen wrote: On Thursday 11 January 2007 12:12, Silver Salonen wrote: On Thursday 11 January 2007 12:08, Silver Salonen wrote: On Friday 03 November 2006 00:48, Scott Ruckh wrote: -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Scott Ruckh Sent: Thursday, November 02, 2006 9:31 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] ClientRunBeforeJob (XP Client) Crashes -- Me Too I saw this error already posted, but never saw a resolution. Director version: 1.39.27 (24 October 2006) (From CVS) Director OS: CentOS 4.3 Storage Daemon: Built from same CVS XP client: winbacula-1.39.26.exe Error received: 02-Nov 10:11 CLIENT-fd: ClientRunBeforeJob: run command C:/Bacula/bin/backup_systemstate.bat * 02-Nov 10:11 BACULA-dir: CLIENT_FULL.2006-11-02_10.11.02 Fatal error: Socket error on ClientRunBeforeJob command: ERR=Connection reset by peer 02-Nov 10:11 BACULA-dir: CLIENT_FULL.2006-11-02_10.11.02 Error: Bacula 1.39.27 (24Oct06): 02-Nov-2006 10:11:54 This is in the job definition ClientRunBeforeJob = C:/Bacula/bin/backup_systemstate.bat The contents of C:/Bacula/bin/backup_systemstate.bat: ntbackup backup systemstate /F C:\SystemState\systemstate.bkf When the batch file is executed (outside of bacula) it works fine. The Windows SYSTEM account has permissions to the directories in question. All of this worked fine before migrating to newer version of bacula. Previous bacula version was 1.38.9. Backup job completes fine if ClientRunBeforeJob directive is commented out. The XP bacula-fd.exe completely crashes and is closed after error (service is no longer running). Anyone know the cause of this error? Thanks. Scott Yesterday. 01-Nov-2006 Thanks. I just rebuilt from CVS again. I got passed the crash, .BAT file did complete, and backup is running. Now I will test for a few days and see if I have eliminated some of my problems or have more to contend with. Thanks. Scott I have the same problem with 2.0.0 on Windows 2003 server :( The directive is: Client Run Before Job = C:/Program Files/Bacula/systemstate.bat Anything I can do about it? I'd really like to backup systemstate also.. Silver BTW, my bacula-dir is also 2.0.0 and it runs on FreeBSD-5.3. Silver Oh, darn. More problems with win32 ClientRunBeforeJob. After the directive was being commented out from the job as it didn't succeed, I now put it back, after upgrading both server and client to 2.0.1. Now the directive seems to not support spaces in its path: 17-Jan 23:06 w2k3-fd: ClientRunBeforeJob: run command C:/Program Files/Bacula/systemstate.bat 17-Jan 23:06 w2k3-fd: ClientRunBeforeJob: 'C:/Program' is not recognized as an internal or external command, I tried escaping space with backslash, but it gave me the same result. However, when I put the script into C:\bacula\, it ran successfully, so now at last I can backup the system state also. I think it would be right to put scripts into Bacula's own directory, not to create a separate one. Silver -- --- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -
Re: [Bacula-users] Win2k Automated Upgrade from 1.3x to 2.0
Don't use sc.exe, you won't get all the parameters right. You should be able to use winbacula-2.0.1.exe /s. If you just want to remove or install the services use the following commands: c:\bacula\bin\bacula-fd /remove c:\Program Files\bacula\bin\bacula-fd /install -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Vladimir Doisan Sent: Wednesday, January 24, 2007 2:53 PM To: Arno Lehmann Cc: bacula-users Subject: Re: [Bacula-users] Win2k Automated Upgrade from 1.3x to 2.0 Very cool! I am crazy enough to start working on it today unless my wify shoots me if I spend too much time working :) Since you told me the most important command sc, the script is ez. If I will not have any emergencies at work, I will have testing done tomorrow. Thanks a lot! Arno Lehmann wrote: Hello, On 1/24/2007 10:38 PM, Vladimir Doisan wrote: I think there is a bit of work needed to get the update 1.38 to 2.0 happen automatically. If I understand correctly, you stop service, copy files, start service. Which would work just perfectly for upgrades 1.38.x - 1.38.y and with slight path modifications it will work fine for 2.0.a - 2.0.b However it will not work for the upgrade from 1.38.x - 2.0.a True, I suppose. Here's some steps what I think needs to be done 1. Stop Service net stop bacula 2. Delete Old Service (pointing to c:\bacula) probably need to delete some registry keys sc bacula delete or something. 3. Move extracted files (.exe, .dll .txt ...) to correct folders (ProgFiles\Bacula and DocsSettins\AllUsers\AppData\bacula) %ProgramFiles% and %AllUsersProfile%\AppData\Bacula might work 4. Move old .conf files to new folders copy ... that one was easy! 5. Create new service (pointing to new path) need to create new registry keys sc create don't ask _me_ for details... Microsofts Web Site probably has some sort of a manual for the sc command. Or see if the output of 'sc create' helps you... 6. Start new service net start bacula-fd (note the new service name!) 7. Delete old c:\bacula directory (optional) I would keep it for a while. File movement is trivial, but how to create / delete services and modify registry from CLI via rpc? sc is the magic command. This is why I think there should be some switches in winbacula-2.0.exe to help automate this task of clicking next, next, next, finish. All of the user interaction stuff (clicking) could be automated. Let me know what you think, I had crazy week (2 months actually), maybe I am way off... If you're crazy enough you'll have something ready tomorrow :-) Arno Vladimir Michel Meyers wrote: P.S. You will also have to adapt the service name, the new installer installs the FD as 'bacula-fd', not just 'bacula'. Greetings, Michel Michel Meyers wrote: Vladimir Doisan wrote: Oh, so the install directory would still be c:\bacula (whatever the 1.3x was)? No, the new installer unfortunately uses the Program Files directory for it (but I think it's the same for all machines, unless you have multiple versions of Windows). Maybe I was looking at the different script, or mixed it up with something else... Could you give me the link? You can find it in examples/upgrade-win32-client.txt if you have the source tarball. Greetings, Michel - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] bacula 2.0.1 error in xp
This is a bug in Kern's 2.0.1 fix for old versions of the shell (circa NT4). Unfortunately it broke all non-English systems and all systems that aren't installed on the C drive. I have a fix I'll check in today for those that build from the CVS. You can work around it by specifying the -c command line option. However the Director is normally run as a service. The installer should automatically install it with the correct command line option. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Erich Prinz Sent: Thursday, January 18, 2007 6:56 AM To: Andres Sanchez Garcia Cc: bacula-devel Development; bacula-users Subject: Re: [Bacula-devel] [Bacula-users] bacula 2.0.1 error in xp It's likely due to language differences. I'll cc this response to the developers list for you... On Jan 18, 2007, at 2:42 AM, Andres Sanchez Garcia wrote: hello! sorry, but my english is very poor. I installed bacula 2.0.1 in windows xp (spanish version). When i executed the bacula-dir.exe, i have this error: bacula-dir.exe: ERROR TERMINATION at ../../lib/parse_conf.c: 819 config error: Cannot open config file C:\Documents and Settings\All Users\Application Data\Bacula\bacula-dir.conf: No such file or directory. NOTE: In windows XP spanish version the path is diferent: C: \Documents and Settings\All Users\Datos de Programa\Bacula\bacula-dir.conf NOTE: I'm serching in bacula-dir.conf, to change the path. But all path are ok for the spanish version. NOTE: I created a path C:\Documents and Settings\All Users \Application Data\Bacula\. And i linked the config files of bacula. It don't work. The version of bacula 2.0.0 in windows xp haven't this problem. It is a bug? Andres -- --- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php? page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-devel mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/bacula-devel - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] about the 1.40 version release
Yes TLS communication is supported by the Windows version. Openssl is installed as part of the Bacula installation. Configuration is similar to the UNIX environment and requires some hand editing of the configuration files. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Jaime Ventura Sent: Wednesday, December 13, 2006 7:22 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] about the 1.40 version release Hello, I've read a few messages ago that the new stable version of bacula would be released 'till the end of 2006. Does this sting stand? On The Current State of Bacula -- 1.39.29 (01 December 2006) its says Configurable TLS (SSL) communications encryption http://www.bacula.org/dev-manual/Bacula_TLS_Communication.html#CommEncrypti on between each component Does the w32 client supports such feature or just the *nix? Thanks. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] FD service repeatedly crashing on Windows Server 2003
Short Answer: Don't do that. Long Answer: Bacula-fd is an interactive service (it interacts with the desktop user) it must be run using the System account. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michal Winsor Sent: Tuesday, December 12, 2006 7:48 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] FD service repeatedly crashing on Windows Server 2003 Hello, I have a multi machine Bacula setup. The Director and Storage Daemons are running on Linux. Two File Daemons are running on Windows Server 2003 SP1. The file daemon services on WS2K3 seem to crash on a regular basis. I setup service recovery (restart) after 15 minutes, but the end result is that the service is not running and backups are failing. The file daemon services are running under a special sys_backup user identity which is a member of the Backup Operators group and has read permissions to the folders to be backed up. Has anyone seen this? Thanks for your help in advance. - Michal -- Michal J. Winsor, ISP Information Technology Analyst Open Systems Canada Limited 1627 Broad Street Regina, SK S4P1X3 Tel.: 306.359.6725 http://www.oscl.ca - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Off-topic: FAT32 disaster recovery
Yep Microsoft is so obviously at fault here. First of all they designed FAT in the late 70s. Shame on them for using a filesystem design similar to all the other systems at the time. Then to top it off they have the audacity to try and repair it when the user boots the system with a drive attached which is corrupted. UNIX is such a better system. Let's see what does it do in a similar situation? Well fsck notices the drive needs repair, finds all these file fragments that are listed as allocated but not attached to any directory. Gee it makes up names for them and puts them in the lost+found directory. Gee seems like exactly the same thing to me. The only real lessons to be learned here is. If your drive has a problem don't continue to use it without fixing the problem. Don't use an OS that caches data on removable drives (Windows doesn't MAC OS apparently does). Don't use an OS that mounts a drive that hasn't been closed properly (another MAC deficiency versus Windows). Finally don't give your drive to someone that doesn't know what they're talking about to have it fixed. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Alan Brown Sent: Friday, December 08, 2006 6:16 AM To: Georg Altmann Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Off-topic: FAT32 disaster recovery On Fri, 8 Dec 2006, Georg Altmann wrote: Unfortunately nice people from Redmond can get in your way here. understatement I attached the FireWire disk to my desktop, booted Windows XP Now you know why you should NEVER use MS products and operating systems to recover corrupted MS filesystems. My personal judgment is, that files already got corrupted by Mac OS X writing to the damaged filesystem and thereby overwriting blocks (clusters? chains? whatever) it mistakenly deemed free, but in reality belonged to already existing files. Yup. Same problem as happens when Messy-Dog (MS DOS) does it. Anyway, this teaches us once more, that you should a) make regular backups (doh!) b) not rely on external hard disks for this c) not at all use crappy filesystems such as FAT32 FAT is fine for floppies and that's where it should have stayed. AB - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring from a BSR...Misunderstanding?
I'm not sure if this affects your choices but Kern has checked in a fix to 1.40 that solves this problem. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Benjamin Chambers Sent: Friday, December 08, 2006 7:06 AM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Restoring from a BSR...Misunderstanding? Hi Kern, On thing that you might try is to add the Volume name(s) to the catalog by doing an add command before running the restore. This can't be done because there are no pools defined in an empty database and the pool is not included in the BSR: bcsonole start *add volume You probably don't want to be using this command since it creates database records without labeling the Volumes. You probably want to use the label command. Using default Catalog name=MyCatalog DB=bacula No pools defined. Use the create command to create one. bcsonole end At this point, I'll either have to rewrite our code/documentation to use bextract or maintain a patch for 1.38.x to behaive as 1.36.x did (at this point, I don't know what that patch might entail, but it should be fairly simple to diff between the two releases). What would you suggest? I know I've caught you at a bad time because of the imminent release of 1.40 - would you be able to advise on a patch which removes the SD statistic write to the Catalog which may be the cause? Cheers, Ben Benjamin Chambers, P.Eng. ClarkConnect Account Manager Point Clark Networks 1179 King Street West, Suite 211 Toronto, ON Canada, M6K 3C5 Tel: +1.416.977.0574 Ext. 111 Fax: +1.416.946.1192 Email: [EMAIL PROTECTED] Kern Sibbald wrote: On Thursday 07 December 2006 22:11, Benjamin Chambers wrote: Bacula version 1.38.9/1.38.11 with MySQL I would very much appreciate it if anyone could clarify an issue that has come up while attempting to restore from a bootstrap file. The question is actually fundamentally quite simple...Can a BSR file be used to perform a restore if you have the boostrap file and backup data...but have lost the Catalog? The situation being, of course, failure of the server itself, where Bacula runs. I have gone under the assumption for the last year or so that this was possible, but with current testing over the last week, I'm starting to think this it is not. In principle it was supposed to work without needing the catalog. It looks like at some point I wasn't thinking through all the consequences and added code to ensure that the SD updated the catalog with the read statistics, so I imagine that is what is going on. On thing that you might try is to add the Volume name(s) to the catalog by doing an add command before running the restore. The correct solution is for the SD during a restore to attempt to read the Volume data from the catalog, but instead of failing when the data is not there, it should complain and continue. The test is to save to a mounted file (Windows share) system. I had read in prior posts where the MediaType must be unique or you get into some problems. I have ensured to do this. Here's a short summary of test results: TEST 1 == 1. Perform a backup of the server 2. Perform a 'run job=Restore' using 'mod' to specify the BSR file created automatically in step 1. Result: Restore OK (the catalog still existed) TEST 2 == 1. Perform a backup of the server 2. Run /drop_mysql_database, create_mysql_database, make_mysql_tables scripts to simulate the loss of the server (Catalog). 3. Perform a 'run job=Restore' using 'mod' to specify the BSR file created automatically in step 1. Result: Restore FAILS I have provided some debug below. It looks as though the restore first tries to match the VolumeName picked up from the BSR against the Catalog. Containing no data (because the database was re-initialized between backup/restore), this operation, of course, fails. At this point, I'm not certain what happens...if a BSR restore with no Catalog is possible, one would think that the SD would see if it could find the Volume specified in the BSR. I *think* this is happening, but somewhere along the line, the VolumeName becomes nil. I know I can use bextract to do a successful restore in this case...but it's not as convenient and it would be good to clear up the capabilities anyways, because the section on Disaster Recovery doesn't (IMO) definitively say what I'm trying to do is possible. Thanks in advance to anyone who has time and knowledge to shed some light. Cheers, Ben **Job Report** 07-Dec 15:58 Server-sd: Restore.2006-12-07_15.58.46 Warning: acquire.c:82 Error getting Volume info: 1997 Volume 2006-12-07-0 not in catalog. 07-Dec 15:58 Server-sd: Restore.2006-12-07_15.58.46 Fatal error: acquire.c:109 Read open device _BensLaptop (/var/bacula/mnt/file/_BensLaptop) Volume failed: ERR=Could not
[Bacula-users] What a difference a database makes
I've been working on the regression tests for the imminent release of 1.40. Initially I was using SQLite3 since it has zero maintenance and zero setup and the tests aren't all that strenuous (at least as far as the database is concerned). However, I found a stress run was taking 12 hours on a dual proc machine with 2 GB of memory. That seemed rather outrageous so I tried with MySQL and it dropped to an hour and a half. Is SQLite3 really this bad? I can't imagine so or it wouldn't survive. In that case, there must be something that we are doing or not doing in Bacula or some problem in our build options that is killing the performance. Is anyone out there using SQLite3? Does anyone have any suggestions on how we could change the default build defines or database creation scripts to improve the performance? If there are any suggestions I'd appreciate getting them quickly so that we can incorporate them into 1.40. Thanks, - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] What a difference a database makes
No I haven't incorporated the gigaslam test yet. This is just the standard non-root file tests. I'll take a look at those two pragmas and see if that helps. More than 10 times slower is what I'm seeing. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Friday, December 08, 2006 8:43 AM To: bacula-users@lists.sourceforge.net Cc: Robert Nelson; 'bacula-devel' Subject: Re: [Bacula-devel] [Bacula-users] What a difference a database makes On Friday 08 December 2006 16:21, Robert Nelson wrote: I've been working on the regression tests for the imminent release of 1.40. Initially I was using SQLite3 since it has zero maintenance and zero setup and the tests aren't all that strenuous (at least as far as the database is concerned). However, I found a stress run was taking 12 hours on a dual proc machine with 2 GB of memory. That seemed rather outrageous so I tried with MySQL and it dropped to an hour and a half. Is that the gigaslam test? Is SQLite3 really this bad? I can't imagine so or it wouldn't survive. In that case, there must be something that we are doing or not doing in Bacula or some problem in our build options that is killing the performance. Well, in some really rough measurements that I did, SQLite version 2 was roughly the same speed as MySQL for the regression scripts. There have been some reports that SQLite might suffer with really big databases compared to MySQL. My equally rough tests with SQLite3 showed it was 4-10 (possibly more) times slower than SQLite version 2. I've never taken the time to try to find out why, so I have never mentioned it to the author. For that reason, I always use SQLite version 2 for my zero maintenance tests -- I also run the regression scripts prior to major releases on MySQL and PostgreSQL, and my production database is MySQL. Is anyone out there using SQLite3? Does anyone have any suggestions on how we could change the default build defines or database creation scripts to improve the performance? If there are any suggestions I'd appreciate getting them quickly so that we can incorporate them into 1.40. When SQLite3 was first released, I looked into this and seems to me that he handled synchronization differently. The two pragmas that I saw (long ago) that made a difference were: PRAGMA default_synchronous PRAGMA default_cache_size - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-devel mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/bacula-devel - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Off-topic: FAT32 disaster recovery
First off you're one of the ones that started this war with your anti-Microsoft comments. Second Minix isn't a file system it is a UNIX clone, which Microsoft never sold. They did however sell Xenix at one time, which they ended up licensing to SCO. As far as the rest of your post, I'm not sure what your point is. What hardware vendors decide to do or require for their support has nothing to do with what Microsoft does, which is what Georg was claiming. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Alan Brown Sent: Friday, December 08, 2006 8:30 AM To: Robert Nelson Cc: 'Georg Altmann'; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Off-topic: FAT32 disaster recovery On Fri, 8 Dec 2006, Robert Nelson wrote: Yet more disinformation, Microsoft hasn't released a desktop OS in more than 7 years that required FAT or even selected it as the default on new installations. FAT32 is STILL the standard shipped filesystem on most laptops, prebuilt desktops and external hard drives (and FAT16 is the standard on sub-2GB flash filesystems). Most users don't know enough to switch them to HFS+ or NTFS. I can't see that changing anytime soon. Some makers (including Toshiba and Acer) consider converting a filesystem from FAT32 to NTFS to be a warranty-busting move, so even if a user knows enough to make the change it may backfire on them. Finally: Microsoft didn't invent FAT12. This is what has prevented them asserting patent claims on the derivative filesystems FAT16 and FAT32 and even in the early days of consumer hard drives there were better filesystems available such as Minix (Which Microsoft itself sold at one point) In the case under consideration, the disk itself is fine, but the filesystem is badly corrupted due to user error. It may be possible to recover most files, but odds are high many older ones will have chunks overwritten due to the damaged index structure. Please take the flamewar somewhere else. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Off-topic: FAT32 disaster recovery
Yet more disinformation, Microsoft hasn't released a desktop OS in more than 7 years that required FAT or even selected it as the default on new installations. Yes all Microsoft Operating Systems still support FAT as do all other Operating Systems. Otherwise it would be very hard to get your photos off the compact flash cards, etc. As for your proverbial casual user, let's use a car as an example. Someone is driving down the street and the engine starts making a funny noise. Does he take it to a mechanic; no he continues to drive it. Now the warning lights are starting to come on in the dash, is it time to seek help? Nope he keeps driving. Finally the car stops running, must be that d*mn Ford engine. Finally, regarding my other comment to which you seemed to have taken offense, continuing with the car analogy, does the user seek the advice of the mechanic? Nope he goes and asks his friend, who also drives a car, if he can fix it. By your own admission you've said you don't understand the internals of filesystems, you don't know what chkdsk does, and you don't know about the various tools available for fixing corrupted drives. Therefore, offended or not, I stand by my original comment. If you have a problem take it to someone that knows what they're doing. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Georg Altmann Sent: Friday, December 08, 2006 7:40 AM To: bacula-users@lists.sourceforge.net Cc: Robert Nelson Subject: Re: [Bacula-users] Off-topic: FAT32 disaster recovery --On Freitag, 8. Dezember 2006 06:50 -0800 Robert Nelson [EMAIL PROTECTED] wrote: Yep Microsoft is so obviously at fault here. First of all they designed FAT in the late 70s. Shame on them for using a filesystem design similar to all the other systems at the time. Then to top it off they have the audacity to try and repair it when the user boots the system with a drive attached which is corrupted. UNIX is such a better system. Let's see what does it do in a similar situation? Well fsck notices the drive needs repair, finds all these file fragments that are listed as allocated but not attached to any directory. Gee it makes up names for them and puts them in the lost+found directory. Gee seems like exactly the same thing to me. Ok, this wasn't about starting a flame-war on Windows vs. Mac/UNIX/whatever, FAT vs. ext2/ufs/whatever, pointing fingers or anything. So please calm down. Anyway, linux/freebsd doesn't mount a filesystem until you explicitly tell it to do so and it only runs fsck on filesystems in /etc/fstab. FreeBSD even stops the fsck run if it finds something serious and waits for manual intervention. Mordern filesystems (ntfs, ufs, ext2fs,...) are much more stable. And many of them have been available at the beginning of the nineties. MS in contrast happily continued to use FAT in all its OSes despite of its known problems. And now you still find disks in the range of multiple hundert GBs using a filesystem which wasn't designed for disks of this size. Problem is you almost have no choice, because it is in fact the only fs that is support on all platforms. Linux is coming up with some experimental NTFS support, though I wouldn't want to use that for critical data yet... The only real lessons to be learned here is. If your drive has a problem don't continue to use it without fixing the problem. Explain that to the casual computer user... Don't use an OS that caches data on removable drives (Windows doesn't MAC OS apparently does). Don't use an OS that mounts a drive that hasn't been closed properly (another MAC deficiency versus Windows). Finally don't give your drive to someone that doesn't know what they're talking about to have it fixed. Finally please stop making personal offenses. Thank you. Regards, Georg - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows backup to network speed issues
I get similar times between all the combinations I test, Windows - Linux, Linux - Windows, Linux - Linux and Windows - Windows. However it did take some tweaking. The first thing to check is to see if you are getting a lot of TCP/IP errors. This could indicate one of adapters isn't running full duplex or there is some other configuration problem. The other thing is the various TCP/IP tuning parameters such as Window Size, etc. Another thing that can make a huge difference, if you are running a gigabit network, is use large packets. Then there are all the apples and oranges issues. Are the machines being tested all on the same network segment, do they have equivalent hardware (disk speed can make a huge difference), etc. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of DAve Sent: Friday, December 08, 2006 9:20 AM To: bacula-users Subject: Re: [Bacula-users] Windows backup to network speed issues Brian Jones wrote: I have a question on the speed of backing up Windows 2003/2000/XP boxes to disk across the network. For 2 windows boxes, here is the rates I am getting though it is the same for all the windows boxes: Rate: 432.1 KB/s Rate: 528.4 KB/s For the Linux boxes, here are 2 rates I am getting but again, it is the same across all the Linux boxes: Rate: 9556.8 KB/s Rate: 8616.3 KB/s I did a test on one of the 2003 server boxes backing up one file that was about 13 gig in size. The speed was as shown above for Windows boxes. Using winSCP to copy that same file to the same box running Bacula, I have a rate of 4000 KB/s. Is the windows Bacula client slow? Are others seeing better speeds? I am fairly new to Bacula so any help would be appreciated. Anyone please correct me if I am wrong, no egos in play here ;^) I see speed differences as well. There are several things that explain most of my differences. The load on the server that is running the client can have a big effect. I have one very busy web server that backs up considerably slower than my FTP server. I noticed as well that full backups of a not in use file system go much faster than a differential of a heavily used filesystem. Not Bacula faults, just the situation. I have tried to move my backup schedules to run when there is the least number of processes to interfer with the Bacula client. Also, keep in mind, the transfer rate is not just the network speed attained, but the rate at which the data is transfered via Bacula which includes verification, compression, disk reading on the client box, and disk writing on the storage box. In my testing a straight data transfer such as ftp always outruns Bacula, so comparisons are not valid. DAve -- Three years now I've asked Google why they don't have a logo change for Memorial Day. Why do they choose to do logos for other non-international holidays, but nothing for Veterans? Maybe they forgot who made that choice possible. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows backup to network speed issues
One other thing, as I was reminded earlier this week by a problem Arno was having, whenever something weird is going on with your Window machine, try disabling the anti-virus. The same goes with any firewall software. It goes without saying (but I'm going to say it anyways :-), only do this with a machine that is not on the internet and re-enable them immediately after the test. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Brian Jones Sent: Friday, December 08, 2006 8:50 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Windows backup to network speed issues I have a question on the speed of backing up Windows 2003/2000/XP boxes to disk across the network. For 2 windows boxes, here is the rates I am getting though it is the same for all the windows boxes: Rate: 432.1 KB/s Rate: 528.4 KB/s For the Linux boxes, here are 2 rates I am getting but again, it is the same across all the Linux boxes: Rate: 9556.8 KB/s Rate: 8616.3 KB/s I did a test on one of the 2003 server boxes backing up one file that was about 13 gig in size. The speed was as shown above for Windows boxes. Using winSCP to copy that same file to the same box running Bacula, I have a rate of 4000 KB/s. Is the windows Bacula client slow? Are others seeing better speeds? I am fairly new to Bacula so any help would be appreciated. Thanks, Brian - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] checksums
You could always do the checksum and copy before the backup. Just dump the files to a different directory. Then copy the files that have changed to the directory that gets backed up. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michael Koppelman Sent: Wednesday, November 29, 2006 8:03 AM To: Dan Langille Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] checksums For us it's a problem because we are dumping out some very large databases, some of which change daily but many which do not. We'd like to dump the files out every night and just have bacula back up the changed files. The unchanged files were recreated but are still identical to previous versions. We wouldn't care if they were restored with the wrong mtime. In fact, I've never run into a situation where I was concerned about the mtime of the restored files. M. On Nov 28, 2006, at 8:12 PM, Dan Langille wrote: On 28 Nov 2006 at 17:26, Michael Koppelman wrote: Sorry if this is redundant but I just wanted to add my voice to the mix that it is too bad that bacula backs up files that have not changed just because their mtime changed. I have never seen it as a problem. In the end, it is probably less expensive to checksum than move and handle redundant data. It would at least be nice if one could choose the scheme in the configuration so people who need to conserve computation time and people who need to converse bandwidth could choose accordingly. Any restore would give you the wrong mtime. Unless you started getting fancy within the Bacula Catalogs. -- Dan Langille : Software Developer looking for work my resume: http://www.freebsddiary.org/dan_langille.php PGCon - The PostgreSQL Conference - http://www.pgcon.org/ - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Job fails if data size reaches more than 2,5GB
This is a result of using a signed 32 bit integer (off_t) in the Bacula code. I've rewritten the code to define a new type boffset_t which is defined as a signed 64 bit integer on Windows. If you would like to test the change and can receive large email messages ( 15 MB) let me know and I'll mail an updated installer to you. The other alternative is to limit your volume size to less than 2 GB. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Arno Lehmann Sent: Friday, November 17, 2006 3:49 PM To: bacula-users@lists.sourceforge.net Cc: bacula-devel Subject: Re: [Bacula-users] Job fails if data size reaches more than 2,5GB Hi, On 11/16/2006 7:30 PM, Vitaliy Matuschenko wrote: Hi all. I'm trying to make a big backup (almost 4 gigs in less than 100 files) over the Internet. Both storage and file daemons are running on windows 2003 servers, director is running on Fedora Core 4. ( You surely noticed that Bacula-sd under windows is a beta version and not considered ready for production use? bacula-beta-1.39.28; MySQL - 4.1.11) For that reason I'd recommend to report this in the bacula-devel list. It's much more likely to find attention from the developer there. I'm cc'ing there... The job starts well, but when the size of transmitted data from fd to sd reach i say more than 2,5G job cancels with following error: Start running the SD and FD with debug output. At least under linux/unix this is what I'd suggest... 16-Nov 13:54 fc3-ua-dir: Start Backup JobId 24, Job= win1.2006-11-16_13.54.40 16-Nov 13:54 fc3-ua-dir: Recycled volume w1_us_full_0002 16-Nov 16:57 w2-us-sd: Labeled new Volume w1_us_full_0002 on device w2_us (c:\backup). 16-Nov 16:57 w2-us-sd: Wrote label to prelabeled Volume w1_us_full_0002 on device w2_us (c:\backup) Everything seems ok until... 16-Nov 18:44 w1-us-fd: win1.2006-11-16_13.54.40 Fatal error: ../../filed/backup.c:845 Network send error to SD. ERR=Input/output error 16-Nov 18:44 w1-us-fd: win1.2006-11-16_13.54.40 Error: ../../lib/bnet.c:393 Write error sending len to Storage daemon:xxx.xxx.xxx.xxx:9103: ERR=Input/output error 16-Nov 17:43 fc3-ua-dir: win1.2006-11-16_13.54.40 Fatal error: Network error with FD during Backup: ERR=Connection reset by peer 16-Nov 17:43 fc3-ua-dir: win1.2006-11-16_13.54.40 Fatal error: No Job status returned from FD. 16-Nov 17:43 fc3-ua-dir: win1.2006-11-16_13.54.40 Error: Bacula 1.39.24 (02Oct06): 16-Nov-2006 17:43:03 JobId: 24 Job:win1.2006-11-16_13.54.40 Backup Level: Full Client: w1-us-fd Linux,Cross-compile,Win32 FileSet:w1_us_set 2006-10-12 15:05:53 Pool: w2_us_pool (From Job resource) Storage:w2-us-sd (From Job resource) Scheduled time: 16-Nov-2006 13:54:39 Start time: 16-Nov-2006 13:54:57 End time: 16-Nov-2006 17:43:03 Elapsed time: 3 hours 48 mins 6 secs Priority: 10 FD Files Written: 0 SD Files Written: 0 FD Bytes Written: 0 (0 B) SD Bytes Written: 0 (0 B) Rate: 0.0 KB/s Software Compression: None Volume name(s): w1_us_full_0002 Volume Session Id: 2 Volume Session Time:1163688842 Last Volume Bytes: 2,999,808,064 (2.999 GB) Non-fatal FD errors:0 SD Errors: 0 FD termination status: Error SD termination status: Error Termination:*** Backup Error *** In this case total amount of transmitted data was 3,561G but none was written and this is regular error unfortunately. I've encountered this stuff while using both 1.39.24 and 1.39.26 versions. There's no pattern for backup size or total amount of files, because every times it comes down with different size. Theres enough space on SD server, and there are no limitations on maximum file size. Both servers are placed at same ISP but on different colo. Small backups, 1Gb 'r done perfect. Can anyone help me with this stuff? - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de
Re: [Bacula-users] Bacula compatible with Sony SDX-520C AIT2?
Yes Bacula works great with all the AIT drives. I have tested it with AIT1, AIT2, and AIT3 based changers. From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Alan To Sent: Tuesday, November 14, 2006 8:10 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Bacula compatible with Sony SDX-520C AIT2? Hi All Just a quickie concerning my Bacula mishaps: Is Bacula compatible with my Sony SDX-520C AIT2 Tape Drive? I'm running Bacula 1.36 that comes with ClarkConnect Office Edition 3.2r1, Kernal Version 2.6.9-28.ccsmp (SMP). (Server-dir Version: 1.36.2 (28 February 2005) i686-redhat-linux-gnu redhat.) I'm relunctant to upgrade Bacula to the latest (Beta) version, as my current version of Bacula was installed with the ClarkConnect kernal/front-end; and I don't know how to install/upgrade properly anyway. Many Thanks Alan To Bernhard and Company Ltd Bilton Road * Rugby * England * CV22 7DT ( +44 1788 811600 * Fax +44 1788 812640 ( Toll Free (USA) 1-888 GRIND IT Website: http://www.bernhard.co.uk - SF.net email is sponsored by: A Better Job is Waiting for You - Find it Now. Check out Slashdot's new job board. Browse through tons of technical jobs posted by companies looking to hire people just like you. http://jobs.slashdot.org/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula compatible with Sony SDX-520C AIT2?
What is the problem? From: Alan To [mailto:[EMAIL PROTECTED] Sent: Tuesday, November 14, 2006 9:14 AM To: Robert Nelson; bacula-users@lists.sourceforge.net Subject: RE: [Bacula-users] Bacula compatible with Sony SDX-520C AIT2? That's good to know. In that case, is there anything wrong with my following Bacula configurations? (Only listed relevant bits from configs.) - bacula-sd.conf Director { Name = Server-dir Password = } Device { Name = SonyAIT MediaType = DDS ArchiveDevice = /dev/nst0 LabelMedia = yes RandomAccess = no AutomaticMount = yes RemovableMedia = yes AlwaysOpen = yes MaximumVolumeSize = 130GB } - bacula-dir.conf Storage { Name = SonyAIT Address = localhost SDport = 9103 Password = Device = SonyAIT MediaType = DDS } Job { Name = 2006_BCo_Scheduled_Backup Type = Backup Level = Full Client = Server-fd FileSet = BCo_All_Files Storage = USB2 Messages = Standard Pool = Default Priority = 10 Schedule = 2006BCoCycle RunBeforeJob = /usr/bacula/backup_script-Catalog.sh RunAfterJob = rm -f /var/bacula/BCo_Scheduled_Backup.sql } Schedule { Name = 2006BCoCycle Run = Level=Full Storage=USB2 FullPool=FullPool mon at 21:30 Run = Level=Differential Storage=SonyAIT DifferentialPool=DiffPool tue-fri at 21:30 } -- Regards Alan To BCo From: Robert Nelson [mailto:[EMAIL PROTECTED] Sent: 14 November 2006 16:44 To: 'Alan To'; Subject: RE: [Bacula-users] Bacula compatible with Sony SDX-520C AIT2? Yes Bacula works great with all the AIT drives. I have tested it with AIT1, AIT2, and AIT3 based changers. From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Alan To Sent: Tuesday, November 14, 2006 8:10 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Bacula compatible with Sony SDX-520C AIT2? Hi All Just a quickie concerning my Bacula mishaps: Is Bacula compatible with my Sony SDX-520C AIT2 Tape Drive? I'm running Bacula 1.36 that comes with ClarkConnect Office Edition 3.2r1, Kernal Version 2.6.9-28.ccsmp (SMP). (Server-dir Version: 1.36.2 (28 February 2005) i686-redhat-linux-gnu redhat.) I'm relunctant to upgrade Bacula to the latest (Beta) version, as my current version of Bacula was installed with the ClarkConnect kernal/front-end; and I don't know how to install/upgrade properly anyway. Many Thanks Alan To Bernhard and Company Ltd Bilton Road * Rugby * England * CV22 7DT ( +44 1788 811600 * Fax +44 1788 812640 ( Toll Free (USA) 1-888 GRIND IT Website: http://www.bernhard.co.uk - SF.net email is sponsored by: A Better Job is Waiting for You - Find it Now. Check out Slashdot's new job board. Browse through tons of technical jobs posted by companies looking to hire people just like you. http://jobs.slashdot.org/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula compatible with Sony SDX-520C AIT2?
You need to use the tape device /dev/nstX not the generic scsi device /dev/sgX for tape software like tar, Bacula, btape, etc. If /dev/nst0 isnt the right device then try /dev/nst1, etc. Anyways this is an OS problem not a Bacula problem. From: Alan To [mailto:[EMAIL PROTECTED] Sent: Tuesday, November 14, 2006 9:29 AM To: Robert Nelson; bacula-users@lists.sourceforge.net Subject: RE: [Bacula-users] Bacula compatible with Sony SDX-520C AIT2? This was the problem... ...tar, bacula and btape all don't like /dev/sg2! Anyway, while the Sony TapeTool happily checks/tests and read/write tapes, using tar/bacula/bconsole etc. still give me the error (this is via bconsole's label command): Connecting to Storage daemon SonyAIT at localhost:9103 ... Sending label command for Volume Tue-A Slot 0 ... block.c:782 Read error at file:blk 0:0 on device /dev/nst0. ERR=Invalid argument. block.c:552 Write error at 0:0 on device /dev/nst0. ERR=Invalid argument. askdir.c:219 NULL Volume name. This shouldn't happen!!! 3912 Failed to label Volume: ERR=block.c:782 Read error at file:blk 0:0 on device /dev/nst0. ERR=Invalid argument. Label command failed for Volume Tue-A. Do not forget to mount the drive!!! Does this suggesta hardware fault, a linux kernal fault (somewhere) and/or a Bacula fault? Remember I have also been using other brand new (unopened) AIT-2 Tapes as well as the cleaning tape quite a few times too. -- Many Thanks Alan To BCo From: Robert Nelson [mailto:[EMAIL PROTECTED] Sent: 14 November 2006 17:18 To: 'Alan To';bacula-users@lists.sourceforge.net Subject: RE: [Bacula-users] Bacula compatible with Sony SDX-520C AIT2? What is the problem? From: Alan To [mailto:[EMAIL PROTECTED] Sent: Tuesday, November 14, 2006 9:14 AM To: Robert Nelson; bacula-users@lists.sourceforge.net Subject: RE: [Bacula-users] Bacula compatible with Sony SDX-520C AIT2? That's good to know. In that case, is there anything wrong with my following Bacula configurations? (Only listed relevant bits from configs.) - bacula-sd.conf Director { Name = Server-dir Password = } Device { Name = SonyAIT MediaType = DDS ArchiveDevice = /dev/nst0 LabelMedia = yes RandomAccess = no AutomaticMount = yes RemovableMedia = yes AlwaysOpen = yes MaximumVolumeSize = 130GB } - bacula-dir.conf Storage { Name = SonyAIT Address = localhost SDport = 9103 Password = Device = SonyAIT MediaType = DDS } Job { Name = 2006_BCo_Scheduled_Backup Type = Backup Level = Full Client = Server-fd FileSet = BCo_All_Files Storage = USB2 Messages = Standard Pool = Default Priority = 10 Schedule = 2006BCoCycle RunBeforeJob = /usr/bacula/backup_script-Catalog.sh RunAfterJob = rm -f /var/bacula/BCo_Scheduled_Backup.sql } Schedule { Name = 2006BCoCycle Run = Level=Full Storage=USB2 FullPool=FullPool mon at 21:30 Run = Level=Differential Storage=SonyAIT DifferentialPool=DiffPool tue-fri at 21:30 } -- Regards Alan To BCo From: Robert Nelson [mailto:[EMAIL PROTECTED] Sent: 14 November 2006 16:44 To: 'Alan To'; Subject: RE: [Bacula-users] Bacula compatible with Sony SDX-520C AIT2? Yes Bacula works great with all the AIT drives. I have tested it with AIT1, AIT2, and AIT3 based changers. From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Alan To Sent: Tuesday, November 14, 2006 8:10 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Bacula compatible with Sony SDX-520C AIT2? Hi All Just a quickie concerning my Bacula mishaps: Is Bacula compatible with my Sony SDX-520C AIT2 Tape Drive? I'm running Bacula 1.36 that comes with ClarkConnect Office Edition 3.2r1, Kernal Version 2.6.9-28.ccsmp (SMP). (Server-dir Version: 1.36.2 (28 February 2005) i686-redhat-linux-gnu redhat.) I'm relunctant to upgrade Bacula to the latest (Beta) version, as my current version of Bacula was installed with the ClarkConnect kernal/front-end; and I don't know how to install/upgrade properly anyway. Many Thanks Alan To Bernhard and Company Ltd Bilton Road * Rugby * England * CV22 7DT ( +44 1788 811600 * Fax +44 1788 812640 ( Toll Free (USA) 1-888 GRIND IT Website: http://www.bernhard.co.uk - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID
Re: [Bacula-users] Bacula under Windows 2003 64 bit.
Actually the Path name limit in version 1.39.x and above is 32767. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Thursday, November 09, 2006 11:18 AM To: bacula-users@lists.sourceforge.net Cc: Troy Daniels Subject: Re: [Bacula-users] Bacula under Windows 2003 64 bit. On Tuesday 17 October 2006 06:09, Troy Daniels wrote: Greetings, We are looking at introducing 6 new Windows 2003 Enterprise 64 Servers into our business in the not too distant future. As the rest of the servers (Mostly Redhat EL3 with a few FreeBSD boxes and a couple of 32 bit Windows servers) are backed up using Bacula we intend to use it on these new beasts as well. Has anyone had experience running Bacula under 64 bit windows? Are 64 bit binaries needed and/or available for Bacula? We'd only need to run File Daemons on the new boxes with backups getting done from our existing Director. We are currently running 1.38.5 but I'm planning on upgrading to 1.40 when it comes out (If I had more time, I'd be upgraded to the latest 1.39 Beta version already to help testing it) Also, if anyone has any information on known limits in the Windows Bacula client (Path lengths, etc) that would be good - one of the other staff here has vague recollections of a maximum path length of 164 characters for restores. In version 1.38.x the maximum Windows total path length is 260 characters. On version 1.39.x and above, it should be limited to something like 65K characters. Any and all information appreciated, Cheers, Troy Daniels Systems Administrator iTouch Australia (pty) ltd. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring archives on windows systems, compression+encryption
Generally, released versions have even numbers; odd numbers are built from the CVS. It looks like you built your own Linux version from CVS but not your Windows software. Since this fix was very recent there are no released versions available incorporating it. Kern will be releasing a new version in the next week or so. If you are unable to build it AND your email server allows large attachments ( 15MB) I can send you an Installer binary. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michael Brennen Sent: Wednesday, November 08, 2006 9:32 AM To: bacula-users@lists.sourceforge.net Cc: Robert Nelson Subject: Re: [Bacula-users] Restoring archives on windows systems,compression+encryption On Wednesday 08 November 2006 00:56, Michael Brennen wrote: On Tue, 7 Nov 2006, Robert Nelson wrote: You aren't going to have any luck with 1.39.26 on Windows since it doesn't have any of the fixes. Ah... somewhere I must have missed the .27 for Windows. I will install/test it, and thanks. Checking the SF site, 1.39.26 is the last release for Windows; that is running as the FD. I am running 1.39.27 on linux as the DIR/SD. Is there a missing Windows 1.39.27, or do I have the latest code in which compression+encryption should work? -- -- Michael - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Bacula BETA encryption bug
Just to be clear, the only backwards compatibility possible is for the encryption only case. From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Landon Fuller Sent: Wednesday, November 08, 2006 10:48 AM To: bacula-users@lists.sourceforge.net Cc: bacula-devel Subject: Re: [Bacula-devel] Bacula BETA encryption bug On Nov 8, 2006, at 06:54, Kern Sibbald wrote: If you have any problems with this procedure, now is the time to speak up. I'd just like to reiterate that if this is going to hose you, let us know -- I can implement backwards compatibility if necessary. -landonf - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup Method with Multiple Media Types - AIT2 Issue
Are these new tapes? I've seen weird problems like this with bulk-erased tapes. I fixed it by formatting them with Windows version Sony's TapeTool. I'm not sure which variant of Unix you are using but here is a link to the Linux one. http://sony.storagesupport.com/tapetool/linux.htm -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Alan To Sent: Wednesday, November 08, 2006 2:22 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Backup Method with Multiple Media Types - AIT2 Issue Hi All Many Thanks to everybody who helped out on the multiple media types and correctly scheduling the Full and Differential backups for me. The schedule and media switch works now, but... Something is wrong with my Sony AIT2 tape device (or tapes) itself - see log below. I've checked Google for ERR-Invalid argument, and have since used my Cleaning Tape a number of times on the drive and also tried a few new blank tapes on the device. This might not be directly a Bacula issue as I am getting the same errors with btape/test and tar commands. Here is my tar test commands and responses: [@ bacula]# mt -f /dev/nst0 rewind [@ bacula]# tar cvf /dev/nst0 . ./ ./mtx-changer ./grant_mysql_privileges ./grant_bacula_privileges ./bacula-sd.conf tar: /dev/nst0: Cannot write: Invalid argument tar: Error is not recoverable: exiting now [@ bacula]# mt -f /dev/nst0 rewind [@ bacula]# tar tvf /dev/nst0 tar: /dev/nst0: Cannot read: Invalid argument tar: At beginning of tape, quitting now tar: Error is not recoverable: exiting now [@ bacula]# mt -f /dev/nst0 rewind Here is my btape SonyAIT test results: *test ... 08-Nov 09:21 btape: btape Error: block.c:552 Write error at 0:0 on device /dev/nst0. ERR=Invalid argument. 08-Nov 09:21 btape: btape Error: Backspace record at EOT failed. ERR=Input/output error btape: btape.c:782 Error writing block to device. *quit Can anybody help me out on this please? Is my tape device itself faulty or not compatable? Or are there other configurations that I need to make first? -- Many Thanks Alan To 07-Nov 21:30 Server-dir: Start Backup JobId 26, Job=2006_BCo_Scheduled_Backup.2006-11-07_21.30.00 07-Nov 21:30 Server-dir: Created new Volume Daily-0001 in catalog. 07-Nov 21:30 Server-sd: 2006_BCo_Scheduled_Backup.2006-11-07_21.30.00 Error: block.c:782 Read error at file:blk 0:0 on device /dev/nst0. ERR=Invalid argument. 07-Nov 21:30 Server-sd: 2006_BCo_Scheduled_Backup.2006-11-07_21.30.00 Error: block.c:552 Write error at 0:0 on device /dev/nst0. ERR=Invalid argument. 07-Nov 21:30 Server-sd: 2006_BCo_Scheduled_Backup.2006-11-07_21.30.00 Fatal error: askdir.c:219 NULL Volume name. This shouldn't happen!!! 07-Nov 21:30 Server-sd: 2006_BCo_Scheduled_Backup.2006-11-07_21.30.00 Fatal error: Job 26 canceled. 07-Nov 21:30 Server-fd: 2006_BCo_Scheduled_Backup.2006-11-07_21.30.00 Fatal error: job.c:1665 Bad response to Append Data command. Wanted 3000 OK data , got 3903 Error append data 07-Nov 21:30 Server-dir: 2006_BCo_Scheduled_Backup.2006-11-07_21.30.00 Error: Bacula 1.36.2 (28Feb05): 07-Nov-2006 21:30:36 JobId: 26 Job: 2006_BCo_Scheduled_Backup.2006-11-07_21.30.00 Backup Level: Differential, since=2006-11-06 21:30:03 Client: Server-fd FileSet: BCo_All_Files 2006-10-30 22:34:19 Pool: DiffPool Storage: SonyAIT Start time: 07-Nov-2006 21:30:02 End time: 07-Nov-2006 21:30:36 FD Files Written: 0 SD Files Written: 0 FD Bytes Written: 0 SD Bytes Written: 0 Rate: 0.0 KB/s Software Compression: None Volume name(s): Volume Session Id: 2 Volume Session Time: 1162813870 Last Volume Bytes: 0 Non-fatal FD errors: 0 SD Errors: 0 FD termination status: Error SD termination status: Error Termination: *** Backup Error *** -Original Message- From: Alan To [mailto:[EMAIL PROTECTED] Sent: 06 November 2006 11:37 To: 'bacula-users@lists.sourceforge.net' Subject: RE: [Bacula-users] Backup Method with Multiple Media Types - Resend Hi All Just updated the configuration and attempted to restart Bacula, got this error: bacula-dir: ERROR TERMINATION at run_conf.c:192 Config error: Expected an equals, got: mon : line 610, col 53 of file /etc/bacula/bacula-dir.conf Run = Level=Full Storage=USB2 Pool=FullPool mon at 22:30 My Schedule part of bacula.dir is: Schedule { Name = 2006BCoCycle Run = Level=Full Storage=USB2 Pool=FullPool mon at 22:30 Run = Level=Differential Storage=SonyAIT DifferentialPool=DiffPool tue-fri at 22:30 } ...just changed the offending line to say FullPool=FullPool instead of Pool=FullPool I'll check over the backups for the next few days and report-back if there are any more problems. -- Many Thanks Alan To - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
Re: [Bacula-users] Restoring archives on windows systems, compression+encryption
Can you try the restore with the PKI Signatures = Yes commented out? I had problems with signatures on my system, but it only showed up as Invalid Signatures rather than missing ones. There was a follow-up thread with Landon on Bacula-devel about the signatures but no resolution yet. I'll change the severity from M_FATAL to M_ERROR so that the restore continues. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michael Brennen Sent: Tuesday, November 07, 2006 1:53 PM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Restoring archives on windows systems,compression+encryption Last Sunday night I restarted my archive set with current CVS, as checked in by Robert with the compression+encryption fixes. I can archive and restore from a linux system successfully now; thanks much, Robert. :) Archiving windows systems is working with compression+encryption without error messages, similar FD key configurations to the linux systems, etc. but I cannot restore to the same windows system from which an archive was made. Given the problems with wx-console I am using bconsole for the restore. I go through the restore process, and the process errors out as below. Robert, others, any ideas? -- Michael --- 07-Nov 13:57 archive-dir: Start Restore Job Restore-Somehost.2006-11-07_13.56.58 07-Nov 13:57 archive-sd: Ready to read from volume FNI0001 on device Drive-0 (/dev/nst0). 07-Nov 13:57 archive-sd: Forward spacing to file:block 0:1. 07-Nov 14:11 archive-sd: End of file 4 on device Drive-0 (/dev/nst0), Volume FNI0001 07-Nov 14:12 somehost.com: Restore-Somehost.2006-11-07_13.56.58 Fatal error: ../../filed/restore.c:876 Decryption error for /backup/bacula/bacula-restores/C/bin/more 07-Nov 14:12 foghorn.fni.com: Restore-Somehost.2006-11-07_13.56.58 Error: ../../filed/restore.c:580 Missing cryptographic signature for /backup/bacula/bacula-restores/C/bin/newmysql 07-Nov 14:12 archive-sd: Restore-Somehost.2006-11-07_13.56.58 Fatal error: read.c:126 Error sending to File daemon. ERR=Connection reset by peer 07-Nov 14:12 archive-sd: Restore-Somehost.2006-11-07_13.56.58 Error: bnet.c:426 Write error sending 19808 bytes to client:123.123.123.123:36643: ERR=Connection reset by peer 07-Nov 14:12 archive-dir: Restore-Somehost.2006-11-07_13.56.58 Error: Bacula 1.39.27 (24Oct06): 07-Nov-2006 14:12:14 JobId: 44 Job:Restore-Somehost.2006-11-07_13.56.58 Client: somehost.com Start time: 07-Nov-2006 13:57:00 End time: 07-Nov-2006 14:12:14 Files Expected: 87 Files Restored: 26 Bytes Restored: 0 Rate: 0.0 KB/s FD Errors: 1 FD termination status: Error SD termination status: Error Termination:*** Restore Error *** --- - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring archives on windows systems, compression+encryption
You aren't going to have any luck with 1.39.26 on Windows since it doesn't have any of the fixes. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michael Brennen Sent: Tuesday, November 07, 2006 10:12 PM To: Robert Nelson Cc: bacula-users@lists.sourceforge.net Subject: RE: [Bacula-users] Restoring archives on windows systems,compression+encryption On Tue, 7 Nov 2006, Robert Nelson wrote: Can you try the restore with the PKI Signatures = Yes commented out? I had problems with signatures on my system, but it only showed up as Invalid Signatures rather than missing ones. There was a follow-up thread with Landon on Bacula-devel about the signatures but no resolution yet. See below. I'll change the severity from M_FATAL to M_ERROR so that the restore continues. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michael Brennen Sent: Tuesday, November 07, 2006 1:53 PM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Restoring archives on windows systems,compression+encryption Last Sunday night I restarted my archive set with current CVS, as checked in by Robert with the compression+encryption fixes. I can archive and restore from a linux system successfully now; thanks much, Robert. :) Archiving windows systems is working with compression+encryption without error messages, similar FD key configurations to the linux systems, etc. but I cannot restore to the same windows system from which an archive was made. Given the problems with wx-console I am using bconsole for the restore. I go through the restore process, and the process errors out as below. Robert, others, any ideas? -- Michael --- 07-Nov 13:57 archive-dir: Start Restore Job Restore-Somehost.2006-11-07_13.56.58 07-Nov 13:57 archive-sd: Ready to read from volume FNI0001 on device Drive-0 (/dev/nst0). 07-Nov 13:57 archive-sd: Forward spacing to file:block 0:1. 07-Nov 14:11 archive-sd: End of file 4 on device Drive-0 (/dev/nst0), Volume FNI0001 07-Nov 14:12 somehost.com: Restore-Somehost.2006-11-07_13.56.58 Fatal error: ../../filed/restore.c:876 Decryption error for /backup/bacula/bacula-restores/C/bin/more 07-Nov 14:12 foghorn.fni.com: Restore-Somehost.2006-11-07_13.56.58 Error: ../../filed/restore.c:580 Missing cryptographic signature for /backup/bacula/bacula-restores/C/bin/newmysql 07-Nov 14:12 archive-sd: Restore-Somehost.2006-11-07_13.56.58 Fatal error: read.c:126 Error sending to File daemon. ERR=Connection reset by peer 07-Nov 14:12 archive-sd: Restore-Somehost.2006-11-07_13.56.58 Error: bnet.c:426 Write error sending 19808 bytes to client:123.123.123.123:36643: ERR=Connection reset by peer 07-Nov 14:12 archive-dir: Restore-Somehost.2006-11-07_13.56.58 Error: Bacula 1.39.27 (24Oct06): 07-Nov-2006 14:12:14 JobId: 44 Job:Restore-Somehost.2006-11-07_13.56.58 Client: somehost.com Start time: 07-Nov-2006 13:57:00 End time: 07-Nov-2006 14:12:14 Files Expected: 87 Files Restored: 26 Bytes Restored: 0 Rate: 0.0 KB/s FD Errors: 1 FD termination status: Error SD termination status: Error Termination:*** Restore Error *** --- 07-Nov 23:48 somehost.com: Restore-Somehost.2006-11-07_23.31.17 Error: Uncompression error on file /backup/bacula/bacula-restores/C/bin/file1. ERR=Zlib data error 07-Nov 23:48 somehost.com: Restore-Somehost.2006-11-07_23.31.17 Error: Uncompression error on file /backup/bacula/bacula-restores/C/bin/file3. ERR=Zlib data error 07-Nov 23:48 somehost.com: Restore-Somehost.2006-11-07_23.31.17 Error: Uncompression error on file /backup/bacula/bacula-restores/C/bin/file3. ERR=Zlib data error Now the zlib errors are back; I saw these a week or so ago. The only difference is that I commented the PKI signature line, touched the files in a directory, ran a fresh archive, and tried to restore from it. The Windows FD configuration is below; it is 1.3.26. -- Michael FileDaemon { Name = somehost.com FDport = 9102 WorkingDirectory = C:\\Documents and Settings\\All Users\\Application Data\\Bacula\\Work Pid Directory = C:\\Documents and Settings\\All Users\\Application Data\\Bacula\\Work Maximum Concurrent Jobs = 2 PKI Signatures = yes PKI Encryption = yes PKI Keypair = C:/Documents and Settings/All Users/Application Data/Bacula/fd_somehost.pem } - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as
Re: [Bacula-users] [Bacula-devel] info about CONFIG_FILE
I reserved comment on the substance of the patch until it was in a form that was easily reviewed. But now that you bring it up, :-) yes configure should not be modifying the source files directly that is exactly what config.h is for. However when you are adding a new feature, you don't want to break the existing behaviour if at all possible. I've already implemented part of this in version 1.39.27. But I made it look in the standard directory only if it didn't exist in the current directory. I didn't want to change configure at this late stage so it just defaults to /etc/bacula on Unix and the All Users\Application Data\Bacula directory on Windows. I didn't think there were a large number of users using alternate directories for their configuration files. Since this is the second time in a week someone has requested this I'll reconsider it. -Original Message- From: Martin Simmons [mailto:[EMAIL PROTECTED] Sent: Monday, November 06, 2006 12:03 PM To: [EMAIL PROTECTED] Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED] Subject: Re: [Bacula-devel] info about CONFIG_FILE On Mon, 06 Nov 2006 19:05:22 +0100, Christian said: Hi Robert, all files that includes CONFIG_FILE are renamed to [filename].in, so it is impossible to show only changes. I thought all files that are modified during configure should have extension .in Example: diff -ruN bacula-1.38.11-orig/src/console/console.c bacula-1.38.11/src/console/console.c --- bacula-1.38.11-orig/src/console/console.c 2005-08-10 16:35:19.0 + +++ bacula-1.38.11/src/console/console.c 2006-11-01 22:33:05.0 + @@ -94,7 +94,7 @@ static int sleepcmd(FILE *input, BSOCK *UA_sock); -#define CONFIG_FILE ./bconsole.conf /* default configuration file */ +#define CONFIG_FILE @sysconfidir@/bconsole.conf /* default configuration file */ static void usage() { I think the defaults for these should be defined via one generated header file (maybe config.h?). I.e. files like console.c should contain #define CONFIG_FILE DEFAULT_CONFIG_DIR/bconsole.conf and the generated header file should define DEFAULT_CONFIG_DIR. __Martin Robert Nelson schrieb: There are a number of problems with your patch. When you are submitting patches you should use the current CVS version of the source. There appears to be a mismatch in line endings between the original reference and your modified version. The result is that diff thinks the whole file has changed. This makes it next to impossible to see what you've changed. Before you submit a patch you should review it to make sure that it only lists the changes you made. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Christian Sent: Monday, November 06, 2006 7:18 AM To: [Bacula-devel] Subject: [Bacula-devel] info about CONFIG_FILE Hi, just wondering why bacula-apps does not look for needed CONFIG_FILE in sysconfdir first. So I applied a patch which will set correct path to CONFIG_FILE when building bacula from source. Best regards Christian - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] 1.39.x Beta Change - Reformated
Title: RE: [Bacula-users] 1.39.x Beta Change - Reformated Ask and ye shall receive J I just committed a change to use the configured location instead of assuming /etc/bacula. From: Robert Nelson [mailto:[EMAIL PROTECTED] Sent: Tuesday, October 24, 2006 7:46 PM To: [EMAIL PROTECTED]; bacula-users@lists.sourceforge.net; [EMAIL PROTECTED] Subject: RE: [Bacula-users] 1.39.x Beta Change - Reformated Unfortunately at the moment it means /etc/bacula. My original plan was to support $PREFIX/etc/bacula or whatever was the configured value of sysconfdir. The changes required to make it work with $PREFIX/etc touched too many files so I decided to add that support after this release. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]] Sent: Tuesday, October 24, 2006 6:53 PM To: Robert Nelson; bacula-users@lists.sourceforge.net; [EMAIL PROTECTED] Subject: Re: [Bacula-users] 1.39.x Beta Change - Reformated Robert, Does the standard location mean a standard of keeping your config files in /etc, or will it also look in $PREFIX/etc? That is what I'd personally love to see -- that Bacula will look for the config file wherever 'make install' put it (which could be /etc, but could not). -Original Message- From: Robert Nelson [EMAIL PROTECTED] Subj: [Bacula-users] 1.39.x Beta Change - Reformated Date: Tue Oct 24, 2006 8:42 pm Size: 4K To: bacula-users@lists.sourceforge.net, [EMAIL PROTECTED] Sorry about the first mail, the formatting got screwed up so that it was one long line, probably related to starting with a copy of the commit email. For those of you using the 1.39.x beta releases, I just committed some changes to the CVS (Version 1.39.27). The biggest change applies to all platforms. As a result of this change it should no longer be necessary to supply a ?c option or have the configuration files in the current directory when running the daemons or utilities interactively. I?ve changed the daemons and utilities so that if -c is omitted from the command line AND there is no configuration file in the current directory then the standard configuration file (eg /etc/bacula/bacula-*.conf) will be used. If the argument to -c doesn't contain any path separators AND there is no configuration file by that name in the current directory then the standard configuration file directory will be searched for a file by that name. The other significant change applies only to the Windows version. I?ve fixed restore so that backslashes as path separators work properly. Also I added the missing query.sql file to Windows installer and fixed the Windows version of catalog backup scripts. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Encryption/Compression Conflict in CVS
Before I cause a panic, there is a cut/paste error in my description below. There is nothing wrong with Sparse + Compression, it should say Works fine not Restore broken. -Original Message- From: Kern Sibbald [mailto:[EMAIL PROTECTED] Sent: Friday, November 03, 2006 5:05 PM To: Robert Nelson Cc: [EMAIL PROTECTED]; 'Landon Fuller'; bacula-users@lists.sourceforge.net Subject: RE: [Bacula-devel] [Bacula-users] Encryption/Compression Conflict in CVS I've got to go now. Thanks for the explaination. I'll respond as soon as I can, but I would also like to see Landon's response. Perhaps if I explained the problem: Currently (as of 1.39.27) No filters = Works fine Sparse = Works fine Compression = Works fine Encryption = Works fine Sparse + Compression = Restore broken Sparse + Encryption = Restore broken Sparse + Compression + Encryption = Restore broken Compression + Encryption = Restore broken With my fix ( 1.39.27): All combinations work fine. But restoration of old backups (1.39.x) using encryption alone or in combination with other filters is broken. Since all cases of encryption in combination with anything else were already broken, that just leaves encryption alone. I could special case the handling of just encryption so that it would be stored differently than when used in combination with other filters. This would allow old encrypted backups to be read at the expense of having two versions of the encryption and decryption code. Since this is a brand new feature I don't think changing the archive format at this point would affect that many people. Particularly since the archives are unreadable if they've used it in combination with compression or sparse file handling. I think it is safer to just say that previously written archives using encryption aren't readable and should be recreated. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Friday, November 03, 2006 4:40 PM To: Robert Nelson Cc: [EMAIL PROTECTED]; 'Landon Fuller'; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-devel] [Bacula-users] Encryption/Compression Conflict in CVS This code is backwards compatible for everything except encrypted data. Previously compressed backups will still work fine. I'm not 100% sure what you mean, but here are my thoughts: If it breaks something that previously worked, then it is does not fit with the Bacula philosophy of always being able to read Volumes written by prior versions. If something was previously broken -- i.e. could not be read -- then we should attempt to fix it, if at all possible. Maintaining backward Volume compatibility and fixing the problem is the best solution. Hopefully this is what you can do ... If we *must* create an incompatibility with Volumes written by prior versions of Bacula, then we need to think really hard about how to handle it because to the best of my knowledge this has never happened. If certain combinations of options created data that cannot be read under any conditions, then we need to carefully document it and inform the users. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Friday, November 03, 2006 4:15 PM To: Robert Nelson Cc: [EMAIL PROTECTED]; 'Landon Fuller'; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS Landon, I've changed the code so that the encryption code prefixes the data block with a block length prior to encryption. The decryption code accumulates data until a full data block is decrypted before passing it along to the decompression code. The code now works for all four scenarios with encryption and compression: none, encryption, compression, and encryption + compression. Unfortunately the code is no longer compatible for previously encrypted backups. I could add some more code to make the encryption only case work like before. However, since this is a new feature in 1.39 and there shouldn't be a lot of existing backups, I would prefer to invalidate the previous backups and keep the code simpler. Also I think we should have a design rule that says any data filters like encryption, compression, etc must maintain the original buffer boundaries. This will allow us to define arbitrary, dynamically extensible filter stacks in the future. What do you think? I'm unfortuntely not in a good position to examine this problem in detail, but I suggest that we should do our best to keep the old data readable by any kludge necessary. One possible solution for the new code that you have implemented is to put the new compressed data in a new stream -- i.e. a different one from the old compressed data -- this could possibly allow old Volumes to be read and any new data written to Volumes will be written correctly. One thing to be very careful
Re: [Bacula-users] [Bacula-devel] Encryption/Compression Conflict in CVS
I've checked in the fix which makes everything work properly. I've tested every combination of encryption, sparse and compression, both backup and restore. I've also compared the restored contents against the original to ensure that there is no corruption of the data. Any previous backups that were encrypted aren't readable. All other previous backups can be restored fine. -Original Message- From: Kern Sibbald [mailto:[EMAIL PROTECTED] Sent: Friday, November 03, 2006 4:23 PM To: Robert Nelson Cc: 'Landon Fuller'; 'Michael Brennen'; [EMAIL PROTECTED]; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-devel] [Bacula-users] Encryption/Compression Conflict in CVS The problem is that currently there are three filters defined: compression, encryption, and sparse file handling. The current implementation of compression and sparse file handling both require block boundary preservation. Even if zlib streaming could handle the existing block based data, sparse file handling would be broken. It seems to me that it is probably time to come up with a better way to handle filters, but it is probably too late for 1.40 to make any major changes to the code. I think the most important two points are: 1. Ensure that old Volumes are readable wherever possible. 2. Fix 1.40 so that it works correctly. As far as point 2 is concerned, if it is not possible to fix it easily or correctly, we could consider disallowing certain combinations of options -- at least until we can find a better way to handle multiple filters. -Original Message- From: Landon Fuller [mailto:[EMAIL PROTECTED] Sent: Thursday, November 02, 2006 11:06 AM To: Robert Nelson Cc: 'Michael Brennen'; [EMAIL PROTECTED]; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS On Nov 2, 2006, at 08:30, Robert Nelson wrote: Landon, I've changed the code so that the encryption code prefixes the data block with a block length prior to encryption. The decryption code accumulates data until a full data block is decrypted before passing it along to the decompression code. The code now works for all four scenarios with encryption and compression: none, encryption, compression, and encryption + compression. Unfortunately the code is no longer compatible for previously encrypted backups. I could add some more code to make the encryption only case work like before. However, since this is a new feature in 1.39 and there shouldn't be a lot of existing backups, I would prefer to invalidate the previous backups and keep the code simpler. Also I think we should have a design rule that says any data filters like encryption, compression, etc must maintain the original buffer boundaries. This will allow us to define arbitrary, dynamically extensible filter stacks in the future. What do you think? I was thinking about this on the way to work. My original assumption was that Bacula used the zlib streaming API to maintain state during file compression/decompression, but this is not the case. Reality is something more like this: Backup: - Set up the zlib stream context - For each file block (not each file), compress the block via deflate (stream, Z_FINISH); and reinitialize the stream. - After all files (and blocks) are compressed, destroy the stream context Restore: - For each block, call uncompress(), which does not handle streaming. This is a unfortunate -- reinitializing the stream for each block significantly degrades compression efficiency, as 1) block boundaries are dynamic and may be set arbitrarily, 2) the LZ77 algorithm may cross block boundaries, referring up to 32k of previous input data. (http://www.gzip.org/zlib/rfc-deflate.html#overview), 3) The huffman coding context comprises the entire block, 4) There's no need to limit zlib block size to bacula's block size. The next question is this -- as we *should* stream the data, does it make sense to enforce downstream block boundaries in the upstream filter? I'm siding in favor requiring streaming support, and thus allowing the individual filter implementor to worry about their own block buffering, since they can far better encapsulate necessary state and implementation -- and most already do. The one other thing I am unsure of is whether the zlib streaming API correctly handles streams that have been written as per above -- each bacula data block as an independent 'stream'. If zlib DOES handle this, it should be possible to modify the backup and restore implementation to use the stream API correctly while maintaining backwards compatibility. This would fix the encryption problem AND increase compression efficiency. With my extremely large database backups, I sure wouldn't mind increased compression efficiency =) Some documentation on the zlib API is available here (I had a little difficulty googling this): http
Re: [Bacula-users] Encryption/Compression Conflict in CVS
This code is backwards compatible for everything except encrypted data. Previously compressed backups will still work fine. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Friday, November 03, 2006 4:15 PM To: Robert Nelson Cc: [EMAIL PROTECTED]; 'Landon Fuller'; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS Landon, I've changed the code so that the encryption code prefixes the data block with a block length prior to encryption. The decryption code accumulates data until a full data block is decrypted before passing it along to the decompression code. The code now works for all four scenarios with encryption and compression: none, encryption, compression, and encryption + compression. Unfortunately the code is no longer compatible for previously encrypted backups. I could add some more code to make the encryption only case work like before. However, since this is a new feature in 1.39 and there shouldn't be a lot of existing backups, I would prefer to invalidate the previous backups and keep the code simpler. Also I think we should have a design rule that says any data filters like encryption, compression, etc must maintain the original buffer boundaries. This will allow us to define arbitrary, dynamically extensible filter stacks in the future. What do you think? I'm unfortuntely not in a good position to examine this problem in detail, but I suggest that we should do our best to keep the old data readable by any kludge necessary. One possible solution for the new code that you have implemented is to put the new compressed data in a new stream -- i.e. a different one from the old compressed data -- this could possibly allow old Volumes to be read and any new data written to Volumes will be written correctly. One thing to be very careful about is to make sure the length that you store is bigendian-littlendian independent. Probably you have already done this, but if not you need to use the serialization code that is also used for sparse file length. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Landon Fuller Sent: Wednesday, November 01, 2006 7:08 PM To: Michael Brennen Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS On Nov 1, 2006, at 2:20 PM, Michael Brennen wrote: On Wednesday 01 November 2006 15:33, Arno Lehmann wrote: This sounds like compression should be automatically disabled when encrypton is enabled. Should be useless anyway as encrypted data should no longer be compressible. Not if compression happens prior to encryption. :) Theoretically - yes, but I'm quite sure that encryption usually also compresses data. This is completely unverified and refers to encryption programs that are rather outdated by now, though... But I suppose you could inform us if encryption in Bacula also compresses :-) Landon, what is your take on this? Since you wrote the code you seem to be the best source on whether the openssl functions you are using compress data. Howdy, The encryption does not include compression -- It made more sense to piggyback on the existing compression code. Also, thanks for catching this! I'm embarrassed that I forgot to test backup+restore with both compression and encryption enabled. -landonf - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users Best regards, Kern - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
Re: [Bacula-users] [Bacula-devel] Encryption/Compression Conflict in CVS
I guess it comes down to the definition of previous versions. If you exclude previous development versions (ie 1.39.x) then it is backwards compatible since the problem and the fix only affect encrypted data which, as far as I know, wasn't available in 1.38.x. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Friday, November 03, 2006 4:40 PM To: Robert Nelson Cc: [EMAIL PROTECTED]; 'Landon Fuller'; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] [Bacula-devel] Encryption/Compression Conflict in CVS This code is backwards compatible for everything except encrypted data. Previously compressed backups will still work fine. I'm not 100% sure what you mean, but here are my thoughts: If it breaks something that previously worked, then it is does not fit with the Bacula philosophy of always being able to read Volumes written by prior versions. If something was previously broken -- i.e. could not be read -- then we should attempt to fix it, if at all possible. Maintaining backward Volume compatibility and fixing the problem is the best solution. Hopefully this is what you can do ... If we *must* create an incompatibility with Volumes written by prior versions of Bacula, then we need to think really hard about how to handle it because to the best of my knowledge this has never happened. If certain combinations of options created data that cannot be read under any conditions, then we need to carefully document it and inform the users. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Friday, November 03, 2006 4:15 PM To: Robert Nelson Cc: [EMAIL PROTECTED]; 'Landon Fuller'; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS Landon, I've changed the code so that the encryption code prefixes the data block with a block length prior to encryption. The decryption code accumulates data until a full data block is decrypted before passing it along to the decompression code. The code now works for all four scenarios with encryption and compression: none, encryption, compression, and encryption + compression. Unfortunately the code is no longer compatible for previously encrypted backups. I could add some more code to make the encryption only case work like before. However, since this is a new feature in 1.39 and there shouldn't be a lot of existing backups, I would prefer to invalidate the previous backups and keep the code simpler. Also I think we should have a design rule that says any data filters like encryption, compression, etc must maintain the original buffer boundaries. This will allow us to define arbitrary, dynamically extensible filter stacks in the future. What do you think? I'm unfortuntely not in a good position to examine this problem in detail, but I suggest that we should do our best to keep the old data readable by any kludge necessary. One possible solution for the new code that you have implemented is to put the new compressed data in a new stream -- i.e. a different one from the old compressed data -- this could possibly allow old Volumes to be read and any new data written to Volumes will be written correctly. One thing to be very careful about is to make sure the length that you store is bigendian-littlendian independent. Probably you have already done this, but if not you need to use the serialization code that is also used for sparse file length. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Landon Fuller Sent: Wednesday, November 01, 2006 7:08 PM To: Michael Brennen Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS On Nov 1, 2006, at 2:20 PM, Michael Brennen wrote: On Wednesday 01 November 2006 15:33, Arno Lehmann wrote: This sounds like compression should be automatically disabled when encrypton is enabled. Should be useless anyway as encrypted data should no longer be compressible. Not if compression happens prior to encryption. :) Theoretically - yes, but I'm quite sure that encryption usually also compresses data. This is completely unverified and refers to encryption programs that are rather outdated by now, though... But I suppose you could inform us if encryption in Bacula also compresses :-) Landon, what is your take on this? Since you wrote the code you seem to be the best source on whether the openssl functions you are using compress data. Howdy, The encryption does not include compression -- It made more sense to piggyback on the existing compression code. Also, thanks for catching this! I'm embarrassed that I forgot to test backup+restore with both compression and encryption enabled. -landonf - Using Tomcat
Re: [Bacula-users] [Bacula-devel] Encryption/Compression Conflict in CVS
Perhaps if I explained the problem: Currently (as of 1.39.27) No filters = Works fine Sparse = Works fine Compression = Works fine Encryption = Works fine Sparse + Compression = Restore broken Sparse + Encryption = Restore broken Sparse + Compression + Encryption = Restore broken Compression + Encryption = Restore broken With my fix ( 1.39.27): All combinations work fine. But restoration of old backups (1.39.x) using encryption alone or in combination with other filters is broken. Since all cases of encryption in combination with anything else were already broken, that just leaves encryption alone. I could special case the handling of just encryption so that it would be stored differently than when used in combination with other filters. This would allow old encrypted backups to be read at the expense of having two versions of the encryption and decryption code. Since this is a brand new feature I don't think changing the archive format at this point would affect that many people. Particularly since the archives are unreadable if they've used it in combination with compression or sparse file handling. I think it is safer to just say that previously written archives using encryption aren't readable and should be recreated. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Friday, November 03, 2006 4:40 PM To: Robert Nelson Cc: [EMAIL PROTECTED]; 'Landon Fuller'; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-devel] [Bacula-users] Encryption/Compression Conflict in CVS This code is backwards compatible for everything except encrypted data. Previously compressed backups will still work fine. I'm not 100% sure what you mean, but here are my thoughts: If it breaks something that previously worked, then it is does not fit with the Bacula philosophy of always being able to read Volumes written by prior versions. If something was previously broken -- i.e. could not be read -- then we should attempt to fix it, if at all possible. Maintaining backward Volume compatibility and fixing the problem is the best solution. Hopefully this is what you can do ... If we *must* create an incompatibility with Volumes written by prior versions of Bacula, then we need to think really hard about how to handle it because to the best of my knowledge this has never happened. If certain combinations of options created data that cannot be read under any conditions, then we need to carefully document it and inform the users. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Kern Sibbald Sent: Friday, November 03, 2006 4:15 PM To: Robert Nelson Cc: [EMAIL PROTECTED]; 'Landon Fuller'; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS Landon, I've changed the code so that the encryption code prefixes the data block with a block length prior to encryption. The decryption code accumulates data until a full data block is decrypted before passing it along to the decompression code. The code now works for all four scenarios with encryption and compression: none, encryption, compression, and encryption + compression. Unfortunately the code is no longer compatible for previously encrypted backups. I could add some more code to make the encryption only case work like before. However, since this is a new feature in 1.39 and there shouldn't be a lot of existing backups, I would prefer to invalidate the previous backups and keep the code simpler. Also I think we should have a design rule that says any data filters like encryption, compression, etc must maintain the original buffer boundaries. This will allow us to define arbitrary, dynamically extensible filter stacks in the future. What do you think? I'm unfortuntely not in a good position to examine this problem in detail, but I suggest that we should do our best to keep the old data readable by any kludge necessary. One possible solution for the new code that you have implemented is to put the new compressed data in a new stream -- i.e. a different one from the old compressed data -- this could possibly allow old Volumes to be read and any new data written to Volumes will be written correctly. One thing to be very careful about is to make sure the length that you store is bigendian-littlendian independent. Probably you have already done this, but if not you need to use the serialization code that is also used for sparse file length. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Landon Fuller Sent: Wednesday, November 01, 2006 7:08 PM To: Michael Brennen Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS On Nov 1, 2006, at 2:20 PM, Michael Brennen wrote: On Wednesday 01 November 2006 15:33, Arno Lehmann wrote: This sounds like compression
Re: [Bacula-users] Encryption/Compression Conflict in CVS
Landon, I've changed the code so that the encryption code prefixes the data block with a block length prior to encryption. The decryption code accumulates data until a full data block is decrypted before passing it along to the decompression code. The code now works for all four scenarios with encryption and compression: none, encryption, compression, and encryption + compression. Unfortunately the code is no longer compatible for previously encrypted backups. I could add some more code to make the encryption only case work like before. However, since this is a new feature in 1.39 and there shouldn't be a lot of existing backups, I would prefer to invalidate the previous backups and keep the code simpler. Also I think we should have a design rule that says any data filters like encryption, compression, etc must maintain the original buffer boundaries. This will allow us to define arbitrary, dynamically extensible filter stacks in the future. What do you think? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Landon Fuller Sent: Wednesday, November 01, 2006 7:08 PM To: Michael Brennen Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS On Nov 1, 2006, at 2:20 PM, Michael Brennen wrote: On Wednesday 01 November 2006 15:33, Arno Lehmann wrote: This sounds like compression should be automatically disabled when encrypton is enabled. Should be useless anyway as encrypted data should no longer be compressible. Not if compression happens prior to encryption. :) Theoretically - yes, but I'm quite sure that encryption usually also compresses data. This is completely unverified and refers to encryption programs that are rather outdated by now, though... But I suppose you could inform us if encryption in Bacula also compresses :-) Landon, what is your take on this? Since you wrote the code you seem to be the best source on whether the openssl functions you are using compress data. Howdy, The encryption does not include compression -- It made more sense to piggyback on the existing compression code. Also, thanks for catching this! I'm embarrassed that I forgot to test backup+restore with both compression and encryption enabled. -landonf - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encryption/Compression Conflict in CVS
The problem is that currently there are three filters defined: compression, encryption, and sparse file handling. The current implementation of compression and sparse file handling both require block boundary preservation. Even if zlib streaming could handle the existing block based data, sparse file handling would be broken. -Original Message- From: Landon Fuller [mailto:[EMAIL PROTECTED] Sent: Thursday, November 02, 2006 11:06 AM To: Robert Nelson Cc: 'Michael Brennen'; [EMAIL PROTECTED]; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS On Nov 2, 2006, at 08:30, Robert Nelson wrote: Landon, I've changed the code so that the encryption code prefixes the data block with a block length prior to encryption. The decryption code accumulates data until a full data block is decrypted before passing it along to the decompression code. The code now works for all four scenarios with encryption and compression: none, encryption, compression, and encryption + compression. Unfortunately the code is no longer compatible for previously encrypted backups. I could add some more code to make the encryption only case work like before. However, since this is a new feature in 1.39 and there shouldn't be a lot of existing backups, I would prefer to invalidate the previous backups and keep the code simpler. Also I think we should have a design rule that says any data filters like encryption, compression, etc must maintain the original buffer boundaries. This will allow us to define arbitrary, dynamically extensible filter stacks in the future. What do you think? I was thinking about this on the way to work. My original assumption was that Bacula used the zlib streaming API to maintain state during file compression/decompression, but this is not the case. Reality is something more like this: Backup: - Set up the zlib stream context - For each file block (not each file), compress the block via deflate (stream, Z_FINISH); and reinitialize the stream. - After all files (and blocks) are compressed, destroy the stream context Restore: - For each block, call uncompress(), which does not handle streaming. This is a unfortunate -- reinitializing the stream for each block significantly degrades compression efficiency, as 1) block boundaries are dynamic and may be set arbitrarily, 2) the LZ77 algorithm may cross block boundaries, referring up to 32k of previous input data. (http://www.gzip.org/zlib/rfc-deflate.html#overview), 3) The huffman coding context comprises the entire block, 4) There's no need to limit zlib block size to bacula's block size. The next question is this -- as we *should* stream the data, does it make sense to enforce downstream block boundaries in the upstream filter? I'm siding in favor requiring streaming support, and thus allowing the individual filter implementor to worry about their own block buffering, since they can far better encapsulate necessary state and implementation -- and most already do. The one other thing I am unsure of is whether the zlib streaming API correctly handles streams that have been written as per above -- each bacula data block as an independent 'stream'. If zlib DOES handle this, it should be possible to modify the backup and restore implementation to use the stream API correctly while maintaining backwards compatibility. This would fix the encryption problem AND increase compression efficiency. With my extremely large database backups, I sure wouldn't mind increased compression efficiency =) Some documentation on the zlib API is available here (I had a little difficulty googling this): http://www.freestandards.org/spec/booksets/LSB-Core-generic/LSB-Core-generic /libzman.html Cheers, Landon - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] ClientRunBeforeJob (XP Client) Crashes -- Me Too
When did you update from the CVS? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Scott Ruckh Sent: Thursday, November 02, 2006 9:31 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] ClientRunBeforeJob (XP Client) Crashes -- Me Too I saw this error already posted, but never saw a resolution. Director version: 1.39.27 (24 October 2006) (From CVS) Director OS: CentOS 4.3 Storage Daemon: Built from same CVS XP client: winbacula-1.39.26.exe Error received: 02-Nov 10:11 CLIENT-fd: ClientRunBeforeJob: run command C:/Bacula/bin/backup_systemstate.bat * 02-Nov 10:11 BACULA-dir: CLIENT_FULL.2006-11-02_10.11.02 Fatal error: Socket error on ClientRunBeforeJob command: ERR=Connection reset by peer 02-Nov 10:11 BACULA-dir: CLIENT_FULL.2006-11-02_10.11.02 Error: Bacula 1.39.27 (24Oct06): 02-Nov-2006 10:11:54 This is in the job definition ClientRunBeforeJob = C:/Bacula/bin/backup_systemstate.bat The contents of C:/Bacula/bin/backup_systemstate.bat: ntbackup backup systemstate /F C:\SystemState\systemstate.bkf When the batch file is executed (outside of bacula) it works fine. The Windows SYSTEM account has permissions to the directories in question. All of this worked fine before migrating to newer version of bacula. Previous bacula version was 1.38.9. Backup job completes fine if ClientRunBeforeJob directive is commented out. The XP bacula-fd.exe completely crashes and is closed after error (service is no longer running). Anyone know the cause of this error? Thanks. Scott - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] ClientRunBeforeJob (XP Client) Crashes -- Me Too
Hmm, the fix was committed early yesterday morning. Can you double check that your src/win32/compat/compat.cpp matches the one in CVS? Also check that the Bacula.dll on your Windows client system matches the one you built from the CVS yesterday? -Original Message- From: Scott Ruckh [mailto:[EMAIL PROTECTED] Sent: Thursday, November 02, 2006 1:51 PM To: Robert Nelson Cc: bacula-users@lists.sourceforge.net Subject: RE: [Bacula-users] ClientRunBeforeJob (XP Client) Crashes -- Me Too -- http://photo-gallery.gemneye.org:1115/Gallery2/ This is what you said Robert Nelson When did you update from the CVS? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Scott Ruckh Sent: Thursday, November 02, 2006 9:31 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] ClientRunBeforeJob (XP Client) Crashes -- Me Too I saw this error already posted, but never saw a resolution. Director version: 1.39.27 (24 October 2006) (From CVS) Director OS: CentOS 4.3 Storage Daemon: Built from same CVS XP client: winbacula-1.39.26.exe Error received: 02-Nov 10:11 CLIENT-fd: ClientRunBeforeJob: run command C:/Bacula/bin/backup_systemstate.bat * 02-Nov 10:11 BACULA-dir: CLIENT_FULL.2006-11-02_10.11.02 Fatal error: Socket error on ClientRunBeforeJob command: ERR=Connection reset by peer 02-Nov 10:11 BACULA-dir: CLIENT_FULL.2006-11-02_10.11.02 Error: Bacula 1.39.27 (24Oct06): 02-Nov-2006 10:11:54 This is in the job definition ClientRunBeforeJob = C:/Bacula/bin/backup_systemstate.bat The contents of C:/Bacula/bin/backup_systemstate.bat: ntbackup backup systemstate /F C:\SystemState\systemstate.bkf When the batch file is executed (outside of bacula) it works fine. The Windows SYSTEM account has permissions to the directories in question. All of this worked fine before migrating to newer version of bacula. Previous bacula version was 1.38.9. Backup job completes fine if ClientRunBeforeJob directive is commented out. The XP bacula-fd.exe completely crashes and is closed after error (service is no longer running). Anyone know the cause of this error? Thanks. Scott Yesterday. 01-Nov-2006 Thanks. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] ClientRunBeforeJob (XP Client) Crashes -- Me Too
Also if the XP client was built from the same CVS then its name should have been winbacula-1.39.27.exe. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Scott Ruckh Sent: Thursday, November 02, 2006 1:51 PM To: Robert Nelson Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] ClientRunBeforeJob (XP Client) Crashes -- Me Too -- http://photo-gallery.gemneye.org:1115/Gallery2/ This is what you said Robert Nelson When did you update from the CVS? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Scott Ruckh Sent: Thursday, November 02, 2006 9:31 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] ClientRunBeforeJob (XP Client) Crashes -- Me Too I saw this error already posted, but never saw a resolution. Director version: 1.39.27 (24 October 2006) (From CVS) Director OS: CentOS 4.3 Storage Daemon: Built from same CVS XP client: winbacula-1.39.26.exe Error received: 02-Nov 10:11 CLIENT-fd: ClientRunBeforeJob: run command C:/Bacula/bin/backup_systemstate.bat * 02-Nov 10:11 BACULA-dir: CLIENT_FULL.2006-11-02_10.11.02 Fatal error: Socket error on ClientRunBeforeJob command: ERR=Connection reset by peer 02-Nov 10:11 BACULA-dir: CLIENT_FULL.2006-11-02_10.11.02 Error: Bacula 1.39.27 (24Oct06): 02-Nov-2006 10:11:54 This is in the job definition ClientRunBeforeJob = C:/Bacula/bin/backup_systemstate.bat The contents of C:/Bacula/bin/backup_systemstate.bat: ntbackup backup systemstate /F C:\SystemState\systemstate.bkf When the batch file is executed (outside of bacula) it works fine. The Windows SYSTEM account has permissions to the directories in question. All of this worked fine before migrating to newer version of bacula. Previous bacula version was 1.38.9. Backup job completes fine if ClientRunBeforeJob directive is commented out. The XP bacula-fd.exe completely crashes and is closed after error (service is no longer running). Anyone know the cause of this error? Thanks. Scott Yesterday. 01-Nov-2006 Thanks. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encryption/Compression Conflict in CVS
Landon, Since you are the owner of the crypto code I'll leave it up to you to decide how you want to handle this. I've attached a patch for the code I wrote to make the encryption code preserve the block boundaries. If it is useful great, if not that's okay too, since I got to explore a whole section of the Bacula code I hadn't played with before. :-). -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Landon Fuller Sent: Wednesday, November 01, 2006 7:08 PM To: Michael Brennen Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS On Nov 1, 2006, at 2:20 PM, Michael Brennen wrote: On Wednesday 01 November 2006 15:33, Arno Lehmann wrote: This sounds like compression should be automatically disabled when encrypton is enabled. Should be useless anyway as encrypted data should no longer be compressible. Not if compression happens prior to encryption. :) Theoretically - yes, but I'm quite sure that encryption usually also compresses data. This is completely unverified and refers to encryption programs that are rather outdated by now, though... But I suppose you could inform us if encryption in Bacula also compresses :-) Landon, what is your take on this? Since you wrote the code you seem to be the best source on whether the openssl functions you are using compress data. Howdy, The encryption does not include compression -- It made more sense to piggyback on the existing compression code. Also, thanks for catching this! I'm embarrassed that I forgot to test backup+restore with both compression and encryption enabled. -landonf bacula-061102.patch Description: Binary data - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encryption/Compression Conflict in CVS
In that case, would you like me to commit the code I have? I agree about reworking the stream implementation. The existing code could be written as a number of filters: gzip, openssl, sparse, block/deblock. With a well defined API you would be able to define new stream types in the configuration files using these filters in addition to external filters located in shared libraries. -Original Message- From: Landon Fuller [mailto:[EMAIL PROTECTED] Sent: Thursday, November 02, 2006 3:38 PM To: Robert Nelson Cc: 'Michael Brennen'; [EMAIL PROTECTED]; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS On Nov 2, 2006, at 13:22, Robert Nelson wrote: The problem is that currently there are three filters defined: compression, encryption, and sparse file handling. The current implementation of compression and sparse file handling both require block boundary preservation. Even if zlib streaming could handle the existing block based data, sparse file handling would be broken. That's true. It's also not possible to make it handle streaming. Bummer. Block-preserving it is, then. The stream implementation could really use a refactor, coupled with a more modular filter API, but that's not something I'll have time for anytime soon. -landonf - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encryption/Compression Conflict in CVS
Actually this bug is quite simple to fix. The problem is that the backup and restore both do them in the same order instead of inverting the order on restore. Current Code: compress - encrypt - decompress - decrypt It should be: compress - encrypt - decrypt - decompress I can change the restore order so that existing backups will become readable and new backups will work whether created by the old software or the new. I'll commit the fix once I've finished testing it. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Arno Lehmann Sent: Wednesday, November 01, 2006 3:43 AM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS Hi, On 11/1/2006 5:43 AM, Michael Brennen wrote: I posted a couple of days ago that restoring files from 1.39.27 (current CVS) with both encryption and compression turned on resulted in 0 length files being restored. I was able to test that further tonight by archiving and restoring a file in the 4 combinations of encryption/compression off/on. Running neither, compression alone or encryption alone I was able to archive and restore a file correctly. Running the two together I was able to reproduce the problem of 0 length restores, with no apparent errors. So... in my testing the combination of encryption and compression is either not writing files correctly to tape (in which case there is a lot of tape space taken up needlessly :) or the files are being corrupted in the restore process; it appears to me to be the latter. This sounds like compression should be automatically disabled when encrypton is enabled. Should be useless anyway as encrypted data should no longer be compressible. Arno -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encryption/Compression Conflict in CVS
On top of the issue with the reversed processing during restore that I previously mentioned, there is a fundamental flaw in the processing of compressed+gzipped data. The problem is that boundaries aren't preserved across encrypt/decrypt. What happens is that after the block is compressed it is encrypted. However since the encryption engine processes data in blocks there may still be bytes from the compressed block in the pipeline when the block is sent to the Storage Daemon. As a result, when the same block is decrypted it may result in only part of the compressed block. Unfortunately there is no way to tell how much decrypted data is required by the decompression engine with the current design. I think the algorithm would have to be changed to pass along the compressed data size with each compressed block. Comments? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Landon Fuller Sent: Wednesday, November 01, 2006 7:08 PM To: Michael Brennen Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Encryption/Compression Conflict in CVS On Nov 1, 2006, at 2:20 PM, Michael Brennen wrote: On Wednesday 01 November 2006 15:33, Arno Lehmann wrote: This sounds like compression should be automatically disabled when encrypton is enabled. Should be useless anyway as encrypted data should no longer be compressible. Not if compression happens prior to encryption. :) Theoretically - yes, but I'm quite sure that encryption usually also compresses data. This is completely unverified and refers to encryption programs that are rather outdated by now, though... But I suppose you could inform us if encryption in Bacula also compresses :-) Landon, what is your take on this? Since you wrote the code you seem to be the best source on whether the openssl functions you are using compress data. Howdy, The encryption does not include compression -- It made more sense to piggyback on the existing compression code. Also, thanks for catching this! I'm embarrassed that I forgot to test backup+restore with both compression and encryption enabled. -landonf - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows Service not starting
On the Windows system open a cmd prompt. Run: C:\Program Files\Bacula\bin\bacula-fd -t. That should tell you if the configuration file is okay. If there are no errors then change the service path to: C:\bacula\bin\bacula-fd.exe /service -d100 -c C:\Documents and Settings\All Users\Application Data\Bacula\bacula-fd.conf Then reply with the following file attached: C:\Documents and Settings\All Users\Application Data\Bacula\work\client name-fd.trace -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Scott Ruckh Sent: Wednesday, November 01, 2006 10:53 PM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Windows Service not starting I just upgraded director, storage daemon and clients (both Linux and Windows). Director, storage daemon, and Linux client built from CVS sources. The version from bconsole reports: Version: 1.39.27 (24 October 2006). The Windows client (winbacula-1.39.26.exe) which was installed was downloaded from sourceforge. Per ReleaseNotes I did the following: Manually copy the *.conf files from C:\Bacula\bin to C:\Documents and Settings\All Users\Application Data\Bacula. cd c:\bacula\bin net stop bacula net stop baculfd ./bacula-fd /remove (Install the new Bacula) The bacula service path to executable looks like the following: C:\bacula\bin\bacula-fd.exe /service -c C:\Documents and Settings\All Users\Application Data\Bacula\bacula-fd.conf During automatic start after system boot up or if I manually try to restart the service I get the following error: Source: Service Control Manager Event ID: 7034 The Bacula File Server service terminated unexpectedly. The configuration file looks correct. This is happening on a Windows XP SP2 machine. Anyone have any ideas why the service will not start? -- Thanks Scott - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Different timeouts in different subnets
As near as I can tell it has always worked this way. -Original Message- From: Marc Brueckner [mailto:[EMAIL PROTECTED] Sent: Friday, October 27, 2006 12:22 AM To: Robert Nelson Cc: bacula-users@lists.sourceforge.net; 'Knischka'; 'Holger Luedecke' Subject: Re: [Bacula-users] Different timeouts in different subnets Robert Nelson schrieb: This is due to the algorithm used by Bacula to do connect timeouts. It isn't really a timeout, it is really a retry count. If you take the connect timeout in seconds and divide it by 10 you get the number of retries. It doesn't account for the time spent in the connect call. If the connect took zero amount of time to fail, the two would be the same thing. To make matters worse, the connect call takes a different amount of time to fail depending on whether or not a switch is involved. Hi Robert, thank you very much for your help. Your explanation made the things clearer for me. Do you know , if the algorithm you described has been changed in 1.38 ? I think, I first observed this effect on 1.38, but I don't know for sure . It dosen't matter now. I will shorten the timeout value to 30 seconds . That should decrease my timeout to approx. 10 minutes. and I can live with that. Thank you once again and greetings Marc So in your case, 5 minutes is equal to 300 seconds, divided by 10 equals 30. So you will get 30 retries. Now, on the same subnet, it takes 6 minutes and 36 seconds to do 30 retries. So it takes 1 minute and 36 seconds for 30 calls to connect to fail or roughly 3 seconds per try. On different subnets, it takes 1 hour 39 minutes and 31 seconds or 189 seconds or roughly 3 minutes per try. The reason for the differences is probably caching on the switch. I suspect that in the same subnet case the arp is failing (so the IP address can't be converted to an Ethernet address), in the other case the switch is responding to the arp and a higher level (and longer timeout) is coming into play, probably the TCP connect timer. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Marc Brückner Sent: Thursday, October 26, 2006 5:45 AM To: bacula-users@lists.sourceforge.net Cc: Knischka; Holger Luedecke Subject: [Bacula-users] Different timeouts in different subnets Hi @ all Bacula users, I am using Bacula for several year now and I am really satisfied with it. But now I have a strange Problem. I am not sure but I think it first occurred since I updated from version 1.36 to 1.38 . Now I am running 1.38.11 My Bacula has to backup several WinXP clients over night. When the client runs, there is no problem and the backup is done properly. But if the users switch off their clients ( what happen often, unfortunately ) the duration of the timeout depends on the IP-Subnet the client is in . I have the following Timeout settings in the bacula-dir.conf FD Connect Timeout = 5 minutes SD Connect Timeout = 5 minutes If the Client is in the same IP-Subnet as the Bacula-director, the director tells: 24-Oct 08:43 Bacula-dir: Start Backup JobId 3040, Job=StudentA2190_A.2006-10-23_19.40.53 24-Oct 08:44 Bacula-dir: StudentA2190_A.2006-10-23_19.40.53 Warning: bnet.c:853 Could not connect to File daemon on 192.168.10.67:9102. ERR=No route to host Retrying ... 24-Oct 08:50 Bacula-dir: StudentA2190_A.2006-10-23_19.40.53 Fatal error: bnet.c:859 Unable to connect to File daemon on 192.168.10.67:9102. ERR=No route to host 24-Oct 08:50 Bacula-dir: StudentA2190_A.2006-10-23_19.40.53 Error: Bacula 1.38.11 (28Jun06): 24-Oct-2006 08:50:29 ... Scheduled time: 23-Oct-2006 19:40:52 Start time: 24-Oct-2006 08:43:53 End time: 24-Oct-2006 08:50:29 Elapsed time: 6 mins 36 secs Timeout after 6 and a half minutes,ERR=No route to host ; thats OK. But if the Client resides in a different IP-Subnet is says: 25-Oct 02:39 Bacula-dir: Start Backup JobId 3070, Job=StudentA1080_A.2006-10-24_18.00.11 25-Oct 02:45 Bacula-dir: StudentA1080_A.2006-10-24_18.00.11 Warning: bnet.c:853 Could not connect to File daemon on 192.168.30.33:9102. ERR=Connection timed out Retrying ... 25-Oct 04:18 Bacula-dir: StudentA1080_A.2006-10-24_18.00.11 Fatal error: bnet.c:859 Unable to connect to File daemon on 192.168.30.33:9102. ERR=Connection timed out 25-Oct 04:18 Bacula-dir: StudentA1080_A.2006-10-24_18.00.11 Error: Bacula 1.38.11 (28Jun06): 25-Oct-2006 04:18:47 ... Scheduled time: 24-Oct-2006 18:00:10 Start time: 25-Oct-2006 02:39:16 End time: 25-Oct-2006 04:18:47 Elapsed time: 1 hour 39 mins 31 secs Timeout after 1 hour and 40 minutes, ERR=Connection timed out; thats a little bit long. I have observed many log entries and its always the same: same subnet = 6 m different subnet =1:40 h. There is no packet filtering between the subnets. Has anyone experienced
Re: [Bacula-users] Different timeouts in different subnets
I doubt this has anything to do with DNS. DNS is used to convert a hostname into an IP address. If there was an error at that stage the error would be something like Host not found. Also there would be no retries and the FDCONNECT timeout wouldn't come into play. In addition, it is most likely going to be the same DNS for different subnets in a corporation or at the very least they'll be configured with the same timeouts. To have a routing problem you have to be at the stage of sending packets. Once you have an IP address you need to figure out which interface to send it on. So if it wasn't on the same subnet and there were no default gateway configured you could end up with a no route to host. But that wouldn't be affected by whether the host were up or not. So it must be able to figure out which interface to use. So now you need to figure out to which Ethernet MAC address the packet should be addressed. This process uses the ARP protocol (Address Resolution Protocol). For the same subnet it tries to map the hosts IP address to a MAC address. For different subnets, it tries to map the IP address of the default gateway. So I stand by my original problem analysis. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Arno Lehmann Sent: Friday, October 27, 2006 2:44 AM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Different timeouts in different subnets Hi, just some minor correction (or assumption...): On 10/27/2006 5:54 AM, Robert Nelson wrote: ... The reason for the differences is probably caching on the switch. I suspect that in the same subnet case the arp is failing (so the IP address can't be converted to an Ethernet address), in the other case the switch is responding to the arp and a higher level (and longer timeout) is coming into play, probably the TCP connect timer. I rather suspect that in one case the DNS was already cleared of the host name (message No Route to Host) while in the other case the DNS still had a record for the host and thus the tcp stack had to actually try the connect, and thus rely on the underlying IP timeouts (error message Timeout). Arno -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users