Re: [Bacula-users] Solved why Windows FD 1.38 sometime is slow

2007-01-31 Thread Kern Sibbald
Hello,

Please always copy the bacula-users list so that the others can benefit from 
what you are discovering.

On Wednesday 31 January 2007 07:29, Gabriele Bulfon wrote:
 So, if I force the windows machines to 32K net buffer, what is the correct
 way to handle the others daemons?

Normally, if a network card/OS doesn't gracefully handle 65K network buffers, 
you need only change it for that machine, especially if it is the FD. 

 - should I force to 32K the sd too? 

If it is a Linux machine that should not really be necessary.  However, in one 
case I am not really sure, and that is during restores, if the SD is sending 
65K buffers and the FD is receiving in 32K buffers, I am not sure if you will 
run into the same slow down problem ...  In principle, the TCP/IP protocol 
should handle it. 

Some testing of restore speeds with SD buffer sizes at 65K and 32K could 
probably answer this question.

One downside to setting the SD to 32K max buffer size may be that transfers 
from Linux (or well behaving Win32) machines may run slower.  

For anyone sending data across the Internet, you should seriously consider 
setting the maximum network buffer size smaller.

 - should I force any other fd on the lan to 32k too?

I don't see any reason to do so unless they are having speed problems.

 - may I leave everything to default, but the windows machines?

Yes, I would say so, with the reservation I made above about possible slowdown 
of restores.

 At the moment I forced everything to 32k.

I don't see any great problem with that.  Previous performance testing by a 
user showed that on Linux/Unix machines the performance could have 
spectacular speedups by increasing the network buffer size -- even more than 
65K.  

If the system is reliable and fast enough for you at 32K buffer size, I would 
be inclined to keep it that way.  If not, experiment.  However, in any 
experimentation, you need to keep good paper records of what you are changing 
and what the results are, or you can quickly get lost ...

Regards,

Kern

 Gabriele Bulfon - Sonicle S.r.l.
 Tel +39 028246016 Int. 30 - Fax +39 028243880
 Via Felice Cavallotti 16 - 20089, Rozzano - Milano - ITALY
 http://www.sonicle.com
 ---
--- Da: Kern Sibbald [EMAIL PROTECTED]
 A: bacula-users@lists.sourceforge.net
 Cc: Gabriele Bulfon [EMAIL PROTECTED]
 Data: 30 gennaio 2007 20.16.33 CET
 Oggetto: Re: [Bacula-users] Solved why Windows FD 1.38 sometime is slow
 Hello,

 On Tuesday 30 January 2007 18:41, Gabriele Bulfon wrote:
  I had headaches for a week, trying to figure out why some windows FDs
  were VERY slow compared to all the rest of FDs. These slow clients were
  all rating at around 1Mb/s. After playing a bit with many system and
  bacula parameters, I decided not to trust what was stated in the manual:
  the default Maximum Network Buffer Size = 32768. Because I tried rising
  this parameter to double default, both on sd and all fds, and noticed
  that I had a slow down of all the FDs, I put back everything to default.
  Then I decided to explicitly set the
  Maximum Network Buffer Size = 32768 to the windows machine
  that was still so slowand it magically started to work as the rest of
  fds!!!

 Yes, you are right.  The documentation is incorrect.  The default was 32768
 but was at some point changed to 65536, but the documentation did not get
 updated.  The 65536 works very well in the Unix/Linux environment, but as
 you have discovered (absolutely amazing), it may not work on some network
 cards. This was mentioned in the manual.  However, I have now updated the
 manual to have the correct default and to more clearly point out the
 potential problems.

  Beacuse I have another windows FD on the same installation, with the
  same version of bacula, and this one was going fine with the default (MNB
  not specified), what I believe is that the windows setup has been built
  with a different default (maybe 65536), and this setting may be fine only
  in specific situations. What I mean, is that probably 32768 is fine for
  almost any card, but 65536 may be fine only for cards that support this
  buffer size.
  What I know now is that explicitly setting the buffer to 32768 on the
  bacula fd will work. After finding this, I did the same on other 3
  installations where I had similar problems, and it worked! Thanx to
  everyone that tried to help me.

 Thanks to you for discovering it ...
 Best regards,
 Kern

  Gabriele.
  Gabriele Bulfon - Sonicle S.r.l.
  Tel +39 028246016 Int. 30 - Fax +39 028243880
  Via Felice Cavallotti 16 - 20089, Rozzano - Milano - ITALY
  http://www.sonicle.com

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash

Re: [Bacula-users] force status full

2007-01-31 Thread Kern Sibbald
On Wednesday 31 January 2007 08:41, Manuel Staechele wrote:
 hi,

 i want every media LastWritten 7 days ago to go in full status.
 because if the media is append, it will not automatic pruned
 i have wrote a little sql query to do the job, but want ask if there is
 a better, than execute the sql query every day.

I'll let others on this list answer your question, but in your SQL below, I 
see no reason to change a Used status to Full.


 sql query:

 UPDATE Media SET
VolStatus = 'Full'
 WHERE (VolStatus = 'Append' or VolStatus = 'Used')
AND LastWritten  NOW() - interval 7 DAY


 thanks for idees.

 greetings
 manuel staechele

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Davide Bolcioni
Kern Sibbald wrote:

 Another thing to check for is HP printers on the network, which have the
 nasty habit of using non-registered ports e.g. 9001, 9002, or 9003, which
 can cause disconnects by Bacula.  If you find printers probing/using those
 ports, either reconfigure the printers or Bacula (preferably the former
 since the ports are officially registered by IANA to Bacula).

Port conflicts are a known annoyance, but maybe it would help to disseminate 
the information about Bacula usage, for example here:

  http://en.wikipedia.org/wiki/List_of_TCP_and_UDP_port_numbers

Should the need to introduce incompatible changes in the protocol arise, which 
I guess would be Bacula 3.0, maybe a different set of default ports could be 
considered ? HP networked printers are fairly common.

Davide Bolcioni
-- 
Paranoia is an afterthought.

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Admin Tool (bat)

2007-01-31 Thread Andrew Paterson
Hi,
I know I am a little late with this comment and it is probably not 
welcome... But I feel it needs stating
...RANT...
I am not happy with the client-specific gui (bat).
It would surely be better to have a server based gui run from a web-browser - 
what I had hoped bacula-web would become.
I don't much look forward to only being able to run the bat gui on linux boxes 
 other UNIX clients to which it has been ported.
OK, you will no doubt port it to windows also - but consider that I can run 
bacula-web from any web enabled device  even my mobile phone!
Surely bacula-web should be further developed to provide the kind of 
functionality for a bacula-server that swat does for samba  the cups 
web-interface does for cups etc.
...END of RANT...

In the meantime - back to my development network reliably secured with bacula - 
Thanks to Kern et al.

Andrew R Paterson
DS Ltd.
www.ds.co.uk





-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] Behalf Of Kern
Sibbald
Sent: 30 January 2007 7:06PM
To: bacula-users@lists.sourceforge.net
Cc: bacula-devel
Subject: Re: [Bacula-users] Bacula Admin Tool (bat)


On Tuesday 30 January 2007 17:48, Chris Hoogendyk wrote:
 Ryan Novosielski wrote:
  -BEGIN PGP SIGNED MESSAGE-
  Hash: SHA1
 
  Not to be chomping at the bit here, but I guess questions that I have
  are A) How hard is it likely to be to get this thing built for Windows?
  I don't expect you to have an answer for that as I suppose Robert does
  most of the Windows work, but I'd be curious to know. B) If anyone is
  familiar with this, on Solaris, is there a set of files that one can add
  to a system that is relatively lightweight to support something like
  this? Perhaps you have other KDE apps and know how this works. In my
  experience, most distros want the qt libs package, but then that package
  wants about 30 others.
 
  Thanks for any insights from the peanut gallery. I'd love to start using
  this, but would pass for the time being if it will require extensive
  dependency building.

 I'll just reply to the Solaris part.

 I typically grab a good deal of this sort of stuff from sunfreeware. I
 try not to get things I don't need, but when you have a chain of
 dependencies, you don't have much choice -- either you want that
 capability or you scrap the whole thing.

 I have a directory /usr/local/pkg and a directory /usr/local/src, and I
 keep everything I have installed in one or the other of those. Some
 things you need source, some things it's unnecessary overhead and trouble.

 For me, Solaris is for servers. My desktop is Mac OS X. I don't use any
 graphical interface on my servers. I typically have a dozen or more
 terminal windows open with ssh sessions.

 If I were going to use a gui for something like bacula, I would want it
 at my desktop, not on the server. So, while my backup servers and
 everything would be on Solaris, 

 I would want a client/server arrangement 
 where I could do the administration from a gui on my Mac. Don't know if
 that fits with the current plan, but it seems most logical to me --
 architecturally more robust and not caught up in the exporting of
 graphical interface through something like X11. From my perspective,
 that's not what a server ought to be spending its time doing. I would
 want the bacula install to be modular enough that I wouldn't have to
 install the graphical stuff on my server.

What is written above is not totally clear to me.  The bat is a GUI 
application that will run on a large variety of machines Linux, Windows, 
Solaris, FreeBSD, Mac OS X and others.  The communications to the Director 
does not use X11 but simple TCP/IP.  There is no requirement to have the GUI 
installed on the server. 



 ---

 Chris Hoogendyk

 -
O__   Systems Administrator
   c/ /'_ --- Biology  Geology Departments
  (*) \(*) -- 140 Morrill Science Center
 ~~ - University of Massachusetts, Amherst

 [EMAIL PROTECTED]

 ---

 Erdös 4



 -
 Take Surveys. Earn Cash. Influence the Future of IT
 Join SourceForge.net's Techsay panel and you'll get the chance to share
 your opinions on IT  business topics through brief surveys - and earn cash
 http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list

[Bacula-users] Generate ISO's only

2007-01-31 Thread Ruben Lopez
Hi,

Is it possible with bacula to stop after generating the ISO and tell 
bacula not to write the actual CD/DVD? What we would like to do is to 
store all the backups in a shared folder, and have one person in charge 
of burning things from this directory periodically.

Thanks.

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Generate ISO's only

2007-01-31 Thread Richard Mortimer
 

 -Original Message-
 From: [EMAIL PROTECTED] 
 [mailto:[EMAIL PROTECTED] On Behalf 
 Of Ruben Lopez
 Sent: 31 January 2007 11:20
 To: bacula-users@lists.sourceforge.net
 Subject: [Bacula-users] Generate ISO's only
 
 Hi,
 
 Is it possible with bacula to stop after generating the ISO and tell 
 bacula not to write the actual CD/DVD? What we would like to do is to 
 store all the backups in a shared folder, and have one person 
 in charge 
 of burning things from this directory periodically.

Hi,

At present this is not something that can be done without a bit of
scripting and changes to the dvd-handler script (and maybe adding
a wrapper script around mount). I don't have time to do it at the
moment but here are the changes required just in case someone else
has time

1 - make dvd-handler write/add to an ISO and not a device
it also needs to do some magic to allow different iso images
to live in the same directory (probably using the base
volumename as a parameter)
2 - make dvd-handler aware of the disk size (currently it reads
it from the disk itself at runtime). Basically the free
command for dvd-handler needs to return the size without
knowing the disk size
3 - wrap the current call to mount in a script (dvd-mount?)
that takes the volumename and finds the appropriate iso
image.

Finally I know that kern has a dvd-simulator script for testing
as I remember that doesn't actually write the iso itself so it
isn't fully useful but it probably has some useful bits in there.

Richard

P.S. This functionality would be really useful for DVD regression
testing. It would speed up the testing no-end whilst actually 
generating the proper iso image.


-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Admin Tool (bat)

2007-01-31 Thread Ger Apeldoorn
Perhaps you can take a look at this:
http://www.opencountry.com/products/ocmwebminplus_home.html

Ger.

Op woensdag 31 januari 2007 11:33, schreef Andrew Paterson:
 Hi,
   I know I am a little late with this comment and it is probably not
 welcome... But I feel it needs stating ...RANT...
 I am not happy with the client-specific gui (bat).
 It would surely be better to have a server based gui run from a web-browser
 - what I had hoped bacula-web would become. I don't much look forward to
 only being able to run the bat gui on linux boxes  other UNIX clients to
 which it has been ported. OK, you will no doubt port it to windows also -
 but consider that I can run bacula-web from any web enabled device  even my
 mobile phone! Surely bacula-web should be further developed to provide the
 kind of functionality for a bacula-server that swat does for samba  the
 cups web-interface does for cups etc. ...END of RANT...

 In the meantime - back to my development network reliably secured with
 bacula - Thanks to Kern et al.

 Andrew R Paterson
 DS Ltd.
 www.ds.co.uk





 -Original Message-
 From: [EMAIL PROTECTED]
 [mailto:[EMAIL PROTECTED] Behalf Of Kern
 Sibbald
 Sent: 30 January 2007 7:06PM
 To: bacula-users@lists.sourceforge.net
 Cc: bacula-devel
 Subject: Re: [Bacula-users] Bacula Admin Tool (bat)

 On Tuesday 30 January 2007 17:48, Chris Hoogendyk wrote:
  Ryan Novosielski wrote:
   -BEGIN PGP SIGNED MESSAGE-
   Hash: SHA1
  
   Not to be chomping at the bit here, but I guess questions that I have
   are A) How hard is it likely to be to get this thing built for Windows?
   I don't expect you to have an answer for that as I suppose Robert does
   most of the Windows work, but I'd be curious to know. B) If anyone is
   familiar with this, on Solaris, is there a set of files that one can
   add to a system that is relatively lightweight to support something
   like this? Perhaps you have other KDE apps and know how this works. In
   my experience, most distros want the qt libs package, but then that
   package wants about 30 others.
  
   Thanks for any insights from the peanut gallery. I'd love to start
   using this, but would pass for the time being if it will require
   extensive dependency building.
 
  I'll just reply to the Solaris part.
 
  I typically grab a good deal of this sort of stuff from sunfreeware. I
  try not to get things I don't need, but when you have a chain of
  dependencies, you don't have much choice -- either you want that
  capability or you scrap the whole thing.
 
  I have a directory /usr/local/pkg and a directory /usr/local/src, and I
  keep everything I have installed in one or the other of those. Some
  things you need source, some things it's unnecessary overhead and
  trouble.
 
  For me, Solaris is for servers. My desktop is Mac OS X. I don't use any
  graphical interface on my servers. I typically have a dozen or more
  terminal windows open with ssh sessions.
 
  If I were going to use a gui for something like bacula, I would want it
  at my desktop, not on the server. So, while my backup servers and
  everything would be on Solaris,
 
  I would want a client/server arrangement
  where I could do the administration from a gui on my Mac. Don't know if
  that fits with the current plan, but it seems most logical to me --
  architecturally more robust and not caught up in the exporting of
  graphical interface through something like X11. From my perspective,
  that's not what a server ought to be spending its time doing. I would
  want the bacula install to be modular enough that I wouldn't have to
  install the graphical stuff on my server.

 What is written above is not totally clear to me.  The bat is a GUI
 application that will run on a large variety of machines Linux, Windows,
 Solaris, FreeBSD, Mac OS X and others.  The communications to the Director
 does not use X11 but simple TCP/IP.  There is no requirement to have the
 GUI installed on the server.

  ---
 
  Chris Hoogendyk
 
  -
 O__   Systems Administrator
c/ /'_ --- Biology  Geology Departments
   (*) \(*) -- 140 Morrill Science Center
  ~~ - University of Massachusetts, Amherst
 
  [EMAIL PROTECTED]
 
  ---
 
  Erdös 4
 
 
 
  -
  Take Surveys. Earn Cash. Influence the Future of IT
  Join SourceForge.net's Techsay panel and you'll get the chance to share
  your opinions on IT  business topics through brief surveys - and earn
  cash
  http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
  ___
  Bacula-users mailing list
  Bacula-users@lists.sourceforge.net
  https://lists.sourceforge.net/lists/listinfo/bacula-users

 -
 Take Surveys. Earn Cash. Influence the Future of IT
 Join SourceForge.net's Techsay panel and you'll get the chance to 

Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Alan Brown
On Wed, 31 Jan 2007, Davide Bolcioni wrote:

 Should the need to introduce incompatible changes in the protocol arise, which
 I guess would be Bacula 3.0, maybe a different set of default ports could be
 considered ? HP networked printers are fairly common.

HP should be prevailed upon to fix it. It's far from the only evil thing 
Jetdirect cards are capable of inflicting on networks.




-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Dan Langille
On 31 Jan 2007 at 11:28, Davide Bolcioni wrote:

 Kern Sibbald wrote:
 
  Another thing to check for is HP printers on the network, which have
  the nasty habit of using non-registered ports e.g. 9001, 9002, or
  9003, which can cause disconnects by Bacula.  If you find printers
  probing/using those ports, either reconfigure the printers or Bacula
  (preferably the former since the ports are officially registered by
  IANA to Bacula).
 
 Port conflicts are a known annoyance, but maybe it would help to
 disseminate the information about Bacula usage, for example here:
 
   http://en.wikipedia.org/wiki/List_of_TCP_and_UDP_port_numbers

The Bacula ports are listed there.

And Bacula is listed here: http://en.wikipedia.org/wiki/Bacula

 Should the need to introduce incompatible changes in the protocol
 arise, which I guess would be Bacula 3.0, maybe a different set of
 default ports could be considered ? HP networked printers are fairly
 common.

Bacula is registered with IANA, which is the definite source as well 
as listed in the protocol database:

   http://www.isecom.info/cgi-local/protocoldb/browse.dsp

Yes, I know it does not make much difference given that HP did and 
does not do the right thing.

-- 
Dan Langille : Software Developer looking for work
my resume: http://www.freebsddiary.org/dan_langille.php
PGCon - The PostgreSQL Conference - http://www.pgcon.org/



-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Admin Tool (bat)

2007-01-31 Thread Michel Meyers
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Ger Apeldoorn wrote:
 Perhaps you can take a look at this:
 http://www.opencountry.com/products/ocmwebminplus_home.html

 Ger.

 Op woensdag 31 januari 2007 11:33, schreef Andrew Paterson:
 Hi,
  I know I am a little late with this comment and it is probably not
 welcome... But I feel it needs stating ...RANT...
 I am not happy with the client-specific gui (bat).
 It would surely be better to have a server based gui run from a web-browser
 - what I had hoped bacula-web would become. I don't much look forward to


You should also try to take a look at bweb (which comes with the
Bacula-gui package). It is mostly view only, giving out reports and
statistics but of course one could always extend it to do more.

Greetings,
Michel
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (MingW32) - GPGrelay v0.959

iD8DBQFFwI3k2Vs+MkscAyURAh8YAJ4jgX6PCTErEhzv/1Gkl2feP4WLAQCg/oGO
Dbyy8jD0FJR7B2xewQ3xZ+k=
=9p7R
-END PGP SIGNATURE-

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Admin Tool (bat)

2007-01-31 Thread John Drescher
On 1/31/07, Ger Apeldoorn [EMAIL PROTECTED] wrote:
 Perhaps you can take a look at this:
 http://www.opencountry.com/products/ocmwebminplus_home.html


I hope this is still being worked on as webmin is at version 1.320 now
and ocmwebminplus is stuck at 1.307 for 2 months and there does not
seem to be any activity at the sorceforge site for ocmwebminplus.

John

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Admin Tool (bat)

2007-01-31 Thread Andrew Paterson
Hi Michel,
As I understand it bweb is (was) bacula-web which I use at the moment - 
It's very useful but as you say its view only.
You are right... it could (should) be extended to provide write (control) 
access.
This is where I believe the gui effort should go :) my whole point :).

Andy

-Original Message-
From: Michel Meyers [mailto:[EMAIL PROTECTED]
Sent: 31 January 2007 12:39PM
To: Andrew Paterson
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Bacula Admin Tool (bat)


-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Ger Apeldoorn wrote:
 Perhaps you can take a look at this:
 http://www.opencountry.com/products/ocmwebminplus_home.html

 Ger.

 Op woensdag 31 januari 2007 11:33, schreef Andrew Paterson:
 Hi,
  I know I am a little late with this comment and it is probably not
 welcome... But I feel it needs stating ...RANT...
 I am not happy with the client-specific gui (bat).
 It would surely be better to have a server based gui run from a web-browser
 - what I had hoped bacula-web would become. I don't much look forward to


You should also try to take a look at bweb (which comes with the
Bacula-gui package). It is mostly view only, giving out reports and
statistics but of course one could always extend it to do more.

Greetings,
Michel
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (MingW32) - GPGrelay v0.959

iD8DBQFFwI3k2Vs+MkscAyURAh8YAJ4jgX6PCTErEhzv/1Gkl2feP4WLAQCg/oGO
Dbyy8jD0FJR7B2xewQ3xZ+k=
=9p7R
-END PGP SIGNATURE-

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Admin Tool (bat)

2007-01-31 Thread Michel Meyers
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Andrew Paterson wrote:
 Hi Michel,
   As I understand it bweb is (was) bacula-web which I use at the moment

I'm not sure, bweb looks radically different from bacula-web. No idea
whether it was developed from that or is a 'from scratch' effort, but it
supports drop down menus etc...

The screenshot on Freshmeat shows it in action:
http://freshmeat.net/screenshots/33280/35297/

Greetings,
   Michel
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (MingW32) - GPGrelay v0.959

iD8DBQFFwJO/2Vs+MkscAyURAmWJAKCGBnjF/PZyfvDqsw165muawA6BiACgpmvk
dW9ru/Mo5ptnYyQiUKj215k=
=S5gZ
-END PGP SIGNATURE-

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Generate ISO's only

2007-01-31 Thread Kern Sibbald
On Wednesday 31 January 2007 12:54, Richard Mortimer wrote:
  -Original Message-
  From: [EMAIL PROTECTED]
  [mailto:[EMAIL PROTECTED] On Behalf
  Of Ruben Lopez
  Sent: 31 January 2007 11:20
  To: bacula-users@lists.sourceforge.net
  Subject: [Bacula-users] Generate ISO's only
 
  Hi,
 
  Is it possible with bacula to stop after generating the ISO and tell
  bacula not to write the actual CD/DVD? What we would like to do is to
  store all the backups in a shared folder, and have one person
  in charge
  of burning things from this directory periodically.

 Hi,

 At present this is not something that can be done without a bit of
 scripting and changes to the dvd-handler script (and maybe adding
 a wrapper script around mount). I don't have time to do it at the
 moment but here are the changes required just in case someone else
 has time

 1 - make dvd-handler write/add to an ISO and not a device
 it also needs to do some magic to allow different iso images
 to live in the same directory (probably using the base
 volumename as a parameter)
 2 - make dvd-handler aware of the disk size (currently it reads
 it from the disk itself at runtime). Basically the free
 command for dvd-handler needs to return the size without
 knowing the disk size
 3 - wrap the current call to mount in a script (dvd-mount?)
 that takes the volumename and finds the appropriate iso
 image.

 Finally I know that kern has a dvd-simulator script for testing
 as I remember that doesn't actually write the iso itself so it
 isn't fully useful but it probably has some useful bits in there.

Yes, it is a *really* crude hack of dvd-handler that rather blindly simulates 
what dvd-handler does and rather than writing the output to a DVD, it writes 
it to a file.  

It seems to me that Ruben to do what he wants would simply require him to 
write to file Volumes and limit them to the size that fits on a DVD 4.8GB?  
Then later, someone could burn those Volumes to a DVD.  They could not be 
directly restored from a DVD, but they could be restored to a file then 
Bacula could do the restore.  If I am not mistaken bimagemgr in the gui 
distribution does exactly that though for CDs.  It allows you to track what 
Volumes have been written to CD with the information stored in the Bacula 
database.


 Richard

 P.S. This functionality would be really useful for DVD regression
 testing. It would speed up the testing no-end whilst actually
 generating the proper iso image.


 -
 Take Surveys. Earn Cash. Influence the Future of IT
 Join SourceForge.net's Techsay panel and you'll get the chance to share
 your opinions on IT  business topics through brief surveys - and earn cash
 http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Admin Tool (bat)

2007-01-31 Thread Kern Sibbald
On Wednesday 31 January 2007 11:33, Andrew Paterson wrote:
 Hi,
   I know I am a little late with this comment and it is probably not
 welcome... But I feel it needs stating ...RANT...
 I am not happy with the client-specific gui (bat).
 It would surely be better to have a server based gui run from a web-browser
 - what I had hoped bacula-web would become. I don't much look forward to
 only being able to run the bat gui on linux boxes  other UNIX clients to
 which it has been ported. OK, you will no doubt port it to windows also -
 but consider that I can run bacula-web from any web enabled device  even my
 mobile phone! Surely bacula-web should be further developed to provide the
 kind of functionality for a bacula-server that swat does for samba  the
 cups web-interface does for cups etc. ...END of RANT...

response
As I clearly stated in a number of emails, I see a big need for both a 
platform GUI that runs on all platforms supported by Bacula and a web 
interface.  My own personal programming preferences are for a platform GUI, 
and after having tried Gnome (I really wanted GTK++ but didn't understand the 
difference at the time), and wx-console (Nicolas).  Neither of these really 
worked out well.  I'm now working on Qt for all the reasons I stated in those 
previous emails, and find it very nice.

I would be pleased to see a nice web interface, and to a good extent, Eric is 
doing that with bweb because from what I understand, brestore now works with 
bweb to restore files.  
/response



 In the meantime - back to my development network reliably secured with
 bacula - Thanks to Kern et al.

 Andrew R Paterson
 DS Ltd.
 www.ds.co.uk





 -Original Message-
 From: [EMAIL PROTECTED]
 [mailto:[EMAIL PROTECTED] Behalf Of Kern
 Sibbald
 Sent: 30 January 2007 7:06PM
 To: bacula-users@lists.sourceforge.net
 Cc: bacula-devel
 Subject: Re: [Bacula-users] Bacula Admin Tool (bat)

 On Tuesday 30 January 2007 17:48, Chris Hoogendyk wrote:
  Ryan Novosielski wrote:
   -BEGIN PGP SIGNED MESSAGE-
   Hash: SHA1
  
   Not to be chomping at the bit here, but I guess questions that I have
   are A) How hard is it likely to be to get this thing built for Windows?
   I don't expect you to have an answer for that as I suppose Robert does
   most of the Windows work, but I'd be curious to know. B) If anyone is
   familiar with this, on Solaris, is there a set of files that one can
   add to a system that is relatively lightweight to support something
   like this? Perhaps you have other KDE apps and know how this works. In
   my experience, most distros want the qt libs package, but then that
   package wants about 30 others.
  
   Thanks for any insights from the peanut gallery. I'd love to start
   using this, but would pass for the time being if it will require
   extensive dependency building.
 
  I'll just reply to the Solaris part.
 
  I typically grab a good deal of this sort of stuff from sunfreeware. I
  try not to get things I don't need, but when you have a chain of
  dependencies, you don't have much choice -- either you want that
  capability or you scrap the whole thing.
 
  I have a directory /usr/local/pkg and a directory /usr/local/src, and I
  keep everything I have installed in one or the other of those. Some
  things you need source, some things it's unnecessary overhead and
  trouble.
 
  For me, Solaris is for servers. My desktop is Mac OS X. I don't use any
  graphical interface on my servers. I typically have a dozen or more
  terminal windows open with ssh sessions.
 
  If I were going to use a gui for something like bacula, I would want it
  at my desktop, not on the server. So, while my backup servers and
  everything would be on Solaris,
 
  I would want a client/server arrangement
  where I could do the administration from a gui on my Mac. Don't know if
  that fits with the current plan, but it seems most logical to me --
  architecturally more robust and not caught up in the exporting of
  graphical interface through something like X11. From my perspective,
  that's not what a server ought to be spending its time doing. I would
  want the bacula install to be modular enough that I wouldn't have to
  install the graphical stuff on my server.

 What is written above is not totally clear to me.  The bat is a GUI
 application that will run on a large variety of machines Linux, Windows,
 Solaris, FreeBSD, Mac OS X and others.  The communications to the Director
 does not use X11 but simple TCP/IP.  There is no requirement to have the
 GUI installed on the server.

  ---
 
  Chris Hoogendyk
 
  -
 O__   Systems Administrator
c/ /'_ --- Biology  Geology Departments
   (*) \(*) -- 140 Morrill Science Center
  ~~ - University of Massachusetts, Amherst
 
  [EMAIL PROTECTED]
 
  ---
 
  Erdös 4
 
 
 
  -
  Take Surveys. Earn Cash. Influence the Future of IT
  

Re: [Bacula-users] Bacula Admin Tool (bat)

2007-01-31 Thread Kern Sibbald
On Wednesday 31 January 2007 14:03, Michel Meyers wrote:
 Andrew Paterson wrote:
  Hi Michel,
  As I understand it bweb is (was) bacula-web which I use at the moment

 I'm not sure, bweb looks radically different from bacula-web. No idea
 whether it was developed from that or is a 'from scratch' effort, 

The two are totally different.

 but it 
 supports drop down menus etc...

 The screenshot on Freshmeat shows it in action:
 http://freshmeat.net/screenshots/33280/35297/

If someone would like to see additional screenshots of bweb, look at the last 
10 slides in:

http://www.bacula.org/presentations/Bacula-FOSDEM-talk-25Feb07.pdf

which is roughly 750K in size.
   

 Greetings,
Michel

 -
 Take Surveys. Earn Cash. Influence the Future of IT
 Join SourceForge.net's Techsay panel and you'll get the chance to share
 your opinions on IT  business topics through brief surveys - and earn cash
 http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Final update : Experience with extremely large fileset include lists?

2007-01-31 Thread Alan Davis

I've completed my initial tests with very large include lists with a
successful outcome.

The final test list was intended to simulate a backup file list
generated by a db query to backup new files or files modified by a part
of our production process. The filesystems are in the 30TB range
containing millions of files in hundreds of directories. 

The file list was generated to include only regular files, no links,
devices files, sockets, etc. and excluded bare directory names. All
files were specified using their full path.

The file list had 292296 entries.

It took longer than the default FD-SD timeout of 30 minutes to ingest
the file list from the Director. I've modified the SD to change the
timeout from 30 minutes to 90 minutes to allow the SD to wait long
enough for the FD to begin sending data.

While the FD was reading the file list from the Director the FD was
using nearly 100% of the CPU. This usage then dropped back to a more
normal 10%.

Memory use on the FD was larger than normal, with max_bytes of
approximately 24MB.

Data transfer rates were normal for that server. Time to complete the
backup was no longer than expected for that server and amount of data.

Conclusion : Using a file list consisting of only the files to be backed
up and excluding bare directory entries (which would cause the full
content of the directory to be backed up) is possible and scales
reasonably into the 200,000+ file range. Larger file lists would need to
be tested to determine what, if any, the practical limit of the FD is.



Alan Davis
Senior Architect
Ruckus Network, Inc.
703.464.6578 (o)
410.365.7175 (m)
[EMAIL PROTECTED]
alancdavis AIM
 
 -Original Message-
 From: Alan Davis [mailto:[EMAIL PROTECTED]
 Sent: Tuesday, January 30, 2007 1:29 PM
 To: 'Kern Sibbald'
 Cc: 'bacula-users@lists.sourceforge.net'
 Subject: RE: [Bacula-users] Experience with extremely large fileset
 include lists?
 
 
 During the 38 minutes that it takes the FD to do it's set up the CPU
is
 running at nearly 100% for the FD process. After the FD begins sending
 data to the SD the CPU use drops to around 10%, which is normal for a
 backup on that server. The transfer rate is also about normal. That
server
 has a mix of very large db files and many small files - I expect the
 backup to take at least 12 hours based on prior experience when using
a
 more normal fileset specification based on directory names rather
than
 individual files.
 
 
 Alan Davis
 Senior Architect
 Ruckus Network, Inc.
 703.464.6578 (o)
 410.365.7175 (m)
 [EMAIL PROTECTED]
 alancdavis AIM
 
 
  -Original Message-
  From: Kern Sibbald [mailto:[EMAIL PROTECTED]
  Sent: Tuesday, January 30, 2007 12:51 PM
  To: Alan Davis
  Cc: bacula-users@lists.sourceforge.net
  Subject: Re: [Bacula-users] Experience with extremely large fileset
  include lists?
 
  On Tuesday 30 January 2007 17:39, Alan Davis wrote:
   I've modified the timeout in stored/job.c to allow the SD to wait
90
   minutes instead of 30, recompiled and installed the modified SD.
  
   The test job takes about 38 minutes for the FD to process the
fileset,
   with the FD memory used :
  
   Heap: bytes=24,593,473 max_bytes=25,570,460 bufs=296,047
   max_bufs=298,836
 
  Yes, 24MB is really large memory utilization.
 
  
   The SD waited for the FD to connect and is running the job as
 expected.
 
  I'll be interested to hear the results of running the job.  I
suspect
 that
  it
  will be catastrophically slow.
 
  
  
  
   
   Alan Davis
   Senior Architect
   Ruckus Network, Inc.
   703.464.6578 (o)
   410.365.7175 (m)
   [EMAIL PROTECTED]
   alancdavis AIM
  
-Original Message-
From: Alan Davis [mailto:[EMAIL PROTECTED]
Sent: Tuesday, January 30, 2007 10:44 AM
To: 'Kern Sibbald'; 'bacula-users@lists.sourceforge.net'
Subject: RE: [Bacula-users] Experience with extremely large
fileset
include lists?
   
Returning to the original thread...
   
Just to make sure I'm being clear - my FileSet specification is:
   
FileSet {
  Name = u2LgFileList
  Include {
Options {
  signature = MD5
}
File = /local/etc/u2LgFileList.list
   
  }
}
   
The file /local/etc/u2LgFileList.list has 29K+ entries in it.
Note that this is /not/ an exclude list - it's explicitly
listing
 the
files to be backed up.
   
The FD takes about 40 minutes to read in the file list.
The SD times out in 30 minutes waiting for the FD.
   
From my reading of the manual there are directives that set the
time
  
   that
  
the Director will wait for an FD to respond FD Connect Timeout
and
  
   the
  
time that the FD will wait for the SD to respond SD Connect
 Timeout
  
   as
  
well as the Heartbeat Interval that will keep the connection
open
  
   during
  
long backups.
   
I've not found a directive to modify the length of time that the
SD
  
   will
  
wait for the FD to begin 

Re: [Bacula-users] force status full

2007-01-31 Thread Manuel Staechele
 i want every media LastWritten 7 days ago to go in full status.
 because if the media is append, it will not automatic pruned
 i have wrote a little sql query to do the job, but want ask if there is
 a better, than execute the sql query every day.
 
 I'll let others on this list answer your question, but in your SQL below, I 
 see no reason to change a Used status to Full.
 
 sql query:

 UPDATE Media SET
VolStatus = 'Full'
 WHERE (VolStatus = 'Append' or VolStatus = 'Used')
AND LastWritten  NOW() - interval 7 DAY


yes ok, my failure i was not sure about status Used.

so i want to update Media Table after Job BackupCatalog. Is there any 
other solution for what i want?

thanks in advance

manuel

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Chris Hoogendyk


Dan Langille wrote:
 On 31 Jan 2007 at 11:28, Davide Bolcioni wrote:

   
 Kern Sibbald wrote:

 
 Another thing to check for is HP printers on the network, which have
 the nasty habit of using non-registered ports e.g. 9001, 9002, or
 9003, which can cause disconnects by Bacula.  If you find printers
 probing/using those ports, either reconfigure the printers or Bacula
 (preferably the former since the ports are officially registered by
 IANA to Bacula).
   
 Port conflicts are a known annoyance, but maybe it would help to
 disseminate the information about Bacula usage, for example here:

   http://en.wikipedia.org/wiki/List_of_TCP_and_UDP_port_numbers
 

 The Bacula ports are listed there.

 And Bacula is listed here: http://en.wikipedia.org/wiki/Bacula

   
 Should the need to introduce incompatible changes in the protocol
 arise, which I guess would be Bacula 3.0, maybe a different set of
 default ports could be considered ? HP networked printers are fairly
 common.
 

 Bacula is registered with IANA, which is the definite source as well 
 as listed in the protocol database:

http://www.isecom.info/cgi-local/protocoldb/browse.dsp

 Yes, I know it does not make much difference given that HP did and 
 does not do the right thing.

I passed an earlier message from this thread along to my network expert, 
because we have had some complaints about recent HP stuff. I'm only 
casually up on that stuff.

I was surprised by his answer, but not by his depth of knowledge. So, 
I'm passing it along just so you all have it. Please note that lprng and 
cups are two of the most widely used printing systems. Mac OS X uses 
cups, and lprng is frequently recommended as a replacement system for 
people in linux/unix environments who want some added capability.


  Chris, I would hope someone would point out to the list that ONLY 
ports  1024 historically
  are well known ports, and those  4096 are sort of registered.  So 
far as I am aware there is
  no binding registration for ports  4096.  But far worse is the fact 
that not just HP printers
  use port 9100.  So do almost all printers which use the idea of a 
service port, and this is
  supported by default in lprng and in cups.  If bacula is on port 9100 
that is a totally bad idea. 
  Bacula ought to have gotten a port registered by IANA in the reserved 
range rather than just
  grabbing ports that have long been in use for printing.
 
   just thought you would find the comments about HP printers at the 
end of this interesting.
  
   I don't get why a printer would be probing -- it should be a 
service, just sitting there
   responding to requests and taking jobs (except when it starts up 
and needs to know its
   assigned information).
  
  
   Chris Hoogendyk


---

Chris Hoogendyk

-
   O__   Systems Administrator
  c/ /'_ --- Biology  Geology Departments
 (*) \(*) -- 140 Morrill Science Center
~~ - University of Massachusetts, Amherst 

[EMAIL PROTECTED]

--- 

Erdös 4



-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Don't understand error

2007-01-31 Thread Richard White
 Tape files are different than actual files.  But the fact that you
see
 neither files nor bytes indicates (to me) that your doing spooling?

Pardon my newbieness, but I'm not sure. I recall seeing a message
during a backup relating to despooling, so maybe I do have spooling set
up.

I should have looked into the log file and posted the pertinent portion
of it in my original post. Here it is:

29-Jan 16:07 lbackup-dir: sql_find.c:132 No Job record found: ERR=
CMD=SELECT StartTime FROM Job WHERE JobStatus='T' AND Type='B' AND
Level='F' AND Name='ArcIMS' AND ClientId=11 AND FileSetId=39 ORDER BY
StartTime DESC LIMIT 1
29-Jan 16:07 lbackup-dir: No prior or suitable Full backup found. Doing
FULL backup.
29-Jan 16:07 lbackup-dir: Start Backup JobId 1462,
Job=ArcIMS.2007-01-29_16.07.46
29-Jan 18:07 lbackup-dir: ArcIMS.2007-01-29_16.07.46 Fatal error:
Network error with FD during Backup: ERR=Connection reset by peer
29-Jan 18:07 lbackup-dir: ArcIMS.2007-01-29_16.07.46 Fatal error: No
Job status returned from FD.
29-Jan 18:07 lbackup-dir: ArcIMS.2007-01-29_16.07.46 Error: Bacula
1.36.3 (22Apr05): 29-Jan-2007 18:07:51

The connection is being reset by peer, and then there is No Job
status returned from FD.

What causes this?




-- 

Tks n rgds,
Richard White CNE6
Network Engineer
Mason County, Washington
360-427-5501
[EMAIL PROTECTED] 


-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Davide Bolcioni
On Wednesday 31 January 2007 1:29 pm, Dan Langille wrote:

  Port conflicts are a known annoyance, but maybe it would help to
  disseminate the information about Bacula usage, for example here:
 
http://en.wikipedia.org/wiki/List_of_TCP_and_UDP_port_numbers

 The Bacula ports are listed there.

I stand corrected ... the Bacula ports are 9101-9103, not 9001-9003 as in my 
original message. Unfortunately, these are also the port used by HP printers.

  Should the need to introduce incompatible changes in the protocol
  arise, which I guess would be Bacula 3.0, maybe a different set of
  default ports could be considered ? HP networked printers are fairly
  common.

 Bacula is registered with IANA, which is the definite source as well
 as listed in the protocol database:

http://www.isecom.info/cgi-local/protocoldb/browse.dsp

 Yes, I know it does not make much difference given that HP did and
 does not do the right thing.

I think we agree on this. Should the need arise for a protocol change, 
however, picking another set of ports might be an option.

Thank you for your consideration,
Davide Bolcioni
-- 
There is no place like /home.

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Dan Langille
On 31 Jan 2007 at 10:38, Chris Hoogendyk wrote:

 
 
 Dan Langille wrote:
  On 31 Jan 2007 at 11:28, Davide Bolcioni wrote:
 

  Kern Sibbald wrote:
 
  
  Another thing to check for is HP printers on the network, which
  have the nasty habit of using non-registered ports e.g. 9001,
  9002, or 9003, which can cause disconnects by Bacula.  If you find
  printers probing/using those ports, either reconfigure the
  printers or Bacula (preferably the former since the ports are
  officially registered by IANA to Bacula).

  Port conflicts are a known annoyance, but maybe it would help to
  disseminate the information about Bacula usage, for example here:
 
http://en.wikipedia.org/wiki/List_of_TCP_and_UDP_port_numbers
  
 
  The Bacula ports are listed there.
 
  And Bacula is listed here: http://en.wikipedia.org/wiki/Bacula
 

  Should the need to introduce incompatible changes in the protocol
  arise, which I guess would be Bacula 3.0, maybe a different set of
  default ports could be considered ? HP networked printers are
  fairly common.
  
 
  Bacula is registered with IANA, which is the definite source as well
  as listed in the protocol database:
 
 http://www.isecom.info/cgi-local/protocoldb/browse.dsp
 
  Yes, I know it does not make much difference given that HP did and
  does not do the right thing.
 
 I passed an earlier message from this thread along to my network
 expert, because we have had some complaints about recent HP stuff. I'm
 only casually up on that stuff.

 I was surprised by his answer, but not by his depth of knowledge. So,
 I'm passing it along just so you all have it. Please note that lprng
 and cups are two of the most widely used printing systems. Mac OS X
 uses cups, and lprng is frequently recommended as a replacement system
 for people in linux/unix environments who want some added capability.

I just spoke with the curator of the protocol database[1] who pointed 
out a few problems with the opinion you were given.  The key points 
are shown below.

[1] - http://www.isecom.info/cgi-local/protocoldb/browse.dsp

   Chris, I would hope someone would point out to the list that ONLY
 ports  1024 historically
   are well known ports, and those  4096 are sort of registered. 
  So 
 far as I am aware there is
   no binding registration for ports  4096.  But far worse is the
  fact 

binding registration?  I wonder what he means by that.  IANA is the 
official word on this matter. The Bacula ports *have* been correctly 
registered with the appropriate authority.  I refer to :

http://www.iana.org/assignments/port-numbers

where I find:

###
The Registered Ports are those from 1024 through 49151

DCCP Registered ports SHOULD NOT be used without IANA registration.
The registration procedure is defined in [RFC4340], Section 19.9.
###

HP did not register the ports.  Bacula did.  Search for Bacula at 
that URL for confirmation.

 that not just HP printers
   use port 9100.  So do almost all printers which use the idea of a
 service port, and this is
   supported by default in lprng and in cups.  If bacula is on port
  9100 
 that is a totally bad idea. 

I'd like to know his reasons for a bad idea.  :)

   Bacula ought to have gotten a port registered by IANA in the
  reserved 
 range rather than just
   grabbing ports that have long been in use for printing.

Now I know he's not researching before speaking.  The above URL 
contains proof.

  
just thought you would find the comments about HP printers at the
  
 end of this interesting.
   
I don't get why a printer would be probing -- it should be a
 service, just sitting there
responding to requests and taking jobs (except when it starts up
 and needs to know its
assigned information).

I am quite interested in your network person's reaction to this.  :)

-- 
Dan Langille : Software Developer looking for work
my resume: http://www.freebsddiary.org/dan_langille.php
PGCon - The PostgreSQL Conference - http://www.pgcon.org/



-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Dan Langille
On 31 Jan 2007 at 16:43, Davide Bolcioni wrote:

 On Wednesday 31 January 2007 1:29 pm, Dan Langille wrote:
 
   Port conflicts are a known annoyance, but maybe it would help to
   disseminate the information about Bacula usage, for example here:
  
 http://en.wikipedia.org/wiki/List_of_TCP_and_UDP_port_numbers
 
  The Bacula ports are listed there.
 
 I stand corrected ... the Bacula ports are 9101-9103, not 9001-9003 as
 in my original message. Unfortunately, these are also the port used by
 HP printers.
 
   Should the need to introduce incompatible changes in the protocol
   arise, which I guess would be Bacula 3.0, maybe a different set of
   default ports could be considered ? HP networked printers are
   fairly common.
 
  Bacula is registered with IANA, which is the definite source as well
  as listed in the protocol database:
 
 http://www.isecom.info/cgi-local/protocoldb/browse.dsp
 
  Yes, I know it does not make much difference given that HP did and
  does not do the right thing.
 
 I think we agree on this. Should the need arise for a protocol change,
 however, picking another set of ports might be an option.

Picking another set of ports, even if we register them properly, 
doesn't mean someone will not use them inappropriatly, as has 
happened in this case.

-- 
Dan Langille : Software Developer looking for work
my resume: http://www.freebsddiary.org/dan_langille.php
PGCon - The PostgreSQL Conference - http://www.pgcon.org/



-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Bill Moran
In response to Chris Hoogendyk [EMAIL PROTECTED]:

[snip]
 
 I passed an earlier message from this thread along to my network expert, 
 because we have had some complaints about recent HP stuff. I'm only 
 casually up on that stuff.
 
 I was surprised by his answer, but not by his depth of knowledge. So, 
 I'm passing it along just so you all have it. Please note that lprng and 
 cups are two of the most widely used printing systems. Mac OS X uses 
 cups, and lprng is frequently recommended as a replacement system for 
 people in linux/unix environments who want some added capability.
 
 
   Chris, I would hope someone would point out to the list that ONLY ports  
 1024 historically
   are well known ports, and those  4096 are sort of registered.

His information is dated.  Historically we only use 2 digits for the year
as well ...

So far as I am aware there is
   no binding registration for ports  4096.  But far worse is the fact that 
 not just HP printers
   use port 9100.  So do almost all printers which use the idea of a service 
 port, and this is
   supported by default in lprng and in cups.

His facts are wrong here.  IPP (i.e. CUPS) uses port 631 and lpd/lpr uses 515.

Those 910x ports are registered to Bacula officially.  There are no internet
police and there's no fine or anything that means that the Jetdirect systems
are doing anything illegal, but it's _only_ jetdirect cards that use those
ports outside of the IANA registration.

Facts:
*) Bacula is registered with IANA to use the 910x ports.  It's official
*) _only_ jetdirect cards use the 910x ports.  CUPS and LPD do not.  If they
   are, it's because you're using some sort of CUPS-jetdirect driver (which
   is actually pretty common) but it's not CUPS, it's the jetdirect driver.

   If bacula is on port 9100 that is a totally bad idea. 

Well, he's welcome to his opinion, but he doesn't seem to have any facts to
back it up.

   Bacula ought to have gotten a port registered by IANA in the reserved 
 range rather than just
   grabbing ports that have long been in use for printing.

Again, he's working off 10-year old data here.  The ports _are_ registered, the
registered port range has been expanded in recent years because there's no
room left for new applications below 1024.

-- 
Bill Moran
Collaborative Fusion Inc.

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] force status full

2007-01-31 Thread Ryan Novosielski
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

I would not recommend doing this, and instead limiting media use by
VolumeUseDuration or MaximumVolumeJobs. Homegrown queries are probably
not the easiest things to follow in the future, and there is really no
need for them, I wouldn't think.

Manuel Staechele wrote:
 i want every media LastWritten 7 days ago to go in full status.
 because if the media is append, it will not automatic pruned
 i have wrote a little sql query to do the job, but want ask if there is
 a better, than execute the sql query every day.
 I'll let others on this list answer your question, but in your SQL below, I 
 see no reason to change a Used status to Full.

 sql query:

 UPDATE Media SET
VolStatus = 'Full'
 WHERE (VolStatus = 'Append' or VolStatus = 'Used')
AND LastWritten  NOW() - interval 7 DAY
 
 
 yes ok, my failure i was not sure about status Used.
 
 so i want to update Media Table after Job BackupCatalog. Is there any 
 other solution for what i want?
 
 thanks in advance
 
 manuel
 
 -
 Take Surveys. Earn Cash. Influence the Future of IT
 Join SourceForge.net's Techsay panel and you'll get the chance to share your
 opinions on IT  business topics through brief surveys - and earn cash
 http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

- --
  _  _ _  _ ___  _  _  _
 |Y#| |  | |\/| |  \ |\ |  | |Ryan Novosielski - Systems Programmer III
 |$| |__| |  | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922)
 \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.5 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFFwL0xmb+gadEcsb4RAu3fAJwNTMQck3t1OTpfB9eY+5ymZz//OwCeKGXX
XNJqvllSoOmdgZ166IMtLas=
=dtRf
-END PGP SIGNATURE-


-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Ryan Novosielski
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Dan Langille wrote:
 On 31 Jan 2007 at 16:43, Davide Bolcioni wrote:
 
 On Wednesday 31 January 2007 1:29 pm, Dan Langille wrote:

 Port conflicts are a known annoyance, but maybe it would help to
 disseminate the information about Bacula usage, for example here:

   http://en.wikipedia.org/wiki/List_of_TCP_and_UDP_port_numbers
 The Bacula ports are listed there.
 I stand corrected ... the Bacula ports are 9101-9103, not 9001-9003 as
 in my original message. Unfortunately, these are also the port used by
 HP printers.

 Should the need to introduce incompatible changes in the protocol
 arise, which I guess would be Bacula 3.0, maybe a different set of
 default ports could be considered ? HP networked printers are
 fairly common.
 Bacula is registered with IANA, which is the definite source as well
 as listed in the protocol database:

http://www.isecom.info/cgi-local/protocoldb/browse.dsp

 Yes, I know it does not make much difference given that HP did and
 does not do the right thing.
 I think we agree on this. Should the need arise for a protocol change,
 however, picking another set of ports might be an option.
 
 Picking another set of ports, even if we register them properly, 
 doesn't mean someone will not use them inappropriatly, as has 
 happened in this case.

Most HP printers only use 9100. This wouldn't really be a problem
anyway, as it really doesn't matter what ports a printer is listening
on. You're obviously not going to be running bacula on a printer (and
vv., probably not running any JetDirect-related service on your host),
so it's fairly irrelevant. Here, though, excerpted from IANA* is the
last word on the matter:

hp-pdl-datastr  9100/tcpPDL Data Streaming Port
hp-pdl-datastr  9100/udpPDL Data Streaming Port
#   Shivaun Albright [EMAIL PROTECTED]
April 2002
 The protocol name pdl-datastream is primarily registered for use

 in DNS SRV records (RFC 2782). DNS SRV records allow a protocol to
run on 
 any port number, but the default port for this protocol is 9100 .
pdl-datastream  9100/tcpPrinter PDL Data Stream
pdl-datastream  9100/udpPrinter PDL Data Stream
#   Stuart Cheshire [EMAIL PROTECTED]
September 2002
bacula-dir  9101/tcpBacula Director
bacula-dir  9101/udpBacula Director
bacula-fd   9102/tcpBacula File Daemon
bacula-fd   9102/udpBacula File Daemon
bacula-sd   9103/tcpBacula Storage Daemon
bacula-sd   9103/udpBacula Storage Daemon

...HP /did/ correctly register 9100 and that's all my printers listen on:

# telnet 10.4.64.70 9100
Trying...
Connected to 10.4.64.70.
Escape character is '^]'.

telnet close
Connection closed.
# telnet 10.4.64.70 9101
Trying...
telnet: Unable to connect to remote host: Connection refused
# telnet 10.4.64.70 9102
Trying...
telnet: Unable to connect to remote host: Connection refused
# telnet 10.4.64.70 9103
Trying...
telnet: Unable to connect to remote host: Connection refused

You /can/ use 910x if you want for additional queues on one printer (I
guess if you have a fancier device), but this is just to keep the ports
near each other on the device. I haven't seen anyplace where HP
necessarily recommends using them, and they are not required for normal
operation of a printer.

So, I guess in summation, Nothing to see here, or What's the problem?

*IANA port list: http://www.iana.org/assignments/port-numbers

- --
  _  _ _  _ ___  _  _  _
 |Y#| |  | |\/| |  \ |\ |  | |Ryan Novosielski - Systems Programmer III
 |$| |__| |  | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922)
 \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.5 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFFwMLHmb+gadEcsb4RAv2/AJ9TxX8SSq3g/UC50laZAwnfpyAF3wCgx8mR
KQ5nFerKs3fbZhjYhn+A058=
=WRLJ
-END PGP SIGNATURE-


-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Dan Langille
On 31 Jan 2007 at 11:24, Ryan Novosielski wrote:

 So, I guess in summation, Nothing to see here, or What's the
 problem?
 
 *IANA port list: http://www.iana.org/assignments/port-numbers

Well, HP does use those ports:

http://www.isecom.info/cgi-
local/protocoldb/browse.dsp?search=1fld1=1opr1=4val1=9100rows=25s
ubmit=search

OR http://tinyurl.com/2vzpqa

Which refers to 
http://h2.www2.hp.com/bizsupport/TechSupport/Document.jsp?objectID
=bpj01014 OR  http://tinyurl.com/3agmm7

Confirmation that HP is using ports 9101 and 9102 which are 
registered to Bacula.

-- 
Dan Langille : Software Developer looking for work
my resume: http://www.freebsddiary.org/dan_langille.php
PGCon - The PostgreSQL Conference - http://www.pgcon.org/



-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Ryan Novosielski
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1



Dan Langille wrote:
 On 31 Jan 2007 at 11:24, Ryan Novosielski wrote:
 
 So, I guess in summation, Nothing to see here, or What's the
 problem?

 *IANA port list: http://www.iana.org/assignments/port-numbers
 
 Well, HP does use those ports:
 
 http://www.isecom.info/cgi-
 local/protocoldb/browse.dsp?search=1fld1=1opr1=4val1=9100rows=25s
 ubmit=search
 
 OR http://tinyurl.com/2vzpqa
 
 Which refers to 
 http://h2.www2.hp.com/bizsupport/TechSupport/Document.jsp?objectID
 =bpj01014 OR  http://tinyurl.com/3agmm7
 
 Confirmation that HP is using ports 9101 and 9102 which are 
 registered to Bacula.

Even so, a very small overlap:

* 9100 TCP port is used for printing. Port numbers 9101 and 9102 are for
parallel ports 2 and 3 on the three-port HP Jetdirect external print
servers.

...and if I'm not mistaken, this is configurable. Is there any way that
this will actually affect anyone? Seems unlikely to me (unless you have
a firewall rule going after HP printer traffic that whacks Bacula in the
process).

- --
  _  _ _  _ ___  _  _  _
 |Y#| |  | |\/| |  \ |\ |  | |Ryan Novosielski - Systems Programmer III
 |$| |__| |  | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922)
 \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.5 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFFwMjemb+gadEcsb4RAhlxAKCv1RsABoM5bOyUIRWXT7vODs6IzwCeJB2F
MMFuisdRpqJJJn8VHrO+quc=
=U0L/
-END PGP SIGNATURE-


-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Final update : Experience with extremely large fileset include lists?

2007-01-31 Thread Kern Sibbald
Hello,

Very interesting results, not too surprising.  See below ...

On Wednesday 31 January 2007 15:52, Alan Davis wrote:
 I've completed my initial tests with very large include lists with a
 successful outcome.

 The final test list was intended to simulate a backup file list
 generated by a db query to backup new files or files modified by a part
 of our production process. The filesystems are in the 30TB range
 containing millions of files in hundreds of directories.

 The file list was generated to include only regular files, no links,
 devices files, sockets, etc. and excluded bare directory names. All
 files were specified using their full path.

 The file list had 292296 entries.

 It took longer than the default FD-SD timeout of 30 minutes to ingest
 the file list from the Director. I've modified the SD to change the
 timeout from 30 minutes to 90 minutes to allow the SD to wait long
 enough for the FD to begin sending data.

 While the FD was reading the file list from the Director the FD was
 using nearly 100% of the CPU. 

Yes, the list structure of included and excluded files is really intended for 
very small numbers.  I think you could get a *very* significant reduction in 
the time needed to ingest the file list from the Director by modifying line 
699 of bacula-source/src/filed/job.c from:

  fileset-incexe-name_list.init(1, true);

to

  fileset-incexe-name_list.init(1, true);

The 10,000 may be a bit of over kill, and you could very likely get almost 
equally good performance by setting it to 1000.  It seems to me that setting 
it to 10,000 is worth a try.  It is not something I would do in the 
mainstream code, but it would probably solve your performance problem.  I 
would have no problem to set it to say 100 in the mainstream code.

A better solution (probably), but one requiring more work would be to change 
the list from an alist (allocated, indexed list) to a dlist (doubly linked 
list).  For an alist adding a new member is very expensive when the growth 
size of the list (first argument above) is exceeded.  On the other hand, 
adding a new member is no more expensive than adding any other member for a 
dlist.

I'll be interested how much the change I suggest above will improve things ...

Best regards, 

Kern

 This usage then dropped back to a more 
 normal 10%.

 Memory use on the FD was larger than normal, with max_bytes of
 approximately 24MB.

 Data transfer rates were normal for that server. Time to complete the
 backup was no longer than expected for that server and amount of data.

 Conclusion : Using a file list consisting of only the files to be backed
 up and excluding bare directory entries (which would cause the full
 content of the directory to be backed up) is possible and scales
 reasonably into the 200,000+ file range. Larger file lists would need to
 be tested to determine what, if any, the practical limit of the FD is.


 
 Alan Davis
 Senior Architect
 Ruckus Network, Inc.
 703.464.6578 (o)
 410.365.7175 (m)
 [EMAIL PROTECTED]
 alancdavis AIM

  -Original Message-
  From: Alan Davis [mailto:[EMAIL PROTECTED]
  Sent: Tuesday, January 30, 2007 1:29 PM
  To: 'Kern Sibbald'
  Cc: 'bacula-users@lists.sourceforge.net'
  Subject: RE: [Bacula-users] Experience with extremely large fileset
  include lists?
 
 
  During the 38 minutes that it takes the FD to do it's set up the CPU

 is

  running at nearly 100% for the FD process. After the FD begins sending
  data to the SD the CPU use drops to around 10%, which is normal for a
  backup on that server. The transfer rate is also about normal. That

 server

  has a mix of very large db files and many small files - I expect the
  backup to take at least 12 hours based on prior experience when using

 a

  more normal fileset specification based on directory names rather

 than

  individual files.
 
  
  Alan Davis
  Senior Architect
  Ruckus Network, Inc.
  703.464.6578 (o)
  410.365.7175 (m)
  [EMAIL PROTECTED]
  alancdavis AIM
 
   -Original Message-
   From: Kern Sibbald [mailto:[EMAIL PROTECTED]
   Sent: Tuesday, January 30, 2007 12:51 PM
   To: Alan Davis
   Cc: bacula-users@lists.sourceforge.net
   Subject: Re: [Bacula-users] Experience with extremely large fileset
   include lists?
  
   On Tuesday 30 January 2007 17:39, Alan Davis wrote:
I've modified the timeout in stored/job.c to allow the SD to wait

 90

minutes instead of 30, recompiled and installed the modified SD.
   
The test job takes about 38 minutes for the FD to process the

 fileset,

with the FD memory used :
   
Heap: bytes=24,593,473 max_bytes=25,570,460 bufs=296,047
max_bufs=298,836
  
   Yes, 24MB is really large memory utilization.
  
The SD waited for the FD to connect and is running the job as
 
  expected.
 
   I'll be interested to hear the results of running the job.  I

 suspect

  that
 
   it
   will be catastrophically slow.
  

Alan Davis
Senior 

Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Kern Sibbald
On Wednesday 31 January 2007 16:38, Chris Hoogendyk wrote:
 Dan Langille wrote:
  On 31 Jan 2007 at 11:28, Davide Bolcioni wrote:
  Kern Sibbald wrote:
  Another thing to check for is HP printers on the network, which have
  the nasty habit of using non-registered ports e.g. 9001, 9002, or
  9003, which can cause disconnects by Bacula.  If you find printers
  probing/using those ports, either reconfigure the printers or Bacula
  (preferably the former since the ports are officially registered by
  IANA to Bacula).
 
  Port conflicts are a known annoyance, but maybe it would help to
  disseminate the information about Bacula usage, for example here:
 
http://en.wikipedia.org/wiki/List_of_TCP_and_UDP_port_numbers
 
  The Bacula ports are listed there.
 
  And Bacula is listed here: http://en.wikipedia.org/wiki/Bacula
 
  Should the need to introduce incompatible changes in the protocol
  arise, which I guess would be Bacula 3.0, maybe a different set of
  default ports could be considered ? HP networked printers are fairly
  common.
 
  Bacula is registered with IANA, which is the definite source as well
  as listed in the protocol database:
 
 http://www.isecom.info/cgi-local/protocoldb/browse.dsp
 
  Yes, I know it does not make much difference given that HP did and
  does not do the right thing.

 I passed an earlier message from this thread along to my network expert,
 because we have had some complaints about recent HP stuff. I'm only
 casually up on that stuff.

 I was surprised by his answer, but not by his depth of knowledge. So,
 I'm passing it along just so you all have it. Please note that lprng and
 cups are two of the most widely used printing systems. Mac OS X uses
 cups, and lprng is frequently recommended as a replacement system for
 people in linux/unix environments who want some added capability.

   Chris, I would hope someone would point out to the list that ONLY

 ports  1024 historically

   are well known ports, and those  4096 are sort of registered.  So

 far as I am aware there is

   no binding registration for ports  4096.  But far worse is the fact

 that not just HP printers

   use port 9100.  So do almost all printers which use the idea of a

 service port, and this is

   supported by default in lprng and in cups.  If bacula is on port 9100

 that is a totally bad idea.

   Bacula ought to have gotten a port registered by IANA in the reserved

 range rather than just

   grabbing ports that have long been in use for printing.
  
just thought you would find the comments about HP printers at the

 end of this interesting.

I don't get why a printer would be probing -- it should be a

 service, just sitting there

responding to requests and taking jobs (except when it starts up

 and needs to know its

assigned information).

Thanks for the feedback.  Your network guru certainly does know something 
about ports, but I'm not sure that we totally agree ...

A few of points:
1. Bacula does have IANA registered ports.  The port numbers were defined and 
officially supplied by IANA.

2. The Bacula ports are 9101, 9102, and 9103.

3. HP uses port 9100, but without having obtained authorization from IANA. I 
am not sure if HP has ever registered its port. IANA *is* aware that HP 
network printers use port 9100 (by default -- the port can be configured).

4. It is not possible for an application such as Bacula to have a port number 
= 1024 -- just try asking IANA for one, and you will understand :-)

5. Registered ports go much higher than 4096.  The proof is the fact that 
Bacula's ports are registered (see the link Dan gave).

6. My terminology of saying that HP printers probe may not be accurate, but 
users have previously reported that once they remove HP printers from the 
same network as Bacula, the problems go away, so I can only assume that the 
printer is intercepting data meant for a Bacula daemon and responding to 
it -- which is what I meant by probing.  In any case, if the printer is 
causing problems every 5 minutes, then it is probing (or broadcasting). What 
conditions, if they really exist, that cause HP printers to use ports other 
than 9100, I cannot say.  I have a Dell network printer at home, which I 
assume is a rebranded HP printer. It uses port 9100 but has never, to my 
knowledge caused problems with Bacula.  Of course, I have never used it at 
the same time a production backup was running (my test backups use ports 
8101-8103).

As far as I am concerned, I have no gripe with HP, though it would be better 
if they followed the rules.  I just point this out for Bacula users who *may* 
(or may not) be affected by this so that they can work around it (if it is 
the problem).

Best regards,

Kern



   
   
Chris Hoogendyk

 ---

 Chris Hoogendyk

 -
O__   Systems Administrator
   c/ /'_ --- Biology  Geology Departments
  (*) \(*) -- 140 Morrill Science Center
 ~~ - University of Massachusetts, Amherst

 

Re: [Bacula-users] Some remarks

2007-01-31 Thread Ryan Novosielski
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Miki Lewinger wrote:

 3) I feel that the bacula-dir.conf file is manageable up to a certain 
 number of clients/jobs... It doesn't scale up well to more than X (in my 
 case x=35). Shouldn't this be saved in the bacula sql database as well ? 
 Thus, the clients, jobs, storage, etc directives could be more easily 
 separated from each other, and SQL queries used for the different 
 resources. Separating the different resources in separate conf files 
 doesn't sound much of an improvement IMO...

Harder to restore in a disaster in this case is really the answer that
I've heard given most. I'd be inclined to agree that the config files
are easier to work with if you don't need a 100% working system too
early in the process.

- --
  _  _ _  _ ___  _  _  _
 |Y#| |  | |\/| |  \ |\ |  | |Ryan Novosielski - Systems Programmer III
 |$| |__| |  | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922)
 \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.5 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFFwNGAmb+gadEcsb4RAs8RAKCBGgTuV4gyW7gGCJ94g/qVhxTV0QCfQF5P
/X/EhEDgENJdwSgx2bJYbrw=
=7e6f
-END PGP SIGNATURE-


-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Davide Bolcioni
On Wednesday 31 January 2007 5:50 pm, Ryan Novosielski wrote:

 Even so, a very small overlap:

 * 9100 TCP port is used for printing. Port numbers 9101 and 9102 are for
 parallel ports 2 and 3 on the three-port HP Jetdirect external print
 servers.

 ...and if I'm not mistaken, this is configurable. Is there any way that
 this will actually affect anyone ? Seems unlikely to me (unless you have
 a firewall rule going after HP printer traffic that whacks Bacula in the
 process).

Unlucky people exist :-( ... this might be the reason behind a few hard to 
replicate nightly failures I had with Bacula at my previous job. The problem 
is unlikely to be with the printers listening, but rather with printer 
drivers scanning the network for autoconfiguration. I am no longer in the 
position to test this; at the time, Bacula was at 1.36.x so this might have 
been corrected in the meantime.

Thank you for your consideration,
Davide Bolcioni
-- 
There is no place like /home.

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] (2.0.1) 5 minute 5 seconds problem

2007-01-31 Thread Darien Hager
(Looks like my last message was misaddressed. Resending.)

On Jan 30, 2007, at 1:09 PM, Kern Sibbald wrote:
 Another thing to check for is HP printers on the network [...]

I don't think that's the problem in my case. While we have an HP  
server on our internal office network, the two servers I was testing  
with are actually in seperate colo facilities. While printers  
recklessly probing ports may cause problems, it still seems a bit of  
a stretch that such interference happens almost precisely 00:05:03 to  
00:05:05  after the beginning of every job.

--

Okay, I've tested with the FD on a different host entirely, and *now*  
it works. But I still want to back up that other host someday...

Here's my previous set-up and theory for failure:

Director/SD/Console on machine server.
FD on the client.

The client machine has a funky IP situation: It's incoming IP  
addresses is not the same as it's outgoing IP address. I have no idea  
why, but wish I did. (One-way NAT?)

1. The Director talks to the SD and gets a token it can pass to the FD.
2. The Director tells the FD connect to the SD at this address with  
this token.
3. The FD connects to the SD, and is accepted. Begins sending data...

But the Director's idea of what the FD's IP address is is somehow  
different from what the SD will register, because the connections  
were originated from different directions.

While it's still possible somebody has some firewall rules I'm not  
being told about (ones which somehow don't affect Netcat)... What  
would happen if an FD connected to the SD with a different IP address  
(but a correct token) than the hostname or IP address the director  
believes it should have?

--
--Darien A. Hager
[EMAIL PROTECTED]
Mobile: (206) 734-5666



-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Splitting config files

2007-01-31 Thread Brian Debelius
Hello,

I am trying to split up a config file on Windows, using the @ directive 
as shown in 
http://www.bacula.org/dev-manual/Customizin_Configurat_Files.html but it 
returns an error that it cannot find the file.  Has anyone done this in 
Windows?

Thanks
Brian

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Splitting config files

2007-01-31 Thread Darien Hager

On Jan 31, 2007, at 10:46 AM, Brian Debelius wrote:
 I am trying to split up a config file on Windows, using the @  
 directive
 as shown in http://www.bacula.org/dev-manual/ 
 Customizin_Configurat_Files.html but it
 returns an error that it cannot find the file.  Has anyone done  
 this in
 Windows?

I haven't tried it in windows, but some quick ideas:
1. Try absolute pathnames if you aren't already--it didn't like  
relative ones for me on Linux.
2. Try escaping Window's backslashes with an additional backslash,  
e.g. @C:\\folder\\file
3. If those don't work, can you post what some details or examples of  
what isn't working?

--
--Darien A. Hager
[EMAIL PROTECTED]



-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Splitting config files

2007-01-31 Thread mikee
On Wed, 31 Jan 2007, Brian Debelius might have said:

 Hello,
 
 I am trying to split up a config file on Windows, using the @ directive 
 as shown in 
 http://www.bacula.org/dev-manual/Customizin_Configurat_Files.html but it 
 returns an error that it cannot find the file.  Has anyone done this in 
 Windows?

I plan on eventually putting all my config files, not only the bacula
config files, into twiki and have twiki export the files, restart services
when things change, etc.

Mike

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Chris Hoogendyk
please read to the bottom before commenting on stuff in the middle. -- 
Chris H.

Bill Moran wrote:
 In response to Chris Hoogendyk [EMAIL PROTECTED]:

 [snip]
  
   
 I passed an earlier message from this thread along to my network expert, 
 because we have had some complaints about recent HP stuff. I'm only 
 casually up on that stuff.

 I was surprised by his answer, but not by his depth of knowledge. So, 
 I'm passing it along just so you all have it. Please note that lprng and 
 cups are two of the most widely used printing systems. Mac OS X uses 
 cups, and lprng is frequently recommended as a replacement system for 
 people in linux/unix environments who want some added capability.


   Chris, I would hope someone would point out to the list that ONLY ports  
 1024 historically
   are well known ports, and those  4096 are sort of registered.
 

 His information is dated.  Historically we only use 2 digits for the year
 as well ...

   
So far as I am aware there is
   no binding registration for ports  4096.  But far worse is the fact that 
 not just HP printers
   use port 9100.  So do almost all printers which use the idea of a 
 service port, and this is
   supported by default in lprng and in cups.
 

 His facts are wrong here.  IPP (i.e. CUPS) uses port 631 and lpd/lpr uses 515.
   

dated is one thing. wrong is another.

if historical equipment is on the network, you have to deal with it.

if current protocols recognize that history, you have to deal with it.

you are correct about IPP and LPD, but you missed PDL-datastream, which 
is 9100. I almost never find his [my network expert] facts to be wrong.

check out: http://www.chebucto.ns.ca/~rakerman/port-table.html#printing 
, and you will find also that Apple Mac OS X Rendezvous Printing will 
use port 9100. So there is a discovery process that goes on here and not 
just listening. That might constitute poking or probing to someone 
who is using the port for some other reason and not expecting this.

 Those 910x ports are registered to Bacula officially.  There are no internet
 police and there's no fine or anything that means that the Jetdirect systems
 are doing anything illegal, but it's _only_ jetdirect cards that use those
 ports outside of the IANA registration.

 Facts:
 *) Bacula is registered with IANA to use the 910x ports.  It's official
 *) _only_ jetdirect cards use the 910x ports.  CUPS and LPD do not.  If they
are, it's because you're using some sort of CUPS-jetdirect driver (which
is actually pretty common) but it's not CUPS, it's the jetdirect driver.
   

Ryan Novosielski pointed out RFC 2782 where this is defined under the protocol 
name pdl-datastream and listed in the IANA port list: 
http://www.iana.org/assignments/port-numbers. Now, you say 910x, but we were 
talking about 9100. Following down from 9100 on the IANA port list, you will 
find 9101, 9102, and 9103 registered to bacula.


   If bacula is on port 9100 that is a totally bad idea. 
 

 Well, he's welcome to his opinion, but he doesn't seem to have any facts to
 back it up.
   

see above.

   Bacula ought to have gotten a port registered by IANA in the reserved 
 range rather than just
   grabbing ports that have long been in use for printing.
 

 Again, he's working off 10-year old data here.  The ports _are_ registered, 
 the
 registered port range has been expanded in recent years because there's no
 room left for new applications below 1024.
   

as we see, 9100 is listed as pdl-datastream.

I went back and reviewed this thread, because I realized there was some 
confusion, and I wanted to know exactly what the original problem was. 
Turns out a good deal of confusion. Kern's message was the first 
reference to HP printers, in which he said to watch out for them, and 
referenced ports 9001, 9002, 9003. He meant 9101, 9102, 9103. My network 
expert saw the reference to HP printers and the 9000 range and replied 
back about the 9100 port (assuming, if there was a conflict, bacula must 
be using that port). As far as I can tell, that was the first reference 
specifically to 9100. Subsequent replies to his comments referred to 
910x for bacula, but still reacted to his comment about 9100.

I apologize for forwarded those comments without first checking out 
precisely which port numbers were in question and adding clarifying 
language regarding assumptions.

I think Ryan's comments have been most useful and informative.

As far as I can tell, no one is reporting currently having problems 
traceable to these printer related questions. I don't see any point in 
pursuing further discussion unless someone has some actual current data 
specifically relating to conflicting traffic on ports 9101, 9102 or 9103 
(bacula does not use 9100).

(I just read Kern's latest reply which clarifies some of the same stuff 
I've mentioned above).



---

Chris Hoogendyk

-
   O__   Systems Administrator
  c/ /'_ --- Biology  Geology 

[Bacula-users] Linksys is killing socket between director and SD

2007-01-31 Thread Brad Peterson
Aaah, I've finally figured it out.  The very common Linksys WRT54G v5 router IS 
dropping inactive sockets after exactly 10 minutes. 

I verified this through a process of elimination.  Any time the Linksys router 
was used, I'd get a socket drop at 10 minutes (wireless or ethernet cable 
included).  But when I bypassed the Linksys router and kept everything else the 
same, it all worked.

I think that makes any Bacula job longer than 10 minutes impossible using this 
Linksys router.  Looks like I'm out of luck.  I have updated to the newest 
firmware, and the Linksys config doesn't have any ability to modify the timeout 
value.   I suppose I could buy a new router, or set up a new offsite backup 
storage daemon.   Unless anyone else has any brilliant ideas  :)

Kern, if you are reading this, what are the chances that a heartbeat could be 
implemented between the director and the storage daemon?

Brad Peterson
[EMAIL PROTECTED]

  
- Original Message 
From: Brad Peterson [EMAIL PROTECTED]
To: bacula-users@lists.sourceforge.net
Sent: Tuesday, January 30, 2007 3:00:03 PM
Subject: [Bacula-users] Director losing socket with SD

First, my request:  Is there anything in Bacula I can do to keep the socket 
between the director and the storage daemon alive?

Now, my explanation why I need this.  As I'm trying to narrow down why my 
lengthy backups to an offsite storage daemon don't work, I sat and watched the 
debug output for the director, the storage daemon, and the file daemon.  About 
almost exactly 10 minutes in, the director's debug output said this:

msgchan.c:333 === End msg_thread. use=2

After a lot of research, it appears what's going on is this:

1) The director starts the job.
2) A socket is opened between the director and the storage daemon.
3) A socket is opened between the file daemon and the storage daemon.
4) The file data transfers just fine over the file daemon/storage daemon 
socket.  
5) At almost exactly 10 minutes in, I get the above debug message which means 
the socket between the director and storage daemon has been closed.  netstat 
confirmed this.
6) The file data continues to transfer just fine to the storage daemon.
7) When the file daemon is done, it tells the director that it is finished.
8) The storage daemon tries to tell the director it received the data 
perfectly, but cannot, because it cannot communicate with the director anymore 
(which makes sense, because the socket died).
9) *I think* the director waits a bit for the the storage daemon, or it just 
knows it can't receive info from the storage daemon.  In any event, the 
director quickly marks the job as having an error because it never heard from 
the storage daemon as to its final result.

So, what can I do in Bacula to keep the socket between the director and the 
storage daemon alive?

I'v already set a heartbeats of 30 seconds, but according to the manual, the 
heartbeats help the file daemon talk to the director, the file daemon talk to 
the storage daemon, and the storage daemon talk to the file daemon.  But in my 
situation, I'm losing a socket between the director and the storage daemon, and 
the heartbeat doesn't help out with that.

I'm also starting to think a Linksys router may be the reason why it loses the 
inactive socket after almost exactly 10 minutes, as other Linksys users have 
found this happens to them.  I'll be able to test this out tonight by bypassing 
the router completely. 

Anyways, in the meantime, anybody know how I can keep that socket alive?

Brad Peterson
[EMAIL PROTECTED]







 

Don't pick lemons.
See all the new 2007 cars at Yahoo! Autos.
http://autos.yahoo.com/new_cars.html 

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users





 

Do you Yahoo!?
Everyone is raving about the all-new Yahoo! Mail beta.
http://new.mail.yahoo.com

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Splitting config files

2007-01-31 Thread Brian Debelius
Darien Hager wrote:
 On Jan 31, 2007, at 10:46 AM, Brian Debelius wrote:
   
 I am trying to split up a config file on Windows, using the @  
 directive
 as shown in http://www.bacula.org/dev-manual/ 
 Customizin_Configurat_Files.html but it
 returns an error that it cannot find the file.  Has anyone done  
 this in
 Windows?
 

 I haven't tried it in windows, but some quick ideas:
 1. Try absolute pathnames if you aren't already--it didn't like  
 relative ones for me on Linux.
 2. Try escaping Window's backslashes with an additional backslash,  
 e.g. @C:\\folder\\file
 3. If those don't work, can you post what some details or examples of  
 what isn't working?

 --
 --Darien A. Hager
 [EMAIL PROTECTED]
In my bacula-dir.conf I have

@C:\\Documents and Settings\\All Users\\Application 
Data\\Bacula\\schedule.conf

but the directory returns the following error:

31-Jan 14:06 bacula-dir: ERROR TERMINATION at ../../lib/lex.c:545
Config error: Cannot open included config file : No such file or directory

: line 163, col 2 of file C:\Documents and Settings\All 
Users\Application Data\Bacula/bacula-dir.conf
@C:\\Documents and Settings\\All Users\\Application 
Data\\Bacula\\schedule.conf




-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Splitting config files (fwd)

2007-01-31 Thread David Romerstein

On Wed, 31 Jan 2007, Brian Debelius wrote:

 Darien Hager wrote:
 On Jan 31, 2007, at 10:46 AM, Brian Debelius wrote:
 
 I am trying to split up a config file on Windows, using the @
 directive
 as shown in http://www.bacula.org/dev-manual/
 Customizin_Configurat_Files.html but it
 returns an error that it cannot find the file.  Has anyone done
 this in Windows?

 I haven't tried it in windows, but some quick ideas:
 1. Try absolute pathnames if you aren't already--it didn't like
 relative ones for me on Linux.
 2. Try escaping Window's backslashes with an additional backslash,
 e.g. @C:\\folder\\file
 3. If those don't work, can you post what some details or examples of
 what isn't working?

 In my bacula-dir.conf I have
 
 @C:\\Documents and Settings\\All Users\\Application
 Data\\Bacula\\schedule.conf
 
 but the directory returns the following error:
 
 31-Jan 14:06 bacula-dir: ERROR TERMINATION at ../../lib/lex.c:545
 Config error: Cannot open included config file : No such file or directory

: line 163, col 2 of file C:\Documents and Settings\All
 Users\Application Data\Bacula/bacula-dir.conf
 @C:\\Documents and Settings\\All Users\\Application
 Data\\Bacula\\schedule.conf

http://www.bacula.org/dev-manual/FileSet_Resource.html#SECTION00154

If you are entering Windows file names, the directory path may be preceded by 
the drive and a colon (as in c:). However, the path separators must be 
specified in Unix convention (i.e. forward slash (/)). If you wish to include a 
quote in a file name, precede the quote with a backslash (\). For example you 
might use the following for a Windows machine to backup the My Documents 
directory:

FileSet {
   Name = Windows Set
   Include {
 Options {
WildFile = *.obj
WildFile = *.exe
exclude = yes
  }
  File = c:/My Documents
   }
}

-- D

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Splitting config files (fwd)

2007-01-31 Thread Brian Debelius
David Romerstein wrote:
 On Wed, 31 Jan 2007, Brian Debelius wrote:

   
 Darien Hager wrote:
 
 On Jan 31, 2007, at 10:46 AM, Brian Debelius wrote:

   
 I am trying to split up a config file on Windows, using the @
 directive
 as shown in http://www.bacula.org/dev-manual/
 Customizin_Configurat_Files.html but it
 returns an error that it cannot find the file.  Has anyone done
 this in Windows?
 

   
 I haven't tried it in windows, but some quick ideas:
 1. Try absolute pathnames if you aren't already--it didn't like
 relative ones for me on Linux.
 2. Try escaping Window's backslashes with an additional backslash,
 e.g. @C:\\folder\\file
 3. If those don't work, can you post what some details or examples of
 what isn't working?
   

   
 In my bacula-dir.conf I have

 @C:\\Documents and Settings\\All Users\\Application
 Data\\Bacula\\schedule.conf

 but the directory returns the following error:

 31-Jan 14:06 bacula-dir: ERROR TERMINATION at ../../lib/lex.c:545
 Config error: Cannot open included config file : No such file or directory

: line 163, col 2 of file C:\Documents and Settings\All
 Users\Application Data\Bacula/bacula-dir.conf
 @C:\\Documents and Settings\\All Users\\Application
 Data\\Bacula\\schedule.conf
 

 http://www.bacula.org/dev-manual/FileSet_Resource.html#SECTION00154

 If you are entering Windows file names, the directory path may be preceded by 
 the drive and a colon (as in c:). However, the path separators must be 
 specified in Unix convention (i.e. forward slash (/)). If you wish to include 
 a 
 quote in a file name, precede the quote with a backslash (\). For example you 
 might use the following for a Windows machine to backup the My Documents 
 directory:

 FileSet {
Name = Windows Set
Include {
  Options {
 WildFile = *.obj
 WildFile = *.exe
 exclude = yes
   }
   File = c:/My Documents
}
 }

 -- D
I changed it to this:
@C:/Documents and Settings/All Users/Application Data/Bacula/schedule.conf

but is still gives an error:
Config error: Cannot open included config file : No such file or directory

: line 163, col 2 of file C:\Documents and Settings\All 
Users\Application Data\Bacula/bacula-dir.conf
@C:/Documents and Settings/All Users/Application Data/Bacula/schedule.conf


-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Splitting config files

2007-01-31 Thread Darien Hager
On Jan 31, 2007, at 11:07 AM, Brian Debelius wrote:
 Config error: Cannot open included config file : No such file or  
 directory

After config file it should list the path it attempted to open.  
 From what you've written it appears blank, suggesting some sort of  
syntax or input issue rather than a filesystem bug etc.

 @C:\\Documents and Settings\\All Users\\Application Data\\Bacula\ 
 \schedule.conf

Hmm. Perhaps ditch the quotes and escape the spaces?

@C:\\Documents\ and\ Settings\\All\ Users\\Application\ Data\\Bacula\ 
\schedule.conf

Another thing you could try is increase the debug level--even while  
testing config files (-t option) you can add the -d### option to get  
more details. It seems it has to be above 200 to show much, and what  
it does show usually isn't too useful... but you never know.

-

On Jan 31, 2007, at 11:27 AM, David Romerstein wrote:
 If you are entering Windows file names, the directory path may be  
 preceded by
 the drive and a colon (as in c:). However, the path separators must be
 specified in Unix convention (i.e. forward slash (/)). If you wish  
 to include a
 quote in a file name, precede the quote with a backslash (\).

He's not having problems in specifying a fileset, though... unless  
the @includefile path syntax is identical for that for filesets?

If so, that suggests:

@C:/Documents and Settings/All Users/Application Data/Bacula/ 
schedule.conf

--Darien A. Hager
[EMAIL PROTECTED]
Mobile: (206) 734-5666



-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Splitting config files

2007-01-31 Thread David Romerstein
On Wed, 31 Jan 2007, Brian Debelius wrote:

 David Romerstein wrote:

 http://www.bacula.org/dev-manual/FileSet_Resource.html#SECTION00154

 If you are entering Windows file names, the directory path may be preceded by
 the drive and a colon (as in c:). However, the path separators must be
 specified in Unix convention (i.e. forward slash (/)). If you wish to 
 include a
 quote in a file name, precede the quote with a backslash (\). For example you
 might use the following for a Windows machine to backup the My Documents
 directory:

 FileSet {
Name = Windows Set
Include {
  Options {
 WildFile = *.obj
 WildFile = *.exe
 exclude = yes
   }
   File = c:/My Documents
}
 }

 I changed it to this:
 @C:/Documents and Settings/All Users/Application Data/Bacula/schedule.conf

 but is still gives an error:
 Config error: Cannot open included config file : No such file or directory

: line 163, col 2 of file C:\Documents and Settings\All
 Users\Application Data\Bacula/bacula-dir.conf
 @C:/Documents and Settings/All Users/Application Data/Bacula/schedule.conf

Check security permissions on that file and the directory it resides in.

-- D

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Linksys is killing socket between director and SD

2007-01-31 Thread Zachariah Mully
On Wed, 2007-01-31 at 11:05 -0800, Brad Peterson wrote:
 Aaah, I've finally figured it out.  The very common Linksys WRT54G v5
 router IS dropping inactive sockets after exactly 10 minutes. 
 
 I verified this through a process of elimination.  Any time the
 Linksys router was used, I'd get a socket drop at 10 minutes (wireless
 or ethernet cable included).  But when I bypassed the Linksys router
 and kept everything else the same, it all worked.
 
 I think that makes any Bacula job longer than 10 minutes impossible
 using this Linksys router.  Looks like I'm out of luck.  I have
 updated to the newest firmware, and the Linksys config doesn't have
 any ability to modify the timeout value.   I suppose I could buy a new
 router, or set up a new offsite backup storage daemon.   Unless anyone
 else has any brilliant ideas  :)
 

Try the DD-WRT firmware on it. I'm pretty sure they now support v5. It's
the best thing since sliced bread.

Z


-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Splitting config files

2007-01-31 Thread Brian Debelius
Darien Hager wrote:
 On Jan 31, 2007, at 11:07 AM, Brian Debelius wrote:
   
 Config error: Cannot open included config file : No such file or  
 directory
 

 After config file it should list the path it attempted to open.  
  From what you've written it appears blank, suggesting some sort of  
 syntax or input issue rather than a filesystem bug etc.

   
 @C:\\Documents and Settings\\All Users\\Application Data\\Bacula\ 
 \schedule.conf
 

 Hmm. Perhaps ditch the quotes and escape the spaces?

 @C:\\Documents\ and\ Settings\\All\ Users\\Application\ Data\\Bacula\ 
 \schedule.conf

 Another thing you could try is increase the debug level--even while  
 testing config files (-t option) you can add the -d### option to get  
 more details. It seems it has to be above 200 to show much, and what  
 it does show usually isn't too useful... but you never know.
   

ok, doing the above helps out a little.  You can now see part of the 
path after the 'config file' line

I changed it to
@C:\\Documents\ and\ Settings\\All\ Users\\Application\ 
Data\\Bacula\\schedule.conf

and the error is
31-Jan 14:40 bacula-dir: ERROR TERMINATION at ../../lib/lex.c:545
Config error: Cannot open included config file C:\\Documents\: No such 
file or directory

: line 163, col 16 of file C:\Documents and Settings\All 
Users\Application Data\Bacula/bacula-dir.conf
@C:\\Documents\ and\ Settings\\All\ Users\\Application\ 
Data\\Bacula\\schedule.conf

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Kern Sibbald
Hello Dan,

Thanks.  Finally! You have provided the proof straight from HP's own documents 
that they do use Bacula registered ports.  It also proves that our users know 
what they are talking about.

Regards,

Kern

On Wednesday 31 January 2007 17:39, Dan Langille wrote:
 On 31 Jan 2007 at 11:24, Ryan Novosielski wrote:
  So, I guess in summation, Nothing to see here, or What's the
  problem?
 
  *IANA port list: http://www.iana.org/assignments/port-numbers

 Well, HP does use those ports:

 http://www.isecom.info/cgi-
 local/protocoldb/browse.dsp?search=1fld1=1opr1=4val1=9100rows=25s
 ubmit=search

 OR http://tinyurl.com/2vzpqa

 Which refers to
 http://h2.www2.hp.com/bizsupport/TechSupport/Document.jsp?objectID
 =bpj01014 OR  http://tinyurl.com/3agmm7

 Confirmation that HP is using ports 9101 and 9102 which are
 registered to Bacula.

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Splitting config files

2007-01-31 Thread Michel Meyers
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Brian Debelius wrote:
 Darien Hager wrote:
 On Jan 31, 2007, at 11:07 AM, Brian Debelius wrote:
 ok, doing the above helps out a little.  You can now see part of the
 path after the 'config file' line

 I changed it to
 @C:\\Documents\ and\ Settings\\All\ Users\\Application\
 Data\\Bacula\\schedule.conf

Maybe trying the good old DOS 8.3 notation will work? ie:

c:\docume~1\alluse~1\applic~1\bacula\schedule.conf

or a variation with double backslashes or single forward slashes.

Just an idea.

Greetings,
   Michel
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (MingW32) - GPGrelay v0.959

iD8DBQFFwPRf2Vs+MkscAyURApdZAJ43brmtb91ZmuC3SgYgj8X+6I5CFACgrgjM
q9bhC4FImRkrJOY2kNSUeA8=
=iC7W
-END PGP SIGNATURE-

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Ryan Novosielski
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Bill Moran wrote:
 In response to Ryan Novosielski [EMAIL PROTECTED]:
 Dan Langille wrote:
 On 31 Jan 2007 at 11:24, Ryan Novosielski wrote:

 So, I guess in summation, Nothing to see here, or What's the
 problem?

 *IANA port list: http://www.iana.org/assignments/port-numbers
 Well, HP does use those ports:

 http://www.isecom.info/cgi-
 local/protocoldb/browse.dsp?search=1fld1=1opr1=4val1=9100rows=25s
 ubmit=search

 OR http://tinyurl.com/2vzpqa

 Which refers to 
 http://h2.www2.hp.com/bizsupport/TechSupport/Document.jsp?objectID
 =bpj01014 OR  http://tinyurl.com/3agmm7

 Confirmation that HP is using ports 9101 and 9102 which are 
 registered to Bacula.
 Even so, a very small overlap:

 * 9100 TCP port is used for printing. Port numbers 9101 and 9102 are for
 parallel ports 2 and 3 on the three-port HP Jetdirect external print
 servers.

 ...and if I'm not mistaken, this is configurable. Is there any way that
 this will actually affect anyone? Seems unlikely to me (unless you have
 a firewall rule going after HP printer traffic that whacks Bacula in the
 process).
 
 I could be wrong, but if memory serves, the problem is not so much that
 HP is using Bacula ports, it's that various HP drivers probe the network
 to automatically find all the printers on the network.
 
 IOW: when MS Windows starts up, the HP printer drivers try to connect to
 port 910x on every host on the network to see if there's a printer there.
 
 Again, I could be wrong on this.

Not sure how one would have to have them configured in order to get the
drivers to do this, but the person or utility setting things up that way
I think deserves more ire than HP. ;) Perhaps people running JetDirect
scans or something like that -- occasionally, discovery is done from
WebJetDirect and things like that. Don't know that they go looking on
9101-3 though. Could well be. However, that leads us to...

...anyone could do this, regardless of the printer. I could telnet to
port 9102 and start rattling off Kafka. I'd assume Bacula would handle
this gracefully and therefore it would not be a problem. If that is not
the case, then that needs looking into. The only real reason HP would be
involved there is that HP printers attract folks who want to screw them
up, so you might end up on the crossfire between some Sasser-style worm
and an HP printer.

PS: I have no love for HP devices, or JetDirect for that matter, and
when the 41xx line started going into the toilet for reliability and
likelihood that a printed PS file would come out of the printer, I
dumped them for Xerox. Even so, nothing that I can see that prevents
them from peacefully coexisting on the network. Their management
utilities, however, could be another story.

=R


- --
  _  _ _  _ ___  _  _  _
 |Y#| |  | |\/| |  \ |\ |  | |Ryan Novosielski - Systems Programmer III
 |$| |__| |  | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922)
 \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.5 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFFwPnVmb+gadEcsb4RArHMAKDgdnkawL9BM9AXpAREjjJkpQvVdQCgxK+t
h49Ni+4YjIfmlgUfqfRNJ5w=
=1++J
-END PGP SIGNATURE-


-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Linksys is killing socket between director and SD

2007-01-31 Thread Darien Hager
 Kern, if you are reading this, what are the chances that a  
 heartbeat could be implemented between the director and the storage  
 daemon?

Would there be any significant downsides to a global heartbeat  
directive in the director? When the director initially connects to an  
FD/SD it could modify their heartbeat settings to match it.

--
--Darien A. Hager
[EMAIL PROTECTED]
Mobile: (206) 734-5666



-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Splitting config files (fwd)

2007-01-31 Thread Kern Sibbald
On Wednesday 31 January 2007 20:31, Brian Debelius wrote:
 David Romerstein wrote:
  On Wed, 31 Jan 2007, Brian Debelius wrote:
  Darien Hager wrote:
  On Jan 31, 2007, at 10:46 AM, Brian Debelius wrote:
  I am trying to split up a config file on Windows, using the @
  directive
  as shown in http://www.bacula.org/dev-manual/
  Customizin_Configurat_Files.html but it
  returns an error that it cannot find the file.  Has anyone done
  this in Windows?
 
  I haven't tried it in windows, but some quick ideas:
  1. Try absolute pathnames if you aren't already--it didn't like
  relative ones for me on Linux.
  2. Try escaping Window's backslashes with an additional backslash,
  e.g. @C:\\folder\\file
  3. If those don't work, can you post what some details or examples of
  what isn't working?
 
  In my bacula-dir.conf I have
 
  @C:\\Documents and Settings\\All Users\\Application
  Data\\Bacula\\schedule.conf
 
  but the directory returns the following error:
 
  31-Jan 14:06 bacula-dir: ERROR TERMINATION at ../../lib/lex.c:545
  Config error: Cannot open included config file : No such file or
  directory
 
 : line 163, col 2 of file C:\Documents and Settings\All
 
  Users\Application Data\Bacula/bacula-dir.conf
  @C:\\Documents and Settings\\All Users\\Application
  Data\\Bacula\\schedule.conf
 
  http://www.bacula.org/dev-manual/FileSet_Resource.html#SECTION0015400
 00
 
  If you are entering Windows file names, the directory path may be
  preceded by the drive and a colon (as in c:). However, the path
  separators must be specified in Unix convention (i.e. forward slash (/)).
  If you wish to include a quote in a file name, precede the quote with a
  backslash (\). For example you might use the following for a Windows
  machine to backup the My Documents directory:
 
  FileSet {
 Name = Windows Set
 Include {
   Options {
  WildFile = *.obj
  WildFile = *.exe
  exclude = yes
}
File = c:/My Documents
 }
  }
 
  -- D

 I changed it to this:
 @C:/Documents and Settings/All Users/Application
 Data/Bacula/schedule.conf

 but is still gives an error:
 Config error: Cannot open included config file : No such file or directory

Rule #1 with computer programs is to assume that the error message is correct 
until definitely proven otherwise.  Have you verified that the file really 
does exist?


 : line 163, col 2 of file C:\Documents and Settings\All

 Users\Application Data\Bacula/bacula-dir.conf
 @C:/Documents and Settings/All Users/Application
 Data/Bacula/schedule.conf

Of hand, I would be willing to bet that there is no such file as C:/... 
including the quotes on anyones system -- there may be a C:/..., but not 
a C:/...



 -
 Using Tomcat but need to do more? Need to support web services, security?
 Get stuff done quickly with pre-integrated technology to make your job
 easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache
 Geronimo
 http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Linksys is killing socket between director and SD

2007-01-31 Thread Brad Peterson
 Kern, if you are reading this, what are the chances that a heartbeat could
 be implemented between the director and the storage daemon?

Yes, that is possible, but you will need to find someone to program it.  

If I knew my C++ well enough, I'd dive into it.  :)  Darn my lack of C++ 
knowledge.

I personally I would ask for a refund on the router since it apparently 
doesn't understand keepalive and doesn't follow standard TCP/IP standards so 
does not function properly.

Ya, I'm not happy with this situation at all, plus I've owned this router for 
over a year now.  Unfortunately, the Linksys router I purchased is perhaps the 
most commonly advertised wireless router for nationwide chains.   That's why I 
spent the extra time to nail down the issue, in case any other Bacula /Linksys 
users run into the same problem.   

Also isn't Linksys one of the companies that is/was in violation of the GPL 
(i.e. using GPLed software without making the source available)?

I don't know about that.  But I believe Linksys did release the source code for 
their version 1-4 WRT54G routers, which allowed hobbyists to make their own 
Linux based firmwares.  And Linksys still makes an L series, specifically so 
that people who want to load their own Linux based firmwares can still continue 
to do so.  Unfortunately, I picked up a v5, which has some open source 
solutions to it, but they're a bit scarier to implement.

Anyway, thanks for your reply.  Seeing that I have hundreds of open source 
project emails I need to respond to,  I really do appreciate that you jumped 
right in and answered mine  :)

Brad Peterson
[EMAIL PROTECTED]




 Brad Peterson
 [EMAIL PROTECTED]


 - Original Message 
 From: Brad Peterson [EMAIL PROTECTED]
 To: bacula-users@lists.sourceforge.net
 Sent: Tuesday, January 30, 2007 3:00:03 PM
 Subject: [Bacula-users] Director losing socket with SD

 First, my request:  Is there anything in Bacula I can do to keep the socket
 between the director and the storage daemon alive?

 Now, my explanation why I need this.  As I'm trying to narrow down why my
 lengthy backups to an offsite storage daemon don't work, I sat and watched
 the debug output for the director, the storage daemon, and the file daemon.
  About almost exactly 10 minutes in, the director's debug output said this:

 msgchan.c:333 === End msg_thread. use=2

 After a lot of research, it appears what's going on is this:

 1) The director starts the job.
 2) A socket is opened between the director and the storage daemon.
 3) A socket is opened between the file daemon and the storage daemon.
 4) The file data transfers just fine over the file daemon/storage daemon
 socket. 5) At almost exactly 10 minutes in, I get the above debug message
 which means the socket between the director and storage daemon has been
 closed.  netstat confirmed this. 6) The file data continues to transfer
 just fine to the storage daemon. 7) When the file daemon is done, it tells
 the director that it is finished. 8) The storage daemon tries to tell the
 director it received the data perfectly, but cannot, because it cannot
 communicate with the director anymore (which makes sense, because the
 socket died). 9) *I think* the director waits a bit for the the storage
 daemon, or it just knows it can't receive info from the storage daemon.  In
 any event, the director quickly marks the job as having an error because it
 never heard from the storage daemon as to its final result.

 So, what can I do in Bacula to keep the socket between the director and the
 storage daemon alive?

 I'v already set a heartbeats of 30 seconds, but according to the manual,
 the heartbeats help the file daemon talk to the director, the file daemon
 talk to the storage daemon, and the storage daemon talk to the file daemon.
  But in my situation, I'm losing a socket between the director and the
 storage daemon, and the heartbeat doesn't help out with that.

 I'm also starting to think a Linksys router may be the reason why it loses
 the inactive socket after almost exactly 10 minutes, as other Linksys users
 have found this happens to them.  I'll be able to test this out tonight by
 bypassing the router completely.

 Anyways, in the meantime, anybody know how I can keep that socket alive?

 Brad Peterson
 [EMAIL PROTECTED]








 ___
_ Don't pick lemons.
 See all the new 2007 cars at Yahoo! Autos.
 http://autos.yahoo.com/new_cars.html

 -
 Take Surveys. Earn Cash. Influence the Future of IT
 Join SourceForge.net's Techsay panel and you'll get the chance to share
 your opinions on IT  business topics through brief surveys - and earn cash
 http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 

Re: [Bacula-users] Bacula and HP JetDirect (was: (2.0.1) 5 minute 5 seconds problem)

2007-01-31 Thread Steen Meyer
Onsdag 31 januar 2007 17:50 skrev Ryan Novosielski:
 Dan Langille wrote:
  On 31 Jan 2007 at 11:24, Ryan Novosielski wrote:
  So, I guess in summation, Nothing to see here, or What's the
  problem?
 
  *IANA port list: http://www.iana.org/assignments/port-numbers
 
  Well, HP does use those ports:
 
  http://www.isecom.info/cgi-
  local/protocoldb/browse.dsp?search=1fld1=1opr1=4val1=9100rows=25s
  ubmit=search
 
  OR http://tinyurl.com/2vzpqa
 
  Which refers to
  http://h2.www2.hp.com/bizsupport/TechSupport/Document.jsp?objectID
  =bpj01014 OR  http://tinyurl.com/3agmm7
 
  Confirmation that HP is using ports 9101 and 9102 which are
  registered to Bacula.

 Even so, a very small overlap:

 * 9100 TCP port is used for printing. Port numbers 9101 and 9102 are for
 parallel ports 2 and 3 on the three-port HP Jetdirect external print
 servers.

 ...and if I'm not mistaken, this is configurable. Is there any way that
 this will actually affect anyone? Seems unlikely to me (unless you have
 a firewall rule going after HP printer traffic that whacks Bacula in the
 process).

I do not remember these ports configurable in the standard software, I have 
one of these, but admit I havent doublechecked just now. The problem I can 
imagine is that if I want to back up my windows server which is acting as 
print server, and if someone prints to the port 2 printer while bacula is 
backing up, what will happen then?


Steen

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Linksys is killing socket between director and SD

2007-01-31 Thread Alan Brown
On Wed, 31 Jan 2007, Brad Peterson wrote:

 Aaah, I've finally figured it out.  The very common Linksys WRT54G v5 
 router IS dropping inactive sockets after exactly 10 minutes.

Set heartbeat intervals to 1 minute.

Problem solved (and is why this directive is there)


-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Linksys is killing socket between director and SD

2007-01-31 Thread Alan Brown
On Wed, 31 Jan 2007, Kern Sibbald wrote:

 I personally I would ask for a refund on the router since it apparently
 doesn't understand keepalive and doesn't follow standard TCP/IP standards so
 does not function properly.

Fat chance of that. Linksys are notorious for lack of response to consumer 
complaints.

 Also isn't Linksys one of the companies that is/was in violation of the GPL
 (i.e. using GPLed software without making the source available)?

Was and is, but it's Dlink who got taken to court and lost.

AB

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Linksys is killing socket between director and SD

2007-01-31 Thread Brad Peterson
 Aaah, I've finally figured it out.  The very common Linksys WRT54G v5 
 router IS dropping inactive sockets after exactly 10 minutes.

Set heartbeat intervals to 1 minute.

Problem solved (and is why this directive is there)

I already have the heartbeats in at 30 seconds each.  Unfortunately, according 
to the manual, the heartbeats helps the file daemon talk to
the director, the file daemon talk to the storage daemon, and the
storage daemon talk to the file daemon.

What would help me is a heartbeat to keep the socket between the director and 
storage daemon alive.

For now, I'm giving up on having an offsite storage daemon.  I don't have the 
money to spend on a fully working router.  So I'm going to just keep the 
storage daemon on the same machine as the director, and then rsync the physical 
volumes afterwards offsite.

Brad Peterson
[EMAIL PROTECTED]







 

Never miss an email again!
Yahoo! Toolbar alerts you the instant new Mail arrives.
http://tools.search.yahoo.com/toolbar/features/mail/

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Linksys is killing socket between director and SD

2007-01-31 Thread Zachariah Mully
On Wed, 2007-01-31 at 13:40 -0800, Brad Peterson wrote:
  Aaah, I've finally figured it out.  The very common Linksys WRT54G
 v5 
  router IS dropping inactive sockets after exactly 10 minutes.
 
 Set heartbeat intervals to 1 minute.
 
 Problem solved (and is why this directive is there)
 
 I already have the heartbeats in at 30 seconds each.  Unfortunately,
 according to the manual, the heartbeats helps the file daemon talk to
 the director, the file daemon talk to the storage daemon, and the
 storage daemon talk to the file daemon.
 
 What would help me is a heartbeat to keep the socket between the
 director and storage daemon alive.
 
 For now, I'm giving up on having an offsite storage daemon.  I don't
 have the money to spend on a fully working router.  So I'm going to
 just keep the storage daemon on the same machine as the director, and
 then rsync the physical volumes afterwards offsite.

Though this is better solution that what you originally wanted (rsync is
going to be more robust and faster over your WAN link than bacula would
be), you could either flash your v5 (even if you brick it, you can
easily un-brick it) or simply pick up any number of the
dd-wrt/openwrt/etc. compatible routers for cheap. A new Buffalo WHR-54GS
usually goes for  $40, and sometimes $30 and is far better than v5. I
can't imagine that $40 is out of your budget. DD-WRT will allow you to
set TCP timeouts upto one hour and probably actually understands
keepalive.

Besides, I don't think it a wise use of developer time fixing a problem
for what amounts to cheap consumable (and totally fixable) consumer
grade hardware. I rather they focus on features like the GUI, handling
extremely large backup sets and improving the core functionality.

Z

Z


-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Linksys is killing socket between director and SD

2007-01-31 Thread James Harper
 I think that makes any Bacula job longer than 10 minutes impossible
using
 this Linksys router.  Looks like I'm out of luck.  I have updated to
the
 newest firmware, and the Linksys config doesn't have any ability to
modify
 the timeout value.   I suppose I could buy a new router, or set up a
new
 offsite backup storage daemon.   Unless anyone else has any brilliant
 ideas  :)
 
 Kern, if you are reading this, what are the chances that a heartbeat
could
 be implemented between the director and the storage daemon?
 

Is Bacula using setsockopt SO_KEEPALIVE's on every socket (it seems that
it does in bnet.c)? If so, you probably just need to set this to more
sensible values in /proc (assuming you are running Linux... I can't
remember if you said or not).

Try:

echo 300  /proc/sys/net/ipv4/tcp_keepalive_time
echo 60  /proc/sys/net/ipv4/tcp_keepalive_intvl
echo 10  /proc/sys/net/ipv4/tcp_keepalive_probes

This will send the first keepalive after 5 minutes, and then every 60
seconds after that, and will drop the connection if no response is seen
from 10 consecutive probes.

The default is that the keepalive won't start for 2 hours (7200 seconds)
after the connection has been idle. Not much good in your case.

http://libkeepalive.sourceforge.net/docs/TCP-Keepalive-HOWTO has some
useful info about the way it all works.

Does Bacula include any application level keepalives? There should be no
need to do this if you've set /proc and setsockopt correctly, unless the
respective daemons implement their own application level timeouts.

James


-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Linksys is killing socket between director and SD

2007-01-31 Thread James Harper
  For now, I'm giving up on having an offsite storage daemon.  I don't
  have the money to spend on a fully working router.  So I'm going to
  just keep the storage daemon on the same machine as the director,
and
  then rsync the physical volumes afterwards offsite.
 
 Though this is better solution that what you originally wanted (rsync
is
 going to be more robust and faster over your WAN link than bacula
would
 be), you could either flash your v5 (even if you brick it, you can
 easily un-brick it) or simply pick up any number of the
 dd-wrt/openwrt/etc. compatible routers for cheap. A new Buffalo
WHR-54GS
 usually goes for  $40, and sometimes $30 and is far better than v5.
I
 can't imagine that $40 is out of your budget. DD-WRT will allow you to
 set TCP timeouts upto one hour and probably actually understands
 keepalive.

Keepalives are a function of the endpoints, the keepalives generate
traffic and it is the traffic that refreshes the connection in the
connection tracking tables on any intermediate routers and firewalls.
The suggestion I posted earlier should resolve this problem.

I've seen Cisco routers with stale connections that are weeks overdue in
terms of being timed out! (and, due to various bugs in IOS, crash). 10
minutes is a bit short, but only if you aren't using SO_KEEPALIVE.
Setting it too long opens you up to a denial of service attack too.

 Besides, I don't think it a wise use of developer time fixing a
problem
 for what amounts to cheap consumable (and totally fixable) consumer
 grade hardware. I rather they focus on features like the GUI, handling
 extremely large backup sets and improving the core functionality.

Agreed. The problem is at layer 3 and should be resolved there. Bacula
already appears to include code to enable keepalives, so all that should
be required is to tweak the kernel values down the right interval.

James


-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula update from 1.38.11 to 2.X?

2007-01-31 Thread pedro moreno

 Hi people.

  I install bacula 2.0.1 in FreeBSD 6.2 Release. I have in another computer
running bacula 1.38.11 OS FreeBSD with MySQL 4.1, is working really great i
had already  restore over 85GB to one Linux client running
Centos 4.4 from tape, bacula again show his power.

  Well my doubt is this, i setup bacula 2.0.1 on FreeBSD 6.2 with
MySQL 4.1in a test machine, i want to try this new version, but i
don't  want to use
my  production server, them:

If i want to update my current version (1.38.11) to 2.0.1 i just copy the
database from my production server to my test server and run the update
script?

I have to make another think?

 This all my doubt, thanks for your time, greetings all!!!
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users