It seems that the resources used by the database should be taken into account when looking at Bacula's memory usage, because even though the two are separate, the director is the one putting the records there. Maybe I should re-ask the question as: How heavily does Bacula tax the database with 50 or more clients being backed up concurrently, and what kind of hardware is recommended for such a situation?
(\_/) (o,o) ()_() Joseph Wright " " On Jun 8, 2007, at 12:35 AM, Kern Sibbald wrote: >> Date: Thu, 07 Jun 2007 21:33:57 -0400 >> From: Ryan Novosielski <[EMAIL PROTECTED]> >> Subject: Re: [Bacula-users] Hardware recommendations >> To: bacula-users@lists.sourceforge.net >> Message-ID: <[EMAIL PROTECTED]> >> Content-Type: text/plain; charset="iso-8859-1" > >> Message was signed with unknown key 0xD11CB1BE. >> The validity of the signature cannot be verified. >> I'm using a Sun UE450 with 3x296MHz and 896MB of RAM. However, the >> maximum simultaneous number of backups I'm doing is 8, and >> probably my >> total aggregate amount of data is less than 100GB for all of the >> systems >> together. > >> There was some information on the list relatively recently about >> optimizing MySQL memory usage, or perhaps making it act somewhat >> differently to running out of memory. > >> AFAIK, as well, newer versions of bacula are slated to handle this >> problem better as well. I personally would be somewhat surprised >> if 2G >> of RAM on a dedicated machine were too little. I've never tried >> watching >> my machine while backups were running, but it seems to me Bacula is >> fairly lightweight most of the time. > > Yes, Bacula is rather light weight in memory usage, and in > addition, does > pretty much minimal copying of data within a daemon. E.g. in the > FD, then > data is read into a buffer then transmitted to the SD in the same > buffer. In > the SD, the data comes into a buffer then is copied into a block > which is > written directly to the tape (unless spooling is enabled). > > Typical memory usage for the Director is about 100-120K per Job for > a backup > regardless of the number of files or size of the data involved. > However, > there was a bug in the MySQL driver that could cause Bacula to lose > memory > after running a lot of jobs. Even with the memory leak, I had no > problem > running 80 simultaneous jobs. The MySQL driver memory leak is fixed > in the > current BETA version. > > MySQL/PostgreSQL server memory usage is another story typically > controlled by > their respective conf/ini files. > > >> Joseph Wright wrote: >>> I'd like to find out what kind of hardware configurations people are >>> using for their director. I plan to be backing up 50 or more >>> clients >>> with ~250G of data each on a dedicated director with 2G RAM and a >>> 120G SATA drive. I had an issue one night where the director shut >>> down with an out of memory error after the backup jobs started, with >>> only 20 clients. I've since backed off the number of clients and am >>> adding them back in more slowly, as well as distributing the startup >>> times so they don't all start at once. But I'd like to find out if >>> people think my hardware is adequate for the task and it would be >>> interesting to know what others are using. > > ---------------------------------------------------------------------- > --- > This SF.net email is sponsored by DB2 Express > Download DB2 Express C - the FREE version of DB2 express and take > control of your XML. No limits. Just data. Click to get it now. > http://sourceforge.net/powerbar/db2/ > _______________________________________________ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users ------------------------------------------------------------------------- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
