Re: [Bacula-users] Suggestion for a REALLY handy enhancement, shouldn't be hard either...
http://www.bacula.org/rel-manual/Bacula_Console.html#SECTION000208000 Not exactly what you want, but should be a good starting point. On 10/21/05, Sherwood McGowan [EMAIL PROTECTED] wrote: Is there any way we could get the ability to do this? I'd love to be able to issue a batch command to bconsole, something similar to bconsole --batch 'status ; 1' Which would tell bconsole to run the command status and then 1 (gets the status of the director) and then exit, outputting the information to the screen (so I can have scripts parse it). Another example: Bconsole --batch 'run ; 8 ; yes' Which would tell bconsole to issue run and 8 (job #8) and then yes to start the backup. This would be great so I can have some simple scripts that force a backup to run, without having to have user interaction... Any thoughts? Thank you, Sherwood --- This SF.Net email is sponsored by: Power Architecture Resource Center: Free content, downloads, discussions, and more. http://solutions.newsforge.com/ibmarch.tmpl ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by: Power Architecture Resource Center: Free content, downloads, discussions, and more. http://solutions.newsforge.com/ibmarch.tmpl ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Large network bacula tips?
Thank you for the response! On 10/17/05, Mark Bober [EMAIL PROTECTED] wrote: I get about ~20 MB/s from my fastest storage, so that's 1200 MB/min, or 1.2 GB/min. You're pulling 300MB/min, or 5 MB/s. I thought so, thanks for verifying my sanity. So you might be a touch slow. I have a maximum of 4 jobs running on any given storage device, however, and usually during fulls on the weekend I've got no more than 4 jobs running at any given time anyway. I was thinking of limiting the number of concurrent jobs. The project manager really wants to have them all done simultaneously, not 100% sure on the reasoning, but it is listed as a requirement. If it has a large negative impact on performance, I'm sure we can drop that requirement. Here's my setup: bacula-dir: Sun v20z (dual Opt, 4g ram) running CentOS 4.1 (RHEL clone). Tape Storage: Either Quantum SDLT/160 Autoloader or Overland LXB SDLT/110 changer for large jobs, hanging off an U320 MPT SCSI PCI-X controller. My spool device is a set of random SCSI disks, mostly old 50 giggers, in a striped software raid. About 400G. They're on a PCI 33mhz controller, a Symbios something-or-other. Nothing special. All gigabit to major servers. All in all I've got about 80 clients, Windows, Solaris, and Linux. A few OSF/1 also. I've ran about 3500 jobs, and have totalled about 17 TB over the past... 2 1/2 months I've been production with Bacula. (I secretly hope that wins me some sort of Biggest Bacula award) :) Anyone have any statistics to top it? Suggestions: 1) Solaris storage-d was *very slow*. It's Solaris's fault. Try a linux storage-d, see what happens. My Linux clients always outpace everything else, even given the same hardware. Go ahead and shoot for 1.37.40 as well. OK, wasn't sure how stable that release was, but since I'm still in testing mode, it doesn't really matter. I'll give it a go. 2) It's Virtuozzo, also. I've got a set of VMWare ESX servers, same hardware as the director. They go about 5 MB/s to disk, which GZIP compression on, when I'd expect 20 MB/s from a plain Linux install without GZIP. Not much can be done about that, really. (this is the VMWare itself - the linux underpinnings, not the virtual machines, backing up). If those 65 virtual machines all have load on each server, I'm amazed they're that fast at all. None of the clients are vps's themselves. Just hosting vps's, so I guess I could have left that out of my original message. They are the main cause of the large amount of data. If you're backing up to disk, drop GZIP once and see how it goes. If you're going straight to tape, you're pretty much at the limit then. That's a lot of virtualization. Yep, to disk. I forgot about the gzip compression, thanks for reminding me. I appreciate the suggestions! Lyle --- This SF.Net email is sponsored by: Power Architecture Resource Center: Free content, downloads, discussions, and more. http://solutions.newsforge.com/ibmarch.tmpl ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Large network bacula tips?
Hello fellow Bacula users! I've only been lurking on this list for a little while, please excuse me if this topic has been covered previously. I've got what I would consider a large network of machines each hosting many virtual private servers with Virtuozzo. http://www.swsoft.com/en/products/virtuozzo/ (19 servers, each hosting an average of 65 virtual environments, average 160GB data per server. Total data to back up ~ 3TB. Generous estimate to allow for growth.) I've been tasked with replacing an aging Amanda install that has been backing them up to disk daily. I've done some testing already with a couple of the servers, and have recently started a backup of all systems. Ran into a small problem with the catalog where the File table grew to 4GB and claimed to be full, easily fixed by switching from MyISAM to the InnoDB engine. It got me thinking though, are there any other gotchas or caveats anyone else has overcome in backing up such a large quantity of data? We have a gigabit Ethernet network over which the backups are run, but it still seems to take an inordinate amount of time to complete a full backup. Currently filling a two gigabyte volume every 6 minutes on average. At that rate, it will take 6 days to finish a full backup?! Maybe I'm doing the math wrong (I already know I haven't taken compression into account), but I think I'm missing something. Comments and suggestions welcome! Thanks for such a great project! (It's backing up my home network of 3 Macs handily!) Oh yeah: Director is running on a FreeBSD 5.4 box, all other clients are Linux. Bacula version 1.36.3 compiled from source (ports tree on director). Thanks in advance, Lyle Vogtmann --- This SF.Net email is sponsored by: Power Architecture Resource Center: Free content, downloads, discussions, and more. http://solutions.newsforge.com/ibmarch.tmpl ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
