Re: [Bacula-users] Bacula LTO-5
Hi, On Fri, Jun 02, 2017 at 01:24:46PM +0200, Kern Sibbald wrote: > I don't seem to have the original post of Richard Fox, so could you please > specify what "this directive" is in the sentence: > > Otherwise, this advice is a little contradictory to the documentation which > states "On most modern tape drives, you will not need to specify this > directive. My apologies, I had sent the message from the wrong address and cancelled moderation on it. I was hoping nobody would notice. My original message asked if this discussion was in regard to the "Maximum block size" (and presumably "Minimum block size") from the device resource. "Are you both referring to "Maximum block size" (and presumably "Minimum block size") from the Device resource? If not please ignore the rest of this message. Otherwise, this advice is a little contradictory to the documentation which states "On most modern tape drives, you will not need to specify this directive.". More importantly however, the documentation (for Bacula 7.2 anyways) says: "The maximum size-in-bytes possible is 2,000,000." which contradicts the assertion that these can be specified as 2MB which is not the same thing. Is the documentation inaccurate on this subject?" > On 06/01/2017 02:51 PM, Cejka Rudolf wrote: > > Richard Fox wrote (2017/06/01): > > > Otherwise, this advice is a little contradictory to the documentation > > > which states "On most modern tape drives, you will not need to specify > > > this directive.". > > Given that Linux with LTO-X tape drive is probably a majority system here > > (not counting > > configurations without tape drives), the statement is slightly misleading. > > I'm convinced > > that it is really not needed because of tape drive, server nor HBA, but it > > seems that it > > is really needed because of Linux. However it is not a real problem, > > because Linux allows > > to increase the block size "naturally", with the exception that you have > > limiting HBA. > > > > > More importantly however, the documentation (for Bacula 7.2 anyways) > > > says: "The maximum size-in-bytes possible is 2,000,000." which > > > contradicts the assertion that these can be specified as 2MB which is not > > > the same thing. Is the documentation inaccurate on this subject? > > I wrote 2 MB as a general recommendation over various manufacturers and > > software > > developers, with non-written suggested value 256 KB or 512 KB as max., so > > please > > take my 2 MB limit just loosely :o) Thanks, Rich. -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory r...@mbl.edu - m...@richfox.org 508-289-7669 -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula splitting big jobs in to two
Hi, On Thu, 29 Jan 2015, Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] wrote: I run bacula 5.2.12 on a RHEL server which is attached to a Tape Library. I have two LTO5 tape drives. Since the data on one of my server has grown big the back-up takes 10-12 days to complete. I would like to split this job in to two jobs. Has anybody done this kind of a set-up? I need some guidance on how to go about it. I did something like this with our backups, dividing them up in order to decrease the amount of time necessary for backups. At the time I conceived this system, we had about 56TB of data. For historic reasons our backups were made from NFS exports from a single central NAS fileserver, because it was proprietary, I couldn't directly access the fileserver any other way. (This has changed but I haven't made substantial changes to the procedure yet.) I have two tape libraries for this each with two drives, and both support partitioning. I partitioned the two libraries so that from the computer's perspective I have 4 libraries. Our filesystems are composed primarily of user directories and working group directories. I calculated the size of each of these directories and then used a basic bin-packing algorithm to subdivide them into four groups each being assigned to a parition. A preperation script is used to mount each directory as a separate NFS mount in its respective group directory. The groups were sized such that the ratio of the data to the capacity of a given library's partition were more or less the same for the four groups. I created four pools, four jobs, for storage devices, etc., all to match up with the 4 library paritions and four groups, essentially creating 4 complete backup jobs. When it's time to take new base backups, I repeat the calculation, bin-packing part and run the update the mount points to redistribute the data. It did cut down the time required to do base backups substantially. I was also able to remove a set of files that while only occupied about a terabyte, contained tens of millions of tiny files that massively slowed down the backup process whenever it hit that spot. Perhaps you have similar conditions on your filesystems? Thanks, Rich. -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory http://www.mbl.edu/jbpc 508-289-7669 - mbl-at-richfox.org -- Dive into the World of Parallel Programming. The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] general question to robocopy and bacula
Hi, No, it shouldn't fail. I'm backing up a filesystem in which that very situation is happening. It completed fine twice last night while data was still streaming in. Thanks, Rich. On Wed, 17 Dec 2014, Markus Rosjat wrote: Hello List, my simple question is: If I have data that gets copied from a remote location to the bacupserver with robocopy and bacula is running a job on the directory while robocopy is changing it could that cause bacula to fail the job with an r/w error ? regards -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory http://www.mbl.edu/jbpc 508-289-7669 - mbl-at-richfox.org -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=164703151iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] general question to robocopy and bacula
Hi, I'm sorry, I responded too soon. I'm not in fact, using robocopy (presumably on Windows?). I'm using rsync on Linux. Thanks, Rich. On Wed, 17 Dec 2014, Richard Fox wrote: Hi, No, it shouldn't fail. I'm backing up a filesystem in which that very situation is happening. It completed fine twice last night while data was still streaming in. Thanks, Rich. On Wed, 17 Dec 2014, Markus Rosjat wrote: Hello List, my simple question is: If I have data that gets copied from a remote location to the bacupserver with robocopy and bacula is running a job on the directory while robocopy is changing it could that cause bacula to fail the job with an r/w error ? regards -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory http://www.mbl.edu/jbpc 508-289-7669 - mbl-at-richfox.org -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=164703151iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Stop unfinished backup, retain data
Hi All, I use Bacula 5.2.6. If I'm not mistaken when I have a backup running and I cancel it, Bacula discards the backup records for the data it has taken to tape which requires Bacula to back up the same files again on the next run. Isn't that correct? If that is correct, is there any way to stop a running backup in which Bacula retains what it has managed to backup so far and picks up where it left off on the next run? Thanks, Rich. -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory http://www.mbl.edu/jbpc 508-289-7669 - mbl-at-richfox.org -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] ibdata1
Hi, On Fri, 25 Jul 2014, Ken Mandelberg wrote: My ibdata1 file is currently at almost a GB. As far as I know Bacula is the only thing using mysql on my workstation. Is this size normal? I think it can be perfectly normal. As far as I understand it, unless you're using file-per-table option in MySQL (or MariaDB) then these files will contain all of the data that is stored using InnoDB table format. http://dev.mysql.com/doc/refman/5.6/en/glossary.html#glos_ibdata_file I have made the mistake of omitting the file-per-table option when I wanted to use it and recall having to dump the tables, re-initialize the system, then import the data. I think my ibdata files were up to about 16G when I noticed the problem. I've seen generic mysql postings about ibdata1 expanding because of bad transactions and the inability to shrink it. I'm not sure how this fits in with Bacula. I'm sorry, I can't comment on this part except I understand that you can't reclaim the disk space used by these files except for anything but innodb data. That is, when you free up space by truncating or dropping innodb tables, it frees up space within these files but only MySQL can use it for new innodb data. It doesn't change their size on disk. Bacula can store a lot of data depending on what you're using it on. My Bacula database (using file-per-table as measured by du -sh ...) is at 42G. Thanks, Rich. -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory http://www.mbl.edu/jbpc 508-289-7669 - mbl-at-richfox.org -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] rpm repo for CentOS 6 anyone?
Hi Jari all, On Thu, 8 May 2014, Jari Fredriksson wrote: CentOS 6 has bacula 5.0.0 which has a bug so that it prunes jobs older than 43 years, no matter how it was defined for director. I could not find a repo or rpm for full Bacula package (only for client), but hopefully someone else knows? I don't know about a repo. I use CentOS 6.4, 6.5 and have compiled Bacula 5.2.x for it from source. I recall that it builds with no issues. I haven't migrated to 7 yet but based on my experience with 5 I doubt there would be any problems. I'd be happy to provide any additional details if you like, email me directly. Thanks, Rich. -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory http://www.mbl.edu/jbpc 508-289-7669 - mbl-at-richfox.org -- Is your legacy SCM system holding you back? Join Perforce May 7 to find out: #149; 3 signs your SCM is hindering your productivity #149; Requirements for releasing software faster #149; Expert tips and advice for migrating your SCM now http://p.sf.net/sfu/perforce ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Thanks From Me Too!
Hi, I also would like to thank Kern Sibbald all of the other people involved in the Bacula project and John Drescher for suggesting it to me probably a long time ago. I was previously using commercial backup software and was forbidden by the vendor to adapt it to the changing architecture of our systems even though it was possible to do so (albeit by sacrificing functionality that I wouldn't be able to use anyway). Switching to Bacula solved those problems and gave me more functionality than ever before. It has been liberating for me and the people that depend on my work (even though they don't know it). Thanks, Rich. -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory http://www.mbl.edu/jbpc 508-289-7669 - mbl-at-richfox.org -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
