[Bacula-users] Shell script to label new tape in changer with barcodes
If anybody need this staff i wrote some script to label new unlabeled tape with barcodes and register it in Bacula system in Pool Scratch This script can be used if you want to label new tape using it's barcode and create a volume with the same name in some Bacula's pool. By default in this script used a pool Scratch Script create a .log file in /var/log/barcode_label.{current date}.log Usage: barcode_label.sh [options] -s [1-8] Tape Barcode Label tool ver $VER OPTIONS: -h | --help Show this message -v | --version Show version only -n | --notifySend notification to Backup group by email -s | --slot Set the slot number with unlabeled tape [1-8] -e | --exch-slot Load unlabeled tape from EE-slot to changer You just need to set the following variables in section Variables: MT=/bin/mt MTX=/usr/local/sbin/mtx MTX_CH=/usr/local/bacula/etc/scripts/mtx-changer ctl=/dev/changer device=/dev/nst0 drive=0 bconsole_cmd=/usr/local/bacula/sbin/bconsole -c /usr/local/bacula/etc/bconsole.conf recipient=bac...@localhost send_mail=no load_from_ee=no ee_slot=10 log_file=/var/log/barcode_label.`date +\%Y%m%d-%H:%M:%S\`.log The script in attach http://old.nabble.com/file/p29934340/barcode_label.sh barcode_label.sh Hope this staff will be usefull to somebody. -- View this message in context: http://old.nabble.com/Shell-script-to-label-new-tape-in-changer-with-barcodes-tp29934340p29934340.html Sent from the Bacula - Users mailing list archive at Nabble.com. -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Two storage daemons - is it possible
Dear All I need advice regarding having several storage daemons that share the MySQL database and discs (using NFS) but one storage daemon manages the tape unit. All backups go to disc but the Full backups are migrated to tape overnight. The reason for asking this question is that we backup 60 laptops during the working week between 9 am and 4 pm with 12 having a full backup on one of the week days. The problem is the network is saturated and some clients are slow and others have large amounts of data. (Applications etc are not backed up only user data). I suspect the NFS and MySQL traffic may negate any gain by having extra storage daemons. Another option is to see if bonding two network adapters may work. Thanks in Advance Stephen Carr -- Stephen Carr Computing Officer School of Civil and Environmental Engineering The University of Adelaide Tel +618-8303-4313 Fax +618-8303-4359 Email sgc...@civeng.adelaide.edu.au CRICOS Provider Number 00123M --- This email message is intended only for the addressee(s) and contains information that may be confidential and/or copyright. If you are not the intended recipient please notify the sender by reply email and immediately delete this email. Use, disclosure or reproduction of this email by anyone other than the intended recipient(s) is strictly prohibited. No representation is made that this email or any attachments are free of viruses. Virus scanning is recommended and is the responsibility of the recipient. -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Two storage daemons - is it possible
Dear All I need advice regarding having several storage daemons that share the MySQL database and discs (using NFS) but one storage daemon manages the tape unit. All backups go to disc but the Full backups are migrated to tape overnight. The reason for asking this question is that we backup 60 laptops during the working week between 9 am and 4 pm with 12 having a full backup on one of the week days. The problem is the network is saturated and some clients are slow and others have large amounts of data. (Applications etc are not backed up only user data). I suspect the NFS and MySQL traffic may negate any gain by having extra storage daemons. Another option is to see if bonding two network adapters may work. The director talks to MySQL, the storage daemon does not. You can have as many storage daemons as you want, although migration does not work between them (or at least it didn't last time I checked), but each sd could have its own set of NFS volumes connected via a different network connection. If the data was being backed up at half the rate would there still be enough time in the day to complete the backups? You could simply throttle the rate to an acceptable percentage of total bandwidth such that the backups still completed in time. James -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Two storage daemons - is it possible
On 10/12/10 04:53, Stephen Carr wrote: Dear All I need advice regarding having several storage daemons that share the MySQL database and discs (using NFS) but one storage daemon manages the tape unit. The storage daemons do not use MySQL directly; only the Director does. Having two storage daemons writing to the same set of disks is not inherently a problem, as long as they are never trying to write the same volume at the same time, but will be likely to result in high levels of seek activity, and thus may actually hurt performance. All backups go to disc but the Full backups are migrated to tape overnight. The reason for asking this question is that we backup 60 laptops during the working week between 9 am and 4 pm with 12 having a full backup on one of the week days. The problem is the network is saturated and some clients are slow and others have large amounts of data. (Applications etc are not backed up only user data). I suspect the NFS and MySQL traffic may negate any gain by having extra storage daemons. As noted above, in this configuration you may not necessarily be even gaining anything from the multiple storage daemons. If backing up your clients is already saturating your network, adding additional NFS traffic into the problem can't possibly help. Another option is to see if bonding two network adapters may work. You could try bonding, or faster network equipment, or a secondary network dedicated to backup traffic. But somehow, if your backup load is saturating your network, the only real way out of the problem is to increase the speed of your network. -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, Free Stater It's not the years, it's the mileage. -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tuning for large (millions of files) backups?
Bruno Friedmann wrote: Rude answer : If you really want to use Mysql drop the myisam to innodb. But you don't want to use mysql for that job, just use Postgresql fine tuned with batch insert enabled. Seconded - having been through this issue. You are going to hit a big pain point with myisam with that many files anyway (it breaks around 4 billion entries without tuning), but even inno will grow large/slow and need a lot of my.cnf tuning Go straight to Postgres - you'll need it eventually anyway, then read up on tuning it. For large databases it runs faster and uses less memory. -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tuning for large (millions of files) backups?
On 12/10/10, Alan Brown (a...@mssl.ucl.ac.uk) wrote: Bruno Friedmann wrote: But you don't want to use mysql for that job, just use Postgresql fine tuned with batch insert enabled. Seconded - having been through this issue. I am running Postgresql with batch insert with jobs of around 8 million files, and it works without any problems. Postgresql is tremendous at providing a smooth upgrade path too. We migrated a lot of services with few problems from each major release starting in the low 7.x release series. Regards Rory -- Rory Campbell-Lange r...@campbell-lange.net Campbell-Lange Workshop www.campbell-lange.net 0207 6311 555 3 Tottenham Street London W1T 2AF Registered in England No. 04551928 -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] How do I move from one bacula server to another?
Hi list! I am running a bacula server (3.0.2) on FreeBSD 8.0 with zfs on root and additional zfs pools. So all the storage is file. I use bconsole and the webmin module for administration. That's quite a nice setup for cheap disk-based backups but a move is needed. Due to more clients and data (and bacula 5.0.1!) a new system with a hardware RAID and ubuntu 10.04.1 server will be set up. FreeBSD will be obsolete, because that way zfs does not make much sense here. I made a VM for testing purpose. bacula, mysql, all the stuff which is needed is installed and thus a blank bacula-server is up and running. How do I proceed from this point? I do a mysqldump from the old server's catalog and push that onto the new one, copy the configs and change the volumes + pools, paths, etc accordingly? Will I run into problems because of the different versions? Thanx for hints! Greetings, Oliver -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How do I move from one bacula server to another?
I do a mysqldump from the old server's catalog and push that onto the new one, copy the configs and change the volumes + pools, paths, etc accordingly? Sounds good. Will I run into problems because of the different versions? Check the manual, there are update scripts for your db. jlc -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tuning for large (millions of files) backups?
Henrik, I really appreciate your reply, particularly as a fellow Bacula-on-Solaris user. I do not have my databases on ZFS, only my Bacula storage. I'll probably have to tune for local disk. Thanks very much, Shon On Fri, Oct 8, 2010 at 3:30 PM, Henrik Johansen hen...@scannet.dk wrote: 'Mingus Dew' wrote: All, I am running Bacula 5.0.1 on Solaris 10 x86. I'm currently running MySQL 4.1.22 for the database server. I do plan on upgrading to a compatible version of MySQL 5, but migrating to PostgreSQL isn't an option at this time. I am trying to backup to tape a very large number of files for a client. While the data size is manageable at around 2TB, the number of files is incredibly large. The first of the jobs had 27 million files and initially failed because the batch table became Full. I changed the myisam_data_pointer size to a value of 6 in the config. This job was then able to run successfully and did not take too long. I have another job which has 42 million files. I'm not sure what that equates to in rows that need to be inserted, but I can say that I've not been able to successfully run the job, as it seems to hang for over 30 hours in a Dir inserting attributes status. This causes other jobs to backup in the queue and once canceled I have to restart Bacula. I'm looking for way to boost performance of MySQL or Bacula (or both) to get this job completed. You *really* need to upgrade to MySQL 5 and change to InnoDB - there is no way in hell that MySQL 4 + MyISAM is going to perform decent in your situation. Solaris 10 is a Tier 1 platform for MySQL so the latest versions are always available from www.mysql.com in the native pkg format so there really is no excuse. We run our Bacula Catalog MySQl servers on Solaris (OpenSolaris) so perhaps I can give you some pointers. Our smallest Bacula DB is currently ~70 GB (381,230,610 rows). Since you are using Solaris 10 I assume that you are going to run MySQL off ZFS - in that case you need to adjust the ZFS recordsize for the filesystem that is going to hold your InnoDB datafiles to match the InnoDB block size. If you are using ZFS you should also consider getting yourself a fast SSD as a SLOG (or to disable the ZIL entirely if you dare) - all InnoDB writes to datafiles are O_SYNC and benefit *greatly* from an SSD in terms of write / transaction speed. If you have enough CPU power to spare you should try turning on compression for the ZFS filesystem holding the datafiles - it also can accelerate DB writes / reads but YMMV. Lastly, our InnoDB related configuration from my.cnf : # InnoDB options skip-innodb_doublewrite innodb_data_home_dir = /tank/db/ innodb_log_group_home_dir = /tank/logs/ innodb_support_xa = false innodb_file_per_table = true innodb_buffer_pool_size = 20G innodb_flush_log_at_trx_commit = 2 innodb_log_buffer_size = 128M innodb_log_file_size = 512M innodb_log_files_in_group = 2 innodb_max_dirty_pages_pct = 90 Thanks, Shon -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Med venlig hilsen / Best Regards Henrik Johansen hen...@scannet.dk Tlf. 75 53 35 00 ScanNet Group A/S ScanNet -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Same client, different servers
On 10/8/2010 12:13 PM, Eduardo JĂșnior wrote: Hi On Fri, Oct 8, 2010 at 12:08 PM, Martin Simmonsmar...@lispworks.com wrote: But in this way, i always would need change 'Address' in Client Section But is it possible I have multiples 'Address' in Client Section, that when the first one fail, the second one is used? No, you can only have one Address in the Client section. However, I think you can use Address = my-server and have multiple addresses in the DNS for my-server. Bacula will use the first address that accepts a connection so you need to ensure that the DNS server returns the addresses in a fixed order (server1 first). Ok, I get it. But I continue with manual work, having to change the order of the A records. You don't, your DNS server does. But that's not important right now... Then, as I can only have one Address in the Client section, the best alternative is create a virtual IP, that automatically change between server1 and server2 according to availability, and in the Client section I point to that IP. A virtual IP or a hostname? When one server takes over from the other, how do the clients connect to the right host? Isn't this the same problem? -- Dan Langille - http://langille.org/ -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users