[Bacula-users] Shell script to label new tape in changer with barcodes

2010-10-12 Thread Rumato

If anybody need this staff i wrote some script to label new unlabeled tape
with barcodes and register it in Bacula system in Pool Scratch
This script can be used if you want to label new tape using it's barcode and
create a volume with the same name in some Bacula's pool. By default in this
script used a pool Scratch
Script create a .log file in /var/log/barcode_label.{current date}.log

Usage: barcode_label.sh [options] -s [1-8]
Tape Barcode Label tool ver $VER
OPTIONS:
-h | --help  Show this message
-v | --version  Show version only
-n | --notifySend notification to Backup group by email
-s | --slot   Set the slot number with unlabeled tape [1-8]
-e | --exch-slot   Load unlabeled tape from EE-slot to changer

You just need to set the following variables in section Variables:

MT=/bin/mt
MTX=/usr/local/sbin/mtx
MTX_CH=/usr/local/bacula/etc/scripts/mtx-changer
ctl=/dev/changer
device=/dev/nst0
drive=0
bconsole_cmd=/usr/local/bacula/sbin/bconsole -c
/usr/local/bacula/etc/bconsole.conf
recipient=bac...@localhost
send_mail=no
load_from_ee=no
ee_slot=10
log_file=/var/log/barcode_label.`date +\%Y%m%d-%H:%M:%S\`.log

The script in attach  http://old.nabble.com/file/p29934340/barcode_label.sh
barcode_label.sh 

Hope this staff will be usefull to somebody.
-- 
View this message in context: 
http://old.nabble.com/Shell-script-to-label-new-tape-in-changer-with-barcodes-tp29934340p29934340.html
Sent from the Bacula - Users mailing list archive at Nabble.com.


--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today.
http://p.sf.net/sfu/beautyoftheweb
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Two storage daemons - is it possible

2010-10-12 Thread Stephen Carr
Dear All

I need advice regarding having several storage daemons that share the 
MySQL database and discs (using NFS) but one storage daemon manages the 
tape unit.

All backups go to disc but the Full backups are migrated to tape overnight.

The reason for asking this question is that we backup 60 laptops during 
the working week between 9 am and 4 pm with 12 having a full backup on 
one of the week days. The problem is the network is saturated and some 
clients are slow and others have large amounts of data. (Applications 
etc are not backed up only user data).

I suspect the NFS and MySQL traffic may negate any gain by having extra 
storage daemons.

Another option is to see if bonding two network adapters may work.

Thanks in Advance
Stephen Carr


-- 
Stephen Carr
Computing Officer
School of Civil and Environmental Engineering
The University of Adelaide
Tel +618-8303-4313
Fax +618-8303-4359
Email sgc...@civeng.adelaide.edu.au

CRICOS Provider Number 00123M
---
This email message is intended only for the addressee(s) and
contains information that may be confidential and/or copyright.
If you are not the intended recipient please notify the sender
by reply email and immediately delete this email. Use, disclosure
or reproduction of this email by anyone other than the intended
recipient(s) is strictly prohibited. No representation is made
that this email or any attachments are free of viruses. Virus
scanning is recommended and is the responsibility of the recipient.


--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today.
http://p.sf.net/sfu/beautyoftheweb
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Two storage daemons - is it possible

2010-10-12 Thread James Harper
 
 Dear All
 
 I need advice regarding having several storage daemons that share the
 MySQL database and discs (using NFS) but one storage daemon manages
the
 tape unit.
 
 All backups go to disc but the Full backups are migrated to tape
overnight.
 
 The reason for asking this question is that we backup 60 laptops
during
 the working week between 9 am and 4 pm with 12 having a full backup on
 one of the week days. The problem is the network is saturated and some
 clients are slow and others have large amounts of data. (Applications
 etc are not backed up only user data).
 
 I suspect the NFS and MySQL traffic may negate any gain by having
extra
 storage daemons.
 
 Another option is to see if bonding two network adapters may work.
 

The director talks to MySQL, the storage daemon does not. You can have
as many storage daemons as you want, although migration does not work
between them (or at least it didn't last time I checked), but each sd
could have its own set of NFS volumes connected via a different network
connection.

If the data was being backed up at half the rate would there still be
enough time in the day to complete the backups? You could simply
throttle the rate to an acceptable percentage of total bandwidth such
that the backups still completed in time.

James



--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today.
http://p.sf.net/sfu/beautyoftheweb
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Two storage daemons - is it possible

2010-10-12 Thread Phil Stracchino
On 10/12/10 04:53, Stephen Carr wrote:
 Dear All
 
 I need advice regarding having several storage daemons that share the 
 MySQL database and discs (using NFS) but one storage daemon manages the 
 tape unit.

The storage daemons do not use MySQL directly; only the Director does.
Having two storage daemons writing to the same set of disks is not
inherently a problem, as long as they are never trying to write the same
volume at the same time, but will be likely to result in high levels of
seek activity, and thus may actually hurt performance.

 All backups go to disc but the Full backups are migrated to tape overnight.
 
 The reason for asking this question is that we backup 60 laptops during 
 the working week between 9 am and 4 pm with 12 having a full backup on 
 one of the week days. The problem is the network is saturated and some 
 clients are slow and others have large amounts of data. (Applications 
 etc are not backed up only user data).
 
 I suspect the NFS and MySQL traffic may negate any gain by having extra 
 storage daemons.

As noted above, in this configuration you may not necessarily be even
gaining anything from the multiple storage daemons.  If backing up your
clients is already saturating your network, adding additional NFS
traffic into the problem can't possibly help.

 Another option is to see if bonding two network adapters may work.

You could try bonding, or faster network equipment, or a secondary
network dedicated to backup traffic.  But somehow, if your backup load
is saturating your network, the only real way out of the problem is to
increase the speed of your network.


-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today.
http://p.sf.net/sfu/beautyoftheweb
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Tuning for large (millions of files) backups?

2010-10-12 Thread Alan Brown
Bruno Friedmann wrote:

 Rude answer :
 
 If you really want to use Mysql drop the myisam to innodb.
 But you don't want to use mysql for that job, just use Postgresql fine tuned 
 with batch insert enabled.

Seconded - having been through this issue.

You are going to hit a big pain point with myisam with that many files 
anyway (it breaks around 4 billion entries without tuning), but even 
inno will grow large/slow and need a lot of my.cnf tuning

Go straight to Postgres - you'll need it eventually anyway, then read up 
on tuning it. For large databases it runs faster and uses less memory.






--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today.
http://p.sf.net/sfu/beautyoftheweb
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Tuning for large (millions of files) backups?

2010-10-12 Thread Rory Campbell-Lange
On 12/10/10, Alan Brown (a...@mssl.ucl.ac.uk) wrote:
 Bruno Friedmann wrote:

  But you don't want to use mysql for that job, just use Postgresql
  fine tuned with batch insert enabled.
 
 Seconded - having been through this issue.

I am running Postgresql with batch insert with jobs of around 8 million
files, and it works without any problems.

Postgresql is tremendous at providing a smooth upgrade path too. We
migrated a lot of services with few problems from each major release
starting in the low 7.x release series.

Regards
Rory

-- 
Rory Campbell-Lange
r...@campbell-lange.net

Campbell-Lange Workshop
www.campbell-lange.net
0207 6311 555
3 Tottenham Street London W1T 2AF
Registered in England No. 04551928

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today.
http://p.sf.net/sfu/beautyoftheweb
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] How do I move from one bacula server to another?

2010-10-12 Thread Oliver Hoffmann
Hi list!

I am running a bacula server (3.0.2) on FreeBSD 8.0 with zfs on root
and additional zfs pools. So all the storage is file. I use bconsole
and the webmin module for administration. That's quite a nice setup for
cheap disk-based backups but a move is needed.

Due to more clients and data (and bacula 5.0.1!) a new system with a
hardware RAID and ubuntu 10.04.1 server will be set up. FreeBSD will
be obsolete, because that way zfs does not make much sense here. I made
a VM for testing purpose. bacula, mysql, all the stuff which is needed
is installed and thus a blank bacula-server is up and running.

How do I proceed from this point? I do a mysqldump from the old
server's catalog and push that onto the new one, copy the configs and
change the volumes + pools, paths, etc accordingly? Will I run into
problems because of the different versions?

Thanx for hints!

Greetings,

Oliver

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today.
http://p.sf.net/sfu/beautyoftheweb
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] How do I move from one bacula server to another?

2010-10-12 Thread Joseph L. Casale
 I do a mysqldump from the old server's catalog and push that onto the new one,
copy the configs and change the volumes + pools, paths, etc accordingly?

Sounds good.

 Will I run into problems because of the different versions?

Check the manual, there are update scripts for your db.

jlc

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today.
http://p.sf.net/sfu/beautyoftheweb
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Tuning for large (millions of files) backups?

2010-10-12 Thread Mingus Dew
Henrik,
 I really appreciate your reply, particularly as a fellow
Bacula-on-Solaris user. I do not have my databases on ZFS, only my Bacula
storage. I'll probably have to tune for local disk.

Thanks very much,
Shon

On Fri, Oct 8, 2010 at 3:30 PM, Henrik Johansen hen...@scannet.dk wrote:

 'Mingus Dew' wrote:

 All,
 I am running Bacula 5.0.1 on Solaris 10 x86. I'm currently running
 MySQL 4.1.22 for the database server. I do plan on upgrading to a
 compatible version of MySQL 5, but migrating to PostgreSQL isn't an
 option at this time.

 I am trying to backup to tape a very large number of files for a
 client. While the data size is manageable at around 2TB, the number of
 files is incredibly large.
 The first of the jobs had 27 million files and initially failed because
 the batch table became Full. I changed the myisam_data_pointer size
 to a value of 6 in the config.

 This job was then able to run successfully and did not take too long.

 I have another job which has 42 million files. I'm not sure what that
 equates to in rows that need to be inserted, but I can say that I've
 not been able to successfully run the job, as it seems to hang for
 over 30 hours in a Dir inserting attributes status. This causes
 other jobs to backup in the queue and once canceled I have to restart
 Bacula.

 I'm looking for way to boost performance of MySQL or Bacula (or both)
 to get this job completed.


 You *really* need to upgrade to MySQL 5 and change to InnoDB - there is no
 way in hell that MySQL 4 + MyISAM is going to perform decent in your
 situation.
 Solaris 10 is a Tier 1 platform for MySQL so the latest versions are
 always available from www.mysql.com in the native pkg format so there
 really
 is no excuse.

 We run our Bacula Catalog MySQl servers on Solaris (OpenSolaris) so
 perhaps I can give you some pointers.

 Our smallest Bacula DB is currently ~70 GB (381,230,610 rows).

 Since you are using Solaris 10 I assume that you are going to run MySQL
 off ZFS - in that case you need to adjust the ZFS recordsize for the
 filesystem that is going to hold your InnoDB datafiles to match the
 InnoDB block size.

 If you are using ZFS you should also consider getting yourself a fast
 SSD as a SLOG (or to disable the ZIL entirely if you dare) - all InnoDB
 writes to datafiles are O_SYNC and benefit *greatly* from an SSD in
 terms of write / transaction speed.

 If you have enough CPU power to spare you should try turning on
 compression for the ZFS filesystem holding the datafiles - it also can
 accelerate DB writes / reads but YMMV.

 Lastly, our InnoDB related configuration from my.cnf :

 # InnoDB options skip-innodb_doublewrite
 innodb_data_home_dir = /tank/db/
 innodb_log_group_home_dir = /tank/logs/
 innodb_support_xa = false
 innodb_file_per_table = true
 innodb_buffer_pool_size = 20G
 innodb_flush_log_at_trx_commit = 2
 innodb_log_buffer_size = 128M
 innodb_log_file_size = 512M
 innodb_log_files_in_group = 2
 innodb_max_dirty_pages_pct = 90



 Thanks,
 Shon


 --
 Beautiful is writing same markup. Internet Explorer 9 supports
 standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
 Spend less time writing and  rewriting code and more time creating great
 experiences on the web. Be a part of the beta today.
 http://p.sf.net/sfu/beautyoftheweb


  ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



 --
 Med venlig hilsen / Best Regards

 Henrik Johansen
 hen...@scannet.dk
 Tlf. 75 53 35 00

 ScanNet Group
 A/S ScanNet
--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today.
http://p.sf.net/sfu/beautyoftheweb___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Same client, different servers

2010-10-12 Thread Dan Langille
On 10/8/2010 12:13 PM, Eduardo JĂșnior wrote:
 Hi

 On Fri, Oct 8, 2010 at 12:08 PM, Martin Simmonsmar...@lispworks.com  wrote:

 But in this way, i always would need change 'Address' in Client Section


 But is it possible I have multiples 'Address' in Client Section,
 that when the first one fail, the second one is used?

 No, you can only have one Address in the Client section.

 However, I think you can use Address = my-server and have multiple addresses
 in the DNS for my-server.  Bacula will use the first address that accepts a
 connection so you need to ensure that the DNS server returns the addresses in
 a fixed order (server1 first).



 Ok, I get it. But I continue with manual work, having to change the
 order of the A records.

You don't, your DNS server does.  But that's not important right now...

 Then, as I can only have one Address in the Client section, the best
 alternative is
 create a virtual IP, that automatically change between server1 and
 server2 according to
 availability, and in the Client section I point to that IP.

A virtual IP or a hostname?

When one server takes over from the other, how do the clients connect to 
the right host?  Isn't this the same problem?

-- 
Dan Langille - http://langille.org/

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today.
http://p.sf.net/sfu/beautyoftheweb
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users