Re: [Bacula-users] Problem with my eject tape job

2010-11-18 Thread Thorsten Reichelt
Hi!

 Try it using Type = Admin in the Eject-LTO-Tape instead of Type = Backup.

Thank you! 
You made my day! 
Type = Admin did it! :)

  Thorsten


-- 
GMX DSL Doppel-Flat ab 19,99 euro;/mtl.! Jetzt auch mit 
gratis Notebook-Flat! http://portal.gmx.net/de/go/dsl

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] TLS and PKI, How to limit de encryption overhead ?

2010-11-18 Thread Hugo Letemplier
I already use Data encryption because I want the content of my Tape to
be encrypted.
The aspect that's boring me in communication is that authentication /
commands / console access is sent clearly over the network.
I am not sure of what security level the File Daemon encryption only
can provide. I know that meta data aren't encrypted.
Do you have advice for that kind of stuff ?
For the moment I use SSH but in a final configuration I might use
remote laptop computers with non static ip configuration ( change ip
via console access ...)
Thanks.
Hugo

2010/11/18 Radosław Korzeniewski rados...@korzeniewski.net:
 2010/11/18 Thomas Mueller tho...@chaschperli.ch

 On 18.11.2010 02:01, Dan Langille wrote:

 
  IMHO TLS is only used for the control-channel not for the data-
  channel.
 
  Really? I hope not. Can you prove this?
 

 ok maybe you're right. i've had in mind that it was not encrypted, but
 written is that the volumes written by sd are not encrypted. not the
 data transfer between fd and sd.

 The data written to Volumes by the Storage daemon is not encrypted by
 this code. 


 http://bacula.org/5.0.x-manuals/en/main/main/Bacula_TLS_Communications.html


 Data encription is performed by FD:

 http://bacula.org/5.0.x-manuals/en/main/main/Data_Encryption.html

 Radek

 --
 Radosław Korzeniewski
 rados...@korzeniewski.net

 --
 Beautiful is writing same markup. Internet Explorer 9 supports
 standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
 Spend less time writing and  rewriting code and more time creating great
 experiences on the web. Be a part of the beta today
 http://p.sf.net/sfu/msIE9-sfdev2dev
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Understanding purge

2010-11-18 Thread Dermot Beirne
Hi,
There is a big difference in the size of individual jobs, they range
from maybe 30Gb to 300Gb.  No individual job would be multi terabyte.
The number of clients combined would be over 1 TB for a given day,
rather than an individual job.  I used 5Gb as it was a suggested size
in the bacula documentation.

Dermot.

On 11/17/10 19:16, Dermot Beirne wrote:
 Hi Phil,
 I have set a size limit of 5Gb on each volume.  My daily incrementals
 are using over 300 such volumes at the moment, so 200 will be nowhere
 near enough to do a full backup of all the clients at year end, so
 I'll be increasing that before then.

Ah, I didn't realize you were using so many volumes per job.  If you're
running multi-terabyte backup jobs, aren't 5GB volumes a bit small?


-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Understanding purge

2010-11-18 Thread Eric Bollengier
Hello Blake,

Le jeudi 18 novembre 2010 00:30:16, Blake Dunlap a écrit :
 Basicly what I see here is that you really want a migration, not a copy
 job. This coupled with the patch from
 http://www.mail-archive.com/bacula-de...@lists.sourceforge.net/msg04724.html
 should do what you want if you set the new option in the migration job
 (from the patch, believe it is Migrate Purge Jobs = yes, as I said, it's
 been a while).

Sorry, we missed your excelent idea, and I think that we can add it very 
quickly, with one minor modification about the directive name (more something 
like  PurgeMigrateJob or PurgeMigrationJob.

If you want to help getting documentation (new feature section and Job 
resource directive) and regression testing on your feature, it would be great.

Bye

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Understanding purge

2010-11-18 Thread Phil Stracchino
On 11/18/10 05:56, Dermot Beirne wrote:
 Hi,
 There is a big difference in the size of individual jobs, they range
 from maybe 30Gb to 300Gb.  No individual job would be multi terabyte.
 The number of clients combined would be over 1 TB for a given day,
 rather than an individual job.  I used 5Gb as it was a suggested size
 in the bacula documentation.

5GB is a good starting size for fixed-size volumes for a small
installation, but one size need not fit all.  It's undoubtedly not an
appropriate choice for a site with a backup volume measured in terabytes
per day.  With that kind of volume of data to back up and that much
evident disk space available to do it with, if I wanted to limit volume
sizes I think I might set my volume size limit at 100GB, or even larger.

In actual fact, although my total full-backup set is under a terabyte, I
don't actually limit the size of my disk volumes at all; I instead use
Volume Write Duration to limit any given volume to hold only a single
day's jobs.  Remember that none of the examples in the documentation is
set in stone.  Use them as a starting point, sure, but apply logic and
decide what's reasonable in your case.  Any volume size limit that
forces you to allocate several hundred volumes for a single day of
incremental backups is probably not appropriate for *your* installation,
and may be costing you significant time in sheer overhead.  If you're
getting any kind of sane transfer rate at all for a dataset of that
size, Bacula must be having to create new volumes and switch volumes
every few seconds.


-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] what does baculas select-query for mysql look like?

2010-11-18 Thread Mike Holden
Martin Simmons wrote:
 On Wed, 17 Nov 2010 17:30:33 +0100, C Keschnat said:

 I'm having problems with long running select statements (bacula
 5.0.2).
 After activating mysql-slow-logs, I saw logs similar to

 # Time: 101117 11:32:56
 # u...@host: bacula[bacula] @ localhost []
 # Query_time: 2793  Lock_time: 0  Rows_sent: 127104387
 Rows_examined:
 127104387
 use bacula;
 SELECT /*!40001 SQL_NO_CACHE */ * FROM `File`;

 I wanted to test some suggestions I read in bug reports and for
 that I
 copied the bacula server to play with it. I tried running

 date  echo 'SELECT SQL_NO_CACHE * FROM `File`;' | mysql -uroot
 -p bacula
 /dev/null  date

 but the process gets killed with Out of memory: kill process
 16377
 (mysql)... after some time. Can anyone tell me how bacula queries
 the
 database?

 It makes many different queries, but I doubt that is makes that one.
  It
 doesn't look like anything it needs to do.

 __Martin


You will need to submit the query exactly as written anyway, which
you haven't done.

SELECT /*!40001 SQL_NO_CACHE */ * FROM `File`;

SELECT SQL_NO_CACHE * FROM `File`;

Note the /*!40001 and the */ in the original code, which is
omitted in the second version? With my experience of Oracle, that
looks like an execution hint, in other words a directive to help
the database choose the most efficient way of retrieveing the data.
It's a specially formed comment, hence the /* ... */, so you either
need to include the entire comment, or omit it entirely, but you
have included the SQL_NO_CACHE part, and omitted the rest, which is
probably causing some weird error in the database.
-- 
Mike Holden

http://www.by-ang.com - the place to shop
for all manner of hand crafted items,
including Jewellery, Greetings Cards and Gifts



--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bscan, file retention, and pruning

2010-11-18 Thread Kleber Leal
Maybe this can help you:
http://www.bacula.org/5.0.x-manuals/en/utility/utility/Volume_Utility_Tools.html#SECTION00274000

copy/paste
*An interesting aspect of restoring a catalog backup using bscan is that the
backup was made while Bacula was running and writing to a tape. At the point
the backup of the catalog is made, the tape Bacula is writing to will have
say 10 files on it, but after the catalog backup is made, there will be 11
files on the tape Bacula is writing. This there is a difference between what
is contained in the backed up catalog and what is actually on the tape. If
after restoring a catalog, you attempt to write on the same tape that was
used to backup the catalog, Bacula will detect the difference in the number
of files registered in the catalog compared to what is on the tape, and will
mark the tape in error. *

Kleber

2010/11/17 Craig Miskell craig.misk...@opus.co.nz

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1

 Hi,
So I have just seen a case where an old tape with a job that had
 it's file
 records pruned by the File Retention was bscan'd to get the records back
 into
 the database.

 The operator then tried to run a restore, but had managed to leave the tape
 drive in an inconsistent state (unmounted, with the tape in it, so mtx had
 a
 hernia), and the Restore job failed.  That's unfortunate, but it happens,
 and
 isn't the real problem.  When the job failed and finished, the File
 Retention
 period kicked in, and the bscan'd records were purged.

 This is somewhat annoying, and means we have to bscan again (4 hours+).  In
 the
 general case of a bscan and a single successful restore, it's pretty much
 ok.
 But in case of a failure of the restore, or if we find we have to do more
 than
 one restore (the user decides they need more files after the first batch),
 this
 is a real pain.

 The somewhat crude approach is to raise File Retention on the client to a
 big
 enough period to cover back to when the tape was written, while going
 through
 the bscan/restore process, and setting it back to normal afterwards.

 Is there a better way?  I'm thinking of something like marking the job as
 not-pruneable after the bscan and while doing restores, but I'm open to any
 suggestions.

 Thanks,

 - --
 Craig Miskell
 Senior Systems Administrator
 Opus International Consultants
 Phone: +64 4 471 7209
 I think we agree, the past is over
 - -George W Bush

 -BEGIN PGP SIGNATURE-
 Version: GnuPG v1.4.9 (GNU/Linux)

 iEYEARECAAYFAkzkUQkACgkQmDveRtxWqna+BwCgmIKDzOVuuqLoNqe4Gzu12Ky9
 ptIAn3R/CfmMMBe+L2m3V+DuY1vrk2p0
 =wdLG
 -END PGP SIGNATURE-


 --
 Beautiful is writing same markup. Internet Explorer 9 supports
 standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
 Spend less time writing and  rewriting code and more time creating great
 experiences on the web. Be a part of the beta today
 http://p.sf.net/sfu/msIE9-sfdev2dev
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Understanding purge

2010-11-18 Thread Dermot Beirne
Hi,
You make a good point.  I stuck with the 5Gb as keeping small volumes
aids restore times and reduces possibility of corruption affecting a
large part of the backups in the event of a disk fault, as indicated
in the documentation, which, as you say, may not be appropriate for my
setup any more, particularly as these disk volumes will only survive a
day, so be rarely used for restores.

I do see bacula switching and recycling volumes very often, and I also
intend to examine my tape write speeds, as the copy jobs take a long
time.  I presume writing a few large files to tape is more efficient
than a large number of small files.

I think I'll reconsider this volume size and test some variations.

Incidently, do you use verification in your setup.  Is this another
set of jobs that need to be scheduled somewhere between the backup
jobs and the copy jobs?  I don't have much of a window for doing this.
  I don't want to go off topic for this thread, but thought I'd ask
you while I'm typing.  I'll start a new thread if I need to pursue
that any further.

Dermot.


On 11/18/10 05:56, Dermot Beirne wrote:
 Hi,
 There is a big difference in the size of individual jobs, they range
 from maybe 30Gb to 300Gb.  No individual job would be multi terabyte.
 The number of clients combined would be over 1 TB for a given day,
 rather than an individual job.  I used 5Gb as it was a suggested size
 in the bacula documentation.

5GB is a good starting size for fixed-size volumes for a small
installation, but one size need not fit all.  It's undoubtedly not an
appropriate choice for a site with a backup volume measured in terabytes
per day.  With that kind of volume of data to back up and that much
evident disk space available to do it with, if I wanted to limit volume
sizes I think I might set my volume size limit at 100GB, or even larger.

In actual fact, although my total full-backup set is under a terabyte, I
don't actually limit the size of my disk volumes at all; I instead use
Volume Write Duration to limit any given volume to hold only a single
day's jobs.  Remember that none of the examples in the documentation is
set in stone.  Use them as a starting point, sure, but apply logic and
decide what's reasonable in your case.  Any volume size limit that
forces you to allocate several hundred volumes for a single day of
incremental backups is probably not appropriate for *your* installation,
and may be costing you significant time in sheer overhead.  If you're
getting any kind of sane transfer rate at all for a dataset of that
size, Bacula must be having to create new volumes and switch volumes
every few seconds.

-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Understanding purge

2010-11-18 Thread Martin Simmons
 On Thu, 18 Nov 2010 00:41:06 +, Dermot Beirne said:
 
 Hi Martin,
 I read that, and understand it doesn't run automatically, but must be
 called from a runscript, or whatever.
 However, my understanding is that the volumes need to be marked as
 purged before this feature will truncate them?
 
 It does not purge them, but truncates any which have a status of
 purged when it's run.  I need something else to purge them first, and
 then run this to truncate them.  As far as I can see, the only time a
 volume will be marked as purged (apart from manually doing it) is when
 Bacula decides to recycle it, in which case it will be truncated
 anyway before being rewritten.
 
 Am I missing the point of this feature completely?

You'll have to use purge (without actiononpurge=trucate) to manually purge the
volumes beforehand.

__Martin


 Dermot
 
 The documation explains how to use it the actiononpurge=trucate feature:
 http://www.bacula.org/5.0.x-manuals/en/main/main/New_Features_in_5_0_1.html#SECTION0041
 It isn't intended to be automatic.
 
 __Martin

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bscan, file retention, and pruning

2010-11-18 Thread Martin Simmons
 On Thu, 18 Nov 2010 11:02:49 +1300, Craig Miskell said:
 
   So I have just seen a case where an old tape with a job that had it's 
 file
 records pruned by the File Retention was bscan'd to get the records back into
 the database.
 
 The operator then tried to run a restore, but had managed to leave the tape
 drive in an inconsistent state (unmounted, with the tape in it, so mtx had a
 hernia), and the Restore job failed.  That's unfortunate, but it happens, and
 isn't the real problem.  When the job failed and finished, the File Retention
 period kicked in, and the bscan'd records were purged.
 
 This is somewhat annoying, and means we have to bscan again (4 hours+).  In 
 the
 general case of a bscan and a single successful restore, it's pretty much ok.
 But in case of a failure of the restore, or if we find we have to do more than
 one restore (the user decides they need more files after the first batch), 
 this
 is a real pain.
 
 The somewhat crude approach is to raise File Retention on the client to a big
 enough period to cover back to when the tape was written, while going through
 the bscan/restore process, and setting it back to normal afterwards.
 
 Is there a better way?  I'm thinking of something like marking the job as
 not-pruneable after the bscan and while doing restores, but I'm open to any
 suggestions.

I assume you have AutoPrune=Yes in the client definitions (it is the default)?
If so, try changing it to AutoPrune=No.

You can either do that temporarily (instead of raising the File Retention) or
you can do it permanently and also add Prune Files = Yes and Prune Jobs = Yes
in the backup job definitions.  Since the Restore job definition will not have
these directives, it won't trigger any pruning.

The only problem with the latter approach is that pruning will still occur if
a backup runs before you have finished the restore.

__Martin

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Restore problem

2010-11-18 Thread Alan Brown

I have one particular restore which only brings back ~11,500 files out 
of 980,000 on a full backup.

Using Bextract and attempting to restore the job that way gives the same 
result.

There are no errors except that the job was expecting a lot more files 
than actually came back.

The odd thing is that stracing and debugging shows that the blocks on 
the tape are being read fine, as are the files on it, but they're simply 
not being extracted to disk.

Subsequent and previous full backups for the same job work fine.

Backups and restores attempted on 64-bit linux, using Bacula 5.0.3

Has anyone else seen this behaviour?




--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula Media Rotation

2010-11-18 Thread Telemat
Hi Guys,

Still having issues with Bacula :(

Basically the media rotation isn't working. Here is an example of my pool 
definition: -

Pool#123;
nbsp; Name = MondayPool
nbsp; PoolType = Backup
nbsp; Recycle = yes
nbsp; Autoprune = yes
nbsp; VolumeRetention = 13 days
nbsp; VolumeUseDuration = 23 hours
nbsp; LabelFormat = 
nbsp; MaximumVolumes = 2
nbsp; RecycleOldestVolume = yes
#125;

What is happening is that Monday0001 is used during week 1 and Monday0002 is 
used during week 2, now week3 Bacula is asking for Monday0002 and not 
Monday0001 as I think it should. I understand that Bacula will use any media in 
a pool that is flagged append. So I guess what I need to know how to do is when 
Monday0001 is used, it keeps it for at least 7 days and after Monday0002 is 
used (kept for 7 days), Monday0001 is flagged as writable and so on.

Would setting RecycleCurrentVolume = yes be better than RecycleOldestVolume = 
yes?

Cheers

Emyr

+--
|This was sent by tech-t...@telem.co.uk via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] TLS and PKI, How to limit de encryption overhead ?

2010-11-18 Thread Landon J Fuller

On Nov 18, 2010, at 12:19 AM, Thomas Mueller wrote:

 On 18.11.2010 02:01, Dan Langille wrote:
 
 
 IMHO TLS is only used for the control-channel not for the data-
 channel.
 
 Really? I hope not. Can you prove this?
 
 
 ok maybe you're right. i've had in mind that it was not encrypted, but 
 written is that the volumes written by sd are not encrypted. not the 
 data transfer between fd and sd.

The TLS implementation supports encryption of all network communications 
between all daemons.

 The data written to Volumes by the Storage daemon is not encrypted by 
 this code. 
 
 http://bacula.org/5.0.x-manuals/en/main/main/Bacula_TLS_Communications.html

Right -- this caveat is intended to explain that despite the network 
communications being encrypted, the data actually written to the volume is not 
encrypted -- ie, anyone with physical access to the disk or tape can still read 
its contents, but the data can not be read off the wire by someone with a 
network sniffer.

The data (but not meta-data) written to disk can be encrypted by the File 
Daemon, but that is separate from the TLS support. Storage encryption in the 
Storage Daemon is not currently supported (something we've discussed on the 
list in the past).

-landonf
--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Jobs waiting on Storage / Volume pool not assigned

2010-11-18 Thread Christopher Strider Cook
If there's any more information I can provide to allow someone to assist 
in resolving this, please let me know.

It really seems as though on some long running multi-volume jobs that 
additional volumes aren't getting their pool assigned until after the 
job finishes, and that this is preventing other jobs from running 
concurrently.

Thanks, any help would be great.

Chris


On 11/16/10 4:11 PM, Christopher Strider Cook wrote:
 I have what is otherwise a very large and successful Bacula installation
 that has been up and running for years.

 Currently running from Debian lenny-backports version 5.0.2-1~bpo50+.

 The issue I'm currently running into is that jobs are stuck:

 --stat dir
28010 Fullray.2010-11-13_20.25.01_31 is running
28022 Differe  waters.2010-11-13_20.25.01_43 is waiting on Storage Paul02
28024 Differe  zebda.2010-11-13_20.25.01_45 is waiting on Storage Paul02
28026 Differe  latifah.2010-11-13_20.25.01_47 is waiting on Storage Paul02
28028 Differe  betadb0.2010-11-13_20.25.02_49 is waiting on Storage Paul02
28057 Fullmaybelle-P4.2010-11-14_03.15.00_22 is waiting on Storage
 Paul02
28202 Increme  blondie.2010-11-15_20.25.00_04 is waiting on max
 Storage jobs
28208 Increme  costello.2010-11-15_20.25.01_10 is waiting on max
 Storage jobs
28212 Increme  django.2010-11-15_20.25.01_14 is waiting on max Storage
 jobs
28214 Increme  electro.2010-11-15_20.25.02_16 is waiting on max
 Storage jobs

 --Storage Status

 3608 JobId=28022 wants Pool=Paul02 but have Pool= nreserve=0 on
 drive Paul02 (/archive/PAUL-nufa/Paul02).

 3608 JobId=28024 wants Pool=Paul02 but have Pool= nreserve=0 on
 drive Paul02 (/archive/PAUL-nufa/Paul02).

 3608 JobId=28026 wants Pool=Paul02 but have Pool= nreserve=0 on
 drive Paul02 (/archive/PAUL-nufa/Paul02).

 3608 JobId=28028 wants Pool=Paul02 but have Pool= nreserve=0 on
 drive Paul02 (/archive/PAUL-nufa/Paul02).

 3608 JobId=28057 wants Pool=Paul02 but have Pool= nreserve=0 on
 drive Paul02 (/archive/PAUL-nufa/Paul02).
 --
 Device Paul02 (/archive/PAUL-nufa/Paul02) is mounted with:
   Volume:  Paul02-9267
   Pool:*unknown*
   Media type:  File50
   Total Bytes=19,733,575,217 Blocks=305,890 Bytes/block=64,511
   Positioned at File=4 Block=2,553,706,032
 --

 When they should be running concurrently. All these jobs have the same
 storage and pool specified and max concurrent jobs is set properly for
 storage and pools. I know this because normally it all works fine. The
 hold ups tend to happen on long running large datasets where multiple
 volumes (File based storage) are created.

 Storage {
 Name = Paul02
 Address = deimos.savagebeast.com
 SDPORT = 9103
 Password = x
 Device = Paul02
 Media Type = File50
 Maximum Concurrent Jobs = 6
 }
 Pool {
 Name = Paul02
 Storage = Paul02
 Pool Type = Backup
 Recycle = no
 AutoPrune = yes
 Volume Retention = 37 days
 Use Volume Once = no
 Maximum Volume Bytes = 25 GB
 Label Format = Paul02-
 Action On Purge = Truncate
 Next Pool = Copy02
 }

 bacula.sd  --
 Storage { # definition of myself
 Name = deimos-sd
 SDPort = 9103  # Director's port
 WorkingDirectory = /var/lib/bacula
 Pid Directory = /var/run/bacula
 Maximum Concurrent Jobs = 20
 }
 Director {
 Name = tavern-dir
 Password = x
 }
 Device {
 Name = Paul02
 Device Type = File
 Media Type = File50
 Archive Device = /archive/PAUL-nufa/Paul02
 Random Access = yes
 Label Media = yes
 Requires Mount = no
 Removable Media = no
 Always Open = yes
 }

 ---

 The only thing I have noted is that the storage status lists the volume
 pool as *unknown*, which I understand the storage daemon to believe
 before the director tells it to write a job, but as you can see the
 volume is actively being written to by the running job. Are the jobs
 'waiting on Storage' waiting because they don't see a volume with the
 correct pool mounted? Why isn't the pool assigned properly? When the
 volume fills and it moves onto the next the pool is set properly.

 Have I missed a step in the configuration or is this some sort of bug?

 Thanks

 Chris

 -- other configs
 Client {
 Name = ray
 Address = ray.savagebeast.com
 FDPORT = 9102
 Catalog = MyCatalog
 Password = x
 File Retention = 30 days
 Job Retention = 37 days
 AutoPrune = yes
 Maximum Concurrent Jobs = 4
 }

 Job {
 Name = ray
 Client = ray
 JobDefs = PandoraClient
 Pool = Paul02
 Schedule = PandoraCycle1
 FileSet = General-host
 }

 Client {
 Name = waters
 Address = waters.savagebeast.com
 FDPORT = 9102
 Catalog = MyCatalog
 Password = x
 File Retention = 30 days
 Job Retention = 37 days
 AutoPrune = yes
 Maximum Concurrent Jobs = 4
 }

 Job {
 Name = waters
 Client = waters
 

Re: [Bacula-users] Understanding purge

2010-11-18 Thread Dermot Beirne
Hello Blake,


 Basicly what I see here is that you really want a migration, not a copy
 job. This coupled with the patch from
 bacula-de...@lists.sourceforge.net/msg04724.html 
 target=_newhttp://www.mail-archive.com/bacula-de...@lists.sourceforge.net/msg04724.html
 should do what you want if you set the new option in the migration job
 (from the patch, believe it is Migrate Purge Jobs = yes, as I said, it's
 been a while).

Sorry, we missed your excelent idea, and I think that we can add it very
quickly, with one minor modification about the directive name (more something
like  PurgeMigrateJob or PurgeMigrationJob.

If you want to help getting documentation (new feature section and Job
resource directive) and regression testing on your feature, it would be great.

Bye


This is great news!
Dermot

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Understanding purge

2010-11-18 Thread Blake Dunlap
If you say so, I guess it will be nice to have one less patch to manually
merge.

Personally, I'd rather see them add VirtualDiffs, VirtualFullCopys, fix the
Pool based expiration (really really really want that), have the option to
automatically purge expired volumes instead of only keeping data as long as
possible so i can stop having to script it, provide better logic for
restores from multiple logical sites like offsite tapes or slow link
datacenters, block based dedup, a more inteligent file based store because
they arent tapes, etc etc =)

-Blake

On Thu, Nov 18, 2010 at 12:05, Dermot Beirne dermot.bei...@dpd.ie wrote:

 Hello Blake,


  Basicly what I see here is that you really want a migration, not a copy
  job. This coupled with the patch from
  bacula-de...@lists.sourceforge.net/msg04724.html target=_new
 http://www.mail-archive.com/bacula-de...@lists.sourceforge.net/msg04724.html
 
  should do what you want if you set the new option in the migration job
  (from the patch, believe it is Migrate Purge Jobs = yes, as I said,
 it's
  been a while).

 Sorry, we missed your excelent idea, and I think that we can add it very
 quickly, with one minor modification about the directive name (more
 something
 like  PurgeMigrateJob or PurgeMigrationJob.

 If you want to help getting documentation (new feature section and Job
 resource directive) and regression testing on your feature, it would be
 great.

 Bye


 This is great news!
 Dermot


 --
 Beautiful is writing same markup. Internet Explorer 9 supports
 standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
 Spend less time writing and  rewriting code and more time creating great
 experiences on the web. Be a part of the beta today
 http://p.sf.net/sfu/msIE9-sfdev2dev
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bscan, file retention, and pruning

2010-11-18 Thread Craig Miskell
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Kleber Leal wrote:
 Maybe this can help you:
 http://www.bacula.org/5.0.x-manuals/en/utility/utility/Volume_Utility_Tools.html#SECTION00274000
 
 copy/paste
 /An interesting aspect of restoring a catalog backup using *bscan* is
 that the backup was made while Bacula was running and writing to a tape.
 At the point the backup of the catalog is made, the tape Bacula is
 writing to will have say 10 files on it, but after the catalog backup is
 made, there will be 11 files on the tape Bacula is writing. This there
 is a difference between what is contained in the backed up catalog and
 what is actually on the tape. If after restoring a catalog, you attempt
 to write on the same tape that was used to backup the catalog, Bacula
 will detect the difference in the number of files registered in the
 catalog compared to what is on the tape, and will mark the tape in error. 

I guess you meant to paste the After bscan section, which recommends making
the volume Read Only after bscanning.

An excellent suggestion, and I should have seen that when reading the docs.
Thanks for pointing it out.

- --
Craig Miskell
Senior Systems Administrator
Opus International Consultants
Phone: +64 4 471 7209
BUT XML IS NOT A SUBSITUTE FOR A *** DATABASE!
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.9 (GNU/Linux)

iEYEARECAAYFAkzlk5MACgkQmDveRtxWqnZdHQCfSlky+DfnHcXgb0xDlTD28Gj2
fXkAnA46ed2gnFNH/ZXMYxXysAgEgsxu
=s4TH
-END PGP SIGNATURE-

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bscan, file retention, and pruning

2010-11-18 Thread Craig Miskell
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Martin Simmons wrote:
 On Thu, 18 Nov 2010 11:02:49 +1300, Craig Miskell said:
  So I have just seen a case where an old tape with a job that had it's 
 file
 records pruned by the File Retention was bscan'd to get the records back into
 the database.

 The operator then tried to run a restore, but had managed to leave the tape
 drive in an inconsistent state (unmounted, with the tape in it, so mtx had a
 hernia), and the Restore job failed.  That's unfortunate, but it happens, and
 isn't the real problem.  When the job failed and finished, the File Retention
 period kicked in, and the bscan'd records were purged.

 This is somewhat annoying, and means we have to bscan again (4 hours+).  In 
 the
 general case of a bscan and a single successful restore, it's pretty much ok.
 But in case of a failure of the restore, or if we find we have to do more 
 than
 one restore (the user decides they need more files after the first batch), 
 this
 is a real pain.

 The somewhat crude approach is to raise File Retention on the client to a big
 enough period to cover back to when the tape was written, while going through
 the bscan/restore process, and setting it back to normal afterwards.

 Is there a better way?  I'm thinking of something like marking the job as
 not-pruneable after the bscan and while doing restores, but I'm open to any
 suggestions.
 
 I assume you have AutoPrune=Yes in the client definitions (it is the default)?
 If so, try changing it to AutoPrune=No.
 
 You can either do that temporarily (instead of raising the File Retention) or
 you can do it permanently and also add Prune Files = Yes and Prune Jobs = Yes
 in the backup job definitions.  Since the Restore job definition will not have
 these directives, it won't trigger any pruning.
 
 The only problem with the latter approach is that pruning will still occur if
 a backup runs before you have finished the restore.
Thanks for both suggestions; the first is a nice clean option, although someone
else suggested making the bscan'd volume Read Only, which is even less intrusive
(affects just that volume).

But thanks anyway; it's helpful to know the various options.

Craig
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.9 (GNU/Linux)

iEYEARECAAYFAkzllAUACgkQmDveRtxWqnYOHgCfSZP6oTFfQHZEpdqnICfms5ub
j84AnR4LDnobtagoqqeJxsqtjIUptuI3
=igQE
-END PGP SIGNATURE-

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Slow LTO4 write speed

2010-11-18 Thread Bob Hetzel
1) Make sure all the firmwares are up to date: the 1068E card, the tape 
drives, specifically.  While you're at it, make sure the Adaptec card has 
up to date firmware too.

2) You might want to try this other setting too...
Maximum File Size = 3GB

3) Looking at your output, you only got a bit over 500GB.  Are you testing 
with an LTO-3 tape? (max uncompressed size of those is only 400GB, whereas 
LTO-4 tapes fit 800GB uncompressed so you should have gotten much more on 
the tape before it thought it hit the end)  If so, my understanding is that 
the tape drive will operate backward compatibly, including lowering the max 
read and write speeds to the previous generation's.

4) Also, writing to the tape is very CPU intensive.  Is the system  busy 
doing something else?


Just a few shots in the dark there, hopefully one of them helps.

In addition, until you get everything working, you should probably not mess 
with the default network buffer size.  The manual has this to say about 
that setting:
Maximum Network Buffer Size = bytes
where bytes specifies the initial network buffer size to use with the File 
daemon. This size will be adjusted down if it is too large until it is 
accepted by the OS. Please use care in setting this value since if it is 
too large, it will be trimmed by 512 bytes until the OS is happy, which may 
require a large number of system calls. The default value is 32,768 bytes.
The default size was chosen to be relatively large but not too big in the 
case that you are transmitting data over Internet. It is clear that on a 
high speed local network, you can increase this number and improve 
performance. For example, some users have found that if you use a value of 
65,536 bytes they get five to ten times the throughput. Larger values for 
most users don't seem to improve performance. If you are interested in 
improving your backup speeds, this is definitely a place to experiment. You 
will probably also want to make the corresponding change in each of your 
File daemons conf files.


Bob



 Hi!

 We're seeing strange behaviour with Bacula 5.0.3 on Debian/Squeeze and
 Kernels 2.6.36 and 2.6.32 (for a while, we've had CentOS 5 for testing,
 but that didn't change a thing).

 See the 'btape fill' results below, the write speed doesn't get above
 50MB/s - the tape drive is an ULTRIUM-HH4 LTO4 drive in a Tandberg
 StorageLoader. Tar is able to write with 120MB/s to the tapes.

 I tried different block sizes (64K to 2M; the tape drive claims to
 support up to 16M, but Linux doesn't let me), the relevant parts of
 bacula-sd.conf are below. I'm quit out of ideas how I could speed up the
 tape writes for bacula?

 The system btw is a single Xeon E5420, 8GB Ram. The Storage Library/Tape
 drives are SAS-connected via a LSI Logig MPTSAS 1068E and storage is a
 24-disk Raid50 via Adaptec 52445.


 16-Nov 17:02 btape JobId 0: 3304 Issuing autochanger load slot 1, drive 0 
 command.
 16-Nov 17:03 btape JobId 0: 3305 Autochanger load slot 1, drive 0, status 
 is OK.
 Wrote Volume label for volume TestVolume1.
 Wrote Start of Session label.
 17:03:23 Begin writing Bacula records to first tape ...
 Wrote block=5000, file,blk=11,239 VolBytes=10,483,662,848 rate=47.01 MB/s
 Wrote block=1, file,blk=22,3 VolBytes=20,969,422,848 rate=40.87 MB/s
 Wrote block=15000, file,blk=32,243 VolBytes=31,455,182,848 rate=42.68 MB/s
 Wrote block=2, file,blk=43,7 VolBytes=41,940,942,848 rate=45.93 MB/s
 Wrote block=25000, file,blk=53,247 VolBytes=52,426,702,848 rate=46.27 MB/s
 Wrote block=3, file,blk=64,11 VolBytes=62,912,462,848 rate=47.87 MB/s
 17:25:41 Flush block, write EOF
 Wrote block=35000, file,blk=74,251 VolBytes=73,398,222,848 rate=48.03 MB/s
 Wrote block=4, file,blk=85,15 VolBytes=83,883,982,848 rate=49.02 MB/s
 Wrote block=45000, file,blk=95,255 VolBytes=94,369,742,848 rate=49.15 MB/s
 Wrote block=5, file,blk=106,19 VolBytes=104,855,502,848 rate=49.74 MB/s
 Wrote block=55000, file,blk=116,259 VolBytes=115,341,262,848 rate=49.82 MB/s
 Wrote block=6, file,blk=127,23 VolBytes=125,827,022,848 rate=50.13 MB/s
 17:46:06 Flush block, write EOF
 Wrote block=65000, file,blk=137,263 VolBytes=136,312,782,848 rate=50.29 MB/s
 Wrote block=7, file,blk=148,27 VolBytes=146,798,542,848 rate=50.29 MB/s
 Wrote block=75000, file,blk=158,267 VolBytes=157,284,302,848 rate=50.52 MB/s
 Wrote block=8, file,blk=169,31 VolBytes=167,770,062,848 rate=50.50 MB/s
 Wrote block=85000, file,blk=179,271 VolBytes=178,255,822,848 rate=50.81 MB/s
 Wrote block=9, file,blk=190,35 VolBytes=188,741,582,848 rate=49.16 MB/s
 18:08:33 Flush block, write EOF
 Wrote block=95000, file,blk=200,275 VolBytes=199,227,342,848 rate=49.50 MB/s
 Wrote block=10, file,blk=211,39 VolBytes=209,713,102,848 rate=49.43 MB/s
 Wrote block=105000, file,blk=221,279 VolBytes=220,198,862,848 rate=49.79 MB/s
 Wrote block=11, file,blk=232,43 VolBytes=230,684,622,848 rate=49.65 MB/s
 Wrote block=115000, file,blk=242,283 

[Bacula-users] Software compression: None

2010-11-18 Thread Steve Thompson
Bacula 5.0.2, CentOS 5.5, x86_64.

Recently noticed a few Software Compression: None reports lately, 
affecting about 10% of my backup jobs, both large and small. Software 
compression is most definitely turned on. What is this telling me?

Steve

Steve Thompson E-mail:  smt AT vgersoft DOT com
Voyager Software LLC   Web: http://www DOT vgersoft DOT com
39 Smugglers Path  VSW Support: support AT vgersoft DOT com
Ithaca, NY 14850
   186,282 miles per second: it's not just a good idea, it's the law


--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bscan, file retention, and pruning

2010-11-18 Thread Bob Hetzel
What you've hit on is something I've noted too... I'm thinking it would be 
a nice tweak/enhancement to bacula if the pruning function was disabled on 
restore jobs.  Another case that could trigger it might be just restoring 
from your oldest backup.

I've no idea how simple this change might be, though.  It seems rather 
counter intuitive for bacula to try to prune something at the end of a 
restore job (successful or failed) so it may be a bigger project than 
adding a simple if statement...  Has anybody dug into that part of the code?

Bob

 From: Craig Miskell craig.misk...@opus.co.nz
 Subject: [Bacula-users] bscan, file retention, and pruning
 To: bacula-users bacula-users@lists.sourceforge.net
 Message-ID: 4ce45109.4010...@opus.co.nz
 Content-Type: text/plain; charset=ISO-8859-1

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1

 Hi,
   So I have just seen a case where an old tape with a job that had it's 
 file
 records pruned by the File Retention was bscan'd to get the records back into
 the database.

 The operator then tried to run a restore, but had managed to leave the tape
 drive in an inconsistent state (unmounted, with the tape in it, so mtx had a
 hernia), and the Restore job failed.  That's unfortunate, but it happens, and
 isn't the real problem.  When the job failed and finished, the File Retention
 period kicked in, and the bscan'd records were purged.

 This is somewhat annoying, and means we have to bscan again (4 hours+).  In 
 the
 general case of a bscan and a single successful restore, it's pretty much ok.
 But in case of a failure of the restore, or if we find we have to do more than
 one restore (the user decides they need more files after the first batch), 
 this
 is a real pain.

 The somewhat crude approach is to raise File Retention on the client to a big
 enough period to cover back to when the tape was written, while going through
 the bscan/restore process, and setting it back to normal afterwards.

 Is there a better way?  I'm thinking of something like marking the job as
 not-pruneable after the bscan and while doing restores, but I'm open to any
 suggestions.

 Thanks,

 - --
 Craig Miskell
 Senior Systems Administrator
 Opus International Consultants
 Phone: +64 4 471 7209
 I think we agree, the past is over
 - -George W Bush



--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Tuning for large (millions of files) backups?

2010-11-18 Thread Alan Brown
On 13/11/10 04:46, Gary R. Schmidt wrote:
 You mean looks increasingly *unlikely* don't you?  As InnoDB is the
 default in MySQL 5.5...

Yes it is, but take a look at what Oracle's been doing to the other 
opensource projects it inherited.

It says a lot when core mysql developers fork a new project.

It says a lot more when this happens across a number of projects 
including the entire Open Office developer team.

  I suspect there to be at least one person involved in this discussion
 who has *religion* in relation to database engines...


Nothing to do with religion - and FWIW, stating that postgresql requires 
a DBA is a clear case of FUD.

My point of view comes from running both engines on the same hardware 
and observing the loads involved. Personally I'd prefer to be running 
mysql but it was clear postgres ran faster and had lower memory 
foorprints for our use than innodb. Others have reported the same thing 
over the years.

(Longer term I'm concerned about what Oracle may do with Mysql as we 
have a number of databases installed on various machines machines doing 
various things for various groups  space scientists are difficult to 
deal with at the best of times, let alone if they have to change tools.)

 Frankly, I'd rather there were reliable connectors and queries available
 for Oracle and DB2, rather than this childish prattle over MySQL and
 PostGRES.

It'd be nice, but it's not going to happen unless someone who wants 
them, writes it (or pays for it)





--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] File mismatch by -1, after a computer crash

2010-11-18 Thread Royce Brown
 Using bacula v 5.0.2 on A netbsd machine v 5.1 (64bit )

I have this strange problem when after a computer crash, the next time
bacula tries to write to tape it gets the file count wrong by -1 file.
No backups are running when the computer crashes.

The error is:

Error: Bacula cannot write on tape Volume 57 because:
The number of files mismatch! Volume=70 Catalog=71

if I do a bscan of the tape. the end result looks like this, but the
main point is it seems to agree with the catalog number

19-Nov 13:39 bscan JobId 0: End of Volume at file 71 on device
BACKUP-LTO-1 (/dev/nrst1), Volume 57
bscan: bscan.c:337-5818 == JobId=0 
19-Nov 13:39 bscan JobId 0: End of all volumes.
bscan: bscan.c:424 Record: SessId=0 SessTim=0 FileIndex=-6 Stream=0 len=0
End of physical tape.
bscan: bscan.c:637 End of all Volumes. VolFiles=71 VolBlocks=0
VolBytes=59,378,195,110
Records would have been added or updated in the catalog:
  1 Media
  1 Pool
 95 Job
 579697 File

Going into bconsole and reducing the file count by 1 allows the tape to
be written to, but I suspect the last backup to the tape has now just
been corrupted. 
There are three tape drives on the machine (2 LTO4  1 DLT drives) and
this happens to every tape in all drives. You  are unable to use those
tapes again unit you fix the file number up or purge the tape.

Bacula works correctly in every other way I have successfully done
multiple backups and restores.

Has anyone seen this kind of behaviour before or have any suggestions,
any help would be much appreciated.

Royce   

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bscan, file retention, and pruning

2010-11-18 Thread Dan Langille
On 11/18/2010 4:20 PM, Bob Hetzel wrote:
 From: Craig Miskellcraig.misk...@opus.co.nz
 Subject: [Bacula-users] bscan, file retention, and pruning
 To: bacula-usersbacula-users@lists.sourceforge.net
 Message-ID:4ce45109.4010...@opus.co.nz
 Content-Type: text/plain; charset=ISO-8859-1

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1

 Hi,
  So I have just seen a case where an old tape with a job that had it's 
 file
 records pruned by the File Retention was bscan'd to get the records back into
 the database.

 The operator then tried to run a restore, but had managed to leave the tape
 drive in an inconsistent state (unmounted, with the tape in it, so mtx had a
 hernia), and the Restore job failed.  That's unfortunate, but it happens, and
 isn't the real problem.  When the job failed and finished, the File Retention
 period kicked in, and the bscan'd records were purged.

 This is somewhat annoying, and means we have to bscan again (4 hours+).  In 
 the
 general case of a bscan and a single successful restore, it's pretty much ok.
 But in case of a failure of the restore, or if we find we have to do more 
 than
 one restore (the user decides they need more files after the first batch), 
 this
 is a real pain.

 The somewhat crude approach is to raise File Retention on the client to a big
 enough period to cover back to when the tape was written, while going through
 the bscan/restore process, and setting it back to normal afterwards.

 Is there a better way?  I'm thinking of something like marking the job as
 not-pruneable after the bscan and while doing restores, but I'm open to any
 suggestions.

 Thanks,

 What you've hit on is something I've noted too... I'm thinking it would be
 a nice tweak/enhancement to bacula if the pruning function was disabled on
 restore jobs.  Another case that could trigger it might be just restoring
 from your oldest backup.

 I've no idea how simple this change might be, though.  It seems rather
 counter intuitive for bacula to try to prune something at the end of a
 restore job (successful or failed) so it may be a bigger project than
 adding a simple if statement...  Has anybody dug into that part of the code?

Do not set auto prune on.

Instead, use an Admin job to do your pruning for you.

-- 
Dan Langille - http://langille.org/

--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] 10,000th backup

2010-11-18 Thread Ryan Novosielski
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Just hit my 10,000th backup with Bacula. Wanted to say thanks again for
this piece of software. Might have been initially a little tricky to set
up, but it does the job day in and day out. The weakest link in the
process is the human that changes the tape (which is often me).

- -- 
-  _  _ _  _ ___  _  _  _
|Y#| |  | |\/| |  \ |\ |  | |Ryan Novosielski - Sr. Systems Programmer
|$| |__| |  | |__/ | \| _| |novos...@umdnj.edu - 973/972.0922 (2-0922)
\__/ Univ. of Med. and Dent.|IST/CST-Academic Svcs. - ADMC 450, Newark
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAkzmDVgACgkQmb+gadEcsb7ffQCgygrhwkwmt4Qw+4kBWiXrxkv0
CRQAoKMTUrOlchuHT96sgGur5znULPKc
=cRW/
-END PGP SIGNATURE-
attachment: novosirj.vcf--
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today
http://p.sf.net/sfu/msIE9-sfdev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users