[Bacula-users] Balancing level 0 dumps over a week / cycle
Hello, we're in the process of migrating our backup infrastructure from Amanda to Bacula running on Debian Linux, and pondering Bacula's schedules the other day, I was wondering if Bacula has a feature similar to Amanda's bumping of level 0 dumps or full backups during nightly backups. Background: Currently, I've scheduled full dumps on the first sunday of every month, with incremental and differential backups on the other days of the month (pretty much the run-of-the mill weeklyCycle that Bacula comes with). I'm a bit uncertain about what will happen on the next first Sunday and wether Bacula will be able to complete the full dumps of so many hosts in time because ideally, the backup should be finished on all systems on a certain time the following day. So does Bacula support running a level 0 dump in between when Bacula feels like it, or if there's still some time left before a certain date / time or if the total differential backup of today was smaller than size y or something similar? Again, please forgive me if I am missing something obvious about Bacula's feature set, maybe something like this is not even necessary once Bacula has a complete level 0 dump on its media because of the catalog feature, or do I have to balance full dumps manually over the weekdays in the cycle? Bye for now thanks in advance for your time, Uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38 Avenwedder Str. 55, D-33311 Guetersloh, Germany GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461 Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Backup up to tape AND disk at the same time
Hello, I was wondering if it's possible to store full backups both to disk and a tape library at the same time? I think I remember an example somewhere in the bacula docs of how to set this up, but I cannot for the life of me find it again. Background: Currently we're running a seven-day cycle to back up all our clients to disk-based storage. My idea is that when a full backup of a client is being done by Bacula, to have that full backup written to a tape library on the same machine to that a set of full backups on tape could be stored in an external location. As the tape's write performance is better than tat of our disk based storage due to mixed LVM / raid setup and the tape library is rather new, I would not expect any issues with backups taking longer than usual. Is a setup like this possible? Thanks in advance for any help on this, Uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38 Avenwedder Str. 55, D-33311 Guetersloh, Germany GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup up to tape AND disk at the same time
On Wed, Aug 02, 2006 at 01:33:53PM +0200, Uwe Schuerkamp wrote: From: Uwe Schuerkamp [EMAIL PROTECTED] To: Bacula Users Mailing List bacula-users@lists.sourceforge.net Date: Wed, 2 Aug 2006 13:33:53 +0200 Subject: [Bacula-users] Backup up to tape AND disk at the same time Hello, I was wondering if it's possible to store full backups both to disk and a tape library at the same time? I think I remember an example somewhere in the bacula docs of how to set this up, but I cannot for the life of me find it again. Sorry to follow up on my own post, but it looks like the clone feature (using run in a job definition) could be used for this purpose, or am I mistaken? Would a line similar to Run = fullbackup-client01 storage=DLT do the trick, and more importantly, would this job run concurrently with the regular backup to disk? All the best, uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38 Avenwedder Str. 55, D-33311 Guetersloh, Germany GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup up to tape AND disk at the same time
On Wed, Aug 02, 2006 at 09:47:18AM -0400, Hristo Benev wrote: From: Hristo Benev [EMAIL PROTECTED] To: Uwe Schuerkamp [EMAIL PROTECTED] Cc: Bacula Users Mailing List bacula-users@lists.sourceforge.net Date: Wed, 02 Aug 2006 09:47:18 -0400 Subject: Re: [Bacula-users] Backup up to tape AND disk at the same time Uwe Schuerkamp wrote: On Wed, Aug 02, 2006 at 01:33:53PM +0200, Uwe Schuerkamp wrote: From: Uwe Schuerkamp [EMAIL PROTECTED] To: Bacula Users Mailing List bacula-users@lists.sourceforge.net Date: Wed, 2 Aug 2006 13:33:53 +0200 Subject: [Bacula-users] Backup up to tape AND disk at the same time Hello, I was wondering if it's possible to store full backups both to disk and a tape library at the same time? I think I remember an example somewhere in the bacula docs of how to set this up, but I cannot for the life of me find it again. Sorry to follow up on my own post, but it looks like the clone feature (using run in a job definition) could be used for this purpose, or am I mistaken? Would a line similar to Run = fullbackup-client01 storage=DLT do the trick, and more importantly, would this job run concurrently with the regular backup to disk? All the best, uwe I think that clone feature is not fully supported yet. I use 2 jobs running in same time one pointing to HDD and another to tape drive. Hi Hristo, thanks for your reply. Will those jobs retrieve the file from the clients twice (once for each job) or will the file / storage daemons handle this concurrent usage in a graceful manner so that unnecessary network and server load can be avoided? Cheers, uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38 Avenwedder Str. 55, D-33311 Guetersloh, Germany GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] list of jobs in a given volume?
On Sat, Aug 19, 2006 at 12:28:59AM -0700, Jo Rhett wrote: From: Jo Rhett [EMAIL PROTECTED] To: bacula-users@lists.sourceforge.net Date: Sat, 19 Aug 2006 00:28:59 -0700 Subject: [Bacula-users] list of jobs in a given volume? So I've poked around all day trying to track down an overly large backup, and I've realized something. I can't seem to find any useful way to get a list of jobs that are stored in a given volume / media. Even using direct SQL, I can't seem to find a join command that will say Daily-0019 contains jobs client1, client2, etc. I'm certain there has to be a way, but I can't seem to find it. Have you tried query #15, List Jobs stored for a given Volume name:, or are you looking for a list regardless of volume name? Some shell scripting should get you going, like get a list of all volumes where inchanger=1 (if you want), then do a query #15 for each of them. Cheers, uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38 Avenwedder Str. 55, D-33311 Guetersloh, Germany GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461 - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] jobdefs question
Hi folks,
I have defined the following jobdefs entry:
JobDefs {
Name = full_tuesday
Type = Backup
Schedule = FullTuesday
Messages = Standard
Pool = Online01
Priority = 10
}
The schedule defines full backups to a tape pool on Tuesday and
incremental backups to disk during the rest of the week, here's an
example job definition:
Job {
Name = host01
Client = host01-fd
JobDefs = full_tuesday
Pool = Default
Incremental Backup Pool = Online01
Storage = DLT8000
FileSet = Full Set host01
Write Bootstrap = /server/bacula/var/bacula/working/host01.bsr
}
And here's the schedule definition:
Schedule {
Name = FullTuesday
Run = Level=Full FullPool=Default Pool=Default Tue at 12:00
Run = Level=Incremental Pool=Online01 IncrementalPool=Online01 mon wed-sun
at 19:05
}
Full backups now go to tape as expected, but when host01 is due for an
incremental backup, the volume column lists *unknown* where it
should list the online (disk) volume when I use status dir in bconsole.
Can somebody please shed some light on what I am doing wrong? (using
bacula 1.38.9 compiled from source on Debian if that matters).
Cheers, Uwe
--
Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/)
[EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38
Avenwedder Str. 55, D-33311 Guetersloh, Germany
GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] jobdefs question
On Tue, Aug 29, 2006 at 10:45:25AM +0200, Masopust, Christian wrote:
From: Masopust, Christian [EMAIL PROTECTED]
To: Uwe Schuerkamp [EMAIL PROTECTED],
Bacula Users Mailing List bacula-users@lists.sourceforge.net
Date: Tue, 29 Aug 2006 10:45:25 +0200
Subject: RE: [Bacula-users] jobdefs question
Hello Uwe,
I'm not totally sure but this also depends on the configuration of your
pools. So please could you also post it?
Chris
Certainly, here's the tape pool definition:
Pool {
Name = Default
Recycle Oldest Volume = yes
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Volume Retention = 6 months
Accept Any Volume = yes
}
and here's the disk pool:
Pool {
Name = Online01
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Volume Retention = 12 days
Accept Any Volume = yes
Maximum Volumes = 14
Recycle Oldest Volume = yes
LabelFormat =ONLINE01_
Volume Use Duration = 1 day
}
Both pools already exist and have appendable volume members.
All the best thanks in advance for your help,
Uwe
--
Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/)
[EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38
Avenwedder Str. 55, D-33311 Guetersloh, Germany
GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] jobdefs question
Hello folks,
sorry to follow up on myself, but it looks like removing the pool
overrides from the schedule definition fixed the problem like so:
Schedule {
Name = FullMonday
Run = Level=Full FullPool=Default Pool=Default Mon at 11:00
Run = Level=Incremental tue-sun at 19:05
}
Now, the hosts scheduled today for an incremental backup seem to be
destined for the correct disk / online volume, at least the
*unknown* volume has disappeared from the status dir output.
All the best thanks again for your help,
Uwe
--
Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/)
[EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38
Avenwedder Str. 55, D-33311 Guetersloh, Germany
GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] jobdefs question
On Tue, Aug 29, 2006 at 11:04:33AM +0200, Uwe Schuerkamp wrote:
From: Uwe Schuerkamp [EMAIL PROTECTED]
To: Masopust, Christian [EMAIL PROTECTED]
Cc: Bacula Users Mailing List bacula-users@lists.sourceforge.net
Date: Tue, 29 Aug 2006 11:04:33 +0200
Subject: Re: [Bacula-users] jobdefs question
Hello folks,
sorry to follow up on myself, but it looks like removing the pool
overrides from the schedule definition fixed the problem like so:
Schedule {
Name = FullMonday
Run = Level=Full FullPool=Default Pool=Default Mon at 11:00
Run = Level=Incremental tue-sun at 19:05
}
Now, the hosts scheduled today for an incremental backup seem to be
destined for the correct disk / online volume, at least the
*unknown* volume has disappeared from the status dir output.
All the best thanks again for your help,
Uwe
That statement seems to have been a bit premature. Now all backups go
to the offline pool, not just full backups, even though I've indicated
the incremental backup pool in the job definition:
Job {
Name = deniol13
Client = deniol13e-fd
JobDefs = full_monday
Pool = Default
Full Backup Pool = Default
Incremental Backup Pool = Online01
Storage = DLT8000
FileSet = Full Set deniol13 online
Write Bootstrap =
/server/bacula/var/bacula/working/deniol13e_online.bsr
}
If I comment out the Pool=Default statement, bacula throws an
error. Now I'm totally confused: How can I make incremental backups go
to a different pool than full backups?
Thanks in advance,
uwe
--
Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/)
[EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38
Avenwedder Str. 55, D-33311 Guetersloh, Germany
GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Full incremental backups to different storage?
On Tue, Aug 29, 2006 at 05:09:18PM +0200, [EMAIL PROTECTED] wrote: From: [EMAIL PROTECTED] To: [EMAIL PROTECTED] Cc: bacula-users@lists.sourceforge.net Date: Tue, 29 Aug 2006 17:09:18 +0200 Subject: Re: [Bacula-users] Full incremental backups to different storage? Ah, close. I saw that it is possible to use Storage=storage1 on the Run-line in Schedule. Thanks for pointer to correct section. The pools are not actually connected to a specific storage. I tried to use different pools with the result that the storage defined in Job-section waited for the correct volume to be mounted on just that storage. Problem solved with Storage= parameter in Schedule. /Aki I'm having the exact same problem, and using overrides in the schedules run statement like so: Run = Incremental Pool=Online01 Storage=online01 tue-sun This results in all volumes for incremental backups listed as *unknown*, although both the pool Online01 and storage online01 are defined and the pool has appendable volumes available. Full backups to the offline / tape pool are still correctly listed with their target volume names. Should I just hope for the best for this evening's incremental backup to the online01 pool or is there something wrong with my setup? Does your status dir also list volumes as unknown in this case? Cheers, uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38 Avenwedder Str. 55, D-33311 Guetersloh, Germany GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461 - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] jobdefs question
On Tue, Aug 29, 2006 at 12:14:39PM +0200, Arno Lehmann wrote: No problem here, I think. This behaviour is well known to me, and I simply ignore it (but I don't really need the expected volume information). I suppose it's because Bacula will not do the whole routine of finding which volume to use in which storage device when doing this report. Anyway, I usually see the jobs going to the right device, and I suppose your setup also works as you want it to. If it doesn't, please send the resulting error messages etc. Arno Hello Arno, thanks for your reply. I'll just hope for the best tonight and post results tomorrow. All the best, uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38 Avenwedder Str. 55, D-33311 Guetersloh, Germany GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461 - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Prevent bacula from requesting volumes *not* in changer
Hi folks,
I was wondering about the best way to tell bacula that volumes not
present in the changer are not to be recycled / used to avoid operator
intervention. We store some tapes (usually 3 out of 8) off-site, but
those volume records will remain in the database, so when the time
comes for bacula to use a new volume when all are full, it should
recycle the oldest volume *in the changer*, not in the volume pool
which quite likely is stored miles away.
Would I need to define a maximum number of volumes setting in the
pool to accomplish this? Here's the pool definition:
Pool {
Name = Default
Recycle Oldest Volume = yes
Pool Type = Backup
Recycle = yes
AutoPrune = yes # Prune expired volumes
Volume Retention = 6 months
Accept Any Volume = yes # write on any volume in the
pool
}
Thanks in advance for your help,
Uwe
--
Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/)
[EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38
Avenwedder Str. 55, D-33311 Guetersloh, Germany
GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Prevent bacula from requesting volumes *not* in changer
On Fri, Sep 01, 2006 at 11:09:16PM +0200, Kern Sibbald wrote:
From: Kern Sibbald [EMAIL PROTECTED]
To: bacula-users@lists.sourceforge.net
Cc: Arno Lehmann [EMAIL PROTECTED]
Date: Fri, 1 Sep 2006 23:09:16 +0200
Subject: Re: [Bacula-users] Prevent bacula from requesting volumes *not* in
changer
On Friday 01 September 2006 22:15, Arno Lehmann wrote:
Hi,
On 9/1/2006 1:40 PM, Uwe Schuerkamp wrote:
Hi folks,
I was wondering about the best way to tell bacula that volumes not
present in the changer are not to be recycled / used to avoid operator
intervention. We store some tapes (usually 3 out of 8) off-site, but
those volume records will remain in the database, so when the time
comes for bacula to use a new volume when all are full, it should
recycle the oldest volume *in the changer*, not in the volume pool
which quite likely is stored miles away.
The best thing to do is to wait some time... because I'm (slowly)
working on an add-on to bacula to manage volume locations. An important
part in this is to disable volumes but still keep the catalog data intact.
Sounds like just what you want.
The necessary catalog extensions are prepared for version 1.40, they do
exist in the catalog schema introduced somewhere during the ongoing
development of 1.39.
I expect a release of 1.40 in rather short time - weeks, not months -
but that's obviously mainly something Kern has to decide.
From my experience running 1.39.20 for some days now I consider it
stable enough for my setup.
There's currently nothing I can release concerning the volume location
management, because it needs some major rewrite after the catalog
changes, but I hope to produce something I can share in the next few weeks.
By the way, Arno, media Enable/disable is implemented. It also has an
archive state where volumes will not be pruned, but I haven't implemented
that feature yet.
Hope this helps,
Arno
Would I need to define a maximum number of volumes setting in the
pool to accomplish this? Here's the pool definition:
Pool {
Name = Default
Recycle Oldest Volume = yes
Pool Type = Backup
Recycle = yes
AutoPrune = yes # Prune expired volumes
Volume Retention = 6 months
Accept Any Volume = yes # write on any volume in the
pool
}
Thanks in advance for your help,
Uwe
Hi all,
I have now set the volume status to archived on those volumes that
are no longer in the changer. Now bacula uses the in-changer volumes
even if they're younger than those that have been removed from the
changer. Once it needs a new volume, it prunes an old one. Sounds
about right, doesn't it?
However, pruning a volume takes bacula far too long than I'd like
to. We have approx. 500GB data per volume (8-way Ultrium HP changer)
from 10 backup clients, and when pruning starts, bacula just sits
there for nearly a day repeating its pruning volume xxx messages ad
nauseam.
I've found that when I purge the volume manually and then set the
recycle flag, everything works as expected, but I really don't want to
constantly check wether bacula has enough volumes available to
complete the next backup (that's not exactly automation, right? ;-)
Purging takes about 3 minutes per volume as opposed to over a day for
pruning one.
The server is only a lowly 1GHz Intel running mysql on Debian with 2GB
RAM (database size varies around 8 GB), but still I would not expect
pruning a single volume to take this long.
It would be great if somebody could shed some light on this.
All the best, uwe
--
Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/)
[EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38
Avenwedder Str. 55, D-33311 Guetersloh, Germany
GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bad response to Append Data command
On Tue, Sep 05, 2006 at 12:59:57PM +0100, Jaime Ventura wrote: From: Jaime Ventura [EMAIL PROTECTED] To: Uwe Schuerkamp [EMAIL PROTECTED] Cc: Arno Lehmann [EMAIL PROTECTED], Bacula Users bacula-users@lists.sourceforge.net Date: Tue, 05 Sep 2006 12:59:57 +0100 Subject: Re: [Bacula-users] Bad response to Append Data command Thanks for your reply. I've already installer and heavily tested the tapeloader with bacula. I've done lots of backups to tape. All worked ok. Then I went on vacation, and when I came I was getting this error. I cant figure out what happened. Maybe the tape went on vacations too :P Jaime Hello Jaime, to get the simple stuff out of the way first: have you tried restarting the bacula daemons? What's the output of mtx status and do you see any strange messages (scsi-errors and such) in the output of dmesg? Cheers, uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38 Avenwedder Str. 55, D-33311 Guetersloh, Germany GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461 - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup rotation
On Wed, Sep 06, 2006 at 02:33:39PM +0200, Marco Strullato wrote:
From: Marco Strullato [EMAIL PROTECTED]
To: bacula-users@lists.sourceforge.net
Date: Wed, 6 Sep 2006 14:33:39 +0200
Subject: [Bacula-users] backup rotation
hi all!
I've set up backups with bacula to do full backup on sunday and incrental
from monday to saturday. My backups are only on disks; I'd like to have one
volume for job. Moreover I need automatic recycling of volumes so volumes
should rotate.
I choose to have 8 volumes but maybe it is not necessary; At the beginning I
set the pool parameter Recycle to no because Bacula used just one
volume: with no bacula wrote me correctly a volume file for each job.
After 8 backups all volumes are Used and any other backup is possible.
Bacula correctly waits for a new volume.
Today I change this directive to yes and re launch backup.
Status of the 1st volume is change to Purged but backup does not start.
I think I have done some mistakes in configuration. Can you help me?
Pool configuration is the following. Do you need more configuration file?
Pool {
Name = PoolRaffaello
Use Volume Once = yes
Pool Type = Backup
LabelFormat = Raffaello-
AutoPrune = yes
VolumeRetention = 7 days
Maximum Volumes = 8
Recycle = yes
Maximum Volume Jobs = 1
}
Looks like you are missing the Recycle Oldest Volume
parameter. Also, it might be a good idea to set the maximum volume use
duration to one day (see the docs) and not try limiting it by the
number of jobs.
Also remember that you'll need to update pool from resource
definition in bconsole once you've changed the pool resource.
HTH,
uwe
--
Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/)
[EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38
Avenwedder Str. 55, D-33311 Guetersloh, Germany
GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup rotation
On Wed, Sep 06, 2006 at 04:06:35PM -0400, Ryan Novosielski wrote: From: Ryan Novosielski [EMAIL PROTECTED] To: Uwe Schuerkamp [EMAIL PROTECTED] Cc: bacula-users@lists.sourceforge.net Date: Wed, 06 Sep 2006 16:06:35 -0400 Subject: Re: [Bacula-users] backup rotation -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I don't think recycle oldest volume is necessary. I do not use it, and I have everything set up just fine. You should only need proper retention times and duration/jobs per volume settings. Thanks for the note, I guess I'm having a problem with retention periods then because the recycle oldest volume thingy has worked wonders with my recycling problems in the past ;-) All the best, uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38 Avenwedder Str. 55, D-33311 Guetersloh, Germany GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461 - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] How long should volume pruning take?
hi folks,
I am having an issue with automatic volume recycling, esp. with the
time it takes to prune the oldest volume to allow it to be recycled.
Our setup:
- bacula 1.38.9 und Debian Linux (compiled from Source)
- MySQL 5.0.20
- Database size: 10G (Total clients: 27, Total bytes stored: 6.89 TB
Total files: 3146301, according to bacula-web)
- HP Ultrium 3 tape library with 8 tapes, each tape holds about 450GB
- Server RAM: 2 GB, CPU: 1 GHz PIII, used exclusively for Bacula
Problem: When bacula prunes the oldest volume, it takes several hours
and apparently never finishes (I have not tested this because the
server is already in production, and we cannot afford to have Bacula
sit there for half a day doing nothing but pruning while all backups
are on hold ;-).
For instance, this morning Bacula started its backups at 00:35 and at
7:19, it decided it needs a new volume, to it decides to prune the
oldest volume. Over two hours later, it still sits there issueing
pruning oldest volume messages to the console every couple of
minutes, while server load is below 1 (0.32-0.5 according to top), and
apparently not getting anywhere.
Once I decide to purge the volume using the bconsole purge command,
it finishes in less than five minutes and the volume is marked as
append in bacula-web; however the backup job that's waiting for an
appendable volume never resumes.
Database performance is apparently fine as we regulary get 10MB/sec
write backup performance over the net and over 20MB/sec when backing
up to tape directly from disk.
Question: How long should bacula take to prune a volume successfully
from the catalog and recycle it? If I've missed any crucial info
please let me know.
Here's the pool definition:
Pool {
Name = Default
Maximum Volumes = 7
Recycle Oldest Volume = yes
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Volume Retention = 6 months
Accept Any Volume = yes
}
Volume Retention is set to 6 months as we like to archive tapes offsite
every once in a while, but I wonder wether this is really necessary (I
was hoping not to have to use bscan should we need to restore files
from some archived volume).
As it stands, Bacula backup is a manual process for now as one has to
be constantly on the watch to see wether there are still appendable
volumes available or wether one has to purge a volume manually. I'm
temped to try the obsolete purge oldest volume thingy, but the docs
tell me this is not a good idea ;-)
Again, if there's any information mission please let me know and I'll
be happy to provide what I can.
All the best thanks much in advance for your help,
Uwe
--
Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/)
[EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38
Avenwedder Str. 55, D-33311 Guetersloh, Germany
GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys -- and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How long should volume pruning take?
On Wed, Sep 20, 2006 at 11:15:39AM +0200, Kern Sibbald wrote: For your performance problems: Please read the Catalog Maintenance chapter of the manual: http://www.bacula.org/dev-manual/Catalog_Maintenance.html In particular the Performance section in that chapter. It tells you how to resolve these kinds of problems. Hi Ken, thanks for your reply. I've gone over that section a couple of times and have changed the my.cnf as mentioned. I guess I'll play with the optimize table statement a bit then. Also, I've checked that all the necessary indices are there, and as I've said write performance is excellent, so why shouldn't prune performance be excellent, too? Is 10 GB database size too much for the backup volume I mentioned in my first email? Cheers thanks, uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38 Avenwedder Str. 55, D-33311 Guetersloh, Germany GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How long should volume pruning take?
On Wed, Sep 20, 2006 at 03:10:27PM +0200, Kern Sibbald wrote: 10 GB is pretty big, but there are users with databases that large. Take a look at src/cats/make_mysql_tables. There are a few tips in that file for creating extra indexes if you have slow pruning. Once you have the indexes properly setup for your site requirements, pruning should run in a maximum of a couple of minutes. Hello Ken et al., I created another index on the File table as recommended in the documentation yesterday which took about one hour to create (the File table data file is around 6 GB), because I wasn't sure about MySQL's index display format, but it seems I created an identical index to one already there (the new one is called file_jfp_index, sorry for the crummy formatting): mysql show index from File ; +---++--+--+-+---+-+--++--++-+ | Table | Non_unique | Key_name | Seq_in_index | Column_name | Collation | Cardinality | Sub_part | Packed | Null | Index_type | Comment | +---++--+--+-+---+-+--++--++-+ | File | 0 | PRIMARY | 1| FileId | A | 59778107| NULL || | BTREE | | | File | 1 | JobId| 1| JobId | A | 318 | NULL || | BTREE | | | File | 1 | JobId_2 | 1| JobId | A | 318 | NULL || | BTREE | | | File | 1 | JobId_2 | 2| PathId | A | 4598315 | NULL || | BTREE | | | File | 1 | JobId_2 | 3| FilenameId | A | 59778107| NULL || | BTREE | | | File | 1 | file_jfp_idx | 1| JobId | A | 318 | NULL || | BTREE | | | File | 1 | file_jfp_idx | 2| FilenameId | A | 29889053| NULL || | BTREE | | | File | 1 | file_jfp_idx | 3| PathId | A | 59778107| NULL || | BTREE | | +---++--+--+-+---+-+--++--++-+ 8 rows in set (0.00 sec) So to me, it looks like the new index is identical in setup to the one that's been there all along called JobId_2. As a consequence, I don't expect any performance improvements when it comes to pruning the next time around. Is this correct? As per Ken's recommendation, I checked the table creation script, and it seems not to mention any additional indices I should create that aren't already there: # # Possibly add one or more of the following indexes # to the above File table if your Verifies are # too slow. # # INDEX (PathId), # INDEX (FilenameId), # INDEX (FilenameId, PathId) # INDEX (JobId), # I don't have a combined (for lack of a better expression) index on (FilenameId, PathId), but wouldn't that just be a subset of the (Job, Filename, Path) index? Also, the comment talks about slow verifies, but my problem is slow pruning ;-) Should I drop the 2nd, identical index? Backup last night was nearly as fast as before (varying from 10MB/sec down to 3MB/sec depending on the client), so it doesn't seem to hurt in a major way. Again, if I'm missing some crucial information, let me know and I'll be happy to provide what I can. Below are the my.cnf parameters relevant to the server: # # * Fine Tuning # key_buffer = 256M max_allowed_packet = 16M thread_stack= 128K record_buffer = 256M sort_buffer_size= 64M myisam_sort_buffer_size = 64M # # * Query Cache Configuration # query_cache_limit = 6448576 query_cache_size= 64777216 query_cache_type= 1 Mysqld uses around 500-700MB RSS memory of 1GB total (sorry, got that wrong in my last post, the server only has 1 GB RAM installed), depending on activity. All the best thanks in advance for your comments, Uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38 Avenwedder Str. 55, D-33311 Guetersloh, Germany GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https
Re: [Bacula-users] How long should volume pruning take?
On Sat, Sep 23, 2006 at 09:30:20PM +0200, Kern Sibbald wrote: I'm not convinced the indexes are the same. Some people say yes, some say no, and it seems to be also dependent on whether one is talking about MySQL as you are or PostgreSQL. The best solution is to test for your particular case. Hi Kern et al., the new index sadly has done nothing to speed up the pruning process, so for now the only solution seems to be using the purge oldest volume directive in our pool definition in order to get the recycling to work reliably. Please don't obsolete that statement any time soon, ok? ;-) All the best thanks for your help, Uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] Tel: +49 (0)5241 / 80 10 66 FAX: / 806 23 38 Avenwedder Str. 55, D-33311 Guetersloh, Germany GnuPG KeyID: 5887047D, Fingerprint: 2E1320229A3F63 7F676FE9B1A836A461 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Importing a bacula tape volume into another bacula instance
Hi folks, I need to restore data from an offlined DLT tape. The tape is labelled OFFLINE01 and was created on one of our four bacula servers (all running the same bacula version) and put into a safe for storage at another location. However I'd like to import the jobs on this volume into the bacula instance running in another data centre, could this be done using bscan on the tape or would some other method be more appropriate? Would it pose a problem if the client I need to restore is unknown on this bacula instance I'll be importing to? All the best TIA for your help, Uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] phone: [+49] 5242.91- 4740 fax:-9722 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Importing a bacula tape volume into another bacula instance
On Wed, Dec 03, 2008 at 10:01:22AM -0500, John Drescher wrote: On Wed, Dec 3, 2008 at 9:37 AM, Uwe Schuerkamp [EMAIL PROTECTED] wrote: Hi folks, I need to restore data from an offlined DLT tape. The tape is labelled OFFLINE01 and was created on one of our four bacula servers (all running the same bacula version) and put into a safe for storage at another location. However I'd like to import the jobs on this volume into the bacula instance running in another data centre, could this be done using bscan on the tape or would some other method be more appropriate? Would it pose a problem if the client I need to restore is unknown on this bacula instance I'll be importing to? I did this to transfer a vps guest from my work bacula installation to my home. Use bscan. For me there was no problem with the client after I did a modify when I ran the job from bconsole. Hello John, thanks much for your reply. When modifying the restore job, what should I enter as the client and the restore client? Restore client is more or less clear as I'm intending to restore the data to a local RAID on the bacula server in order to recover some files from it, but the client itself (and possibly its associated fileset, Storage, Pool and so on) might come up as unknown in the bacula instance I'm restoring in, or shouldn't this be a problem? All the best, Uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] phone: [+49] 5242.91- 4740 fax:-9722 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Importing a bacula tape volume into another bacula instance
On Wed, Dec 03, 2008 at 11:32:04AM -0500, John Drescher wrote: thanks much for your reply. When modifying the restore job, what should I enter as the client and the restore client? Restore client is more or less clear as I'm intending to restore the data to a local RAID on the bacula server in order to recover some files from it, but the client itself (and possibly its associated fileset, Storage, Pool and so on) might come up as unknown in the bacula instance I'm restoring in, or shouldn't this be a problem? All the best, I am sorry. I don't exactly remember what I did about the client. I think I added the original client to the bacula-dir.conf but I could be wrong. John Hi John, do you recall the bscan syntax you used for the import? It's a 400G medium so I'd like to get it right the first time ;-) Would it be possible to simply copy the entire tape to disk using cp /dev/nst0 /mnt/raid/OFFLINE01 and then work with the OFFLINE01 file for faster access? All the best thanks again for your help, Uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] phone: [+49] 5242.91- 4740 fax:-9722 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Importing a bacula tape volume into another bacula instance
On Wed, Dec 03, 2008 at 03:37:10PM +0100, Uwe Schuerkamp wrote: Hi folks, I need to restore data from an offlined DLT tape. The tape is labelled OFFLINE01 and was created on one of our four bacula servers (all running the same bacula version) and put into a safe for storage at another location. However I'd like to import the jobs on this volume into the bacula instance running in another data centre, could this be done using bscan on the tape or would some other method be more appropriate? Would it pose a problem if the client I need to restore is unknown on this bacula instance I'll be importing to? Hi folks, I've tried a bscan of the volume in question (without db modifications as outlined in the fine manual), but during the scan bacula comes up with tons of unknown client errors which are probably due to the fact that the bacula instance I'd like to use to restore the data doesn't know about the other instance's clients. would it be sufficient to re-create the one client that I'm after in the bacula instance that I use to bscan the tape? Is it somehow possible to tell bscan or some other bacula utility to simply grab all the files associated with a job, jobid or client off a tape and dump it somewhere in the filesystem? Thanks, Uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] phone: [+49] 5242.91- 4740 fax:-9722 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Importing a bacula tape volume into another bacula instance
sorry, just found out about bextract, please ignore my previous email. all the best, uwe -- Uwe Schuerkamp, NIONEX GmbH (http://www.nionex.com/) [EMAIL PROTECTED] phone: [+49] 5242.91- 4740 fax:-9722 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring from volumes on multiple storages
On Wed, Feb 25, 2009 at 05:37:05PM +, Graham Keeling wrote: Hello, Here I'm using bacula-2.2.8. I have a bacula storage daemon, 'Disk 1' (Device 'Disk 1.0') and a bacula storage daemon, 'BPL2Disk 1' (Device 'BPL2Disk 1.0'). There is one backup job allowed per volume. 'BPL2Disk 1' has a full backup and several incrementals. 'Disk 1' has the latest incremental. When I try to restore a job that needs four volumes in total including the latest one on 'Disk 1', it seems as if bacula doesn't bother trying to find the last volume on the second storage. It just tries the first and gives up. I have attached the .bsr file that was produced for the restore job. You can see that it has got the device names correct. The attached file 'log' shows the commands that I entered for the restore job into bconsole, the questions that it asked me, and the messages that bacula logged when it tried to run the restore. It clearly shows that bacula knows where the different volumes are, but it then ignored that information and tried to find all the volumes on 'BPL2Disk 1'. Have a found a bug, a limitation, a feature, or am I doing it wrong? Hi Graham, sorry I cannot help you with your question, but I was under the impression that bacula is able to handle multiple storages and devices in a pool just fine (or are your volumes in different backup pools?). As we'll be adding a 2nd tape library / changer to an existing bacula installation next week I'd be very interested in some comments from the list gurus. All the best, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91- 4740 fax:-9722 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] performance problems backing up ocfs2 clusters
Hello folks, we're experiencing massive problems backing up an ocfs2 cluster filesystem mounted on SLES 10 SP2 machines located on a shared SAN storage). The cluster has 8 members, and we've already tried certain mount options (noatime et al.) in an attempt to improve performance, however bacula's transfer speeds drop down into the double kb / sec digits when it encounters directories which contain many small files (say about 20,000 per dir or so). The backup server in question is a Compaq dl360 (CentOS 5.2 on x86_64) which provides usually excellent performance when backing up other non-ocfs2 fileystems, so I was wondering if anyone has developed a successful strategy for backing up ocfs2 clusters (we're talking 160gb here, no it's not really a huge amount of data). Bacula Version used is 2.2.8 compiled from source, the file daemon on the target machine claims it's version Version: 2.4.3 (10 October 2008) x86_64-unknown-linux-gnu suse 10 Thanks in advance for any ideas or suggestions on this matter. All the best, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91- 4740 fax:-9722 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] performance problems backing up ocfs2 clusters
Hi folks, thanks for your suggestions, I tried your tar suggestion and indeed it turns out that transfer rates drop to the dozens of kb/sec in one special directory stored on the ocfs2 filesystem. I'm now in contact with the ocfs2 devs on the users list to see if they have any suggestions. All the best, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91- 4740 fax:-9722 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Multiple Storage devices in a single Pool?
Hi folks, I'd like to add a 2nd tape library to one of our bacula servers which is running out of space. Is it possible to define jobs in such a way that bacula itself will take care of which storage the job actually ends up in / on? My idea was to label the tapes in the new library so that they belong to the same pool as the tapes in the old tape library, but I wonder wether the Storage = keyword is mandatory in a bacula job / jobdef statement? All the best thanks in advance for any pointers, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91- 4740 fax:-9722 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] End of tape error
On Tue, Mar 17, 2009 at 10:21:46AM +, Prashant Ramhit wrote: Hi All, I am using a SuperLoader 3 - LTO4 and I had the following error. I think the end of the tape is reached. 10-Mar 09:41 server-sd JobId 52: Error: Unable to position to end of data on device TapeDrive (/dev/nst0): ERR=dev.c:896 ioctl MTEOM error on TapeDrive (/dev/nst0). ERR=Input/output error. I want to add *Maximum Volume Bytes *to the storage-dir-conf but do not know whether to add 800GB or 1.6TB to the tape as I am using compressed, GZIP backup. Hello Prashant, usually you should not need to set the tape size manually as bacula will detect an end of tape situation and handle it gracefully. Cheers, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91- 4740 fax:-9722 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Pausing the backup schedule
There's also the disable bconsole command which allows you to disable certain backup jobs. This way, you won't have to change the configuration files. All the best, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Relocating a bacula host, database, dir sd
On Thu, Mar 26, 2009 at 03:35:19PM +1100, terryc wrote: Due to hardware recognition problems in the latest version of Debian(lenny), I might have to relocate my bacula host to another boxen. Are there any gotchas(likely problems)? My main area of concern is the database? Hi Terry, as long as the other box can read the tapes fine I don't see any issues with using the volumes on the other machine. Just make sure to have a mysqldump handy in case that things go pear shaped. All the best good luck, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] brief reporting
On Wed, Mar 25, 2009 at 04:02:08PM -0400, Bill Szkotnicki wrote: Hi, I was wondering if there is a command line tool that could produce a brief report on the status of a client's backups. I have bacula set up to do PC client backups every day and I would like to basically sent each client an email once a week ( on a crontab ) informing him or her that all is well with the backups. Thank you, Bill Hi Bill, I guess you chould achieve something towards that goal by doing a bit of bconsole scripting, for instance by doing a query command for the client in question, formatting the output a bit and then piping the result to mail or mutt -s to send the report, or you could just send a link to a bacula-web generated page. HTH, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] concurrent backups to a single disk volume
Hi folks, the recent talk here of a bug relating to concurrent writes to a single backup volume has made me a bit uneasy about one of our production bacula servers. We have one system with two tape libraries (so no single volume is used by two backups at the same time), however the other system used a large RAID with single file volumes (about 400g each). Bacula version there is bacula-2.2.8, and I only configured concurrent backups to 2 a couple of weeks ago, so I can't really tell we're facing the same issue here as described earlier. Has anyone observed this bug in version 2.2.8, and what's the version considered safe at the moment to use with concurrent backup jobs? All the best thanks in advance for your comments, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Stay on top of everything new and different, both inside and around Java (TM) technology - register by April 22, and save $200 on the JavaOne (SM) conference, June 2-5, 2009, San Francisco. 300 plus technical and hands-on sessions. Register today. Use priority code J9JMT32. http://p.sf.net/sfu/p ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula 2.2.8 creating new volumes even though maxvols = 8
Hi folks,
I'm having a problem with my bacula setup: Bacula creates a new volume
in an 8-volume pool that already has 8 volumes in it, then waits for a
mount of the new volume.
Background: I recently played around with a 2nd changer tape in the
same pool and had to increase the maxvols parameter to 16. Things
didn't work out as expected, to I removed the 2nd changer / tape,
deleted the new volumes in the pool and reduced the number of volumes
back to 8.
Here's the pool definition:
Pool {
Name = Offline
Pool Type = Backup
Recycle = yes # Bacula can recycle Volumes
Purge Oldest Volume = yes
Volume Retention = 6 months # 20 days
# Accept Any Volume = yes # write on any volume in the pool
Maximum Volumes = 8
Recycle Oldest Volume = yes
LabelFormat =OFFLINE_
}
However when I issue an update pool from resource, I still see the
number 15, not 8 as it should be:
+
| 3 | Offline | 15 | 15 | 0 | 1 |
1 | 15,552,000 | 0 | 0 | 0 |
0 | 1 | 1 | Backup | 0 | OFFLINE_| 1
| 0 | 0 | 0 | 0 |
0 | 0 |
show pool shows the correct pool definition:
Pool: name=Offline PoolType=Backup
use_cat=1 use_once=0 cat_files=1
max_vols=8 auto_prune=1 VolRetention=6 months
VolUse=0 secs recycle=1 LabelFormat=OFFLINE_
CleaningPrefix=*None* LabelType=0
RecyleOldest=1 PurgeOldest=1
MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=0
MigTime=0 secs MigHiBytes=0 MigLoBytes=0
So currently, i have to manually delete the new tape, then issue a
mount using another autochanger slot to get bacula to run jobs
again.
Any help with getting Bacula back to recycling old tapes again would
be greatly appreciated, version in use is 2.2.8 which has been working
fine for a year or so.
All the best thanks in advance,
Uwe
--
uwe.schuerk...@nionex.net phone: [+49] 5242.91 - 4740, fax:-69 72
Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany
Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr
NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de
--
Crystal Reports #45; New Free Runtime and 30 Day Trial
Check out the new simplified licensign option that enables unlimited
royalty#45;free distribution of the report engine for externally facing
server and web deployment.
http://p.sf.net/sfu/businessobjects
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] 48-way autochanger problems
Hi folks, I've installed bacula 2.4.4 from source on a Centos 5 system connected to a 48-volume overland datavault tape library (one LTO4 drive). btape tests (incl. the autochanger test) ran worked fine, as did the labelling of the first 8 tapes. Hoewver when I try to label tape #9, I get the following error from bacula: ## 1000 OK: archiv-dir Version: 2.4.4 (28 December 2008) Enter a period to cancel a command. *label slot=9 volume=Offline09 storage=LTO4 pool=Default Automatically selected Catalog: MyCatalog Using Catalog MyCatalog Connecting to Storage daemon LTO4 at wmv-backup:9103 ... Sending label command for Volume Offline09 Slot 9 ... 3301 Issuing autochanger loaded? drive 0 command. 3302 Autochanger loaded? drive 0, result: nothing loaded. 3304 Issuing autochanger load slot 9, drive 0 command. 3992 Bad autochanger load slot 9, drive 0: ERR=Child died from signal 15: Termination. Results=Program killed by Bacula watchdog (timeout) Label command failed for Volume Offline09. Do not forget to mount the drive!!! ## As loading tapes from slot numbers 8 works fine using mtx, I was wondering if there's some hard limit within bacula that needs to be increased in order to use more than 8 slots? Thanks in advance for your help comments, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] 48-way autochanger problems
Sorry, just read up on the maximum changer wait directive, sorry for wasting your time and bandwidth, I'll give this one a try. Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Slow backup
On Thu, May 28, 2009 at 06:01:06AM -0400, Il Neofita wrote: I connected the backup server and the client with a crossover cable at 1G however Files=16,251 Bytes=5,504,385,701 Bytes/sec=9,690,819 Errors=0 What can I check? I am using SAS disks With ethtool I have Speed: 1000Mb/s therefore is correct Are you using gzip compression? All the best, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, iPhoneDevCamp as they present alongside digital heavyweights like Barbarian Group, R/GA, Big Spaceship. http://p.sf.net/sfu/creativitycat-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Slow backup
On Thu, May 28, 2009 at 08:27:06AM -0400, Il Neofita wrote:
First of all thank you for the answer
No I do not use compression in my file set
Options {
signature = MD5
}
I tried to upload with sftp
Uploading testfile to /tmp/terrierj
testfile 100% 83MB 41.4MB/s 00:02
There is only a problem,
I have the following configuration
two ethernet card in both servers
one connected to the LAN with an IP 10.10.1.X with a speed of 100M
and the other connected between the two servers with the IPs 192.168.10.x
with the speed of 1G
On my bacula-dir.conf other the client I put in the address the right
address and on the statistic of the second ethernet (that one a 1G) I have
100M o traffic therefore is used
Thank you for the support and any Idea or test that I should do
Are you backing up a lot of small files? I've seen rates dropping to
the hundreds of kilobytes when bacula encounters directories with lots
of small files. Which filesystem are you using on the client host?
Cheers,
Uwe
--
uwe.schuerk...@nionex.net phone: [+49] 5242.91 - 4740, fax:-69 72
Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany
Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr
NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de
--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
is a gathering of tech-side developers brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,
iPhoneDevCamp as they present alongside digital heavyweights like Barbarian
Group, R/GA, Big Spaceship. http://p.sf.net/sfu/creativitycat-com
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] migration from 1.38 to 2.4
On Mon, Jun 01, 2009 at 12:13:37AM -0300, junior carvalho wrote: Hi all; I have some debian etch servers working with bacula 1.38; I would like to migrate to 2.4 ( from backports ), there are some kind of incompatibilites? problems? there are a special way to follow? JC Hello JC, we usually compile bacula from source and keep the different versions in separate directories, so if you have a db dump and a config file backup handy going back to the previous-version is a no-brainer. Don't know about using the backports repositories though, backing up your database and config files first might be the prudent thing to do. All the best, uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- OpenSolaris 2009.06 is a cutting edge operating system for enterprises looking to deploy the next generation of Solaris that includes the latest innovations from Sun and the OpenSource community. Download a copy and enjoy capabilities such as Networking, Storage and Virtualization. Go to: http://p.sf.net/sfu/opensolaris-get ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] The number of files mismatch! Marking volume in Error in Catalog
On Thu, Jun 04, 2009 at 09:20:34AM +0200, Christian Gaul wrote: Bob Hetzel schrieb: Greetings, I've been seeing an issue whereby a volume gets marked in error periodically. The last items logged about that volume are typically like this: 02-Jun 11:53 gyrus-sd JobId 83311: Volume LTO224L2 previously written, moving to end of data. 02-Jun 11:53 gyrus-sd JobId 83311: Error: Bacula cannot write on tape Volume LTO224L2 because: The number of files mismatch! Volume=46 Catalog=45 02-Jun 11:53 gyrus-sd JobId 83311: Marking Volume LTO224L2 in Error in Catalog. I don't think I have any SCSI errors, but instead the problem seems to be related to bacula not properly keeping track of the volume files in some rare case. This time the problem happened not too long after the volume got recycled and so I noted one thing about how the tape was used... a backup started on another volume and then spanned onto it. Could that be a source of these problems? Here's the pertinent part of the bacula log file--debugging not turned on right now but I'm hoping enough got logged to help. If not I'll have to turn debugging back on but what level would be good for determining the source of that error? http://casemed.case.edu/admin_computing/bacula/bacula-2009-06-01.log.txt Bob To me this looks like an issue reported a couple of times on this list, once by me and once by another user, whereby Bacula isnt updating the Volume Files when doing concurrent jobs. So far nobody has seemed interested in it. For me and another user it has worked to set the maximum concurrent jobs to 1 on the device.. Yes, you will have jobs piling on for hours until they get worked off. I witnessed this first after upgrading from 2.4.4 to 3.0.0 but have not been able to track it down myself or i would have made a proper bugreport for it.. Hope that helps a little Hi, we're running bacula 2.2.8, using concurrent jobs = 2 on a disk based set of volumes. I've done several restores from those volumes without any errors, and haven't seen the error you mention in a good 3 months or so since having switched from concurrent jobs = 1 to = 2, so I'd consider this a positive report that the feature actually does work. The problem bug may have been introduced in a later version of bacula. All the best, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- OpenSolaris 2009.06 is a cutting edge operating system for enterprises looking to deploy the next generation of Solaris that includes the latest innovations from Sun and the OpenSource community. Download a copy and enjoy capabilities such as Networking, Storage and Virtualization. Go to: http://p.sf.net/sfu/opensolaris-get ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Help needed with setting up a 2nd storage daemon on a separate server (bacula 2.x)
Hi folks, I have a spare lto3 8x library which I'd like to use to story copy jobs of recent full backups. The library is attached to a separate server (compaq dl360), so my question is what would be required on this server in order to run 2nd bacula storage there. Is it just the sd that needs configuration? An fd is already present as the machine itself is backed up regularly by the 1st, primary bacula server which runs the director process. The primary bacula server als has an 8x changer device with an lto3 tape drive attached. I'm planning to use bacula 2.2.8 (or even 2.4.x) in case that matters (compilation from source). My idea is to run maybe one copy job per day during normal business hours when the primary server is idle anyway. As we have less than 30 clients this could be a relatively painless way of building up a backup history (offlining tapes on the primary server would be too much hassle as we only have 8 days of bacula history there as it stands). All the best thanks in advance for any ideas, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] concurrent backups to one volume?
On Thu, Jun 25, 2009 at 12:42:30PM +0200, Andreas Schuldei wrote: hi! reading the documentation i understand that you should have several volumes for concurrent backups, on different devices/directories. (i work on disk for now.) However some people here on the list seem to be doing well with concurrent backups to only one volume. is that actually true or am i misunderstanding something? if so, how do i do that? i would like a reciept for that. what bacula version is required for that? Hallo Andreas, we're running two concurrent backups to one disk based volume using bacula 2.2.8. The volume grows to a maximum size of 400g (so we can fit two of them onto an lto4 for off-site storage), then the oldest one is recycled and used. So far, we haven't had any troubles restoring data with this setup. All I did in order to enable 2 concurrent jobs was to add the line Maximum concurrent jobs = 2 to the director definition. HTH, Uwe -- uwe.schuerk...@nionex.net phone: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Guetersloh, Germany Registergericht Guetersloh HRB 4196, Geschaeftsfuehrer: Horst Gosewehr NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] What to do with Error Disk Volumes
On Wed, Jul 15, 2009 at 09:50:43PM -0400, John Drescher wrote: On Wed, Jul 15, 2009 at 8:15 PM, terrycter...@woa.com.au wrote: Martin Simmons wrote: The best thing is to find out why it happened, before deciding how to correct it. So the question still stands of the recommended way to get them back into the cycle. I usually delete the volume in bconsole then delete the file on the storage and let bacula create a new volume when it wants. John Hi folks, In case you want to the keep the data in the defective volume for the duration of the volume's recycle lifetime (theoretically, you could still extract jobs from it using bscan, for instance), you can also update the volume status to used so bacula will automatically recycle it as it usually would when it's time to do so. Cheers, Uwe -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backuping 2000+ host with bacula?
On Thu, Jul 16, 2009 at 11:45:53AM +0100, Graham Keeling wrote:
I had similar problems. I had to define 'Maximum Concurrent Jobs' in many
places to get it to work.
Currently, I have it like this:
bacula-dir.conf:
Director { Maximum Concurrent Jobs = 20; }
Storage { Maximum Concurrent Jobs = 20; }
Client { Maximum Concurrent Jobs = 20; }
Job { Maximum Concurrent Jobs = 1; }
bacula-fd.conf:
FileDaemon { Maximum Concurrent Jobs = 20; }
bacula-sd.conf:
Storage { Maximum Concurrent Jobs = 20; }
Watch out not to overload your database with all those parallel
inserts esp. if you are backing up many small files on the clients, or
you might get the opposite of what you're trying to achieve.
Uwe
--
Enter the BlackBerry Developer Challenge
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize
details at: http://p.sf.net/sfu/Challenge
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Exlude-List Generation by inclusion of a text file?
Hi folks, quick question about Bacula 2.4.x: Is it possible to generate an Exclude fileset statement by inclusion of a text file that lists dirs to be excluded in a line-by-line fashion? All the best thank in advance for any ideas, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bscan job spanning multiple tapes
On Tue, Sep 29, 2009 at 11:23:09PM +0100, John Kennedy wrote: Using Bacula 2.2.6 on Debian 4 with an Overland 2 drive, 24 tape library We have some archive tapes that we hold beyond the normal pruning cycle. Unfortunately we need to recover some data off these tapes. I have used blist to find the tapes that the data we want is on and have used bscan to recover most of the needed data. At this point there is a job that spanned 2 tapes. When we bscan the first tape it runs for about 4 hours then requests the second tape. This request times out after 3 minutes. Since it can take up to a minute to unload the first then another minute to load the second tape this leaves a 1 minute window to catch the end of the first tape and enter commands to unload and load the correct tapes. I have looked at the docs for bscan but can not see a way to either automate the loading of the second tape (can't use ; to run consecutive commands because the first bscan has not finished) or to extend the timeout to a more reasonable time? Thanks, John Hello John, unless it's an o/s function that's timing out you could always grab the bscan source and search for the value in question (or parameters to modify it) there. All the best, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Relabel a tape deleted from a Pool
On Thu, Oct 29, 2009 at 10:37:13AM +0100, mario.tolj wrote: Hello, Sorry if my English isn't very well. I did a mistake when i deleted a volume from the Default Pool. and now i would like to relabel the tape with another name and put this volume in a different Pool (in example Inc-Pool). When i use the relabel command, i can't relabel the volume because i deleted it from the Default Pool When i use the label command, i can't because he say me /3920 Cannot label Volume because it is already labeled:/ How can i do this ? Hello Mario, are you using actual tapes or disk-based volumes? Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Relabel a tape deleted from a Pool
On Thu, Oct 29, 2009 at 10:37:13AM +0100, mario.tolj wrote: Hello, Sorry if my English isn't very well. I did a mistake when i deleted a volume from the Default Pool. and now i would like to relabel the tape with another name and put this volume in a different Pool (in example Inc-Pool). Sorry, only just now saw the word tape ;-) you need to remove the volume label using the mt command. If /dev/st0 ist your tape drive, stop bacula and enter the following commands as root or as a user who has write access to the tape device: # mt -f /dev/st0 rewind # mt -f /dev/st0 weof Once you restart bacula, you should be able to write a new tape label. HTH Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bconsole: reload command
On Thu, Oct 29, 2009 at 11:18:58AM -0200, Rodrigo Fernandes wrote: Does anyone know if the reload command really works in bconsole? For the manual, only works in some situations. Has anyone tested this command? Regards, Works fine here in all of our bacula 2.x installations as far as I'm aware. Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Problem Storage File
On Mon, Dec 07, 2009 at 06:33:59AM -0800, Oliver Knittel wrote: Hello Together, I get the folloing message when I ask for the Status of Storage File Fatal error: bsock.c:135 Unable to connect to Storage daemon on backupsrv.ke-si.intern:9103. ERR=Connection refused DNS is correct Sever Name is checkt many times FQN is in hosts too. Password is proofed. When I use telnet i get refused too. Do anybody has got an Idea? Tankx for your help Oli could your storage daemon be listening on a different ip? the fact you don't get a connection via telnet is a giveaway of sorts... Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Join us December 9, 2009 for the Red Hat Virtual Experience, a free event focused on virtualization and cloud computing. Attend in-depth sessions from your desk. Your couch. Anywhere. http://p.sf.net/sfu/redhat-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] continuing a failed job
On Wed, Jan 06, 2010 at 12:52:44PM -0500, Phil Stracchino wrote: My first inclination is to say that if the network connection to the machine is sufficiently unstable that you can't complete a full backup, you probably shouldn't be trying to back it up over the network. However, there are ways to work around the problem. You could also try rsync'ing (rsync -av u...@remotehost:/ /backup/remote_host/) to a local filesystem and then backing that copy up locally. Should rsync abort it will skip the files which are already present up to date on the local copy. HTH, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Q: Can 2.x clients talk to a 3.0.3 server?
Hi folks, I just set up the first 3.0.3 bacula server (compiled from source on CentOS 5.4) in our environment and was wondering wether 2.x clients cann still talk to a 3.x server version? I cannot test this right now without going through major changes because the new server is not at its final destination, read: our hosting facility yet. All the best TIA for any thoughts, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Throughout its 18-year history, RSA Conference consistently attracts the world's best and brightest in the field, creating opportunities for Conference attendees to learn about information security's most important issues through interactions with peers, luminaries and emerging and established companies. http://p.sf.net/sfu/rsaconf-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Q: Can 2.x clients talk to a 3.0.3 server?
On Thu, Jan 14, 2010 at 05:43:36PM +0100, Ulrich Leodolter wrote: On Thu, 2010-01-14 at 17:10 +0100, Ralf Gross wrote: Uwe Schuerkamp schrieb: Hi folks, I just set up the first 3.0.3 bacula server (compiled from source on CentOS 5.4) in our environment and was wondering wether 2.x clients cann still talk to a 3.x server version? I cannot test this right now without going through major changes because the new server is not at its final destination, read: our hosting facility yet. http://www.bacula.org/en/?page=news quote: Compatibility: As always, both the Director and Storage daemon must be upgraded at the same time. Older 3.0.x and possibly 2.4.x File Daemons are compatible with the 3.0.3 Director and Storage daemons. There should be no need to upgrade older File Daemons. You cannot use all new 3.0.x features for old 2.4.x fd clients, e.g ExcludeDirContaining thanks much for your replies, I'll give it a go next week then report back. For now, we're not planning to introduce any new features from 3.x to our backup strategy, it's a simple drop-in replacement for a 2.2.8 bacula server, so I don't expect too many problems. All the best, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Throughout its 18-year history, RSA Conference consistently attracts the world's best and brightest in the field, creating opportunities for Conference attendees to learn about information security's most important issues through interactions with peers, luminaries and emerging and established companies. http://p.sf.net/sfu/rsaconf-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] enabling compression for incremental backups only?
Hi folks, I'm running bacula 2.2.8 compiled from source on Ubuntu lts 8.04. I was wondering wether it's possible to enable software compresson for incrementals only as our full backups go to an lto3 tape (hw compression), while the incs end up on local disk, using the incremental=... syntax in the schedule definition. All the best thanks in advance for any thoughts, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] enabling compression for incremental backups only?
On Thu, Jan 28, 2010 at 01:24:35PM -0500, Steve Polyack wrote: On 01/28/10 13:07, Uwe Schuerkamp wrote: Hi folks, I'm running bacula 2.2.8 compiled from source on Ubuntu lts 8.04. I was wondering wether it's possible to enable software compresson for incrementals only as our full backups go to an lto3 tape (hw compression), while the incs end up on local disk, using the incremental=... syntax in the schedule definition. All the best thanks in advance for any thoughts, Uwe If you upgrade to the newest release (5.0.0), you can make use of a feature I added: AllowCompression = yes|no. It will allow you to disable compression for any job which runs against your LTO3 tape device. More info is available here: http://www.bacula.org/5.0.x-manuals/en/main/main/New_Features_in_5_0_0.html#SECTION0034 I also have patches for this against the 3.0.2 version, but I doubt that they would apply cleanly to Bacula 2.2.8. Steve Hello Steve, thanks for your suggestion, sadly right now upgrading to 5.x is out of the question as we'd like to watch things settle with the brand-new release for a while. All the best, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Dynamically assign volumes to pools
On Tue, Feb 02, 2010 at 01:57:52PM +0100, Daniel Kamm wrote: Hi all Just an idea of mine, let me know if this is possible or not. Let's say I have a huge autochanger with lots of space and lots of cartriges available. Let's also assume, that I have a uncontrollable data groth and I cannot (or I am too lazy to) predict the ammount of cartridges needed to backup the data. Is it possible to dynamically assign empty volumes from a spare pool to the actual running pool if the volumes available for doing backups are not sufficient? TIA - Dan Hi Dan, I think the scratch pool should provide what you're looking for, but I believe once volumes have been reassigned to another pool they'll stay there for the rest of their lifetimes (I'm still on 2.x, so things may have changed in the meantime). All the best, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] using two tape drives?
On Wed, Feb 03, 2010 at 05:58:49PM -0500, Dan Langille wrote: I have two tape drives. We'll ignore that one of them is a tape library for now (http://marc.info/?l=bacula-usersm=126504711226283w=2). I have one Pool because I haven't had a good reason to create another pool. I cannot get backups to go to the second drive. Only the first drive is used, even if I put the tape in the second drive and mount it. Bacula demands that it be in the first drive. I have no idea why. Are you using multiple drives? If so, can you elaborate please? I tried this a while ago with bacula 2.x and failed heroically. I guess your only option is to create two pools and split your backups among them, but again things may have changed in the meantime in 3.x or even 5.x All the best let us know how it goes, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Compatibility with long-ago version?
On Wed, Feb 03, 2010 at 03:22:24PM -0500, Scott Courtney wrote: On Wed, 2010-02-03 at 11:08 -0600, Heitor Medrado de Faria wrote: I couldn't find anything going back that far in the docs. Does anyone happen to know offhand what the latest director is that can still connect to file daemon 2.0.3? I guess 3.x and 5.x directors still can work with 2.0.3 file daemons - but its not the ideal scenario. Thanks for the reply. I understand it's not ideal. It's very temporary -- just a couple of weeks during a migration period. Based on your comments, I'll give it a try, but won't spend a lot of time on it if it seems to be not working. We recently updated a 2.x server to 3.0.3, and so far it appears to work fine even with file daemons as old as 1.38.x (using no fancy features of the newer versions, of course). I tried a test restore and also so no apparent problems. All the best, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Cannot find any appendable volumes
On Mon, Feb 15, 2010 at 11:55:35AM +0100, Daniel Kamm wrote: Hi Tino Am 2/15/10 11:10 AM, schrieb Tino Schwarze: And even though there are volumes in the scratch pool, e.g.: Pool: Scratch +-++---+-+-+--+--+-+--+---+---+-+ | mediaid | volumename | volstatus | enabled | volbytes| volfiles | volretention | recycle | slot | inchanger | mediatype | lastwritten | +-++---+-+-+--+--+-+--+---+---+-+ | 13 | MJR258L3 | Full | 1 | 205,955,637,248 | 49 | 1,209,600 | 1 |8 | 1 | LTO-3 | 2010-01-23 16:23:37 | | 20 | MJR264L3 | Full | 1 | 202,673,155,072 | 49 | 1,209,600 | 1 |3 | 1 | LTO-3 | 2010-01-21 05:12:25 | | 31 | MJR278L3 | Used | 1 | 20,567,032,832 |5 | 1,209,600 | 1 |1 | 1 | LTO-3 | 2010-01-23 16:35:31 | | 55 | MJR289L3 | Used | 1 | 117,238,043,648 | 29 | 1,209,600 | 1 |6 | 1 | LTO-3 | 2010-01-20 05:13:19 | | 58 | MJR290L3 | Used | 1 | 231,347,448,832 | 55 | 1,209,600 | 1 |7 | 1 | LTO-3 | 2010-01-22 16:29:37 | +-++---+-+-+--+--+-+--+---+---+-+ All your volumes are either full or used (not appendable), and volume retention time is far away for those volumes are being recycled. Regards, - Dan It might also help if you add Purge oldest Volume = yes to the pool definition, followed by update pools from resource in bconsole. This way, bacula will automatically recycle and re-use the oldest volume in the pool if there's none left in state append. Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tanberg Tape drives?
On Wed, Mar 24, 2010 at 07:58:40AM -0700, MoreDakka wrote: Hi, Bacula looks like a great piece of software. We are looking to pair it with: TANDBERG LTO4 800/1.6TB HH SCSI INT Mfg#: TAB-3501-LTO Does anyone know if that will be compatible with bacula or should we be looking for a different tape drive? Thanks. Hi, as long as it's a std. SCSI device, your chances are very high the tape will work with Linux and Bacula. Cheers, Uwe -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Ubuntu Lucid
Hi folks, looks like lucid comes with bacula v5 which seemingly is unable to talk to our server running bacula 2.4.x: bacula-fd -c /etc/bacula/bacula-fd.conf -d 99 -f bacula-fd: filed_conf.c:452-0 Inserting director res: lotus-mon lotus-fd: filed.c:275-0 filed: listening on port 9102 lotus-fd: cram-md5.c:73-0 send: auth cram-md5 1993776720.1272363...@lotus-fd ssl=0 lotus-fd: cram-md5.c:152-0 sending resp to challenge: XXX following that, there's a client rejected hello command message on the server. Is there any way to turn on 2.x client compatibility in a 5.0.1 client? Thanks much in advance, Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Ubuntu Lucid
On Tue, Apr 27, 2010 at 12:50:08PM +0200, Matija Nalis wrote: On Tue, Apr 27, 2010 at 12:27:11PM +0200, Uwe Schuerkamp wrote: Hi folks, looks like lucid comes with bacula v5 which seemingly is unable to talk to our server running bacula 2.4.x: Your other clients are all 2.4.x I guess. following that, there's a client rejected hello command message on the server. Is there any way to turn on 2.x client compatibility in a 5.0.1 client? No. So your options are either to downgrade the client on Lucid (maybe there can be found a package for 2.4.x version ? If not, you may need to build it yourself) Or you can upgrade your director and SDs (it is usually possible to have a newer directory/SD talk to older FD client; but not the other way around. However 5.0 to 2.4 might be quite a stretch). Thanks for the info, Matija. I'll do a client-only compile from source using version 2.4.x then. All the best, Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Ubuntu Lucid
On Tue, Apr 27, 2010 at 04:08:21PM +0200, Daniel Kamm wrote: Am 4/27/10 12:50 PM, schrieb Matija Nalis: So your options are either to downgrade the client on Lucid (maybe there can be found a package for 2.4.x version ? You may try to install the Ubuntu package for Karmic Koala or Hardy Heron, which both are 2.4.4. Cheerz, - Dan Thanks Dan, that did the trick. I installed the following deb's: bacula-common_2.4.4-1ubuntu5_i386.deb bacula-fd_2.4.4-1ubuntu5_i386.deb downloaded from here: https://launchpad.net/ubuntu/jaunty/i386/bacula-common/2.4.4-1ubuntu5 https://launchpad.net/ubuntu/karmic/i386/bacula-fd/2.4.4-1ubuntu5 Just in case someone searches the archives for a similar problem. All the best, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Compression on Windows
On Mon, May 03, 2010 at 04:35:20PM -0400, Phil Stracchino wrote:
On 05/03/10 06:02, Carlo Filippetto wrote:
Hi all,
I have a problem,
I had installed bacula 5.0.1. on Winows client, and work fine, but I
have no compression
Software Compression: None
while
FileSet {
Name = FS-test-windows
Enable VSS = yes
Ignore FileSet Changes = no
Include {
File = C:/Programmi/Test
Options {
compression = GZIP
signature = MD5
}
}
}
Hm, I've never seen Option *inside* an Include block, maybe that's the
problem unless that's a new feature in 5.x?
All the best, Uwe
I read that is the same fd that make this compression.. why it don't work??
Can you be a little more specific about don't worl? What doesn't
work? Compression? Backups?
If you're not getting compression and you're asking about that, from the
fragmentary bits of configuration you've posted above you appear to have
compression both turned on and turned off. This probably isn't helping.
--
Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org
Renaissance Man, Unix ronin, Perl hacker, Free Stater
It's not the years, it's the mileage.
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72
Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany
Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda
NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Assigning labels in bacula-web
Hi folks, sorry if this is the wrong list, but maybe you can help me out anyway: Is it possible to assign labels to db instances in bacula-web? Right now, whenever I use something besides [.DATABASEn], php barfs and I don't get any results. Thanks much in advance, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Volume in Status error after cancelling a job (5.0.2)
On Wed, May 12, 2010 at 12:59:53PM +0200, Uwe Schuerkamp wrote: Hi folks, each time I cancel a backup job, the next job bound for that volume on which the cancelled job ran Bacula marks the volume in error with a file count mismatch. I don't recall bad behaviour like this from previous versions (mainly 2.4 and 3.0.x), so is this a bug or a feature? Is it safe to repair the volume by upping the file count in the catalog and setting it to status full? All the best, Uwe Hi folks, can somebody tell me wether the above repair method is acceptable? I haven't seen any answers so far, so I thought I'd ask the question one more time. Thanks Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] full LTO-4 tape @ only 176 GIG
On Fri, May 28, 2010 at 01:16:33PM -0400, lweinlan wrote: Hello, I am running backups using bacula and a LTO-4 tape library. Everything is running fine, but this morning, the first LTO-4 tape that I used is marked as volume status = full with only 176.24 GB ??? A LTO-4 tape has a capacity of 800 GB native, and 1.6 TB compressed . I have absoultely no idea why this tape is already full. Could someone please help. What are the modifications that need to be made on the bacula-dir.conf file to fix this ??? Thank you I have a similar, but even weirder problem with one lto4 volume: It shows up in the bacula-web interface with only 70gb of data and status full, but a query shows about 350G on the tape (3 jobs)! This is bacula 5.0.2 on centos compiled from source, btw. All the best, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula FD fails after 51 files
On Fri, Jul 02, 2010 at 12:02:25PM -0400, Dan Langille wrote: On 7/2/2010 12:00 PM, Mike Carlson wrote: On 06/28/2010 07:01 PM, Dan Langille wrote: On 6/28/2010 12:53 PM, Mike Carlson wrote: Hello Bacula user's list, I'm having some trouble with a bacula client. The backup to a storage node (disk based storage) fails at the same file. I suspect the time. Always at 1 hour 30 minutes? Firewall or switch timeout ? Hey Dan, and List, I wanted to follow up with this, Dan was correct, there was an issue with ALL traffic between the server and client, and the networking folks here are working to resolve it. Thanks a lot, I'm glad it wasn't software related! Good. To be fair, any time a back fails after the same length of time, it is usually a network issue. Seen it mant times before. Have fun. It also sometimes helps (if you're on Linux and don't want to wait for the network folks to resolve and firewall issues ;-) to set the tcp_keepalive_time on the client to some smaller value: echo 600 /proc/sys/net/ipv4/tcp_keepalive_time All the best, Uwe -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Schedule Question
Hi folks,
will the following schedule accomplish what we expect? ;-)
Schedule {
Name = first_saturday_in_mar_jun_sep_dec
Run = Level=Full 1st Sat Mar Jun Sep Dec at 00:00
Run = Level=Incremental 2nd Sat at 00:00
}
- full backups on the 1st Saturday in mar, jun, sep and dec.
- incrementals on the 2nd Saturday of each month
Thanks in advance for your comments,
Uwe
--
NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de
--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] BigInt hit max value in mysql... what now?
Hi folks, over the weekend, our mysql bacula db seems to have hit the maximum possible auto_increment counter for an unsigned int(10) as I'm getting duplicate key errors on insert's into the File table. Is there a way to increase the maximum value or do I need to rebuild the bacula db from the last working dump?`The file table is around 15G at the moment, we have 67657255 files with a total db size around 23G. will alter table File change FileId FileId unsigned int(20) do anything useful? Thanks in advance for your comments, Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Sell apps to millions through the Intel(R) Atom(Tm) Developer Program Be part of this innovative community and reach millions of netbook users worldwide. Take advantage of special opportunities to increase revenue and speed time-to-market. Join now, and jumpstart your future. http://p.sf.net/sfu/intel-atom-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] BigInt hit max value in mysql... what now?
On Mon, Aug 30, 2010 at 08:45:50AM +0200, Uwe Schuerkamp wrote: Hi folks, over the weekend, our mysql bacula db seems to have hit the maximum possible auto_increment counter for an unsigned int(10) as I'm getting duplicate key errors on insert's into the File table. Is there a way to increase the maximum value or do I need to rebuild the bacula db from the last working dump?`The file table is around 15G at the moment, we have 67657255 files with a total db size around 23G. will alter table File change FileId FileId unsigned int(20) Hi folks, I was able to extend the value range by issuing ALTER TABLE File CHANGE COLUMN FileId FileId bigint unsigned; I should have mentioned I'm running bacula 3.x on that server, bacula 5.x seems to use a bigint type value by default. All the best, Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Sell apps to millions through the Intel(R) Atom(Tm) Developer Program Be part of this innovative community and reach millions of netbook users worldwide. Take advantage of special opportunities to increase revenue and speed time-to-market. Join now, and jumpstart your future. http://p.sf.net/sfu/intel-atom-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] BigInt hit max value in mysql... what now?
Hi folks, looks like extending the value range did not fix the error entirely. When running an incr. backup, I receive the following error message: Fatal error: Can't fill File table Query failed: INSERT INTO File (FileIndex, JobId, PathId, FilenameId, LStat, MD5)SELECT batch.FileIndex, batch.JobId, Path.PathId, Filename.FilenameId,batch.LStat, batch.MD5 FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN Filename ON (batch.Name = Filename.Name): ERR=Duplicate entry '0' for key 1 I've tried deleting those rows with 0 from File (1 Row), but apparently that did not fix the problem. Will I need to upgrade to bacula 5.0 in order to resolve the issue? Is 3.x limited to 32bit auto_inc counters or something? All the best, Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Sell apps to millions through the Intel(R) Atom(Tm) Developer Program Be part of this innovative community and reach millions of netbook users worldwide. Take advantage of special opportunities to increase revenue and speed time-to-market. Join now, and jumpstart your future. http://p.sf.net/sfu/intel-atom-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Exclude NFS
On Wed, Sep 29, 2010 at 01:51:15PM +0200, Roberto Preziusi wrote: Hello Folks, how can I exclude all NFS share mounted in randomly mount point ? Thanks Hello Roberto, there is a settings variable that tells bacula not to descend into different file systems from the one it is currently in. Check the fileset documentation. http://bacula.org/dev-manual/Configuring_Director.html#SECTION000147000 All the best, Uwe -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Exclude NFS
sorry folks, that link seems to be dead, I wanted to point out the onefs=yes|no configuration option. Cheers, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Exclude NFS
On Wed, Sep 29, 2010 at 03:33:44PM +0200, Roberto Preziusi wrote: I have a server with ext3 and ext2 local FS. Bacula saves both FS with *onefs=yes *enabled ? If you have onefs enabled (which is the default I believe), bacula will not cross fs boundaries, so if you have two filesystems, say /boot / you need to list them both explicitly in your fileset definition. HTH, Uwe 2010/9/29 Uwe Schuerkamp uwe.schuerk...@nionex.net sorry folks, that link seems to be dead, I wanted to point out the onefs=yes|no configuration option. Cheers, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Preziusi Roberto -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Is it safe to run 2 concurrent jobs on a tape drive?
Hi folks, I have an HP 1/8 autoloader lto4 drive which we use for full offline backups and was wondering wether it's safe to run 2 concurrent jobs on that device at the same time? Despooling sadly isn't possible at the moment for lack of disk space, bacula version is 5.0.3 on CentOS (compiled from source). All the best TIA for your comments, Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Is it safe to run 2 concurrent jobs on a tape drive?
On Wed, Oct 06, 2010 at 08:55:27AM -0400, John Drescher wrote: I have an HP 1/8 autoloader lto4 drive which we use for full offline backups and was wondering wether it's safe to run 2 concurrent jobs on that device at the same time? Despooling sadly isn't possible at the moment for lack of disk space, bacula version is 5.0.3 on CentOS (compiled from source). How about using a small spool file? I run 5GB spool files and multiple simultaneous jobs to my LTO2 autochanger. John Hi John, thanks for the suggestion, I'll look into it! Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Trying to understand why device FileStorage can't access the disk?
On Thu, Dec 30, 2010 at 11:03:07AM +, Mister IT Guru wrote: When I run a backup, I end up with this error: 30-Dec 10:53 bacula.local JobId 16: Warning: mount.c:217 Open device FileStorage (/backups/default) Volume BaculaBackups-0001 failed: ERR=dev.c:549 Could not open: /backups/default/BaculaBackups-0001, ERR=No such file or directory The directories on disk are writable, and I'm not sure how to diagnose this particular error, some pointers would be appreciated :) Have you configured automatic volume creation? You could also try deleting the volume if it's empty and maybe a product of previous experiments. All the best, Uwe -- Learn how Oracle Real Application Clusters (RAC) One Node allows customers to consolidate database storage, standardize their database environment, and, should the need arise, upgrade to a full multi-node Oracle RAC database without downtime or disruption http://p.sf.net/sfu/oracle-sfdevnl ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Creating archival backup
On Wed, Jan 05, 2011 at 11:06:52AM -0600, Ben Beuchler wrote: Once a year, I need to create a full backup that will be stored off-site. This backup will not be readily available for normal restores. The obvious approach would be to delete that backup (and its volumes) from the catalog so they will not be considered when performing future backups/restores. Is there a better approach? This seems rather clumsy. You can simply set the archived volumes to status archive (update voluume in bconsole). Cheers, Uwe Thanks! -Ben -- Learn how Oracle Real Application Clusters (RAC) One Node allows customers to consolidate database storage, standardize their database environment, and, should the need arise, upgrade to a full multi-node Oracle RAC database without downtime or disruption http://p.sf.net/sfu/oracle-sfdevnl ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Learn how Oracle Real Application Clusters (RAC) One Node allows customers to consolidate database storage, standardize their database environment, and, should the need arise, upgrade to a full multi-node Oracle RAC database without downtime or disruption http://p.sf.net/sfu/oracle-sfdevnl ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Volume Retention / Use Duration
Hi folks,
I'm trying to wrap my head around the following setup:
- For a couple of clients / jobs, we'd like to store two full backups
on disk (weekly full, daily incremental)
- We'd also like to keep 14 incrementals around just in case we need
to do a point in time recovery.
The incremental part seems rather easy, I've defined a separate pool
like so (Bacula 5.0.2 on centos compiled from source):
Pool {
Name = Online_Incremental
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Volume Retention = 14 days
Recycle Oldest Volume = yes
Maximum Volumes = 14
Volume Use Duration = 1 day
Label Format =Incr-
}
So we'd end up with a maximum of 14 volumes, using a new volume for
incrementals each day, recycling the old ones as they expire.
Now I was wondering how to go about the Full Pool definition. I'd like
to do full backups on the same day for all clients / jobs, so I've
come up with something like this:
Pool {
Name = Online_Full
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Volume Retention = 14 days
Volume Use Duration = 6 days
Recycle Oldest Volume = yes
Maximum Volumes = 3
Label Format =Full-
}
But I'm unsure about the use duration. Is there a better way to
implement the above requirements?
Thanks in advance for your help comments,
Uwe
--
NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de
--
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! http://p.sf.net/sfu/intel-dev2devmar
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Volume Retention / Use Duration
Hello Jeremy all, thanks much for your reply. On Wed, Mar 30, 2011 at 04:27:07PM +0200, Jeremy Maes wrote: Pool Type = Backup Recycle = yes AutoPrune = yes Volume Retention = 14 days Volume Use Duration = 6 days Recycle Oldest Volume = yes Maximum Volumes = 3 Label Format =Full- } Here you specify 3 volumes max, probably to make sure your incrementals are still useful? (something you forgot to do for the incrementals themselves I think) Why the 6 day use duration though? You say you want to do all full backups on the same day. Do the backups take multiple days to complete? But I'm unsure about the use duration. Is there a better way to implement the above requirements? I was hoping that when the 7th day in the cycle comes around with a new full backup being due, bacula would note the max use duration and create a new volume automatically (if max volumes isn't yet reached) or recycle the oldest one, keeping two older full backups on the other volumes. the backups themselves are rather smallish (the biggest is around 160G) and complete within a couple of hours after being started. Is there a more elegant way to keep two older volumes in the pool without making use of max use duration? All the best, Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Create and publish websites with WebMatrix Use the most popular FREE web apps or write code yourself; WebMatrix provides all the features you need to develop and publish your website. http://p.sf.net/sfu/ms-webmatrix-sf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Volume Retention / Use Duration
On Thu, Mar 31, 2011 at 09:58:29AM +0200, Jeremy Maes wrote: Take care using this if you're doing all the backups concurrently though, in that case the Volume Use Duration is probably the best way to go. Hello Jeremy, thanks again for your thoughts support. I'll try the max use duration then. All the best, Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Create and publish websites with WebMatrix Use the most popular FREE web apps or write code yourself; WebMatrix provides all the features you need to develop and publish your website. http://p.sf.net/sfu/ms-webmatrix-sf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Question about best backup / storage strategy
Hi folks, I was wondering what would be the best way to implement the following backup strategy (we have about 30 clients with about 1TB total space used, with 10TB storage available in total, disk based): - full backups on weekends (sat / sun) - incrementals during the week - At the end of each month, make a copy of the last full backups and store them for a month or so - at the end of each year, copy the that latest fulls and keep them around for a year. I've been reading up on migration / copy jobs in the documentation, but I cannot decide is they would be the way to go or if I should rather define separate pools and modify the schedule definitions accordingly? We're running bacula 5.0.x compiled from source on centos 5.x. All the best thanks in advance for your comments, Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula-sd dmesg output
Hi folks, for a couple of weeks now I occasionally see messages like these in the kernel log or our bacula server (bacula 5.0.3 compiled from source on centos 5.6 64bit): ## INFO: task bacula-sd:12467 blocked for more than 120 seconds. echo 0 /proc/sys/kernel/hung_task_timeout_secs disables this message. bacula-sd D 81000102e4a0 0 12467 1 27666 (NOTLB) 810248521cd8 0086 81042e88 810248521db8 0001 000a 810428a1e7e0 81042fea0100 0001ce40568d4933 000224fb 810428a1e9c8 00058002e2e3 Call Trace: [8006315f] wait_for_completion+0x79/0xa2 [8008e437] default_wake_function+0x0/0xe [8829fe85] :st:st_do_scsi+0x1f4/0x221 [882a098c] :st:st_int_ioctl+0x5ea/0x923 [882a2ab2] :st:st_ioctl+0xaa5/0xe1f [800a28f3] autoremove_wake_function+0x0/0x2e [80042426] do_ioctl+0x55/0x6b [800303df] vfs_ioctl+0x457/0x4b9 [800b9646] audit_syscall_entry+0x1a4/0x1cf [8004c8fc] sys_ioctl+0x59/0x78 [8005d28d] tracesys+0xd5/0xe0 ## Should I worry about these, and if so, what can be done to fix this issue? All the best TIA for any suggestions, Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-sd dmesg output
On Mon, May 16, 2011 at 08:39:38AM -0400, John Drescher wrote: Maybe do what it says. echo 0 /proc/sys/kernel/hung_task_timeout_secs John Hi John, thanks for your reply, I was wondering if it's an error that I need to look info or bacula's expected behaviour in those circumstances. All the best, Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-sd dmesg output
On Mon, May 16, 2011 at 08:50:25AM -0400, John Drescher wrote: On Mon, May 16, 2011 at 8:45 AM, Uwe Schuerkamp uwe.schuerk...@nionex.net wrote: On Mon, May 16, 2011 at 08:39:38AM -0400, John Drescher wrote: Maybe do what it says. echo 0 /proc/sys/kernel/hung_task_timeout_secs John Hi John, thanks for your reply, I was wondering if it's an error that I need to look info or bacula's expected behaviour in those circumstances. Do you have a tape drive that sometimes takes more than 2 minutes to rewind? It's an lto4 drive attached to an 1/8 autochanger, so I guess this might well be the case. So it's safe to ignore these messages for now? All the best thanks for your help, Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
Hi folks, I've been following the mysql vs. postgres vs. different mysql versions discussion which has been very interesting. Has anyone tried Drizzle as a bacula db backend? It's supposed to be a lot leaner than mysql, just wondering. All the best, Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Waiting on Maximum Storage Jobs
On Mon, Jun 20, 2011 at 09:56:29AM -0400, Craig Van Tassle wrote: I've got several jobs that are running at the same time and they are spooling data to the local disk, then writing to my Tape Drive for full backups. My Incremental and Differential's are being written to Disk. I can only run one Full job at a time. The rest of the jobs are all in the status Waiting on Maximum Storage Jobs I'm not sure where to look to set fix this. My Google-fu has failed me on the one :( Hello Craig, could you check the maximum concurrent jobs setting in your tape storage / device definition? HTH Uwe -- NIONEX ist ein Unternehmen der DirectGroup Germany www.directgroupgermany.de -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Ignore fileset changes
On Tue, Aug 09, 2011 at 06:07:41AM +0200, Olle Romo wrote: Hi All, 'Ignore Fileset Changes = yes' doesn't seem to have the effect I was hoping for... If a drive is missing on one run, the next time Bacula sees the drive it will proceed to backup the entire thing again. I'm sure there's an obvious way to avoid this but I can't seem to find it... Any suggestions warmly welcomed. Hello Olle, I think there's a slight misunderstanding in your concept of fileset changes. According to the docs, fileset changes affect the definition of filesets in the director config file as opposed to *actual* changes in the filesystem's you're backing up. If you're talking about removeable drives and such that are mounted somewhere in the directory, tree, I guess you should be looking at bacula crossing fs boundaries during backups (or not ;-) All the best, Uwe All best, Olle -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX --- Ein Unternehmen der Bertelsmann AG -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Optimized mysql settings for CentOS 6 64bit
Hi folks, I'm wondering about the best mysql settings for our new bacula installation which will be taking over from an older setup. Current bacula db size is 55G, we have around 14TB backup data from ca. 100 clients on disk storage ATM but this is expected to double in the next year or so. the new machine has 6GB memory and reports 12 CPU cores. The bacula db is stored on an 8-drive RAID 5. Backups will be going to an lto 5 library (24 Tapes) and 2 additional 16TB RAID devices which have yet to be installed (and I've not thought up a good backup strategy yet ;-) Would you recommend spooling and using bacula's batch insert in such a setup? All the best thanks in advance for your thoughts, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann AG -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Optimized mysql settings for CentOS 6 64bit
On Wed, Oct 05, 2011 at 02:37:37PM +0100, Rory Campbell-Lange wrote: I've been using non-batch insertion with postgres (following your dare, I think, Phil) for about a year. Backups are only about 8TB, but it works extremely well for us. Hi folks, thanks for your recommendations and thoughts. I've also noticed long wait times for jobs with status Dir inserting attributes, and it looks like the new compile (5.0.3) was configured without batch insertion by default. I'm still looking for mysql optimizations, or do you think it best to leave my.cnf at the default values (we don't do many restores) and use the maximum amount of RAM for the fs buffer cache as needed? All the best, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann AG -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Creating directory tree on 5.0.3 takes a long time
Hi folks, as you may remember I've recently set up a brand new bacula server with version 5.0.3 compiled from source. I copied over the mysql settings (mysql-server-5.1.52-1.el6_0.1.x86_64) from the old machine and inquired here for optimized mysql settings to use with the setup (backup size volume is the same as it was on the old server which had less ram, cpu and diskspace). However, when I try to run a restore job from a decent-sized full backup, it takes forever to build the directory tree where on the old machine this has been quite a speedy process. I've checked the faq and the indices for the file table: mysql show indexes from File ; +---++--+--+-+---+-+--++--++-+ | Table | Non_unique | Key_name | Seq_in_index | Column_name | Collation | Cardinality | Sub_part | Packed | Null | Index_type | Comment | +---++--+--+-+---+-+--++--++-+ | File | 0 | PRIMARY |1 | FileId | A | 154262958 | NULL | NULL | | BTREE | | | File | 1 | JobId|1 | JobId | A |NULL | NULL | NULL | | BTREE | | | File | 1 | JobId_2 |1 | JobId | A |NULL | NULL | NULL | | BTREE | | | File | 1 | JobId_2 |2 | PathId | A |NULL | NULL | NULL | | BTREE | | | File | 1 | JobId_2 |3 | FilenameId | A |NULL | NULL | NULL | | BTREE | | +---++--+--+-+---+-+--++--++-+ (sorry for the long lines) which look ok to me, so I was wondering what could cause this huge difference in restore run times before I get to the file marking part of the restore process. This operation: Building directory tree for JobId(s) 759 ... + 1,629 files inserted into the tree. took over three minutes where I seem to recall it being much faster on the old setup. I used the standard create_bacula_tables script that comes with 5.0.3 to set up the database. The major difference seems to be moving from a CentOS 5.6 to a 6.1 environment (both were 64bits, btw). Bacula DB size is 26GB (MyISAM tables). Thanks in advance for any pointers, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann AG -- The demand for IT networking professionals continues to grow, and the demand for specialized networking skills is growing even more rapidly. Take a complimentary Learning@Ciosco Self-Assessment and learn about Cisco certifications, training, and career opportunities. http://p.sf.net/sfu/cisco-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Starting bacula-fd: Error: Not been configured [FAILED]
On Wed, Oct 26, 2011 at 04:28:58PM +0530, Rushdhi Mohamed wrote: hi guys .. I have already installed a bacula client on REHL 6 and it works fine. but this time its giving an ERROR saying Starting bacula-fd: Error: Not been configured [FAILED] test out put here... I think you need to set and FD-password in /etc/bacula/bacula-fd.conf. HTH Uwe -- The demand for IT networking professionals continues to grow, and the demand for specialized networking skills is growing even more rapidly. Take a complimentary Learning@Cisco Self-Assessment and learn about Cisco certifications, training, and career opportunities. http://p.sf.net/sfu/cisco-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Creating directory tree on 5.0.3 takes a long time
On Thu, Oct 20, 2011 at 05:41:14PM +0200, Uwe Schuerkamp wrote: Hi folks, as you may remember I've recently set up a brand new bacula server with version 5.0.3 compiled from source. I copied over the mysql settings (mysql-server-5.1.52-1.el6_0.1.x86_64) from the old machine and inquired here for optimized mysql settings to use with the setup (backup size volume is the same as it was on the old server which had less ram, cpu and diskspace). However, when I try to run a restore job from a decent-sized full backup, it takes forever to build the directory tree where on the old machine this has been quite a speedy process. I've checked the faq and the indices for the file table: mysql show indexes from File ; +---++--+--+-+---+-+--++--++-+ | Table | Non_unique | Key_name | Seq_in_index | Column_name | Collation | Cardinality | Sub_part | Packed | Null | Index_type | Comment | +---++--+--+-+---+-+--++--++-+ | File | 0 | PRIMARY |1 | FileId | A | 154262958 | NULL | NULL | | BTREE | | | File | 1 | JobId|1 | JobId | A |NULL | NULL | NULL | | BTREE | | | File | 1 | JobId_2 |1 | JobId | A |NULL | NULL | NULL | | BTREE | | | File | 1 | JobId_2 |2 | PathId | A |NULL | NULL | NULL | | BTREE | | | File | 1 | JobId_2 |3 | FilenameId | A |NULL | NULL | NULL | | BTREE | | +---++--+--+-+---+-+--++--++-+ (sorry for the long lines) which look ok to me, so I was wondering what could cause this huge difference in restore run times before I get to the file marking part of the restore process. This operation: Building directory tree for JobId(s) 759 ... + 1,629 files inserted into the tree. took over three minutes where I seem to recall it being much faster on the old setup. I used the standard create_bacula_tables script that comes with 5.0.3 to set up the database. The major difference seems to be moving from a CentOS 5.6 to a 6.1 environment (both were 64bits, btw). Bacula DB size is 26GB (MyISAM tables). Hi folks, I've turned on the slow query log and it's come up with the following result (dirtree build for an incremental job that contains 41 files): http://pastebin.com/rNDivjHg when I quit the restore function and immediately try the same job restore, the tree builds instantly, so I guess it's a mysql problem. I've tried running mysqltuner and have increased the key buffer size, however the total index size is 10G where the server only has 6GB RAM ;-) Anything else I could try to speed up the dirtree generation? All the best thanks in advance, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann AG -- The demand for IT networking professionals continues to grow, and the demand for specialized networking skills is growing even more rapidly. Take a complimentary Learning@Cisco Self-Assessment and learn about Cisco certifications, training, and career opportunities. http://p.sf.net/sfu/cisco-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tuning lto-4
On Thu, Dec 15, 2011 at 10:25:04AM -0800, gary artim wrote: no, full, doing a mod on run command in bconsole to force full backup on every test. cheers 40MB/sec sounds very much like a natural RAID speed limit you're hitting. Have you tried running some i/o benchmarks on the disks like bonnie+ or dd? Cheers, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann AG -- Learn Windows Azure Live! Tuesday, Dec 13, 2011 Microsoft is holding a special Learn Windows Azure training event for developers. It will provide a great way to learn Windows Azure and what it provides. You can attend the event by watching it streamed LIVE online. Learn more at http://p.sf.net/sfu/ms-windowsazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Have we reached bacula's limits?
Hi folks, we're running four bacula installations, most of them on version 5.0.x compiled from source on CentOS 5.x / 6.x 64bit servers. We're mostly happy with the setup, backups are fast, reliable and generally do not cause us a lot of headaches. Today, a colleague asked me to restore some data from the last backup of a client on our largest bacula install, namely (according to bweb) DB Size: Total clients: 107 Total bytes stored: 34.41 TB Total files:47495362 Database size:31.64 GB MySQL isn't exactly huge, and restoring the data didn't look like too much of a big deal at first: +---+---+--++-+--+ | 9,582 | F | 527,265 | 55,999,595,573 | 2012-01-20 21:05:03 | OFFLINE14_02 | | 9,652 | I |1,150 | 1,534,499,185 | 2012-01-21 18:34:56 | OFFLINE15_01 | +---+---+--++-+--+ So we're talking a mere 500,000 files (he only needed a single dir out of the bunch). 4,5 hours later, Bacula is still sitting at the Building Directory Tree message, without so much as a single . or + hopefully showing up in the terminal, indicating some kind of progress. I've run mysqltuner on the db a couple of times as this isn't the first time we've had problems during a restore, and it looks ok (to my untrained, non-dba eyes anyway): ## General Statistics -- [--] Skipped version check for MySQLTuner script [OK] Currently running supported MySQL version 5.1.52-log [OK] Operating on 64-bit architecture Storage Engine Statistics --- [--] Status: -Archive -BDB -Federated -InnoDB -ISAM -NDBCluster [--] Data in MyISAM tables: 31G (Tables: 33) [!!] Total fragmented tables: 2 Performance Metrics - [--] Up for: 35s (57 q [1.629 qps], 12 conn, TX: 44K, RX: 3K) [--] Reads / Writes: 100% / 0% [--] Total buffers: 12.0G global + 83.2M per thread (151 max threads) [!!] Maximum possible memory usage: 24.3G (137% of installed RAM) [OK] Slow queries: 0% (0/57) [OK] Highest usage of available connections: 0% (1/151) [OK] Key buffer size / total MyISAM indexes: 11.9G/15.3G [OK] Key buffer hit rate: 100.0% (6K cached / 2 reads) [!!] Query cache efficiency: 0.0% (0 cached / 23 selects) [OK] Query cache prunes per day: 0 [OK] Sorts requiring temporary tables: 0% (0 temp sorts / 9 sorts) [!!] Temporary tables created on disk: 34% (8 on disk / 23 total) [OK] Thread cache hit rate: 91% (1 created / 12 connections) [OK] Table cache hit rate: 85% (41 open / 48 opened) [OK] Open file limit used: 1% (83/4K) [OK] Table locks acquired immediately: 100% (38 immediate / 38 locks) [!!] Connections aborted: 8% Recommendations - General recommendations: Run OPTIMIZE TABLE to defragment tables for better performance MySQL started within last 24 hours - recommendations may be inaccurate Reduce your overall MySQL memory footprint for system stability When making adjustments, make tmp_table_size/max_heap_table_size equal Reduce your SELECT DISTINCT queries without LIMIT clauses Your applications are not closing MySQL connections properly Variables to adjust: *** MySQL's maximum memory usage is dangerously high *** *** Add RAM before increasing MySQL buffer variables *** query_cache_limit ( 16M, or use smaller result sets) tmp_table_size ( 61M) max_heap_table_size ( 16M) ## For the restore run mentioned above, I'm seeing a 40MB mysql tmp table in /tmp updated every once in a while, and there's lots of write activity to the partition that holds /tmp. I'm now running a repair table File after cancelling the restore job, but I guess there's something seriously wrong with the above setup. The other bacula servers generally run on smaller machines, but come up with a dir tree after five to ten minutes for a comparable job which is acceptable, but 5 hours seems way off the mark. the bacula db was created using bacula's own mysql init script, so I assume all the indices where created (and more importantly, no extra ones that might slow bacula down) correctly. Insert performance it great during backups, we usually achieve around 30-50MB/sec sustained for 3 to 4 jobs running in parallel. Mem usage (as opposed to mysql tuner's warning) is ok during the restore run, no swapping, 5GB of 18G total still used for buffer cache. Thanks in advance for any help / hints or thoughts, Uwe PS: Please let me know if I should provide more info on the setup what would help in analyzing this problem. -- NIONEX --- Ein Unternehmen der Bertelsmann AG
Re: [Bacula-users] Have we reached bacula's limits?
Hi folks, thanks to your hints and ideas the restore times have been reduced from 3-4 hours to about five minutes (building the directory tree, that is). Lesson learnt: Before complaining loudly to the list, make sure your db is in good health by administering a generous dosage of repair table statements in mysql even if the database itself reports that all is just fine and dandy. Turned out the File table had some errors which seem to have gone undetected. 8-P I also used the opportunity to kick out mysql for good and replace it with MariaDB 5.2 which helped improve dir build times even further, even without having to tweak any special my.cnf settings or exporting / importing to InnoDB or some other storage backen. I had wanted to do this ever since listening to the recent interview with Monty Widenius on FLOSS Weekly. All the best thanks again for your help, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann AG -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula lost backup Job details / id
Hi folks, bacula seems to have forgotten the job details for a job I was going to test a restore on today. According to the bacula email, the backup finished ok: Build OS: x86_64-unknown-linux-gnu redhat JobId: 2155 snip snip Volume name(s): Offline38|Offline39|Offline40|Offline23_01|Offline16_02|Offline27_02|Offline28_02 Volume Session Id: 37 Volume Session Time:1326930050 Last Volume Bytes: 290,593,981,440 (290.5 GB) Non-fatal FD errors:0 SD Errors: 0 FD termination status: OK SD termination status: OK Termination:Backup OK However, when I try to list the jobs stored on each of those volumes I simply receive the message: Choose a query (1-16): 14 Enter Volume name: Offline23_01 No results to list. The Last Written column looks ok, the volume hasn't been written since the date of the previous backup: Offline23_01 796.44 GB DDS-4 2013/02/06 2012/02/07 Full Also: Enter a period to cancel a command. *restore Select item: (1-12): 3 Enter JobId(s), comma separated, to restore: 2155 Unable to get Job record for JobId=2155: ERR=sql_get.c:294 No Job found for JobId 2155 Is there a chance to restore the job details without resorting to bscan? I wonder why the job details were pruned in the first place... Bacula version is rather old (2.4.x), still I think it should be able to restore files from a backup that apparently ran ok... All the best thanks in advance, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX --- Ein Unternehmen der Bertelsmann AG -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula lost backup Job details / id
On Mon, Feb 20, 2012 at 09:36:47AM -0500, John Drescher wrote: Has you job retention period expired? Either way you can get this back using the bacula volume utilities. http://www.bacula.org/5.2.x-manuals/en/utility/utility/Volume_Utility_Tools.html#SECTION00272000 Make sure you have a longer retention period before you run this otherwise bacula can expire the records just after it is done with the recovery.. John Hi John, it's definitely not the job retention period as I'm able to find one backup of this job that's even older, four weeks older in fact. So to me it looks like bacula has simply forgotten job 2155 and the fact that it finished successfully. Thanks for the util link, I'll give it a read. Will bacula need to read the entire tapes? All the best, Uwe -- uwe.schuerk...@nionex.net fon: [+49] 5242.91 - 4740, fax:-69 72 Hauptsitz: Avenwedder Str. 55, D-33311 Gütersloh, Germany Registergericht Gütersloh HRB 4196, Geschäftsführer: H. Gosewehr, D. Suda NIONEX --- Ein Unternehmen der Bertelsmann AG -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
