Re: [Bacula-users] Backups are growing furiously and I'm confused
Hello Bill,
(previous answer was sent personally, sorry)
Thanks a lot for a prompt reply.
I've already revised volume creation/retention/labeling policies so
that they will use 60 Gbs of disk space as maximum and Bacula will be
able to reuse them if needed.
Configuration of the Pool is the following:
Pool {
Name = Default
Pool Type = Backup
Recycle = yes # Bacula can automatically recycle Volumes
AutoPrune = yes # Prune expired volumes
Volume Retention = 1 month
Accept Any Volume = yes # write on any volume in the pool
Label Format = $Storage-$NumVols
Maximum Volumes = 30
Maximum Volume Bytes = 20
}
I hope this will work better.
Tuesday, July 11, 2006, 5:04:47 PM, you wrote:
In response to Alexei [EMAIL PROTECTED]:
Hi all,
I'm sorry for disturbing you since I know deep inside that it can be a dumb
question :)
The question is:
I'm running Bacula without tape backups, using File as storage. There are 2
huge jobs (about 5-6 Gb for full backup) running and I've run out of free
space quickly.
Now when it came to this point I've tried to reconfigure the retention
periods and the Pool resource in order to free space by the Bacula means
only and found that I'm doing something wrong or smth like that because many
volumes and jobs are marked as purged but the corresponding files (say 5-6
Gb each) are still on disk...
How can I easily and correctly clean my storage to leave (and always have)
only the most current set of (1 Full Monthly + 4 Diff Weekly + 7 Inc Daily)
backups for each job?
Bacula takes the policy that it doesn't delete your data automatically.
As a result, it will never remove volumes and you can't configure it to
do so automatically (that I am aware of).
To clear off the volumes that you don't want anymore, use the delete
command in bconsole. Once the volume is deleted from the catalog, you can
use typical filesystem tools to remove the files.
If your new schedule and retention periods do not require the recreation
of those volumes, they won't be recreated.
--
Best regards,
Alexeimailto:[EMAIL PROTECTED]
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Volumes Use Duration not honored
Ryan Novosielski wrote: Volume retention is a minimum, not a maximum. If there is no pressing need to recycle/prune a tape, Bacula will not (if it's still appendable, for example). You need to limit tape usage by size/jobs/time in order for this to work as you expect, I think. Ok, so I should be able to limit the time the tape is used by setting the Volume Use Duration right? I have this set to 16 hours, yet 2 weeks later, Bacula seems quite happy to continue writing to this tape. Or am I using the wrong parameter to limit how long a tape is valid for use? Kind regards, Costyn van Dongen. -- ICS B.V. Stadhouderslaan 57 3583 JD UTRECHT The Netherlands T: +31 30 6355730 F: +31 30 6355731 http://www.ic-s.nl/ ICS biedt Support, Ontwikkeling en Consultancy voor uiteenlopende Internet gerelateerde platformen, met een voorliefde voor Open Source. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula, backup on tapes : ask for the volume of the next job
Hi, Am Dienstag, den 11.07.2006, 10:33 +0200 schrieb Benoit Guguin: Hi, I'm currently using Bacula 1.36 on a Debian Sarge. I've configured multiples backups on tapes. So my question is : How can I configure Bacula to send a mail that ask the needed and appropriated volume (ie tape) for the next job on, and only on, the tape device ? if you will find an answer, let me know. I am also looking for that feature. Axel # DISCLAIMER # # # # Der Inhalt dieser E-Mail ist vertraulich. Falls Sie nicht der# # angegebene Empfaenger sind oder falls diese Email irrtuemlich an Sie # # addressiert wurde, verstaendigen Sie bitte den Absender sofort und # # loeschen Sie die Email umgehend. Das unerlaubte Kopieren sowie die # # unbefugte Uebermittlung sind nicht gestattet.# # Die Sicherheit von Uebermittlungen per Email kann nicht garantiert # # werden. Falls Sie eine Bestaetigung wuenschen, fordern Sie bitte den # # Inhalt der Email als Hardcopy an.# # # # # # The contents of this e-mail are confidential. # # If you are not the named addressee you should not disseminate, # # distribute or copy this e-mail. Please notify the sender immediately # # if you have received this e-mail by mistake and delete this e-mail # # from your system. Finally, the recipient should check this email and # # any attachments for the presence of viruses. The company accepts no # # liability for any damage caused by any virus transmitted by this # # email. # # # # SuedFactoring GmbH, Heilbronner Strasse 86, 70191 Stuttgart # - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula, backup on tapes : ask for the volume of the next job
Hi, Am Dienstag, den 11.07.2006, 10:33 +0200 schrieb Benoit Guguin: Hi, I'm currently using Bacula 1.36 on a Debian Sarge. I've configured multiples backups on tapes. So my question is : How can I configure Bacula to send a mail that ask the needed and appropriated volume (ie tape) for the next job on, and only on, the tape device ? if you will find an answer, let me know. I am also looking for that feature. Axel # DISCLAIMER # # # # Der Inhalt dieser E-Mail ist vertraulich. Falls Sie nicht der# # angegebene Empfaenger sind oder falls diese Email irrtuemlich an Sie # # addressiert wurde, verstaendigen Sie bitte den Absender sofort und # # loeschen Sie die Email umgehend. Das unerlaubte Kopieren sowie die # # unbefugte Uebermittlung sind nicht gestattet.# # Die Sicherheit von Uebermittlungen per Email kann nicht garantiert # # werden. Falls Sie eine Bestaetigung wuenschen, fordern Sie bitte den # # Inhalt der Email als Hardcopy an.# # # # # # The contents of this e-mail are confidential. # # If you are not the named addressee you should not disseminate, # # distribute or copy this e-mail. Please notify the sender immediately # # if you have received this e-mail by mistake and delete this e-mail # # from your system. Finally, the recipient should check this email and # # any attachments for the presence of viruses. The company accepts no # # liability for any damage caused by any virus transmitted by this # # email. # # # # SuedFactoring GmbH, Heilbronner Strasse 86, 70191 Stuttgart # - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] From single to multiple volumes!
Hi! I have a question! When I started using bacula I configured it to write the data to one file for full backups and one file for incremental backups for each host. Now I want it to always create new files so that I can remove data that is no longer useful. My question: Is it possible to just add the directive Maximum Volume Jobs = 1 to the pool definition and get the effect that it will create new volumes for every coming job and still be able to restore from the old volume? /marcus -- /Marcus Hallberg Wimlet Consulting AB Djurgårdsgatan 10 414 62 Göteborg mobil: 0707-141716 e-post: [EMAIL PROTECTED] hemsida: www.wimlet.se - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula, backup on tapes : ask for the volume of the next job
Am Mittwoch, den 12.07.2006, 10:27 +0200 schrieb Benoit Guguin: Hi, Ok ... no probleme. But I really don't know how to do this ... maybe someone will find an answer ;-) # DISCLAIMER # # # # Der Inhalt dieser E-Mail ist vertraulich. Falls Sie nicht der# # angegebene Empfaenger sind oder falls diese Email irrtuemlich an Sie # # addressiert wurde, verstaendigen Sie bitte den Absender sofort und # # loeschen Sie die Email umgehend. Das unerlaubte Kopieren sowie die # # unbefugte Uebermittlung sind nicht gestattet.# # Die Sicherheit von Uebermittlungen per Email kann nicht garantiert # # werden. Falls Sie eine Bestaetigung wuenschen, fordern Sie bitte den # # Inhalt der Email als Hardcopy an.# # # # # # The contents of this e-mail are confidential. # # If you are not the named addressee you should not disseminate, # # distribute or copy this e-mail. Please notify the sender immediately # # if you have received this e-mail by mistake and delete this e-mail # # from your system. Finally, the recipient should check this email and # # any attachments for the presence of viruses. The company accepts no # # liability for any damage caused by any virus transmitted by this # # email. # # # # SuedFactoring GmbH, Heilbronner Strasse 86, 70191 Stuttgart # - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restore Question.
In the manual (on page 92) you find a scenario with the command restore all. What other arguments can be given to the restore command? And what's the difference between restore all and just restore? -- Erik P. Olsen, Civilingeniør, MSc Solsortvej 30, DK-2000 Frederiksberg, Denmark Phone: +45 38346480, Fax: +45 38346470, Mobil: +45 40765300 - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] From single to multiple volumes!
Marcus Hallberg wrote: Hi! I have a question! When I started using bacula I configured it to write the data to one file for full backups and one file for incremental backups for each host. Now I want it to always create new files so that I can remove data that is no longer useful. My question: Is it possible to just add the directive Maximum Volume Jobs = 1 to the pool definition and get the effect that it will create new volumes for every coming job and still be able to restore from the old volume? /marcus Hi Marcus, You can easily define a maximum use duration or a maximum volume size. When those limits are reached a new volume file will be created. http://bacula.org/rel-manual/Basic_Volume_Management.html#SECTION000251100 http://bacula.org/rel-manual/Basic_Volume_Management.html#SECTION000251300 I hope this helps, Jo - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula, backup on tapes : ask for the volume of the next job
In response to Axel S. Gruner [EMAIL PROTECTED]: Hi, Am Dienstag, den 11.07.2006, 10:33 +0200 schrieb Benoit Guguin: Hi, I'm currently using Bacula 1.36 on a Debian Sarge. I've configured multiples backups on tapes. So my question is : How can I configure Bacula to send a mail that ask the needed and appropriated volume (ie tape) for the next job on, and only on, the tape device ? Do you receive email messages from Bacula at all? If your mail config is set up properly, Bacula will email the configured address if it needs a tape change, like this: 07-Jul 06:05 mindwipe-sd: Please mount Volume rotation0.year2006.tape000101.pitbpa0 on Storage Device Ultrium (/dev/nsa0) for Job server-std.2006-07-06_23.05.00 -- Bill Moran Collaborative Fusion Inc. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Performace between MySQL and Postgres 7 8?
Additionally, MySQL with MyISAM will _always_ be faster than PG, because MyISAM doesn't support transactions. The overhead of ensuring your data is ACID slows things down a bit. If you want to try to compare MySQL to PostgreSQL, use InnoDB or BDB tables. You'd really want InnoDB if you're going to do any kind of fair comparison. BDB doesn't do any kind of MVCC, whereas InnoDB does. Also, ensure that you vacuum and analyze PostgreSQL databases frequently. An occasional REINDEX helps as well. These are normal maintenance tasks for PostgreSQL. ANALYZE is especially important right after populating a new database. REINDEX really shouldn't be needed anymore as long as your database is properly configured, but if you're still on 7.x it may be. //Magnus - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Performace between MySQL and Postgres 7 8?
there is a way to 'cheat' : either use fsync = off in postgresql (that sucks), or try a writeback enabled raid controller. In both cases you're taking a risk, but it's rather low in the second one. That's not entirely correct. fsync=off is pretty much the same thing you have with MyISAM, so if you're fine with that, you shuld be fine with fsync=off. However, if you use a writeback enabled RAID controller (*with* a battery backup of course - if you have one without a battery, someone ripped you off), you do *not* take a bigger risk. You will get almost the performance of fsync=off without any real risk. This is really the only option for *any* database system if you want both performance and stability. These two cheats both remove the sync wait created by the transactions on the 'WAL' (journal) files on postgresql. No. fsync=off removes *all* fsync, but the WAL does not necessarily use it. WAL can also use OPEN_SYNC, OPEN_DSYNC etc, in which case it's really not affected by fsync=off. However, all data file access during checkpoints and such things also fsync, so you'll definitly get more performance (at a risk) by turning it off. //Magnus - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula, backup on tapes : ask for the volume of the next job
Hi,
I receive messages from Bacula. Mail configuration is ok ;).
But my purpose is to have a message like insert tape after the end of
the job, and not when bacula detect a wrong tape.
Perphaps I'm going wrong in the way I configure Bacula ... ;)
I've find a way to do what I want (ie bacula ask for the volume of the next
job) :
* I'm running a Console programme from a shell script
(
http://www.bacula.org/rel-manual/Bacula_Console.html#SECTION000209000
).
* I ask bconsole to display the director status
* I parse the response, and send a mail.
So my script to have the tape name for the next job is like this :
1) interogate bconsole :
/usr/bin/bconsole -c /etc/bacula/bconsole.confEND_OF_DATA
@output /tmp/bconsole.out.tmp
status director
quit
END_OF_DATA
2) parse the response
#!/usr/bin/perl -w
open(LOG, /tmp/bconsole.out.tmp);
while (LOG) {
if(/(Save(\w+))\s+((\2)-.*)$/i) {
print $1 $3 ;
}
}
3) I send an email with the job name and the job volume
I hope that can help you.
Regards,
Le Mercredi 12 Juillet 2006 14:09, Bill Moran a écrit :
In response to Axel S. Gruner [EMAIL PROTECTED]:
Hi,
Am Dienstag, den 11.07.2006, 10:33 +0200 schrieb Benoit Guguin:
Hi,
I'm currently using Bacula 1.36 on a Debian Sarge.
I've configured multiples backups on tapes.
So my question is :
How can I configure Bacula to send a mail that ask the needed and
appropriated volume (ie tape) for the next job on, and only on, the
tape device ?
Do you receive email messages from Bacula at all? If your mail config is
set up properly, Bacula will email the configured address if it needs a
tape change, like this:
07-Jul 06:05 mindwipe-sd: Please mount Volume
rotation0.year2006.tape000101.pitbpa0 on Storage Device Ultrium
(/dev/nsa0) for Job server-std.2006-07-06_23.05.00
--
Guguin Benoit
Société Alixen 2 rue Jean Rostand 91 893 Orsay Cedex France
Tel : 01 69 85 24 13, Fax : 01 69 85 24 10
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Please help! Strange bacula behaviour lets some jobsfail on autoloader! - unfortntly still unresolved
On Tue, 11 Jul 2006, Christoff Buch wrote: Hi Alan Is 1.38.9 meant to be an older version? Yes, current is 1.38.11 07-Jul 23:00 heem-sd: 3304 Issuing autochanger load slot 15, drive 0 command. 07-Jul 23:00 heem-sd: A-1_dali-AAW-Con-Fin-Man_.2006-07-07_23.00.00 Fatal error: 3992 Bad autochanger load slot 15, drive 0: ERR=Child exited with c ode 1. This is a MTX error. If you are running programs as user=bacula, then su - bacula and run the mtx command by hand to see what errors you are getting - most likely it is permissions on /dev/changer If this works, then use mtx-changer and perform the tests detailed in the bacula manual. 07-Jul 22:59 dali-fd: A-1_dali-AAW-Con-Fin-Man_.2006-07-07_23.00.00 Fatal error: job.c:1617 Bad response to Append Data command. Wanted 3000 OK data , got 3903 Error append data because you do not have concurrent jobs running, this must be related to the changer error. AB - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Performace between MySQL and Postgres 7 8?
Also, ensure that you vacuum and analyze PostgreSQL databases frequently. An occasional REINDEX helps as well. These are normal maintenance tasks for PostgreSQL. ANALYZE is especially important right after populating a new database. REINDEX really shouldn't be needed anymore as long as your database is properly configured, but if you're still on 7.x it may be. Shoulda, coulda, woulda. Fact is, in actual experience, doing a REINDEX resulted in both a noticeable reduction in the size of the database, and the appearance of a performance gain. The performance part is arguable, since I didn't do any benchmarking, but it _seemed_ faster ;) If it did make a difference, you probably want to check the values for your freespace map size. If there's not enough space in the freespace map, vacuum won't be able to properly deal with the indexes so this can happen. (running a database wide vacuum verbose should tell you what values you have vs what values you need) But yeah, read the docs. REINDEX shouldn't be needed, but it's there if you want to do it. Plus, on a database that has lots of downtime, like a Bacula system where the backups only run at night, it's not hurting anything to REINDEX during the day. Good point. (assuming you don't backup different servers around the clock for some reason) //Magnus - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Please help! Strange bacula behaviour lets some jobsfail on autoloader! - unfortntly still unresolved
Alan Brown [EMAIL PROTECTED] wrote on 12.07.2006 14:48:03: On Tue, 11 Jul 2006, Christoff Buch wrote: Hi Alan Is 1.38.9 meant to be an older version? Yes, current is 1.38.11 07-Jul 23:00 heem-sd: 3304 Issuing autochanger load slot 15, drive 0 command. 07-Jul 23:00 heem-sd: A-1_dali-AAW-Con-Fin-Man_.2006-07-07_23.00.00 Fatal error: 3992 Bad autochanger load slot 15, drive 0: ERR=Child exited with c ode 1. This is a MTX error. If you are running programs as user=bacula, then su - bacula and run the mtx command by hand to see what errors you are getting - most likely it is permissions on /dev/changer = Everything runs as root here... Don't even have an user bacula. If this works, then use mtx-changer and perform the tests detailed in the bacula manual. = If you are talking about btape tests for drive / autochanger: I did run them all when I started controlling the autochanger with bacula and all tests succeeded just fine. I did have a close look on the results and there really was not a single error / failure / warning whatsoever. 07-Jul 22:59 dali-fd: A-1_dali-AAW-Con-Fin-Man_.2006-07-07_23.00.00 Fatal error: job.c:1617 Bad response to Append Data command. Wanted 3000 OK data , got 3903 Error append data because you do not have concurrent jobs running, this must be related to the changer error. = Yes the thing here is: Since bacula doesn't get a response from the loaded drive 0 commmand because ERR= Operation not permitted, it can't know that the appropriate tape is already in the drive. So the job fails with the above error. The next job after that one, however, gets a response from the loaded drive 0 command, does see the tape still in the drive and appends data as well as succeeds in the most normal way without any problems. This is stunning me. Best Greetings, Christoff AB - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Performace between MySQL and Postgres 7 8?
In response to Magnus Hagander [EMAIL PROTECTED]: Also, ensure that you vacuum and analyze PostgreSQL databases frequently. An occasional REINDEX helps as well. These are normal maintenance tasks for PostgreSQL. ANALYZE is especially important right after populating a new database. REINDEX really shouldn't be needed anymore as long as your database is properly configured, but if you're still on 7.x it may be. Fact is, in actual experience, doing a REINDEX resulted in both a noticeable reduction in the size of the database, and the appearance of a performance gain. The performance part is arguable, since I didn't do any benchmarking, but it _seemed_ faster ;) If it did make a difference, you probably want to check the values for your freespace map size. If there's not enough space in the freespace map, vacuum won't be able to properly deal with the indexes so this can happen. Well ... feel free to correct me if I'm wrong, but vacuum isn't capable of completely optimizing indexes. It only deletes empty index pages. The result is that over time, you accumulate lots of half-empty index pages. REINDEX recompacts the indexes into full pages. This results in less IO required to read the index off disk. Theoretically, you shouldn't have to REINDEX because the free space will be reused in time, but it can get pretty fragmented under normal usage. Depending on the page size, this may or may not have a noticeable impact on performance. It definitely has a noticeable impact on disk usage. -- Bill Moran Collaborative Fusion Inc. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Please help! Strange bacula behaviour lets some jobsfail on autoloader! - unfortntly still unresolved
On Wed, 12 Jul 2006, Christoff Buch wrote: = Everything runs as root here... Don't even have an user bacula. That eliminates one issue. If this works, then use mtx-changer and perform the tests detailed in the bacula manual. = If you are talking about btape tests for drive / autochanger: I did run them all when I started controlling the autochanger with bacula and all tests succeeded just fine. I did have a close look on the results and there really was not a single error / failure / warning whatsoever. OK. The next job after that one, however, gets a response from the loaded drive 0 command, does see the tape still in the drive and appends data as well as succeeds in the most normal way without any problems. This is stunning me. What happens if you run the jobs manually? AB - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Performace between MySQL and Postgres 7 8?
On Wednesday 12 July 2006 14:14, Magnus Hagander wrote: there is a way to 'cheat' : either use fsync = off in postgresql (that sucks), or try a writeback enabled raid controller. In both cases you're taking a risk, but it's rather low in the second one. That's not entirely correct. fsync=off is pretty much the same thing you have with MyISAM, so if you're fine with that, you shuld be fine with fsync=off. However, if you use a writeback enabled RAID controller (*with* a battery backup of course - if you have one without a battery, someone ripped you off), you do *not* take a bigger risk. You will get almost the performance of fsync=off without any real risk. This is really the only option for *any* database system if you want both performance and stability. I've allready experienced this without risk writeback cache firsthand, when the controller crashed... yes, that happens too... and then you can be sure your data is corrupted (very corrupted...). Of course, it's really rare. It hapened only once for me, but there was a lot of damage. These two cheats both remove the sync wait created by the transactions on the 'WAL' (journal) files on postgresql. No. fsync=off removes *all* fsync, but the WAL does not necessarily use it. WAL can also use OPEN_SYNC, OPEN_DSYNC etc, in which case it's really not affected by fsync=off. However, all data file access during checkpoints and such things also fsync, so you'll definitly get more performance (at a risk) by turning it off. But this part is good to know :) Anyway thanks a lot for correcting my mistakes :) - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula, backup on tapes : ask for the volume of the next job
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
How about list nextvol job=jobname?
Benoit Guguin wrote:
Hi,
I receive messages from Bacula. Mail configuration is ok ;).
But my purpose is to have a message like insert tape after the end of
the job, and not when bacula detect a wrong tape.
Perphaps I'm going wrong in the way I configure Bacula ... ;)
I've find a way to do what I want (ie bacula ask for the volume of the next
job) :
* I'm running a Console programme from a shell script
(
http://www.bacula.org/rel-manual/Bacula_Console.html#SECTION000209000
).
* I ask bconsole to display the director status
* I parse the response, and send a mail.
So my script to have the tape name for the next job is like this :
1) interogate bconsole :
/usr/bin/bconsole -c /etc/bacula/bconsole.confEND_OF_DATA
@output /tmp/bconsole.out.tmp
status director
quit
END_OF_DATA
2) parse the response
#!/usr/bin/perl -w
open(LOG, /tmp/bconsole.out.tmp);
while (LOG) {
if(/(Save(\w+))\s+((\2)-.*)$/i) {
print $1 $3 ;
}
}
3) I send an email with the job name and the job volume
I hope that can help you.
Regards,
Le Mercredi 12 Juillet 2006 14:09, Bill Moran a écrit :
In response to Axel S. Gruner [EMAIL PROTECTED]:
Hi,
Am Dienstag, den 11.07.2006, 10:33 +0200 schrieb Benoit Guguin:
Hi,
I'm currently using Bacula 1.36 on a Debian Sarge.
I've configured multiples backups on tapes.
So my question is :
How can I configure Bacula to send a mail that ask the needed and
appropriated volume (ie tape) for the next job on, and only on, the
tape device ?
Do you receive email messages from Bacula at all? If your mail config is
set up properly, Bacula will email the configured address if it needs a
tape change, like this:
07-Jul 06:05 mindwipe-sd: Please mount Volume
rotation0.year2006.tape000101.pitbpa0 on Storage Device Ultrium
(/dev/nsa0) for Job server-std.2006-07-06_23.05.00
- --
_ _ _ _ ___ _ _ _
|Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer III
|$| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922)
\__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.2.2 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iD8DBQFEtSommb+gadEcsb4RAs0tAJ9s26IgIUIAyQCBztJulcxugReELgCfffGA
wS+A4goRMTsXW/AITtJp1fc=
=LMo9
-END PGP SIGNATURE-
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Autochanger: Unloading/Reloading tape for follow-up job - Bad autochanger loaded drive 0 command: ???
Hi,
On 7/7/2006 6:25 PM, Christoff Buch wrote:
Hi Arno
This has taken a while but here come mtx and bacula-sd.conf:
As to the btape test results:
I can't find my files with the results at the moment (oops...), but I
have the print-outs here:
I reviewed them again (as I already did when I started with the
autochanger) and there is really not a single error whatsoever.
I did the normal test for the drive as such and the test for the
autochanger. Both succeded fine.
A good start, at least...
If you can find anything, answers would be very appreciated!
Well, I looked them over, and - see below.
Thanks again + Best Regards,
Christoff Buch
...
#!/bin/sh
#
# Bacula interface to mtx autoloader Adapted by Christoff Buch, OneVision
Software AG, 2006-05-31
#
# $Id: mtx-changer.in,v 1.21.2.7 2006/05/02 14:48:12 kerns Exp $
#
# If you set in your Device resource
#
# Changer Command = path-to-this-script/mtx-changer %c %o %S %a %d
#you will have the following input to this script:
#
# So Bacula will always call with all the following arguments, even though
#in come cases, not all are used.
#
# mtx-changer changer-device command slot archive-device
drive-index
#$1 $2 $3$4 $5
#
# for example:
#
# mtx-changer /dev/sg0 load 1 /dev/nst0 0 (on a Linux system)
#
# will request to load the first cartidge into drive 0, where
# the SCSI control channel is /dev/sg0, and the read/write device
# is /dev/nst0.
#
# If you need to an offline, refer to the drive as $4
#e.g. mt -f $4 offline
#
# Many changers need an offline after (Sorry, not before?) the unload. Also
many
# changers need a sleep 60 after the mtx load.
#
# N.B. If you change the script, take care to return either
# the mtx exit code or a 0. If the script exits with a non-zero
# exit code, Bacula will assume the request failed.
#
MTX=mtx
#
# log whats done
#
# to turn on logging, uncomment the following line
You might consider turning on logging. Personally, I also like some more
extensive output in the debug log, like mtx output.
#touch /usr/local/bacula/working/mtx.log
#
dbgfile=/usr/local/bacula/working/mtx.log
debug() {
if test -f $dbgfile; then
echo `date +\%Y%m%d-%H:%M:%S\` $* $dbgfile
fi
}
#
# Create a temporary file
#
make_temp_file() {
...
}
#
# The purpose of this function to wait a maximum
# time for the drive. It will
# return as soon as the drive is ready, or after
# waiting a maximum of 300 seconds.
# Note, this is very system dependent, so if you are
# not running on Linux, you will probably need to
# re-write it, or at least change the grep target.
#
wait_for_drive() {
i=0
while [ $i -le 300 ]; do # Wait max 300 seconds
if mt -f $1 status | grep ONLINE /dev/null 21; then
break
fi
debug Device $1 - not ready, retrying...
sleep 1
i=`expr $i + 1`
done
}
Ok, here it might happen that waiting for the drive times out without
notification.
I use a longer wait time per loop, and you should log the result of the
last check, for example.
Also, there is a last-resort timeout in the SD configuration: Maximum
Changer Wait = time in seconds should be set to a time longer than any
mtx-changer operation should ever take. I have this set to a very long time.
# check parameter count on commandline
#
check_parm_count() {
...
# Check for special cases where only 2 arguments are needed,
# all others are a minimum of 5
#
...
case $cmd in
unload)
debug Doing mtx -f $ctl unload $slot $drive
#
# enable the following line if you need to eject the cartridge
# the following two(!)lines enabled by Christoff Buch, OneVision Software AG,
2006-05-31
mt -f $device offline
sleep 10
should not be a problem, but when reading this I thought about adding a
negative wait_for_drive, some function that makes sure a tape is not
loaded (but perhaps in the drive).
${MTX} -f $ctl unload $slot $drive
;;
load)
debug Doing mtx -f $ctl load $slot $drive
${MTX} -f $ctl load $slot $drive
rtn=$?
#
# Increase the sleep time if you have a slow device
# or remove the sleep and add the following:
# the following line enabled by Christoff Buch, OneVision Software AG,
2006-05-31
wait_for_drive $device
# the following line disabled by Christoff Buch, OneVision Software AG,
2006-05-31
# sleep 15
exit $rtn
looks good, although, even after the wait_for_drive succeeded the $rtn
variable might still contain a value != 0. Worth checking or logging, I
think.
;;
list)
debug Doing mtx -f $ctl -- to list volumes
make_temp_file
# Enable the following if you are using barcodes and need an inventory
# OneVision
[Bacula-users] tapes not filling up?
Hey List- I'm having some issues with tapes not filling up all the way. The system was running fine for about 3-4months and then suddenly I started having issues with tapes only using about 20% of the supposed space available. I thought perhaps the tapes were dying, so I bought some news ones. Again, it only used about 30% of the tape before asking for another tape. Some one suggested there was a thread in the user list, but I couldn't find it. Anyone have a link? If not, anyone have any ideas? My system: FreeBSD 5.4 -stable'ish (x86) bacula version: 1.38.10 drive: EXABYTE VXA-2 2105 adaptor: Adaptec 29160N Ultra160 SCSI adapter I am seeing the following errors in my logs: (sa0:ahc0:0:11:0): Target operating conditions have changed (sa0:ahc0:0:11:0): Retrying Command (per Sense Data) (sa0:ahc0:0:11:0): REWIND. CDB: 1 0 0 0 0 0 (sa0:ahc0:0:11:0): CAM Status: SCSI Status Error (sa0:ahc0:0:11:0): SCSI Status: Check Condition (sa0:ahc0:0:11:0): NOT READY asc:3f,0 (sa0:ahc0:0:11:0): Target operating conditions have changed (sa0:ahc0:0:11:0): Retrying Command (per Sense Data) (sa0:ahc0:0:11:0): REWIND. CDB: 1 0 0 0 0 0 (sa0:ahc0:0:11:0): CAM Status: SCSI Status Error (sa0:ahc0:0:11:0): SCSI Status: Check Condition (sa0:ahc0:0:11:0): NOT READY asc:3f,0 (sa0:ahc0:0:11:0): Target operating conditions have changed (sa0:ahc0:0:11:0): Retries Exhausted So, something is happening to the drive / scsi device which is causing Bacula to timeout. It seems to happen at a random point. There were no major updates done to the box after it was running. Just some patches to samba, etc... Thoughts? Henrik -- Henrik Hudson [EMAIL PROTECTED] -- God, root, what is difference? Pitr; UF (http://www.userfriendly.org/) - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
