Re: [Bacula-users] [Bacula-devel] Load slots timeout
On Nov 10, 2014, at 3:33 AM, Andrey Chebotarev a...@525.su wrote: Hi. It's in devel because the question about editing sources, but not about configuration. And I think solve the question could only developer. The conclusion to change the code is premature. On Nov 4, 2014, at 6:55 AM, Andrey Chebotarev a...@525.su wrote: Hi guys. I use bacula 5.2.13 with IBM TS3200 library. Periodically I face problem with load slot time out. In logs it looks lilke: 22-Sep 00:35 baculasrv-dir JobId 10471: Recycled volume 220AAAL6 22-Sep 00:35 baculasrv-sd JobId 10471: 3304 Issuing autochanger load slot 1, drive 1 command. 22-Sep 00:40 baculasrv-sd JobId 10471: Fatal error: 3992 Bad autochanger load slot 1, drive 1: ERR=Child died from signal 15: Termination. Results=Program killed by Bacula (timeout) 22-Sep 00:32 sqcompose-fd JobId 10471: Fatal error: backup.c:1019 Network send error to SD. As I understood, bacula tries to load slot for 5 minutes and if it's not successful stops job. I started investigation why bacula sometimes doesn't manage to load slot in 5 minutes and find out library stops responding to commands and starts cleaning drive procedure which takes more than 5 minutes(Library was configured to clean drive automatically) So how can I solve the problem? I've found place in mtx-changer script where declared 300 seconds to wait. I've increased it value to 1800 seconds. Is it only place or I have to change somthing else in sources? Hi everybody. Increasing timeout in mtx-changer script hasn't helped, I have the same issue. Where in sources I can increase timeout to 30 minutes? I don’t see why this is on devel It should be on users, which is cc’d here. -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Load slots timeout
Mr. Andrey,
/etc/bacula/scripts/mtx-changer:
wait_for_drive() {
i=0
while [ $i -le 300 ]; do # Wait max 300 seconds
if mt -f $1 status 21 | grep ${ready} /dev/null 21; then
break
fi
debug Device $1 - not ready, retrying...
sleep 1
i=`expr $i + 1`
done
}
Regards,
=
Heitor Medrado de Faria
Faltam poucos dias - Treinamento Telepresencial Bacula:
http://www.bacula.com.br/?p=2174
61 2021-8260 | 8268-4220
Site: www.bacula.com.br | Facebook: heitor.faria | Gtalk: heitorfa...@gmail.com
==
- Mensagem original -
De: Andrey Chebotarev a...@525.su
Para: Dan Langille d...@langille.org
Cc: bacula-de...@lists.sourceforge.net, bacula-users
bacula-users@lists.sourceforge.net
Enviadas: Segunda-feira, 10 de novembro de 2014 10:24:48
Assunto: Re: [Bacula-devel] Load slots timeout
I wanted to change the code by myself. I just wanted to know where is in code
place where defined 5 minutes timeout.
On Nov 10, 2014, at 3:33 AM, Andrey Chebotarev a...@525.su wrote:
blockquote
Hi.
It's in devel because the question about editing sources, but not about
configuration.
And I think solve the question could only developer.
The conclusion to change the code is premature.
blockquote
blockquote
blockquote
On Nov 4, 2014, at 6:55 AM, Andrey Chebotarev a...@525.su wrote:
blockquote
Hi guys.
I use bacula 5.2.13 with IBM TS3200 library.
Periodically I face problem with load slot time out. In logs it looks lilke:
22-Sep 00:35 baculasrv-dir JobId 10471: Recycled volume 220AAAL6
22-Sep 00:35 baculasrv-sd JobId 10471: 3304 Issuing autochanger load slot 1,
drive 1 command.
22-Sep 00:40 baculasrv-sd JobId 10471: Fatal error: 3992 Bad autochanger load
slot 1, drive 1: ERR=Child died from signal 15: Termination.
Results=Program killed by Bacula (timeout)
22-Sep 00:32 sqcompose-fd JobId 10471: Fatal error: backup.c:1019 Network send
error to SD.
As I understood, bacula tries to load slot for 5 minutes and if it's not
successful stops job.
I started investigation why bacula sometimes doesn't manage to load slot in 5
minutes and find out library stops responding to commands and starts cleaning
drive procedure which takes more than 5 minutes(Library was configured to clean
drive automatically)
So how can I solve the problem?
I've found place in mtx-changer script where declared 300 seconds to wait. I've
increased it value to 1800 seconds. Is it only place or I have to change
somthing else in sources?
/blockquote
/blockquote
blockquote
Hi everybody.
Increasing timeout in mtx-changer script hasn't helped, I have the same issue.
Where in sources I can increase timeout to 30 minutes?
/blockquote
I don’t see why this is on devel It should be on users, which is cc’d here.
/blockquote
/blockquote
/blockquote
--
___
Bacula-devel mailing list
bacula-de...@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-devel
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuration reload for bacula-sd
Hi Kern, In spite of Bacula do not need different Media Types when using different LTO generations in tape libraries, I really think that it could be a best practice for working with LTO tapes to have the LTO tape generation specified in storage device definition. Just because of compatibility between tape drives and LTO generations: the hardware reads data from catridges in its own generation and at least two prior ones and writes in its own generation and to catridges that are in the immediately prior generation (using the immediately prior generation format). Suppose you have an LTO-3 drive working with LTO-3 catridges and you upgrade your hardware to an LTO-5 drive that will not write to your LTO-3 catridges because of compatibility. If you just specify Media Type = LTO, Bacula will try to read and write to all the LTO-3 and LTO-5 catridges and this will no work. Is there another way of distinguishing different LTO catridge generations? Normally I have been using this way: having two storage device definitions for the same drive, each one working with an LTO catridge generation. Best regards, Ana On Thu, Nov 6, 2014 at 3:01 PM, Kern Sibbald k...@sibbald.com wrote: Which is why I'll never understand the tape/disk dichotomy. (As an aside, bacula, specifically, seems to force you to use different Media Type for each physical device so I don't get how it would work with multiple drives in the same jukebox, either -- thankfully I don't need to.) To be more precise, Bacula does not require you to use different Media Types for different devices. It only does so for different disk devices so that it can be sure where the Volume is actually stored. For a compatible tape drives in an autochanger, there is no need to have different Media Types. However, if you have multiple separate libraries the Media Type must be different so that Bacula is sure what library the Volume is in (it actually keeps a device index, but this is often insufficient). Best regards, Kern ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -BEGIN PGP SIGNATURE- Version: GnuPG v1 Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iEYEARECAAYFAlRbt38ACgkQNgfoSvWqwEjnUQCfSOAEbCisEiI5zfGS2roZ1sEL V0EAn28D4+yLzkzOcwfszYq5q3qOfy12 =mf19 -END PGP SIGNATURE- -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Failed on backup volume 2 suddenly
10-Nov 01:12 bacula-fd JobId 1105: Error: bsock.c:429 Write error sending 29424 bytes to Storage daemon:localhost:910 3: ERR=Connection reset by peer 10-Nov 01:12 bacula-fd JobId 1105: Fatal error: backup.c:1200 Network send error to SD. ERR=Connection reset by peer 10-Nov 01:45 bacula-dir JobId 1105: Fatal error: sql_create.c:860 Fill File table Query failed: INSERT INTO File (Fil eIndex, JobId, PathId, FilenameId, LStat, MD5, DeltaSeq) SELECT batch.FileIndex, batch.JobId, Path.PathId, Filename.F ilenameId,batch.LStat, batch.MD5, batch.DeltaSeq FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN Filename ON (b atch.Name = Filename.Name): ERR=ERROR: relation batch does not exist LINE 1: ...ameId,batch.LStat, batch.MD5, batch.DeltaSeq FROM batch JOIN... Mr. Keith: this is a database error. Probably related with batch insert feature. Was it upgraded before the problem starts to happen? Other causes to the similar problem: disk partition full on the database host; backup volumes loop inferno when PurgestOldestVolume is enabled. Regards, = Heitor Medrado de Faria Faltam poucos dias - Treinamento Telepresencial Bacula: http://www.bacula.com.br/?p=2174 61 2021-8260 | 8268-4220 Site: www.bacula.com.br | Facebook: heitor.faria | Gtalk: heitorfa...@gmail.com == -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Load slots timeout
Consider a admin job where the drive is cleaned. I'm very confused by the library needing to clean so often. -- Dan Langille http://langille.org/ On Nov 10, 2014, at 7:45 AM, Andrey Chebotarev a...@525.su wrote: Ok, may be there is another solution. Let's put everything in one place: I have very long jobs, which spend 30-40 cartridges per one. I have library which have to be configured with auto cleaning. During running job after several cartridges filled, say 10, library wants to clean tape and does it automatically. Cleaning takes more than 5 minutes. Meanwhile bacula is trying to load new cartridges and after 5 minutes fails. What is the best solution of my issue? I wanted to change the code by myself. I just wanted to know where is in code place where defined 5 minutes timeout. On Nov 10, 2014, at 3:33 AM, Andrey Chebotarev a...@525.su wrote: Hi. It's in devel because the question about editing sources, but not about configuration. And I think solve the question could only developer. The conclusion to change the code is premature. On Nov 4, 2014, at 6:55 AM, Andrey Chebotarev a...@525.su wrote: Hi guys. I use bacula 5.2.13 with IBM TS3200 library. Periodically I face problem with load slot time out. In logs it looks lilke: 22-Sep 00:35 baculasrv-dir JobId 10471: Recycled volume 220AAAL6 22-Sep 00:35 baculasrv-sd JobId 10471: 3304 Issuing autochanger load slot 1, drive 1 command. 22-Sep 00:40 baculasrv-sd JobId 10471: Fatal error: 3992 Bad autochanger load slot 1, drive 1: ERR=Child died from signal 15: Termination. Results=Program killed by Bacula (timeout) 22-Sep 00:32 sqcompose-fd JobId 10471: Fatal error: backup.c:1019 Network send error to SD. As I understood, bacula tries to load slot for 5 minutes and if it's not successful stops job. I started investigation why bacula sometimes doesn't manage to load slot in 5 minutes and find out library stops responding to commands and starts cleaning drive procedure which takes more than 5 minutes(Library was configured to clean drive automatically) So how can I solve the problem? I've found place in mtx-changer script where declared 300 seconds to wait. I've increased it value to 1800 seconds. Is it only place or I have to change somthing else in sources? Hi everybody. Increasing timeout in mtx-changer script hasn't helped, I have the same issue. Where in sources I can increase timeout to 30 minutes? I don’t see why this is on devel It should be on users, which is cc’d here. -- ___ Bacula-devel mailing list bacula-de...@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-devel -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] CentOS 6.6 SELINUX Problems BACULA 5.2.18 [Help]
Hey thanks for the reply, /First of all, you can try to relabel your filesystem in case you have some mislabeled file; as root do fixfiles onboot and reboot the system./ I tried relabel the file system already and that didn't fix it. /Second, you can delete all files in /var/log/audit/ and make the problem reappear, so you can debug the SELinux permission problems with audit2allow -a or by looking directly at a clean /var/log/audit/audit.log file./ OK thanks, I will try that and also do some reading on SELINUX. /Then, it's worth saying that /backup is not a path that is part of SELinux labels. It is not a problem by itself (it should work anyway) but my suggestion is to use /bacula/ as the path for your backups./ The /backup directory was created on my test server when i was just learning bacula (newbee mistake), I will try change it when I get around this SELINUX issue. Thanks Again On 11/09/2014 04:27 AM, Simone Caronni wrote: Hello, you should do some debugging on the SELinux side, this is not related to Bacula. It is too complicated to explain by mail, Redhat docs are very good in this regard. On Fri, 2014-11-07 at 13:06 -0500, Humphrey Bryant wrote: I check, recheck and double check all permissions on my volumes/files and directory and everything was OK but when i run the backup they still hang nonetheless. It was after I temporarily disabled SELINUX backup start working again, so I am of the conclusion that SELINUX is at fault here.. I need some help getting SELINUX to play nice with Bacula on CENTOS 6.6, can anyone here help me out please. any one can help me create a policy or something, I don’t want to upgrade my production server and have this same problem. First of all, you can try to relabel your filesystem in case you have some mislabeled file; as root do fixfiles onboot and reboot the system. Second, you can delete all files in /var/log/audit/ and make the problem reappear, so you can debug the SELinux permission problems with audit2allow -a or by looking directly at a clean /var/log/audit/audit.log file. Then, it's worth saying that /backup is not a path that is part of SELinux labels. It is not a problem by itself (it should work anyway) but my suggestion is to use /bacula/ as the path for your backups. # semanage fcontext -l | grep bacula /bacula(/.*)? all files system_u:object_r:bacula_store_t:s0 /etc/bacula.* all files system_u:object_r:bacula_etc_t:s0 /etc/rc\.d/init\.d/bacula.*regular file system_u:object_r:bacula_initrc_exec_t:s0 /usr/sbin/bacula.* regular file system_u:object_r:bacula_exec_t:s0 /usr/sbin/bat regular file system_u:object_r:bacula_admin_exec_t:s0 /usr/sbin/bconsole regular file system_u:object_r:bacula_admin_exec_t:s0 /var/lib/bacula.* all files system_u:object_r:bacula_var_lib_t:s0 /var/log/bacula.* all files system_u:object_r:bacula_log_t:s0 /var/run/bacula.* regular file system_u:object_r:bacula_var_run_t:s0 /var/spool/bacula.*all files system_u:object_r:bacula_spool_t:s0 /var/spool/bacula/log(/.*)?all files system_u:object_r:var_log_t:s0 Regards, --Simone -- Best Regards Humphrey Bryant Information System Admin Foga Daley Attorneys-at-Law 7 Stanton Terrace Kingston 6 Tel - (876) 927-4371-5 Fax - (876) 927-5081 This E-mail contains information which is confidential and privileged. Unless you are the addressee (or authorised to receive for the addressee), you may not use, copy or disclose to anyone the message or information contained in it. If you have received this e-mail in error, please destroy it and advise the sender. attachment: hbryant.vcf-- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] summarizing messages into a single mail
Hello, everyone. I was wondering, if there is a way to avoid receiving one email for each completed bacula job and instead receive a single mail with all messages. Also, if this is possible, would you recommend it or should I instead try something like Web-Bacula to do some reporting? I am currently receiving mails for 6 jobs per day. Rising to 8 soon. Regards, Florian S. -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] LTO-6 - tape cleaning frequency
How often does your LTO-6 tape drive need to be cleaned? I ask because a recent post mentioned every 10 tapes. With my limited tape knowledge, that seems rather high, but I have no LTO experience. — Dan Langille signature.asc Description: Message signed with OpenPGP using GPGMail -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Load slots timeout
On Nov 10, 2014, at 7:45 AM, Andrey Chebotarev a...@525.su wrote:
Ok, may be there is another solution.
Let's put everything in one place:
I have very long jobs, which spend 30-40 cartridges per one.
I have library which have to be configured with auto cleaning.
During running job after several cartridges filled, say 10, library wants to
clean tape and does it automatically. Cleaning takes more than 5 minutes.
Meanwhile bacula is trying to load new cartridges and after 5 minutes fails.
What is the best solution of my issue?
I’m sorry this took so long to get you any help.
The above information, and the logs you provided in another post, should have
been included with your initial post. Context is everything.
Given the evidence presented, everyone correctly concluded you were having
trouble with initial configuration. That was not the case.
I've modified and recompiled, waiting for result till next drive cleaning...
Probably that's it:
stored/stored_conf.c:
{maximumchangerwait,store_time, ITEM(res_dev.max_changer_wait),
0, ITEM_DEFAULT, 5 * 60},
If this helps, I think it should/could become a configurable item, available in
bacula-dir.conf.
I also wonder what other installations do for cleaning in similar circumstances.
—
Dan Langille
signature.asc
Description: Message signed with OpenPGP using GPGMail
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO-6 - tape cleaning frequency
On Nov 10, 2014, at 10:15 AM, Dan Langille d...@langille.org wrote: How often does your LTO-6 tape drive need to be cleaned? I ask because a recent post mentioned every 10 tapes. With my limited tape knowledge, that seems rather high, but I have no LTO experience. That frequency is incorrect. I misread the post, but I’d still like to hear how people deal with cleaning needs which arise *during* a job. — Dan Langille signature.asc Description: Message signed with OpenPGP using GPGMail -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] summarizing messages into a single mail
On Nov 10, 2014, at 10:00 AM, Florian florian.spl...@web.de wrote: Hello, everyone. I was wondering, if there is a way to avoid receiving one email for each completed bacula job and instead receive a single mail with all messages. Also, if this is possible, would you recommend it or should I instead try something like Web-Bacula to do some reporting? I am currently receiving mails for 6 jobs per day. Rising to 8 soon. Only 6? ;) What I do is use mail filtering to move all successful jobs to a folder. All other jobs reach my inbox. If you are concerned with knowing ‘did all my jobs run today’, consider a Nagios (or similar) check. — Dan Langille signature.asc Description: Message signed with OpenPGP using GPGMail -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO-6 - tape cleaning frequency
How often does your LTO-6 tape drive need to be cleaned? I ask because a recent post mentioned every 10 tapes. With my limited tape knowledge, that seems rather high, but I have no LTO experience. That seems excessive to me although I am still using a dual drive LTO2 autoloader. For that I run a cleaning cycle 2 times per year for each of the HP LTO2 tape drives. John -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Failed on backup volume 2 suddenly
Hi Heitor, Thanks for your kind reply! No upgrade had done in those few months for Bacula. If DB got error, just query why volume 1 has no problem but always stuck at volume 2? Is it able to check/repair the DB comes with bacula? Or shall I check postgresql manual? I ran the job again after replaced another USB docking and HDD to see whether it would be the issue related. DB: postgresql-8.4.9-1.fc14.x86_64 Catalog size: 4.6TB [root@baculab]# echo list jobs|bconsole|grep MTHLY | 828 | COMMTHLY1 | 2014-05-15 11:41:40 | B | F | 12,041,875 | 3,186,454,529,352 | T | | 833 | COMMTHLY2 | 2014-05-18 10:13:00 | B | F | 1,709,675 | 6,256,974,076,676 | T | | 928 | COMMTHLY2 | 2014-07-08 09:56:23 | B | F | 1,743,758 | 6,575,280,360,690 | T | | 964 | COMMTHLY1 | 2014-08-03 08:00:05 | B | F | 12,286,436 | 3,598,328,180,140 | T | | 965 | COMMTHLY2 | 2014-08-05 12:22:48 | B | F | 1,673,471 | 6,415,007,319,252 | T | | 1,098 | COMMTHLY1 | 2014-11-02 22:09:18 | B | F | 0 | 0 | A | | 1,099 | COMMTHLY2 | 2014-11-05 11:25:33 | B | F | 0 | 0 | A | | 1,113 | COMMTHLY1 | 2014-11-10 09:55:34 | B | F | 0 | 0 | R | Thanks and best regards,Keith On Monday, November 10, 2014 8:44 PM, hei...@bacula.com.br hei...@bacula.com.br wrote: 10-Nov 01:12 bacula-fd JobId 1105: Error: bsock.c:429 Write error sending 29424 bytes to Storage daemon:localhost:910 3: ERR=Connection reset by peer 10-Nov 01:12 bacula-fd JobId 1105: Fatal error: backup.c:1200 Network send error to SD. ERR=Connection reset by peer 10-Nov 01:45 bacula-dir JobId 1105: Fatal error: sql_create.c:860 Fill File table Query failed: INSERT INTO File (Fil eIndex, JobId, PathId, FilenameId, LStat, MD5, DeltaSeq) SELECT batch.FileIndex, batch.JobId, Path.PathId, Filename.F ilenameId,batch.LStat, batch.MD5, batch.DeltaSeq FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN Filename ON (b atch.Name = Filename.Name): ERR=ERROR: relation batch does not exist LINE 1: ...ameId,batch.LStat, batch.MD5, batch.DeltaSeq FROM batch JOIN... Mr. Keith: this is a database error. Probably related with batch insert feature. Was it upgraded before the problem starts to happen?Other causes to the similar problem: disk partition full on the database host; backup volumes loop inferno when PurgestOldestVolume is enabled. Regards,= Heitor Medrado de Faria Faltam poucos dias - Treinamento Telepresencial Bacula: http://www.bacula.com.br/?p=2174 61 2021-8260 | 8268-4220 Site: www.bacula.com.br | Facebook: heitor.faria | Gtalk: heitorfa...@gmail.com == -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] summarizing messages into a single mail
There are a number of scripts available which can be run via cron to give you stats on your backup jobs. Check your Bacula source directory/examples/reports In here I found report.pl from Jonas Björkland which I modified to give me specific information I was looking for, but it's an excellent starting point for a summary notifier. -John On Mon, Nov 10, 2014 at 10:00 AM, Florian florian.spl...@web.de wrote: Hello, everyone. I was wondering, if there is a way to avoid receiving one email for each completed bacula job and instead receive a single mail with all messages. Also, if this is possible, would you recommend it or should I instead try something like Web-Bacula to do some reporting? I am currently receiving mails for 6 jobs per day. Rising to 8 soon. Regards, Florian S. -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- --- John M. Lockard | U of Michigan - School of Information Unix Sys Admin | 105 South State St. | 4325 North Quad jlock...@umich.edu |Ann Arbor, MI 48109-1285 www.umich.edu/~jlockard http://www.umich.edu/%7Ejlockard | 734-936-7255 | 734-764-2475 FAX --- - The University of Michigan will never ask you for your password - -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] summarizing messages into a single mail
Aw, heck. Might as well attach what I've been using. Again, it's modified from what you'll find in the examples/reports directory. Usage amounts will be different from what is reported by Bacula on the console or on-system logs as Bacula reports 1000=1K and my report uses 1024=1K (easily modified in the script). I'm sure what I've done could probably be done more cleanly/efficiently/correctly... you're free to make those changes as you wish. -John On Mon, Nov 10, 2014 at 10:35 AM, John Lockard jlock...@umich.edu wrote: There are a number of scripts available which can be run via cron to give you stats on your backup jobs. Check your Bacula source directory/examples/reports In here I found report.pl from Jonas Björkland which I modified to give me specific information I was looking for, but it's an excellent starting point for a summary notifier. -John On Mon, Nov 10, 2014 at 10:00 AM, Florian florian.spl...@web.de wrote: Hello, everyone. I was wondering, if there is a way to avoid receiving one email for each completed bacula job and instead receive a single mail with all messages. Also, if this is possible, would you recommend it or should I instead try something like Web-Bacula to do some reporting? I am currently receiving mails for 6 jobs per day. Rising to 8 soon. Regards, Florian S. -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- --- John M. Lockard | U of Michigan - School of Information Unix Sys Admin | 105 South State St. | 4325 North Quad jlock...@umich.edu |Ann Arbor, MI 48109-1285 www.umich.edu/~jlockard http://www.umich.edu/%7Ejlockard | 734-936-7255 | 734-764-2475 FAX --- - The University of Michigan will never ask you for your password - -- --- John M. Lockard | U of Michigan - School of Information Unix Sys Admin | 105 South State St. | 4325 North Quad jlock...@umich.edu |Ann Arbor, MI 48109-1285 www.umich.edu/~jlockard http://www.umich.edu/%7Ejlockard | 734-936-7255 | 734-764-2475 FAX --- - The University of Michigan will never ask you for your password - bacula-report.pl Description: Perl program -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Load slots timeout
There is no need to modify the code.
Just modify the bacula-sd.conf file. It is much easier.
Best regards,
Kern
On 11/10/2014 04:14 PM, Andrey Chebotarev wrote:
I've modified and recompiled, waiting
for result till next drive cleaning...
Probably that's it:
stored/stored_conf.c:
{"maximumchangerwait", store_time,
ITEM(res_dev.max_changer_wait), 0, ITEM_DEFAULT, 5 * 60},
Here example what's going on.
Job logs:
31-Oct 12:35 baculasrv-dir JobId 10967: Start Backup JobId 10967, Job=StorwizeBSRVData2BJob1.2014-10-31_12.35.06_34
31-Oct 12:35 baculasrv-dir JobId 10967: Recycled volume "346AAJL6"
31-Oct 12:35 baculasrv-dir JobId 10967: Using Device "IBM_TS3200_2_drive1" to write.
31-Oct 12:35 baculasrv-sd JobId 10967: 3307 Issuing autochanger "unload slot 46, drive 1" command.
31-Oct 12:36 baculasrv-sd JobId 10967: 3304 Issuing autochanger "load slot 12, drive 1" command.
31-Oct 12:36 baculasrv-sd JobId 10967: 3305 Autochanger "load slot 12, drive 1", status is OK.
31-Oct 12:36 baculasrv-sd JobId 10967: Recycled volume "346AAJL6" on device "IBM_TS3200_2_drive1" (/dev/nst0), all previous data lost.
31-Oct 12:36 baculasrv-dir JobId 10967: Max Volume jobs=1 exceeded. Marking Volume "346AAJL6" as Used.
31-Oct 23:25 baculasrv-sd JobId 10967: End of Volume "346AAJL6" at 2555:8545 on device "IBM_TS3200_2_drive1" (/dev/nst0). Write of 64512 bytes got -1.
31-Oct 23:25 baculasrv-sd JobId 10967: Re-read of last block succeeded.
31-Oct 23:25 baculasrv-sd JobId 10967: End of medium on Volume "346AAJL6" Bytes=2,555,387,735,040 Blocks=39,611,044 at 31-Oct-2014 23:25.
31-Oct 23:25 baculasrv-sd JobId 10967: 3307 Issuing autochanger "unload slot 12, drive 1" command.
31-Oct 23:28 baculasrv-dir JobId 10967: Recycled volume "349AAJL6"
31-Oct 23:28 baculasrv-sd JobId 10967: 3304 Issuing autochanger "load slot 34, drive 1" command.
31-Oct 23:28 baculasrv-sd JobId 10967: 3305 Autochanger "load slot 34, drive 1", status is OK.
31-Oct 23:28 baculasrv-sd JobId 10967: Recycled volume "349AAJL6" on device "IBM_TS3200_2_drive1" (/dev/nst0), all previous data lost.
31-Oct 23:28 baculasrv-dir JobId 10967: Max Volume jobs=1 exceeded. Marking Volume "349AAJL6" as Used.
31-Oct 23:28 baculasrv-sd JobId 10967: New volume "349AAJL6" mounted on device "IBM_TS3200_2_drive1" (/dev/nst0) at 31-Oct-2014 23:28.
01-Nov 10:25 baculasrv-sd JobId 10967: End of Volume "349AAJL6" at 2541:9287 on device "IBM_TS3200_2_drive1" (/dev/nst0). Write of 64512 bytes got -1.
01-Nov 10:25 baculasrv-sd JobId 10967: Re-read of last block succeeded.
01-Nov 10:25 baculasrv-sd JobId 10967: End of medium on Volume "349AAJL6" Bytes=2,541,436,498,944 Blocks=39,394,786 at 01-Nov-2014 10:25.
01-Nov 10:25 baculasrv-sd JobId 10967: 3307 Issuing autochanger "unload slot 34, drive 1" command.
01-Nov 10:27 baculasrv-dir JobId 10967: Recycled volume "225AAAL6"
01-Nov 10:27 baculasrv-sd JobId 10967: 3304 Issuing autochanger "load slot 3, drive 1" command.
01-Nov 10:28 baculasrv-sd JobId 10967: 3305 Autochanger "load slot 3, drive 1", status is OK.
01-Nov 10:28 baculasrv-sd JobId 10967: Recycled volume "225AAAL6" on device "IBM_TS3200_2_drive1" (/dev/nst0), all previous data lost.
01-Nov 10:28 baculasrv-dir JobId 10967: Max Volume jobs=1 exceeded. Marking Volume "225AAAL6" as Used.
01-Nov 10:28 baculasrv-sd JobId 10967: New volume "225AAAL6" mounted on device "IBM_TS3200_2_drive1" (/dev/nst0) at 01-Nov-2014 10:28.
01-Nov 23:20 baculasrv-sd JobId 10967: End of Volume "225AAAL6" at 2652:7176 on device "IBM_TS3200_2_drive1" (/dev/nst0). Write of 64512 bytes got -1.
01-Nov 23:20 baculasrv-sd JobId 10967: Re-read of last block succeeded.
01-Nov 23:20 baculasrv-sd JobId 10967: End of medium on Volume "225AAAL6" Bytes=2,652,293,210,112 Blocks=41,113,175 at 01-Nov-2014 23:20.
01-Nov 23:20 baculasrv-sd JobId 10967: 3307 Issuing autochanger "unload slot 3, drive 1" command.
01-Nov 23:22 baculasrv-dir JobId 10967: Recycled volume "345AAJL6"
01-Nov 23:22 baculasrv-sd JobId 10967: 3304 Issuing autochanger "load slot 11, drive 1" command.
01-Nov 23:23 baculasrv-sd JobId 10967: 3305 Autochanger "load slot 11, drive 1", status is OK.
01-Nov 23:23 baculasrv-sd JobId 10967: Recycled volume "345AAJL6" on device "IBM_TS3200_2_drive1" (/dev/nst0), all previous data lost.
01-Nov 23:23 baculasrv-dir JobId 10967: Max Volume jobs=1 exceeded. Marking Volume "345AAJL6" as Used.
01-Nov 23:23 baculasrv-sd JobId 10967: New volume "345AAJL6" mounted on device "IBM_TS3200_2_drive1" (/dev/nst0) at 01-Nov-2014 23:23.
02-Nov 10:21 baculasrv-sd JobId 10967: End of Volume "345AAJL6" at 2554:12632 on device "IBM_TS3200_2_drive1" (/dev/nst0). Write of 64512 bytes got -1.
02-Nov 10:22 baculasrv-sd JobId 10967: Re-read of last block succeeded.
02-Nov
Re: [Bacula-users] [Bacula-devel] Load slots timeout
On Nov 10, 2014, at 11:22 AM, Kern Sibbald k...@sibbald.com wrote: There is no need to modify the code. Just modify the bacula-sd.conf file. It is much easier. Best regards, Kern I think Kern refers to here: http://www.bacula.org/5.0.x-manuals/en/main/main/Storage_Daemon_Configuratio.html http://www.bacula.org/5.0.x-manuals/en/main/main/Storage_Daemon_Configuratio.html Maximum Changer Wait = time This directive specifies the maximum time in seconds for Bacula to wait for an autochanger to change the volume. If this time is exceeded, Bacula will invalidate the Volume slot number stored in the catalog and try again. If no additional changer volumes exist, Bacula will ask the operator to intervene. The default is 5 minutes. There are several ‘wait’ / ‘time’ options listed there. — Dan Langille signature.asc Description: Message signed with OpenPGP using GPGMail -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO-6 - tape cleaning frequency
On 2014-11-10 07:32 AM, John Drescher wrote: How often does your LTO-6 tape drive need to be cleaned? I ask because a recent post mentioned every 10 tapes. With my limited tape knowledge, that seems rather high, but I have no LTO experience. That seems excessive to me although I am still using a dual drive LTO2 autoloader. For that I run a cleaning cycle 2 times per year for each of the HP LTO2 tape drives. John I have an IBM LTO-3 autoloader here. I just have a cleaning cartridge in the reserved slot in the library and I let it take care of itself rather than trying to do it on any sort of schedule. It loads the cleaning cartridge a couple of times a year. I bought this library used - when I first started using it I had to run cleanings every few weeks but they tapered off quite significantly after it had been in use for a while. The research I've done in the past on LTO technology has implied that you should never need to trigger a cleaning cycle on your own - the drive will let you know if it needs it. Cleaning tapes should only be used when the drive requests one. Our bigger library we had in the office ran for years without ever requesting a cleaning. It's worth mentioning that different manufacturers have different cleaning programs in their drives. For instance my IBM drive runs a much shorter cleaning cycle and has about 3-4x more cycles 'allowed' on a cleaning tape versus my HP drive I was using before it. My experience with my limited sample size of a half dozen LTO drives would seem to indicate that the IBM drive requests cleaning more often too. Also worth mentioning - the way your drive is used will have a significant impact on how many cleaning cycles it needs. If you aren't flowing data fast enough to it to keep it streaming at full speed it will build up a lot of cruft on the heads much faster. Bacula can help with this greatly by spooling data before writing, in particular with incremental backups that have many small files scattered all over the disk. Bryn -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuration reload for bacula-sd
In the message dated: Mon, 10 Nov 2014 09:31:41 -0300, The pithy ruminations from =?UTF-8?Q?Ana_Em=C3=ADlia_M=2E_Arruda?= on Re: [Bacula-users] Configuration reload for bacula-sd were: = -- = Kern, = = In spite of Bacula do not need different Media Types when using different = LTO generations in tape libraries, I really think that it could be a best = practice for working with LTO tapes to have the LTO tape generation = specified in storage device definition. Just because of compatibility It would be great if Bacula was enhanced to add more intelligence to the definition of storage devices, including specifying a list of media types that the storage device can use 'read+write' or use 'read-only'. = have an LTO-3 drive working with LTO-3 catridges and you upgrade your = hardware to an LTO-5 drive that will not write to your LTO-3 catridges That's close to our situation, as we have gone from LTO2 - LTO3 - LTO4. = because of compatibility. If you just specify Media Type = LTO, Bacula Even more confusing, when we began using Bacula, we had just LTO2 drives media, so all the initial media was labled LTO2. When we upgraded to LTO3, we had the choice of correctly labling the new media as LTO3 and then losing access to all our LTO2 media since Bacula cannot deal with multiple media types in a single SD, or deliberately incorrectly labling our LTO3 media as LTO2, or using multiple SD definitions for the same physical tape drives. We chose to label all our media (LTO2, LTO3, and LTO4) as LTO2 within Bacula. We use printed barcode labels to name each piece of media, and are using a convention where the first non-zero digit in the name is the LTO type. For example, tape 004079 is an LTO4 tape, while 003134 is LTO3 media. This makes it easy for human beings to distinguish the actual media types. = will try to read and write to all the LTO-3 and LTO-5 catridges and this = will no work. Is there another way of distinguishing different LTO catridge = generations? Normally I have been using this way: having two storage device Our solution has been to to label all media as LTO2, but to set the actual LTO2 tapes as read-only within Bacula. = definitions for the same drive, each one working with an LTO catridge = generation. I dislike that idea, as it will cause problems with backups. For example, if a backup job begins with LTO3 media, loaded into a drive under the LTO3 definition for that SD, and the remaining available cartridges in the tape changer are LTO4 media, then the backup will wait on operator intervention until an LTO3 tape is supplied, rather than using one of the LTO4 tapes. = = Best regards, = Ana = -- Mark Bergman voice: 215-662-7310 mark.berg...@uphs.upenn.edu fax: 215-614-0266 http://www.cbica.upenn.edu/ IT Technical Director, Center for Biomedical Image Computing and Analytics Department of Radiology University of Pennsylvania PGP Key: http://www.cbica.upenn.edu/sbia/bergman -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] summarizing messages into a single mail
On 11/10/2014 10:00 AM, Florian wrote: Hello, everyone. I was wondering, if there is a way to avoid receiving one email for each completed bacula job and instead receive a single mail with all messages. Also, if this is possible, would you recommend it or should I instead try something like Web-Bacula to do some reporting? I am currently receiving mails for 6 jobs per day. Rising to 8 soon. Regards, Florian S. Hi Florian! heh Like Dan said only 6? Some of the sites we manage get 20+ emails/night. :) We get 19/night here. There are many options to choose from: 1. John mentioned a perl script to email you a summary 2. I wrote a Bacula summary email script which I shared here a while back: http://revpol.com/baculasummaryemails That emails a short, basic report - and of course can be modded to provide any additional info you might want/need. 3. Monitor Bacula's status with Nagios or other monitoring system. We use Xymon here, and I wrote a custom Bacula test for it here: http://revpol.com/node/126 4. Filter emails to separate folders. (boring) hehe 5. Send all Bacula-related emails into a helpdesk system and have the system automate your workflow. We use Cerberus here (cerberusweb.com) and all OK backup jobs get filtered into the good backups folder, and closed, while BAD jobs, or Bacula daemon messages are put into the problems folder and workers are notified via emails. In addition, our helpdesk has widgets (we use gauges) that we can quickly look at to get a visual indication that all backups have run at all client sites (see attached image - we have a whole page of these widgets :) ** apologies if this turned into a Cerberus ad, didn't mean for it to ** 6. Instead of the mail script using bsmtp to email the job, write a script that appends the job's log to a file, then email that one file each night and then delete it. (this might get ugly though having to scroll through all the volume changes etc to get to each Summary.) Other options is to have your script pull out only the summaries from the file and send one email with just summaries. Hope some of these options help, Florian! Bill -- Bill Arlofski Reverse Polarity, LLC http://www.revpol.com/ -- Not responsible for anything below this line -- -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO-6 - tape cleaning frequency
On Nov 10, 2014, at 10:15 AM, Dan Langille d...@langille.org wrote: How often does your LTO-6 tape drive need to be cleaned? Hi, I bought five cleaning tapes ten years ago. Four are on sale :o) HP LTO-3: Almost never, 7 years of operation HP LTO-5: Almost never, 2 years of operation 650 mounts, roughly 1 petabyte written 2 uses of cleaning tape, however I would bet that both were just my experiments with reading of cartridge memory Simply buy library, reserve one slot for cleaning tape, insert cleaning tape into and sing I don't care! I love it! I don't care! :o) You can look into /usr/src/sys/cam/scsi/scsi_sa.c. The timeouts are in minutes. Even IO has default timeout 4 minutes. Maybe the reason is possible cleaning? If you are really interested, please read http://www.tarconis.com/documentos/LTO_Cleaning_wp.pdf It is rather old, but many things still have to be true. It is from HP and it is possible that IBM is different. But I did not find similar document from IBM. The most important facts from the document above are: 1) The tape is flying over the head during the operation and the only contact is just when tape starts or stops. So yes, correct streaming is very important. Tape drive has to write data without repositions. 2) There is internal non-abrasive brush, which is usually sufficient. (From 150 km and LTO-1, I think that it may be preventively used after roughly 5 fully written tapes, but it is just my unconfirmed estimate.) 3) The cleaning tape is used practically only as a last resort and could not replace the brush - it is for another type of dirt. And it is abrasive, so if there is no reason to use cleaning tape, do not do it. Your head will be happier. Regards. -- Rudolf Cejka cejkar at fit.vutbr.cz http://www.fit.vutbr.cz/~cejkar Brno University of Technology, Faculty of Information Technology Bozetechova 2, 612 66 Brno, Czech Republic -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://pubads.g.doubleclick.net/gampad/clk?id=154624111iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
