[Bacula-users] Problem with Volumes
Hi,
I would like to use a new volume every day..
I use this configuration:
Pool {
Name = P-daily
Pool Type = Backup
AutoPrune = yes
VolumeRetention = 6d
Maximum Volumes = 5
Recycle = yes
Purge Oldest Volume = yes
Recycle Oldest Volume = yes
Volume Use Duration = 23h
}
But the volume new is in use from 7 days!!
What is wrong?
*** Bacula 5.0.2 ***
Thank's
CIAO
---
Carlo Filippetto
--
The Palm PDK Hot Apps Program offers developers who use the
Plug-In Development Kit to bring their C/C++ apps to Palm for a share
of $1 Million in cash or HP Products. Visit us here for more details:
http://p.sf.net/sfu/dev2dev-palm___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula + Postgres : copy batch problem
I'm fairly desperate for some advice on this issue. I have 3.4GB free in /var where Postgresql is located. At the end of a large backup job (7,643,966 files taking up 7.265TB of space) Postgres bails out copying a batch file into the File table due to a mysterious no space left on device error. Questions: 1. How should I size my postgresql partition? 2. Can I stop this needless after-backup insertion? I tried setting Spool Attributes to NO but it did not work 3. Why is Bacula using a batch file at all? Why not simply do a straight insert? I'm keen to get this 7TB backup out, but I have to reconfigure Bacula to suit. Help much appreciated! Rory On 02/08/10, Rory Campbell-Lange (r...@campbell-lange.net) wrote: I turned off spooling and set the Spool Attributes directive to no and reran the backup. The backup job completes but the database insert bails out. clwbackup-dir JobId 8: Fatal error: sql_create.c:894 Fill File table Query failed: INSERT INTO File (FileIndex, JobId, PathId, FilenameId, LStat, MD5)SELECT batch.FileIndex, bat ch.JobId, Path.PathId, Filename.FilenameId,batch.LStat, batch.MD5 FROM batch JOIN Path ON (batc h.Path = Path.Path) JOIN Filename ON (batch.Name = Filename.Name): ERR=ERROR: could not write to hash-join temporary file: No space left on device I don't understand why bacula isn't writing to the database continuously. Why is a batch file needed? -- Rory Campbell-Lange r...@campbell-lange.net -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Problem starting bconsole
Hello Have installed Bacula 5.0.0.1 (with MySQL) on a FreeBSD 8.0 platform. When I try to start bconsole i get the following message: Connecting to Director localhost:9101 Director authorization problem. Most likely the passwords do not agree. If you are using TLS, there may have been a certificate validation error during the TLS handshake. Please see http://www.bacula.org/en/rel-manual/Bacula_Freque_Asked_Questi.html#SECTION00376for help. I have checked that MySQL is running: mysql680 0.0 0.0 3624 1544 v0- I10:06AM 0:00.00 /bin/sh /usr/local/bin/mysqld_safe --defaults-extra-file=/var/db/mysql/my.cnf --user=mys mysql760 0.0 1.1 192480 41020 v0- I10:06AM 0:00.56 [mysqld] Also checked if Bacula are running: bacula 804 0.0 0.1 9996 4560 ?? Ss 10:06AM 0:00.01 /usr/local/sbin/bacula-sd -u bacula -g bacula -v -c /usr/local/etc/bacula-sd.conf root 809 0.0 0.1 8896 4252 ?? Ss 10:06AM 0:00.01 /usr/local/sbin/bacula-fd -u root -g wheel -v -c /usr/local/etc/bacula-fd.conf bacula 813 0.0 0.2 11428 5692 ?? Is 10:06AM 0:00.01 /usr/local/sbin/bacula-dir -u bacula -g bacula -v -c /usr/local/etc/bacula-dir.conf Cant seem to find anything useful on the subject on google either. Anybody have any idea on how to fix it? Best regards Albin -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Spooling
I wonder... does the despooling level reduce on a consistent basis all through the two week period? Or does it suddenly drop. This sounds like it calls for a pretty graph... ;) As luck would have it: I have a pretty graph. It suddenly drops. AB -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula + Postgres : copy batch problem
On Tue, 3 Aug 2010 10:15:18 +0100, Rory Campbell-Lange said: I'm fairly desperate for some advice on this issue. I have 3.4GB free in /var where Postgresql is located. At the end of a large backup job (7,643,966 files taking up 7.265TB of space) Postgres bails out copying a batch file into the File table due to a mysterious no space left on device error. Questions: 1. How should I size my postgresql partition? I expect 7.6 million records to need at least 800MB when inserted and the batch tables will need a similar amount during the backup. It is difficult to predict what the hash-join temporary file will need because it depends on the internals of PostgreSQL. Firstly though I suggest running df frequently during the backup to verify that the problem really is /var filling up. 2. Can I stop this needless after-backup insertion? I tried setting Spool Attributes to NO but it did not work You need to rebuild Bacula with the --disable-batch-insert option, but it might run quite slowly. Setting synchronous_commit = off in postgresql.conf might help to make it faster. 3. Why is Bacula using a batch file at all? Why not simply do a straight insert? Because 7,643,966 inserts would be much slower. __Martin I'm keen to get this 7TB backup out, but I have to reconfigure Bacula to suit. Help much appreciated! Rory On 02/08/10, Rory Campbell-Lange (r...@campbell-lange.net) wrote: I turned off spooling and set the Spool Attributes directive to no and reran the backup. The backup job completes but the database insert bails out. clwbackup-dir JobId 8: Fatal error: sql_create.c:894 Fill File table Query failed: INSERT INTO File (FileIndex, JobId, PathId, FilenameId, LStat, MD5)SELECT batch.FileIndex, bat ch.JobId, Path.PathId, Filename.FilenameId,batch.LStat, batch.MD5 FROM batch JOIN Path ON (batc h.Path = Path.Path) JOIN Filename ON (batch.Name = Filename.Name): ERR=ERROR: could not write to hash-join temporary file: No space left on device I don't understand why bacula isn't writing to the database continuously. Why is a batch file needed? -- Rory Campbell-Lange r...@campbell-lange.net -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Two directors?
2010/7/28 Simone Martina smart...@noc.skylogicnet.com Hi at all, Hi, at the end of this year probably I will have to solve a trouble: my boss would like to have an adjunctive bacula director (and sd, tape-reader and so on) due to respect redundancy asset policy. Now, my Bacula If you need bacula director redundancy then you have to setup a HA cluster. You can put bacula director and database as a cluster resources. You shouldn't run two directors on one db it isn't safe. regards -- Radosław Korzeniewski rados...@korzeniewski.net -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula + Postgres : copy batch problem
Thanks very much for your response, Martin. On 03/08/10, Martin Simmons (mar...@lispworks.com) wrote: On Tue, 3 Aug 2010 10:15:18 +0100, Rory Campbell-Lange said: I have 3.4GB free in /var where Postgresql is located. At the end of a large backup job (7,643,966 files taking up 7.265TB of space) Postgres bails out copying a batch file into the File table due to a mysterious no space left on device error. Questions: 1. How should I size my postgresql partition? I expect 7.6 million records to need at least 800MB when inserted and the batch tables will need a similar amount during the backup. It is difficult to predict what the hash-join temporary file will need because it depends on the internals of PostgreSQL. Firstly though I suggest running df frequently during the backup to verify that the problem really is /var filling up. My server logs over the backup period still show over 2GB free in /var (where postgresql is held) and 8GB in /tmp. Thanks however for the rule of thumb sizes for the records. 2. Can I stop this needless after-backup insertion? I tried setting Spool Attributes to NO but it did not work You need to rebuild Bacula with the --disable-batch-insert option, but it might run quite slowly. Setting synchronous_commit = off in postgresql.conf might help to make it faster. Thanks about the note about the --disable-batch-insert compile time option. Changing the synchronous_commit flag to off will speed up inserts into the database which will is great, but it won't affect the size of the batch file. Please clarify why you are suggesting this. 3. Why is Bacula using a batch file at all? Why not simply do a straight insert? Because 7,643,966 inserts would be much slower. Really? I've logged Bacula's performance on the server and the inserts run at around 0.35 ms and updates at around 0.5 ms. 8 million inserts at 0.35ms will take about 46 minutes. But it would be quite possible for Bacula to do this asynchronously while it does the job of writing data from disk to tape, which in this case takes several days. Perhaps this is something the developers could consider? In the mean time I will move Postgres to a 10G dedicated XFS partition and try again. -- Rory Campbell-Lange r...@campbell-lange.net -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula + Postgres : copy batch problem
On Tue, 3 Aug 2010 13:17:25 +0100, Rory Campbell-Lange said: Thanks very much for your response, Martin. On 03/08/10, Martin Simmons (mar...@lispworks.com) wrote: On Tue, 3 Aug 2010 10:15:18 +0100, Rory Campbell-Lange said: I have 3.4GB free in /var where Postgresql is located. At the end of a large backup job (7,643,966 files taking up 7.265TB of space) Postgres bails out copying a batch file into the File table due to a mysterious no space left on device error. Questions: 1. How should I size my postgresql partition? I expect 7.6 million records to need at least 800MB when inserted and the batch tables will need a similar amount during the backup. It is difficult to predict what the hash-join temporary file will need because it depends on the internals of PostgreSQL. Firstly though I suggest running df frequently during the backup to verify that the problem really is /var filling up. My server logs over the backup period still show over 2GB free in /var (where postgresql is held) and 8GB in /tmp. Thanks however for the rule of thumb sizes for the records. It isn't clear to me if your logs cover the minutes and seconds up to the point of failure. After the failure, the temporary table/file will have been deleted so the free space will appear to be fine again. 2. Can I stop this needless after-backup insertion? I tried setting Spool Attributes to NO but it did not work You need to rebuild Bacula with the --disable-batch-insert option, but it might run quite slowly. Setting synchronous_commit = off in postgresql.conf might help to make it faster. Thanks about the note about the --disable-batch-insert compile time option. Changing the synchronous_commit flag to off will speed up inserts into the database which will is great, but it won't affect the size of the batch file. Please clarify why you are suggesting this. Sorry, I wasn't clear. I was only suggesting that you change synchronous_commit if you use --disable-batch-insert. 3. Why is Bacula using a batch file at all? Why not simply do a straight insert? Because 7,643,966 inserts would be much slower. Really? I've logged Bacula's performance on the server and the inserts run at around 0.35 ms and updates at around 0.5 ms. 8 million inserts at 0.35ms will take about 46 minutes. The batch insert code made a noticable difference for me. It takes 2 to 3 minutes to process 950,000 file records, but I don't have the figures for the non-batch insert now. Process here is the whole operation, not just inserting into the File table (it has to query and update Filename and Path too). But it would be quite possible for Bacula to do this asynchronously while it does the job of writing data from disk to tape, which in this case takes several days. That's true. Moreover, your average file size is quite large, so the per file time to insert the records may not be so important anyway. Perhaps this is something the developers could consider? You can do that already by compiling with --disable-batch-insert and setting Spool Attributes to NO. __Martin -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Two directors?
2010/8/3 Radosław Korzeniewski rados...@korzeniewski.net 2010/7/28 Simone Martina smart...@noc.skylogicnet.com Hi at all, Hi, at the end of this year probably I will have to solve a trouble: my boss would like to have an adjunctive bacula director (and sd, tape-reader and so on) due to respect redundancy asset policy. Now, my Bacula If you need bacula director redundancy then you have to setup a HA cluster. You can put bacula director and database as a cluster resources. You shouldn't run two directors on one db it isn't safe. Hi, You could also setup 2 independant directors with their own catalog and sd. We have been using this configuration for years, so that each fd does its backup twice. The challenge here is to keep configuration up to date on both directors and manage the Before job scripts. In our case, we have stopped running scripts from bacula and started only one dump per server via crontab Regards, Mikael -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem with Volumes
On Tue, Aug 3, 2010 at 9:55 AM, Carlo Filippetto carlo.filippe...@gmail.com wrote: Here it is *list media pool=P-daily Automatically selected Catalog: MyCatalog Using Catalog MyCatalog +-+--+---+-++--+--+-+--+---+---+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-+--+---+-++--+--+-+--+---+---+-+ | 237 | V-daily-0001 | Recycle | 1 | 21,978,673,815 | 5 | 518,400 | 1 | 0 | 0 | File | 2010-07-23 21:14:14 | | 238 | V-daily-0002 | Append | 1 | 52,987,139,269 | 12 | 518,400 | 1 | 0 | 0 | File | 2010-08-02 21:41:19 | | 239 | V-daily-0003 | Append | 1 | 0 | 0 | 518,400 | 1 | 2 | 0 | File | -00-00 00:00:00 | | 240 | V-daily-0004 | Append | 1 | 0 | 0 | 518,400 | 1 | 3 | 0 | File | -00-00 00:00:00 | | 241 | V-daily-0005 | Append | 1 | 0 | 0 | 518,400 | 1 | 4 | 0 | File | -00-00 00:00:00 | +-+--+---+-++--+--+-+--+---+---+-+ Your volumes show a 6 day retention. However you have only used 2 volumes so there is not much I can tell you at this point. John -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Display of device content in BAT
Hi list, A little thing that I've noticed with the current bat (5.0.2)... when I query the device status of my Tandberg 24-slot changer with one LTO-4 tape drive, I'm getting this information: Device LTO-4-1 (/dev/nst1) is mounted with: Volume: A00013 Pool:TapeCopyPool Media type: LTO-4 Slot 13 is loaded in drive 0. Total Bytes=482,731,940,864 Blocks=1,841,493 Bytes/block=262,141 Positioned at File=109 Block=5,238 Well, but when in bat, and double-click on the changer device, I don't get the status of the tape drive displayed, so one can not determine with the bat, in what state the tape is. Here's a screenshot of what I mean: http://tinyurl.com/35qxuse Does someone have an idea about what I've possibly configured wrong? The director consists of on Storage entry named T24-Changer, which refers to the autochanger device in the storage-daemon. The storage-daemon has one autochanger device and one tape device named LTO-4-1. Le deagh dhùraghd, Frank Altpeter -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bizarre wait state 6
fileserv ~ # bconsole Connecting to Director fileserver:9101 1000 OK: fileserver-dir Version: 5.0.2 (28 April 2010) Enter a period to cancel a command. *st Status available for: 1: Director 2: Storage 3: Client 4: All Select daemon type for status (1-4): 1 fileserver-dir Version: 5.0.2 (28 April 2010) x86_64-pc-linux-gnu gentoo Daemon started 28-Jul-10 16:41, 76 Jobs run since started. Heap: heap=2,007,040 smbytes=535,293 max_bytes=1,545,515 bufs=3,177 max_bufs=11,839 Scheduled Jobs: Level Type Pri Scheduled Name Volume === IncrementalBackup10 03-Aug-10 20:30CVSSource Other-0252 IncrementalBackup10 03-Aug-10 20:30radimgws74-fullA00056 IncrementalBackup10 03-Aug-10 20:30radimgws68-fullA00056 IncrementalBackup10 03-Aug-10 20:30radimgws61-fullA00056 IncrementalBackup10 03-Aug-10 20:30radimgws58-fullA00056 IncrementalBackup10 03-Aug-10 20:30radimgws56-fullA00056 IncrementalBackup10 03-Aug-10 20:30radimgws55-fullA00056 IncrementalBackup10 03-Aug-10 20:30radimgws53-fullA00056 IncrementalBackup10 03-Aug-10 20:30radimgws52-fullA00056 IncrementalBackup10 03-Aug-10 20:30PublicsA00056 IncrementalBackup10 03-Aug-10 20:30user-private A00056 Full Backup10 04-Aug-10 01:10BackupCatalog Catalogs-0217 Running Jobs: Console connected at 03-Aug-10 11:12 Console connected at 03-Aug-10 11:16 JobId Level Name Status == 22067 Increme user-private.2010-08-02_20.30.00_18 is running 22068 Increme Publics.2010-08-02_20.30.00_19 is running 22075 Fullradimgws68-full.2010-08-02_20.30.00_26 is running Terminated Jobs: JobId LevelFiles Bytes Status FinishedName 22060 Full159,18432.15 G Error02-Aug-10 12:34 radimgws56-full 22070 Full 0 0 Error02-Aug-10 20:30 radimgws53-full 22066 Incr 0 0 OK 02-Aug-10 20:30 CVSSource 22071 Incr 0 0 Error02-Aug-10 20:33 radimgws55-full 22069 Full 0 0 Error02-Aug-10 20:33 radimgws52-full 22073 Incr 0 0 Error02-Aug-10 20:36 radimgws58-full 22074 Incr 0 0 Error02-Aug-10 20:36 radimgws61-full 22076 Full 0 0 Error02-Aug-10 20:39 radimgws74-full 22077 Full 12.298 G OK 03-Aug-10 01:18 BackupCatalog 22072 Incr 0 0 Cancel 03-Aug-10 11:13 radimgws56-full * *st Status available for: 1: Director 2: Storage 3: Client 4: All Select daemon type for status (1-4): 2 The defined Storage resources are: 1: File 2: DLT-IV 3: DVD-FILESERVER 4: DEV6-DLT-IV-0 5: DEV6-LTO-0 6: DEV6-LTO2-1 7: DEV6-Changer Select Storage resource (1-7): 5 Connecting to Storage daemon DEV6-LTO-0 at dev6.radimg.pitt.edu:9103 dev6-sd Version: 5.0.2 (28 April 2010) x86_64-pc-linux-gnu gentoo Daemon started 28-Jul-10 14:24, 59 Jobs run since started. Heap: heap=1,404,928 smbytes=910,816 max_bytes=1,145,939 bufs=243 max_bufs=286 Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 Running Jobs: Writing: Incremental Backup job user-private JobId=22067 Volume=A00056 pool=UserBackup-LTO2 device=LTO2-0 (/dev/nst0) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=4 fd=10 Writing: Incremental Backup job Publics JobId=22068 Volume=A00056 pool=UserBackup-LTO2 device=LTO2-0 (/dev/nst0) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=4 fd=9 Writing: Incremental Backup job radimgws56-full JobId=22072 Volume=A00056 pool=UserBackup-LTO2 device=LTO2-0 (/dev/nst0) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=5 fd=12 Writing: Full Backup job radimgws68-full JobId=22075 Volume=A00056 pool=UserBackup-LTO2 device=LTO2-0 (/dev/nst0) spooling=0 despooling=0 despool_wait=0 Files=0 Bytes=0 Bytes/sec=0 FDReadSeqNo=6 in_msg=6 out_msg=4 fd=13 Jobs waiting to reserve a drive: Terminated Jobs: JobId LevelFiles Bytes Status FinishedName === 22064 Full 0 0 Cancel 01-Aug-10 20:41 radimgws74-full 22055 Full458,77091.16 G Error02-Aug-10 12:34 user-private 22060 Full159,15632.17 G Error02-Aug-10 12:34 radimgws56-full 22056 Full252,279117.9 G Error02-Aug-10 12:34
Re: [Bacula-users] Spooling
Any failed jobs about that time? Sent from my iPhone On Aug 3, 2010, at 6:59 AM, Alan Brown a...@mssl.ucl.ac.uk wrote: I wonder... does the despooling level reduce on a consistent basis all through the two week period? Or does it suddenly drop. This sounds like it calls for a pretty graph... ;) As luck would have it: I have a pretty graph. It suddenly drops. AB -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem starting bconsole
If you are not using TLS then simply check bconsole.conf to see if you have set the right dir name, password and address which correspond to these in bacula-dir.conf. - Original Message - From: Albin Vega To: Bacula Mailingliste ; FreeBSD Mailingliste Sent: Tuesday, August 03, 2010 12:46 PM Subject: [Bacula-users] Problem starting bconsole Hello Have installed Bacula 5.0.0.1 (with MySQL) on a FreeBSD 8.0 platform. When I try to start bconsole i get the following message: Connecting to Director localhost:9101 Director authorization problem. Most likely the passwords do not agree. If you are using TLS, there may have been a certificate validation error during the TLS handshake. Please see http://www.bacula.org/en/rel-manual/Bacula_Freque_Asked_Questi.html#SECTION00376 for help. I have checked that MySQL is running: mysql680 0.0 0.0 3624 1544 v0- I10:06AM 0:00.00 /bin/sh /usr/local/bin/mysqld_safe --defaults-extra-file=/var/db/mysql/my.cnf --user=mys mysql760 0.0 1.1 192480 41020 v0- I10:06AM 0:00.56 [mysqld] Also checked if Bacula are running: bacula 804 0.0 0.1 9996 4560 ?? Ss 10:06AM 0:00.01 /usr/local/sbin/bacula-sd -u bacula -g bacula -v -c /usr/local/etc/bacula-sd.conf root 809 0.0 0.1 8896 4252 ?? Ss 10:06AM 0:00.01 /usr/local/sbin/bacula-fd -u root -g wheel -v -c /usr/local/etc/bacula-fd.conf bacula 813 0.0 0.2 11428 5692 ?? Is 10:06AM 0:00.01 /usr/local/sbin/bacula-dir -u bacula -g bacula -v -c /usr/local/etc/bacula-dir.conf Cant seem to find anything useful on the subject on google either. Anybody have any idea on how to fix it? Best regards Albin -- -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem starting bconsole
Also if you are using tcp wrappers check your host.allow file to ensure you are allowed to connect. This error also comes up when that is wrong. On Tue, 2010-08-03 at 18:14 +0200, Ali Reza Sajedi wrote: If you are not using TLS then simply check bconsole.conf to see if you have set the right dir name, password and address which correspond to these in bacula-dir.conf. - Original Message - From: Albin Vega To: Bacula Mailingliste ; FreeBSD Mailingliste Sent: Tuesday, August 03, 2010 12:46 PM Subject: [Bacula-users] Problem starting bconsole Hello Have installed Bacula 5.0.0.1 (with MySQL) on a FreeBSD 8.0 platform. When I try to start bconsole i get the following message: Connecting to Director localhost:9101 Director authorization problem. Most likely the passwords do not agree. If you are using TLS, there may have been a certificate validation error during the TLS handshake. Please see http://www.bacula.org/en/rel-manual/Bacula_Freque_Asked_Questi.html#SECTION00376 for help. I have checked that MySQL is running: mysql680 0.0 0.0 3624 1544 v0- I10:06AM 0:00.00 /bin/sh /usr/local/bin/mysqld_safe --defaults-extra-file=/var/db/mysql/my.cnf --user=mys mysql760 0.0 1.1 192480 41020 v0- I10:06AM 0:00.56 [mysqld] Also checked if Bacula are running: bacula 804 0.0 0.1 9996 4560 ?? Ss 10:06AM 0:00.01 /usr/local/sbin/bacula-sd -u bacula -g bacula -v -c /usr/local/etc/bacula-sd.conf root 809 0.0 0.1 8896 4252 ?? Ss 10:06AM 0:00.01 /usr/local/sbin/bacula-fd -u root -g wheel -v -c /usr/local/etc/bacula-fd.conf bacula 813 0.0 0.2 11428 5692 ?? Is 10:06AM 0:00.01 /usr/local/sbin/bacula-dir -u bacula -g bacula -v -c /usr/local/etc/bacula-dir.conf Cant seem to find anything useful on the subject on google either. Anybody have any idea on how to fix it? Best regards Albin __ -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm __ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula restore runs forever - bootstrap creation
On Sat, 31 Jul 2010 12:01:40 +0200, news only said: Martin Simmons schrieb: Michael schrieb: So, what might be the cause for the creation of the erroneous bootstrap entry (VolAddr=0-1078036843257)? It could be catalog corruption. What does the following SQL query return (where NNN is the jobid containing that file)? SELECT VolumeName, MediaType, FirstIndex, LastIndex, StartFile, JobMedia.EndFile, StartBlock, JobMedia.EndBlock, Slot, StorageId, InChanger FROMJobMedia, Media WHERE JobMedia.JobId=NNN AND JobMedia.MediaId=Media.MediaId ORDER BY VolIndex,JobMediaId; Thanks for the reply. This is the outout from the query: ++---++---+---+-++--+--+---+---+ | VolumeName | MediaType | FirstIndex | LastIndex | StartFile | EndFile | StartBlock | EndBlock | Slot | StorageId | InChanger | ++---++---+---+-++--+--+---+---+ | KYE713L4 | LTO-4 | 1 |101610 | 246 | 246 | 0 |77503 |1 | 3 | 1 | | KYE713L4 | LTO-4 | 101610 |116651 | 247 | 247 | 0 |77503 |1 | 3 | 1 | | KYE713L4 | LTO-4 | 116651 |126690 | 248 | 248 | 0 |77503 |1 | 3 | 1 | | KYE713L4 | LTO-4 | 126690 |151467 | 249 | 249 | 0 |77503 |1 | 3 | 1 | | KYE713L4 | LTO-4 | 151467 |169844 | 250 | 250 | 0 |77503 |1 | 3 | 1 | | KYE713L4 | LTO-4 | 169844 |292514 | 251 | 251 | 0 |51961 |1 | 3 | 1 | | KYE713L4 | LTO-4 | 1 |292514 | 0 | 251 | 0 |51961 |1 | 3 | 1 | ++---++---+---+-++--+--+---+---+ Ok, that explains the duplicate bootstrap rows. I do not understand the reason of the last line. Shouldn't it be StartFile 246? But I get similar results for at least another full backup (didn't query all of them). No, I don't think StartFile 246 would be any better. The last row looks completely bogus to me -- either it is not needed or it is badly corrupted. What is the size of the job in bytes? Did it complete without errors? Have you run any tools like bscan with this volume to update the catalog? What does the following slightly modified query print for that jobid? SELECT VolumeName, MediaType, VolIndex, JobMediaId, FirstIndex, LastIndex, StartFile, JobMedia.EndFile, StartBlock, JobMedia.EndBlock FROMJobMedia, Media WHERE JobMedia.JobId=NNN AND JobMedia.MediaId=Media.MediaId ORDER BY VolIndex,JobMediaId; __Martin -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula + Postgres : copy batch problem
On 03/08/10, Martin Simmons (mar...@lispworks.com) wrote: 2. Can I stop this needless after-backup insertion? I tried setting Spool Attributes to NO but it did not work You need to rebuild Bacula with the --disable-batch-insert option, but it might run quite slowly. Setting synchronous_commit = off in postgresql.conf might help to make it faster. Thanks about the note about the --disable-batch-insert compile time option. Changing the synchronous_commit flag to off will speed up inserts into the database which will is great, but it won't affect the size of the batch file. Please clarify why you are suggesting this. Sorry, I wasn't clear. I was only suggesting that you change synchronous_commit if you use --disable-batch-insert. ... Perhaps this is something the developers could consider? You can do that already by compiling with --disable-batch-insert and setting Spool Attributes to NO. Thanks very much for your comments, Martin. I'm about to try with this compile option and setting Spool Attributes to NO. I'll report back. -- Rory Campbell-Lange r...@campbell-lange.net -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula + Postgres : copy batch problem
On 03/08/10, Marc Cousin (cousinm...@gmail.com) wrote: 3. Why is Bacula using a batch file at all? Why not simply do a straight insert? Because 7,643,966 inserts would be much slower. Really? I've logged Bacula's performance on the server and the inserts run at around 0.35 ms and updates at around 0.5 ms. What is traced, usually, is execution time. You won't easily get : - Parse time of the query. It is basically 0 with batch insert, where it is very measurable with insert. - Round trip duration and overhead. This one, even if everything is running on the same machine, is where the costs savings are high with batch insert : if you run everything on inserts, the inserting process has to wait for the database to acknowledge each operation before submitting the next one. And inserting records in bacula isn't all about inserts. There are some selects too, to lookup for pathid and filenameid. You also pay a penalty because you send back data to the caller (how many inserted records and the like). To give you a very simplified simulation, I've tried inserting 1 million integer values the way the batch insert works (copy), It takes 3.5 seconds, mostly IO bound. With inserts, 77s, mostly CPU bound. The gains are lower with bacula, because data inserted is more complex, bacula itself is more complex, there are indexes to maintain, but it gives you an idea of why there is a batch mode. Actually, this is what I don't get. Postgresql is a highly scalable, robust database system and it is being used as a data dump rather than a working tool for creating a transaction-based working catalogue. Yes, a batch insert is faster than a specfic insert, but the latter should be done at the written-to-tape transaction time, and could be done asynchronously, but in a transaction. Its pretty crazy for a 7TB tape backup to fail because of a temporary file/table problem at the END of the backup process rather than during it. Also the copy writes to a temporary table and then some rather curious inserts are done into the Bacula tables. E.g: INSERT INTO Path (Path) SELECT a.Path FROM ( SELECT DISTINCT Path FROM batch ) AS a WHERE NOT EXISTS (SELECT Path FROM Path WHERE Path = a.Path) This is a cludge (with an inefficient correlated subquery!) that could easily miss paths which exist from previous, unrelated backups. A continuous insert process against a job and mediaid simply wouldn't need to do this. More native support for postgres would also allow, for instance, faster and more powerful searching of catalogues for retrieves, rather than the strange restore procedure required through bconsole. I'm delighted to be using Bacula (particularly after our tribulations with Amanda) but it seems to me that Bacula could lean much more heavily on Postgresql. -- Rory Campbell-Lange r...@campbell-lange.net -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula confused about slots on autochanger
It seems that part of the problem I have been having with backup is that bacula is having communication problems with the autochanger. Bacula tells the autochanger to load slot 3, but instead slot 2 is loaded: *messages 03-Aug 18:14 billie-sd JobId 1728: 3301 Issuing autochanger loaded? drive 0 command. 03-Aug 18:14 billie-sd JobId 1728: 3302 Autochanger loaded? drive 0, result: nothing loaded. 03-Aug 18:14 billie-sd JobId 1728: 3304 Issuing autochanger load slot 3, drive 0 command. * 03-Aug 18:15 billie-sd JobId 1728: 3305 Autochanger load slot 3, drive 0, status is OK. * 03-Aug 18:15 billie-sd JobId 1728: Warning: Director wanted Volume A005. Current Volume B005 not acceptable because: 1998 Volume B005 status is Full, not in Pool. 03-Aug 18:15 billie-sd JobId 1728: Please mount Volume A005 or label a new one for: Job: NightlySave.2010-08-01_01.05.00.32 Storage: Drive-1 (/dev/nst0) Pool: Daily Media type: VXA-2 *exit billie:~# mtx -f /dev/sg2 status Storage Changer /dev/sg2:1 Drives, 10 Slots ( 0 Import/Export ) Data Transfer Element 0:Full (Storage Element 2 Loaded):VolumeTag = B005 Storage Element 1:Full :VolumeTag=A006 Storage Element 2:Empty:VolumeTag= Storage Element 3:Full :VolumeTag=A005 Storage Element 4:Full :VolumeTag=A004 Storage Element 5:Full :VolumeTag=B004 Storage Element 6:Full :VolumeTag=C005 Storage Element 7:Full :VolumeTag=A007 Storage Element 8:Full :VolumeTag=C006 Storage Element 9:Full :VolumeTag=A010 Storage Element 10:Full :VolumeTag=CLNA0001 Any ideas what is going on or how to fix it? thanks, maria -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula + Postgres : copy batch problem
On 8/3/2010 7:09 PM, Rory Campbell-Lange wrote: Actually, this is what I don't get. Postgresql is a highly scalable, robust database system and it is being used as a data dump rather than a working tool for creating a transaction-based working catalogue. Changes to one part of Bacula has to be compatible with all other parts of Bacula. For example, given that we support SQLite, PostgreSQL, and MySQL, we have to keep each in mind. Yes, it's a compromise. Yes, a batch insert is faster than a specfic insert, but the latter should be done at the written-to-tape transaction time, and could be done asynchronously, but in a transaction. So... don't use batch-insert. Go the single insert approach. I dare you. ;) Its pretty crazy for a7TB tape backup to fail because of a temporary file/table problem at the END of the backup process rather than during it. The running out of space is a PostgreSQL issue. Also the copy writes to a temporary table and then some rather curious inserts are done into the Bacula tables. E.g: INSERT INTO Path (Path) SELECT a.Path FROM ( SELECT DISTINCT Path FROM batch ) AS a WHERE NOT EXISTS (SELECT Path FROM Path WHERE Path = a.Path) This is a cludge (with an inefficient correlated subquery!) that could easily miss paths which exist from previous, unrelated backups. A continuous insert process against a job and mediaid simply wouldn't need to do this. If you want to patch it, we'll certainly look at it. More native support for postgres would also allow, for instance, faster and more powerful searching of catalogues for retrieves, rather than the strange restore procedure required through bconsole. Sure, it would. We're always looking for more people to take on the heavy lifting. I'm delighted to be using Bacula (particularly after our tribulations with Amanda) but it seems to me that Bacula could lean much more heavily on Postgresql. Yep. I was this close to deploying Amanda when I found Bacula. I switched immediately. When the PostgreSQL module was written, it was based exactly upon the MySQL module. Why? Ease. Walk first. Run later. As time has gone on, more PostgreSQL specific code has been added. Now that we have extensive regression testing, such changes are easier to evaluate. -- Dan Langille - http://langille.org/ -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula + Postgres : copy batch problem
On 8/3/2010 7:09 PM, Rory Campbell-Lange wrote: Yes, a batch insert is faster than a specfic insert, but the latter should be done at the written-to-tape transaction time, and could be done asynchronously, but in a transaction. Its pretty crazy for a7TB tape backup to fail because of a temporary file/table problem at the END of the backup process rather than during it. Perhaps this will help: * batch insert determines the method to be used. * Spool Attributes determines when this method is used. Does that help? -- Dan Langille - http://langille.org/ -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] DisktoCatalog difference verification
Hello,
Good day.
I'm using Bacula 5.0.2 on CentOS 5.5. I've created a DisktoCatalog level
verify job as a way to check things. I'm getting the warning below even
though they are on disk:
Warning: The following files are in the Catalog but not on disk:
/usr/
/var/
/var/log/
/var/log/audit/
/home/
/boot/
Below is the FileSet I'm using:
FileSet {
Name = Linux Full Set
Include {
Options {
signature = SHA1
Compression = GZIP
Accurate = mcs1
Verify = pins1
aclsupport=yes
xattrsupport = yes
}
File = /
File = /usr
File = /var
File = /var/log
File = /var/log/audit
File = /home
File = /boot
}
Exclude {
File = lost+found
File = /sys
File = /proc
File = /tmp
File = /.autofsck
File = /var/tmp
File = /dev/shm
File = /dev
File = /selinux
File = /var/lib/bacula
File = /var/run
File = /var/spool
File = /var/cache
File = /var/lock
}
}
I tried listing files of the job using the bconsole and I saw two
entries of /usr and the rest mentioned on the warning. Is it safe to
ignore the warning or can it be removed?
Thanks.
Best regards,
Ceejay
--
The Palm PDK Hot Apps Program offers developers who use the
Plug-In Development Kit to bring their C/C++ apps to Palm for a share
of $1 Million in cash or HP Products. Visit us here for more details:
http://p.sf.net/sfu/dev2dev-palm___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula confused about slots on autochanger
Hi, no clever idea for me, just basic thoughts. what is the output of an update slots command ? what happen when you ask a 'mount' request from slot 3 ? Le Mer 4 août 2010 03:20, Maria McKinley a écrit : It seems that part of the problem I have been having with backup is that bacula is having communication problems with the autochanger. Bacula tells the autochanger to load slot 3, but instead slot 2 is loaded: *messages 03-Aug 18:14 billie-sd JobId 1728: 3301 Issuing autochanger loaded? drive 0 command. 03-Aug 18:14 billie-sd JobId 1728: 3302 Autochanger loaded? drive 0, result: nothing loaded. 03-Aug 18:14 billie-sd JobId 1728: 3304 Issuing autochanger load slot 3, drive 0 command. * 03-Aug 18:15 billie-sd JobId 1728: 3305 Autochanger load slot 3, drive 0, status is OK. * 03-Aug 18:15 billie-sd JobId 1728: Warning: Director wanted Volume A005. Current Volume B005 not acceptable because: 1998 Volume B005 status is Full, not in Pool. 03-Aug 18:15 billie-sd JobId 1728: Please mount Volume A005 or label a new one for: Job: NightlySave.2010-08-01_01.05.00.32 Storage: Drive-1 (/dev/nst0) Pool: Daily Media type: VXA-2 *exit billie:~# mtx -f /dev/sg2 status Storage Changer /dev/sg2:1 Drives, 10 Slots ( 0 Import/Export ) Data Transfer Element 0:Full (Storage Element 2 Loaded):VolumeTag = B005 Storage Element 1:Full :VolumeTag=A006 Storage Element 2:Empty:VolumeTag= Storage Element 3:Full :VolumeTag=A005 Storage Element 4:Full :VolumeTag=A004 Storage Element 5:Full :VolumeTag=B004 Storage Element 6:Full :VolumeTag=C005 Storage Element 7:Full :VolumeTag=A007 Storage Element 8:Full :VolumeTag=C006 Storage Element 9:Full :VolumeTag=A010 Storage Element 10:Full :VolumeTag=CLNA0001 Any ideas what is going on or how to fix it? thanks, maria -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
