[Bacula-users] Read and write devices not properly initialized.
Dear bacula-users, I am using bacula 9.4.2 on Ubuntu 20.04.4. Recently I discovered 2 new configuration options: „Max Virtual Full Interval" and "Virtual Full Backup Pool“. As I already use MaxDiffInterval and MaxFullInterval I wanted to use them. But no matter what I configured I was not able to get a running configuration. Each virtual full ends up with a fatal error "Read and write devices not properly initialized.“ Explanations: Pools Full, Diff and Incr should be used as source and pool Full as destination pool. Devices GebM0 and GebM1 are part of Storage DiskM which is the Storage device for pool Full. I should say that, even if configuring another pool device as Virtual Full Backup Pool the fatal error still remains. I uploaded cleared up versions of bacula-dir.conf and bacula-sd.conf to https://cloud.uni-koblenz-landau.de/s/CYHZYzdATKcsLwf Any hint is greatly appreciated. Thanks a lot in advance. 10-Mai 00:07 bacula-dir JobId 1545775: 10-Mai 00:07 bacula-dir JobId 1545775: No prior or suitable Full backup found in catalog. Doing Virtual FULL backup. 10-Mai 00:07 bacula-dir JobId 1545775: Start Virtual Backup JobId 1545775, Job=unikodc02.2022-05-10_00.07.02_09 10-Mai 00:07 bacula-dir JobId 1545775: Consolidating JobIds=1497692,1537954,1538361,1538776,1538915,1539052,1539995,1540410,1540830,1541242,1541654,1541793,1541939,1542890,1543303,1543718,1544129,1544541 10-Mai 00:07 bacula-dir JobId 1545775: Found 705099 files to consolidate into Virtual Full. 10-Mai 00:07 bacula-dir JobId 1545775: Using Device "GebM1" to write. 10-Mai 00:07 bacula-sd JobId 1545775: Fatal error: Read and write devices not properly initialized. 10-Mai 00:07 bacula-sd JobId 1545775: Elapsed time=458926:07:50, Transfer rate=0 Bytes/second 10-Mai 00:07 bacula-dir JobId 1545775: Error: Bacula bacula-dir 9.4.2 (04Feb19): Build OS: x86_64-pc-linux-gnu ubuntu 20.04 JobId: 1545775 Job: unikodc02.2022-05-10_00.07.02_09 Backup Level: Virtual Full Client: "unikodc02" 5.2.10 (28Jun12) Microsoft Standard Edition (build 9200), 64-bit,Cross-compile,Win64 FileSet: "unikodc01-02 Files" 2015-02-18 00:09:03 Pool: "Full" (From Job VFullPool override) Catalog: "MyCatalog" (From Client resource) Storage: "DiskM" (From Pool resource) Scheduled time: 10-Mai-2022 00:07:02 Start time: 07-Mai-2022 00:07:18 End time: 07-Mai-2022 00:18:29 Elapsed time: 11 mins 11 secs Priority: 10 SD Files Written: 0 SD Bytes Written: 0 (0 B) Rate: 0.0 KB/s Volume name(s): Volume Session Id: 4175 Volume Session Time: 1651219107 Last Volume Bytes: 8,250,903,080 (8.250 GB) SD Errors: 1 SD termination status: Error Termination: *** Backup Error *** -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Jobs still despooling waiting for media
Sorry, in the meantime I updated to 9.4.2. But nothing changed. > Am 04.04.2022 um 08:50 schrieb Christoph Litauer : > > Dear bacula-admins, > > I am using bacula 9.0.6. > > Starting about 2 weeks ago I have several problems regarding bacula-sd. > Backups are started about midnight every day. In the morning I have the > following situation: > > Console connected at 04-Apr-22 07:11 > JobId Type Level Files Bytes Name Status > == > 1530372 Back Incr 5,4631.277 G nfs1-user SD despooling Data > 1530373 Back Incr 151.584 M nfs1-export SD despooling Data > 1530376 Back Incr 6,8682.962 G nfs2-user SD despooling Data > 1530381 Back Incr 1,9789.918 G sambaverw-userdata SD despooling Data > 1530382 Back Incr 7224.02 M sambaverw-sharedata SD despooling > Data > 1530421 Back Incr 14,283246.6 M salt SD despooling Data > 1530450 Back Incr68159.22 G cms2 SD despooling Data > > status storage shows that a drive is BLOCKED waiting for media: > Device File: "FileStorage1" (/storageG/changer/drive1) is not open. > Device is BLOCKED waiting for media. > Drive 1 is not loaded. > > When I try to mount the concerning media nothing happens: > *mount storage=DiskChanger device=FileStorage1 slot=2316 drive=1 > 3001 OK mount requested. Specified slot ignored. Device="FileStorage1" > (/storageG/changer/drive1) > > The „tape“ File-2316 is not still not mounted and the despooling doesn’t go > on. > > status storage shows an additional job not in the directors list of running > jobs: > Writing: Incremental Backup job pos04 JobId=1530443 Volume="" >pool="Incr" device="FileStorage1" (/storageG/changer/drive1) >spooling=0 despooling=1 despool_wait=0 >Files=86,506 Bytes=3,183,460,265 AveBytes/sec=104,739 LastBytes/sec=17,088 >FDReadSeqNo=776,606 in_msg=530870 out_msg=6 fd=26 > > I restartet the fd on pos04 with no effect. maybe this job blocks the drive? > Volume=““ > > Any help is greatly appreciated ... > > -- > Kind regards > Christoph > _ > Christoph Litauer > Uni Koblenz, Computing Centre, Office A 022 > Postfach 201602, 56016 Koblenz > Fon: +49 261 287-1311, Fax: -100 1311 > > > > _______ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- Freundliche Grüße Christoph Litauer _ Christoph Litauer Uni Koblenz, Rechenzentrum, Raum A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Jobs still despooling waiting for media
Dear bacula-admins, I am using bacula 9.0.6. Starting about 2 weeks ago I have several problems regarding bacula-sd. Backups are started about midnight every day. In the morning I have the following situation: Console connected at 04-Apr-22 07:11 JobId Type Level Files Bytes Name Status == 1530372 Back Incr 5,4631.277 G nfs1-user SD despooling Data 1530373 Back Incr 151.584 M nfs1-export SD despooling Data 1530376 Back Incr 6,8682.962 G nfs2-user SD despooling Data 1530381 Back Incr 1,9789.918 G sambaverw-userdata SD despooling Data 1530382 Back Incr 7224.02 M sambaverw-sharedata SD despooling Data 1530421 Back Incr 14,283246.6 M salt SD despooling Data 1530450 Back Incr68159.22 G cms2 SD despooling Data status storage shows that a drive is BLOCKED waiting for media: Device File: "FileStorage1" (/storageG/changer/drive1) is not open. Device is BLOCKED waiting for media. Drive 1 is not loaded. When I try to mount the concerning media nothing happens: *mount storage=DiskChanger device=FileStorage1 slot=2316 drive=1 3001 OK mount requested. Specified slot ignored. Device="FileStorage1" (/storageG/changer/drive1) The „tape“ File-2316 is not still not mounted and the despooling doesn’t go on. status storage shows an additional job not in the directors list of running jobs: Writing: Incremental Backup job pos04 JobId=1530443 Volume="" pool="Incr" device="FileStorage1" (/storageG/changer/drive1) spooling=0 despooling=1 despool_wait=0 Files=86,506 Bytes=3,183,460,265 AveBytes/sec=104,739 LastBytes/sec=17,088 FDReadSeqNo=776,606 in_msg=530870 out_msg=6 fd=26 I restartet the fd on pos04 with no effect. maybe this job blocks the drive? Volume=““ Any help is greatly appreciated ... -- Kind regards Christoph _____ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Trying to get mount requests by mail
Dear bacula-users, I am running bacula 9.0.6 on Ubuntu 18.04.6. Every night I run Copy jobs to copy the last recent backups from a file to a tape device. Sometimes the scratch pool is empty, no new tapes available. In that case I want to receive a mail to label and mount new volumes ... Job and Messages definition appended. Any ideas why bacula-mountreque...@uni-koblenz.de doesn’t get an „Intervention needed“ message? Job { Name = "CopyFull" Type = Copy Messages = TapeCopy Pool = Full Selection Type = PoolUncopiedJobs Priority = 15 Schedule = Weekdays Max Start Delay = 43200 # wait max 12 hours Maximum Concurrent Jobs = 1 Spool Data = no Level = Full Client = bacula FileSet = "client files-to-backup" } Messages { Name = TapeCopy mailcommand = "/usr/bin/mail -r \"Bacula \<%r\>\" -s \"Bacula tape copy\" %r" operatorcommand = "/usr/bin/mail -r \"Bacula \<%r\>\" -s \"Bacula: Intervention needed for %j\" %r" Mail On Error = bacula-com...@uni-koblenz.de = all, !skipped operator = bacula-mountreque...@uni-koblenz.de = mount append = "/var/log/bacula/copy.log" = all, !skipped } -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Best practice for tape library upgrade
Dear bacula users, I need to upgrade one of my old tape library pools from LTO4 to LTO8. The pool consists of about 100 tapes with about 18000 jobs. I wonder about the best practice to transfer all these jobs to new tapes in a new pool. I could do it with a copy-job but it would take months to complete because each job is first restored and then written to the new tape. Overhead is about 4-5 minutes for each job. I read the manpages for bcopy. Maybe this would be the tool I should use? Would bcopy copy the bacula tape label, too? Is bcopy able to handle jobs that are split over more than one tape? Can I bcopy all tapes at once? Thanks a lot in advance! -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Query for "most recent copies of a file"
I added a query to my query.sql that does the job. Thanks a lot. > Am 07.05.2019 um 18:30 schrieb Martin Simmons : > > I think option 2 should be fixed to ignore deleted files. E.g. > > # 2 > :List where the most recent copies of a file are saved > *Enter path with trailing slash: > *Enter filename: > *Enter Client name: > SELECT DISTINCT Job.JobId,StartTime AS JobStartTime,VolumeName,Client.Name AS > ClientName > FROM Job,File,Path,Filename,Media,JobMedia,Client > WHERE File.JobId=Job.JobId > AND File.FileIndex > 0 > AND Path.Path='%1' > AND Filename.Name='%2' > AND Client.Name='%3' > AND Path.PathId=File.PathId > AND Filename.FilenameId=File.FilenameId > AND JobMedia.JobId=Job.JobId > AND JobMedia.MediaId=Media.MediaId > AND Client.ClientId=Job.ClientId > ORDER BY Job.StartTime DESC LIMIT 5; > > Queries 1 and 12 also need to be fixed. > > __Martin > > >>>>>> On Tue, 7 May 2019 14:59:47 +0200, Christoph Litauer said: >> >> Sorry for the long delay, had holidays ... >> >> That seems to be the explanation. I use accurate for all my backups. Your >> command lists cyrus.header as deleted. As a result "restore" doesn't list >> the parent directory. >> >> But >> - should option 2 really find deleted files? >> - how do I find the last _not_ deleted version of a file? >> >>> Am 25.04.2019 um 17:19 schrieb Martin Simmons : >>> >>> Here's another possible problem: query 2 gives the wrong results if you are >>> using "accurate" backups and have deleted files. >>> >>> Try >>> >>> echo "list files type=deleted jobid=1100162" | bconsole | grep >>> someuser/Transkriptionen >>> >>> to see if that directory was deleted. >>> >>> __Martin >>> >>> >>>>>>>> On Thu, 18 Apr 2019 13:13:20 +0100, Martin Simmons said: >>>> >>>> Yes, I think commands 2 and 3 should be successful because command 1 is >>>> successful. >>>> >>>> Is the path entirely ASCII? Is "someuser" the real name? >>>> >>>> You could try >>>> >>>> (echo "restore"; echo 3; echo 1100162; echo "cd /var") | bconsole >>>> (echo "restore"; echo 3; echo 1100162; echo "cd /var/spool") | bconsole >>>> (echo "restore"; echo 3; echo 1100162; echo "cd /var/spool/imap") | >>>> bconsole >>>> >>>> etc to see which directory is invalid. >>>> >>>> __Martin >>>> >>>> >>>>>>>> On Thu, 18 Apr 2019 13:43:11 +0200, Christoph Litauer said: >>>>> >>>>> Dubious ... >>>>> >>>>> # (echo "query"; echo 12; echo 1100162) | bconsole | grep someuser/ | >>>>> grep cyrus.header >>>>> | /var/spool/imap/d/user/someuser/Transkriptionen/ >>>>> | cyrus.header | >>>>> >>>>> # echo "list files jobid=1100162" | bconsole | grep >>>>> someuser/Transkriptionen >>>>> >>>>> >>>>> # (echo "restore"; echo 3; echo 1100162; echo "cd >>>>> /var/spool/imap/d/user/someuser/Transkriptionen") | bconsole >>>>> ... >>>>> Invalid path given. >>>>> ... >>>>> >>>>> >>>>> In my opinion all 3 commands should be successful? >>>>> >>>>>> Am 18.04.2019 um 11:39 schrieb Martin Simmons : >>>>>> >>>>>> You could also check with query 12 (List Files for a selected JobId) to >>>>>> see if >>>>>> that lists your files. >>>>>> >>>>>> __Martin >>>>>> >>>>>>>>>>> On Wed, 17 Apr 2019 17:53:50 +0100, Martin Simmons said: >>>>>> >>>>>> Ah, it looks like query 2 will list up to 5 lines for jobs that span >>>>>> more than >>>>>> one volume, so that is not suspicious after all. >>>>>> >>>>>> Do you have any non-ASCII characters in the path (I assume "someuser" is >>>>>> a >>>>>> manual edit)? >>>>>> >>>>>> __Martin >>>>>> >>
Re: [Bacula-users] Query for "most recent copies of a file"
Sorry for the long delay, had holidays ... That seems to be the explanation. I use accurate for all my backups. Your command lists cyrus.header as deleted. As a result "restore" doesn't list the parent directory. But - should option 2 really find deleted files? - how do I find the last _not_ deleted version of a file? > Am 25.04.2019 um 17:19 schrieb Martin Simmons : > > Here's another possible problem: query 2 gives the wrong results if you are > using "accurate" backups and have deleted files. > > Try > > echo "list files type=deleted jobid=1100162" | bconsole | grep > someuser/Transkriptionen > > to see if that directory was deleted. > > __Martin > > >>>>>> On Thu, 18 Apr 2019 13:13:20 +0100, Martin Simmons said: >> >> Yes, I think commands 2 and 3 should be successful because command 1 is >> successful. >> >> Is the path entirely ASCII? Is "someuser" the real name? >> >> You could try >> >> (echo "restore"; echo 3; echo 1100162; echo "cd /var") | bconsole >> (echo "restore"; echo 3; echo 1100162; echo "cd /var/spool") | bconsole >> (echo "restore"; echo 3; echo 1100162; echo "cd /var/spool/imap") | bconsole >> >> etc to see which directory is invalid. >> >> __Martin >> >> >>>>>> On Thu, 18 Apr 2019 13:43:11 +0200, Christoph Litauer said: >>> >>> Dubious ... >>> >>> # (echo "query"; echo 12; echo 1100162) | bconsole | grep someuser/ | grep >>> cyrus.header >>> | /var/spool/imap/d/user/someuser/Transkriptionen/ >>> | cyrus.header | >>> >>> # echo "list files jobid=1100162" | bconsole | grep someuser/Transkriptionen >>> >>> >>> # (echo "restore"; echo 3; echo 1100162; echo "cd >>> /var/spool/imap/d/user/someuser/Transkriptionen") | bconsole >>> ... >>> Invalid path given. >>> ... >>> >>> >>> In my opinion all 3 commands should be successful? >>> >>>> Am 18.04.2019 um 11:39 schrieb Martin Simmons : >>>> >>>> You could also check with query 12 (List Files for a selected JobId) to >>>> see if >>>> that lists your files. >>>> >>>> __Martin >>>> >>>>>>>>> On Wed, 17 Apr 2019 17:53:50 +0100, Martin Simmons said: >>>>> >>>>> Ah, it looks like query 2 will list up to 5 lines for jobs that span more >>>>> than >>>>> one volume, so that is not suspicious after all. >>>>> >>>>> Do you have any non-ASCII characters in the path (I assume "someuser" is a >>>>> manual edit)? >>>>> >>>>> __Martin >>>>> >>>>> >>>>>>>>> On Wed, 17 Apr 2019 16:59:29 +0200, Christoph Litauer said: >>>>>> >>>>>> Hi Martin, >>>>>> >>>>>> thanks for the suggestions. >>>>>> The job is about 161GB and spans more than one "File"-volume. "list >>>>>> jobmedia jobid=1100162" gives all the index numbers for all mentioned >>>>>> volumes. And a query 7 gives: >>>>>> >>>>>> Choose a query (1-20): 7 >>>>>> Enter JobId: 1100162 >>>>>> +---++ >>>>>> | jobid | volumename | >>>>>> +---++ >>>>>> | 1,100,162 | File-2110 | >>>>>> | 1,100,162 | File-2885 | >>>>>> | 1,100,162 | File-1828 | >>>>>> | 1,100,162 | File-2598 | >>>>>> | 1,100,162 | File-2188 | >>>>>> | 1,100,162 | File-1157 | >>>>>> | 1,100,162 | File-1500 | >>>>>> | 1,100,162 | File-1107 | >>>>>> | 1,100,162 | File-1995 | >>>>>> +---++ >>>>>> >>>>>> My retention time for differentials is about 3 month. I use postgres. >>>>>> >>>>>> Everything seems to be ok. Will investigate further. >>>>>> >>>>>>> Am 12.04.2019 um 16:21 schrieb Martin Simmons : >>>>>>> >>>>>>> Thq query output looks suspicious to me -- do you expect the
Re: [Bacula-users] Query for "most recent copies of a file"
Dubious ... # (echo "query"; echo 12; echo 1100162) | bconsole | grep someuser/ | grep cyrus.header | /var/spool/imap/d/user/someuser/Transkriptionen/ | cyrus.header | # echo "list files jobid=1100162" | bconsole | grep someuser/Transkriptionen # (echo "restore"; echo 3; echo 1100162; echo "cd /var/spool/imap/d/user/someuser/Transkriptionen") | bconsole ... Invalid path given. ... In my opinion all 3 commands should be successful? > Am 18.04.2019 um 11:39 schrieb Martin Simmons : > > You could also check with query 12 (List Files for a selected JobId) to see if > that lists your files. > > __Martin > >>>>>> On Wed, 17 Apr 2019 17:53:50 +0100, Martin Simmons said: >> >> Ah, it looks like query 2 will list up to 5 lines for jobs that span more >> than >> one volume, so that is not suspicious after all. >> >> Do you have any non-ASCII characters in the path (I assume "someuser" is a >> manual edit)? >> >> __Martin >> >> >>>>>> On Wed, 17 Apr 2019 16:59:29 +0200, Christoph Litauer said: >>> >>> Hi Martin, >>> >>> thanks for the suggestions. >>> The job is about 161GB and spans more than one "File"-volume. "list >>> jobmedia jobid=1100162" gives all the index numbers for all mentioned >>> volumes. And a query 7 gives: >>> >>> Choose a query (1-20): 7 >>> Enter JobId: 1100162 >>> +---++ >>> | jobid | volumename | >>> +---++ >>> | 1,100,162 | File-2110 | >>> | 1,100,162 | File-2885 | >>> | 1,100,162 | File-1828 | >>> | 1,100,162 | File-2598 | >>> | 1,100,162 | File-2188 | >>> | 1,100,162 | File-1157 | >>> | 1,100,162 | File-1500 | >>> | 1,100,162 | File-1107 | >>> | 1,100,162 | File-1995 | >>> +---++ >>> >>> My retention time for differentials is about 3 month. I use postgres. >>> >>> Everything seems to be ok. Will investigate further. >>> >>>> Am 12.04.2019 um 16:21 schrieb Martin Simmons : >>>> >>>> Thq query output looks suspicious to me -- do you expect the file to be >>>> stored >>>> 5 times in the same job? >>>> >>>> It might be interesting to see the output from "list jobmedia >>>> jobid=1100162" and >>>> query 7 (List Volumes used by selected JobId) for 1100162. >>>> >>>> If you are using mysql, then I suggest running mysqlcheck abd myisamchk if >>>> appropriate. >>>> >>>> Also, I assume you mean "list files jobid=1100162" (not job=1100162). >>>> >>>> __Martin >>>> >>>> >>>> >>>>>>>>> On Fri, 12 Apr 2019 11:02:52 +0200, Christoph Litauer said: >>>>> >>>>> Dear bacula users, >>>>> >>>>> I am using bacula 9.0.4. I wonder about a strange effect: >>>>> >>>>> Sometimes I get restore requests without a concrete timestamp. The users >>>>> can't remember the time of removal. In these cases I use the bconsole >>>>> query command, option 2 "List where the most recent copies of a file are >>>>> saved". Example: >>>>> >>>>> Choose a query (1-20): 2 >>>>> /var/spool/imap/d/user/someuser/Transkriptionen/ >>>>> Enter filename: cyrus.index >>>>> Enter Client name: imap1 >>>>> +---+-+++ >>>>> | jobid | jobstarttime| volumename | clientname | >>>>> +---+-+++ >>>>> | 1,100,162 | 2019-03-27 00:07:01 | File-1107 | imap1 | >>>>> | 1,100,162 | 2019-03-27 00:07:01 | File-1157 | imap1 | >>>>> | 1,100,162 | 2019-03-27 00:07:01 | File-1500 | imap1 | >>>>> | 1,100,162 | 2019-03-27 00:07:01 | File-1828 | imap1 | >>>>> | 1,100,162 | 2019-03-27 00:07:01 | File-1995 | imap1 | >>>>> +---+-+++ >>>>> >>>>> Then I try to find the file with "list files job=1100162", but no luck. I >>>>> am not able to restore the f
Re: [Bacula-users] Query for "most recent copies of a file"
Hi Martin, thanks for the suggestions. The job is about 161GB and spans more than one "File"-volume. "list jobmedia jobid=1100162" gives all the index numbers for all mentioned volumes. And a query 7 gives: Choose a query (1-20): 7 Enter JobId: 1100162 +---++ | jobid | volumename | +---++ | 1,100,162 | File-2110 | | 1,100,162 | File-2885 | | 1,100,162 | File-1828 | | 1,100,162 | File-2598 | | 1,100,162 | File-2188 | | 1,100,162 | File-1157 | | 1,100,162 | File-1500 | | 1,100,162 | File-1107 | | 1,100,162 | File-1995 | +---++ My retention time for differentials is about 3 month. I use postgres. Everything seems to be ok. Will investigate further. > Am 12.04.2019 um 16:21 schrieb Martin Simmons : > > Thq query output looks suspicious to me -- do you expect the file to be stored > 5 times in the same job? > > It might be interesting to see the output from "list jobmedia jobid=1100162" > and > query 7 (List Volumes used by selected JobId) for 1100162. > > If you are using mysql, then I suggest running mysqlcheck abd myisamchk if > appropriate. > > Also, I assume you mean "list files jobid=1100162" (not job=1100162). > > __Martin > > > >>>>>> On Fri, 12 Apr 2019 11:02:52 +0200, Christoph Litauer said: >> >> Dear bacula users, >> >> I am using bacula 9.0.4. I wonder about a strange effect: >> >> Sometimes I get restore requests without a concrete timestamp. The users >> can't remember the time of removal. In these cases I use the bconsole query >> command, option 2 "List where the most recent copies of a file are saved". >> Example: >> >> Choose a query (1-20): 2 >> /var/spool/imap/d/user/someuser/Transkriptionen/ >> Enter filename: cyrus.index >> Enter Client name: imap1 >> +---+-+++ >> | jobid | jobstarttime| volumename | clientname | >> +---+-+++ >> | 1,100,162 | 2019-03-27 00:07:01 | File-1107 | imap1 | >> | 1,100,162 | 2019-03-27 00:07:01 | File-1157 | imap1 | >> | 1,100,162 | 2019-03-27 00:07:01 | File-1500 | imap1 | >> | 1,100,162 | 2019-03-27 00:07:01 | File-1828 | imap1 | >> | 1,100,162 | 2019-03-27 00:07:01 | File-1995 | imap1 | >> +---+-+++ >> >> Then I try to find the file with "list files job=1100162", but no luck. I am >> not able to restore the file in the queried job. >> >> Is my index corrupt? But we never had problems restoring files (with >> concrete timestamps). Or is the query weird? >> >> -- >> Kind regards >> Christoph >> _ >> Uni Koblenz, Computing Centre, Office A 022 >> Postfach 201602, 56016 Koblenz >> Fon: +49 261 287-1311, Fax: -100 1311 >> >> >> >> >> >> >> ___ >> Bacula-users mailing list >> Bacula-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/bacula-users >> -- Freundliche Grüße Christoph Litauer _ Uni Koblenz, Rechenzentrum, Raum A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Query for "most recent copies of a file"
Dear bacula users, I am using bacula 9.0.4. I wonder about a strange effect: Sometimes I get restore requests without a concrete timestamp. The users can't remember the time of removal. In these cases I use the bconsole query command, option 2 "List where the most recent copies of a file are saved". Example: Choose a query (1-20): 2 /var/spool/imap/d/user/someuser/Transkriptionen/ Enter filename: cyrus.index Enter Client name: imap1 +---+-+++ | jobid | jobstarttime| volumename | clientname | +---+-+++ | 1,100,162 | 2019-03-27 00:07:01 | File-1107 | imap1 | | 1,100,162 | 2019-03-27 00:07:01 | File-1157 | imap1 | | 1,100,162 | 2019-03-27 00:07:01 | File-1500 | imap1 | | 1,100,162 | 2019-03-27 00:07:01 | File-1828 | imap1 | | 1,100,162 | 2019-03-27 00:07:01 | File-1995 | imap1 | +---+-+++ Then I try to find the file with "list files job=1100162", but no luck. I am not able to restore the file in the queried job. Is my index corrupt? But we never had problems restoring files (with concrete timestamps). Or is the query weird? -- Kind regards Christoph _ Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore uses wrong autochanger
Thanks for your suggestions. In the meantime I changed the mediatype and restores work now. But would it be possible to use a shared scratch pool of tapes when setting different mediatypes for different libraries? > Am 18.07.2018 um 11:22 schrieb Radosław Korzeniewski > : > > Hello, > > 2018-07-17 13:57 GMT+02:00 Christoph Litauer : > Maybe the problem is that both libraries are of type LTO6? > > > I think this is a main issue here. All your devices have MediaType=LTO6 which > tells Bacula it can use any drive with any volume which has the same > MediaType parameter set. This is the only parameter which allows Bacula to > distinguish tape/drive physical separation. All you need is to change the > configuration and manual update the media type for volumes in catalog. > > best regards > -- > Radosław Korzeniewski > rados...@korzeniewski.net -- Freundliche Grüße Christoph Litauer _ Uni Koblenz, Rechenzentrum, Raum A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restore uses wrong autochanger
Dear bacula users, using bacula 9.0.4. My situation: I have two nearly identical LTO-6 libraries. I use "Neo400" for Full backups "FlexStorII" for Diff backups. bacula-sd.conf is attached. Preparing a restore that needs a full and a diff backup I get the output: The Job will require the following (*=>InChanger): Volume(s) Storage(s)SD Device(s) === *LTO6-020 Neo400Neo400 *LTO6-002 FlexStorIIFlexStor2 Volumes marked with "*" are in the Autochanger. So LTO6-020 (Full) is in Neo400 while LTO6-002 is in FlexStorII. Both are available. Starting the restore leads to: 17-Jul 12:40 bacula-dir JobId 1016825: Start Restore Job RestoreFiles.2018-07-17_12.40.22_19 17-Jul 12:40 bacula-dir JobId 1016825: Using Device "LTO6-1" to read. 17-Jul 12:40 bacula-sd JobId 1016825: 3307 Issuing autochanger "unload Volume LTO6-002, Slot 3, Drive 1" command. 17-Jul 12:40 bacula-sd JobId 1016825: 3304 Issuing autochanger "load Volume LTO6-020, Slot 20, Drive 1" command. 17-Jul 12:41 bacula-sd JobId 1016825: 3305 Autochanger "load Volume LTO6-020, Slot 20, Drive 1", status is OK. 17-Jul 12:41 bacula-sd JobId 1016825: Ready to read from volume "LTO6-020" on Tape device "LTO6-1" (/dev/tape/by-id/scsi-35000e11150246004-nst). 17-Jul 12:41 bacula-sd JobId 1016825: Forward spacing Volume "LTO6-020" to addr=88:0 17-Jul 12:42 imap3 JobId 1016825: drwxr-xr-x 15 root root4096 2016-01-18 10:42:03 /tmp/bacula-restores/var/spool/ 17-Jul 12:44 imap3 JobId 1016825: drwxr-xr-x 4 cyrusmail 34 2016-01-19 04:58:27 /tmp/bacula-restores/var/spool/imap/l/ 17-Jul 12:45 imap3 JobId 1016825: -rw--- 1 cyrusmail 128 2017-03-31 12:35:19 /tmp/bacula-restores/var/spool/imap/l/user/litauer/Trash/cyrus.index 17-Jul 12:45 imap3 JobId 1016825: -rw--- 1 cyrusmail 4 2017-03-31 12:35:19 /tmp/bacula-restores/var/spool/imap/l/user/litauer/Trash/cyrus.cache 17-Jul 12:45 imap3 JobId 1016825: -rw--- 1 cyrusmail 189 2017-03-31 12:35:19 /tmp/bacula-restores/var/spool/imap/l/user/litauer/Trash/cyrus.header 17-Jul 12:45 imap3 JobId 1016825: drwx-- 2 cyrusmail 77 2017-03-31 12:35:19 /tmp/bacula-restores/var/spool/imap/l/user/litauer/Trash/ 17-Jul 12:47 bacula-sd JobId 1016825: End of Volume "LTO6-020" at addr=136:8676 on device "LTO6-1" (/dev/tape/by-id/scsi-35000e11150246004-nst). 17-Jul 12:47 imap3 JobId 1016825: drwxr-xr-x 17 root root4096 2017-07-06 13:50:37 /tmp/bacula-restores/var/ 17-Jul 12:47 bacula-sd JobId 1016825: 3307 Issuing autochanger "unload Volume LTO6-020, Slot 20, Drive 1" command. 17-Jul 12:48 bacula-sd JobId 1016825: 3304 Issuing autochanger "load Volume LTO6-002, Slot 3, Drive 1" command. 17-Jul 12:49 bacula-sd JobId 1016825: 3305 Autochanger "load Volume LTO6-002, Slot 3, Drive 1", status is OK. 17-Jul 12:49 bacula-sd JobId 1016825: 3307 Issuing autochanger "unload Volume LTO6-002, Slot 3, Drive 1" command. 17-Jul 12:50 bacula-sd JobId 1016825: Warning: acquire.c:279 Read acquire: Wrong Volume mounted on Tape device "LTO6-1" (/dev/tape/by-id/scsi-35000e11150246004-nst): Wanted LTO6-002 have LTO6-003 17-Jul 12:50 bacula-sd JobId 1016825: 3304 Issuing autochanger "load Volume LTO6-002, Slot 3, Drive 1" command. 17-Jul 12:50 bacula-sd JobId 1016825: 3305 Autochanger "load Volume LTO6-002, Slot 3, Drive 1", status is OK. 17-Jul 12:50 bacula-sd JobId 1016825: 3307 Issuing autochanger "unload Volume LTO6-002, Slot 3, Drive 1" command. 17-Jul 12:51 bacula-sd JobId 1016825: Warning: acquire.c:279 Read acquire: Wrong Volume mounted on Tape device "LTO6-1" (/dev/tape/by-id/scsi-35000e11150246004-nst): Wanted LTO6-002 have LTO6-003 As you can see, tape LTO6-002 is found in slot 3. So bacula tries to load slot 3 -- but uses library Neo400 instead of FlexStorII. This results in a "wrong volume" error. Is this a bug or should I configure my libraries in some other way? Maybe the problem is that both libraries are of type LTO6? -- Kind regards Christoph Litauer _ Uni Koblenz, Rechenzentrum, Raum A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 bacula-sd.conf Description: Binary data -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Relabel tapes without loosing data
Thank you all for your answers and suggestions. In the meantime I found out that the problem is ... the laser printer that I printed the labels with. The label format doesn't matter at all. I printed new labels with an ink jet. Now the recognition is 100%. Maybe the fixed black toner has a higher reflection and confuses the barcode reader ... > Am 03.07.2018 um 15:59 schrieb Wolfgang Denk : > > Dear Christoph, > > In message <1be9171a-8dd0-48f3-aad5-d4ff9a8b7...@uni-koblenz.de> you wrote: >> >> I think I know the answer ("not possible") but maybe someone has an idea: > > Right - you cannot (re-) write any data at the start of the tape > without loing all data after it. > >> Some years ago I labeled all my LTO-6 tapes with manual printed >> stickers "LTO6-###". As you can see, there are 5 alphanumeric >> characters followed by 3 digits. The barcode standard allows this >> and my LTO devices never had problems with that kind of labels. >> My new tape library (Overland Neo Series T48) does. Sometimes it >> recognises the labels, sometimes not. I think this is because >> LTO-labels should have max. 3 characters followed by max 3 digits >> followed by the LTO series number (LTO###L6). >> I would have no problem in printing new labels, but the tapes have >> to be physically relabelled. Is it possible without loosing the >> tape data? (no). > > No, this cannot be done. At best, you can relabel the tapes when > you re-use them, i. e. when you rewrite all of the content anyway. > >> Any other ideas how to switch my old tapes to the new label scheme? > > Well... who really needs the barcode labels to be exactly the same as > the on-tape and in-database labels? I think this is just for your > own convenience, so you can match the "mtx status" output and bacula > messages against the physical label on the tapes. > > But then - in your old labels, the "LTO" part is redundant at least, > and you don't really need it to identify a tape if it's the same on > all tapes. If I were you, I would just print new bracode labels, > and omit the "LT" part. i. e., instead of "LTO6-###" you get > "O6-###L6". Then you can still easily match the "real" label to the > barcode stickers, and don't have to change anything software-wise. > > And the "O6-" prefeix could even be explained as "old LTO6 label" > format :-) > > [Of course, you should not attempt to use this with a "label ... > barcodes" command and result in the old tape names; but I guess for > new tapes you would switch to a new label scheme anyway.]] > > Hope this helps. > > Viele Grüße, > > Wolfgang Denk > > -- > DENX Software Engineering GmbH, Managing Director: Wolfgang Denk > HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany > Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de > The ultimate barrier is one's viewpoint. >- Terry Pratchett, _The Dark Side of the Sun_ -- Freundliche Grüße Christoph Litauer _ Uni Koblenz, Rechenzentrum, Raum A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Relabel tapes without loosing data
Dear bacula users, I think I know the answer ("not possible") but maybe someone has an idea: Some years ago I labeled all my LTO-6 tapes with manual printed stickers "LTO6-###". As you can see, there are 5 alphanumeric characters followed by 3 digits. The barcode standard allows this and my LTO devices never had problems with that kind of labels. My new tape library (Overland Neo Series T48) does. Sometimes it recognises the labels, sometimes not. I think this is because LTO-labels should have max. 3 characters followed by max 3 digits followed by the LTO series number (LTO###L6). I would have no problem in printing new labels, but the tapes have to be physically relabelled. Is it possible without loosing the tape data? (no) Any other ideas how to switch my old tapes to the new label scheme? -- Kind regards Christoph _ Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] print numbers without thousands separators
Just what I wanted, thanks a lot! > Am 25.09.2017 um 11:52 schrieb Radosław Korzeniewski > <rados...@korzeniewski.net>: > > Hello, > > 2017-09-23 19:06 GMT+02:00 Dimitri Maziuk <dmaz...@bmrb.wisc.edu>: > On 2017-09-23 07:04, Dan Langille wrote: > > Why? Because nobody wants it enough. > > > Well, there is a switch in bconsole: gui on which does what OP wants. Yes, it > is not permanent. > > *list jobid=55177 > Automatically selected Catalog: Catalog > Using Catalog "Catalog" > ++---+-+--+---+--+--+---+ > | jobid | name | starttime | type | level | jobfiles | > jobbytes | jobstatus | > ++---+-+--+---+--+--+---+ > | 55,177 | SYS-Admin | 2017-09-25 06:56:14 | D| |0 | > 0 | T | > ++---+-+--+---+--+--+---+ > *gui on > *list jobid=55177 > ++---+-+--+---+--+--+---+ > | jobid | name | starttime | type | level | jobfiles | > jobbytes | jobstatus | > ++---+-+--+---+--+--+---+ > | 55177 | SYS-Admin | 2017-09-25 06:56:14 | D| | 0| 0 > | T | > ++---+-+--+---+--+--+---+ > > best regards > -- > Radosław Korzeniewski > rados...@korzeniewski.net > -- > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! > http://sdm.link/slashdot___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- Freundliche Grüße Christoph Litauer _ Uni Koblenz, Rechenzentrum, Raum A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] print numbers without thousands separators
Dear bacula users, using bacula for many years without problems now. Great software! One little thing would be nice: In bconsole, querying e.g. "List alle backups for a client" results in +-+---++---+-+--+---++ | jobid | client| fileset| level | starttime | jobfiles | jobbytes | volumename | +-+---++---+-+--+---++ | 821,494 | printhost | client files-to-backup | F | 2016-11-19 00:10:53 | 222,727 | 5,945,291,349 | LTO6-012 | As you can see, all numbers are printed using thousands separators. I think this is independent on the current locale (tried with C and en). These numbers cannot be reused (by copy/paste) within bconsole or some other scripts without reformatting. Selecting information using psql seems to ommit those separators. Would be nice, if bconsole didn't print separators within numbers. -- Kind regards Christoph _ Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] restore fails, bls succeeds
Dear bacula-users, I am using bacula 7.2.0 I am trying to restore some data. the restore fails with 13-Feb 15:26 bacula-sd JobId 845497: Ready to read from volume "File-2039" on file device "FileStorage0" (/storageB/changer/drive0). 13-Feb 15:26 bacula-sd JobId 845497: Forward spacing Volume "File-2039" to file:block 3:3560165384. 13-Feb 15:26 bacula-sd JobId 845497: Error: block_util.c:312 Volume data error at 3:3560165384! Wanted ID: "BB02", got "Èòå". Buffer discarded. File-2039 is a virtual tape (file). I checked the "tape" with bls: bacula:~ # bls -L -V File-2039 FileStorage0 bls: butil.c:294-0 Using device: "FileStorage0" for reading. 13-Feb 15:35 bls JobId 0: No slot defined in catalog (slot=0) for Volume "File-2039" on "FileStorage0" (/storageB/changer/drive0). 13-Feb 15:35 bls JobId 0: Cartridge change or "update slots" may be required. 13-Feb 15:35 bls JobId 0: Ready to read from volume "File-2039" on file device "FileStorage0" (/storageB/changer/drive0). Volume Label: Id: Bacula 1.0 immortal VerNo : 11 VolName : File-2039 PrevVolName : VolFile : 0 LabelType : VOL_LABEL LabelSize : 160 PoolName : Scratch MediaType : File PoolType : Backup HostName : baculanew Date label written: 02-Sep-2010 16:14 bacula:~ # bls -j -V File-2039 FileStorage0 bls: butil.c:294-0 Using device: "FileStorage0" for reading. 13-Feb 15:32 bls JobId 0: No slot defined in catalog (slot=0) for Volume "File-2039" on "FileStorage0" (/storageB/changer/drive0). 13-Feb 15:32 bls JobId 0: Cartridge change or "update slots" may be required. 13-Feb 15:32 bls JobId 0: Ready to read from volume "File-2039" on file device "FileStorage0" (/storageB/changer/drive0). Volume Record: File:blk=0:195 SessId=6235 SessTime=1484314938 JobId=7 DataLen=160 End Job Session Record: File:blk=3:2650423294 SessId=6235 SessTime=1484314938 JobId=842668 Date=04-Feb-2017 05:41:52 Level=D Type=B Files=299,117 Bytes=59,380,812,240 Errors=0 Status=T End Job Session Record: File:blk=4:2694503927 SessId=6249 SessTime=1484314938 JobId=842672 Date=04-Feb-2017 05:36:02 Level=D Type=B Files=357,870 Bytes=66,880,557,798 Errors=0 Status=T 13-Feb 15:33 bls JobId 0: End of Volume at file 4 on device "FileStorage0" (/storageB/changer/drive0), Volume "File-2039" 13-Feb 15:33 bls JobId 0: End of all volumes. Seems as if the tape is OK? Any ideas why the restore fails? -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] pruning fails
Ana, in german we have a saying: "Erst denken, dann reden" … maybe in english it's "think before you speak" … Next time I will take care of this saying and think before I ask dumb questions …. :-) Thanks a lot and sorry for annoying the community! > Am 10.02.2016 um 21:53 schrieb Ana Emília M. Arruda <emiliaarr...@gmail.com>: > > Hello Christoph, > > The retention period for your volume is 6 months (180 days). And I think that > you will be able to prune this volume at 2016-02-11 11:17:11 (passed 180 > days). > > Best regards, > Ana > > On Wed, Feb 10, 2016 at 2:48 PM, Christoph Litauer <lita...@uni-koblenz.de > <mailto:lita...@uni-koblenz.de>> wrote: > Dear bacula users, > > I am running bacula 7.2.0. > > Yesterday I recognized that bacula doesn't seem to recycle one of my pools. > Pool "Full" has a volume retention of 6 month, but see what happens: > > *list files volume=FileM-0092 > +-++---+-++--+--+-+--+---+---+--+-+ > | mediaid | volumename | volstatus | enabled | volbytes | volfiles | > volretention | recycle | slot | inchanger | mediatype | volparts | > lastwritten | > +-++---+-++--+--+-+--+---+---+--+-+ > | 4,712 | FileM-0092 | Full | 1 | 21,474,818,746 |4 | > 15,552,000 | 1 | 92 | 1 | FileM |0 | 2015-08-15 > 11:17:10 | > +-++---+-++--+--+-+--+---+---+--+-+ > > *prune volume=FileM-0092 > The current Volume retention period is: 6 months > Continue? (yes/mod/no): yes > Found no Job associated with the Volume "FileM-0092" to prune > > > I think FileM-0092 should be purged because it was last written at > 2015-08-15. Any ideas? -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Site24x7 APM Insight: Get Deep Visibility into Application Performance APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month Monitor end-to-end web transactions and take corrective actions now Troubleshoot faster and improve end-user experience. Signup Now! http://pubads.g.doubleclick.net/gampad/clk?id=272487151=/4140___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] pruning fails
Dear bacula users, I am running bacula 7.2.0. Yesterday I recognized that bacula doesn't seem to recycle one of my pools. Pool "Full" has a volume retention of 6 month, but see what happens: *list files volume=FileM-0092 +-++---+-++--+--+-+--+---+---+--+-+ | mediaid | volumename | volstatus | enabled | volbytes | volfiles | volretention | recycle | slot | inchanger | mediatype | volparts | lastwritten | +-++---+-++--+--+-+--+---+---+--+-+ | 4,712 | FileM-0092 | Full | 1 | 21,474,818,746 |4 | 15,552,000 | 1 | 92 | 1 | FileM |0 | 2015-08-15 11:17:10 | +-++---+-++--+--+-+--+---+---+--+-+ *prune volume=FileM-0092 The current Volume retention period is: 6 months Continue? (yes/mod/no): yes Found no Job associated with the Volume "FileM-0092" to prune I think FileM-0092 should be purged because it was last written at 2015-08-15. Any ideas? -- Kind regards Christoph _________ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Site24x7 APM Insight: Get Deep Visibility into Application Performance APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month Monitor end-to-end web transactions and take corrective actions now Troubleshoot faster and improve end-user experience. Signup Now! http://pubads.g.doubleclick.net/gampad/clk?id=272487151=/4140 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Anyone know if Webacula 7.0 works on Bacula 7.2?
Mike, I am running 7.0.0, build 2014.10.05 together with bacula 7.2 without problems. > Am 14.01.2016 um 20:03 schrieb Brady, Mike <mike.br...@devnull.net.nz>: > > There are DB changes in Bacula 7.2 so wondering if Webacula still works. > -- Kind regards Christoph _____ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Site24x7 APM Insight: Get Deep Visibility into Application Performance APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month Monitor end-to-end web transactions and take corrective actions now Troubleshoot faster and improve end-user experience. Signup Now! http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Typical tape write performance
Hi Alan, maybe this is an important hint … I thought btape doesn't use a disk at all. Instead it uses on-the-fly generation of test data … does it? If btape uses the configured spool directory I have to take a look at that point. > Am 30.11.2015 um 17:00 schrieb Alan Brown <a...@mssl.ucl.ac.uk>: > > On 30/11/15 15:32, Christoph Litauer wrote: >> Andrew, >> >> many thanks for this hint. I installed the IBM driver and found the tape >> drive testing tool itdt, too. >> Now, using itdt and the new driver there is an improvement: >> LTO6: 158 MB/s without compression, 177MB/s with compression >> LTO4: 27 MB/s without compression, 128 MB/s with compression. >> >> For LTO6 this is in fact near to the theoretical limit (regarding random >> data). >> >> Using btape with the new driver I still got 153MB/s (with compression) resp. >> 39 MB/s (random data). >> Seems as if there is a bottleneck in bacula? >> My device configuration: >> > > or a bottleneck in your disks. > > What is the physical makeup of /var/spool/bacula and how many simultaneous > sessions have you got using that point? > > > >> Device { >> Name = "LTO6-1" >> Device Type = Tape; >> Media Type = LTO6 >> Archive Device = /dev/IBMtape0n >> AutomaticMount = yes; >> AlwaysOpen = yes; >> RemovableMedia = yes; >> RandomAccess = no; >> Spool Directory = /var/spool/bacula >> Maximum Spool Size = 300G >> Maximum File Size = 5G >> Maximum Block Size = 1m >> } >> >> >>> Am 28.11.2015 um 08:56 schrieb Andrew Ryder <tire...@shaw.ca>: >>> >>> Are you using the IBM Linux tape driver? If not, I'd suggest installing it >>> vs the generic linux kernel's tape driver. >>> >>> http://www-933.ibm.com/support/fixcentral/swg/selectFixes?parent=Tape%2Bdrivers%2Band%2Bsoftware=ibm/Storage_Tape/Tape+device+drivers=1.0=Linux=all >>> >>> On 11/27/2015 08:43 AM, Christoph Litauer wrote: >>>> Dear bacula users, >>>> >>>> I recently recognized that my tape drives do not perform as expected. >>>> Neither while used with bacula nor native with dd. I did many performance >>>> tests in the meantime but could not figure out the reason. So may I ask in >>>> this group what typical write speeds you have with your tape drives? >>>> >>>> I tested LTO6 (IBM Ultrium HH6) and LTO4 (Ultrium 4-SCSI). Both are part >>>> of two libraries connected via SAS to a LSI SAS3801E-controller. The host >>>> system runs SLES12. >>>> I used btape and dd for writing. >>>> I figured out the best writing performance with blocksize 512KB (LTO4) >>>> resp. 2MB (LTO6). Both drives with compression on. >>>> >>>> LTO4 best performance (writing zeros): 115 MB/s >>>> LTO4 worst performance (random data): 71.58 MB/s >>>> >>>> LTO6 best performance (zeros): 153 MB/s >>>> LTO6 worst performance (random): 58 MB/s >>>> >>>> Disabling compression does not change the maximum speed. In this case >>>> writing zeros is the same as writing random date (expected). >>>> >>>> According to Wikipedia, theoretical speed should be >>>> LTO4: 240 resp. 120MB/s >>>> LTO6: 400 resp. 160MB/s >>>> >>>> Any ideas welcome! Thanks in advance! >>>> >>>> -- >>>> Kind regards >>>> Christoph >>>> _ >>>> Christoph Litauer >>>> Uni Koblenz, Computing Centre, Office A 022 >>>> Postfach 201602, 56016 Koblenz >>>> Fon: +49 261 287-1311, Fax: -100 1311 >>>> >>>> >>>> >>>> >>>> -- >>>> ___ >>>> Bacula-users mailing list >>>> Bacula-users@lists.sourceforge.net >>>> https://lists.sourceforge.net/lists/listinfo/bacula-users >>>> >> >> -- >> Freundliche Grüße >> Christoph Litauer >> _____ >> Christoph Litauer >> Uni Koblenz, Rechenzentrum, Raum A 022 >> Postfach 201602, 56016 Koblenz >> Fon: +49 261 287-1311, Fax: -100 1311 >> >> >> >> >> >> -- >> Go from Ide
Re: [Bacula-users] Typical tape write performance
Andrew, many thanks for this hint. I installed the IBM driver and found the tape drive testing tool itdt, too. Now, using itdt and the new driver there is an improvement: LTO6: 158 MB/s without compression, 177MB/s with compression LTO4: 27 MB/s without compression, 128 MB/s with compression. For LTO6 this is in fact near to the theoretical limit (regarding random data). Using btape with the new driver I still got 153MB/s (with compression) resp. 39 MB/s (random data). Seems as if there is a bottleneck in bacula? My device configuration: Device { Name = "LTO6-1" Device Type = Tape; Media Type = LTO6 Archive Device = /dev/IBMtape0n AutomaticMount = yes; AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; Spool Directory = /var/spool/bacula Maximum Spool Size = 300G Maximum File Size = 5G Maximum Block Size = 1m } > Am 28.11.2015 um 08:56 schrieb Andrew Ryder <tire...@shaw.ca>: > > Are you using the IBM Linux tape driver? If not, I'd suggest installing it vs > the generic linux kernel's tape driver. > > http://www-933.ibm.com/support/fixcentral/swg/selectFixes?parent=Tape%2Bdrivers%2Band%2Bsoftware=ibm/Storage_Tape/Tape+device+drivers=1.0=Linux=all > > On 11/27/2015 08:43 AM, Christoph Litauer wrote: >> Dear bacula users, >> >> I recently recognized that my tape drives do not perform as expected. >> Neither while used with bacula nor native with dd. I did many performance >> tests in the meantime but could not figure out the reason. So may I ask in >> this group what typical write speeds you have with your tape drives? >> >> I tested LTO6 (IBM Ultrium HH6) and LTO4 (Ultrium 4-SCSI). Both are part of >> two libraries connected via SAS to a LSI SAS3801E-controller. The host >> system runs SLES12. >> I used btape and dd for writing. >> I figured out the best writing performance with blocksize 512KB (LTO4) resp. >> 2MB (LTO6). Both drives with compression on. >> >> LTO4 best performance (writing zeros): 115 MB/s >> LTO4 worst performance (random data): 71.58 MB/s >> >> LTO6 best performance (zeros): 153 MB/s >> LTO6 worst performance (random): 58 MB/s >> >> Disabling compression does not change the maximum speed. In this case >> writing zeros is the same as writing random date (expected). >> >> According to Wikipedia, theoretical speed should be >> LTO4: 240 resp. 120MB/s >> LTO6: 400 resp. 160MB/s >> >> Any ideas welcome! Thanks in advance! >> >> -- >> Kind regards >> Christoph >> _ >> Christoph Litauer >> Uni Koblenz, Computing Centre, Office A 022 >> Postfach 201602, 56016 Koblenz >> Fon: +49 261 287-1311, Fax: -100 1311 >> >> >> >> >> -------------- >> ___ >> Bacula-users mailing list >> Bacula-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/bacula-users >> -- Freundliche Grüße Christoph Litauer _ Christoph Litauer Uni Koblenz, Rechenzentrum, Raum A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Go from Idea to Many App Stores Faster with Intel(R) XDK Give your users amazing mobile app experiences with Intel(R) XDK. Use one codebase in this all-in-one HTML5 development environment. Design, debug & build mobile apps & 2D/3D high-impact games for multiple OSs. http://pubads.g.doubleclick.net/gampad/clk?id=254741911=/4140 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Typical tape write performance
Dear bacula users, I recently recognized that my tape drives do not perform as expected. Neither while used with bacula nor native with dd. I did many performance tests in the meantime but could not figure out the reason. So may I ask in this group what typical write speeds you have with your tape drives? I tested LTO6 (IBM Ultrium HH6) and LTO4 (Ultrium 4-SCSI). Both are part of two libraries connected via SAS to a LSI SAS3801E-controller. The host system runs SLES12. I used btape and dd for writing. I figured out the best writing performance with blocksize 512KB (LTO4) resp. 2MB (LTO6). Both drives with compression on. LTO4 best performance (writing zeros): 115 MB/s LTO4 worst performance (random data): 71.58 MB/s LTO6 best performance (zeros): 153 MB/s LTO6 worst performance (random): 58 MB/s Disabling compression does not change the maximum speed. In this case writing zeros is the same as writing random date (expected). According to Wikipedia, theoretical speed should be LTO4: 240 resp. 120MB/s LTO6: 400 resp. 160MB/s Any ideas welcome! Thanks in advance! -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Message resource when copying jobs
Hello Ana, thanks for your response. No, I defined three CopyJobs (Full, Diff and Incremental). All of them have Message = "TapeCopy": Job { Name = "CopyFull" Type = Copy Messages = TapeCopy Pool = Full Selection Type = PoolUncopiedJobs Priority = 10 Schedule = Weekdays Max Start Delay = 43200 # wait max 12 hours Enabled = yes Level = Full Client = bacula } The mail body is logged in /var/log/bacula/bacula.log, too. But not in copy.log. copy.log instead has all other messages of the copy job, e.g.: 02-Oct 05:00 bacula-dir JobId 697688: Copying using JobId=697586 Job=holmes.2015-10-02_00.07.00_21 02-Oct 05:00 bacula-dir JobId 697688: Bootstrap records written to /var/bacula/bacula-dir.restore.10.bsr 02-Oct 05:09 bacula-dir JobId 697688: Start Copying JobId 697688, Job=CopyIncr.2015-10-02_05.00.03_04 02-Oct 05:09 bacula-dir JobId 697688: Using Device "FileStorage0" to read. 02-Oct 05:09 bacula-sd JobId 697688: 3307 Issuing autochanger "unload slot 1415, drive 0" command. 02-Oct 05:09 bacula-sd JobId 697688: 3304 Issuing autochanger "load slot 2436, drive 0" command. 02-Oct 05:09 bacula-sd JobId 697688: 3305 Autochanger "load slot 2436, drive 0", status is OK. 02-Oct 05:09 bacula-sd JobId 697688: Ready to read from volume "File-2436" on file device "FileStorage0" (/storage/changer/drive0). 02-Oct 05:09 bacula-sd JobId 697688: Forward spacing Volume "File-2436" to file:block 4:4182819019. 02-Oct 05:09 bacula-sd JobId 697688: End of Volume at file 4 on device "FileStorage0" (/storage/changer/drive0), Volume "File-2436" 02-Oct 05:09 bacula-sd JobId 697688: 3307 Issuing autochanger "unload slot 2436, drive 0" command. 02-Oct 05:09 bacula-sd JobId 697688: 3304 Issuing autochanger "load slot 2126, drive 0" command. 02-Oct 05:09 bacula-sd JobId 697688: 3305 Autochanger "load slot 2126, drive 0", status is OK. 02-Oct 05:09 bacula-sd JobId 697688: Ready to read from volume "File-2126" on file device "FileStorage0" (/storage/changer/drive0). 02-Oct 05:09 bacula-sd JobId 697688: Forward spacing Volume "File-2126" to file:block 0:196. 02-Oct 05:09 bacula-sd JobId 697688: End of Volume at file 0 on device "FileStorage0" (/storage/changer/drive0), Volume "File-2126" 02-Oct 05:09 bacula-sd JobId 697688: End of all volumes. 02-Oct 05:09 bacula-sd JobId 697688: Elapsed time=00:00:04, Transfer rate=89.96 M Bytes/second 02-Oct 05:09 bacula-dir JobId 697688: Bacula bacula-dir 7.2.0 (14Aug15): Build OS: x86_64-suse-linux-gnu suse 12 Prev Backup JobId: 697586 Prev Backup Job:holmes.2015-10-02_00.07.00_21 New Backup JobId: 697689 Current JobId: 697688 Current Job:CopyIncr.2015-10-02_05.00.03_04 Backup Level: Full Client: bacula FileSet:"client files-to-backup" 2007-04-18 16:16:43 Read Pool: "Incr" (From Command input) Read Storage: "DiskChanger" (From Pool resource) Write Pool: "LTOincr" (From Command input) Write Storage: "Scalar50" (From Command input) Catalog:"MyCatalog" (From Client resource) Start time: 02-Oct-2015 05:09:01 End time: 02-Oct-2015 05:09:06 Elapsed time: 5 secs Priority: 10 SD Files Written: 112 SD Bytes Written: 359,861,747 (359.8 MB) Rate: 71972.4 KB/s Volume name(s): LTO4-053 Volume Session Id: 112 Volume Session Time:1443691351 Last Volume Bytes: 179,426,806,784 (179.4 GB) SD Errors: 0 SD termination status: OK Termination:Copying OK > Am 02.10.2015 um 19:21 schrieb Ana Emília M. Arruda <emiliaarr...@gmail.com>: > > Hello Christoph, > > How is your job copy "messages" directive defined? It seems it is configured > as "messages = Standard". Could you check if the text of this e-mail appears > in /var/log/bacula/bacula.log or /var/log/bacula/copy.log? > > Best regards, > Ana > > On Fri, Oct 2, 2015 at 9:22 AM, Christoph Litauer <lita...@uni-koblenz.de> > wrote: > Dear bacula users, > > I recently upgraded from 5.1.3 to 7.2.0. > Runs like a charm except for one thing: > We do copy jobs every morning to copy the disk backups to tape. Every copy > job sends a mail reporting "Backup OK of clientname incremental". Never had > this in 5.1.3. > My message ressources are: > > Messages { > Name = Standard > mailcommand = "/usr/bin/mail -r \"Bacula \<%r\>\" -s \"Bacula: %t %e of %c > %l\" %r" > operatorcommand = &qu
[Bacula-users] Message resource when copying jobs
Dear bacula users, I recently upgraded from 5.1.3 to 7.2.0. Runs like a charm except for one thing: We do copy jobs every morning to copy the disk backups to tape. Every copy job sends a mail reporting "Backup OK of clientname incremental". Never had this in 5.1.3. My message ressources are: Messages { Name = Standard mailcommand = "/usr/bin/mail -r \"Bacula \<%r\>\" -s \"Bacula: %t %e of %c %l\" %r" operatorcommand = "/usr/bin/mail -r \"Bacula \<%r\>\" -s \"Bacula: Intervention needed for %j\" %r" mail = bacula at uni-koblenz.de = all, !skipped, !restored operator = litauer at uni-koblenz.de = mount console = all, !skipped, !saved, !restored catalog = all, !skipped, !saved append = "/var/log/bacula/bacula.log" = all, !skipped, !restored } Messages { Name = TapeCopy mailcommand = "/usr/bin/mail -r \"Bacula \<%r\>\" -s \"Bacula tape copy\" %r" operatorcommand = "/usr/bin/mail -r \"Bacula \<%r\>\" -s \"Bacula: Intervention needed for %j\" %r" Mail On Error = lita...@uni-koblenz.de = all, !skipped operator = lita...@uni-koblenz.de = mount append = "/var/log/bacula/copy.log" = all, !skipped } Example mail when a copy job is run: From: Bacula <bac...@uni-koblenz.de> To: bac...@uni-koblenz.de Subject: Bacula: Backup OK of clientname Incremental 02-Oct 05:09 bacula-dir JobId 697689: Using Device "LTO4-0" to write. 02-Oct 05:09 bacula-sd JobId 697689: Elapsed time=00:00:04, Transfer rate=89.96 M Bytes/second 02-Oct 05:09 bacula-sd JobId 697689: Sending spooled attrs to the Director. Despooling 26,284 bytes … I understand that a copy job in fact is a combined restore and backup job. But wouldn't it be enough to only get the copy job status? -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Upgrade from Incremental to Full issue?
Just define one Schedule with different levels and different pools: Schedule { Name = Schedule1 Run = Level=Full Pool=Pool1 Tue at 21:00 Run = Level=Incremental Pool=Pool2 Wed at 22:00 } Am 28.07.2015 um 16:44 schrieb jalil1408 bacula-fo...@backupcentral.com: Got it! The incremental backup is based on the full backup executed with: - The same Job name. (in my case I have different jobs: Job1 and Job2) - The same Client name. - The same FileSet (any change to the definition of the FileSet such as adding or deleting a file in the Include or Exclude sections constitutes a different FileSet. Why isn't it based only on the same Client and the same Fileset only? -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Record header index xxxx not equal record index yyyy
Kern, thank you for your quick response. I did the restore twice with exactly the same numbers in the error message. As the autochanger is a disk based changer, the drives are virtual (symbolic links) so I won't expect any difference. I tried to read the tapes using bscan, but it crashes with a segmentation fault while reading File-2563. This morning I did a bextract using the bootstrap file of client aleph1. That recovered my files. Am 11.11.2013 um 19:07 schrieb Kern Sibbald k...@sibbald.com: I am assuming that aleph1 is the name of your File daemon, and what it is say is that it had received a header for the 309262 record, and when the record arrived it was 329209, so it gave up. The errors after that one are meaningless ... This may have been a one time comm line hit or error, or it may be a permanent error in reading back the data in the Storage Daemon. The first step is to try the restore again. If that fails with exactly the same error (same numbers) force Bacula to read the device (a disk I imagine) on a different drive since the mount was so fast. If the error occurs, but the numbers are different, check your network and switches. Best regards, Kern On 11/11/2013 05:42 PM, Christoph Litauer wrote: Dear bacula users, I am trying to restore some files, but get the following output: 11-Nov 15:22 bacula-dir JobId 497604: Start Restore Job RestoreFiles.2013-11-11_15.22.03_45 11-Nov 15:22 bacula-dir JobId 497604: Using Device FileStorage0 to read. 11-Nov 15:22 bacula-sd JobId 497604: 3307 Issuing autochanger unload slot 2563, drive 1 command. 11-Nov 15:22 bacula-sd JobId 497604: 3304 Issuing autochanger load slot 2563, drive 0 command. 11-Nov 15:22 bacula-sd JobId 497604: 3305 Autochanger load slot 2563, drive 0, status is OK. 11-Nov 15:22 bacula-sd JobId 497604: Ready to read from volume File-2563 on device FileStorage0 (/storage/changer/drive0). 11-Nov 15:22 bacula-sd JobId 497604: Forward spacing Volume File-2563 to file:block 1:3704520861. 11-Nov 15:22 aleph1 JobId 497604: Fatal error: Record header file index 309262 not equal record index 329209 11-Nov 15:22 bacula-sd JobId 497604: Error: bsock.c:429 Write error sending 65536 bytes to client:141.26.64.17:9103: ERR=Connection reset by peer 11-Nov 15:22 bacula-sd JobId 497604: Fatal error: read.c:137 Error sending to File daemon. ERR=Connection reset by peer 11-Nov 15:22 bacula-sd JobId 497604: Error: bsock.c:375 Socket has errors=1 on call to client:141.26.64.17:9103 11-Nov 15:22 bacula-dir JobId 497604: Error: Bacula bacula-dir 5.2.13 (19Jan13): Anybody is able to explain the meaning of this error message? -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- November Webinars for C, C++, Fortran Developers Accelerate application performance with scalable programming models. Explore techniques for threading, error checking, porting, and tuning. Get the most from the latest Intel processors and coprocessors. See abstracts and register http://pubads.g.doubleclick.net/gampad/clk?id=60136231iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- November Webinars for C, C++, Fortran Developers Accelerate application performance with scalable programming models. Explore techniques for threading, error checking, porting, and tuning. Get the most from the latest Intel processors and coprocessors. See abstracts and register http://pubads.g.doubleclick.net/gampad/clk?id=60136231iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Freundliche Grüße Christoph Litauer _ Christoph Litauer Uni Koblenz, Rechenzentrum, Raum A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- November Webinars for C, C++, Fortran Developers Accelerate application performance with scalable programming models. Explore techniques for threading, error checking, porting, and tuning. Get the most from the latest Intel processors and coprocessors. See abstracts and register http://pubads.g.doubleclick.net/gampad/clk?id=60136231iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Record header index xxxx not equal record index yyyy
Dear bacula users, I am trying to restore some files, but get the following output: 11-Nov 15:22 bacula-dir JobId 497604: Start Restore Job RestoreFiles.2013-11-11_15.22.03_45 11-Nov 15:22 bacula-dir JobId 497604: Using Device FileStorage0 to read. 11-Nov 15:22 bacula-sd JobId 497604: 3307 Issuing autochanger unload slot 2563, drive 1 command. 11-Nov 15:22 bacula-sd JobId 497604: 3304 Issuing autochanger load slot 2563, drive 0 command. 11-Nov 15:22 bacula-sd JobId 497604: 3305 Autochanger load slot 2563, drive 0, status is OK. 11-Nov 15:22 bacula-sd JobId 497604: Ready to read from volume File-2563 on device FileStorage0 (/storage/changer/drive0). 11-Nov 15:22 bacula-sd JobId 497604: Forward spacing Volume File-2563 to file:block 1:3704520861. 11-Nov 15:22 aleph1 JobId 497604: Fatal error: Record header file index 309262 not equal record index 329209 11-Nov 15:22 bacula-sd JobId 497604: Error: bsock.c:429 Write error sending 65536 bytes to client:141.26.64.17:9103: ERR=Connection reset by peer 11-Nov 15:22 bacula-sd JobId 497604: Fatal error: read.c:137 Error sending to File daemon. ERR=Connection reset by peer 11-Nov 15:22 bacula-sd JobId 497604: Error: bsock.c:375 Socket has errors=1 on call to client:141.26.64.17:9103 11-Nov 15:22 bacula-dir JobId 497604: Error: Bacula bacula-dir 5.2.13 (19Jan13): Anybody is able to explain the meaning of this error message? -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- November Webinars for C, C++, Fortran Developers Accelerate application performance with scalable programming models. Explore techniques for threading, error checking, porting, and tuning. Get the most from the latest Intel processors and coprocessors. See abstracts and register http://pubads.g.doubleclick.net/gampad/clk?id=60136231iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows client backup: VSS and/or ntbackup?
Thanks Simone, I will check this out. Am 21.03.2013 um 17:36 schrieb Simone Caronni negativ...@gmail.com: Hello, On 21 March 2013 16:14, Christoph Litauer lita...@uni-koblenz.de wrote: So I wonder if VSS won't fit my needs _without_ doing a ntbackup systemstate with clientRunBeforeJob? Will a VSS backup of partition C: save all system relevant information (registry etc.) for disaster recovery? I've succesfully restored many Windows systems using only VSS. The only thing you will have on Windows Server variants is the popup window with the unexpected shutdown message stating that the system was not shutdown properly. Regards, --Simone -- You cannot discover new oceans unless you have the courage to lose sight of the shore (R. W. Emerson). -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows client backup: VSS and/or ntbackup?
Am 21.03.2013 um 16:27 schrieb Chris Adams cmad...@hiwaay.net: Once upon a time, Christoph Litauer lita...@uni-koblenz.de said: This works but has two ceveats: ntbackup runs several minutes even on an unused system and the resulting backup is severeal gb every day. It sounds like you are not excluding things you should exclude. An incremental backup of an unused system should not be several GB/day. Sorry, this is a misunderstanding. I checked it out once more: The resulting backup-file of ntbackup is about 500MB each day even if the system is rarely used. Something like this should help (but remember that changing the include/exclude will cause the next backup to be promoted to a full backup): Options { # Windows is case-preserving, NOT case-sensitive Ignore Case = yes Exclude = yes # general Windows stuff wilddir = c:/Windows/$NtServicePackUninstall$ wilddir = c:/Windows/$NtUninstall* wilddir = c:/Windows/Installer/$PatchCache$ wilddir = c:/Windows/ServicePackFiles wilddir = c:/Windows/SoftwareDistribution/Download wilddir = c:/Windows/Temp # per drive wilddir = [a-z]:/$Recycle.Bin wilddir = [a-z]:/RECYCLER wilddir = [a-z]:/System Volume Information wilddir = [a-z]:/pagefile.sys } I exclude lots of windows stuff but never excluded System Volume Information. Is it really save even if I don't use ntbackup in the future? -- Freundliche Grüße Christoph -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Send mail only to one address for one job.
Am 19.03.2013 um 10:34 schrieb Manuel Trujillo mtruji...@grupointercom.com: Hi! I would like to know if there is any possibility to send a mail about the status of two jobs to a mail address different of the system mail (please, excuse me my bad english :-/). I do it like this: In bacula-dir.conf define a new Message ressource using a different e-mail address: Messages { Name = Message for 2 Jobs mailcommand = /usr/sbin/bsmtp -h localhost -f \Bacula \bac...@uni-koblenz.de\\ -s \Bacula: %t %e of %c %l\ %r mail = mailaddress.for.2.j...@yourdomain.de = all, !skipped console = all, !skipped, !saved append = /var/log/bacula = all, !skipped } Then use this new ressource in the job ressources of your two jobs: Job { ... Messages = Messages for 2 Jobs ... } -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Windows client backup: VSS and/or ntbackup?
Dear bacula users, we use bacula for some years now, excellent tool! But there is one open question I was not able to answer 'til today: Doing windows (XP)-client backups I need the possibility to do a disaster recovery. My solution (tested successfully) is 1.) Do ntbackup backup systemstate /F c:\systemstate.bkf using ClientRunBeforeJob 2.) Do a bacula backup using VSS including c:\systemstate.bkf Disaster recovery then is 1.) Install a minimal windows client 2.) restore c: using bacula (includes systemstate.bkf) 3.) restore systemstate using ntbackup on the client 4.) reboot This works but has two ceveats: ntbackup runs several minutes even on an unused system and the resulting backup is severeal gb every day. So I wonder if VSS won't fit my needs _without_ doing a ntbackup systemstate with clientRunBeforeJob? Will a VSS backup of partition C: save all system relevant information (registry etc.) for disaster recovery? -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems restoring ownership and group
Radoslaw, Am 15.03.2013 um 16:08 schrieb Radosław Korzeniewski rados...@korzeniewski.net: I would give you any log you need ... but what logs are required? What is your restore session? How do you select a jobid, how do you mark a directory... etc... I exactly did a restore select 5 select my client and FileSet waited for the prompt and changed to /export/user2/litauer/mgmt/backend mark live mailman done Recover to the original fs in the original place lsmark shows: *live/ So, now you should be able to recover a live directory with all required permissions/ownership. If not, it means that you have no live directory on your backup (jobid) and this directory is recovered only with default permissions. Then you have to check your FileSet definition or jobid's used for recovery. Check estimate listing or you can use bls command to check if your backup has directory live. I think I found the reason: While recovering my default config for replace was ifnewer. Changing this to always recovers correct ownership and permissions ... But ... isn't this a bug? My target directory did not exist. So I would expect that everything is exacly restored even if I don't want newer files to be overridden -- there were no files or directories in place. -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Problems restoring ownership and group
Dear bacula users, since some time I have problems recovering the owner, group and permission of (some) directories. Today I took the time to trace that down: I am doing an interactive restore of nfs2:/export/user2/litauer/mgmt/backend/mailman and nfs2:/export/user2/litauer/mgmt/backend/live. Baculas index shows the correct ownership, group and permissions: $ pwd cwd is: /export/user2/litauer/mgmt/backend/ $ dir mailman drwx--x--x 3 litauer 1050 65 2012-05-18 23:20:10 /export/user2/litauer/mgmt/backend/mailman/ $ dir live drwx--x--x 3 litauer 10504096 2012-05-18 23:20:10 /export/user2/litauer/mgmt/backend/live/ I mark both directories and start a recover to the original backup-client and filesystem. Bacula dir and client fd are running version 5.2.13. The clients filesystem is of type xfs. The recovered directories look like this: nfs2:/export/user2/litauer/mgmt/backend # pwd /export/user2/litauer/mgmt/backend nfs2:/export/user2/litauer/mgmt/backend # ll -d live mailman drwxr-x--x 3 rootbacula 4096 Mar 15 10:38 live drwx--x--x 3 litauer employee 65 Mar 15 10:38 mailman nfs2:/export/user2/litauer/mgmt/backend # ll -dn live mailman drwxr-x--x 3 0 114 4096 Mar 15 10:38 live drwx--x--x 3 14255 1050 65 Mar 15 10:38 mailman As you can see, permissions of both dirs are correct. Ownership and group or mailman too. But owner and group of live are not restored. While restoring I did an strace on chown-calls at the clients bacula-fd. I can see lots of chown calls for all restored files, e.g. [pid 12033] chown(/export/user2/litauer/mgmt/backend/mailman, 14255, 1050) = 0 [pid 12033] chown(/export/user2/litauer/mgmt/backend/mailman/.svn, 14255, 1050) = 0 [pid 12033] chown(/export/user2/litauer/mgmt/backend/mailman/.svn/prop-base, 14255, 1050) = 0 [pid 12033] chown(/export/user2/litauer/mgmt/backend/live/.svn/prop-base, 14255, 1050) = 0 [pid 12033] chown(/export/user2/litauer/mgmt/backend/live/.svn/prop-base/CommandLine.exe.config.svn-base, 14255, 1050) = 0 But I miss the chown call for /export/user2/litauer/mgmt/backend/live and its subdirectory .svn. Other subdirectories inside of live are restored correctly. The problem is not exclusively present for this example recovery. It happens nearly at every restore I am doing, regardless on which client the data is restored. I wonder if this is a bug in bacula-dir or bacula-fd ... but this bug would be that serious, I cannot believe nobody else would have registered. So it seems as if it is a local problem. Any ideas? -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems restoring ownership and group
Am 15.03.2013 um 13:38 schrieb Radosław Korzeniewski rados...@korzeniewski.net: Hello, 2013/3/15 Christoph Litauer lita...@uni-koblenz.de Hi Radoslaw, Thanks for your quick repsonse! while interactive restore I changed to the parent dir (cd /export/user2/litauer/mgmt/backend) and typed mark live mailman. The parent directory still exists on the client fs. I would expect that subdirs mailman and live are restored with correct ownership. In fact mailman _is_ restored correct, just live is failing ... Any log for that? And another question what lsmark shows? Radoslaw, I would give you any log you need ... but what logs are required? The only log I know of is the log output of the restore I get via mail. Attached. lsmark shows: *live/ *.svn/ *all-wcprops *entries *format *prop-base/ *CommandLine.exe.config.svn-base *CommandLine.exe.svn-base *Manage-User.ps1.svn-base *ManageDomain.exe.svn-base *WLACSDK_20100224.zip.svn-base *usage.txt.svn-base *props *text-base/ *CommandLine.exe.config.svn-base *CommandLine.exe.svn-base *Manage-User.ps1.svn-base *ManageDomain.exe.config.svn-base *ManageDomain.exe.svn-base *WLACSDK_20100224.zip.svn-base *sample-ps.txt.svn-base *usage.txt.svn-base *tmp/ *prop-base *props *text-base *CommandLine.exe *CommandLine.exe.config *Manage-User.ps1 *ManageDomain.exe *ManageDomain.exe.config *WLACSDK_20100224.zip *sample-ps.txt *usage.txt *mailman/ *.svn/ *all-wcprops *entries *format *prop-base *props *text-base/ *muster.moderated.svn-base *muster.unmoderated.svn-base *tmp/ *prop-base *props *text-base *muster.moderated *muster.unmoderated -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 ---BeginMessage--- 15-Mar 14:33 bacula-dir JobId 430904: Start Restore Job RestoreFiles.2013-03-15_14.33.46_29 15-Mar 14:33 bacula-dir JobId 430904: Using Device FileStorage0 to read. 15-Mar 14:33 bacula-sd JobId 430904: 3307 Issuing autochanger unload slot 2842, drive 0 command. 15-Mar 14:33 bacula-sd JobId 430904: 3304 Issuing autochanger load slot 2492, drive 0 command. 15-Mar 14:33 bacula-sd JobId 430904: 3305 Autochanger load slot 2492, drive 0, status is OK. 15-Mar 14:33 bacula-sd JobId 430904: Ready to read from volume File-2492 on device FileStorage0 (/storage/changer/drive0). 15-Mar 14:33 bacula-sd JobId 430904: Forward spacing Volume File-2492 to file:block 3:2114137624. 15-Mar 14:33 nfs2 JobId 430904: -r 1 litauer employee 30 2012-05-18 22:04:23 /export/user2/litauer/mgmt/backend/live/.svn/prop-base/CommandLine.exe.config.svn-base 15-Mar 14:33 nfs2 JobId 430904: -r 1 litauer employee 79 2012-05-18 22:04:23 /export/user2/litauer/mgmt/backend/live/.svn/prop-base/CommandLine.exe.svn-base 15-Mar 14:33 nfs2 JobId 430904: -r 1 litauer employee 79 2012-05-18 22:04:23 /export/user2/litauer/mgmt/backend/live/.svn/prop-base/Manage-User.ps1.svn-base 15-Mar 14:33 nfs2 JobId 430904: -r 1 litauer employee 53 2012-05-18 22:04:23 /export/user2/litauer/mgmt/backend/live/.svn/prop-base/ManageDomain.exe.svn-base 15-Mar 14:33 nfs2 JobId 430904: -r 1 litauer employee 53 2012-05-18 22:04:23 /export/user2/litauer/mgmt/backend/live/.svn/prop-base/WLACSDK_20100224.zip.svn-base 15-Mar 14:33 nfs2 JobId 430904: -r 1 litauer employee 30 2012-05-18 22:04:23 /export/user2/litauer/mgmt/backend/live/.svn/prop-base/usage.txt.svn-base 15-Mar 14:33 nfs2 JobId 430904: drwx--x--x 2 litauer employee 6 2012-05-18 22:01:10 /export/user2/litauer/mgmt/backend/live/.svn/props/ 15-Mar 14:33 nfs2 JobId 430904: -r 1 litauer employee 896 2012-05-18 22:04:23 /export/user2/litauer/mgmt/backend/live/.svn/text-base/CommandLine.exe.config.svn-base 15-Mar 14:33 nfs2 JobId 430904: -r 1 litauer employee 86016 2012-05-18 22:04:23 /export/user2/litauer/mgmt/backend/live/.svn/text-base/CommandLine.exe.svn-base 15-Mar 14:33 nfs2 JobId 430904: -r 1 litauer employee 16924 2012-05-18 22:04:23 /export/user2/litauer/mgmt/backend/live/.svn/text-base/Manage-User.ps1.svn-base 15-Mar 14:33 nfs2 JobId 430904: -r 1 litauer employee 834 2012-05-18 22:04:23 /export/user2/litauer/mgmt/backend/live/.svn/text-base/ManageDomain.exe.config.svn-base 15-Mar 14:33 nfs2 JobId 430904: -r 1 litauer employee 232304 2012-05-18 22:04:23 /export/user2/litauer/mgmt/backend/live/.svn/text-base/ManageDomain.exe.svn-base 15-Mar 14:33 nfs2 JobId 430904: -r 1 litauer employee 347897 2012-05-18 22:04:23 /export/user2/litauer/mgmt/backend/live/.svn/text
[Bacula-users] Ownership of restores
Dear bacula users, I am using bacula backups for some years now. Great system! I nearly never had problems to restore something ... For some time now, parts of my restores have the wrong ownership. Example: baculas restore command lists: $ dir drwxr-xr-x 6 litauer 1050 83 2012-11-09 10:25:23 /export/profiles2/Win2K/litauer/Application Data/ drwxr-xr-x 2 litauer 10504096 2012-11-09 10:25:23 /export/profiles2/Win2K/litauer/Cookies/ drwxr-xr-x 2 litauer 1050 6 2012-11-09 10:25:23 /export/profiles2/Win2K/litauer/Desktop/ drwxr-xr-x 4 litauer 1050 61 2012-11-09 10:25:23 /export/profiles2/Win2K/litauer/Favorites/ drwxr-xr-x 2 litauer 1050 22 2012-11-09 10:25:23 /export/profiles2/Win2K/litauer/IETldCache/ drwxr-xr-x 4 litauer 1050 46 2012-11-09 10:25:23 /export/profiles2/Win2K/litauer/My Documents/ -rwxr--r-- 1 litauer 1050 2097152 2012-11-09 10:25:22 /export/profiles2/Win2K/litauer/NTUSER.DAT 1050 is group employee. When I restore these files, I get drwxr-x--x 6 rootbacula83 Nov 12 10:03 Application Data drwxr--r-- 2 litauer employee4096 Nov 12 10:03 Cookies drwxr-xr-x 2 litauer employee 6 Mar 30 2006 Desktop drwxr-x--x 4 rootbacula61 Nov 12 10:03 Favorites drwxr--r-- 2 litauer employee 22 Nov 12 10:03 IETldCache drwxr-xr-x 4 litauer employee 46 Nov 12 10:03 My Documents -rwxr--r-- 1 litauer employee 2097152 Nov 9 10:25 NTUSER.DAT As you can see, some directories belong to root/bacula. The restore log stated Restore OK ... Any ideas how to avoid this? -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Ownership of restores
Hi Kleber, thanks for your response. Yes, I am restoring to the same server the backup was taken from. Parts of the restore got the correct user and group mapping ... Am 12.11.2012 um 11:35 schrieb Kleber Leal kleber.l...@gmail.com: Hi Christoph, Are you restoring on the same server you got the backup? If not, you should have to keep the uid and gid across all servers to have the same user and group mapping when copying files preserving ownerships. Kleber Leal Em 12/11/2012 06:32, Christoph Litauer lita...@uni-koblenz.de escreveu: Dear bacula users, I am using bacula backups for some years now. Great system! I nearly never had problems to restore something ... For some time now, parts of my restores have the wrong ownership. Example: baculas restore command lists: $ dir drwxr-xr-x 6 litauer 1050 83 2012-11-09 10:25:23 /export/profiles2/Win2K/litauer/Application Data/ drwxr-xr-x 2 litauer 10504096 2012-11-09 10:25:23 /export/profiles2/Win2K/litauer/Cookies/ drwxr-xr-x 2 litauer 1050 6 2012-11-09 10:25:23 /export/profiles2/Win2K/litauer/Desktop/ drwxr-xr-x 4 litauer 1050 61 2012-11-09 10:25:23 /export/profiles2/Win2K/litauer/Favorites/ drwxr-xr-x 2 litauer 1050 22 2012-11-09 10:25:23 /export/profiles2/Win2K/litauer/IETldCache/ drwxr-xr-x 4 litauer 1050 46 2012-11-09 10:25:23 /export/profiles2/Win2K/litauer/My Documents/ -rwxr--r-- 1 litauer 1050 2097152 2012-11-09 10:25:22 /export/profiles2/Win2K/litauer/NTUSER.DAT 1050 is group employee. When I restore these files, I get drwxr-x--x 6 rootbacula83 Nov 12 10:03 Application Data drwxr--r-- 2 litauer employee4096 Nov 12 10:03 Cookies drwxr-xr-x 2 litauer employee 6 Mar 30 2006 Desktop drwxr-x--x 4 rootbacula61 Nov 12 10:03 Favorites drwxr--r-- 2 litauer employee 22 Nov 12 10:03 IETldCache drwxr-xr-x 4 litauer employee 46 Nov 12 10:03 My Documents -rwxr--r-- 1 litauer employee 2097152 Nov 9 10:25 NTUSER.DAT As you can see, some directories belong to root/bacula. The restore log stated Restore OK ... -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Upgrade to virtual full
Dear bacula users, currently using the amazing bacula system version 5.2.5 I have a configuration question: I do my Diff and Full backups based on MaxFullInterval/MaxDiffInterval. That is, I schedule only incrementals that are then automatically updated to diff or full backups. Works like a charm. No that I did accurate backups for a few month I want to switch from Full o VirtuallFull backups. There is no directive MaxVirtualFullInterval so I wonder how to achieve this? Any ideas? -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-dir crashes
Just another hint: I was able to solve the problem by reducing the maximal number of jobs selectable by selection type PoolUncopiedJobs. I changed the type to SQLQuery and Selection Pattern to SELECT DISTINCT Job.JobId,Job.StartTime FROM Job,Pool WHERE Pool.Name = 'Incr' AND Pool.PoolId = Job.PoolId AND Job.Type = 'B' AND Job.JobStatus IN ('T','W') AND Job.jobBytes 0 AND Job.JobId NOT IN (SELECT PriorJobId FROM Job WHERE Type IN ('B','C') AND Job.JobStatus IN ('T','W') AND PriorJobId != 0) ORDER by Job.StartTime LIMIT 300 Am 03.05.2011 um 17:17 schrieb Christoph Litauer: Dear bacula users, I am running bacula 5.0.3 (x64). Recently my system started to crash the director when starting copy jobs. The copy job is defined as Job { Name = CopyIncr Type = Copy Messages = TapeCopy Pool = Incr Selection Type = PoolUncopiedJobs Priority = 10 Schedule = Weekdays Max Start Delay = 43200 # wait max 12 hours Allow Duplicate Jobs = yes Maximum Concurrent Jobs = 1 Level = Full Client = bacula FileSet = client files-to-backup } It should copy all uncopied jobs from pool Incr to a tape pool. Running the jobs results in: bacula:~ # /usr/sbin/bacula-dir -c /etc/bacula/bacula-dir.conf -f -r CopyIncr Bacula interrupted by signal 11: Segmentation violation Kaboom! bacula-dir, bacula-dir got signal 11 - Segmentation violation. Attempting traceback. Kaboom! exepath=/usr/sbin/ Calling: /usr/sbin/btraceback /usr/sbin/bacula-dir 30846 /var/bacula It looks like the traceback worked ... Dumping: /var/bacula/bacula-dir.30846.bactrace The bactrace can be loaded here: ftp://ftphost.uni-koblenz.de/pub/outgoing/litauer/bacula-dir.30846.bactrace Any help is greatly appreciated! Thanks in advance! -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Freundliche Grüße Christoph Litauer _ Christoph Litauer Uni Koblenz, Rechenzentrum, Raum A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula-dir crashes
Dear bacula users, I am running bacula 5.0.3 (x64). Recently my system started to crash the director when starting copy jobs. The copy job is defined as Job { Name = CopyIncr Type = Copy Messages = TapeCopy Pool = Incr Selection Type = PoolUncopiedJobs Priority = 10 Schedule = Weekdays Max Start Delay = 43200 # wait max 12 hours Allow Duplicate Jobs = yes Maximum Concurrent Jobs = 1 Level = Full Client = bacula FileSet = client files-to-backup } It should copy all uncopied jobs from pool Incr to a tape pool. Running the jobs results in: bacula:~ # /usr/sbin/bacula-dir -c /etc/bacula/bacula-dir.conf -f -r CopyIncr Bacula interrupted by signal 11: Segmentation violation Kaboom! bacula-dir, bacula-dir got signal 11 - Segmentation violation. Attempting traceback. Kaboom! exepath=/usr/sbin/ Calling: /usr/sbin/btraceback /usr/sbin/bacula-dir 30846 /var/bacula It looks like the traceback worked ... Dumping: /var/bacula/bacula-dir.30846.bactrace The bactrace can be loaded here: ftp://ftphost.uni-koblenz.de/pub/outgoing/litauer/bacula-dir.30846.bactrace Any help is greatly appreciated! Thanks in advance! -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Copy Job performance issues
Am 07.12.2010 um 02:53 schrieb Dan Langille: On 12/6/2010 11:13 AM, Christoph Litauer wrote: Dear bacula users, I have a problem concerning the speed of copy jobs. My setup is: - bacula server is OpenSuSE 11.3, version 5.0.3 using postgres, 2 Xeons (4 cores) and 8 GB memory. - Attached is an iSCSI-RAID containing File devices - Copy Jobs run to a Quantum Scalar 50 Tapelibrary with 2 LTO4 tape drives. The library and the tapes are connected via eSATA. According to wikipedia, LTO4 should transfer 120MB/s without compression. Compression is enabled. My backups go to the iSCSI-RAID. I run CopyJObs every day to copy all uncopied jobs to tape. My problem is, that my copy jobs run with max. 45 Mbyte/s I checked the following: - btape shows a maximum speed of 80MByte/sec. - I can read about 150 Mbyte/s from the RAID device - Copying data from RAID to tape using dd I get rates about 80 MByte/s - While copying the cpu load is about 20-50% (bacula-sd) So it seems as if bacula-sd itself slows the copy jobs down, but I cannot imagine, why. Maybe it is a configuration issue, but reading the manuals didn't help. Configuration of the tape device in bacula-sd.conf: Autochanger { Name = Scalar50-2 Device = LTO4-0 Device = LTO4-1 Changer Device = /dev/tape/by-id/scsi-3500e09e0bb562001 Changer Command = /usr/lib64/bacula/mtx-changer %c %o %S %a %d } Device { Name = LTO4-0 Device Type = Tape; Media Type = LTO4 Archive Device = /dev/tape/by-id/scsi-3500110a00104374e-nst AutomaticMount = yes; AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; Autochanger = yes Drive Index = 0 Spool Directory = /var/spool/bacula } Device { Name = LTO4-1 Device Type = Tape; Media Type = LTO4 Archive Device = /dev/tape/by-id/scsi-3500110a0012be1ee-nst AutomaticMount = yes; AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; Autochanger = yes Drive Index = 1 Spool Directory = /var/spool/bacula } Any ideas? I'm guessing. A copy job does a great deal of disk access. It had to read all the data from the Volume. It has to read the original Catalog entries. It has to write the new Catalog entries. Hi Dan, thanks for your suggestions. I am just doing a very large copy job (about 600 GB): - CPU load is 35-50% used by bacula-sd - iostat gives me about 40-50 MB/s reading performance on my iSCSI-Device (which is able to read about 150MB/s). - postmaster takes about 2% CPU load - iowait is 0 to 0.2% I can see no bottleneck at all ... but status storage still reports 40MB/s write performance. -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- What happens now with your Lotus Notes apps - do you make another costly upgrade, or settle for being marooned without product support? Time to move off Lotus Notes and onto the cloud with Force.com, apps are easier to build, use, and manage than apps on traditional platforms. Sign up for the Lotus Notes Migration Kit to learn more. http://p.sf.net/sfu/salesforce-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Exclude dir containing - Invalid fileset command
Dear bacula users, my bacula version is 5.0.3. I am trying to use the exclude dir containing directive but only get fatal errors complaining about Invalid FileSet command when running my backup jobs. My FileSet is: # List of files to be backed up FileSet { Name = client files-to-backup Ignore FileSet Changes = yes Include { Options { signature = MD5 compression=GZIP1 } File = \\/etc/bacula/files-to-backup ExcludeDirContaining = .nobackup } Exclude { File = /proc File = /tmp File = /.journal File = /.fsck File = /var/cache/apache2 File = /var/log } } On the client exists /etc/bacula-files-to-backup containing a list of filesystems to be backup'd, line by line (/, /var, /boot). Is the combination of \filename and exclude dir containing not allowed? -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- What happens now with your Lotus Notes apps - do you make another costly upgrade, or settle for being marooned without product support? Time to move off Lotus Notes and onto the cloud with Force.com, apps are easier to build, use, and manage than apps on traditional platforms. Sign up for the Lotus Notes Migration Kit to learn more. http://p.sf.net/sfu/salesforce-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Copy Job performance issues
Dear bacula users, I have a problem concerning the speed of copy jobs. My setup is: - bacula server is OpenSuSE 11.3, version 5.0.3 using postgres, 2 Xeons (4 cores) and 8 GB memory. - Attached is an iSCSI-RAID containing File devices - Copy Jobs run to a Quantum Scalar 50 Tapelibrary with 2 LTO4 tape drives. The library and the tapes are connected via eSATA. According to wikipedia, LTO4 should transfer 120MB/s without compression. Compression is enabled. My backups go to the iSCSI-RAID. I run CopyJObs every day to copy all uncopied jobs to tape. My problem is, that my copy jobs run with max. 45 Mbyte/s I checked the following: - btape shows a maximum speed of 80MByte/sec. - I can read about 150 Mbyte/s from the RAID device - Copying data from RAID to tape using dd I get rates about 80 MByte/s - While copying the cpu load is about 20-50% (bacula-sd) So it seems as if bacula-sd itself slows the copy jobs down, but I cannot imagine, why. Maybe it is a configuration issue, but reading the manuals didn't help. Configuration of the tape device in bacula-sd.conf: Autochanger { Name = Scalar50-2 Device = LTO4-0 Device = LTO4-1 Changer Device = /dev/tape/by-id/scsi-3500e09e0bb562001 Changer Command = /usr/lib64/bacula/mtx-changer %c %o %S %a %d } Device { Name = LTO4-0 Device Type = Tape; Media Type = LTO4 Archive Device = /dev/tape/by-id/scsi-3500110a00104374e-nst AutomaticMount = yes; AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; Autochanger = yes Drive Index = 0 Spool Directory = /var/spool/bacula } Device { Name = LTO4-1 Device Type = Tape; Media Type = LTO4 Archive Device = /dev/tape/by-id/scsi-3500110a0012be1ee-nst AutomaticMount = yes; AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; Autochanger = yes Drive Index = 1 Spool Directory = /var/spool/bacula } Any ideas? -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- What happens now with your Lotus Notes apps - do you make another costly upgrade, or settle for being marooned without product support? Time to move off Lotus Notes and onto the cloud with Force.com, apps are easier to build, use, and manage than apps on traditional platforms. Sign up for the Lotus Notes Migration Kit to learn more. http://p.sf.net/sfu/salesforce-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula rpm installation: sqlite vs. postgres
Dear bacula users, I just installed version 5.0.2 on a freshly OpenSuSE 11.3 system using the following packages: http://sourceforge.net/projects/bacula/files/rpms/5.0.2/bacula-libs-5.0.2-1.su112.i586.rpm/download http://sourceforge.net/projects/bacula/files/rpms/5.0.2/bacula-postgresql-5.0.2-1.su112.i586.rpm/download Trying to start the director I get the following error: 20-Aug 13:46 bacula-dir JobId 0: Fatal error: Could not open Catalog MyCatalog, database bacula. 20-Aug 13:46 bacula-dir JobId 0: Fatal error: sqlite.c:178 Database /var/bacula/bacula.db does not exist, please create it. 20-Aug 13:46 bacula-dir ERROR TERMINATION Please correct configuration file: /etc/bacula/bacula-dir.conf Well, I still have a Catalog located in a postgres database. As I installed the postgres-rpms ... why does the director try to open a sqlite database? -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- This SF.net email is sponsored by Make an app they can't live without Enter the BlackBerry Developer Challenge http://p.sf.net/sfu/RIM-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bscanning accidently destroyed volumes
Dear bacula users, accidently I destroyed all of my file-volumes (partitioned the wrong disk, sigh) containing the backups of the last 6 weeks. Older backups have already been migrated to tape. By a fluke I still had 2 weeks old copies of these file-volumes on another disk. I want to import these file volumes to my running catalogue. At first I deleted the volumes in my catalogue. Now I want to use bscan to import the volumes, but how? I created a bsr-file containing 442 lines like Volume = File-0005 Volume = File-0006 (I should mention that my backups span more than one volume). What I wonder about: How does bacula know in what order the file volumes have to be imported in case of a volume spanning backup? Or: How do I know how to sort the volume names in the bsr file? Then: Updating the (file-)autochanger content, bconsole reported Volume File-0005 not found in catalog. Slot=5 InChanger set to zero. So all my to be imported volumes are not registered to be inChanger. So bscan aborts after reading the first volume because it cannot automatically load the next volume ... I think I read all the manuals but I'm still lost. Any help would be appreciated. Thanks in advance! -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] usage of bsr files after migration
Dear bacula users, my backup schedule is as follows: Monthly Fulls, Weekly Differentials, Daily Incrementals. Backups go to file storage and are migrated to tape after 5 weeks. File volume retention is 6 weeks, Tape volume retention is 12 month, job retention varies between 3 and 9 month. My question: Sometimes I need to recover data older than the job retention time. So the job cannot be found in the catalog but should be somewhere on the tapes. Without migration I were able to use a (say) 8 month old .bsr file to initiate a disaster recovery and extract the data to be restored. But jobs are migrated after 6 weeks, so my .bsr files get unusable? -- Kind regards Christoph _ Christoph Litauer Uni Koblenz, Computing Centre, Office A 022 Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Recursive restores not working any more
Dear bacula users, running bacula 3.0.3 I used to restore a directory hierarchy (in the latest backup) with option 9: Find the JobIds of the most recent backup for a client and then 11: Enter a list of directories to restore for found JobIds As far as I remember the directory and all its subdirectories got restored. But this don't work any more (since a few days I think). Instead just the directory and all the top level files are restored. No subdir. I am able to restore the complete hierarchy using the interactive restore commands (option 5). The selected JobId's are the same in both ways. Any hints? -- Regards Christoph smime.p7s Description: S/MIME cryptographic signature -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Very slow interactive restore
Christoph Litauer schrieb: Arno Lehmann schrieb: Hi, 24.11.2009 08:59, Christoph Litauer wrote: Christoph Litauer schrieb: Jesper Krogh schrieb: Christoph Litauer wrote: Thanks! One last question (hopefully): How big is /var/lib/mysql/ibdata1? 282GB on ext3 Dear Jesper, in the meantime I made a test setup - not successfull 'til now regarding the performance. What I forgot to ask: What mysql-DB version are you running? And another demand, please: Could you - or someone else - please select any JobId and execute the following (my)sql-statement: mysqlEXPLAIN SELECT Path.Path, Filename.Name, File.FileIndex, File.JobId, File.LStat FROM ( SELECT max(FileId) as FileId, PathId, FilenameId FROM ( SELECT FileId, PathId, FilenameId FROM File WHERE JobId IN (insert your JobId here) ) AS F GROUP BY PathId, FilenameId ) AS Temp JOIN Filename ON (Filename.FilenameId = Temp.FilenameId) JOIN Path ON (Path.PathId = Temp.PathId) JOIN File ON (File.FileId = Temp.FileId) WHERE File.FileIndex 0 ORDER BY JobId, FileIndex ASC Please post the result. Thanks in advance! Sure... mysql EXPLAIN SELECT Path.Path, Filename.Name, File.FileIndex, File.JobId, File.LStat FROM ( SELECT max(FileId) as FileId, PathId, FilenameId FROM ( SELECT FileId, PathId, FilenameId FROM File WHERE JobId IN (11902)) AS F GROUP BY PathId, FilenameId ) AS Temp JOIN Filename ON (Filename.FilenameId = Temp.FilenameId) JOIN Path ON (Path.PathId = Temp.PathId) JOIN File ON (File.FileId =Temp.FileId) WHERE File.FileIndex 0 ORDER BY JobId, FileIndex ASC; ++-+++---+-+-+-+---+-+ | id | select_type | table | type | possible_keys | key | key_len | ref | rows | Extra | ++-+++---+-+-+-+---+-+ | 1 | PRIMARY | derived2 | ALL| NULL | NULL| NULL | NULL| 60905 | Using temporary; Using filesort | | 1 | PRIMARY | Path | eq_ref | PRIMARY | PRIMARY | 4 | Temp.PathId | 1 | | | 1 | PRIMARY | Filename | eq_ref | PRIMARY | PRIMARY | 4 | Temp.FilenameId | 1 | | | 1 | PRIMARY | File | eq_ref | PRIMARY | PRIMARY | 8 | Temp.FileId | 1 | Using where | | 2 | DERIVED | derived3 | ALL| NULL | NULL| NULL | NULL| 60905 | Using temporary; Using filesort | | 3 | DERIVED | File | ref| JobId,JobId_2 | JobId_2 | 4 | | 52471 | | ++-+++---+-+-+-+---+-+ 6 rows in set (6.99 secs) This is a MyISAM catalog with 14776513 Files, 1163114 FileNames, and 198492 Paths. Machine is a Dual-Core Opteron with 2GB RAM and a decent disk subsystem. MySQL is not exactly configured for maximum performance. Thanks a lot Arno. May I ask you too, how long an interactive restore of a big filesystem takes to build the directory tree? Seems as if I found the reason: I had been running version 3.0.2 which uses a comlicated sql statement as the above to build the directory tree. Version 3.0.3 uses more but simpler sql queries ... I read the release notes for this version once again but couldn't find any hint regarding that fix. -- Kind regards Christoph Christoph Litauer lita...@uni-koblenz.de Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 -- Join us December 9, 2009 for the Red Hat Virtual Experience, a free event focused on virtualization and cloud computing. Attend in-depth sessions from your desk. Your couch. Anywhere. http://p.sf.net/sfu/redhat-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Very slow interactive restore
Arno Lehmann schrieb: Hi, 24.11.2009 08:59, Christoph Litauer wrote: Christoph Litauer schrieb: Jesper Krogh schrieb: Christoph Litauer wrote: Thanks! One last question (hopefully): How big is /var/lib/mysql/ibdata1? 282GB on ext3 Dear Jesper, in the meantime I made a test setup - not successfull 'til now regarding the performance. What I forgot to ask: What mysql-DB version are you running? And another demand, please: Could you - or someone else - please select any JobId and execute the following (my)sql-statement: mysqlEXPLAIN SELECT Path.Path, Filename.Name, File.FileIndex, File.JobId, File.LStat FROM ( SELECT max(FileId) as FileId, PathId, FilenameId FROM ( SELECT FileId, PathId, FilenameId FROM File WHERE JobId IN (insert your JobId here) ) AS F GROUP BY PathId, FilenameId ) AS Temp JOIN Filename ON (Filename.FilenameId = Temp.FilenameId) JOIN Path ON (Path.PathId = Temp.PathId) JOIN File ON (File.FileId = Temp.FileId) WHERE File.FileIndex 0 ORDER BY JobId, FileIndex ASC Please post the result. Thanks in advance! Sure... mysql EXPLAIN SELECT Path.Path, Filename.Name, File.FileIndex, File.JobId, File.LStat FROM ( SELECT max(FileId) as FileId, PathId, FilenameId FROM ( SELECT FileId, PathId, FilenameId FROM File WHERE JobId IN (11902)) AS F GROUP BY PathId, FilenameId ) AS Temp JOIN Filename ON (Filename.FilenameId = Temp.FilenameId) JOIN Path ON (Path.PathId = Temp.PathId) JOIN File ON (File.FileId =Temp.FileId) WHERE File.FileIndex 0 ORDER BY JobId, FileIndex ASC; ++-+++---+-+-+-+---+-+ | id | select_type | table | type | possible_keys | key | key_len | ref | rows | Extra | ++-+++---+-+-+-+---+-+ | 1 | PRIMARY | derived2 | ALL| NULL | NULL| NULL | NULL| 60905 | Using temporary; Using filesort | | 1 | PRIMARY | Path | eq_ref | PRIMARY | PRIMARY | 4 | Temp.PathId | 1 | | | 1 | PRIMARY | Filename | eq_ref | PRIMARY | PRIMARY | 4 | Temp.FilenameId | 1 | | | 1 | PRIMARY | File | eq_ref | PRIMARY | PRIMARY | 8 | Temp.FileId | 1 | Using where | | 2 | DERIVED | derived3 | ALL| NULL | NULL| NULL | NULL| 60905 | Using temporary; Using filesort | | 3 | DERIVED | File | ref| JobId,JobId_2 | JobId_2 | 4 | | 52471 | | ++-+++---+-+-+-+---+-+ 6 rows in set (6.99 secs) This is a MyISAM catalog with 14776513 Files, 1163114 FileNames, and 198492 Paths. Machine is a Dual-Core Opteron with 2GB RAM and a decent disk subsystem. MySQL is not exactly configured for maximum performance. Thanks a lot Arno. May I ask you too, how long an interactive restore of a big filesystem takes to build the directory tree? -- Kind regards Christoph Christoph Litauer lita...@uni-koblenz.de Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Very slow interactive restore
Christoph Litauer schrieb: Jesper Krogh schrieb: Christoph Litauer wrote: Thanks! One last question (hopefully): How big is /var/lib/mysql/ibdata1? 282GB on ext3 Dear Jesper, in the meantime I made a test setup - not successfull 'til now regarding the performance. What I forgot to ask: What mysql-DB version are you running? And another demand, please: Could you - or someone else - please select any JobId and execute the following (my)sql-statement: mysqlEXPLAIN SELECT Path.Path, Filename.Name, File.FileIndex, File.JobId, File.LStat FROM ( SELECT max(FileId) as FileId, PathId, FilenameId FROM ( SELECT FileId, PathId, FilenameId FROM File WHERE JobId IN (insert your JobId here) ) AS F GROUP BY PathId, FilenameId ) AS Temp JOIN Filename ON (Filename.FilenameId = Temp.FilenameId) JOIN Path ON (Path.PathId = Temp.PathId) JOIN File ON (File.FileId = Temp.FileId) WHERE File.FileIndex 0 ORDER BY JobId, FileIndex ASC Please post the result. Thanks in advance! -- Kind regards Christoph Christoph Litauer lita...@uni-koblenz.de Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Very slow interactive restore
Jesper Krogh schrieb: Christoph Litauer wrote: Thanks! One last question (hopefully): How big is /var/lib/mysql/ibdata1? 282GB on ext3 Dear Jesper, in the meantime I made a test setup - not successfull 'til now regarding the performance. What I forgot to ask: What mysql-DB version are you running? -- Kind regards Christoph Christoph Litauer lita...@uni-koblenz.de Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Very slow interactive restore
Jesper Krogh schrieb: Christoph Litauer wrote: Jesper Krogh schrieb: Christoph Litauer wrote: 3.) What are your directory building times when using interactive restores? For 8.5 million files ~ 2 minutes. That would be _very_ nice! Jesper, please give the following information, so I can compare our setups: 1.) Output of 'show index from File' http://krogh.cc/~jesper/show-index.txt 2.) Your /etc/my.cnf http://krogh.cc/~jesper/my.cnf 3.) How much memory your system has. 48GB where typically 40GB are uses as spool-area for 2 x LTO4 devices mounted as a ramfs Sorry Jesper, a few more questions: 1.) Where is the 'dump_info_idx' index from? I don't think it is created by make_mysql_tables ... I may have created it manually.. years ago.. The setup is actually since may 2006, file-table around 1.8 billion (10^9) files. 2.) Is your machine/os 32bit or 64bit based? 64bit 3.) Do you use InnoDB- or MyISAM-Tables? Hmm. due to some wierd reason.. it is a mixture, but the large ones are all InnoDB. Thanks! One last question (hopefully): How big is /var/lib/mysql/ibdata1? -- Kind regards Christoph Christoph Litauer lita...@uni-koblenz.de Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] command line editing
Dear bacula users, another question: I wonder if I can configure or compile bconsole in a way that I can use history and/or command line editing in a linux/mac terminal? Now, even typing a backspace confuses my terminal ... -- Kind regards Christoph Christoph Litauer lita...@uni-koblenz.de Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Very slow interactive restore
Jesper Krogh schrieb: Christoph Litauer wrote: 3.) What are your directory building times when using interactive restores? For 8.5 million files ~ 2 minutes. That would be _very_ nice! Jesper, please give the following information, so I can compare our setups: 1.) Output of 'show index from File' http://krogh.cc/~jesper/show-index.txt 2.) Your /etc/my.cnf http://krogh.cc/~jesper/my.cnf 3.) How much memory your system has. 48GB where typically 40GB are uses as spool-area for 2 x LTO4 devices mounted as a ramfs Sorry Jesper, a few more questions: 1.) Where is the 'dump_info_idx' index from? I don't think it is created by make_mysql_tables ... 2.) Is your machine/os 32bit or 64bit based? 3.) Do you use InnoDB- or MyISAM-Tables? -- Kind regards Christoph Christoph Litauer lita...@uni-koblenz.de Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] command line editing
Am 11.11.2009 um 13:46 schrieb Martin Simmons: On Wed, 11 Nov 2009 09:28:13 +0100, Christoph Litauer said: Dear bacula users, another question: I wonder if I can configure or compile bconsole in a way that I can use history and/or command line editing in a linux/mac terminal? Now, even typing a backspace confuses my terminal ... Try building with the --disable-conio argument to configure. Then Bacula will use readline if you have it installed (on Linux you'll need readline- devel as well). Worked like a charm! Thanks a lot! -- Kind regards Christoph -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Very slow interactive restore
Jesper Krogh schrieb: Christoph Litauer wrote: Most often I need to restore whole directories (recursive) out of the last backup or using a backup some time ago. Because there is no bacula command for restores of directories, I use the interactive restore method. When selecting a job that contains about 10 Mio. files, building the directory tree lasts about 30 minutes -- which is very long. Hi Jesper, thanks for your answers ... Add more memory.. I'll bet your system is swapping out while building the tree. So I have a few questions: 1.) Any hints how to recover a directory recursive without using interactive mode? It's something like this: http://krogh.cc/~jesper/bacula-restore.txt ... especially for this one. Must have been stupid ... 2.) Any hints concering mysql optimizations for a bacula database as big as mine? Add more memory. Well, I can't see any swap space is used while the directory tree build ist running. 3.) What are your directory building times when using interactive restores? For 8.5 million files ~ 2 minutes. That would be _very_ nice! Jesper, please give the following information, so I can compare our setups: 1.) Output of 'show index from File' 2.) Your /etc/my.cnf 3.) How much memory your system has. -- Kind regards Christoph Christoph Litauer lita...@uni-koblenz.de Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Very slow interactive restore
Dear bacula users, I am using bacula 3.0.2 with mysql on a 4 core Xeon machine with 4 GB RAM. mysql is used locally, bacula database is about 40GB containing about 180 million files. First of all: bacula does a great job for over 1 year now! Thanks a lot to Kern and the community! Most often I need to restore whole directories (recursive) out of the last backup or using a backup some time ago. Because there is no bacula command for restores of directories, I use the interactive restore method. When selecting a job that contains about 10 Mio. files, building the directory tree lasts about 30 minutes -- which is very long. I tracked down the SQL-select statement that bconsole uses to select the millions of files, leading to SELECT Path.Path, Filename.Name, File.FileIndex, File.JobId, File.LStat FROM ( SELECT max(FileId) as FileId, PathId, FilenameId FROM ( SELECT FileId, PathId, FilenameId FROM File WHERE JobId IN (jobid1, jobid2, jobid3) ) AS F GROUP BY PathId, FilenameId ) AS Temp JOIN Filename ON (Filename.FilenameId = Temp.FilenameId) JOIN Path ON (Path.PathId = Temp.PathId) JOIN File ON (File.FileId = Temp.FileId) WHERE File.FileIndex 0 ORDER BY JobId, FileIndex ASC Sending this statement to mysql lasts about 20 minutes -- it seems that the database structure or the indexes are not optimal. I tried with the 4 commented additional indexes in make_mysql_tables .. the performance even got worser. So I have a few questions: 1.) Any hints how to recover a directory recursive without using interactive mode? 2.) Any hints concering mysql optimizations for a bacula database as big as mine? 3.) What are your directory building times when using interactive restores? -- Kind regards Christoph Christoph Litauer lita...@uni-koblenz.de Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] migration job problems
Hi, running bacula 2.2.5. I configured a migration job that should migrate all jobs older than 3 month. While migrating, some jobs issue the following messages: 07-Dez 12:53 bacula-sd JobId 8446: Ready to read from volume File-0189 on device FileStorage (/storage). 07-Dez 12:55 bacula-sd JobId 8446: End of file 2 on device FileStorage (/storage), Volume File-0189 07-Dez 12:55 bacula-sd JobId 8446: End of Volume at file 2 on device FileStorage (/storage), Volume File-0189 07-Dez 12:55 bacula-sd JobId 8446: Ready to read from volume File-0190 on device FileStorage (/storage). 07-Dez 12:55 bacula-dir JobId 8446: Warning: Got MD5 digest but not same File as attributes 07-Dez 12:57 bacula-sd JobId 8446: End of file 2 on device FileStorage (/storage), Volume File-0190 07-Dez 12:57 bacula-sd JobId 8446: End of Volume at file 2 on device FileStorage (/storage), Volume File-0190 07-Dez 12:57 bacula-sd JobId 8446: Ready to read from volume File-0191 on device FileStorage (/storage). 07-Dez 13:00 bacula-sd JobId 8446: End of file 2 on device FileStorage (/storage), Volume File-0191 07-Dez 13:00 bacula-sd JobId 8446: End of Volume at file 2 on device FileStorage (/storage), Volume File-0191 07-Dez 13:00 bacula-sd JobId 8446: Ready to read from volume File-0192 on device FileStorage (/storage). 07-Dez 13:00 bacula-dir JobId 8446: Warning: Got MD5 digest but not same File as attributes 07-Dez 13:03 bacula-sd JobId 8446: End of file 2 on device FileStorage (/storage), Volume File-0192 07-Dez 13:03 bacula-sd JobId 8446: End of Volume at file 2 on device FileStorage (/storage), Volume File-0192 07-Dez 13:03 bacula-sd JobId 8446: Ready to read from volume File-0193 on device FileStorage (/storage). 07-Dez 13:03 bacula-dir JobId 8446: Warning: Got MD5 digest but not same File as attributes 07-Dez 13:05 bacula-sd JobId 8446: End of file 2 on device FileStorage (/storage), Volume File-0193 07-Dez 13:05 bacula-sd JobId 8446: End of Volume at file 2 on device FileStorage (/storage), Volume File-0193 07-Dez 13:05 bacula-sd JobId 8446: Ready to read from volume File-0194 on device FileStorage (/storage). 07-Dez 13:05 bacula-dir JobId 8446: Warning: Got MD5 digest but not same File as attributes ... and so on. What does this warning message mean? -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - SF.Net email is sponsored by: Check out the new SourceForge.net Marketplace. It's the best place to buy or sell services for just about anything Open Source. http://sourceforge.net/services/buy/index.php ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] iSCSI-Tape problems
Josh Fisher schrieb: The only difference that I can see is that the full_write() / safe_write() functions in tar attempt the write multiple times if need be and attempt to finish (it seems) partial writes. Btape fails immediately if the write() system call fails to write the requested number of bytes. However, btape should be issuing a Write failed at block message if the write fails. That error message contains an error string corresponding to the errno that was set when the write() failed, which could be helpful. Christopher Litauer's initial message does not include such an error message after the Begin writing raw blocks of message, so I don't know if he just didn't include it or if the only messages he saw were the bad page state syslog messages. If there was no Write failed at block message, then the write() system call never returned, in which case it is a real mystery (to me) as to how tar can possibly work with the same block size. No, there definitly is no such message after Begin writing raw blocks, just one or two '+', nothing more, just the kernel panic messages in /var/log/message -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] iSCSI-Tape problems
Josh Fisher schrieb: This can happen when ClearPageReserved() is not called for a reserved kernel memory page. Could be an iSCSI driver (included with the Linux kernel) problem or, if you are using a hardware iSCSI adapter, it could be a problem with its driver. My question is: What is the difference between the tape write actions of tar and btape? Maybe I will be able to configure the tape device so that btape doesn't run in kernel panics any more? Well, btape is very likely using a different block size than you used with tar. The default block size for btape is 126x512 = 64,512 bytes. The default for tar is 20x512 = 10,240 bytes. Try setting 'Maximum block size = 10240' and 'Minimum block size = 10240' in the bacula-sd.conf config file being used by btape. If that works, then try tar with '-b 64512' and see if tar causes the same problem with large block sizes. If neither wroks with the larger block size, then you will have to use the smaller block size until the iSCSI bug is fixed. Thanks Josh, I think the blocksizes are a step in the right direction - but no solution yet. In the meantime I changed the iSCSI-Switch and did a few more tests: - tar xv -f /dev/nst0 -b 126 /var = no Problems (I think -b 126 is right because - according to the manpage - tar multiplies option -b with 512, 126x512 = 64512) - btape HP-LTO2, rawfill (maximum block size set to 10240) = panic Output was: *rawfill btape: btape.c:2496 Begin writing raw blocks of 10240 bytes. + - btape HP-LTO2, rawfill (maximum block size set to 8192) = panic Output was: *rawfill btape: btape.c:2496 Begin writing raw blocks of 8192 bytes. ++ Any further ideas? -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] iSCSI-Tape problems
Christoph Litauer schrieb: Josh Fisher schrieb: This can happen when ClearPageReserved() is not called for a reserved kernel memory page. Could be an iSCSI driver (included with the Linux kernel) problem or, if you are using a hardware iSCSI adapter, it could be a problem with its driver. My question is: What is the difference between the tape write actions of tar and btape? Maybe I will be able to configure the tape device so that btape doesn't run in kernel panics any more? Well, btape is very likely using a different block size than you used with tar. The default block size for btape is 126x512 = 64,512 bytes. The default for tar is 20x512 = 10,240 bytes. Try setting 'Maximum block size = 10240' and 'Minimum block size = 10240' in the bacula-sd.conf config file being used by btape. If that works, then try tar with '-b 64512' and see if tar causes the same problem with large block sizes. If neither wroks with the larger block size, then you will have to use the smaller block size until the iSCSI bug is fixed. Thanks Josh, I think the blocksizes are a step in the right direction - but no solution yet. In the meantime I changed the iSCSI-Switch and did a few more tests: - tar xv -f /dev/nst0 -b 126 /var = no Problems (I think -b 126 is right because - according to the manpage - tar multiplies option -b with 512, 126x512 = 64512) - btape HP-LTO2, rawfill (maximum block size set to 10240) = panic Output was: *rawfill btape: btape.c:2496 Begin writing raw blocks of 10240 bytes. + - btape HP-LTO2, rawfill (maximum block size set to 8192) = panic Output was: *rawfill btape: btape.c:2496 Begin writing raw blocks of 8192 bytes. ++ Any further ideas? Update: I experimented a little with blocksizes. Up to 4092 works great. More or equal than 5120 kills the machine. Any ideas, why 4092? -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] iSCSI-Tape problems
Dear bacula users, I am running bacula-mysql 2.2.5 (rpm from sourceforge) on a SuSE SLES 10SP1 machine, kernel version 2.6.16 (SMP). I configured and mounted tape drive via iSCSI. I can tar from and to this drive without problems. I can label a tape with btape, read this label without problems. But immediatly after writing a few blocks using qfill or wr the machine stops working. One of my write attempts left a kernel panic message in /var/log/messages: Oct 24 13:28:26 bacula kernel: Bad page state in process 'btape' Oct 24 13:28:26 bacula kernel: page:c16cce40 flags:0x8000 mapping: mapcount:0 count:1 Oct 24 13:28:26 bacula kernel: Trying to fix it up, but a reboot is needed Oct 24 13:28:26 bacula kernel: Backtrace: Oct 24 13:28:26 bacula kernel: [c0149955] bad_page+0x42/0x68 Oct 24 13:28:26 bacula kernel: [c0149dbd] __free_pages_ok+0x55/0xe4 Oct 24 13:28:26 bacula kernel: [f906e0bb] normalize_buffer+0x31/0x63 [st] Oct 24 13:28:26 bacula kernel: [f9070492] st_release+0x1e/0x45 [st] Oct 24 13:28:26 bacula kernel: [c01613d5] __fput+0xa1/0x167 Oct 24 13:28:26 bacula kernel: [c015ed5d] filp_close+0x4e/0x54 Oct 24 13:28:26 bacula kernel: [c0103bdb] sysenter_past_esp+0x54/0x79 Oct 24 13:28:26 bacula kernel: Bad page state in process 'btape' Oct 24 13:28:26 bacula kernel: page:c16cce60 flags:0x8080 mapping: mapcount:0 count:1 Oct 24 13:28:26 bacula kernel: Trying to fix it up, but a reboot is needed Oct 24 13:28:26 bacula kernel: Backtrace: Oct 24 13:28:26 bacula kernel: [c0149955] bad_page+0x42/0x68 Oct 24 13:28:26 bacula kernel: [c0149dbd] __free_pages_ok+0x55/0xe4 Oct 24 13:28:26 bacula kernel: [f906e0bb] normalize_buffer+0x31/0x63 [st] Oct 24 13:28:26 bacula kernel: [f9070492] st_release+0x1e/0x45 [st] Oct 24 13:28:26 bacula kernel: [c01613d5] __fput+0xa1/0x167 Oct 24 13:28:26 bacula kernel: [c015ed5d] filp_close+0x4e/0x54 Oct 24 13:28:26 bacula kernel: [c0103bdb] sysenter_past_esp+0x54/0x79 So this seems to be a kernel bug. Googling lead me to http://www.mail-archive.com/bacula-users@lists.sourceforge.net/msg17890.html but this didn't help too much ... My question is: What is the difference between the tape write actions of tar and btape? Maybe I will be able to configure the tape device so that btape doesn't run in kernel panics any more? -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Insert bug?
Dear bacula users, last night my bacula server reported lots of the following errors: 23-Sep 13:38 bacula-dir: iwmuser.2007-09-23_04.05.11 Fatal error: sql_create.c:730 sql_create.c:730 insert INSERT INTO batch VALUES (5,2652,'/home/','','U C EHt BD A A A BAA QAA I BG9k/M BG3Y4l BG3Y4l A A E','0') failed: Table 'bacula.batch' doesn't exist 23-Sep 13:38 bacula-dir: sql_create.c:730 INSERT INTO batch VALUES (5,2652,'/home/','','U C EHt BD A A A BAA QAA I BG9k/M BG3Y4l BG3Y4l A A E','0') 23-Sep 13:38 bacula-dir: iwmuser.2007-09-23_04.05.11 Fatal error: catreq.c:404 Attribute create error. Query failed: DROP INDEX DelInx1: ERR=You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '' at line 1 iwmuser-fd: Filesystem change prohibited. Will not descend into /sys 23-Sep 13:38 bacula-dir: iwmuser.2007-09-23_04.05.11 Fatal error: sql_create.c:730 sql_create.c:730 insert INSERT INTO batch VALUES (6,2652,'/sbin/','','gR EEAB EHt C A A A CAA BAA Y BG9Icu BG9dXz BG9dXz A A E','0') failed: Table 'bacula.batch' doesn't exist 23-Sep 13:38 bacula-dir: sql_create.c:730 INSERT INTO batch VALUES (6,2652,'/sbin/','','gR EEAB EHt C A A A CAA BAA Y BG9Icu BG9dXz BG9dXz A A E','0') 23-Sep 13:38 bacula-dir: iwmuser.2007-09-23_04.05.11 Fatal error: catreq.c:404 Attribute create error. Query failed: DROP INDEX DelInx1: ERR=You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '' at line 1 Seems as if my database structure isn't correct? But what about the sql syntax errors? I am running bacula-mysql 2.2.4 on a SuSE SLES10_SP1 system. Thanks a lot in advance. -- Regards Christoph Litauer - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Need help restoring bacula configuration
Dear admins, I accidently removed all files in /etc/bacula on my bacula server (rm wx-console.conf * should have been rm wx-console.conf*). As the daemons were still running I recreated a minimal bconsole.conf, connected to the director and tried to restore /etc/bacula. I got the following error: 11-Sep 11:08 bacula-sd: RestoreFiles.2007-09-11_11.08.24 Error: block.c:275 Volume data error at 1:2363602536! Wanted ID: BB02, got hein. Buffer discarded. As I found in http://www.bacula.org/dev-manual/Restore_Command.html this maybe caused by incorrect block size settings for my devices. I wonder wether this can be, because I use File devices ... ... but nevertheless I would try the configuration changes ... if I could: I also deleted bacula-sd.conf and don't really remember all the settings. Any other idea? I don't want to restart the daemons trying one configuration after another because now they are still running with my working configuration. Perhaps there is a way bacula-dir writes out the running configuration? -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] sql error using brestore
Eric Bollengier schrieb: Hi, You are using an old version, please, update with svn or debian package. (see ReleaseNotes) Well, I grabbed the svn version (4599, 2007-04-22) but still get errors. I am running bacula-2.0.3 on a SuSE Linux Enterprise Server 10 (i586). DBD::mysql::st execute failed: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'AND brestore_pathvisibility1.jobid IN (127,107,87,67,47,5)) AS listpath1 JOI' at line 13 at ./brestore.pl line 2519. DBD::mysql::st fetchall_arrayref failed: fetch() without execute() at ./brestore.pl line 2520. DBD::mysql::db selectall_arrayref failed: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ') AND File.JobId IN (127,107,87,67,47,5) GROUP BY Filename.Name ORDER BY' at line 7 at ./brestore.pl line 292. Use of uninitialized value in subroutine entry at ./brestore.pl line 1491. -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] sql error using brestore
Hi, I just installed brestore and started brestore.pl. When selecting a client from the client list I get the following error: DBD::mysql::st execute failed: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ') ORDER BY 2,3 DESC ) As a' at line 37 at ./brestore.pl line 2048. DBD::mysql::st fetchall_arrayref failed: fetch() without execute() at ./brestore.pl line 2049. Switching on debug mode gives the following sql-statement. Any ideas? SELECT Path, JobId, Lstat FROM( ( SELECT Path.Path, lower(Path.Path), listfile.JobId, listfile.Lstat FROM ( SELECT DISTINCT brestore_pathhierarchy.PathId FROM brestore_pathhierarchy JOIN Path ON (brestore_pathhierarchy.PathId = Path.PathId) JOIN brestore_pathvisibility ON (brestore_pathhierarchy.PathId = brestore_pathvisibility.PathId) WHERE brestore_pathhierarchy.PPathId = 268387 AND brestore_pathvisibility.jobid IN (107,87,67,47,5)) AS listpath JOIN Path ON (listpath.PathId = Path.PathId) LEFT JOIN ( SELECT File.PathId, File.JobId, File.Lstat FROM File WHERE File.FilenameId = 21 AND File.JobId IN (107,87,67,47,5)) AS listfile ON (listpath.PathId = listfile.PathId) UNION SELECT brestore_missing_path.Path, lower(brestore_missing_path.Path), listfile.JobId, listfile.Lstat FROM ( SELECT DISTINCT brestore_pathhierarchy.PathId FROM brestore_pathhierarchy JOIN brestore_missing_path ON (brestore_pathhierarchy.PathId = brestore_missing_path.PathId) JOIN brestore_pathvisibility ON (brestore_pathhierarchy.PathId = brestore_pathvisibility.PathId) WHERE brestore_pathhierarchy.PPathId = 268387 AND brestore_pathvisibility.jobid IN (107,87,67,47,5)) AS listpath JOIN brestore_missing_path ON (listpath.PathId = brestore_missing_path.PathId) LEFT JOIN ( SELECT File.PathId, File.JobId, File.Lstat FROM File WHERE File.FilenameId = 21 AND File.JobId IN (107,87,67,47,5)) AS listfile ON (listpath.PathId = listfile.PathId)) ORDER BY 2,3 DESC ) As a -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encoding problems on restore
Kern Sibbald schrieb: On Thursday 12 April 2007 16:37, Christoph Litauer wrote: Kern Sibbald schrieb: On Thursday 12 April 2007 15:38, Christoph Litauer wrote: Kern Sibbald schrieb: On Wednesday 11 April 2007 15:30, Christoph Litauer wrote: Lots of ideas, starting with If you want a reasonable response, you must first provide at least minimum information. Please read the Support page on www.bacula.org. Perhaps you supplied it previously, but I don't see it in this email. Sorry, Kern. I didn't read the support info. I am running bacula-dir and bacula-sd on a Suse Linux Enterprise Server 10 (hostname is bacula). Version is mysql-2.0.3 (rpm on sourceforge). The client is a windows 2003 server running winbacula-2.0.3 (sourceforge, too). Hostname is hisservld. Attached is the relevant part of my bacula-dir.conf. OK, that helps. At least I know that Bacula *should* handle German characters correctly (older versions did not). I did a full dump of hisservld and tried to restore the files on the client at c:\temp\bacula. All files a restored but I get lots of messages complaining about errors changing the file permissions, e.g.: 05-Apr 16:12 hisservld-fd: RestoreFiles.2007-04-05_16.10.57 Warning: Cannot change permissions of C:/temp/bacula/C/Dokumente und Einstellungen/Administrator/StartmenÃŒ/Programme/Autostart: ERR=No such file or directory As you can see, the german umlaut ü Startmenü has been converted to a 2-byte UTF8 encoded character in the restoration path. Thanks a lot for any help! I suspect that you are not running UTF-8 on your Bacula server. As the manual indicates (some place), you need to have your LANG environment variable set correctly for Bacula. It must be something of the order: en_US.UTF-8 but adjusted for German (probably de_DE.UTF-8). Or you have a PostgreSQL database and it is not running in UTF-8 mode ... Kern, thanks for your help. I changed the systems default locale to de_DE.UTF-8 and rebootet the system. OK. That is probably the best way to run your system. However, it is always possible to set the LANG environment variable just for Bacula if using UTF-8 isn't possible on your site. Then I did another full dump of the Windows client -- same effects as before. I am using a mysql database. What I wonder about: If the problem was on the servers side, e.g. wrong pathnames in the database, I would expect problems while restoring the files. But all my files and directories are created correctly. Just setting the file permissions causes the errors ... I'd recommend trying a new backup and restore to test if the problem is corrected, then if you are having problems with older backups, it is probably because of mis-matching encoding. I'm not sure how to solve the problem, but you can probably get the files back by restoring them to a Unix machine, then moving them to Windows, and correcting any of the filenames that may be messed up. You may also be able to restore them directly to a temp directory on Windows, though Windows disallows many more characters in filenames than Unix does ... Well, sorry, seems as my english is too bad ... I already did a new full dump and tried a restore. No change. I don't need to restore old backups because I am just installing and testing a new bacula server. While testing we simulated a disaster recovery for that windows 2003 server. Ah, OK. It isn't your English, but the word dump confused me. In Bacula terminology I always call it a backup. Perhaps the error message is just not correctly translated -- that was not one of our worries. If that is the case, then the problem is as the error message states: Cannot change permissions of C:/temp/bacula/C/Dokumente und Einstellungen/Administrator/StartmenÃŒ/Programme/Autostart: ERR=No such file or directory You need to start with a simpler FileSet to ensure everything is working, then work on figuring out what is wrong with the path. (i.e. do you have a /tmp, rather thant the /temp? Sorry, I am out of ideas, perhaps the list can help more. This morning I started to build a test environment. I created 2 directories named Neuer Ordner and Neuer Ördner. Then I changed the permissions of both directories (added some rights for a new user). Next I created a file named Umlauteüöä.txt. I did a backup and a restore of these new dirs and the file. Everything is created successfull and even the directory permissions are correct -- although I got the following error: 13-Apr 08:57 hisservld-fd: RestoreFiles.2007-04-13_08.55.57 Warning: Cannot change permissions of C:/temp/bacula/C/Dokumente und Einstellungen/adminKO/Eigene Dateien/Neuer Ã�rdner: ERR=No such file or directory So everything seems to work OK. But I wonder, why bacula complains about the permission change. For the records: Starting the restore on the windows client shows correct german umlauts
Re: [Bacula-users] Encoding problems on restore
Kern Sibbald schrieb: I did a full dump of hisservld and tried to restore the files on the client at c:\temp\bacula. All files a restored but I get lots of messages complaining about errors changing the file permissions, e.g.: 05-Apr 16:12 hisservld-fd: RestoreFiles.2007-04-05_16.10.57 Warning: Cannot change permissions of C:/temp/bacula/C/Dokumente und Einstellungen/Administrator/StartmenÌ/Programme/Autostart: ERR=No such file or directory Are you running with VSS enabled? Perhaps there is a bug with VSS turned off changing permissions on files where the filename is not translated to Unicode -- setting file permissions is something that rarely happens since I think everyone uses VSS where that function is not used. Yes I think I use VSS: FileSet { Name = HISserver Files Include { File = C:/ } Enable VSS = yes } -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encoding problems on restore
Kern Sibbald schrieb: On Wednesday 11 April 2007 15:30, Christoph Litauer wrote: Lots of ideas, starting with If you want a reasonable response, you must first provide at least minimum information. Please read the Support page on www.bacula.org. Perhaps you supplied it previously, but I don't see it in this email. Sorry, Kern. I didn't read the support info. I am running bacula-dir and bacula-sd on a Suse Linux Enterprise Server 10 (hostname is bacula). Version is mysql-2.0.3 (rpm on sourceforge). The client is a windows 2003 server running winbacula-2.0.3 (sourceforge, too). Hostname is hisservld. Attached is the relevant part of my bacula-dir.conf. OK, that helps. At least I know that Bacula *should* handle German characters correctly (older versions did not). I did a full dump of hisservld and tried to restore the files on the client at c:\temp\bacula. All files a restored but I get lots of messages complaining about errors changing the file permissions, e.g.: 05-Apr 16:12 hisservld-fd: RestoreFiles.2007-04-05_16.10.57 Warning: Cannot change permissions of C:/temp/bacula/C/Dokumente und Einstellungen/Administrator/StartmenÃŒ/Programme/Autostart: ERR=No such file or directory As you can see, the german umlaut ü Startmenü has been converted to a 2-byte UTF8 encoded character in the restoration path. Thanks a lot for any help! I suspect that you are not running UTF-8 on your Bacula server. As the manual indicates (some place), you need to have your LANG environment variable set correctly for Bacula. It must be something of the order: en_US.UTF-8 but adjusted for German (probably de_DE.UTF-8). Or you have a PostgreSQL database and it is not running in UTF-8 mode ... Kern, thanks for your help. I changed the systems default locale to de_DE.UTF-8 and rebootet the system. Then I did another full dump of the Windows client -- same effects as before. I am using a mysql database. What I wonder about: If the problem was on the servers side, e.g. wrong pathnames in the database, I would expect problems while restoring the files. But all my files and directories are created correctly. Just setting the file permissions causes the errors ... -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encoding problems on restore
Kern Sibbald schrieb: On Thursday 12 April 2007 15:38, Christoph Litauer wrote: Kern Sibbald schrieb: On Wednesday 11 April 2007 15:30, Christoph Litauer wrote: Lots of ideas, starting with If you want a reasonable response, you must first provide at least minimum information. Please read the Support page on www.bacula.org. Perhaps you supplied it previously, but I don't see it in this email. Sorry, Kern. I didn't read the support info. I am running bacula-dir and bacula-sd on a Suse Linux Enterprise Server 10 (hostname is bacula). Version is mysql-2.0.3 (rpm on sourceforge). The client is a windows 2003 server running winbacula-2.0.3 (sourceforge, too). Hostname is hisservld. Attached is the relevant part of my bacula-dir.conf. OK, that helps. At least I know that Bacula *should* handle German characters correctly (older versions did not). I did a full dump of hisservld and tried to restore the files on the client at c:\temp\bacula. All files a restored but I get lots of messages complaining about errors changing the file permissions, e.g.: 05-Apr 16:12 hisservld-fd: RestoreFiles.2007-04-05_16.10.57 Warning: Cannot change permissions of C:/temp/bacula/C/Dokumente und Einstellungen/Administrator/StartmenÃŒ/Programme/Autostart: ERR=No such file or directory As you can see, the german umlaut ü Startmenü has been converted to a 2-byte UTF8 encoded character in the restoration path. Thanks a lot for any help! I suspect that you are not running UTF-8 on your Bacula server. As the manual indicates (some place), you need to have your LANG environment variable set correctly for Bacula. It must be something of the order: en_US.UTF-8 but adjusted for German (probably de_DE.UTF-8). Or you have a PostgreSQL database and it is not running in UTF-8 mode ... Kern, thanks for your help. I changed the systems default locale to de_DE.UTF-8 and rebootet the system. OK. That is probably the best way to run your system. However, it is always possible to set the LANG environment variable just for Bacula if using UTF-8 isn't possible on your site. Then I did another full dump of the Windows client -- same effects as before. I am using a mysql database. What I wonder about: If the problem was on the servers side, e.g. wrong pathnames in the database, I would expect problems while restoring the files. But all my files and directories are created correctly. Just setting the file permissions causes the errors ... I'd recommend trying a new backup and restore to test if the problem is corrected, then if you are having problems with older backups, it is probably because of mis-matching encoding. I'm not sure how to solve the problem, but you can probably get the files back by restoring them to a Unix machine, then moving them to Windows, and correcting any of the filenames that may be messed up. You may also be able to restore them directly to a temp directory on Windows, though Windows disallows many more characters in filenames than Unix does ... Well, sorry, seems as my english is too bad ... I already did a new full dump and tried a restore. No change. I don't need to restore old backups because I am just installing and testing a new bacula server. While testing we simulated a disaster recovery for that windows 2003 server. -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encoding problems on restore
Christoph Litauer schrieb: Robert Nelson schrieb: Which version of Windows is this? A 2003 Server. -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Christoph Litauer Sent: Thursday, April 05, 2007 7:38 AM To: bacula-users Subject: [Bacula-users] Encoding problems on restore Hi, I have problems restoring a german windows system backup'd with bacula. German windows installations contain german umlauts in some path names (e.g. c:/../Startmenü/...). The files are all created but as bacula tries to cahnge the file permissions I got lots of errors like: 05-Apr 16:12 hisservld-fd: RestoreFiles.2007-04-05_16.10.57 Warning: Cannot change permissions of C:/temp/bacula/C/Dokumente und Einstellungen/Administrator/StartmenÃŒ/Programme/Autostart: ERR=No such file or directory As you can see, the german umlaut ü has been changed to a UTF8 representation. Any hints how to avoid this? Thanks a lot in advance. Well ... no ideas? -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encoding problems on restore
Lots of ideas, starting with If you want a reasonable response, you must first provide at least minimum information. Please read the Support page on www.bacula.org. Perhaps you supplied it previously, but I don't see it in this email. Sorry, Kern. I didn't read the support info. I am running bacula-dir and bacula-sd on a Suse Linux Enterprise Server 10 (hostname is bacula). Version is mysql-2.0.3 (rpm on sourceforge). The client is a windows 2003 server running winbacula-2.0.3 (sourceforge, too). Hostname is hisservld. Attached is the relevant part of my bacula-dir.conf. I did a full dump of hisservld and tried to restore the files on the client at c:\temp\bacula. All files a restored but I get lots of messages complaining about errors changing the file permissions, e.g.: 05-Apr 16:12 hisservld-fd: RestoreFiles.2007-04-05_16.10.57 Warning: Cannot change permissions of C:/temp/bacula/C/Dokumente und Einstellungen/Administrator/StartmenÃŒ/Programme/Autostart: ERR=No such file or directory As you can see, the german umlaut ü Startmenü has been converted to a 2-byte UTF8 encoded character in the restoration path. Thanks a lot for any help! -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 # # Default Bacula Director Configuration file # # The only thing that MUST be changed is to add one or more # file or directory names in the Include directive of the # FileSet resource. # # For Bacula release 1.36.3 (22 April 2005) -- suse 9.2 # # You might also want to change the default email address # from root to your address. See the mail and operator # directives in the Messages resource. # Director {# define myself Name = bacula-dir DIRport = 9101# where we listen for UA connections QueryFile = /etc/bacula/query.sql WorkingDirectory = /var/bacula PidDirectory = /var/run Maximum Concurrent Jobs = 20 Password = x Messages = Daemon } JobDefs { Name = DefaultJob Type = Backup Level = Incremental Client = bacula FileSet = Full Set Schedule = WeeklyCycle Storage = Files Pool = Default Messages = Standard Priority = 10 SpoolData = no } FileSet { Name = HISserver Files Include { File = C:/ } Enable VSS = yes } Client { Name = hisservld Address = hisservld FDPort = 9102 Catalog = MyCatalog Password = xxx Auto Prune = yes File Retention = 3 months Job Retention = 5 months } Job { Name = hisservld JobDefs = DefaultJob Client = hisservld FileSet = HISserver Files Write Bootstrap = /var/bacula/hisservld.bsr Client Run Before Job = ntbackup backup systemstate /F c:\\systemstate.bkf c:/programme/bacula/wait 300 } # # Backup the catalog database (after the nightly save) Job { Name = BackupCatalog JobDefs = DefaultJob Level = Full FileSet=Catalog Schedule = WeeklyCycleAfterBackup # This creates an ASCII copy of the catalog RunBeforeJob = /etc/bacula/make_catalog_backup bacula bacula # This deletes the copy of the catalog RunAfterJob = /etc/bacula/delete_catalog_backup Write Bootstrap = /var/bacula/BackupCatalog.bsr Priority = 11 # run after main backup } # Standard Restore template, to be changed by Console program Job { Name = RestoreFiles Type = Restore Client = bacula FileSet = client files-to-backup Storage = Files Pool = Default Messages = Standard Where = /tmp/bacula-restores } # List of files to be backed up FileSet { Name = client files-to-backup Ignore FileSet Changes = yes Include { Options { signature = MD5 compression=GZIP } File = \\/etc/bacula/files-to-backup } Exclude { File = /proc File = /tmp File = /.journal File = /.fsck } } FileSet { Name = Full Set Include { Options { signature = MD5 } # # Put your list of files here, preceded by 'File =', one per line #or include an external list with: # #File = file-name # # Note: / backs up everything on the root partition. #if you have other partitons such as /usr or /home #you will probably want to add them too. # # By default this is defined to point to the Bacula build #directory to give a reasonable FileSet to backup to #disk storage during initial testing. # File = / } # # If you backup the root directory, the following two excluded # files can be useful # Exclude { File = /proc File = /tmp File = /.journal File = /.fsck } } # # When to do the backups, full backup on first sunday of the month, # differential (i.e
[Bacula-users] Encoding problems on restore
Hi, I have problems restoring a german windows system backup'd with bacula. German windows installations contain german umlauts in some path names (e.g. c:/../Startmenü/...). The files are all created but as bacula tries to cahnge the file permissions I got lots of errors like: 05-Apr 16:12 hisservld-fd: RestoreFiles.2007-04-05_16.10.57 Warning: Cannot change permissions of C:/temp/bacula/C/Dokumente und Einstellungen/Administrator/StartmenÃŒ/Programme/Autostart: ERR=No such file or directory As you can see, the german umlaut ü has been changed to a UTF8 representation. Any hints how to avoid this? Thanks a lot in advance. -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Encoding problems on restore
Robert Nelson schrieb: Which version of Windows is this? A 2003 Server. -Original Message- From: [EMAIL PROTECTED] [mailto:bacula-users- [EMAIL PROTECTED] On Behalf Of Christoph Litauer Sent: Thursday, April 05, 2007 7:38 AM To: bacula-users Subject: [Bacula-users] Encoding problems on restore Hi, I have problems restoring a german windows system backup'd with bacula. German windows installations contain german umlauts in some path names (e.g. c:/../Startmenü/...). The files are all created but as bacula tries to cahnge the file permissions I got lots of errors like: 05-Apr 16:12 hisservld-fd: RestoreFiles.2007-04-05_16.10.57 Warning: Cannot change permissions of C:/temp/bacula/C/Dokumente und Einstellungen/Administrator/StartmenÃŒ/Programme/Autostart: ERR=No such file or directory As you can see, the german umlaut ü has been changed to a UTF8 representation. Any hints how to avoid this? Thanks a lot in advance. -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Gruß Christoph Litauer - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] reusing tapes in Error-State
Hi, a few of my autochanger tapes have VolStatus: Error. This is because the number of files in the catalogue didn't match the number of files on the tape. I don't know why this happend, is it a known bug of version 1.38.9? Nevertheless: I need to reuse these errored tapes. Are they automatically reused after alle jobs are purged? Is an errored tape still used in recovers? How can I list all jobs on an errored tape? Thanks a lot in advance! -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] One Pool with several File-Devices
Hi, I want to setup a bacula backup server with several raid devices connected. I don't want to build one big volume out of the raids. Instead I need to use them as singe devices. I want to defined lots of backup media on each of the raids so that any job could use any media on any of the raids. Is it possible? Can you give me a configuration example? I read through the manuals but could only find definitions for exactly one storage device per job or pool. Thanks a lot in advance. -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Spooling parallel, Despooling sequential
Arno Lehmann schrieb: Hi, On 6/2/2006 9:00 AM, Christoph Litauer wrote: Dear bacula users, I currently backup about 15 linux/windows servers to a LTO streamer. For increased restore speed I want no parallel (interleaving) backups on the tapes. So I set Maximum Concurrent Jobs of the tape storage to 1. On the other hand, collecting data should happen in parallel on all clients. So I set SpoolData = yes and Maximum Concurrent Jobs in the sections Director, FileDaemon (in clients bacula-fd.conf) and Storage (bacula-sd.conf) to 20. I expected the clients to spool in parallel but despooling sequential. But the clients wait for each other doing the backups on after another. Did I miss something? Not exactly, but there's another solution to your needs. Activate spooling and allow multiple concurrent jobs. In this case, the data for one job will be written to tape consecutively (at least the amount that is spooled). Despooling happens per job, so during despooling there's only data from one job at a time going to tape. This was a important hint, thank you. Setting Concurrent Jobs to 20 everywhere does what I wanted to. -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Spooling parallel, Despooling sequential
Baptiste Malguy schrieb: Hello, I wish I could get more precise details for my case. Let's consider backup are only made on some disks. In bacula-dir.conf, in Job resources, we may set Spool Data attribute to yes. From the online doc, you can read: This option should not be used if you are writing to a disk file. I definitly understand this advice. Why spool on disk, while the final storage is on a disk. However, I still want to run multiple Jobs in parallel AND avoid interleaved backup data. Furthermore, when I had to restore some small ( 100kb) files from a disk volume 50GB, I had to wait for more than 20 minutes. I don't understand why it was so long. Here are my questions: 1 - Is it just the OS that takes so long to set its index to the content of the disk volume (file) or is it Bacula that treats a disk volume as a cartridge, with sequential access instead of random access ? It is bacula (at the moment). As you can read in the release notes, random access to disk media is disabled due to some error. So bacula has to read all the backup devices sequential. See http://www.bacula.org/?page=news - Disk seeking during restores does not yet work correctly in all cases, so it is turned off. 2 - Based on the fact Bacula does not use random access to disk volumes, what's the best deal between spooling data to avoid interleaved backups data and havin interleaved backups data on disk volumes ? I used disk devices AND spooling for a long time now (until my disk became too small). Works as you want to. 3 - By the way, what do you think of havin a single ~ 60GB disk volume or several smaller 5-10GB volumes ? Does anyone has some background about it ? There is no preference -- if bacula would use random access on disk devices. But as all backup volumes are read sequentially each volume should be small. I used 2GB. -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] suse rpms with acl support
Dear bacula users, I experimented a few days with aclsupport=yes for a SuSE 10.0 server and client -- wondering why my acls never got restored. Now I realized that the rpms for SuSE on sourceforge.net are compiled without acl support: bruch:~ # ldd /usr/sbin/bacula-fd linux-gate.so.1 = (0xe000) libz.so.1 = /lib/libz.so.1 (0x4003a000) libpthread.so.0 = /lib/tls/libpthread.so.0 (0x4004d000) libdl.so.2 = /lib/libdl.so.2 (0x4005f000) libssl.so.0.9.7 = /usr/lib/libssl.so.0.9.7 (0x40063000) libcrypto.so.0.9.7 = /usr/lib/libcrypto.so.0.9.7 (0x40093000) libstdc++.so.6 = /usr/lib/libstdc++.so.6 (0x4018d000) libm.so.6 = /lib/tls/libm.so.6 (0x4026a000) libgcc_s.so.1 = /lib/libgcc_s.so.1 (0x4029) libc.so.6 = /lib/tls/libc.so.6 (0x4029b000) /lib/ld-linux.so.2 (0x4000) I compiled the sources for myself and had no problems with acls on xfs no more. Wouldn't it be a good idea to include acl support in all rpms? -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Spooling parallel, Despooling sequential
Dear bacula users, I currently backup about 15 linux/windows servers to a LTO streamer. For increased restore speed I want no parallel (interleaving) backups on the tapes. So I set Maximum Concurrent Jobs of the tape storage to 1. On the other hand, collecting data should happen in parallel on all clients. So I set SpoolData = yes and Maximum Concurrent Jobs in the sections Director, FileDaemon (in clients bacula-fd.conf) and Storage (bacula-sd.conf) to 20. I expected the clients to spool in parallel but despooling sequential. But the clients wait for each other doing the backups on after another. Did I miss something? -- Gruß Christoph Litauer Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Rechenzentrum,http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Cloning
Erich Prinz schrieb: It's this directive in the Job section: Storage = FileStorage If I'm not mistaken, you are sending the backups to disk and to tape. Change your Storage directive to point to Overland instead of FileStorage and see if that doesn't fix it. If I am missing something, kindly point out the error! Thanks Erich, but I think this is correct. I want the backup to be done to FileStorage first. When it's finished I want it to be copied (aka cloned) to another storage medium, e.g. tape. As Arno already stated, I have to wait for migration build in. Thank you Arno. -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 --- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Cloning
Dear bacula users, I just tested a little bit with the cloning-feature of bacula. I expected cloning to work as follows: 1.) Save the clients data to medium1 (disk) 2.) Copy the saved data from medium1 to medium2 (tape) What I see is 1.) Save the clients data to medium1 (disk) 2.) Save the clients data a 2nd time to medium2 (tape) So in fact the backup is done twice: Once to the primary device and once to the clone device. bacula is such a wondeful backup tool, I believe I misconfigured something? Here are the relevant parts of my conf files: bacula-dir.conf: # Backup-Client: bruch # Client { Name = bruch-fd Address = bruch FDPort = 9102 Catalog = MyCatalog Password = xxx # password for FileDaemon File Retention = 30 days# 30 days Job Retention = 3 months# six months AutoPrune = yes # Prune expired Jobs/Files } Job { Name = bruch JobDefs = DefaultJob Client = bruch-fd FileSet = client files-to-backup Write Bootstrap = /var/bacula/bruch.bsr Storage = FileStorage Pool = Default Priority = 10 SpoolData = yes Run = bruch level=%l since=\%s\ storage=Overland pool=LTO } Storage { Name = FileStorage Address = baculahost.uni-koblenz.de SDPort = 9103 Password = xxx Device = FileStorage Autochanger = yes Media Type = File Maximum Concurrent Jobs = 20 } Storage { Name = Overland Address = baculahost.uni-koblenz.de SDPort = 9103 Password = xxx Device = Overland-NEO2000 Autochanger = yes Media Type = LTO2 Maximum Concurrent Jobs = 1 } bacula-sd.conf: # # Overland NEO 2000, 1 drive, 29 Slots (+1 cleaning slot) # Autochanger { Name = Overland-NEO2000 Device = HP LTO2 Changer Device = /dev/sg1 Changer Command = /etc/bacula/mtx-changer %c %o %S %a %d } Device { Name = HP LTO2 Device Type = Tape; Media Type = LTO2 Archive Device = /dev/nst0 AutomaticMount = yes AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; Autochanger = yes Spool Directory = /var/spool/bacula Maximum Spool Size = 26843545600 # 25GB } # # File Storage # Device { Name = FileStorage Media Type = File Archive Device = /storage LabelMedia = yes; # lets Bacula label unlabeled media Random Access = Yes; AutomaticMount = yes; # when device opened, read it RemovableMedia = no; AlwaysOpen = no; Maximum Volume Size = 2147483648 # 2GB Spool Directory = /var/spool/bacula Maximum Spool Size = 26843545600 # 25GB } -- Gruß Christoph Litauer Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Rechenzentrum,http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 --- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid0709bid3057dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restore performance using concurrent backups
Hi, I just searched the archives but didn't find hints. Sorry if this question has been asked before. I am using bacula-1.36.3 for the backup of about 12 linux clients. At the moment I just use an external hardware raid as (File-)backup device: Device { Name = FileStorage Media Type = File Archive Device = /storage LabelMedia = yes; Random Access = Yes; AutomaticMount = yes; RemovableMedia = no; AlwaysOpen = no; Maximum Volume Size = 2147483648 # 2GB } The backups are done in parallel with a maximum of 20 concurrent jobs. The most recent backup of one of the clients (about 1,6 GB of data) consists of a full, 1 differential and 2 incrememtal backups, located on 16 backup files (FileStorage). Running the restore I get a Rate of about 500 KB/sec (restoring to a local filesystem on the storage server). The raid device is able to deliver 12MB/sec. The local filesystem is able to write about 10MB/sec, My conclusion for that degraded performance is that even if I use FileStorage as a random access media, the restore process recovers the data by sequentially reading all the 16 backup files searching for the right files. I would have expected a rate of nearly native disk speed because the backup files could be seeked. A solution would be to not perform concurrent backups. But then the backup window gets significantly wider (especially for the incrementals). Any solutions, hints? Would my problem disappear if I upgrade to 1.38.x? Thanks a lot in advance. If you need more of my configuration files, no problem, please tell me. -- Regards Christoph Christoph Litauer [EMAIL PROTECTED] Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311 PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2 --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users