Re: [Bacula-users] Windows File Recovery
On 14.04.2010 1:54, Jon bruce wrote: Hello there, I have a Linux bacula director with a few clients. So far so good, except when I need to select files from one client which is a windows computer. From bconsole I enter the command restore, select 6: Select backup for a client before a specified time and pick my date and time. Then select my client and FileSet. Bacula shows me ... You have selected the following JobIds: 303,345 Building directory tree for JobId(s) 303,345 ... ++ 61,909 files inserted into the tree. Then dumps me to the file selection mode. I can now do ls and see (for example) d:\office\Employee files/ however trying cd d:\office\Employee files/ does not work, it returns Invalid path given.. I've tried different combinations of \ and / and and ', etc all with the same result. cdtab tab does show me that directory as well. If I use *Employee* it works, however I need a specific directory under that, not the whole thing. Based on http://man.chinaunix.net/network/bacula/bacula_manual/Bacula_Consol_Restor_Comman.html#SECTION0002111000 I am trying the right command. Any thoughts or help would be great. I should point out that I'm using bacula 5.0.1 from Debian BackPorts and the windows side was downloaded from sourceforge. -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users Hello. I always use in situation of setting files/folders for restore such scheme. At directory tree I make cd step only on one level in depth, i.e. ls see directories names. maybe copy name of needed dir cd [DirectoryName] and so on -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] End of Tape errors with HP LTO-4 drive on Linux
Bacula works perfectly so far. The only serious problem I have is End of Tape detection. E.g. if I need to reboot the backup server, the current tape will be rewinded. The next backup job then seems not to find the end of the last backup and the tape will be set to Error state: 14-Apr 04:00 bacula-sd JobId 925: Volume Weekly1 previously written, moving to end of data. 14-Apr 04:23 bacula-sd JobId 925: Error: Unable to position to end of data on device LTO-4 (/dev/nst0): ERR=dev.c:954 ioctl MTEOM error on LTO-4 (/dev/nst0). ERR=Input/output error. 14-Apr 04:23 bacula-sd JobId 925: Marking Volume Weekly1 in Error in Catalog. I already tried playing with TWO EOF = yes/no with no luck. Any ideas? Robert -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
--- On Mon, 4/12/10, Phil Stracchino ala...@metrocast.net wrote:
File Retention = 1 days
Job Retention = 6 months
}
===
Is the client specific File Retention causing my
problem?
Yes, that's exactly the problem.
I'm also a bit confused (obviously) with:
File Retention
Job Retention
Volume Retention
Volume Use Duration
Basically, whichever is the SHORTEST of the retention
settings will
dictate when data begins getting pruned. In most
cases, you probably
want all three retention settings to be the same.
Volume Use Duration is not a retention setting at all; it
is the time
window during which data may be written to the volume,
starting from
when it is first written after creation or recycling.
When that window
ends, the volume will be marked Used even if not full, and
no new jobs
not already running will be allowed to write to it.
(I'm honestly not
certain what happens to the running job if the use duration
expires
while a job is still writing to the volume; I've never
tried it.)
If all your clients will have the same settings, then I
would remofe the
File Retention setting from your clients altogether.
Unless a specific
client NEEDS its retention settings to be different from
the Pool
defaults, there's no reason to have retention settings in
the client
resource at all.
Phil:
It's still using a new file every night. Here's the top of the 'messages'
log, if it's any help:
===
12-Apr 23:05 backula-dir JobId 160: No prior Full backup Job record found.
12-Apr 23:05 backula-dir JobId 160: No prior or suitable Full backup found in
catalog. Doing FULL backup.
12-Apr 23:05 backula-dir JobId 160: Start Backup JobId 160,
Job=DefaultBackupClient.2010-04-12_23.05.00_03
12-Apr 23:05 backula-dir JobId 160: Using Device FileStorage
12-Apr 23:05 backula-sd JobId 160: Volume disk_0002 previously written,
moving to end of data.
12-Apr 23:05 backula-sd JobId 160: Ready to append to end of Volume disk_0002
size=2566554688
12-Apr 23:05 backula-sd JobId 160: Job write elapsed time = 00:00:19, Transfer
rate = 132.2 M Bytes/second
12-Apr 23:05 backula-dir JobId 160: Bacula backula-dir 5.0.1 (24Feb10):
12-Apr-2010 23:05:29
===
I made all those settings be 9 days, as you suggested. So, currently, I have:
no 'retention' definitions in any of my Client sections.
# Default pool definition
Pool {
Name = Default
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Job Retention = 9 days
Volume Retention = 9 day
}
# File Pool definition
Pool {
Name = File
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Job Retention = 9 days
Volume Retention = 9 days
Volume Use Duration = 23h
Maximum Volume Bytes = 1400G
Maximum Volumes = 10
}
Could it be the Volume Use Retetion ? Currently, my backups run fast since
there are only 2 clients. So, if they're done within an hour, maybe this
setting isn't doing what it would normally do when backups take a few hours to
run?
--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula backup problem!
Hello all I have an ubuntu (8.04.3) server where I use bacula to make backups of the files stored on the server. Ive been trying to find a solution (with no luck) trying to succesfully implement the following:- A Backup tape for each day of the week besides Thurs which is resused on a weekly basis. For the thursday tapes we have a backup tape corresponding to the week number that the thursday falls so for the first thursday of the month it would be ThursOne For example. These tapes are resued on a monthly basis. We then have a monthly tape that is used on the last thursday of the month. These tapes will be resused on a yearly basis. Another requirement is just in case a tape is accidently not changed a backup should still occur regardless of what tape is in the drive (so if its tuesday and mondays tape is still in the tape drive it should rewrite the tape). I did have this successfully set up where the tape was appeneded after each use rather than being recycled after the nightly backup. But then after a few weeks I would have to manually purge tapes when they became full (which isnt ideal - as Im not always in the office so in my absence it may be that a backup may not take place), so have been playing around and have now got the tapes to be marked as used after a max of 2 jobs (so the backup of the files and the catalog of the night). I also added this line 'Recycle Current Volume = yes' so that it would hopefully recycle the volume in the drive. However what I am finding is that the tape that should be recycled is not, but in yesterday case the Mondays tape was recycled rather than the Tuesday although Mondays was the last written so Im not even sure why it choose to recycle this tape... Any ideas as to how I would implement the above with the requirements... Another idea is for a script to run before the job that would purge the current tape and recycle it so that the backup occurs on this tape. Any idea how to write such a script - as I would have no clue!!! Thanks in advance for any help!!! +-- |This was sent by tqzeli...@yahoo.co.uk via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
--- On Mon, 4/12/10, Phil Stracchino ala...@metrocast.net wrote:
File Retention = 1 days
Job Retention = 6 months
}
===
Is the client specific File Retention causing my
problem?
Yes, that's exactly the problem.
I'm also a bit confused (obviously) with:
File Retention
Job Retention
Volume Retention
Volume Use Duration
Basically, whichever is the SHORTEST of the retention
settings will
dictate when data begins getting pruned. In most
cases, you probably
want all three retention settings to be the same.
Volume Use Duration is not a retention setting at all; it
is the time
window during which data may be written to the volume,
starting from
when it is first written after creation or recycling.
When that window
ends, the volume will be marked Used even if not full, and
no new jobs
not already running will be allowed to write to it.
(I'm honestly not
certain what happens to the running job if the use duration
expires
while a job is still writing to the volume; I've never
tried it.)
If all your clients will have the same settings, then I
would remofe the
File Retention setting from your clients altogether.
Unless a specific
client NEEDS its retention settings to be different from
the Pool
defaults, there's no reason to have retention settings in
the client
resource at all.
Phil:
I just realized a typo. I meant to say it's still using the same file every
night. I also just noticed something after the post-- the appending
information in the log below. So, it's not re-writing over the top of the same
file every night; it's appending to it-- and not using a new file every night
as I initially wanted.
Here's the top of the 'messages' log, if it's any help:
===
12-Apr 23:05 backula-dir JobId 160: No prior Full backup Job record found.
12-Apr 23:05 backula-dir JobId 160: No prior or suitable Full backup found in
catalog. Doing FULL backup.
12-Apr 23:05 backula-dir JobId 160: Start Backup JobId 160,
Job=DefaultBackupClient.2010-04-12_23.05.00_03
12-Apr 23:05 backula-dir JobId 160: Using Device FileStorage
12-Apr 23:05 backula-sd JobId 160: Volume disk_0002 previously written,
moving to end of data.
12-Apr 23:05 backula-sd JobId 160: Ready to append to end of Volume disk_0002
size=2566554688
12-Apr 23:05 backula-sd JobId 160: Job write elapsed time = 00:00:19, Transfer
rate = 132.2 M Bytes/second
12-Apr 23:05 backula-dir JobId 160: Bacula backula-dir 5.0.1 (24Feb10):
12-Apr-2010 23:05:29
===
I made all those settings be 9 days, as you suggested. So, currently, I have:
no 'retention' definitions in any of my Client sections.
# Default pool definition
Pool {
Name = Default
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Job Retention = 9 days
Volume Retention = 9 day
}
# File Pool definition
Pool {
Name = File
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Job Retention = 9 days
Volume Retention = 9 days
Volume Use Duration = 23h
Maximum Volume Bytes = 1400G
Maximum Volumes = 10
}
Could it be the Volume Use Retetion ? Currently, my backups run fast since
there are only 2 clients. So, if they're done within an hour, maybe this
setting isn't doing what it would normally do when backups take a few hours to
run?
--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
I just realized a typo. I meant to say it's still using the same file every night. I also just noticed something after the post-- the appending information in the log below. So, it's not re-writing over the top of the same file every night; it's appending to it-- and not using a new file every night as I initially wanted. Can you post the output of list media John -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
On 04/14/10 07:51, Joseph Spenner wrote:
Phil:
I just realized a typo. I meant to say it's still using the same file
every night. I also just noticed something after the post-- the appending
information in the log below. So, it's not re-writing over the top of the
same file every night; it's appending to it-- and not using a new file
every night as I initially wanted.
Here's the top of the 'messages' log, if it's any help:
===
12-Apr 23:05 backula-dir JobId 160: No prior Full backup Job record found.
12-Apr 23:05 backula-dir JobId 160: No prior or suitable Full backup found in
catalog. Doing FULL backup.
12-Apr 23:05 backula-dir JobId 160: Start Backup JobId 160,
Job=DefaultBackupClient.2010-04-12_23.05.00_03
12-Apr 23:05 backula-dir JobId 160: Using Device FileStorage
12-Apr 23:05 backula-sd JobId 160: Volume disk_0002 previously written,
moving to end of data.
12-Apr 23:05 backula-sd JobId 160: Ready to append to end of Volume
disk_0002 size=2566554688
12-Apr 23:05 backula-sd JobId 160: Job write elapsed time = 00:00:19,
Transfer rate = 132.2 M Bytes/second
12-Apr 23:05 backula-dir JobId 160: Bacula backula-dir 5.0.1 (24Feb10):
12-Apr-2010 23:05:29
===
I made all those settings be 9 days, as you suggested. So, currently, I have:
no 'retention' definitions in any of my Client sections.
# Default pool definition
Pool {
Name = Default
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Job Retention = 9 days
Volume Retention = 9 day
}
# File Pool definition
Pool {
Name = File
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Job Retention = 9 days
Volume Retention = 9 days
Volume Use Duration = 23h
Maximum Volume Bytes = 1400G
Maximum Volumes = 10
}
Could it be the Volume Use Retetion ? Currently, my backups run fast since
there are only 2 clients. So, if they're done within an hour, maybe this
setting isn't doing what it would normally do when backups take a few hours
to run?
Did you Update the pools from the resources, and the volumes from the pools?
What do the 'List Volumes' and 'Show Pools' commands return?
--
Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org
Renaissance Man, Unix ronin, Perl hacker, Free Stater
It's not the years, it's the mileage.
--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Could not create JobMedia record
On Wed, 14 Apr 2010 02:30:15 -0400, ladolf said: Martin Simmons wrote: On Tue, 13 Apr 2010 04:08:03 -0400, ladolf said: I am trying to import tape data to bacula catalog using bscan: bscan -b mju3-fd_MJU-TED2.bsr -m -n bacula -u bacula -P bacula -h localhost -s -S -v /dev/st0 I got this error: bscan: bscan.c:1245 Could not create JobMedia record. ERR=sql_create.c:156 Update Media record UPDATE Media SET EndFile=167, EndBlock=27602 WHERE MediaId=0 failed: ERR= This is whole log: bacula:~ # bscan -b /root/bacula/mju1-fd_MJU-MES3.bsr -m -n bacula -u bacula -P bacula -s -S -v /dev/st0 bscan: butil.c:282 Using device: /dev/st0 for reading. 13-Apr 08:17 bscan JobId 0: Ready to read from volume MJU-MES3 on device LTO3Drive (/dev/st0). bscan: bscan.c:297 First Volume Size = 0 bscan: bscan.c:309 Using Database: bacula, User: bacula 13-Apr 08:17 bscan JobId 0: Forward spacing Volume MJU-MES3 to file:block 0:1. bscan: bscan.c:521 SOS_LABEL: Found Job record for JobId: 375 ... bscan: bscan.c:689 1,572,864 file records. At file:blk=165:13,267 bytes=330,660,788,028 bscan: bscan.c:1037 Fileset MJU_NSS already exists. bscan: bscan.c:1152 Could not update JobId=328 record. ERR=sql_update.c:196 Update failed: affected_rows=0 for UPDATE Job SET JobStatus='T',EndTime='2010-03-30 05:21:18',ClientId=2,JobBytes=33547479,ReadBytes=0,JobFiles=1594852,JobErrors=0,VolSessionId=43,VolSessionTime=1268211453,PoolId=0,FileSetId=9,JobTDate=1269919278,RealEndTime='2010-03-30 05:21:18',PriorJobId=0 WHERE JobId=328 bscan: bscan.c:1245 Could not create JobMedia record. ERR=sql_create.c:156 Update Media record UPDATE Media SET EndFile=167, EndBlock=27602 WHERE MediaId=0 failed: ERR= What is in the bsr file? Also, I notice that you have two different bsr files in the command lines above. Do you have any bsr files that work? BTW, I hope you aren't using /dev/st0 in your bacula-sd.conf -- it should be /dev/nst0, otherwise the start of the tape might be overwritten if you run more than one job. Thanks for the notice __Martin. You are right. The first bsr (TED2) is wrong one. But the second one (mju1-fd_MJU-MES3.bsr) should be valid one. I actually have 3 bsr files (3 jobs) for that monthly tape mju1-fd_MJU-MES3.bsr mju2-fd_MJU-MES3.bsr mju3-fd_MJU-MES3.bsr but only first one is important. Should I include all 3 bsr files in one command line? The reason I am trying to get data from this tape is because I installed a new bacula server. Old bacula server was the same version (3.0.2). A new server used LTO-3 drive, a new one has LTO-4. I left section for LTO-3 drive in bacula-sd.conf. I dumped catalog from old server and inported it to new server. Restore from old tape worked. The problem occured because the first time monthly tape should be used on new server, but backup on new server did not start (forgot to add mount to start of the job). Because old server was still running, I have montly backup, which is in catalog on old server, but not in catalog on new server. I would like to import it to new server. I know I could use bextract in case of emergency, but I would still like to import informations about data on monthly tape into new catalog. The bsr created by a backup might be too restrictive for bscan. Can you bscan the whole tape by passing the -V VolumeName argument instead of using the bsr? Bacula reports that jobs are imported, but volume is not. I am using /dev/st0, not /dev/nst0. Why would be this wrong? I have no problem running more than one job. The /dev/st0 device usually rewinds the tape every time it is opened, whereas the /dev/nst0 device leaves it at the current position. This matters in some Bacula confgurations because it can close and reopen the device and expect it to remain in the same place. If the tape rewinds, then it will overwrite the volume label and existing jobs. Bacula will always rewind the tape itself if it needs to. __Martin -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
--- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote: Can you post the output of list media John John: Here's the results of list media === *list media Automatically selected Catalog: MyCatalog Using Catalog MyCatalog Pool: Default No results to list. Pool: File +-++---+-+---+--+--+-+--+---+---+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-++---+-+---+--+--+-+--+---+---+-+ | 25 | disk_0001 | Used | 1 |37,353,382 |0 | 0 | 1 |0 | 0 | File | 2010-04-08 23:10:03 | | 26 | disk_0002 | Append| 1 | 5,125,873,046 |1 | 0 | 1 |0 | 0 | File | 2010-04-13 23:10:02 | | 27 | disk_0003 | Used | 1 | 4,440,507,545 |1 | 0 | 1 |0 | 0 | File | 2010-04-07 23:21:26 | | 28 | disk_0004 | Used | 1 |51,194,220 |0 | 0 | 1 |0 | 0 | File | 2010-04-07 23:21:59 | | 29 | disk_0005 | Used | 1 |10,436 |0 | 0 | 1 |0 | 0 | File | 2010-04-08 23:05:03 | | 30 | disk_0006 | Used | 1 | 561 |0 | 0 | 1 |0 | 0 | File | 2010-04-08 23:07:14 | +-++---+-+---+--+--+-+--+---+---+-+ Pool: Scratch No results to list. * === -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula 5.0.1 and db issues - please, share your experience
Thanks for your answers. Stephen, do you use bconsole or bat? Perhaps the issue is only on bat. I recognize that i only use bweb and bat (on windows). Regarding your comments Stephen, my bacula server is smaller than yours, but my catalog size was 400 Mb (Baculas is working since 2 months ago). I don´t tune my database, but with 3.0.3 version thats wasn´t neccesary. Wich parameters are recommending to tune? This info i think that is very useful for people with the same issue like me... i see that some people says that the better way is creating new indexes(someone says that this is the worst option), others say to custom mysql parameters...but i can´t find any official info, and, at less in my case, i don´t have enough time(and knowledge) to testing bacula with some new indexes, or customizing mysql/postgre... I miss this offcial info... Regards On Tue, Apr 13, 2010 at 7:36 PM, Thomas Mueller tho...@chaschperli.chwrote: Am Tue, 13 Apr 2010 15:59:25 +0200 schrieb Koldo Santisteban: thanks for your answer. The first stage was with mysql 5.0.77, and works with bacula 3.0.3 without problems. I have used the same database and server with bacula 5.0.1. The bacula server + DB is a 3,5 Gb Ram with a Xeon processor. I have tested my environment installing postgree on the same server and with a empty db. I create full bacula server backup and then try to restore. I have detected that the restore process works fine usgin bweb and bacula 5.0.1, what is the difference between bat and bweb? noticed too, bat takes forever on building trees on restores. bconsole is _much_ faster. - Thomas -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
--- On Wed, 4/14/10, Phil Stracchino ala...@metrocast.net wrote: Did you Update the pools from the resources, and the volumes from the pools? What do the 'List Volumes' and 'Show Pools' commands return? Phil: Sorry. I did not do that. So, I just now did the update the pools. As far as volumes from the pools, I wasn't sure what this meant. Which commands (series of commands) perform this? Here's the output of the commands you requested: --- list volumes: --- === *list volumes Pool: Default No results to list. Pool: File +-++---+-+---+--+--+-+--+---+---+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-++---+-+---+--+--+-+--+---+---+-+ | 25 | disk_0001 | Used | 1 |37,353,382 |0 | 0 | 1 |0 | 0 | File | 2010-04-08 23:10:03 | | 26 | disk_0002 | Append| 1 | 5,125,873,046 |1 | 0 | 1 |0 | 0 | File | 2010-04-13 23:10:02 | | 27 | disk_0003 | Used | 1 | 4,440,507,545 |1 | 0 | 1 |0 | 0 | File | 2010-04-07 23:21:26 | | 28 | disk_0004 | Used | 1 |51,194,220 |0 | 0 | 1 |0 | 0 | File | 2010-04-07 23:21:59 | | 29 | disk_0005 | Used | 1 |10,436 |0 | 0 | 1 |0 | 0 | File | 2010-04-08 23:05:03 | | 30 | disk_0006 | Used | 1 | 561 |0 | 0 | 1 |0 | 0 | File | 2010-04-08 23:07:14 | +-++---+-+---+--+--+-+--+---+---+-+ Pool: Scratch No results to list. * === -- and show pools -- === *show pools Pool: name=Default PoolType=Backup use_cat=1 use_once=0 cat_files=1 max_vols=0 auto_prune=1 VolRetention=9 days VolUse=0 secs recycle=1 LabelFormat=*None* CleaningPrefix=*None* LabelType=0 RecyleOldest=0 PurgeOldest=0 ActionOnPurge=0 MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=0 MigTime=0 secs MigHiBytes=0 MigLoBytes=0 JobRetention=0 secs FileRetention=0 secs Pool: name=File PoolType=Backup use_cat=1 use_once=0 cat_files=1 max_vols=10 auto_prune=1 VolRetention=9 days VolUse=23 hours recycle=1 LabelFormat=*None* CleaningPrefix=*None* LabelType=0 RecyleOldest=0 PurgeOldest=0 ActionOnPurge=0 MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=1503238553600 MigTime=0 secs MigHiBytes=0 MigLoBytes=0 JobRetention=0 secs FileRetention=0 secs Pool: name=Scratch PoolType=Backup use_cat=1 use_once=0 cat_files=1 max_vols=0 auto_prune=1 VolRetention=1 year VolUse=0 secs recycle=1 LabelFormat=*None* CleaningPrefix=*None* LabelType=0 RecyleOldest=0 PurgeOldest=0 ActionOnPurge=0 MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=0 MigTime=0 secs MigHiBytes=0 MigLoBytes=0 JobRetention=0 secs FileRetention=0 secs * === -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula 5.0.1 and db issues - please, share your experience
On Wed, Apr 14, 2010 at 03:29:29PM +0200, Koldo Santisteban wrote: Thanks for your answers. Stephen, do you use bconsole or bat? Perhaps the issue is only on bat. I recognize that i only use bweb and bat (on windows). For what it's worth, I used bconsole, and it was extremly slow (20+ hours) under 5.0.x, while it was relatively fast (less than 10 minutes) under 3.0.3 Regarding your comments Stephen, my bacula server is smaller than yours, but my catalog size was 400 Mb (Baculas is working since 2 months ago). I don´t tune my database, but with 3.0.3 version thats wasn´t neccesary. Wich parameters are recommending to tune? This info i think that is very useful for people with the same issue like me... i see that some people says that the better way is creating new indexes(someone says that this is the worst option), others say to custom mysql parameters...but i can´t find any official info, and, at less in my case, i don´t have enough time(and knowledge) to testing bacula with some new indexes, or customizing mysql/postgre... I miss this offcial info... I do not see how you could expect to get official info before there is official opinion formed ? There is a speed bug in bacula 5.0.x series only. It is reported, and you can track the bug status at http://bugs.bacula.org/view.php?id=1472 Once the exact problem and official resolution are known, then bug report will be closed and speed bug fixed (or official recommendations given in bug report at URL above). So you could either: 1) put up with slowness until the bug 1472 is resolved and then upgrade and/or follow official recommendations. Perhaps you can even help with it by providing additional information and/or running tests ? 2) downgrade to 3.0.3 which does not have this bug 3) spend some time reading the experiences of others and trying to adopt them to your case 4) give up -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
On Wed, Apr 14, 2010 at 9:28 AM, Joseph Spenner joseph85...@yahoo.com wrote: --- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote: Can you post the output of list media John John: Here's the results of list media === *list media Automatically selected Catalog: MyCatalog Using Catalog MyCatalog Pool: Default No results to list. Pool: File +-++---+-+---+--+--+-+--+---+---+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-++---+-+---+--+--+-+--+---+---+-+ | 25 | disk_0001 | Used | 1 | 37,353,382 | 0 | 0 | 1 | 0 | 0 | File | 2010-04-08 23:10:03 | | 26 | disk_0002 | Append | 1 | 5,125,873,046 | 1 | 0 | 1 | 0 | 0 | File | 2010-04-13 23:10:02 | | 27 | disk_0003 | Used | 1 | 4,440,507,545 | 1 | 0 | 1 | 0 | 0 | File | 2010-04-07 23:21:26 | | 28 | disk_0004 | Used | 1 | 51,194,220 | 0 | 0 | 1 | 0 | 0 | File | 2010-04-07 23:21:59 | | 29 | disk_0005 | Used | 1 | 10,436 | 0 | 0 | 1 | 0 | 0 | File | 2010-04-08 23:05:03 | | 30 | disk_0006 | Used | 1 | 561 | 0 | 0 | 1 | 0 | 0 | File | 2010-04-08 23:07:14 | +-++---+-+---+--+--+-+--+---+---+-+ Pool: Scratch No results to list. * === All of these volumes are in the Default pool where you have no restrictions on volume usage. You placed the restrictions on the Backup pool. For these volumes you have Volume Retention of 0 which I believe means never recycle. John -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
On Wed, Apr 14, 2010 at 10:06 AM, John Drescher dresche...@gmail.com wrote: On Wed, Apr 14, 2010 at 9:28 AM, Joseph Spenner joseph85...@yahoo.com wrote: --- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote: Can you post the output of list media John John: Here's the results of list media === *list media Automatically selected Catalog: MyCatalog Using Catalog MyCatalog Pool: Default No results to list. Pool: File +-++---+-+---+--+--+-+--+---+---+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-++---+-+---+--+--+-+--+---+---+-+ | 25 | disk_0001 | Used | 1 | 37,353,382 | 0 | 0 | 1 | 0 | 0 | File | 2010-04-08 23:10:03 | | 26 | disk_0002 | Append | 1 | 5,125,873,046 | 1 | 0 | 1 | 0 | 0 | File | 2010-04-13 23:10:02 | | 27 | disk_0003 | Used | 1 | 4,440,507,545 | 1 | 0 | 1 | 0 | 0 | File | 2010-04-07 23:21:26 | | 28 | disk_0004 | Used | 1 | 51,194,220 | 0 | 0 | 1 | 0 | 0 | File | 2010-04-07 23:21:59 | | 29 | disk_0005 | Used | 1 | 10,436 | 0 | 0 | 1 | 0 | 0 | File | 2010-04-08 23:05:03 | | 30 | disk_0006 | Used | 1 | 561 | 0 | 0 | 1 | 0 | 0 | File | 2010-04-08 23:07:14 | +-++---+-+---+--+--+-+--+---+---+-+ Pool: Scratch No results to list. * === All of these volumes are in the Default pool where you have no restrictions on volume usage. You placed the restrictions on the Backup pool. For these volumes you have Volume Retention of 0 which I believe means never recycle. I am sorry. I was misreading. You have the restrictions on the File pool which is what your output says. You need to execute the two update commands that Phil asked you about. update -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
On Wed, Apr 14, 2010 at 10:09 AM, John Drescher dresche...@gmail.com wrote: On Wed, Apr 14, 2010 at 10:06 AM, John Drescher dresche...@gmail.com wrote: On Wed, Apr 14, 2010 at 9:28 AM, Joseph Spenner joseph85...@yahoo.com wrote: --- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote: Can you post the output of list media John John: Here's the results of list media === *list media Automatically selected Catalog: MyCatalog Using Catalog MyCatalog Pool: Default No results to list. Pool: File +-++---+-+---+--+--+-+--+---+---+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-++---+-+---+--+--+-+--+---+---+-+ | 25 | disk_0001 | Used | 1 | 37,353,382 | 0 | 0 | 1 | 0 | 0 | File | 2010-04-08 23:10:03 | | 26 | disk_0002 | Append | 1 | 5,125,873,046 | 1 | 0 | 1 | 0 | 0 | File | 2010-04-13 23:10:02 | | 27 | disk_0003 | Used | 1 | 4,440,507,545 | 1 | 0 | 1 | 0 | 0 | File | 2010-04-07 23:21:26 | | 28 | disk_0004 | Used | 1 | 51,194,220 | 0 | 0 | 1 | 0 | 0 | File | 2010-04-07 23:21:59 | | 29 | disk_0005 | Used | 1 | 10,436 | 0 | 0 | 1 | 0 | 0 | File | 2010-04-08 23:05:03 | | 30 | disk_0006 | Used | 1 | 561 | 0 | 0 | 1 | 0 | 0 | File | 2010-04-08 23:07:14 | +-++---+-+---+--+--+-+--+---+---+-+ Pool: Scratch No results to list. * === All of these volumes are in the Default pool where you have no restrictions on volume usage. You placed the restrictions on the Backup pool. For these volumes you have Volume Retention of 0 which I believe means never recycle. I am sorry. I was misreading. You have the restrictions on the File pool which is what your output says. You need to execute the two update commands that Phil asked you about. An example of what you need to do is here: # bconsole Connecting to Director jmd0:9101 1000 OK: jmd0-dir Version: 5.0.1 (24 February 2010) Enter a period to cancel a command. *update Automatically selected Catalog: MyCatalog Using Catalog MyCatalog Update choice: 1: Volume parameters 2: Pool from resource 3: Slots from autochanger 4: Long term statistics Choose catalog item to update (1-4): 2 The defined Pool resources are: 1: Default 2: Catalogs 3: Users 4: Temp 5: Scratch Select Pool resource (1-5): 1 Select the File pool instead of the default pool. Then run the update the volumes from pool *update Update choice: 1: Volume parameters 2: Pool from resource 3: Slots from autochanger 4: Long term statistics Choose catalog item to update (1-4): 1 Parameters to modify: 1: Volume Status 2: Volume Retention Period 3: Volume Use Duration 4: Maximum Volume Jobs 5: Maximum Volume Files 6: Maximum Volume Bytes 7: Recycle Flag 8: Slot 9: InChanger Flag 10: Volume Files 11: Pool 12: Volume from Pool 13: All Volumes from Pool 14: All Volumes from all Pools 15: Enabled 16: RecyclePool 17: Action On Purge 18: Done Select parameter to modify (1-18): 13 The defined Pool resources are: 1: Default 2: Catalogs 3: Users 4: Temp 5: Scratch Select Pool resource (1-5): 1 All Volume defaults updated from Default Pool record. Again select the File pool instead of default. John -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
--- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote: You need to execute the two update commands that Phil asked you about. update Ok, I ran the commands. I'll see what happens tonight. Anything else I should run to verify? Thanks! -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
On Wed, Apr 14, 2010 at 10:28 AM, Joseph Spenner joseph85...@yahoo.com wrote: --- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote: You need to execute the two update commands that Phil asked you about. update Ok, I ran the commands. I'll see what happens tonight. Anything else I should run to verify? Post the output of list media pool=File John -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
--- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote: Post the output of list media pool=File John John: Here are results: === *list media pool=File +-++---+-+---+--+--+-+--+---+---+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-++---+-+---+--+--+-+--+---+---+-+ | 25 | disk_0001 | Used | 1 |37,353,382 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-08 23:10:03 | | 26 | disk_0002 | Append| 1 | 5,125,873,046 |1 | 777,600 | 1 |0 | 0 | File | 2010-04-13 23:10:02 | | 27 | disk_0003 | Used | 1 | 4,440,507,545 |1 | 777,600 | 1 |0 | 0 | File | 2010-04-07 23:21:26 | | 28 | disk_0004 | Used | 1 |51,194,220 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-07 23:21:59 | | 29 | disk_0005 | Used | 1 |10,436 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-08 23:05:03 | | 30 | disk_0006 | Used | 1 | 561 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-08 23:07:14 | +-++---+-+---+--+--+-+--+---+---+-+ * === -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula 5.0.1 and db issues - please, share your experience
I mostly use bat for restores (i.e. building restore tree). I did nothing with my tables regarding indexing. I have whatever the bacula scripts create by defaults. In regards to tuning, I did play with changing the join and sort buffer sizes. I found a 'slight' increase in performance. By slight, I mean something like 4.5 vs 4.6 minutes for the same restore. Stephen On 4/14/10 6:29 AM, Koldo Santisteban wrote: Thanks for your answers. Stephen, do you use bconsole or bat? Perhaps the issue is only on bat. I recognize that i only use bweb and bat (on windows). Regarding your comments Stephen, my bacula server is smaller than yours, but my catalog size was 400 Mb (Baculas is working since 2 months ago). I don´t tune my database, but with 3.0.3 version thats wasn´t neccesary. Wich parameters are recommending to tune? This info i think that is very useful for people with the same issue like me... i see that some people says that the better way is creating new indexes(someone says that this is the worst option), others say to custom mysql parameters...but i can´t find any official info, and, at less in my case, i don´t have enough time(and knowledge) to testing bacula with some new indexes, or customizing mysql/postgre... I miss this offcial info... Regards On Tue, Apr 13, 2010 at 7:36 PM, Thomas Mueller tho...@chaschperli.ch mailto:tho...@chaschperli.ch wrote: Am Tue, 13 Apr 2010 15:59:25 +0200 schrieb Koldo Santisteban: thanks for your answer. The first stage was with mysql 5.0.77, and works with bacula 3.0.3 without problems. I have used the same database and server with bacula 5.0.1. The bacula server + DB is a 3,5 Gb Ram with a Xeon processor. I have tested my environment installing postgree on the same server and with a empty db. I create full bacula server backup and then try to restore. I have detected that the restore process works fine usgin bweb and bacula 5.0.1, what is the difference between bat and bweb? noticed too, bat takes forever on building trees on restores. bconsole is _much_ faster. - Thomas -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net mailto:Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Stephen Thompson Berkeley Seismological Laboratory step...@seismo.berkeley.edu215 McCone Hall # 4760 404.538.7077 (phone) University of California, Berkeley 510.643.5811 (fax) Berkeley, CA 94720-4760 -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula 5.0.1 and db issues - please, share your experience
Stephen, do you use bat or bconsole? Perhaps the issue os on bat console... El 13 de abr de 2010, 7:37 p.m., Thomas Mueller tho...@chaschperli.ch escribió: Am Tue, 13 Apr 2010 15:59:25 +0200 schrieb Koldo Santisteban: thanks for your answer. The first stage was with mysql 5.0.77, and works with bacula 3.0.3 ... noticed too, bat takes forever on building trees on restores. bconsole is _much_ faster. - Thomas -- Download Intel#174... -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
On 04/14/10 10:55, Joseph Spenner wrote: --- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote: Post the output of list media pool=File John John: Here are results: === *list media pool=File +-++---+-+---+--+--+-+--+---+---+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-++---+-+---+--+--+-+--+---+---+-+ | 25 | disk_0001 | Used | 1 |37,353,382 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-08 23:10:03 | | 26 | disk_0002 | Append| 1 | 5,125,873,046 |1 | 777,600 | 1 |0 | 0 | File | 2010-04-13 23:10:02 | | 27 | disk_0003 | Used | 1 | 4,440,507,545 |1 | 777,600 | 1 |0 | 0 | File | 2010-04-07 23:21:26 | | 28 | disk_0004 | Used | 1 |51,194,220 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-07 23:21:59 | | 29 | disk_0005 | Used | 1 |10,436 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-08 23:05:03 | | 30 | disk_0006 | Used | 1 | 561 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-08 23:07:14 | +-++---+-+---+--+--+-+--+---+---+-+ * === Joseph, That looks much better. Now your volumes have the correct nine days retention time for your desired ten-day cycle, instead of zero, so your jobs will actually be kept around instead of being pruned as soon as they complete. (That's why you were always seeing No prior job found.) I suggest you now purge and recycle all of your existing volumes so that you're starting over from a clean slate, let it run, and see how it goes. Right now, you have only one appendable volume. -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, Free Stater It's not the years, it's the mileage. -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] restore directory incomplete
Hi, I am using bacula 5.0.1 on linux opensuse 64bits and would like to report a strange behaviour for the restore directory feature. When I restore a user's directory using bconsole, some sub-folders are missing and are not restored. I checked Bacula catalog and those missing directories have been backed up correctly because I can restore them individually. For example, if I restore /home/olivier folder, the /home/olivier/Desktop is not restored. Nevertheless I can restore /home/olivier/Desktop individually if I specify /home/olivier/Desktop when choosing to restore using a list of directories. It would be handy to make sure that no sub-folders are missing when restoring users' folders. Any help appreciated Regards Olivier -- Olivier RICHE, Computing officer University of Ulster, School of Biomedical Sciences, Cromore Road, Coleraine BT52 1SA, Northern Ireland http://www.systemsbiology.ulster.ac.uk phone: +44-(0)28-70-323205 Western laziness consists of cramming our lives with compulsive activity, so that there is no time at all to confront the real issues. - -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bconsole command for media info
Hi, In bacula-5.0.1 if I run the bconsole command: llist media pool=FullTapes I'll get the extended information for all tapes in the pool. Is there a command that will give me the same information bit only for tapes I specifically ask for (like mediaid=4 or volumelabel=...) Thanks -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
If life gives you lemons, keep them-- because hey.. free lemons. --- On Wed, 4/14/10, Phil Stracchino ala...@metrocast.net wrote: Joseph, That looks much better. Now your volumes have the correct nine days retention time for your desired ten-day cycle, instead of zero, so your jobs will actually be kept around instead of being pruned as soon as they complete. (That's why you were always seeing No prior job found.) I suggest you now purge and recycle all of your existing volumes so that you're starting over from a clean slate, let it run, and see how it goes. Right now, you have only one appendable volume. Phil: I believe I purged the volumes correctly, but not sure how to 'recycle' volumes..? Here's what it looks like now: === *list media pool=File +-++---+-+---+--+--+-+--+---+---+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-++---+-+---+--+--+-+--+---+---+-+ | 25 | disk_0001 | Purged| 1 |37,353,382 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-08 23:10:03 | | 26 | disk_0002 | Purged| 1 | 5,125,873,046 |1 | 777,600 | 1 |0 | 0 | File | 2010-04-13 23:10:02 | | 27 | disk_0003 | Purged| 1 | 4,440,507,545 |1 | 777,600 | 1 |0 | 0 | File | 2010-04-07 23:21:26 | | 28 | disk_0004 | Purged| 1 |51,194,220 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-07 23:21:59 | | 29 | disk_0005 | Purged| 1 |10,436 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-08 23:05:03 | | 30 | disk_0006 | Purged| 1 | 561 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-08 23:07:14 | +-++---+-+---+--+--+-+--+---+---+-+ * === -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] too big differential backup
Hi there, I have a working Bacula-system, my only problem is that I get too big differential backups comparing to the full backup, although just a few files changed. (I had the same issue when I used incremental backups before but now I'm using only full and differential backups.) I just backed up a directory with almost 130 000 files and got a 6GB full backup. Then I run a differential backup and got 70 000 files backed up again using 2GB disk... The differential backup has just run a few minutes after the full finished and the files did NOT changed since the full backup finished. I checked the version browser in Bat and found duplicated files with having the same hash and after checking the files on the file-system, I noticed that they were not changed at all The same size, permissions and modification date. I am using the accurate option, having TLS and encryption set. And the director is running on an Ubuntu 9.10 but from Debian Lenny Backports. Version number is 5.0.1-1~bpo50+1. Any idea? thank you, Zsolt -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problems getting restore to work
Craig, Actually I found out to late that the restore was doing exactly what the documentation said it would do. It restored to the 'root' directory of the client. So, I just got home last night and I got a call from one of the engineers that the root directory of the file server was full, do you know anything about this directory /home...? OOPS!!! So we deleted the errant restore and I think they rebooted the file server. Goes to show that sometimes we can't remember everything! H, how many times did I try that 4,5,6 with different options. Anyway, it restored. thanks, jerry Craig Ringer wrote: On 14/04/10 00:19, Jerry Lowry wrote: I also get an error saying that it can not create a directory on the same disk for the same reason ERR= No space left on device. But I think this is the same type of error. Betcha you've run out of free inodes on the target file system. Run df -i to see. -- Craig Ringer -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
On 04/14/10 14:01, Joseph Spenner wrote: Phil: I believe I purged the volumes correctly, but not sure how to 'recycle' volumes..? Here's what it looks like now: === *list media pool=File +-++---+-+---+--+--+-+--+---+---+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-++---+-+---+--+--+-+--+---+---+-+ | 25 | disk_0001 | Purged| 1 |37,353,382 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-08 23:10:03 | | 26 | disk_0002 | Purged| 1 | 5,125,873,046 |1 | 777,600 | 1 |0 | 0 | File | 2010-04-13 23:10:02 | | 27 | disk_0003 | Purged| 1 | 4,440,507,545 |1 | 777,600 | 1 |0 | 0 | File | 2010-04-07 23:21:26 | | 28 | disk_0004 | Purged| 1 |51,194,220 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-07 23:21:59 | | 29 | disk_0005 | Purged| 1 |10,436 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-08 23:05:03 | | 30 | disk_0006 | Purged| 1 | 561 |0 | 777,600 | 1 |0 | 0 | File | 2010-04-08 23:07:14 | +-++---+-+---+--+--+-+--+---+---+-+ * === Once purged, you can either let Bacula recycle them itself, or you can use the Update Volume command to manually change the volume status to Recycle. This is a particularly straightforward operation if you are using BAT, since you can do it on all the volumes at once. -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, Free Stater It's not the years, it's the mileage. -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] VirtualFull mysql query blocks other jobs for a long time
Hello, Graham Keeling wrote: Hello, I now believe that the 'taking hours' problem that I was having was down to having additional indexes on my File table, as Eric suggested. I am using mysql-5.0.45. I had these indexes: JobId JobId, PathId, FilenameId PathId FilenameId Now I have these indexes: JobId JobId, PathId, FilenameId The queries on my 'real' database now take about a second, rather than half a day. Nice to see that my first advise was the good one. A suggestion - perhaps the following comment in src/cats/make_mysql_tables.in could be changed to include a warning: # # Possibly add one or more of the following indexes # to the above File table if your Verifies are # too slow. # # INDEX (PathId), # INDEX (FilenameId), # INDEX (FilenameId, PathId) # INDEX (JobId), # However, I also tested the 3.0.3 and 5.0.1 queries using Eric's test script and the much larger database that it generates. I found that there is a definite slowdown. Results from do_bench(10,13, 220). In this case, the slowdown is about 15%. new|220|220|312 old|220|220|268 graham|220|220|158 Result 'graham' is the time it takes to do a query that I came up with that looks similar to the postgresql query, but uses the mysql group by trick that is frowned upon: SELECT MAX(JobTDate) AS JobTDate, JobId, FileId, FileIndex, PathId, FilenameId, LStat, MD5 FROM (SELECT JobTDate, JobId, FileId, FileIndex, PathId, FilenameId, LStat, MD5 FROM (SELECT FileId, JobId, PathId, FilenameId, FileIndex, LStat, MD5 FROM File WHERE JobId IN ($jobid) UNION ALL SELECT File.FileId, File.JobId, PathId, FilenameId, File.FileIndex, LStat, MD5 FROM BaseFiles JOIN File USING (FileId) WHERE BaseFiles.JobId IN ($jobid) ) AS T JOIN Job USING (JobId) ORDER BY FilenameId, PathId, JobTDate DESC ) AS U GROUP BY PathId, FilenameId I don't think it will work, the documentation saids that if two records have the same FilenameId, PathId, the value for LStat, MD5, JobId and FileIndex will be a random one (which is not acceptable in our case). Thanks for your feeback and your help. Bye -- View this message in context: http://old.nabble.com/VirtualFull-mysql-query-blocks-other-jobs-for-a-long-time-tp28149748p28247276.html Sent from the Bacula - Users mailing list archive at Nabble.com. -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula 5.0.1 and db issues - please, share your experience
Hello Stephan, Thanks for your feeback, sometime, few users have performance problem due to bad settings and can give bad advise or the impression that nothing can be done whereas it works well on ten of thousand of silent users. In this case the performance problem is due to the presence of bad and useless indexes on the database. Just use the default schema, don't add anything, and it will work like a charm (proper my.cnf could also help of course). With those extra indexes, it was looking to work with 3.0.3, but not with 5.0.x. anymore. IMHO, MySQL (and probably PostgreSQL) try to use them for the new query and performances are bad (yes indexes aren't always the solution to speedup database performance). When I see sites like yours that run very big jobs in few minutes, and others that should wait days the difference has big chance to come from configuration mistake and extra tuning... In this kind of situation, the best way to avoid problems is asking for profesionnal help. In your case, if you want to wait only a couple of seconds (instead of minutes), you can think to switch on PostgreSQL, but it doesn't look like to be a problem for you :-) Anyway if you give only a couple of bytes to run sort and join operations (default settings) or you add bad indexes, performance will be bad. Thanks for using Bacula, and feel free to fill a testimonial on www.bacula.org, your setup looks to be very interesting! Bye Stephen Thompson wrote: Heya, This response isn't advice, just a statement about how 5.0.1 is working out for me in a mysql environment. I've read a lot of concerns out there and like you say, there are issues, but no magic bullet, so I too am trying to understand the situation so as not to create problems for myself now or down the road. My catalog... mysql-5.0.77 (64bit) MyISAM 210Gb in size 1,412,297,215 records in File table note: database built with bacula 2x scripts, upgraded with 3x scripts, then again with 5x scripts (i.e. nothing customized along the way) My OS hardware for bacula DIR+SD server... Centos 5.4 (fully patched) 8Gb RAM 2Gb Swap 1Tb EXT3 filesystem on external fiber RAID5 array (dedicated to database, incl. temp files) 2 dual-core [AMD Opteron(tm) Processor 2220] CPUs My experience... I was worried when I migrated to 5.x because I had heard of slow mysql issues, but building the most recent restore tree for a 1.23Tb 6,578,204-files FileSet takes just under 5 minutes. That response time seems reasonable and acceptable to me. Hope this info helps at least define what's possible -- would be nice to see more stats about the bacula community in general. Good luck! thanks, Stephen On 04/13/2010 05:42 AM, Koldo Santisteban wrote: Hello I am working with bacula 5.0.1. On first stage i setup the server with bacula 5.0.1 and Mysql, but, when i need to restore i have found that the bulid tree process take 10-12 hours (or more). I have read all about this issues and i can see that no exists any magic solution. In order to solve it, i have migrate from mysql to postgre, but i can see the same symtopms. Perhaps it works better, but, in my opnion, this is not serios on a production environment. If it´s possible, i will appreciate it people share their experience with bacula last version and this kind of issues. A couple of month ago i finished to deploy bacula on my environment, but now, i am considering to go back all. Please any comment regarding this case is welcome. Regards -- View this message in context: http://old.nabble.com/bacula-5.0.1-and-db-issues---please%2C-share-your-experience-tp28229717p28247718.html Sent from the Bacula - Users mailing list archive at Nabble.com. -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bconsole command for media info
Hi, In bacula-5.0.1 if I run the bconsole command: llist media pool=FullTapes I'll get the extended information for all tapes in the pool. Is there a command that will give me the same information bit only for tapes I request (like mediaid=4 or volumelabel=...)? Thanks -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula Full/Inc Questions (Noob)
1) When making a Full backup, does this replace the expired backup or will this create a new Volume on the drive? Depends on your pool configuration. In most setups it'll recycle an older volume that's outside its retention period. See the bacula documentation. I guess I am not sure if a Full backup will override the existing backup. Does a full backup override only retired backups? So does this mean I have to set the volume to expire in 3 months and schedule a full job in 3 months + 1 day? What I don't want is to have a second volume created because the drive is only 1TB and another full backup + existing incrementals will exceed the capacity. 2) Can you force the Full backup to expire on a weekend? Why would you want to? I want to force the job to run on weekends because I don't know if 6 hours will be enough to backup 400 GB, M-F. +-- |This was sent by ikkysle...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Using removable SATA disks as media
--- On Wed, 4/14/10, John Drescher dresche...@gmail.com wrote: OK, my next backup ran and it used the next volume. Success! However.. it appended. Here's what my volumes look like now: *list volumes Automatically selected Catalog: MyCatalog Using Catalog MyCatalog Pool: Default No results to list. Pool: File +-++---+-+---+--+--+-+--+---+---+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-++---+-+---+--+--+-+--+---+---+-+ | 25 | disk_0001 | Purged | 1 | 37,353,382 | 0 | 777,600 | 1 | 0 | 0 | File | 2010-04-08 23:10:03 | | 26 | disk_0002 | Purged | 1 | 5,125,873,046 | 1 | 777,600 | 1 | 0 | 0 | File | 2010-04-13 23:10:02 | | 27 | disk_0003 | Append | 1 | 7,009,019,184 | 1 | 777,600 | 1 | 0 | 0 | File | 2010-04-14 23:21:34 | | 28 | disk_0004 | Purged | 1 | 51,194,220 | 0 | 777,600 | 1 | 0 | 0 | File | 2010-04-07 23:21:59 | | 29 | disk_0005 | Purged | 1 | 10,436 | 0 | 777,600 | 1 | 0 | 0 | File | 2010-04-08 23:05:03 | | 30 | disk_0006 | Purged | 1 | 561 | 0 | 777,600 | 1 | 0 | 0 | File | 2010-04-08 23:07:14 | +-++---+-+---+--+--+-+--+---+---+-+ Pool: Scratch No results to list. * Whatever was on disk_0003 was left in place, and the new backup data appended to that volume. Is there a way to make it wipe the volume clean before writing? It should have done that. Are you sure you did not backup 7G of data? Perhaps I should let it run a few days to know for sure. I'll keep everyone posted. Thanks! -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Full/Inc Questions (Noob)
Your experience will vary, I am used to seeing 20 GB/hour with batch processing and compression turned on. Lots of small files - so heavy database usage on a store of about 750 GB. I'd suppose you would see your job done in 10 hours. On Wed, Apr 14, 2010 at 4:33 PM, ikkysleepy bacula-fo...@backupcentral.comwrote: I want to force the job to run on weekends because I don't know if 6 hours will be enough to backup 400 GB, M-F. -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Full/Inc Questions (Noob)
On 15/04/2010 7:33 AM, ikkysleepy wrote: 1) When making a Full backup, does this replace the expired backup or will this create a new Volume on the drive? Depends on your pool configuration. In most setups it'll recycle an older volume that's outside its retention period. See the bacula documentation. I guess I am not sure if a Full backup will override the existing backup. Does a full backup override only retired backups? So does this mean I have to set the volume to expire in 3 months and schedule a full job in 3 months + 1 day? What I don't want is to have a second volume created because the drive is only 1TB and another full backup + existing incrementals will exceed the capacity. Then you'll need a bigger disk. If you try to keep only one backup at a time, so that you have to delete it to update it, you cannot trust that backup. I promise you that if you ever do need the backup, you'll need it on Sunday morning just after Bacula has truncated it and started to overwrite it with next week's. That's why Bacula makes doing this rather difficult. It's a really, REALLY bad idea. At the very minimum you need *two* full backup volumes, so that one can be being written to while the other is safely stored. If you do not have enough space for that, you need to get more space. To give you some idea, my backup server has 6TB of usable storage - 8 1TB HDDs in RAID 6, plus two hot spares. So it has 6 / 10 TB usable. I have two servers which have a 1TB full backup file set, so I need more than least 4TB of space (2 backups each for 2 servers) for those two alone. If you really, really, really want to keep only one volume, you can find out how in the manual. But honestly, you're better off with even a RAID0 array (!!) on your backup server if that gives you room for two backup sets, rather than just trying to have one. Better again, buy two more disks and use RAID 5. If your file set is fairly static in nature - it's only added to, so there's not much churn in old files - you can instead take a single full backup manually, and then do daily incrementals thereafter, consolidating them into differentials say weekly. You never need to replace the full backup. However, this only works IF: - You don't generally delete files; and - *YOU TEST YOUR BACKUPS REGULARLY TO MAKE SURE THE FULL BACKUP VOLUME IS UNDAMAGED AND READABLE*. 2) Can you force the Full backup to expire on a weekend? Why would you want to? I want to force the job to run on weekends because I don't know if 6 hours will be enough to backup 400 GB, M-F. So you don't actually care exactly when the old backup(s) expire and certainly don't need them to do so on a weekend. You only need to schedule the backup so that it'll run on a weekend, and make sure the retention periods are set so that an old backup will expire on *or* *before* the weekend so it can be recycled when Bacula needs it. -- Craig Ringer -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restore all failure...
Hi all, Just did a test restore of a Centos client to my Solaris Bacula system, and this happened: 15-Apr 14:26 sercburp-sd JobId 929: Forward spacing Volume FJU602L4 to file:block 285:5973. 15-Apr 14:35 sercburp-fd JobId 929: Error: attribs.c:423 File size of restored file /tank/bacula-restores/var/log/messages not correct. Original 9742923, restored 9743033. 15-Apr 14:35 sercburp-dir JobId 929: Error: Bacula sercburp-dir 3.0.3 (18Oct09): 15-Apr-2010 14:35:04 Build OS: i386-pc-solaris2.10 solaris 5.10 JobId: 929 Job:RestoreFiles.2010-04-15_13.01.13_59 Restore Client: sercburp-fd Start time: 15-Apr-2010 13:01:15 End time: 15-Apr-2010 14:35:04 Files Expected: 1,962,127 Files Restored: 1,961,746 Bytes Restored: 216,943,466,338 Rate: 38540.3 KB/s FD Errors: 1 FD termination status: Error SD termination status: OK Termination:*** Restore Error *** I assume it's because of a stat() to get details and then read the file until EOF sort of situation, but how do I make a restore all (or just a plain restore) continue after an error like this? I can't spot or recall anything in the documentation. Cheers, GaryB-) -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
